Apr 12 15:55:06 user nova-compute[71874]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code.
Apr 12 15:55:09 user nova-compute[71874]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=71874) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Apr 12 15:55:09 user nova-compute[71874]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=71874) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Apr 12 15:55:09 user nova-compute[71874]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=71874) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Apr 12 15:55:09 user nova-compute[71874]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Apr 12 15:55:09 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 15:55:09 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.021s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 15:55:10 user nova-compute[71874]: INFO nova.virt.driver [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] Loading compute driver 'libvirt.LibvirtDriver'
Apr 12 15:55:10 user nova-compute[71874]: INFO nova.compute.provider_config [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] Acquiring lock "singleton_lock" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] Acquired lock "singleton_lock" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] Releasing lock "singleton_lock" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] Full set of CONF: {{(pid=71874) _wait_for_exit_or_signal /usr/local/lib/python3.10/dist-packages/oslo_service/service.py:362}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] ******************************************************************************** {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] Configuration options gathered from: {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] ================================================================================ {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] allow_resize_to_same_host      = True {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] arq_binding_timeout            = 300 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] backdoor_port                  = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] backdoor_socket                = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] block_device_allocate_retries  = 300 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] block_device_allocate_retries_interval = 5 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] cert                           = self.pem {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] compute_monitors               = [] {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] config_dir                     = [] {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] config_drive_format            = iso9660 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] config_source                  = [] {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] console_host                   = user {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] control_exchange               = nova {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] cpu_allocation_ratio           = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] daemon                         = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] debug                          = True {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] default_access_ip_network_name = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] default_availability_zone      = nova {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] default_ephemeral_format       = ext4 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] default_schedule_zone          = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] disk_allocation_ratio          = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] enable_new_services            = True {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] enabled_apis                   = ['osapi_compute'] {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] enabled_ssl_apis               = [] {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] flat_injected                  = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] force_config_drive             = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] force_raw_images               = True {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] graceful_shutdown_timeout      = 5 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] heal_instance_info_cache_interval = 60 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] host                           = user {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] instance_build_timeout         = 0 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] instance_delete_interval       = 300 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] instance_format                = [instance: %(uuid)s]  {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] instance_name_template         = instance-%08x {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] instance_usage_audit           = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] instance_usage_audit_period    = month {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] internal_service_availability_zone = internal {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] key                            = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] live_migration_retry_count     = 30 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] log_config_append              = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] log_dir                        = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] log_file                       = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] log_options                    = True {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] log_rotate_interval            = 1 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] log_rotate_interval_type       = days {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] log_rotation_type              = none {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] long_rpc_timeout               = 1800 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] max_concurrent_builds          = 10 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] max_concurrent_live_migrations = 1 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] max_concurrent_snapshots       = 5 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] max_local_block_devices        = 3 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] max_logfile_count              = 30 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] max_logfile_size_mb            = 200 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] maximum_instance_delete_attempts = 5 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] metadata_listen                = 0.0.0.0 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] metadata_listen_port           = 8775 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] metadata_workers               = 3 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] migrate_max_retries            = -1 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] mkisofs_cmd                    = genisoimage {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] my_ip                          = 10.0.0.210 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] network_allocate_retries       = 0 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] osapi_compute_listen_port      = 8774 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] osapi_compute_unique_server_name_scope =  {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] osapi_compute_workers          = 3 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] password_length                = 12 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] periodic_enable                = True {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] periodic_fuzzy_delay           = 60 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] pointer_model                  = ps2mouse {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] preallocate_images             = none {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] publish_errors                 = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] pybasedir                      = /opt/stack/nova {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] ram_allocation_ratio           = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] rate_limit_burst               = 0 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] rate_limit_except_level        = CRITICAL {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] rate_limit_interval            = 0 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] reboot_timeout                 = 0 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] reclaim_instance_interval      = 0 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] record                         = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] reimage_timeout_per_gb         = 20 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] report_interval                = 10 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] rescue_timeout                 = 0 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] reserved_host_cpus             = 0 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] reserved_host_disk_mb          = 0 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] reserved_host_memory_mb        = 512 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] reserved_huge_pages            = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] resize_confirm_window          = 0 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] resize_fs_using_block_device   = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] resume_guests_state_on_host_boot = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] rpc_response_timeout           = 60 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] run_external_periodic_tasks    = True {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] running_deleted_instance_action = reap {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] running_deleted_instance_poll_interval = 1800 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] running_deleted_instance_timeout = 0 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] scheduler_instance_sync_interval = 120 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] service_down_time              = 60 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] servicegroup_driver            = db {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] shelved_offload_time           = 0 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] shelved_poll_interval          = 3600 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] shutdown_timeout               = 0 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] source_is_ipv6                 = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] ssl_only                       = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] state_path                     = /opt/stack/data/nova {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] sync_power_state_interval      = 600 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] sync_power_state_pool_size     = 1000 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] syslog_log_facility            = LOG_USER {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] tempdir                        = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] timeout_nbd                    = 10 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] transport_url                  = **** {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] update_resources_interval      = 0 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] use_cow_images                 = True {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] use_eventlog                   = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] use_journal                    = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] use_json                       = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] use_rootwrap_daemon            = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] use_stderr                     = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] use_syslog                     = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] vcpu_pin_set                   = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] vif_plugging_is_fatal          = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] vif_plugging_timeout           = 0 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] virt_mkfs                      = [] {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] volume_usage_poll_interval     = 0 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] watch_log_file                 = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] web                            = /usr/share/spice-html5 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] oslo_concurrency.disable_process_locking = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] api.auth_strategy              = keystone {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] api.compute_link_prefix        = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] api.dhcp_domain                = novalocal {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] api.enable_instance_password   = True {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] api.glance_link_prefix         = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] api.instance_list_per_project_cells = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] api.list_records_by_skipping_down_cells = True {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] api.local_metadata_per_cell    = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] api.max_limit                  = 1000 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] api.metadata_cache_expiration  = 15 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] api.neutron_default_tenant_id  = default {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] api.use_forwarded_for          = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] api.use_neutron_default_nets   = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] api.vendordata_dynamic_targets = [] {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] api.vendordata_jsonfile_path   = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] cache.backend                  = dogpile.cache.memcached {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] cache.backend_argument         = **** {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] cache.config_prefix            = cache.oslo {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] cache.dead_timeout             = 60.0 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] cache.debug_cache_backend      = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] cache.enable_retry_client      = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] cache.enable_socket_keepalive  = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] cache.enabled                  = True {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] cache.expiration_time          = 600 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] cache.hashclient_retry_attempts = 2 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] cache.memcache_dead_retry      = 300 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] cache.memcache_password        =  {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] cache.memcache_pool_maxsize    = 10 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] cache.memcache_sasl_enabled    = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] cache.memcache_username        =  {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] cache.proxies                  = [] {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] cache.retry_attempts           = 2 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] cache.retry_delay              = 0.0 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] cache.socket_keepalive_count   = 1 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] cache.socket_keepalive_idle    = 1 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] cache.socket_keepalive_interval = 1 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] cache.tls_allowed_ciphers      = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] cache.tls_cafile               = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] cache.tls_certfile             = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] cache.tls_enabled              = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] cache.tls_keyfile              = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] cinder.auth_section            = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] cinder.auth_type               = password {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] cinder.cafile                  = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] cinder.certfile                = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] cinder.collect_timing          = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] cinder.cross_az_attach         = True {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] cinder.debug                   = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] cinder.endpoint_template       = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] cinder.http_retries            = 3 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] cinder.insecure                = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] cinder.keyfile                 = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] cinder.os_region_name          = RegionOne {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] cinder.split_loggers           = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] cinder.timeout                 = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] compute.cpu_dedicated_set      = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] compute.cpu_shared_set         = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] compute.image_type_exclude_list = [] {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] compute.max_concurrent_disk_ops = 0 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] compute.max_disk_devices_to_attach = -1 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] compute.resource_provider_association_refresh = 300 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] compute.shutdown_retry_interval = 10 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] conductor.workers              = 3 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] console.allowed_origins        = [] {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] console.ssl_ciphers            = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] console.ssl_minimum_version    = default {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] consoleauth.token_ttl          = 600 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] cyborg.cafile                  = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] cyborg.certfile                = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] cyborg.collect_timing          = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] cyborg.connect_retries         = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] cyborg.connect_retry_delay     = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] cyborg.endpoint_override       = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] cyborg.insecure                = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] cyborg.keyfile                 = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] cyborg.max_version             = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] cyborg.min_version             = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] cyborg.region_name             = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] cyborg.service_name            = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] cyborg.service_type            = accelerator {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] cyborg.split_loggers           = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] cyborg.status_code_retries     = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] cyborg.status_code_retry_delay = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] cyborg.timeout                 = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] cyborg.version                 = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] database.backend               = sqlalchemy {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] database.connection            = **** {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] database.connection_debug      = 0 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] database.connection_parameters =  {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] database.connection_recycle_time = 3600 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] database.connection_trace      = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] database.db_inc_retry_interval = True {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] database.db_max_retries        = 20 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] database.db_max_retry_interval = 10 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] database.db_retry_interval     = 1 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] database.max_overflow          = 50 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] database.max_pool_size         = 5 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] database.max_retries           = 10 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] database.mysql_enable_ndb      = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] database.mysql_wsrep_sync_wait = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] database.pool_timeout          = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] database.retry_interval        = 10 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] database.slave_connection      = **** {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] database.sqlite_synchronous    = True {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] api_database.backend           = sqlalchemy {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] api_database.connection        = **** {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] api_database.connection_debug  = 0 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] api_database.connection_parameters =  {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] api_database.connection_recycle_time = 3600 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] api_database.connection_trace  = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] api_database.db_inc_retry_interval = True {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] api_database.db_max_retries    = 20 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] api_database.db_max_retry_interval = 10 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] api_database.db_retry_interval = 1 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] api_database.max_overflow      = 50 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] api_database.max_pool_size     = 5 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] api_database.max_retries       = 10 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] api_database.mysql_enable_ndb  = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] api_database.pool_timeout      = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] api_database.retry_interval    = 10 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] api_database.slave_connection  = **** {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] api_database.sqlite_synchronous = True {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] devices.enabled_mdev_types     = [] {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] ephemeral_storage_encryption.enabled = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] glance.api_servers             = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] glance.cafile                  = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] glance.certfile                = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] glance.collect_timing          = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] glance.connect_retries         = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] glance.connect_retry_delay     = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] glance.debug                   = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] glance.default_trusted_certificate_ids = [] {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] glance.enable_certificate_validation = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] glance.enable_rbd_download     = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] glance.endpoint_override       = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] glance.insecure                = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] glance.keyfile                 = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] glance.max_version             = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] glance.min_version             = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] glance.num_retries             = 3 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] glance.rbd_ceph_conf           =  {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] glance.rbd_connect_timeout     = 5 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] glance.rbd_pool                =  {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] glance.rbd_user                =  {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] glance.region_name             = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] glance.service_name            = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] glance.service_type            = image {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] glance.split_loggers           = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] glance.status_code_retries     = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] glance.status_code_retry_delay = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] glance.timeout                 = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] glance.verify_glance_signatures = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] glance.version                 = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] guestfs.debug                  = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] hyperv.config_drive_cdrom      = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] hyperv.config_drive_inject_password = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] hyperv.enable_instance_metrics_collection = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] hyperv.enable_remotefx         = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] hyperv.instances_path_share    =  {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] hyperv.iscsi_initiator_list    = [] {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] hyperv.limit_cpu_features      = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] hyperv.power_state_check_timeframe = 60 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] hyperv.use_multipath_io        = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] hyperv.volume_attach_retry_count = 10 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] hyperv.vswitch_name            = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] mks.enabled                    = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] image_cache.manager_interval   = 2400 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] image_cache.precache_concurrency = 1 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] image_cache.remove_unused_base_images = True {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] image_cache.subdirectory_name  = _base {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] ironic.api_max_retries         = 60 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] ironic.api_retry_interval      = 2 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] ironic.auth_section            = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] ironic.auth_type               = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] ironic.cafile                  = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] ironic.certfile                = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] ironic.collect_timing          = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] ironic.connect_retries         = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] ironic.connect_retry_delay     = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] ironic.endpoint_override       = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] ironic.insecure                = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] ironic.keyfile                 = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] ironic.max_version             = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] ironic.min_version             = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] ironic.partition_key           = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] ironic.peer_list               = [] {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] ironic.region_name             = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] ironic.serial_console_state_timeout = 10 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] ironic.service_name            = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] ironic.service_type            = baremetal {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] ironic.split_loggers           = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] ironic.status_code_retries     = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] ironic.status_code_retry_delay = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] ironic.timeout                 = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] ironic.version                 = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] key_manager.fixed_key          = **** {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] barbican.barbican_api_version  = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] barbican.barbican_endpoint     = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] barbican.barbican_endpoint_type = public {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] barbican.barbican_region_name  = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] barbican.cafile                = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] barbican.certfile              = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] barbican.collect_timing        = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] barbican.insecure              = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] barbican.keyfile               = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] barbican.number_of_retries     = 60 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] barbican.retry_delay           = 1 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] barbican.send_service_user_token = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] barbican.split_loggers         = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] barbican.timeout               = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] barbican.verify_ssl            = True {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] barbican.verify_ssl_path       = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] barbican_service_user.auth_section = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] barbican_service_user.auth_type = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] barbican_service_user.cafile   = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] barbican_service_user.certfile = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] barbican_service_user.collect_timing = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] barbican_service_user.insecure = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] barbican_service_user.keyfile  = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] barbican_service_user.split_loggers = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] barbican_service_user.timeout  = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] vault.approle_role_id          = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] vault.approle_secret_id        = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] vault.cafile                   = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] vault.certfile                 = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] vault.collect_timing           = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] vault.insecure                 = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] vault.keyfile                  = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] vault.kv_mountpoint            = secret {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] vault.kv_version               = 2 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] vault.namespace                = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] vault.root_token_id            = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] vault.split_loggers            = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] vault.ssl_ca_crt_file          = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] vault.timeout                  = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] vault.use_ssl                  = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] keystone.cafile                = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] keystone.certfile              = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] keystone.collect_timing        = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] keystone.connect_retries       = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] keystone.connect_retry_delay   = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] keystone.endpoint_override     = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] keystone.insecure              = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] keystone.keyfile               = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] keystone.max_version           = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] keystone.min_version           = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] keystone.region_name           = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] keystone.service_name          = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] keystone.service_type          = identity {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] keystone.split_loggers         = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] keystone.status_code_retries   = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] keystone.status_code_retry_delay = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] keystone.timeout               = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] keystone.version               = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] libvirt.connection_uri         =  {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] libvirt.cpu_mode               = custom {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: WARNING oslo_config.cfg [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] libvirt.cpu_power_governor_high = performance {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] libvirt.cpu_power_governor_low = powersave {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] libvirt.cpu_power_management   = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] libvirt.device_detach_attempts = 8 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] libvirt.device_detach_timeout  = 20 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] libvirt.disk_cachemodes        = [] {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] libvirt.disk_prefix            = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] libvirt.enabled_perf_events    = [] {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] libvirt.file_backed_memory     = 0 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] libvirt.gid_maps               = [] {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] libvirt.hw_disk_discard        = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] libvirt.hw_machine_type        = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] libvirt.images_rbd_glance_store_name =  {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] libvirt.images_rbd_pool        = rbd {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] libvirt.images_type            = default {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] libvirt.images_volume_group    = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] libvirt.inject_key             = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] libvirt.inject_partition       = -2 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] libvirt.inject_password        = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] libvirt.iscsi_iface            = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] libvirt.iser_use_multipath     = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] libvirt.live_migration_bandwidth = 0 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] libvirt.live_migration_downtime = 500 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] libvirt.live_migration_inbound_addr = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] libvirt.live_migration_permit_post_copy = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] libvirt.live_migration_scheme  = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] libvirt.live_migration_timeout_action = abort {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] libvirt.live_migration_tunnelled = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: WARNING oslo_config.cfg [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Apr 12 15:55:10 user nova-compute[71874]: live_migration_uri is deprecated for removal in favor of two other options that
Apr 12 15:55:10 user nova-compute[71874]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Apr 12 15:55:10 user nova-compute[71874]: and ``live_migration_inbound_addr`` respectively.
Apr 12 15:55:10 user nova-compute[71874]: ).  Its value may be silently ignored in the future.
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] libvirt.live_migration_with_native_tls = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] libvirt.max_queues             = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] libvirt.nfs_mount_options      = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] libvirt.num_memory_encrypted_guests = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] libvirt.num_pcie_ports         = 0 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] libvirt.pmem_namespaces        = [] {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] libvirt.quobyte_client_cfg     = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] libvirt.rbd_secret_uuid        = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] libvirt.rbd_user               = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] libvirt.remote_filesystem_transport = ssh {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] libvirt.rescue_image_id        = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] libvirt.rescue_kernel_id       = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] libvirt.rescue_ramdisk_id      = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] libvirt.rx_queue_size          = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] libvirt.smbfs_mount_options    =  {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] libvirt.snapshot_compression   = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] libvirt.snapshot_image_format  = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] libvirt.sparse_logical_volumes = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] libvirt.swtpm_enabled          = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] libvirt.swtpm_group            = tss {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] libvirt.swtpm_user             = tss {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] libvirt.sysinfo_serial         = unique {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] libvirt.tx_queue_size          = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] libvirt.uid_maps               = [] {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] libvirt.use_virtio_for_bridges = True {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] libvirt.virt_type              = kvm {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] libvirt.volume_clear           = zero {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] libvirt.volume_clear_size      = 0 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] libvirt.volume_use_multipath   = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] libvirt.vzstorage_cache_path   = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] libvirt.vzstorage_mount_user   = stack {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] neutron.auth_section           = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] neutron.auth_type              = password {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] neutron.cafile                 = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] neutron.certfile               = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] neutron.collect_timing         = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] neutron.connect_retries        = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] neutron.connect_retry_delay    = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] neutron.default_floating_pool  = public {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] neutron.endpoint_override      = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] neutron.extension_sync_interval = 600 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] neutron.http_retries           = 3 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] neutron.insecure               = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] neutron.keyfile                = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] neutron.max_version            = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] neutron.min_version            = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] neutron.ovs_bridge             = br-int {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] neutron.physnets               = [] {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] neutron.region_name            = RegionOne {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] neutron.service_metadata_proxy = True {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] neutron.service_name           = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] neutron.service_type           = network {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] neutron.split_loggers          = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] neutron.status_code_retries    = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] neutron.status_code_retry_delay = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] neutron.timeout                = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] neutron.version                = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] notifications.bdms_in_notifications = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] notifications.default_level    = INFO {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] notifications.notification_format = unversioned {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] notifications.notify_on_state_change = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] pci.alias                      = [] {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] pci.device_spec                = [] {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] pci.report_in_placement        = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] placement.auth_section         = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] placement.auth_type            = password {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] placement.cafile               = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] placement.certfile             = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] placement.collect_timing       = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] placement.connect_retries      = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] placement.connect_retry_delay  = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] placement.default_domain_id    = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] placement.default_domain_name  = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] placement.domain_id            = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] placement.domain_name          = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] placement.endpoint_override    = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] placement.insecure             = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] placement.keyfile              = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] placement.max_version          = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] placement.min_version          = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] placement.password             = **** {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] placement.project_domain_id    = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] placement.project_domain_name  = Default {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] placement.project_id           = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] placement.project_name         = service {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] placement.region_name          = RegionOne {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] placement.service_name         = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] placement.service_type         = placement {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] placement.split_loggers        = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] placement.status_code_retries  = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] placement.status_code_retry_delay = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] placement.system_scope         = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] placement.timeout              = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] placement.trust_id             = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] placement.user_domain_id       = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] placement.user_domain_name     = Default {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] placement.user_id              = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] placement.username             = placement {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] placement.version              = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] quota.cores                    = 20 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] quota.count_usage_from_placement = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] quota.injected_file_content_bytes = 10240 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] quota.injected_file_path_length = 255 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] quota.injected_files           = 5 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] quota.instances                = 10 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] quota.key_pairs                = 100 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] quota.metadata_items           = 128 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] quota.ram                      = 51200 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] quota.recheck_quota            = True {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] quota.server_group_members     = 10 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] quota.server_groups            = 10 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] rdp.enabled                    = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] scheduler.image_metadata_prefilter = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] scheduler.max_attempts         = 3 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] scheduler.max_placement_results = 1000 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] scheduler.query_placement_for_availability_zone = True {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] scheduler.query_placement_for_image_type_support = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] scheduler.workers              = 3 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] filter_scheduler.host_subset_size = 1 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] filter_scheduler.isolated_hosts = [] {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] filter_scheduler.isolated_images = [] {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] filter_scheduler.pci_in_placement = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] filter_scheduler.track_instance_changes = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] metrics.required               = True {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] metrics.weight_multiplier      = 1.0 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] metrics.weight_setting         = [] {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] serial_console.enabled         = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] serial_console.port_range      = 10000:20000 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] serial_console.serialproxy_port = 6083 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] service_user.auth_section      = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] service_user.auth_type         = password {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] service_user.cafile            = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] service_user.certfile          = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] service_user.collect_timing    = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] service_user.insecure          = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] service_user.keyfile           = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] service_user.send_service_user_token = True {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] service_user.split_loggers     = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] service_user.timeout           = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] spice.agent_enabled            = True {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] spice.enabled                  = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] spice.html5proxy_port          = 6082 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] spice.image_compression        = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] spice.jpeg_compression         = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] spice.playback_compression     = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] spice.server_listen            = 127.0.0.1 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] spice.streaming_mode           = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] spice.zlib_compression         = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] upgrade_levels.baseapi         = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] upgrade_levels.cert            = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] upgrade_levels.compute         = auto {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] upgrade_levels.conductor       = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] upgrade_levels.scheduler       = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] vendordata_dynamic_auth.auth_section = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] vendordata_dynamic_auth.auth_type = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] vendordata_dynamic_auth.cafile = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] vendordata_dynamic_auth.certfile = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] vendordata_dynamic_auth.insecure = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] vendordata_dynamic_auth.keyfile = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] vendordata_dynamic_auth.timeout = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] vmware.api_retry_count         = 10 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] vmware.ca_file                 = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] vmware.cache_prefix            = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] vmware.cluster_name            = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] vmware.connection_pool_size    = 10 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] vmware.console_delay_seconds   = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] vmware.datastore_regex         = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] vmware.host_ip                 = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] vmware.host_password           = **** {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] vmware.host_port               = 443 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] vmware.host_username           = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] vmware.insecure                = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] vmware.integration_bridge      = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] vmware.maximum_objects         = 100 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] vmware.pbm_default_policy      = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] vmware.pbm_enabled             = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] vmware.pbm_wsdl_location       = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] vmware.serial_port_proxy_uri   = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] vmware.serial_port_service_uri = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] vmware.task_poll_interval      = 0.5 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] vmware.use_linked_clone        = True {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] vmware.vnc_keymap              = en-us {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] vmware.vnc_port                = 5900 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] vmware.vnc_port_total          = 10000 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] vnc.auth_schemes               = ['none'] {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] vnc.enabled                    = True {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] vnc.novncproxy_port            = 6080 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] vnc.server_listen              = 0.0.0.0 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] vnc.vencrypt_ca_certs          = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] vnc.vencrypt_client_cert       = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] vnc.vencrypt_client_key        = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] workarounds.disable_rootwrap   = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] workarounds.enable_numa_live_migration = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] workarounds.libvirt_disable_apic = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] wsgi.client_socket_timeout     = 900 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] wsgi.default_pool_size         = 1000 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] wsgi.keep_alive                = True {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] wsgi.max_header_line           = 16384 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] wsgi.ssl_ca_file               = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] wsgi.ssl_cert_file             = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] wsgi.ssl_key_file              = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] wsgi.tcp_keepidle              = 600 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] zvm.ca_file                    = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] zvm.cloud_connector_url        = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] zvm.reachable_timeout          = 300 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] oslo_policy.enforce_new_defaults = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] oslo_policy.enforce_scope      = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] oslo_policy.policy_default_rule = default {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] oslo_policy.policy_file        = policy.yaml {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] profiler.connection_string     = messaging:// {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] profiler.enabled               = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] profiler.es_doc_type           = notification {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] profiler.es_scroll_size        = 10000 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] profiler.es_scroll_time        = 2m {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] profiler.filter_error_trace    = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] profiler.hmac_keys             = SECRET_KEY {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] profiler.sentinel_service_name = mymaster {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] profiler.socket_timeout        = 0.1 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] profiler.trace_sqlalchemy      = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] remote_debug.host              = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] remote_debug.port              = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] oslo_messaging_rabbit.ssl      = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] oslo_messaging_notifications.retry = -1 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] oslo_messaging_notifications.transport_url = **** {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] oslo_limit.auth_section        = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] oslo_limit.auth_type           = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] oslo_limit.cafile              = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] oslo_limit.certfile            = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] oslo_limit.collect_timing      = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] oslo_limit.connect_retries     = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] oslo_limit.connect_retry_delay = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] oslo_limit.endpoint_id         = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] oslo_limit.endpoint_override   = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] oslo_limit.insecure            = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] oslo_limit.keyfile             = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] oslo_limit.max_version         = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] oslo_limit.min_version         = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] oslo_limit.region_name         = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] oslo_limit.service_name        = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] oslo_limit.service_type        = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] oslo_limit.split_loggers       = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] oslo_limit.status_code_retries = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] oslo_limit.status_code_retry_delay = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] oslo_limit.timeout             = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] oslo_limit.valid_interfaces    = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] oslo_limit.version             = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] oslo_reports.file_event_handler = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] oslo_reports.log_dir           = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] vif_plug_ovs_privileged.group  = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] vif_plug_ovs_privileged.user   = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] os_vif_linux_bridge.flat_interface = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] os_vif_ovs.isolate_vif         = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] os_vif_ovs.per_port_bridge     = False {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] os_brick.lock_path             = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] privsep_osbrick.capabilities   = [21] {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] privsep_osbrick.group          = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] privsep_osbrick.helper_command = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] privsep_osbrick.user           = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] nova_sys_admin.group           = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] nova_sys_admin.helper_command  = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] nova_sys_admin.user            = None {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG oslo_service.service [None req-161b1af6-e0a7-4acb-b6b8-5fef106ab5a9 None None] ******************************************************************************** {{(pid=71874) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}}
Apr 12 15:55:10 user nova-compute[71874]: INFO nova.service [-] Starting compute node (version 0.0.0)
Apr 12 15:55:10 user nova-compute[71874]: DEBUG nova.virt.libvirt.host [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Starting native event thread {{(pid=71874) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG nova.virt.libvirt.host [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Starting green dispatch thread {{(pid=71874) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG nova.virt.libvirt.host [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Starting connection event dispatch thread {{(pid=71874) initialize /opt/stack/nova/nova/virt/libvirt/host.py:620}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG nova.virt.libvirt.host [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Connecting to libvirt: qemu:///system {{(pid=71874) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG nova.virt.libvirt.host [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7fc3d04be6b0> {{(pid=71874) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:509}}
Apr 12 15:55:10 user nova-compute[71874]: DEBUG nova.virt.libvirt.host [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7fc3d04be6b0> {{(pid=71874) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:530}}
Apr 12 15:55:10 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Connection event '1' reason 'None'
Apr 12 15:55:10 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Apr 12 15:55:10 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.mount [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Initialising _HostMountState generation 0 {{(pid=71874) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Apr 12 15:55:17 user nova-compute[71874]: INFO nova.virt.libvirt.host [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Libvirt host capabilities <capabilities>
Apr 12 15:55:17 user nova-compute[71874]:   <host>
Apr 12 15:55:17 user nova-compute[71874]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Apr 12 15:55:17 user nova-compute[71874]:     <cpu>
Apr 12 15:55:17 user nova-compute[71874]:       <arch>x86_64</arch>
Apr 12 15:55:17 user nova-compute[71874]:       <model>IvyBridge-IBRS</model>
Apr 12 15:55:17 user nova-compute[71874]:       <vendor>Intel</vendor>
Apr 12 15:55:17 user nova-compute[71874]:       <microcode version='1070'/>
Apr 12 15:55:17 user nova-compute[71874]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Apr 12 15:55:17 user nova-compute[71874]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Apr 12 15:55:17 user nova-compute[71874]:       <feature name='ss'/>
Apr 12 15:55:17 user nova-compute[71874]:       <feature name='vmx'/>
Apr 12 15:55:17 user nova-compute[71874]:       <feature name='pcid'/>
Apr 12 15:55:17 user nova-compute[71874]:       <feature name='osxsave'/>
Apr 12 15:55:17 user nova-compute[71874]:       <feature name='hypervisor'/>
Apr 12 15:55:17 user nova-compute[71874]:       <feature name='arat'/>
Apr 12 15:55:17 user nova-compute[71874]:       <feature name='tsc_adjust'/>
Apr 12 15:55:17 user nova-compute[71874]:       <feature name='md-clear'/>
Apr 12 15:55:17 user nova-compute[71874]:       <feature name='stibp'/>
Apr 12 15:55:17 user nova-compute[71874]:       <feature name='arch-capabilities'/>
Apr 12 15:55:17 user nova-compute[71874]:       <feature name='ssbd'/>
Apr 12 15:55:17 user nova-compute[71874]:       <feature name='invtsc'/>
Apr 12 15:55:17 user nova-compute[71874]:       <feature name='rsba'/>
Apr 12 15:55:17 user nova-compute[71874]:       <feature name='skip-l1dfl-vmentry'/>
Apr 12 15:55:17 user nova-compute[71874]:       <pages unit='KiB' size='4'/>
Apr 12 15:55:17 user nova-compute[71874]:       <pages unit='KiB' size='2048'/>
Apr 12 15:55:17 user nova-compute[71874]:     </cpu>
Apr 12 15:55:17 user nova-compute[71874]:     <power_management>
Apr 12 15:55:17 user nova-compute[71874]:       <suspend_mem/>
Apr 12 15:55:17 user nova-compute[71874]:       <suspend_disk/>
Apr 12 15:55:17 user nova-compute[71874]:       <suspend_hybrid/>
Apr 12 15:55:17 user nova-compute[71874]:     </power_management>
Apr 12 15:55:17 user nova-compute[71874]:     <iommu support='no'/>
Apr 12 15:55:17 user nova-compute[71874]:     <migration_features>
Apr 12 15:55:17 user nova-compute[71874]:       <live/>
Apr 12 15:55:17 user nova-compute[71874]:       <uri_transports>
Apr 12 15:55:17 user nova-compute[71874]:         <uri_transport>tcp</uri_transport>
Apr 12 15:55:17 user nova-compute[71874]:         <uri_transport>rdma</uri_transport>
Apr 12 15:55:17 user nova-compute[71874]:       </uri_transports>
Apr 12 15:55:17 user nova-compute[71874]:     </migration_features>
Apr 12 15:55:17 user nova-compute[71874]:     <topology>
Apr 12 15:55:17 user nova-compute[71874]:       <cells num='2'>
Apr 12 15:55:17 user nova-compute[71874]:         <cell id='0'>
Apr 12 15:55:17 user nova-compute[71874]:           <memory unit='KiB'>8189224</memory>
Apr 12 15:55:17 user nova-compute[71874]:           <pages unit='KiB' size='4'>2047306</pages>
Apr 12 15:55:17 user nova-compute[71874]:           <pages unit='KiB' size='2048'>0</pages>
Apr 12 15:55:17 user nova-compute[71874]:           <distances>
Apr 12 15:55:17 user nova-compute[71874]:             <sibling id='0' value='10'/>
Apr 12 15:55:17 user nova-compute[71874]:             <sibling id='1' value='20'/>
Apr 12 15:55:17 user nova-compute[71874]:           </distances>
Apr 12 15:55:17 user nova-compute[71874]:           <cpus num='6'>
Apr 12 15:55:17 user nova-compute[71874]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Apr 12 15:55:17 user nova-compute[71874]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Apr 12 15:55:17 user nova-compute[71874]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Apr 12 15:55:17 user nova-compute[71874]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Apr 12 15:55:17 user nova-compute[71874]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Apr 12 15:55:17 user nova-compute[71874]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Apr 12 15:55:17 user nova-compute[71874]:           </cpus>
Apr 12 15:55:17 user nova-compute[71874]:         </cell>
Apr 12 15:55:17 user nova-compute[71874]:         <cell id='1'>
Apr 12 15:55:17 user nova-compute[71874]:           <memory unit='KiB'>8218764</memory>
Apr 12 15:55:17 user nova-compute[71874]:           <pages unit='KiB' size='4'>2054691</pages>
Apr 12 15:55:17 user nova-compute[71874]:           <pages unit='KiB' size='2048'>0</pages>
Apr 12 15:55:17 user nova-compute[71874]:           <distances>
Apr 12 15:55:17 user nova-compute[71874]:             <sibling id='0' value='20'/>
Apr 12 15:55:17 user nova-compute[71874]:             <sibling id='1' value='10'/>
Apr 12 15:55:17 user nova-compute[71874]:           </distances>
Apr 12 15:55:17 user nova-compute[71874]:           <cpus num='6'>
Apr 12 15:55:17 user nova-compute[71874]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Apr 12 15:55:17 user nova-compute[71874]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Apr 12 15:55:17 user nova-compute[71874]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Apr 12 15:55:17 user nova-compute[71874]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Apr 12 15:55:17 user nova-compute[71874]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Apr 12 15:55:17 user nova-compute[71874]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Apr 12 15:55:17 user nova-compute[71874]:           </cpus>
Apr 12 15:55:17 user nova-compute[71874]:         </cell>
Apr 12 15:55:17 user nova-compute[71874]:       </cells>
Apr 12 15:55:17 user nova-compute[71874]:     </topology>
Apr 12 15:55:17 user nova-compute[71874]:     <cache>
Apr 12 15:55:17 user nova-compute[71874]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Apr 12 15:55:17 user nova-compute[71874]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Apr 12 15:55:17 user nova-compute[71874]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Apr 12 15:55:17 user nova-compute[71874]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Apr 12 15:55:17 user nova-compute[71874]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Apr 12 15:55:17 user nova-compute[71874]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Apr 12 15:55:17 user nova-compute[71874]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Apr 12 15:55:17 user nova-compute[71874]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Apr 12 15:55:17 user nova-compute[71874]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Apr 12 15:55:17 user nova-compute[71874]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Apr 12 15:55:17 user nova-compute[71874]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Apr 12 15:55:17 user nova-compute[71874]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Apr 12 15:55:17 user nova-compute[71874]:     </cache>
Apr 12 15:55:17 user nova-compute[71874]:     <secmodel>
Apr 12 15:55:17 user nova-compute[71874]:       <model>apparmor</model>
Apr 12 15:55:17 user nova-compute[71874]:       <doi>0</doi>
Apr 12 15:55:17 user nova-compute[71874]:     </secmodel>
Apr 12 15:55:17 user nova-compute[71874]:     <secmodel>
Apr 12 15:55:18 user nova-compute[71874]:       <model>dac</model>
Apr 12 15:55:18 user nova-compute[71874]:       <doi>0</doi>
Apr 12 15:55:18 user nova-compute[71874]:       <baselabel type='kvm'>+64055:+108</baselabel>
Apr 12 15:55:18 user nova-compute[71874]:       <baselabel type='qemu'>+64055:+108</baselabel>
Apr 12 15:55:18 user nova-compute[71874]:     </secmodel>
Apr 12 15:55:18 user nova-compute[71874]:   </host>
Apr 12 15:55:18 user nova-compute[71874]:   <guest>
Apr 12 15:55:18 user nova-compute[71874]:     <os_type>hvm</os_type>
Apr 12 15:55:18 user nova-compute[71874]:     <arch name='alpha'>
Apr 12 15:55:18 user nova-compute[71874]:       <wordsize>64</wordsize>
Apr 12 15:55:18 user nova-compute[71874]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='4'>clipper</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <domain type='qemu'/>
Apr 12 15:55:18 user nova-compute[71874]:     </arch>
Apr 12 15:55:18 user nova-compute[71874]:     <features>
Apr 12 15:55:18 user nova-compute[71874]:       <cpuselection/>
Apr 12 15:55:18 user nova-compute[71874]:       <deviceboot/>
Apr 12 15:55:18 user nova-compute[71874]:       <disksnapshot default='on' toggle='no'/>
Apr 12 15:55:18 user nova-compute[71874]:     </features>
Apr 12 15:55:18 user nova-compute[71874]:   </guest>
Apr 12 15:55:18 user nova-compute[71874]:   <guest>
Apr 12 15:55:18 user nova-compute[71874]:     <os_type>hvm</os_type>
Apr 12 15:55:18 user nova-compute[71874]:     <arch name='armv6l'>
Apr 12 15:55:18 user nova-compute[71874]:       <wordsize>32</wordsize>
Apr 12 15:55:18 user nova-compute[71874]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>integratorcp</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='2'>ast2600-evb</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>borzoi</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>spitz</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='255'>virt-2.7</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='2'>nuri</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>romulus-bmc</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='512'>virt-3.0</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='512'>virt-5.0</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='2'>npcm750-evb</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='255'>virt-2.10</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='2'>rainier-bmc</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>mps3-an547</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='2'>musca-b1</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>versatileab</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>kzm</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='255'>virt-2.8</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='2'>musca-a</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='512'>virt-3.1</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='512'>virt-5.1</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='2'>smdkc210</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>sx1</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='255'>virt-2.11</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>imx25-pdk</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='255'>virt-2.9</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='4'>orangepi-pc</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>z2</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='512'>virt-5.2</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>tosa</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>mps2-an500</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='255'>virt-2.12</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='2'>mps2-an521</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='4'>sabrelite</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>mps2-an511</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>canon-a1100</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>realview-eb</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>emcraft-sf2</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>realview-pb-a8</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='512'>virt-4.0</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>raspi1ap</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>palmetto-bmc</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>sx1-v1</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>n810</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>g220a-bmc</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>n800</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='2'>tacoma-bmc</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='512'>virt-4.1</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='2'>quanta-gsj</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>versatilepb</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>terrier</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>mainstone</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='512'>virt-4.2</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='2'>mps3-an524</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='2'>kudo-bmc</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='4'>vexpress-a9</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='4'>midway</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>musicpal</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>lm3s811evb</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>lm3s6965evb</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>microbit</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>mps2-an505</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>mps2-an385</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='512'>virt-6.0</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>cubieboard</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>verdex</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>netduino2</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>mps2-an386</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='512'>virt-6.1</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='4'>raspi2b</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='4'>vexpress-a15</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='2'>fuji-bmc</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='512'>virt-6.2</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>cheetah</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='255'>virt-2.6</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>ast2500-evb</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='4'>highbank</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>akita</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>connex</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>netduinoplus2</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>collie</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>raspi0</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <domain type='qemu'/>
Apr 12 15:55:18 user nova-compute[71874]:     </arch>
Apr 12 15:55:18 user nova-compute[71874]:     <features>
Apr 12 15:55:18 user nova-compute[71874]:       <cpuselection/>
Apr 12 15:55:18 user nova-compute[71874]:       <deviceboot/>
Apr 12 15:55:18 user nova-compute[71874]:       <disksnapshot default='on' toggle='no'/>
Apr 12 15:55:18 user nova-compute[71874]:     </features>
Apr 12 15:55:18 user nova-compute[71874]:   </guest>
Apr 12 15:55:18 user nova-compute[71874]:   <guest>
Apr 12 15:55:18 user nova-compute[71874]:     <os_type>hvm</os_type>
Apr 12 15:55:18 user nova-compute[71874]:     <arch name='armv7l'>
Apr 12 15:55:18 user nova-compute[71874]:       <wordsize>32</wordsize>
Apr 12 15:55:18 user nova-compute[71874]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>integratorcp</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='2'>ast2600-evb</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>borzoi</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>spitz</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='255'>virt-2.7</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='2'>nuri</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>romulus-bmc</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='512'>virt-3.0</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='512'>virt-5.0</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='2'>npcm750-evb</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='255'>virt-2.10</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='2'>rainier-bmc</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>mps3-an547</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='2'>musca-b1</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>versatileab</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>kzm</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='255'>virt-2.8</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='2'>musca-a</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='512'>virt-3.1</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='512'>virt-5.1</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='2'>smdkc210</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>sx1</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='255'>virt-2.11</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>imx25-pdk</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='255'>virt-2.9</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='4'>orangepi-pc</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>z2</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='512'>virt-5.2</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>tosa</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>mps2-an500</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='255'>virt-2.12</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='2'>mps2-an521</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='4'>sabrelite</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>mps2-an511</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>canon-a1100</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>realview-eb</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>emcraft-sf2</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>realview-pb-a8</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='512'>virt-4.0</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>raspi1ap</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>palmetto-bmc</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>sx1-v1</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>n810</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>g220a-bmc</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>n800</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='2'>tacoma-bmc</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='512'>virt-4.1</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='2'>quanta-gsj</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>versatilepb</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>terrier</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>mainstone</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='512'>virt-4.2</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='2'>mps3-an524</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='2'>kudo-bmc</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='4'>vexpress-a9</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='4'>midway</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>musicpal</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>lm3s811evb</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>lm3s6965evb</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>microbit</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>mps2-an505</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>mps2-an385</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='512'>virt-6.0</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>cubieboard</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>verdex</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>netduino2</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>mps2-an386</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='512'>virt-6.1</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='4'>raspi2b</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='4'>vexpress-a15</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='2'>fuji-bmc</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='512'>virt-6.2</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>cheetah</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='255'>virt-2.6</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>ast2500-evb</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='4'>highbank</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>akita</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>connex</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>netduinoplus2</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>collie</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>raspi0</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <domain type='qemu'/>
Apr 12 15:55:18 user nova-compute[71874]:     </arch>
Apr 12 15:55:18 user nova-compute[71874]:     <features>
Apr 12 15:55:18 user nova-compute[71874]:       <cpuselection/>
Apr 12 15:55:18 user nova-compute[71874]:       <deviceboot/>
Apr 12 15:55:18 user nova-compute[71874]:       <disksnapshot default='on' toggle='no'/>
Apr 12 15:55:18 user nova-compute[71874]:     </features>
Apr 12 15:55:18 user nova-compute[71874]:   </guest>
Apr 12 15:55:18 user nova-compute[71874]:   <guest>
Apr 12 15:55:18 user nova-compute[71874]:     <os_type>hvm</os_type>
Apr 12 15:55:18 user nova-compute[71874]:     <arch name='aarch64'>
Apr 12 15:55:18 user nova-compute[71874]:       <wordsize>64</wordsize>
Apr 12 15:55:18 user nova-compute[71874]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>integratorcp</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='2'>ast2600-evb</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>borzoi</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>spitz</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='255'>virt-2.7</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='2'>nuri</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>romulus-bmc</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='512'>virt-3.0</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='512'>virt-5.0</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='2'>npcm750-evb</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='255'>virt-2.10</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='2'>rainier-bmc</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>mps3-an547</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='255'>virt-2.8</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='2'>musca-b1</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>versatileab</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>kzm</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='2'>musca-a</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='512'>virt-3.1</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='512'>virt-5.1</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='2'>smdkc210</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>sx1</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='255'>virt-2.11</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>imx25-pdk</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='255'>virt-2.9</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='4'>orangepi-pc</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>z2</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='512'>virt-5.2</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>tosa</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>mps2-an500</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='255'>virt-2.12</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='2'>mps2-an521</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='4'>sabrelite</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>mps2-an511</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>canon-a1100</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>realview-eb</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>emcraft-sf2</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>realview-pb-a8</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='512'>sbsa-ref</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='512'>virt-4.0</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>raspi1ap</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>palmetto-bmc</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>sx1-v1</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>n810</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>g220a-bmc</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>n800</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='2'>tacoma-bmc</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='512'>virt-4.1</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='2'>quanta-gsj</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>versatilepb</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>terrier</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>mainstone</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='512'>virt-4.2</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='2'>mps3-an524</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='2'>kudo-bmc</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='4'>vexpress-a9</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='4'>midway</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>musicpal</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>lm3s811evb</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>lm3s6965evb</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>microbit</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>mps2-an505</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>mps2-an385</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='512'>virt-6.0</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='4'>raspi3ap</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>cubieboard</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>verdex</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>netduino2</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>mps2-an386</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='512'>virt-6.1</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='4'>raspi3b</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='4'>raspi2b</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='4'>vexpress-a15</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='2'>fuji-bmc</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='512'>virt-6.2</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>cheetah</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='255'>virt-2.6</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>ast2500-evb</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='4'>highbank</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>akita</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>connex</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>netduinoplus2</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>collie</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>raspi0</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <domain type='qemu'/>
Apr 12 15:55:18 user nova-compute[71874]:     </arch>
Apr 12 15:55:18 user nova-compute[71874]:     <features>
Apr 12 15:55:18 user nova-compute[71874]:       <acpi default='on' toggle='yes'/>
Apr 12 15:55:18 user nova-compute[71874]:       <cpuselection/>
Apr 12 15:55:18 user nova-compute[71874]:       <deviceboot/>
Apr 12 15:55:18 user nova-compute[71874]:       <disksnapshot default='on' toggle='no'/>
Apr 12 15:55:18 user nova-compute[71874]:     </features>
Apr 12 15:55:18 user nova-compute[71874]:   </guest>
Apr 12 15:55:18 user nova-compute[71874]:   <guest>
Apr 12 15:55:18 user nova-compute[71874]:     <os_type>hvm</os_type>
Apr 12 15:55:18 user nova-compute[71874]:     <arch name='cris'>
Apr 12 15:55:18 user nova-compute[71874]:       <wordsize>32</wordsize>
Apr 12 15:55:18 user nova-compute[71874]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>axis-dev88</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <domain type='qemu'/>
Apr 12 15:55:18 user nova-compute[71874]:     </arch>
Apr 12 15:55:18 user nova-compute[71874]:     <features>
Apr 12 15:55:18 user nova-compute[71874]:       <cpuselection/>
Apr 12 15:55:18 user nova-compute[71874]:       <deviceboot/>
Apr 12 15:55:18 user nova-compute[71874]:       <disksnapshot default='on' toggle='no'/>
Apr 12 15:55:18 user nova-compute[71874]:     </features>
Apr 12 15:55:18 user nova-compute[71874]:   </guest>
Apr 12 15:55:18 user nova-compute[71874]:   <guest>
Apr 12 15:55:18 user nova-compute[71874]:     <os_type>hvm</os_type>
Apr 12 15:55:18 user nova-compute[71874]:     <arch name='i686'>
Apr 12 15:55:18 user nova-compute[71874]:       <wordsize>32</wordsize>
Apr 12 15:55:18 user nova-compute[71874]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='288'>pc-q35-artful</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>x-remote</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>isapc</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='288'>pc-q35-disco</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='288'>pc-q35-impish</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='288'>pc-q35-focal</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='288'>microvm</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <domain type='qemu'/>
Apr 12 15:55:18 user nova-compute[71874]:       <domain type='kvm'/>
Apr 12 15:55:18 user nova-compute[71874]:     </arch>
Apr 12 15:55:18 user nova-compute[71874]:     <features>
Apr 12 15:55:18 user nova-compute[71874]:       <pae/>
Apr 12 15:55:18 user nova-compute[71874]:       <nonpae/>
Apr 12 15:55:18 user nova-compute[71874]:       <acpi default='on' toggle='yes'/>
Apr 12 15:55:18 user nova-compute[71874]:       <apic default='on' toggle='no'/>
Apr 12 15:55:18 user nova-compute[71874]:       <cpuselection/>
Apr 12 15:55:18 user nova-compute[71874]:       <deviceboot/>
Apr 12 15:55:18 user nova-compute[71874]:       <disksnapshot default='on' toggle='no'/>
Apr 12 15:55:18 user nova-compute[71874]:     </features>
Apr 12 15:55:18 user nova-compute[71874]:   </guest>
Apr 12 15:55:18 user nova-compute[71874]:   <guest>
Apr 12 15:55:18 user nova-compute[71874]:     <os_type>hvm</os_type>
Apr 12 15:55:18 user nova-compute[71874]:     <arch name='m68k'>
Apr 12 15:55:18 user nova-compute[71874]:       <wordsize>32</wordsize>
Apr 12 15:55:18 user nova-compute[71874]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>mcf5208evb</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>an5206</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>virt-6.0</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>q800</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>virt-6.2</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>next-cube</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>virt-6.1</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <domain type='qemu'/>
Apr 12 15:55:18 user nova-compute[71874]:     </arch>
Apr 12 15:55:18 user nova-compute[71874]:     <features>
Apr 12 15:55:18 user nova-compute[71874]:       <cpuselection/>
Apr 12 15:55:18 user nova-compute[71874]:       <deviceboot/>
Apr 12 15:55:18 user nova-compute[71874]:       <disksnapshot default='on' toggle='no'/>
Apr 12 15:55:18 user nova-compute[71874]:     </features>
Apr 12 15:55:18 user nova-compute[71874]:   </guest>
Apr 12 15:55:18 user nova-compute[71874]:   <guest>
Apr 12 15:55:18 user nova-compute[71874]:     <os_type>hvm</os_type>
Apr 12 15:55:18 user nova-compute[71874]:     <arch name='microblaze'>
Apr 12 15:55:18 user nova-compute[71874]:       <wordsize>32</wordsize>
Apr 12 15:55:18 user nova-compute[71874]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>petalogix-ml605</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <domain type='qemu'/>
Apr 12 15:55:18 user nova-compute[71874]:     </arch>
Apr 12 15:55:18 user nova-compute[71874]:     <features>
Apr 12 15:55:18 user nova-compute[71874]:       <cpuselection/>
Apr 12 15:55:18 user nova-compute[71874]:       <deviceboot/>
Apr 12 15:55:18 user nova-compute[71874]:       <disksnapshot default='on' toggle='no'/>
Apr 12 15:55:18 user nova-compute[71874]:     </features>
Apr 12 15:55:18 user nova-compute[71874]:   </guest>
Apr 12 15:55:18 user nova-compute[71874]:   <guest>
Apr 12 15:55:18 user nova-compute[71874]:     <os_type>hvm</os_type>
Apr 12 15:55:18 user nova-compute[71874]:     <arch name='microblazeel'>
Apr 12 15:55:18 user nova-compute[71874]:       <wordsize>32</wordsize>
Apr 12 15:55:18 user nova-compute[71874]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>petalogix-ml605</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <domain type='qemu'/>
Apr 12 15:55:18 user nova-compute[71874]:     </arch>
Apr 12 15:55:18 user nova-compute[71874]:     <features>
Apr 12 15:55:18 user nova-compute[71874]:       <cpuselection/>
Apr 12 15:55:18 user nova-compute[71874]:       <deviceboot/>
Apr 12 15:55:18 user nova-compute[71874]:       <disksnapshot default='on' toggle='no'/>
Apr 12 15:55:18 user nova-compute[71874]:     </features>
Apr 12 15:55:18 user nova-compute[71874]:   </guest>
Apr 12 15:55:18 user nova-compute[71874]:   <guest>
Apr 12 15:55:18 user nova-compute[71874]:     <os_type>hvm</os_type>
Apr 12 15:55:18 user nova-compute[71874]:     <arch name='mips'>
Apr 12 15:55:18 user nova-compute[71874]:       <wordsize>32</wordsize>
Apr 12 15:55:18 user nova-compute[71874]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='16'>malta</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>mipssim</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <domain type='qemu'/>
Apr 12 15:55:18 user nova-compute[71874]:     </arch>
Apr 12 15:55:18 user nova-compute[71874]:     <features>
Apr 12 15:55:18 user nova-compute[71874]:       <cpuselection/>
Apr 12 15:55:18 user nova-compute[71874]:       <deviceboot/>
Apr 12 15:55:18 user nova-compute[71874]:       <disksnapshot default='on' toggle='no'/>
Apr 12 15:55:18 user nova-compute[71874]:     </features>
Apr 12 15:55:18 user nova-compute[71874]:   </guest>
Apr 12 15:55:18 user nova-compute[71874]:   <guest>
Apr 12 15:55:18 user nova-compute[71874]:     <os_type>hvm</os_type>
Apr 12 15:55:18 user nova-compute[71874]:     <arch name='mipsel'>
Apr 12 15:55:18 user nova-compute[71874]:       <wordsize>32</wordsize>
Apr 12 15:55:18 user nova-compute[71874]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='16'>malta</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>mipssim</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <domain type='qemu'/>
Apr 12 15:55:18 user nova-compute[71874]:     </arch>
Apr 12 15:55:18 user nova-compute[71874]:     <features>
Apr 12 15:55:18 user nova-compute[71874]:       <cpuselection/>
Apr 12 15:55:18 user nova-compute[71874]:       <deviceboot/>
Apr 12 15:55:18 user nova-compute[71874]:       <disksnapshot default='on' toggle='no'/>
Apr 12 15:55:18 user nova-compute[71874]:     </features>
Apr 12 15:55:18 user nova-compute[71874]:   </guest>
Apr 12 15:55:18 user nova-compute[71874]:   <guest>
Apr 12 15:55:18 user nova-compute[71874]:     <os_type>hvm</os_type>
Apr 12 15:55:18 user nova-compute[71874]:     <arch name='mips64'>
Apr 12 15:55:18 user nova-compute[71874]:       <wordsize>64</wordsize>
Apr 12 15:55:18 user nova-compute[71874]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='16'>malta</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>mipssim</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>pica61</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>magnum</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <domain type='qemu'/>
Apr 12 15:55:18 user nova-compute[71874]:     </arch>
Apr 12 15:55:18 user nova-compute[71874]:     <features>
Apr 12 15:55:18 user nova-compute[71874]:       <cpuselection/>
Apr 12 15:55:18 user nova-compute[71874]:       <deviceboot/>
Apr 12 15:55:18 user nova-compute[71874]:       <disksnapshot default='on' toggle='no'/>
Apr 12 15:55:18 user nova-compute[71874]:     </features>
Apr 12 15:55:18 user nova-compute[71874]:   </guest>
Apr 12 15:55:18 user nova-compute[71874]:   <guest>
Apr 12 15:55:18 user nova-compute[71874]:     <os_type>hvm</os_type>
Apr 12 15:55:18 user nova-compute[71874]:     <arch name='mips64el'>
Apr 12 15:55:18 user nova-compute[71874]:       <wordsize>64</wordsize>
Apr 12 15:55:18 user nova-compute[71874]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='16'>malta</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='16'>loongson3-virt</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>mipssim</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>pica61</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>magnum</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='16'>boston</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>fuloong2e</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <domain type='qemu'/>
Apr 12 15:55:18 user nova-compute[71874]:     </arch>
Apr 12 15:55:18 user nova-compute[71874]:     <features>
Apr 12 15:55:18 user nova-compute[71874]:       <cpuselection/>
Apr 12 15:55:18 user nova-compute[71874]:       <deviceboot/>
Apr 12 15:55:18 user nova-compute[71874]:       <disksnapshot default='on' toggle='no'/>
Apr 12 15:55:18 user nova-compute[71874]:     </features>
Apr 12 15:55:18 user nova-compute[71874]:   </guest>
Apr 12 15:55:18 user nova-compute[71874]:   <guest>
Apr 12 15:55:18 user nova-compute[71874]:     <os_type>hvm</os_type>
Apr 12 15:55:18 user nova-compute[71874]:     <arch name='ppc'>
Apr 12 15:55:18 user nova-compute[71874]:       <wordsize>32</wordsize>
Apr 12 15:55:18 user nova-compute[71874]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>g3beige</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>virtex-ml507</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>mac99</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='32'>ppce500</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>pegasos2</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>sam460ex</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>bamboo</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>40p</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>ref405ep</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='15'>mpc8544ds</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>taihu</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <domain type='qemu'/>
Apr 12 15:55:18 user nova-compute[71874]:     </arch>
Apr 12 15:55:18 user nova-compute[71874]:     <features>
Apr 12 15:55:18 user nova-compute[71874]:       <cpuselection/>
Apr 12 15:55:18 user nova-compute[71874]:       <deviceboot/>
Apr 12 15:55:18 user nova-compute[71874]:       <disksnapshot default='on' toggle='no'/>
Apr 12 15:55:18 user nova-compute[71874]:     </features>
Apr 12 15:55:18 user nova-compute[71874]:   </guest>
Apr 12 15:55:18 user nova-compute[71874]:   <guest>
Apr 12 15:55:18 user nova-compute[71874]:     <os_type>hvm</os_type>
Apr 12 15:55:18 user nova-compute[71874]:     <arch name='ppc64'>
Apr 12 15:55:18 user nova-compute[71874]:       <wordsize>64</wordsize>
Apr 12 15:55:18 user nova-compute[71874]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='2048'>powernv9</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>taihu</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='15'>mpc8544ds</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='2048'>powernv10</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='32'>ppce500</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>40p</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>pegasos2</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>bamboo</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>g3beige</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>virtex-ml507</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>mac99</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>sam460ex</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>ref405ep</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='2048'>powernv8</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <domain type='qemu'/>
Apr 12 15:55:18 user nova-compute[71874]:     </arch>
Apr 12 15:55:18 user nova-compute[71874]:     <features>
Apr 12 15:55:18 user nova-compute[71874]:       <cpuselection/>
Apr 12 15:55:18 user nova-compute[71874]:       <deviceboot/>
Apr 12 15:55:18 user nova-compute[71874]:       <disksnapshot default='on' toggle='no'/>
Apr 12 15:55:18 user nova-compute[71874]:     </features>
Apr 12 15:55:18 user nova-compute[71874]:   </guest>
Apr 12 15:55:18 user nova-compute[71874]:   <guest>
Apr 12 15:55:18 user nova-compute[71874]:     <os_type>hvm</os_type>
Apr 12 15:55:18 user nova-compute[71874]:     <arch name='ppc64le'>
Apr 12 15:55:18 user nova-compute[71874]:       <wordsize>64</wordsize>
Apr 12 15:55:18 user nova-compute[71874]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='2048'>powernv9</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>taihu</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='15'>mpc8544ds</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='2048'>powernv10</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='32'>ppce500</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>40p</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>pegasos2</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>bamboo</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>g3beige</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>virtex-ml507</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>mac99</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>sam460ex</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>ref405ep</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='2048'>powernv8</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <domain type='qemu'/>
Apr 12 15:55:18 user nova-compute[71874]:     </arch>
Apr 12 15:55:18 user nova-compute[71874]:     <features>
Apr 12 15:55:18 user nova-compute[71874]:       <cpuselection/>
Apr 12 15:55:18 user nova-compute[71874]:       <deviceboot/>
Apr 12 15:55:18 user nova-compute[71874]:       <disksnapshot default='on' toggle='no'/>
Apr 12 15:55:18 user nova-compute[71874]:     </features>
Apr 12 15:55:18 user nova-compute[71874]:   </guest>
Apr 12 15:55:18 user nova-compute[71874]:   <guest>
Apr 12 15:55:18 user nova-compute[71874]:     <os_type>hvm</os_type>
Apr 12 15:55:18 user nova-compute[71874]:     <arch name='riscv32'>
Apr 12 15:55:18 user nova-compute[71874]:       <wordsize>32</wordsize>
Apr 12 15:55:18 user nova-compute[71874]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='8'>spike</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>opentitan</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='5'>sifive_u</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>sifive_e</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='8'>virt</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <domain type='qemu'/>
Apr 12 15:55:18 user nova-compute[71874]:     </arch>
Apr 12 15:55:18 user nova-compute[71874]:     <features>
Apr 12 15:55:18 user nova-compute[71874]:       <cpuselection/>
Apr 12 15:55:18 user nova-compute[71874]:       <deviceboot/>
Apr 12 15:55:18 user nova-compute[71874]:       <disksnapshot default='on' toggle='no'/>
Apr 12 15:55:18 user nova-compute[71874]:     </features>
Apr 12 15:55:18 user nova-compute[71874]:   </guest>
Apr 12 15:55:18 user nova-compute[71874]:   <guest>
Apr 12 15:55:18 user nova-compute[71874]:     <os_type>hvm</os_type>
Apr 12 15:55:18 user nova-compute[71874]:     <arch name='riscv64'>
Apr 12 15:55:18 user nova-compute[71874]:       <wordsize>64</wordsize>
Apr 12 15:55:18 user nova-compute[71874]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='8'>spike</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='5'>sifive_u</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>shakti_c</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>sifive_e</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='8'>virt</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <domain type='qemu'/>
Apr 12 15:55:18 user nova-compute[71874]:     </arch>
Apr 12 15:55:18 user nova-compute[71874]:     <features>
Apr 12 15:55:18 user nova-compute[71874]:       <cpuselection/>
Apr 12 15:55:18 user nova-compute[71874]:       <deviceboot/>
Apr 12 15:55:18 user nova-compute[71874]:       <disksnapshot default='on' toggle='no'/>
Apr 12 15:55:18 user nova-compute[71874]:     </features>
Apr 12 15:55:18 user nova-compute[71874]:   </guest>
Apr 12 15:55:18 user nova-compute[71874]:   <guest>
Apr 12 15:55:18 user nova-compute[71874]:     <os_type>hvm</os_type>
Apr 12 15:55:18 user nova-compute[71874]:     <arch name='s390x'>
Apr 12 15:55:18 user nova-compute[71874]:       <wordsize>64</wordsize>
Apr 12 15:55:18 user nova-compute[71874]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <domain type='qemu'/>
Apr 12 15:55:18 user nova-compute[71874]:     </arch>
Apr 12 15:55:18 user nova-compute[71874]:     <features>
Apr 12 15:55:18 user nova-compute[71874]:       <cpuselection/>
Apr 12 15:55:18 user nova-compute[71874]:       <deviceboot/>
Apr 12 15:55:18 user nova-compute[71874]:       <disksnapshot default='on' toggle='no'/>
Apr 12 15:55:18 user nova-compute[71874]:     </features>
Apr 12 15:55:18 user nova-compute[71874]:   </guest>
Apr 12 15:55:18 user nova-compute[71874]:   <guest>
Apr 12 15:55:18 user nova-compute[71874]:     <os_type>hvm</os_type>
Apr 12 15:55:18 user nova-compute[71874]:     <arch name='sh4'>
Apr 12 15:55:18 user nova-compute[71874]:       <wordsize>32</wordsize>
Apr 12 15:55:18 user nova-compute[71874]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>shix</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>r2d</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <domain type='qemu'/>
Apr 12 15:55:18 user nova-compute[71874]:     </arch>
Apr 12 15:55:18 user nova-compute[71874]:     <features>
Apr 12 15:55:18 user nova-compute[71874]:       <cpuselection/>
Apr 12 15:55:18 user nova-compute[71874]:       <deviceboot/>
Apr 12 15:55:18 user nova-compute[71874]:       <disksnapshot default='on' toggle='no'/>
Apr 12 15:55:18 user nova-compute[71874]:     </features>
Apr 12 15:55:18 user nova-compute[71874]:   </guest>
Apr 12 15:55:18 user nova-compute[71874]:   <guest>
Apr 12 15:55:18 user nova-compute[71874]:     <os_type>hvm</os_type>
Apr 12 15:55:18 user nova-compute[71874]:     <arch name='sh4eb'>
Apr 12 15:55:18 user nova-compute[71874]:       <wordsize>64</wordsize>
Apr 12 15:55:18 user nova-compute[71874]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>shix</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>r2d</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <domain type='qemu'/>
Apr 12 15:55:18 user nova-compute[71874]:     </arch>
Apr 12 15:55:18 user nova-compute[71874]:     <features>
Apr 12 15:55:18 user nova-compute[71874]:       <cpuselection/>
Apr 12 15:55:18 user nova-compute[71874]:       <deviceboot/>
Apr 12 15:55:18 user nova-compute[71874]:       <disksnapshot default='on' toggle='no'/>
Apr 12 15:55:18 user nova-compute[71874]:     </features>
Apr 12 15:55:18 user nova-compute[71874]:   </guest>
Apr 12 15:55:18 user nova-compute[71874]:   <guest>
Apr 12 15:55:18 user nova-compute[71874]:     <os_type>hvm</os_type>
Apr 12 15:55:18 user nova-compute[71874]:     <arch name='sparc'>
Apr 12 15:55:18 user nova-compute[71874]:       <wordsize>32</wordsize>
Apr 12 15:55:18 user nova-compute[71874]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>SS-5</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='4'>SS-20</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>LX</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>SPARCClassic</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>leon3_generic</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>SPARCbook</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>SS-4</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='4'>SS-600MP</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='4'>SS-10</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>Voyager</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <domain type='qemu'/>
Apr 12 15:55:18 user nova-compute[71874]:     </arch>
Apr 12 15:55:18 user nova-compute[71874]:     <features>
Apr 12 15:55:18 user nova-compute[71874]:       <cpuselection/>
Apr 12 15:55:18 user nova-compute[71874]:       <deviceboot/>
Apr 12 15:55:18 user nova-compute[71874]:       <disksnapshot default='on' toggle='no'/>
Apr 12 15:55:18 user nova-compute[71874]:     </features>
Apr 12 15:55:18 user nova-compute[71874]:   </guest>
Apr 12 15:55:18 user nova-compute[71874]:   <guest>
Apr 12 15:55:18 user nova-compute[71874]:     <os_type>hvm</os_type>
Apr 12 15:55:18 user nova-compute[71874]:     <arch name='sparc64'>
Apr 12 15:55:18 user nova-compute[71874]:       <wordsize>64</wordsize>
Apr 12 15:55:18 user nova-compute[71874]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>sun4u</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>niagara</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>sun4v</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <domain type='qemu'/>
Apr 12 15:55:18 user nova-compute[71874]:     </arch>
Apr 12 15:55:18 user nova-compute[71874]:     <features>
Apr 12 15:55:18 user nova-compute[71874]:       <cpuselection/>
Apr 12 15:55:18 user nova-compute[71874]:       <deviceboot/>
Apr 12 15:55:18 user nova-compute[71874]:       <disksnapshot default='on' toggle='no'/>
Apr 12 15:55:18 user nova-compute[71874]:     </features>
Apr 12 15:55:18 user nova-compute[71874]:   </guest>
Apr 12 15:55:18 user nova-compute[71874]:   <guest>
Apr 12 15:55:18 user nova-compute[71874]:     <os_type>hvm</os_type>
Apr 12 15:55:18 user nova-compute[71874]:     <arch name='x86_64'>
Apr 12 15:55:18 user nova-compute[71874]:       <wordsize>64</wordsize>
Apr 12 15:55:18 user nova-compute[71874]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='288'>pc-q35-artful</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>x-remote</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='1'>isapc</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='288'>pc-q35-disco</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='288'>pc-q35-impish</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='288'>pc-q35-focal</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='288'>microvm</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <domain type='qemu'/>
Apr 12 15:55:18 user nova-compute[71874]:       <domain type='kvm'/>
Apr 12 15:55:18 user nova-compute[71874]:     </arch>
Apr 12 15:55:18 user nova-compute[71874]:     <features>
Apr 12 15:55:18 user nova-compute[71874]:       <acpi default='on' toggle='yes'/>
Apr 12 15:55:18 user nova-compute[71874]:       <apic default='on' toggle='no'/>
Apr 12 15:55:18 user nova-compute[71874]:       <cpuselection/>
Apr 12 15:55:18 user nova-compute[71874]:       <deviceboot/>
Apr 12 15:55:18 user nova-compute[71874]:       <disksnapshot default='on' toggle='no'/>
Apr 12 15:55:18 user nova-compute[71874]:     </features>
Apr 12 15:55:18 user nova-compute[71874]:   </guest>
Apr 12 15:55:18 user nova-compute[71874]:   <guest>
Apr 12 15:55:18 user nova-compute[71874]:     <os_type>hvm</os_type>
Apr 12 15:55:18 user nova-compute[71874]:     <arch name='xtensa'>
Apr 12 15:55:18 user nova-compute[71874]:       <wordsize>32</wordsize>
Apr 12 15:55:18 user nova-compute[71874]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='4'>sim</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='32'>kc705</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='32'>ml605</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='32'>ml605-nommu</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='32'>virt</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='32'>lx60-nommu</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='32'>lx200</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='32'>lx200-nommu</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='32'>lx60</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='32'>kc705-nommu</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <domain type='qemu'/>
Apr 12 15:55:18 user nova-compute[71874]:     </arch>
Apr 12 15:55:18 user nova-compute[71874]:     <features>
Apr 12 15:55:18 user nova-compute[71874]:       <cpuselection/>
Apr 12 15:55:18 user nova-compute[71874]:       <deviceboot/>
Apr 12 15:55:18 user nova-compute[71874]:       <disksnapshot default='on' toggle='no'/>
Apr 12 15:55:18 user nova-compute[71874]:     </features>
Apr 12 15:55:18 user nova-compute[71874]:   </guest>
Apr 12 15:55:18 user nova-compute[71874]:   <guest>
Apr 12 15:55:18 user nova-compute[71874]:     <os_type>hvm</os_type>
Apr 12 15:55:18 user nova-compute[71874]:     <arch name='xtensaeb'>
Apr 12 15:55:18 user nova-compute[71874]:       <wordsize>32</wordsize>
Apr 12 15:55:18 user nova-compute[71874]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='4'>sim</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='32'>kc705</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='32'>ml605</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='32'>ml605-nommu</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='32'>virt</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='32'>lx60-nommu</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='32'>lx200</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='32'>lx200-nommu</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='32'>lx60</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <machine maxCpus='32'>kc705-nommu</machine>
Apr 12 15:55:18 user nova-compute[71874]:       <domain type='qemu'/>
Apr 12 15:55:18 user nova-compute[71874]:     </arch>
Apr 12 15:55:18 user nova-compute[71874]:     <features>
Apr 12 15:55:18 user nova-compute[71874]:       <cpuselection/>
Apr 12 15:55:18 user nova-compute[71874]:       <deviceboot/>
Apr 12 15:55:18 user nova-compute[71874]:       <disksnapshot default='on' toggle='no'/>
Apr 12 15:55:18 user nova-compute[71874]:     </features>
Apr 12 15:55:18 user nova-compute[71874]:   </guest>
Apr 12 15:55:18 user nova-compute[71874]: </capabilities>
Apr 12 15:55:18 user nova-compute[71874]: 
Apr 12 15:55:18 user nova-compute[71874]: DEBUG nova.virt.libvirt.host [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=71874) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 15:55:18 user nova-compute[71874]: DEBUG nova.virt.libvirt.host [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=71874) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 15:55:18 user nova-compute[71874]: DEBUG nova.virt.libvirt.host [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Getting domain capabilities for armv6l via machine types: {None, 'virt'} {{(pid=71874) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 15:55:18 user nova-compute[71874]: DEBUG nova.virt.libvirt.host [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=71874) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 15:55:18 user nova-compute[71874]: DEBUG nova.virt.libvirt.host [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=71874) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 15:55:18 user nova-compute[71874]: DEBUG nova.virt.libvirt.host [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=71874) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 15:55:18 user nova-compute[71874]: DEBUG nova.virt.libvirt.host [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=71874) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 15:55:18 user nova-compute[71874]: DEBUG nova.virt.libvirt.host [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=71874) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 15:55:18 user nova-compute[71874]: DEBUG nova.virt.libvirt.host [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=71874) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 15:55:18 user nova-compute[71874]: DEBUG nova.virt.libvirt.host [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=71874) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 15:55:18 user nova-compute[71874]: DEBUG nova.virt.libvirt.host [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=71874) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 15:55:18 user nova-compute[71874]: DEBUG nova.virt.libvirt.host [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Getting domain capabilities for i686 via machine types: {'ubuntu-q35', 'pc', 'q35', 'ubuntu'} {{(pid=71874) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 15:55:18 user nova-compute[71874]: DEBUG nova.virt.libvirt.host [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Apr 12 15:55:18 user nova-compute[71874]: <domainCapabilities>
Apr 12 15:55:18 user nova-compute[71874]:   <path>/usr/bin/qemu-system-i386</path>
Apr 12 15:55:18 user nova-compute[71874]:   <domain>kvm</domain>
Apr 12 15:55:18 user nova-compute[71874]:   <machine>pc-q35-jammy</machine>
Apr 12 15:55:18 user nova-compute[71874]:   <arch>i686</arch>
Apr 12 15:55:18 user nova-compute[71874]:   <vcpu max='288'/>
Apr 12 15:55:18 user nova-compute[71874]:   <iothreads supported='yes'/>
Apr 12 15:55:18 user nova-compute[71874]:   <os supported='yes'>
Apr 12 15:55:18 user nova-compute[71874]:     <enum name='firmware'/>
Apr 12 15:55:18 user nova-compute[71874]:     <loader supported='yes'>
Apr 12 15:55:18 user nova-compute[71874]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Apr 12 15:55:18 user nova-compute[71874]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Apr 12 15:55:18 user nova-compute[71874]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Apr 12 15:55:18 user nova-compute[71874]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Apr 12 15:55:18 user nova-compute[71874]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='type'>
Apr 12 15:55:18 user nova-compute[71874]:         <value>rom</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>pflash</value>
Apr 12 15:55:18 user nova-compute[71874]:       </enum>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='readonly'>
Apr 12 15:55:18 user nova-compute[71874]:         <value>yes</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>no</value>
Apr 12 15:55:18 user nova-compute[71874]:       </enum>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='secure'>
Apr 12 15:55:18 user nova-compute[71874]:         <value>no</value>
Apr 12 15:55:18 user nova-compute[71874]:       </enum>
Apr 12 15:55:18 user nova-compute[71874]:     </loader>
Apr 12 15:55:18 user nova-compute[71874]:   </os>
Apr 12 15:55:18 user nova-compute[71874]:   <cpu>
Apr 12 15:55:18 user nova-compute[71874]:     <mode name='host-passthrough' supported='yes'>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='hostPassthroughMigratable'>
Apr 12 15:55:18 user nova-compute[71874]:         <value>off</value>
Apr 12 15:55:18 user nova-compute[71874]:       </enum>
Apr 12 15:55:18 user nova-compute[71874]:     </mode>
Apr 12 15:55:18 user nova-compute[71874]:     <mode name='maximum' supported='yes'>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='maximumMigratable'>
Apr 12 15:55:18 user nova-compute[71874]:         <value>on</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>off</value>
Apr 12 15:55:18 user nova-compute[71874]:       </enum>
Apr 12 15:55:18 user nova-compute[71874]:     </mode>
Apr 12 15:55:18 user nova-compute[71874]:     <mode name='host-model' supported='yes'>
Apr 12 15:55:18 user nova-compute[71874]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 12 15:55:18 user nova-compute[71874]:       <vendor>Intel</vendor>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='require' name='ss'/>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='require' name='vmx'/>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='require' name='pcid'/>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='require' name='hypervisor'/>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='require' name='arat'/>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='require' name='tsc_adjust'/>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='require' name='umip'/>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='require' name='md-clear'/>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='require' name='stibp'/>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='require' name='arch-capabilities'/>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='require' name='ssbd'/>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='require' name='ibpb'/>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='require' name='ibrs'/>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='require' name='amd-stibp'/>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='require' name='amd-ssbd'/>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='disable' name='erms'/>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='disable' name='xsaveopt'/>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='disable' name='lm'/>
Apr 12 15:55:18 user nova-compute[71874]:     </mode>
Apr 12 15:55:18 user nova-compute[71874]:     <mode name='custom' supported='yes'>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>qemu64</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='yes'>qemu32</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>phenom</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='yes'>pentium3</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='yes'>pentium2</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='yes'>pentium</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>n270</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>kvm64</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='yes'>kvm32</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='yes'>coreduo</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>core2duo</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>athlon</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Westmere-IBRS</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Westmere</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Snowridge</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Skylake-Server</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Skylake-Client</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>SandyBridge</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Penryn</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Opteron_G5</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Opteron_G4</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Opteron_G3</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Opteron_G2</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Opteron_G1</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Nehalem-IBRS</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Nehalem</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>IvyBridge</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Icelake-Server</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Haswell-noTSX</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Haswell-IBRS</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Haswell</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>EPYC-Rome</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>EPYC-Milan</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>EPYC-IBPB</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>EPYC</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Dhyana</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Cooperlake</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Conroe</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Cascadelake-Server</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Broadwell-noTSX</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Broadwell-IBRS</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Broadwell</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='yes'>486</model>
Apr 12 15:55:18 user nova-compute[71874]:     </mode>
Apr 12 15:55:18 user nova-compute[71874]:   </cpu>
Apr 12 15:55:18 user nova-compute[71874]:   <memoryBacking supported='yes'>
Apr 12 15:55:18 user nova-compute[71874]:     <enum name='sourceType'>
Apr 12 15:55:18 user nova-compute[71874]:       <value>file</value>
Apr 12 15:55:18 user nova-compute[71874]:       <value>anonymous</value>
Apr 12 15:55:18 user nova-compute[71874]:       <value>memfd</value>
Apr 12 15:55:18 user nova-compute[71874]:     </enum>
Apr 12 15:55:18 user nova-compute[71874]:   </memoryBacking>
Apr 12 15:55:18 user nova-compute[71874]:   <devices>
Apr 12 15:55:18 user nova-compute[71874]:     <disk supported='yes'>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='diskDevice'>
Apr 12 15:55:18 user nova-compute[71874]:         <value>disk</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>cdrom</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>floppy</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>lun</value>
Apr 12 15:55:18 user nova-compute[71874]:       </enum>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='bus'>
Apr 12 15:55:18 user nova-compute[71874]:         <value>fdc</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>scsi</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>virtio</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>usb</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>sata</value>
Apr 12 15:55:18 user nova-compute[71874]:       </enum>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='model'>
Apr 12 15:55:18 user nova-compute[71874]:         <value>virtio</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>virtio-transitional</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>virtio-non-transitional</value>
Apr 12 15:55:18 user nova-compute[71874]:       </enum>
Apr 12 15:55:18 user nova-compute[71874]:     </disk>
Apr 12 15:55:18 user nova-compute[71874]:     <graphics supported='yes'>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='type'>
Apr 12 15:55:18 user nova-compute[71874]:         <value>sdl</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>vnc</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>spice</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>egl-headless</value>
Apr 12 15:55:18 user nova-compute[71874]:       </enum>
Apr 12 15:55:18 user nova-compute[71874]:     </graphics>
Apr 12 15:55:18 user nova-compute[71874]:     <video supported='yes'>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='modelType'>
Apr 12 15:55:18 user nova-compute[71874]:         <value>vga</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>cirrus</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>vmvga</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>qxl</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>virtio</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>none</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>bochs</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>ramfb</value>
Apr 12 15:55:18 user nova-compute[71874]:       </enum>
Apr 12 15:55:18 user nova-compute[71874]:     </video>
Apr 12 15:55:18 user nova-compute[71874]:     <hostdev supported='yes'>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='mode'>
Apr 12 15:55:18 user nova-compute[71874]:         <value>subsystem</value>
Apr 12 15:55:18 user nova-compute[71874]:       </enum>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='startupPolicy'>
Apr 12 15:55:18 user nova-compute[71874]:         <value>default</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>mandatory</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>requisite</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>optional</value>
Apr 12 15:55:18 user nova-compute[71874]:       </enum>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='subsysType'>
Apr 12 15:55:18 user nova-compute[71874]:         <value>usb</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>pci</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>scsi</value>
Apr 12 15:55:18 user nova-compute[71874]:       </enum>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='capsType'/>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='pciBackend'/>
Apr 12 15:55:18 user nova-compute[71874]:     </hostdev>
Apr 12 15:55:18 user nova-compute[71874]:     <rng supported='yes'>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='model'>
Apr 12 15:55:18 user nova-compute[71874]:         <value>virtio</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>virtio-transitional</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>virtio-non-transitional</value>
Apr 12 15:55:18 user nova-compute[71874]:       </enum>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='backendModel'>
Apr 12 15:55:18 user nova-compute[71874]:         <value>random</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>egd</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>builtin</value>
Apr 12 15:55:18 user nova-compute[71874]:       </enum>
Apr 12 15:55:18 user nova-compute[71874]:     </rng>
Apr 12 15:55:18 user nova-compute[71874]:     <filesystem supported='yes'>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='driverType'>
Apr 12 15:55:18 user nova-compute[71874]:         <value>path</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>handle</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>virtiofs</value>
Apr 12 15:55:18 user nova-compute[71874]:       </enum>
Apr 12 15:55:18 user nova-compute[71874]:     </filesystem>
Apr 12 15:55:18 user nova-compute[71874]:     <tpm supported='yes'>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='model'>
Apr 12 15:55:18 user nova-compute[71874]:         <value>tpm-tis</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>tpm-crb</value>
Apr 12 15:55:18 user nova-compute[71874]:       </enum>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='backendModel'>
Apr 12 15:55:18 user nova-compute[71874]:         <value>passthrough</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>emulator</value>
Apr 12 15:55:18 user nova-compute[71874]:       </enum>
Apr 12 15:55:18 user nova-compute[71874]:     </tpm>
Apr 12 15:55:18 user nova-compute[71874]:   </devices>
Apr 12 15:55:18 user nova-compute[71874]:   <features>
Apr 12 15:55:18 user nova-compute[71874]:     <gic supported='no'/>
Apr 12 15:55:18 user nova-compute[71874]:     <vmcoreinfo supported='yes'/>
Apr 12 15:55:18 user nova-compute[71874]:     <genid supported='yes'/>
Apr 12 15:55:18 user nova-compute[71874]:     <backingStoreInput supported='yes'/>
Apr 12 15:55:18 user nova-compute[71874]:     <backup supported='yes'/>
Apr 12 15:55:18 user nova-compute[71874]:     <sev supported='no'/>
Apr 12 15:55:18 user nova-compute[71874]:   </features>
Apr 12 15:55:18 user nova-compute[71874]: </domainCapabilities>
Apr 12 15:55:18 user nova-compute[71874]:  {{(pid=71874) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 12 15:55:18 user nova-compute[71874]: DEBUG nova.virt.libvirt.host [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Apr 12 15:55:18 user nova-compute[71874]: <domainCapabilities>
Apr 12 15:55:18 user nova-compute[71874]:   <path>/usr/bin/qemu-system-i386</path>
Apr 12 15:55:18 user nova-compute[71874]:   <domain>kvm</domain>
Apr 12 15:55:18 user nova-compute[71874]:   <machine>pc-i440fx-6.2</machine>
Apr 12 15:55:18 user nova-compute[71874]:   <arch>i686</arch>
Apr 12 15:55:18 user nova-compute[71874]:   <vcpu max='255'/>
Apr 12 15:55:18 user nova-compute[71874]:   <iothreads supported='yes'/>
Apr 12 15:55:18 user nova-compute[71874]:   <os supported='yes'>
Apr 12 15:55:18 user nova-compute[71874]:     <enum name='firmware'/>
Apr 12 15:55:18 user nova-compute[71874]:     <loader supported='yes'>
Apr 12 15:55:18 user nova-compute[71874]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Apr 12 15:55:18 user nova-compute[71874]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Apr 12 15:55:18 user nova-compute[71874]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Apr 12 15:55:18 user nova-compute[71874]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Apr 12 15:55:18 user nova-compute[71874]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='type'>
Apr 12 15:55:18 user nova-compute[71874]:         <value>rom</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>pflash</value>
Apr 12 15:55:18 user nova-compute[71874]:       </enum>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='readonly'>
Apr 12 15:55:18 user nova-compute[71874]:         <value>yes</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>no</value>
Apr 12 15:55:18 user nova-compute[71874]:       </enum>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='secure'>
Apr 12 15:55:18 user nova-compute[71874]:         <value>no</value>
Apr 12 15:55:18 user nova-compute[71874]:       </enum>
Apr 12 15:55:18 user nova-compute[71874]:     </loader>
Apr 12 15:55:18 user nova-compute[71874]:   </os>
Apr 12 15:55:18 user nova-compute[71874]:   <cpu>
Apr 12 15:55:18 user nova-compute[71874]:     <mode name='host-passthrough' supported='yes'>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='hostPassthroughMigratable'>
Apr 12 15:55:18 user nova-compute[71874]:         <value>off</value>
Apr 12 15:55:18 user nova-compute[71874]:       </enum>
Apr 12 15:55:18 user nova-compute[71874]:     </mode>
Apr 12 15:55:18 user nova-compute[71874]:     <mode name='maximum' supported='yes'>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='maximumMigratable'>
Apr 12 15:55:18 user nova-compute[71874]:         <value>on</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>off</value>
Apr 12 15:55:18 user nova-compute[71874]:       </enum>
Apr 12 15:55:18 user nova-compute[71874]:     </mode>
Apr 12 15:55:18 user nova-compute[71874]:     <mode name='host-model' supported='yes'>
Apr 12 15:55:18 user nova-compute[71874]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 12 15:55:18 user nova-compute[71874]:       <vendor>Intel</vendor>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='require' name='ss'/>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='require' name='vmx'/>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='require' name='pcid'/>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='require' name='hypervisor'/>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='require' name='arat'/>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='require' name='tsc_adjust'/>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='require' name='umip'/>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='require' name='md-clear'/>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='require' name='stibp'/>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='require' name='arch-capabilities'/>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='require' name='ssbd'/>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='require' name='ibpb'/>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='require' name='ibrs'/>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='require' name='amd-stibp'/>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='require' name='amd-ssbd'/>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='disable' name='erms'/>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='disable' name='xsaveopt'/>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='disable' name='lm'/>
Apr 12 15:55:18 user nova-compute[71874]:     </mode>
Apr 12 15:55:18 user nova-compute[71874]:     <mode name='custom' supported='yes'>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>qemu64</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='yes'>qemu32</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>phenom</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='yes'>pentium3</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='yes'>pentium2</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='yes'>pentium</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>n270</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>kvm64</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='yes'>kvm32</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='yes'>coreduo</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>core2duo</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>athlon</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Westmere-IBRS</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Westmere</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Snowridge</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Skylake-Server</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Skylake-Client</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>SandyBridge</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Penryn</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Opteron_G5</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Opteron_G4</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Opteron_G3</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Opteron_G2</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Opteron_G1</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Nehalem-IBRS</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Nehalem</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>IvyBridge</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Icelake-Server</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Haswell-noTSX</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Haswell-IBRS</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Haswell</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>EPYC-Rome</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>EPYC-Milan</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>EPYC-IBPB</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>EPYC</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Dhyana</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Cooperlake</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Conroe</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Cascadelake-Server</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Broadwell-noTSX</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Broadwell-IBRS</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Broadwell</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='yes'>486</model>
Apr 12 15:55:18 user nova-compute[71874]:     </mode>
Apr 12 15:55:18 user nova-compute[71874]:   </cpu>
Apr 12 15:55:18 user nova-compute[71874]:   <memoryBacking supported='yes'>
Apr 12 15:55:18 user nova-compute[71874]:     <enum name='sourceType'>
Apr 12 15:55:18 user nova-compute[71874]:       <value>file</value>
Apr 12 15:55:18 user nova-compute[71874]:       <value>anonymous</value>
Apr 12 15:55:18 user nova-compute[71874]:       <value>memfd</value>
Apr 12 15:55:18 user nova-compute[71874]:     </enum>
Apr 12 15:55:18 user nova-compute[71874]:   </memoryBacking>
Apr 12 15:55:18 user nova-compute[71874]:   <devices>
Apr 12 15:55:18 user nova-compute[71874]:     <disk supported='yes'>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='diskDevice'>
Apr 12 15:55:18 user nova-compute[71874]:         <value>disk</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>cdrom</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>floppy</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>lun</value>
Apr 12 15:55:18 user nova-compute[71874]:       </enum>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='bus'>
Apr 12 15:55:18 user nova-compute[71874]:         <value>ide</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>fdc</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>scsi</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>virtio</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>usb</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>sata</value>
Apr 12 15:55:18 user nova-compute[71874]:       </enum>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='model'>
Apr 12 15:55:18 user nova-compute[71874]:         <value>virtio</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>virtio-transitional</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>virtio-non-transitional</value>
Apr 12 15:55:18 user nova-compute[71874]:       </enum>
Apr 12 15:55:18 user nova-compute[71874]:     </disk>
Apr 12 15:55:18 user nova-compute[71874]:     <graphics supported='yes'>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='type'>
Apr 12 15:55:18 user nova-compute[71874]:         <value>sdl</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>vnc</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>spice</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>egl-headless</value>
Apr 12 15:55:18 user nova-compute[71874]:       </enum>
Apr 12 15:55:18 user nova-compute[71874]:     </graphics>
Apr 12 15:55:18 user nova-compute[71874]:     <video supported='yes'>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='modelType'>
Apr 12 15:55:18 user nova-compute[71874]:         <value>vga</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>cirrus</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>vmvga</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>qxl</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>virtio</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>none</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>bochs</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>ramfb</value>
Apr 12 15:55:18 user nova-compute[71874]:       </enum>
Apr 12 15:55:18 user nova-compute[71874]:     </video>
Apr 12 15:55:18 user nova-compute[71874]:     <hostdev supported='yes'>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='mode'>
Apr 12 15:55:18 user nova-compute[71874]:         <value>subsystem</value>
Apr 12 15:55:18 user nova-compute[71874]:       </enum>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='startupPolicy'>
Apr 12 15:55:18 user nova-compute[71874]:         <value>default</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>mandatory</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>requisite</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>optional</value>
Apr 12 15:55:18 user nova-compute[71874]:       </enum>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='subsysType'>
Apr 12 15:55:18 user nova-compute[71874]:         <value>usb</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>pci</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>scsi</value>
Apr 12 15:55:18 user nova-compute[71874]:       </enum>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='capsType'/>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='pciBackend'/>
Apr 12 15:55:18 user nova-compute[71874]:     </hostdev>
Apr 12 15:55:18 user nova-compute[71874]:     <rng supported='yes'>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='model'>
Apr 12 15:55:18 user nova-compute[71874]:         <value>virtio</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>virtio-transitional</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>virtio-non-transitional</value>
Apr 12 15:55:18 user nova-compute[71874]:       </enum>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='backendModel'>
Apr 12 15:55:18 user nova-compute[71874]:         <value>random</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>egd</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>builtin</value>
Apr 12 15:55:18 user nova-compute[71874]:       </enum>
Apr 12 15:55:18 user nova-compute[71874]:     </rng>
Apr 12 15:55:18 user nova-compute[71874]:     <filesystem supported='yes'>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='driverType'>
Apr 12 15:55:18 user nova-compute[71874]:         <value>path</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>handle</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>virtiofs</value>
Apr 12 15:55:18 user nova-compute[71874]:       </enum>
Apr 12 15:55:18 user nova-compute[71874]:     </filesystem>
Apr 12 15:55:18 user nova-compute[71874]:     <tpm supported='yes'>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='model'>
Apr 12 15:55:18 user nova-compute[71874]:         <value>tpm-tis</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>tpm-crb</value>
Apr 12 15:55:18 user nova-compute[71874]:       </enum>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='backendModel'>
Apr 12 15:55:18 user nova-compute[71874]:         <value>passthrough</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>emulator</value>
Apr 12 15:55:18 user nova-compute[71874]:       </enum>
Apr 12 15:55:18 user nova-compute[71874]:     </tpm>
Apr 12 15:55:18 user nova-compute[71874]:   </devices>
Apr 12 15:55:18 user nova-compute[71874]:   <features>
Apr 12 15:55:18 user nova-compute[71874]:     <gic supported='no'/>
Apr 12 15:55:18 user nova-compute[71874]:     <vmcoreinfo supported='yes'/>
Apr 12 15:55:18 user nova-compute[71874]:     <genid supported='yes'/>
Apr 12 15:55:18 user nova-compute[71874]:     <backingStoreInput supported='yes'/>
Apr 12 15:55:18 user nova-compute[71874]:     <backup supported='yes'/>
Apr 12 15:55:18 user nova-compute[71874]:     <sev supported='no'/>
Apr 12 15:55:18 user nova-compute[71874]:   </features>
Apr 12 15:55:18 user nova-compute[71874]: </domainCapabilities>
Apr 12 15:55:18 user nova-compute[71874]:  {{(pid=71874) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 12 15:55:18 user nova-compute[71874]: DEBUG nova.virt.libvirt.host [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Apr 12 15:55:18 user nova-compute[71874]: <domainCapabilities>
Apr 12 15:55:18 user nova-compute[71874]:   <path>/usr/bin/qemu-system-i386</path>
Apr 12 15:55:18 user nova-compute[71874]:   <domain>kvm</domain>
Apr 12 15:55:18 user nova-compute[71874]:   <machine>pc-q35-6.2</machine>
Apr 12 15:55:18 user nova-compute[71874]:   <arch>i686</arch>
Apr 12 15:55:18 user nova-compute[71874]:   <vcpu max='288'/>
Apr 12 15:55:18 user nova-compute[71874]:   <iothreads supported='yes'/>
Apr 12 15:55:18 user nova-compute[71874]:   <os supported='yes'>
Apr 12 15:55:18 user nova-compute[71874]:     <enum name='firmware'/>
Apr 12 15:55:18 user nova-compute[71874]:     <loader supported='yes'>
Apr 12 15:55:18 user nova-compute[71874]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Apr 12 15:55:18 user nova-compute[71874]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Apr 12 15:55:18 user nova-compute[71874]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Apr 12 15:55:18 user nova-compute[71874]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Apr 12 15:55:18 user nova-compute[71874]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='type'>
Apr 12 15:55:18 user nova-compute[71874]:         <value>rom</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>pflash</value>
Apr 12 15:55:18 user nova-compute[71874]:       </enum>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='readonly'>
Apr 12 15:55:18 user nova-compute[71874]:         <value>yes</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>no</value>
Apr 12 15:55:18 user nova-compute[71874]:       </enum>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='secure'>
Apr 12 15:55:18 user nova-compute[71874]:         <value>no</value>
Apr 12 15:55:18 user nova-compute[71874]:       </enum>
Apr 12 15:55:18 user nova-compute[71874]:     </loader>
Apr 12 15:55:18 user nova-compute[71874]:   </os>
Apr 12 15:55:18 user nova-compute[71874]:   <cpu>
Apr 12 15:55:18 user nova-compute[71874]:     <mode name='host-passthrough' supported='yes'>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='hostPassthroughMigratable'>
Apr 12 15:55:18 user nova-compute[71874]:         <value>off</value>
Apr 12 15:55:18 user nova-compute[71874]:       </enum>
Apr 12 15:55:18 user nova-compute[71874]:     </mode>
Apr 12 15:55:18 user nova-compute[71874]:     <mode name='maximum' supported='yes'>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='maximumMigratable'>
Apr 12 15:55:18 user nova-compute[71874]:         <value>on</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>off</value>
Apr 12 15:55:18 user nova-compute[71874]:       </enum>
Apr 12 15:55:18 user nova-compute[71874]:     </mode>
Apr 12 15:55:18 user nova-compute[71874]:     <mode name='host-model' supported='yes'>
Apr 12 15:55:18 user nova-compute[71874]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 12 15:55:18 user nova-compute[71874]:       <vendor>Intel</vendor>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='require' name='ss'/>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='require' name='vmx'/>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='require' name='pcid'/>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='require' name='hypervisor'/>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='require' name='arat'/>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='require' name='tsc_adjust'/>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='require' name='umip'/>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='require' name='md-clear'/>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='require' name='stibp'/>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='require' name='arch-capabilities'/>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='require' name='ssbd'/>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='require' name='ibpb'/>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='require' name='ibrs'/>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='require' name='amd-stibp'/>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='require' name='amd-ssbd'/>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='disable' name='erms'/>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='disable' name='xsaveopt'/>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='disable' name='lm'/>
Apr 12 15:55:18 user nova-compute[71874]:     </mode>
Apr 12 15:55:18 user nova-compute[71874]:     <mode name='custom' supported='yes'>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>qemu64</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='yes'>qemu32</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>phenom</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='yes'>pentium3</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='yes'>pentium2</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='yes'>pentium</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>n270</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>kvm64</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='yes'>kvm32</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='yes'>coreduo</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>core2duo</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>athlon</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Westmere-IBRS</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Westmere</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Snowridge</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Skylake-Server</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Skylake-Client</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>SandyBridge</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Penryn</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Opteron_G5</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Opteron_G4</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Opteron_G3</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Opteron_G2</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Opteron_G1</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Nehalem-IBRS</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Nehalem</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>IvyBridge</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Icelake-Server</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Haswell-noTSX</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Haswell-IBRS</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Haswell</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>EPYC-Rome</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>EPYC-Milan</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>EPYC-IBPB</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>EPYC</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Dhyana</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Cooperlake</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Conroe</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Cascadelake-Server</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Broadwell-noTSX</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Broadwell-IBRS</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Broadwell</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='yes'>486</model>
Apr 12 15:55:18 user nova-compute[71874]:     </mode>
Apr 12 15:55:18 user nova-compute[71874]:   </cpu>
Apr 12 15:55:18 user nova-compute[71874]:   <memoryBacking supported='yes'>
Apr 12 15:55:18 user nova-compute[71874]:     <enum name='sourceType'>
Apr 12 15:55:18 user nova-compute[71874]:       <value>file</value>
Apr 12 15:55:18 user nova-compute[71874]:       <value>anonymous</value>
Apr 12 15:55:18 user nova-compute[71874]:       <value>memfd</value>
Apr 12 15:55:18 user nova-compute[71874]:     </enum>
Apr 12 15:55:18 user nova-compute[71874]:   </memoryBacking>
Apr 12 15:55:18 user nova-compute[71874]:   <devices>
Apr 12 15:55:18 user nova-compute[71874]:     <disk supported='yes'>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='diskDevice'>
Apr 12 15:55:18 user nova-compute[71874]:         <value>disk</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>cdrom</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>floppy</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>lun</value>
Apr 12 15:55:18 user nova-compute[71874]:       </enum>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='bus'>
Apr 12 15:55:18 user nova-compute[71874]:         <value>fdc</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>scsi</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>virtio</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>usb</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>sata</value>
Apr 12 15:55:18 user nova-compute[71874]:       </enum>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='model'>
Apr 12 15:55:18 user nova-compute[71874]:         <value>virtio</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>virtio-transitional</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>virtio-non-transitional</value>
Apr 12 15:55:18 user nova-compute[71874]:       </enum>
Apr 12 15:55:18 user nova-compute[71874]:     </disk>
Apr 12 15:55:18 user nova-compute[71874]:     <graphics supported='yes'>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='type'>
Apr 12 15:55:18 user nova-compute[71874]:         <value>sdl</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>vnc</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>spice</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>egl-headless</value>
Apr 12 15:55:18 user nova-compute[71874]:       </enum>
Apr 12 15:55:18 user nova-compute[71874]:     </graphics>
Apr 12 15:55:18 user nova-compute[71874]:     <video supported='yes'>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='modelType'>
Apr 12 15:55:18 user nova-compute[71874]:         <value>vga</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>cirrus</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>vmvga</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>qxl</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>virtio</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>none</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>bochs</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>ramfb</value>
Apr 12 15:55:18 user nova-compute[71874]:       </enum>
Apr 12 15:55:18 user nova-compute[71874]:     </video>
Apr 12 15:55:18 user nova-compute[71874]:     <hostdev supported='yes'>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='mode'>
Apr 12 15:55:18 user nova-compute[71874]:         <value>subsystem</value>
Apr 12 15:55:18 user nova-compute[71874]:       </enum>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='startupPolicy'>
Apr 12 15:55:18 user nova-compute[71874]:         <value>default</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>mandatory</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>requisite</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>optional</value>
Apr 12 15:55:18 user nova-compute[71874]:       </enum>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='subsysType'>
Apr 12 15:55:18 user nova-compute[71874]:         <value>usb</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>pci</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>scsi</value>
Apr 12 15:55:18 user nova-compute[71874]:       </enum>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='capsType'/>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='pciBackend'/>
Apr 12 15:55:18 user nova-compute[71874]:     </hostdev>
Apr 12 15:55:18 user nova-compute[71874]:     <rng supported='yes'>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='model'>
Apr 12 15:55:18 user nova-compute[71874]:         <value>virtio</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>virtio-transitional</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>virtio-non-transitional</value>
Apr 12 15:55:18 user nova-compute[71874]:       </enum>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='backendModel'>
Apr 12 15:55:18 user nova-compute[71874]:         <value>random</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>egd</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>builtin</value>
Apr 12 15:55:18 user nova-compute[71874]:       </enum>
Apr 12 15:55:18 user nova-compute[71874]:     </rng>
Apr 12 15:55:18 user nova-compute[71874]:     <filesystem supported='yes'>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='driverType'>
Apr 12 15:55:18 user nova-compute[71874]:         <value>path</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>handle</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>virtiofs</value>
Apr 12 15:55:18 user nova-compute[71874]:       </enum>
Apr 12 15:55:18 user nova-compute[71874]:     </filesystem>
Apr 12 15:55:18 user nova-compute[71874]:     <tpm supported='yes'>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='model'>
Apr 12 15:55:18 user nova-compute[71874]:         <value>tpm-tis</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>tpm-crb</value>
Apr 12 15:55:18 user nova-compute[71874]:       </enum>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='backendModel'>
Apr 12 15:55:18 user nova-compute[71874]:         <value>passthrough</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>emulator</value>
Apr 12 15:55:18 user nova-compute[71874]:       </enum>
Apr 12 15:55:18 user nova-compute[71874]:     </tpm>
Apr 12 15:55:18 user nova-compute[71874]:   </devices>
Apr 12 15:55:18 user nova-compute[71874]:   <features>
Apr 12 15:55:18 user nova-compute[71874]:     <gic supported='no'/>
Apr 12 15:55:18 user nova-compute[71874]:     <vmcoreinfo supported='yes'/>
Apr 12 15:55:18 user nova-compute[71874]:     <genid supported='yes'/>
Apr 12 15:55:18 user nova-compute[71874]:     <backingStoreInput supported='yes'/>
Apr 12 15:55:18 user nova-compute[71874]:     <backup supported='yes'/>
Apr 12 15:55:18 user nova-compute[71874]:     <sev supported='no'/>
Apr 12 15:55:18 user nova-compute[71874]:   </features>
Apr 12 15:55:18 user nova-compute[71874]: </domainCapabilities>
Apr 12 15:55:18 user nova-compute[71874]:  {{(pid=71874) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 12 15:55:18 user nova-compute[71874]: DEBUG nova.virt.libvirt.host [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Apr 12 15:55:18 user nova-compute[71874]: <domainCapabilities>
Apr 12 15:55:18 user nova-compute[71874]:   <path>/usr/bin/qemu-system-i386</path>
Apr 12 15:55:18 user nova-compute[71874]:   <domain>kvm</domain>
Apr 12 15:55:18 user nova-compute[71874]:   <machine>pc-i440fx-jammy</machine>
Apr 12 15:55:18 user nova-compute[71874]:   <arch>i686</arch>
Apr 12 15:55:18 user nova-compute[71874]:   <vcpu max='255'/>
Apr 12 15:55:18 user nova-compute[71874]:   <iothreads supported='yes'/>
Apr 12 15:55:18 user nova-compute[71874]:   <os supported='yes'>
Apr 12 15:55:18 user nova-compute[71874]:     <enum name='firmware'/>
Apr 12 15:55:18 user nova-compute[71874]:     <loader supported='yes'>
Apr 12 15:55:18 user nova-compute[71874]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Apr 12 15:55:18 user nova-compute[71874]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Apr 12 15:55:18 user nova-compute[71874]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Apr 12 15:55:18 user nova-compute[71874]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Apr 12 15:55:18 user nova-compute[71874]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='type'>
Apr 12 15:55:18 user nova-compute[71874]:         <value>rom</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>pflash</value>
Apr 12 15:55:18 user nova-compute[71874]:       </enum>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='readonly'>
Apr 12 15:55:18 user nova-compute[71874]:         <value>yes</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>no</value>
Apr 12 15:55:18 user nova-compute[71874]:       </enum>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='secure'>
Apr 12 15:55:18 user nova-compute[71874]:         <value>no</value>
Apr 12 15:55:18 user nova-compute[71874]:       </enum>
Apr 12 15:55:18 user nova-compute[71874]:     </loader>
Apr 12 15:55:18 user nova-compute[71874]:   </os>
Apr 12 15:55:18 user nova-compute[71874]:   <cpu>
Apr 12 15:55:18 user nova-compute[71874]:     <mode name='host-passthrough' supported='yes'>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='hostPassthroughMigratable'>
Apr 12 15:55:18 user nova-compute[71874]:         <value>off</value>
Apr 12 15:55:18 user nova-compute[71874]:       </enum>
Apr 12 15:55:18 user nova-compute[71874]:     </mode>
Apr 12 15:55:18 user nova-compute[71874]:     <mode name='maximum' supported='yes'>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='maximumMigratable'>
Apr 12 15:55:18 user nova-compute[71874]:         <value>on</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>off</value>
Apr 12 15:55:18 user nova-compute[71874]:       </enum>
Apr 12 15:55:18 user nova-compute[71874]:     </mode>
Apr 12 15:55:18 user nova-compute[71874]:     <mode name='host-model' supported='yes'>
Apr 12 15:55:18 user nova-compute[71874]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 12 15:55:18 user nova-compute[71874]:       <vendor>Intel</vendor>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='require' name='ss'/>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='require' name='vmx'/>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='require' name='pcid'/>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='require' name='hypervisor'/>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='require' name='arat'/>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='require' name='tsc_adjust'/>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='require' name='umip'/>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='require' name='md-clear'/>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='require' name='stibp'/>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='require' name='arch-capabilities'/>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='require' name='ssbd'/>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='require' name='ibpb'/>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='require' name='ibrs'/>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='require' name='amd-stibp'/>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='require' name='amd-ssbd'/>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='disable' name='erms'/>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='disable' name='xsaveopt'/>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='disable' name='lm'/>
Apr 12 15:55:18 user nova-compute[71874]:     </mode>
Apr 12 15:55:18 user nova-compute[71874]:     <mode name='custom' supported='yes'>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>qemu64</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='yes'>qemu32</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>phenom</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='yes'>pentium3</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='yes'>pentium2</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='yes'>pentium</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>n270</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>kvm64</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='yes'>kvm32</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='yes'>coreduo</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>core2duo</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>athlon</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Westmere-IBRS</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Westmere</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Snowridge</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Skylake-Server</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Skylake-Client</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>SandyBridge</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Penryn</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Opteron_G5</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Opteron_G4</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Opteron_G3</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Opteron_G2</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Opteron_G1</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Nehalem-IBRS</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Nehalem</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>IvyBridge</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Icelake-Server</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Haswell-noTSX</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Haswell-IBRS</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Haswell</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>EPYC-Rome</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>EPYC-Milan</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>EPYC-IBPB</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>EPYC</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Dhyana</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Cooperlake</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Conroe</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Cascadelake-Server</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Broadwell-noTSX</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Broadwell-IBRS</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Broadwell</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='yes'>486</model>
Apr 12 15:55:18 user nova-compute[71874]:     </mode>
Apr 12 15:55:18 user nova-compute[71874]:   </cpu>
Apr 12 15:55:18 user nova-compute[71874]:   <memoryBacking supported='yes'>
Apr 12 15:55:18 user nova-compute[71874]:     <enum name='sourceType'>
Apr 12 15:55:18 user nova-compute[71874]:       <value>file</value>
Apr 12 15:55:18 user nova-compute[71874]:       <value>anonymous</value>
Apr 12 15:55:18 user nova-compute[71874]:       <value>memfd</value>
Apr 12 15:55:18 user nova-compute[71874]:     </enum>
Apr 12 15:55:18 user nova-compute[71874]:   </memoryBacking>
Apr 12 15:55:18 user nova-compute[71874]:   <devices>
Apr 12 15:55:18 user nova-compute[71874]:     <disk supported='yes'>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='diskDevice'>
Apr 12 15:55:18 user nova-compute[71874]:         <value>disk</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>cdrom</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>floppy</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>lun</value>
Apr 12 15:55:18 user nova-compute[71874]:       </enum>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='bus'>
Apr 12 15:55:18 user nova-compute[71874]:         <value>ide</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>fdc</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>scsi</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>virtio</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>usb</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>sata</value>
Apr 12 15:55:18 user nova-compute[71874]:       </enum>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='model'>
Apr 12 15:55:18 user nova-compute[71874]:         <value>virtio</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>virtio-transitional</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>virtio-non-transitional</value>
Apr 12 15:55:18 user nova-compute[71874]:       </enum>
Apr 12 15:55:18 user nova-compute[71874]:     </disk>
Apr 12 15:55:18 user nova-compute[71874]:     <graphics supported='yes'>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='type'>
Apr 12 15:55:18 user nova-compute[71874]:         <value>sdl</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>vnc</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>spice</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>egl-headless</value>
Apr 12 15:55:18 user nova-compute[71874]:       </enum>
Apr 12 15:55:18 user nova-compute[71874]:     </graphics>
Apr 12 15:55:18 user nova-compute[71874]:     <video supported='yes'>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='modelType'>
Apr 12 15:55:18 user nova-compute[71874]:         <value>vga</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>cirrus</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>vmvga</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>qxl</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>virtio</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>none</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>bochs</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>ramfb</value>
Apr 12 15:55:18 user nova-compute[71874]:       </enum>
Apr 12 15:55:18 user nova-compute[71874]:     </video>
Apr 12 15:55:18 user nova-compute[71874]:     <hostdev supported='yes'>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='mode'>
Apr 12 15:55:18 user nova-compute[71874]:         <value>subsystem</value>
Apr 12 15:55:18 user nova-compute[71874]:       </enum>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='startupPolicy'>
Apr 12 15:55:18 user nova-compute[71874]:         <value>default</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>mandatory</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>requisite</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>optional</value>
Apr 12 15:55:18 user nova-compute[71874]:       </enum>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='subsysType'>
Apr 12 15:55:18 user nova-compute[71874]:         <value>usb</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>pci</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>scsi</value>
Apr 12 15:55:18 user nova-compute[71874]:       </enum>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='capsType'/>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='pciBackend'/>
Apr 12 15:55:18 user nova-compute[71874]:     </hostdev>
Apr 12 15:55:18 user nova-compute[71874]:     <rng supported='yes'>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='model'>
Apr 12 15:55:18 user nova-compute[71874]:         <value>virtio</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>virtio-transitional</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>virtio-non-transitional</value>
Apr 12 15:55:18 user nova-compute[71874]:       </enum>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='backendModel'>
Apr 12 15:55:18 user nova-compute[71874]:         <value>random</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>egd</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>builtin</value>
Apr 12 15:55:18 user nova-compute[71874]:       </enum>
Apr 12 15:55:18 user nova-compute[71874]:     </rng>
Apr 12 15:55:18 user nova-compute[71874]:     <filesystem supported='yes'>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='driverType'>
Apr 12 15:55:18 user nova-compute[71874]:         <value>path</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>handle</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>virtiofs</value>
Apr 12 15:55:18 user nova-compute[71874]:       </enum>
Apr 12 15:55:18 user nova-compute[71874]:     </filesystem>
Apr 12 15:55:18 user nova-compute[71874]:     <tpm supported='yes'>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='model'>
Apr 12 15:55:18 user nova-compute[71874]:         <value>tpm-tis</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>tpm-crb</value>
Apr 12 15:55:18 user nova-compute[71874]:       </enum>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='backendModel'>
Apr 12 15:55:18 user nova-compute[71874]:         <value>passthrough</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>emulator</value>
Apr 12 15:55:18 user nova-compute[71874]:       </enum>
Apr 12 15:55:18 user nova-compute[71874]:     </tpm>
Apr 12 15:55:18 user nova-compute[71874]:   </devices>
Apr 12 15:55:18 user nova-compute[71874]:   <features>
Apr 12 15:55:18 user nova-compute[71874]:     <gic supported='no'/>
Apr 12 15:55:18 user nova-compute[71874]:     <vmcoreinfo supported='yes'/>
Apr 12 15:55:18 user nova-compute[71874]:     <genid supported='yes'/>
Apr 12 15:55:18 user nova-compute[71874]:     <backingStoreInput supported='yes'/>
Apr 12 15:55:18 user nova-compute[71874]:     <backup supported='yes'/>
Apr 12 15:55:18 user nova-compute[71874]:     <sev supported='no'/>
Apr 12 15:55:18 user nova-compute[71874]:   </features>
Apr 12 15:55:18 user nova-compute[71874]: </domainCapabilities>
Apr 12 15:55:18 user nova-compute[71874]:  {{(pid=71874) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 12 15:55:18 user nova-compute[71874]: DEBUG nova.virt.libvirt.host [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Getting domain capabilities for m68k via machine types: {None, 'virt'} {{(pid=71874) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 15:55:18 user nova-compute[71874]: DEBUG nova.virt.libvirt.host [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=71874) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 15:55:18 user nova-compute[71874]: DEBUG nova.virt.libvirt.host [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=71874) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 15:55:18 user nova-compute[71874]: DEBUG nova.virt.libvirt.host [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=71874) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 15:55:18 user nova-compute[71874]: DEBUG nova.virt.libvirt.host [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=71874) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 15:55:18 user nova-compute[71874]: DEBUG nova.virt.libvirt.host [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=71874) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 15:55:18 user nova-compute[71874]: DEBUG nova.virt.libvirt.host [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=71874) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 15:55:18 user nova-compute[71874]: DEBUG nova.virt.libvirt.host [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=71874) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 15:55:18 user nova-compute[71874]: DEBUG nova.virt.libvirt.host [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=71874) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 15:55:18 user nova-compute[71874]: DEBUG nova.virt.libvirt.host [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=71874) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 15:55:18 user nova-compute[71874]: DEBUG nova.virt.libvirt.host [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=71874) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 15:55:18 user nova-compute[71874]: DEBUG nova.virt.libvirt.host [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=71874) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 15:55:18 user nova-compute[71874]: DEBUG nova.virt.libvirt.host [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=71874) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 15:55:18 user nova-compute[71874]: DEBUG nova.virt.libvirt.host [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=71874) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 15:55:18 user nova-compute[71874]: DEBUG nova.virt.libvirt.host [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=71874) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 15:55:18 user nova-compute[71874]: DEBUG nova.virt.libvirt.host [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=71874) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 15:55:18 user nova-compute[71874]: DEBUG nova.virt.libvirt.host [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=71874) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 15:55:18 user nova-compute[71874]: DEBUG nova.virt.libvirt.host [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Getting domain capabilities for ppc64 via machine types: {'pseries', 'powernv', None} {{(pid=71874) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 15:55:18 user nova-compute[71874]: DEBUG nova.virt.libvirt.host [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=71874) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 15:55:18 user nova-compute[71874]: DEBUG nova.virt.libvirt.host [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=71874) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 15:55:18 user nova-compute[71874]: DEBUG nova.virt.libvirt.host [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=71874) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 15:55:18 user nova-compute[71874]: DEBUG nova.virt.libvirt.host [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=71874) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 15:55:18 user nova-compute[71874]: DEBUG nova.virt.libvirt.host [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=71874) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 15:55:18 user nova-compute[71874]: DEBUG nova.virt.libvirt.host [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=71874) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 15:55:18 user nova-compute[71874]: DEBUG nova.virt.libvirt.host [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=71874) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 15:55:18 user nova-compute[71874]: DEBUG nova.virt.libvirt.host [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=71874) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 15:55:18 user nova-compute[71874]: DEBUG nova.virt.libvirt.host [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=71874) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 15:55:18 user nova-compute[71874]: DEBUG nova.virt.libvirt.host [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=71874) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 15:55:18 user nova-compute[71874]: DEBUG nova.virt.libvirt.host [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=71874) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 15:55:18 user nova-compute[71874]: DEBUG nova.virt.libvirt.host [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=71874) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 15:55:18 user nova-compute[71874]: DEBUG nova.virt.libvirt.host [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=71874) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 15:55:18 user nova-compute[71874]: DEBUG nova.virt.libvirt.host [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=71874) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 15:55:18 user nova-compute[71874]: DEBUG nova.virt.libvirt.host [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=71874) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 15:55:18 user nova-compute[71874]: DEBUG nova.virt.libvirt.host [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=71874) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 15:55:18 user nova-compute[71874]: DEBUG nova.virt.libvirt.host [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=71874) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 15:55:18 user nova-compute[71874]: DEBUG nova.virt.libvirt.host [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=71874) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 15:55:18 user nova-compute[71874]: DEBUG nova.virt.libvirt.host [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=71874) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 15:55:18 user nova-compute[71874]: DEBUG nova.virt.libvirt.host [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=71874) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 15:55:18 user nova-compute[71874]: DEBUG nova.virt.libvirt.host [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Getting domain capabilities for x86_64 via machine types: {'ubuntu-q35', 'pc', 'q35', 'ubuntu'} {{(pid=71874) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 15:55:18 user nova-compute[71874]: DEBUG nova.virt.libvirt.host [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Apr 12 15:55:18 user nova-compute[71874]: <domainCapabilities>
Apr 12 15:55:18 user nova-compute[71874]:   <path>/usr/bin/qemu-system-x86_64</path>
Apr 12 15:55:18 user nova-compute[71874]:   <domain>kvm</domain>
Apr 12 15:55:18 user nova-compute[71874]:   <machine>pc-q35-jammy</machine>
Apr 12 15:55:18 user nova-compute[71874]:   <arch>x86_64</arch>
Apr 12 15:55:18 user nova-compute[71874]:   <vcpu max='288'/>
Apr 12 15:55:18 user nova-compute[71874]:   <iothreads supported='yes'/>
Apr 12 15:55:18 user nova-compute[71874]:   <os supported='yes'>
Apr 12 15:55:18 user nova-compute[71874]:     <enum name='firmware'>
Apr 12 15:55:18 user nova-compute[71874]:       <value>efi</value>
Apr 12 15:55:18 user nova-compute[71874]:     </enum>
Apr 12 15:55:18 user nova-compute[71874]:     <loader supported='yes'>
Apr 12 15:55:18 user nova-compute[71874]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Apr 12 15:55:18 user nova-compute[71874]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Apr 12 15:55:18 user nova-compute[71874]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='type'>
Apr 12 15:55:18 user nova-compute[71874]:         <value>rom</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>pflash</value>
Apr 12 15:55:18 user nova-compute[71874]:       </enum>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='readonly'>
Apr 12 15:55:18 user nova-compute[71874]:         <value>yes</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>no</value>
Apr 12 15:55:18 user nova-compute[71874]:       </enum>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='secure'>
Apr 12 15:55:18 user nova-compute[71874]:         <value>yes</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>no</value>
Apr 12 15:55:18 user nova-compute[71874]:       </enum>
Apr 12 15:55:18 user nova-compute[71874]:     </loader>
Apr 12 15:55:18 user nova-compute[71874]:   </os>
Apr 12 15:55:18 user nova-compute[71874]:   <cpu>
Apr 12 15:55:18 user nova-compute[71874]:     <mode name='host-passthrough' supported='yes'>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='hostPassthroughMigratable'>
Apr 12 15:55:18 user nova-compute[71874]:         <value>on</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>off</value>
Apr 12 15:55:18 user nova-compute[71874]:       </enum>
Apr 12 15:55:18 user nova-compute[71874]:     </mode>
Apr 12 15:55:18 user nova-compute[71874]:     <mode name='maximum' supported='yes'>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='maximumMigratable'>
Apr 12 15:55:18 user nova-compute[71874]:         <value>on</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>off</value>
Apr 12 15:55:18 user nova-compute[71874]:       </enum>
Apr 12 15:55:18 user nova-compute[71874]:     </mode>
Apr 12 15:55:18 user nova-compute[71874]:     <mode name='host-model' supported='yes'>
Apr 12 15:55:18 user nova-compute[71874]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 12 15:55:18 user nova-compute[71874]:       <vendor>Intel</vendor>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='require' name='ss'/>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='require' name='vmx'/>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='require' name='pcid'/>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='require' name='hypervisor'/>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='require' name='arat'/>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='require' name='tsc_adjust'/>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='require' name='umip'/>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='require' name='md-clear'/>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='require' name='stibp'/>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='require' name='arch-capabilities'/>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='require' name='ssbd'/>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='require' name='invtsc'/>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='require' name='ibpb'/>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='require' name='ibrs'/>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='require' name='amd-stibp'/>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='require' name='amd-ssbd'/>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='require' name='rsba'/>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='require' name='pschange-mc-no'/>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='disable' name='erms'/>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='disable' name='xsaveopt'/>
Apr 12 15:55:18 user nova-compute[71874]:     </mode>
Apr 12 15:55:18 user nova-compute[71874]:     <mode name='custom' supported='yes'>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>qemu64</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='yes'>qemu32</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>phenom</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='yes'>pentium3</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='yes'>pentium2</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='yes'>pentium</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>n270</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='yes'>kvm64</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='yes'>kvm32</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='yes'>coreduo</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='yes'>core2duo</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>athlon</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='yes'>Westmere-IBRS</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='yes'>Westmere</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Snowridge</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Skylake-Server</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Skylake-Client</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>SandyBridge</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='yes'>Penryn</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Opteron_G5</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Opteron_G4</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Opteron_G3</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Opteron_G2</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='yes'>Opteron_G1</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='yes'>Nehalem-IBRS</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='yes'>Nehalem</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>IvyBridge</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Icelake-Server</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Haswell-noTSX</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Haswell-IBRS</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Haswell</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>EPYC-Rome</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>EPYC-Milan</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>EPYC-IBPB</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>EPYC</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Dhyana</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Cooperlake</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='yes'>Conroe</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Cascadelake-Server</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Broadwell-noTSX</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Broadwell-IBRS</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Broadwell</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='yes'>486</model>
Apr 12 15:55:18 user nova-compute[71874]:     </mode>
Apr 12 15:55:18 user nova-compute[71874]:   </cpu>
Apr 12 15:55:18 user nova-compute[71874]:   <memoryBacking supported='yes'>
Apr 12 15:55:18 user nova-compute[71874]:     <enum name='sourceType'>
Apr 12 15:55:18 user nova-compute[71874]:       <value>file</value>
Apr 12 15:55:18 user nova-compute[71874]:       <value>anonymous</value>
Apr 12 15:55:18 user nova-compute[71874]:       <value>memfd</value>
Apr 12 15:55:18 user nova-compute[71874]:     </enum>
Apr 12 15:55:18 user nova-compute[71874]:   </memoryBacking>
Apr 12 15:55:18 user nova-compute[71874]:   <devices>
Apr 12 15:55:18 user nova-compute[71874]:     <disk supported='yes'>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='diskDevice'>
Apr 12 15:55:18 user nova-compute[71874]:         <value>disk</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>cdrom</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>floppy</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>lun</value>
Apr 12 15:55:18 user nova-compute[71874]:       </enum>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='bus'>
Apr 12 15:55:18 user nova-compute[71874]:         <value>fdc</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>scsi</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>virtio</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>usb</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>sata</value>
Apr 12 15:55:18 user nova-compute[71874]:       </enum>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='model'>
Apr 12 15:55:18 user nova-compute[71874]:         <value>virtio</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>virtio-transitional</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>virtio-non-transitional</value>
Apr 12 15:55:18 user nova-compute[71874]:       </enum>
Apr 12 15:55:18 user nova-compute[71874]:     </disk>
Apr 12 15:55:18 user nova-compute[71874]:     <graphics supported='yes'>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='type'>
Apr 12 15:55:18 user nova-compute[71874]:         <value>sdl</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>vnc</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>spice</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>egl-headless</value>
Apr 12 15:55:18 user nova-compute[71874]:       </enum>
Apr 12 15:55:18 user nova-compute[71874]:     </graphics>
Apr 12 15:55:18 user nova-compute[71874]:     <video supported='yes'>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='modelType'>
Apr 12 15:55:18 user nova-compute[71874]:         <value>vga</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>cirrus</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>vmvga</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>qxl</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>virtio</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>none</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>bochs</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>ramfb</value>
Apr 12 15:55:18 user nova-compute[71874]:       </enum>
Apr 12 15:55:18 user nova-compute[71874]:     </video>
Apr 12 15:55:18 user nova-compute[71874]:     <hostdev supported='yes'>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='mode'>
Apr 12 15:55:18 user nova-compute[71874]:         <value>subsystem</value>
Apr 12 15:55:18 user nova-compute[71874]:       </enum>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='startupPolicy'>
Apr 12 15:55:18 user nova-compute[71874]:         <value>default</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>mandatory</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>requisite</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>optional</value>
Apr 12 15:55:18 user nova-compute[71874]:       </enum>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='subsysType'>
Apr 12 15:55:18 user nova-compute[71874]:         <value>usb</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>pci</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>scsi</value>
Apr 12 15:55:18 user nova-compute[71874]:       </enum>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='capsType'/>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='pciBackend'/>
Apr 12 15:55:18 user nova-compute[71874]:     </hostdev>
Apr 12 15:55:18 user nova-compute[71874]:     <rng supported='yes'>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='model'>
Apr 12 15:55:18 user nova-compute[71874]:         <value>virtio</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>virtio-transitional</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>virtio-non-transitional</value>
Apr 12 15:55:18 user nova-compute[71874]:       </enum>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='backendModel'>
Apr 12 15:55:18 user nova-compute[71874]:         <value>random</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>egd</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>builtin</value>
Apr 12 15:55:18 user nova-compute[71874]:       </enum>
Apr 12 15:55:18 user nova-compute[71874]:     </rng>
Apr 12 15:55:18 user nova-compute[71874]:     <filesystem supported='yes'>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='driverType'>
Apr 12 15:55:18 user nova-compute[71874]:         <value>path</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>handle</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>virtiofs</value>
Apr 12 15:55:18 user nova-compute[71874]:       </enum>
Apr 12 15:55:18 user nova-compute[71874]:     </filesystem>
Apr 12 15:55:18 user nova-compute[71874]:     <tpm supported='yes'>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='model'>
Apr 12 15:55:18 user nova-compute[71874]:         <value>tpm-tis</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>tpm-crb</value>
Apr 12 15:55:18 user nova-compute[71874]:       </enum>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='backendModel'>
Apr 12 15:55:18 user nova-compute[71874]:         <value>passthrough</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>emulator</value>
Apr 12 15:55:18 user nova-compute[71874]:       </enum>
Apr 12 15:55:18 user nova-compute[71874]:     </tpm>
Apr 12 15:55:18 user nova-compute[71874]:   </devices>
Apr 12 15:55:18 user nova-compute[71874]:   <features>
Apr 12 15:55:18 user nova-compute[71874]:     <gic supported='no'/>
Apr 12 15:55:18 user nova-compute[71874]:     <vmcoreinfo supported='yes'/>
Apr 12 15:55:18 user nova-compute[71874]:     <genid supported='yes'/>
Apr 12 15:55:18 user nova-compute[71874]:     <backingStoreInput supported='yes'/>
Apr 12 15:55:18 user nova-compute[71874]:     <backup supported='yes'/>
Apr 12 15:55:18 user nova-compute[71874]:     <sev supported='no'/>
Apr 12 15:55:18 user nova-compute[71874]:   </features>
Apr 12 15:55:18 user nova-compute[71874]: </domainCapabilities>
Apr 12 15:55:18 user nova-compute[71874]:  {{(pid=71874) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 12 15:55:18 user nova-compute[71874]: DEBUG nova.virt.libvirt.host [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Apr 12 15:55:18 user nova-compute[71874]: <domainCapabilities>
Apr 12 15:55:18 user nova-compute[71874]:   <path>/usr/bin/qemu-system-x86_64</path>
Apr 12 15:55:18 user nova-compute[71874]:   <domain>kvm</domain>
Apr 12 15:55:18 user nova-compute[71874]:   <machine>pc-i440fx-6.2</machine>
Apr 12 15:55:18 user nova-compute[71874]:   <arch>x86_64</arch>
Apr 12 15:55:18 user nova-compute[71874]:   <vcpu max='255'/>
Apr 12 15:55:18 user nova-compute[71874]:   <iothreads supported='yes'/>
Apr 12 15:55:18 user nova-compute[71874]:   <os supported='yes'>
Apr 12 15:55:18 user nova-compute[71874]:     <enum name='firmware'>
Apr 12 15:55:18 user nova-compute[71874]:       <value>efi</value>
Apr 12 15:55:18 user nova-compute[71874]:     </enum>
Apr 12 15:55:18 user nova-compute[71874]:     <loader supported='yes'>
Apr 12 15:55:18 user nova-compute[71874]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='type'>
Apr 12 15:55:18 user nova-compute[71874]:         <value>rom</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>pflash</value>
Apr 12 15:55:18 user nova-compute[71874]:       </enum>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='readonly'>
Apr 12 15:55:18 user nova-compute[71874]:         <value>yes</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>no</value>
Apr 12 15:55:18 user nova-compute[71874]:       </enum>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='secure'>
Apr 12 15:55:18 user nova-compute[71874]:         <value>no</value>
Apr 12 15:55:18 user nova-compute[71874]:       </enum>
Apr 12 15:55:18 user nova-compute[71874]:     </loader>
Apr 12 15:55:18 user nova-compute[71874]:   </os>
Apr 12 15:55:18 user nova-compute[71874]:   <cpu>
Apr 12 15:55:18 user nova-compute[71874]:     <mode name='host-passthrough' supported='yes'>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='hostPassthroughMigratable'>
Apr 12 15:55:18 user nova-compute[71874]:         <value>on</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>off</value>
Apr 12 15:55:18 user nova-compute[71874]:       </enum>
Apr 12 15:55:18 user nova-compute[71874]:     </mode>
Apr 12 15:55:18 user nova-compute[71874]:     <mode name='maximum' supported='yes'>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='maximumMigratable'>
Apr 12 15:55:18 user nova-compute[71874]:         <value>on</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>off</value>
Apr 12 15:55:18 user nova-compute[71874]:       </enum>
Apr 12 15:55:18 user nova-compute[71874]:     </mode>
Apr 12 15:55:18 user nova-compute[71874]:     <mode name='host-model' supported='yes'>
Apr 12 15:55:18 user nova-compute[71874]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 12 15:55:18 user nova-compute[71874]:       <vendor>Intel</vendor>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='require' name='ss'/>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='require' name='vmx'/>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='require' name='pcid'/>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='require' name='hypervisor'/>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='require' name='arat'/>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='require' name='tsc_adjust'/>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='require' name='umip'/>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='require' name='md-clear'/>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='require' name='stibp'/>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='require' name='arch-capabilities'/>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='require' name='ssbd'/>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='require' name='invtsc'/>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='require' name='ibpb'/>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='require' name='ibrs'/>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='require' name='amd-stibp'/>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='require' name='amd-ssbd'/>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='require' name='rsba'/>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='require' name='pschange-mc-no'/>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='disable' name='erms'/>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='disable' name='xsaveopt'/>
Apr 12 15:55:18 user nova-compute[71874]:     </mode>
Apr 12 15:55:18 user nova-compute[71874]:     <mode name='custom' supported='yes'>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>qemu64</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='yes'>qemu32</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>phenom</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='yes'>pentium3</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='yes'>pentium2</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='yes'>pentium</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>n270</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='yes'>kvm64</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='yes'>kvm32</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='yes'>coreduo</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='yes'>core2duo</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>athlon</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='yes'>Westmere-IBRS</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='yes'>Westmere</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Snowridge</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Skylake-Server</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Skylake-Client</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>SandyBridge</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='yes'>Penryn</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Opteron_G5</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Opteron_G4</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Opteron_G3</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Opteron_G2</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='yes'>Opteron_G1</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='yes'>Nehalem-IBRS</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='yes'>Nehalem</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>IvyBridge</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Icelake-Server</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Haswell-noTSX</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Haswell-IBRS</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Haswell</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>EPYC-Rome</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>EPYC-Milan</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>EPYC-IBPB</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>EPYC</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Dhyana</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Cooperlake</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='yes'>Conroe</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Cascadelake-Server</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Broadwell-noTSX</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Broadwell-IBRS</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Broadwell</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='yes'>486</model>
Apr 12 15:55:18 user nova-compute[71874]:     </mode>
Apr 12 15:55:18 user nova-compute[71874]:   </cpu>
Apr 12 15:55:18 user nova-compute[71874]:   <memoryBacking supported='yes'>
Apr 12 15:55:18 user nova-compute[71874]:     <enum name='sourceType'>
Apr 12 15:55:18 user nova-compute[71874]:       <value>file</value>
Apr 12 15:55:18 user nova-compute[71874]:       <value>anonymous</value>
Apr 12 15:55:18 user nova-compute[71874]:       <value>memfd</value>
Apr 12 15:55:18 user nova-compute[71874]:     </enum>
Apr 12 15:55:18 user nova-compute[71874]:   </memoryBacking>
Apr 12 15:55:18 user nova-compute[71874]:   <devices>
Apr 12 15:55:18 user nova-compute[71874]:     <disk supported='yes'>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='diskDevice'>
Apr 12 15:55:18 user nova-compute[71874]:         <value>disk</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>cdrom</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>floppy</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>lun</value>
Apr 12 15:55:18 user nova-compute[71874]:       </enum>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='bus'>
Apr 12 15:55:18 user nova-compute[71874]:         <value>ide</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>fdc</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>scsi</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>virtio</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>usb</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>sata</value>
Apr 12 15:55:18 user nova-compute[71874]:       </enum>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='model'>
Apr 12 15:55:18 user nova-compute[71874]:         <value>virtio</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>virtio-transitional</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>virtio-non-transitional</value>
Apr 12 15:55:18 user nova-compute[71874]:       </enum>
Apr 12 15:55:18 user nova-compute[71874]:     </disk>
Apr 12 15:55:18 user nova-compute[71874]:     <graphics supported='yes'>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='type'>
Apr 12 15:55:18 user nova-compute[71874]:         <value>sdl</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>vnc</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>spice</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>egl-headless</value>
Apr 12 15:55:18 user nova-compute[71874]:       </enum>
Apr 12 15:55:18 user nova-compute[71874]:     </graphics>
Apr 12 15:55:18 user nova-compute[71874]:     <video supported='yes'>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='modelType'>
Apr 12 15:55:18 user nova-compute[71874]:         <value>vga</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>cirrus</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>vmvga</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>qxl</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>virtio</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>none</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>bochs</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>ramfb</value>
Apr 12 15:55:18 user nova-compute[71874]:       </enum>
Apr 12 15:55:18 user nova-compute[71874]:     </video>
Apr 12 15:55:18 user nova-compute[71874]:     <hostdev supported='yes'>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='mode'>
Apr 12 15:55:18 user nova-compute[71874]:         <value>subsystem</value>
Apr 12 15:55:18 user nova-compute[71874]:       </enum>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='startupPolicy'>
Apr 12 15:55:18 user nova-compute[71874]:         <value>default</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>mandatory</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>requisite</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>optional</value>
Apr 12 15:55:18 user nova-compute[71874]:       </enum>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='subsysType'>
Apr 12 15:55:18 user nova-compute[71874]:         <value>usb</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>pci</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>scsi</value>
Apr 12 15:55:18 user nova-compute[71874]:       </enum>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='capsType'/>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='pciBackend'/>
Apr 12 15:55:18 user nova-compute[71874]:     </hostdev>
Apr 12 15:55:18 user nova-compute[71874]:     <rng supported='yes'>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='model'>
Apr 12 15:55:18 user nova-compute[71874]:         <value>virtio</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>virtio-transitional</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>virtio-non-transitional</value>
Apr 12 15:55:18 user nova-compute[71874]:       </enum>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='backendModel'>
Apr 12 15:55:18 user nova-compute[71874]:         <value>random</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>egd</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>builtin</value>
Apr 12 15:55:18 user nova-compute[71874]:       </enum>
Apr 12 15:55:18 user nova-compute[71874]:     </rng>
Apr 12 15:55:18 user nova-compute[71874]:     <filesystem supported='yes'>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='driverType'>
Apr 12 15:55:18 user nova-compute[71874]:         <value>path</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>handle</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>virtiofs</value>
Apr 12 15:55:18 user nova-compute[71874]:       </enum>
Apr 12 15:55:18 user nova-compute[71874]:     </filesystem>
Apr 12 15:55:18 user nova-compute[71874]:     <tpm supported='yes'>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='model'>
Apr 12 15:55:18 user nova-compute[71874]:         <value>tpm-tis</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>tpm-crb</value>
Apr 12 15:55:18 user nova-compute[71874]:       </enum>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='backendModel'>
Apr 12 15:55:18 user nova-compute[71874]:         <value>passthrough</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>emulator</value>
Apr 12 15:55:18 user nova-compute[71874]:       </enum>
Apr 12 15:55:18 user nova-compute[71874]:     </tpm>
Apr 12 15:55:18 user nova-compute[71874]:   </devices>
Apr 12 15:55:18 user nova-compute[71874]:   <features>
Apr 12 15:55:18 user nova-compute[71874]:     <gic supported='no'/>
Apr 12 15:55:18 user nova-compute[71874]:     <vmcoreinfo supported='yes'/>
Apr 12 15:55:18 user nova-compute[71874]:     <genid supported='yes'/>
Apr 12 15:55:18 user nova-compute[71874]:     <backingStoreInput supported='yes'/>
Apr 12 15:55:18 user nova-compute[71874]:     <backup supported='yes'/>
Apr 12 15:55:18 user nova-compute[71874]:     <sev supported='no'/>
Apr 12 15:55:18 user nova-compute[71874]:   </features>
Apr 12 15:55:18 user nova-compute[71874]: </domainCapabilities>
Apr 12 15:55:18 user nova-compute[71874]:  {{(pid=71874) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 12 15:55:18 user nova-compute[71874]: DEBUG nova.virt.libvirt.host [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Apr 12 15:55:18 user nova-compute[71874]: <domainCapabilities>
Apr 12 15:55:18 user nova-compute[71874]:   <path>/usr/bin/qemu-system-x86_64</path>
Apr 12 15:55:18 user nova-compute[71874]:   <domain>kvm</domain>
Apr 12 15:55:18 user nova-compute[71874]:   <machine>pc-q35-6.2</machine>
Apr 12 15:55:18 user nova-compute[71874]:   <arch>x86_64</arch>
Apr 12 15:55:18 user nova-compute[71874]:   <vcpu max='288'/>
Apr 12 15:55:18 user nova-compute[71874]:   <iothreads supported='yes'/>
Apr 12 15:55:18 user nova-compute[71874]:   <os supported='yes'>
Apr 12 15:55:18 user nova-compute[71874]:     <enum name='firmware'>
Apr 12 15:55:18 user nova-compute[71874]:       <value>efi</value>
Apr 12 15:55:18 user nova-compute[71874]:     </enum>
Apr 12 15:55:18 user nova-compute[71874]:     <loader supported='yes'>
Apr 12 15:55:18 user nova-compute[71874]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Apr 12 15:55:18 user nova-compute[71874]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Apr 12 15:55:18 user nova-compute[71874]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='type'>
Apr 12 15:55:18 user nova-compute[71874]:         <value>rom</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>pflash</value>
Apr 12 15:55:18 user nova-compute[71874]:       </enum>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='readonly'>
Apr 12 15:55:18 user nova-compute[71874]:         <value>yes</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>no</value>
Apr 12 15:55:18 user nova-compute[71874]:       </enum>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='secure'>
Apr 12 15:55:18 user nova-compute[71874]:         <value>yes</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>no</value>
Apr 12 15:55:18 user nova-compute[71874]:       </enum>
Apr 12 15:55:18 user nova-compute[71874]:     </loader>
Apr 12 15:55:18 user nova-compute[71874]:   </os>
Apr 12 15:55:18 user nova-compute[71874]:   <cpu>
Apr 12 15:55:18 user nova-compute[71874]:     <mode name='host-passthrough' supported='yes'>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='hostPassthroughMigratable'>
Apr 12 15:55:18 user nova-compute[71874]:         <value>on</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>off</value>
Apr 12 15:55:18 user nova-compute[71874]:       </enum>
Apr 12 15:55:18 user nova-compute[71874]:     </mode>
Apr 12 15:55:18 user nova-compute[71874]:     <mode name='maximum' supported='yes'>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='maximumMigratable'>
Apr 12 15:55:18 user nova-compute[71874]:         <value>on</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>off</value>
Apr 12 15:55:18 user nova-compute[71874]:       </enum>
Apr 12 15:55:18 user nova-compute[71874]:     </mode>
Apr 12 15:55:18 user nova-compute[71874]:     <mode name='host-model' supported='yes'>
Apr 12 15:55:18 user nova-compute[71874]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 12 15:55:18 user nova-compute[71874]:       <vendor>Intel</vendor>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='require' name='ss'/>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='require' name='vmx'/>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='require' name='pcid'/>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='require' name='hypervisor'/>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='require' name='arat'/>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='require' name='tsc_adjust'/>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='require' name='umip'/>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='require' name='md-clear'/>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='require' name='stibp'/>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='require' name='arch-capabilities'/>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='require' name='ssbd'/>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='require' name='invtsc'/>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='require' name='ibpb'/>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='require' name='ibrs'/>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='require' name='amd-stibp'/>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='require' name='amd-ssbd'/>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='require' name='rsba'/>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='require' name='pschange-mc-no'/>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='disable' name='erms'/>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='disable' name='xsaveopt'/>
Apr 12 15:55:18 user nova-compute[71874]:     </mode>
Apr 12 15:55:18 user nova-compute[71874]:     <mode name='custom' supported='yes'>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>qemu64</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='yes'>qemu32</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>phenom</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='yes'>pentium3</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='yes'>pentium2</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='yes'>pentium</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>n270</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='yes'>kvm64</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='yes'>kvm32</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='yes'>coreduo</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='yes'>core2duo</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>athlon</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='yes'>Westmere-IBRS</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='yes'>Westmere</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Snowridge</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Skylake-Server</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Skylake-Client</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>SandyBridge</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='yes'>Penryn</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Opteron_G5</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Opteron_G4</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Opteron_G3</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Opteron_G2</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='yes'>Opteron_G1</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='yes'>Nehalem-IBRS</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='yes'>Nehalem</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>IvyBridge</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Icelake-Server</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Haswell-noTSX</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Haswell-IBRS</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Haswell</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>EPYC-Rome</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>EPYC-Milan</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>EPYC-IBPB</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>EPYC</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Dhyana</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Cooperlake</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='yes'>Conroe</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Cascadelake-Server</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Broadwell-noTSX</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Broadwell-IBRS</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Broadwell</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='yes'>486</model>
Apr 12 15:55:18 user nova-compute[71874]:     </mode>
Apr 12 15:55:18 user nova-compute[71874]:   </cpu>
Apr 12 15:55:18 user nova-compute[71874]:   <memoryBacking supported='yes'>
Apr 12 15:55:18 user nova-compute[71874]:     <enum name='sourceType'>
Apr 12 15:55:18 user nova-compute[71874]:       <value>file</value>
Apr 12 15:55:18 user nova-compute[71874]:       <value>anonymous</value>
Apr 12 15:55:18 user nova-compute[71874]:       <value>memfd</value>
Apr 12 15:55:18 user nova-compute[71874]:     </enum>
Apr 12 15:55:18 user nova-compute[71874]:   </memoryBacking>
Apr 12 15:55:18 user nova-compute[71874]:   <devices>
Apr 12 15:55:18 user nova-compute[71874]:     <disk supported='yes'>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='diskDevice'>
Apr 12 15:55:18 user nova-compute[71874]:         <value>disk</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>cdrom</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>floppy</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>lun</value>
Apr 12 15:55:18 user nova-compute[71874]:       </enum>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='bus'>
Apr 12 15:55:18 user nova-compute[71874]:         <value>fdc</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>scsi</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>virtio</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>usb</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>sata</value>
Apr 12 15:55:18 user nova-compute[71874]:       </enum>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='model'>
Apr 12 15:55:18 user nova-compute[71874]:         <value>virtio</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>virtio-transitional</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>virtio-non-transitional</value>
Apr 12 15:55:18 user nova-compute[71874]:       </enum>
Apr 12 15:55:18 user nova-compute[71874]:     </disk>
Apr 12 15:55:18 user nova-compute[71874]:     <graphics supported='yes'>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='type'>
Apr 12 15:55:18 user nova-compute[71874]:         <value>sdl</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>vnc</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>spice</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>egl-headless</value>
Apr 12 15:55:18 user nova-compute[71874]:       </enum>
Apr 12 15:55:18 user nova-compute[71874]:     </graphics>
Apr 12 15:55:18 user nova-compute[71874]:     <video supported='yes'>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='modelType'>
Apr 12 15:55:18 user nova-compute[71874]:         <value>vga</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>cirrus</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>vmvga</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>qxl</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>virtio</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>none</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>bochs</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>ramfb</value>
Apr 12 15:55:18 user nova-compute[71874]:       </enum>
Apr 12 15:55:18 user nova-compute[71874]:     </video>
Apr 12 15:55:18 user nova-compute[71874]:     <hostdev supported='yes'>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='mode'>
Apr 12 15:55:18 user nova-compute[71874]:         <value>subsystem</value>
Apr 12 15:55:18 user nova-compute[71874]:       </enum>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='startupPolicy'>
Apr 12 15:55:18 user nova-compute[71874]:         <value>default</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>mandatory</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>requisite</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>optional</value>
Apr 12 15:55:18 user nova-compute[71874]:       </enum>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='subsysType'>
Apr 12 15:55:18 user nova-compute[71874]:         <value>usb</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>pci</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>scsi</value>
Apr 12 15:55:18 user nova-compute[71874]:       </enum>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='capsType'/>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='pciBackend'/>
Apr 12 15:55:18 user nova-compute[71874]:     </hostdev>
Apr 12 15:55:18 user nova-compute[71874]:     <rng supported='yes'>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='model'>
Apr 12 15:55:18 user nova-compute[71874]:         <value>virtio</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>virtio-transitional</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>virtio-non-transitional</value>
Apr 12 15:55:18 user nova-compute[71874]:       </enum>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='backendModel'>
Apr 12 15:55:18 user nova-compute[71874]:         <value>random</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>egd</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>builtin</value>
Apr 12 15:55:18 user nova-compute[71874]:       </enum>
Apr 12 15:55:18 user nova-compute[71874]:     </rng>
Apr 12 15:55:18 user nova-compute[71874]:     <filesystem supported='yes'>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='driverType'>
Apr 12 15:55:18 user nova-compute[71874]:         <value>path</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>handle</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>virtiofs</value>
Apr 12 15:55:18 user nova-compute[71874]:       </enum>
Apr 12 15:55:18 user nova-compute[71874]:     </filesystem>
Apr 12 15:55:18 user nova-compute[71874]:     <tpm supported='yes'>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='model'>
Apr 12 15:55:18 user nova-compute[71874]:         <value>tpm-tis</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>tpm-crb</value>
Apr 12 15:55:18 user nova-compute[71874]:       </enum>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='backendModel'>
Apr 12 15:55:18 user nova-compute[71874]:         <value>passthrough</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>emulator</value>
Apr 12 15:55:18 user nova-compute[71874]:       </enum>
Apr 12 15:55:18 user nova-compute[71874]:     </tpm>
Apr 12 15:55:18 user nova-compute[71874]:   </devices>
Apr 12 15:55:18 user nova-compute[71874]:   <features>
Apr 12 15:55:18 user nova-compute[71874]:     <gic supported='no'/>
Apr 12 15:55:18 user nova-compute[71874]:     <vmcoreinfo supported='yes'/>
Apr 12 15:55:18 user nova-compute[71874]:     <genid supported='yes'/>
Apr 12 15:55:18 user nova-compute[71874]:     <backingStoreInput supported='yes'/>
Apr 12 15:55:18 user nova-compute[71874]:     <backup supported='yes'/>
Apr 12 15:55:18 user nova-compute[71874]:     <sev supported='no'/>
Apr 12 15:55:18 user nova-compute[71874]:   </features>
Apr 12 15:55:18 user nova-compute[71874]: </domainCapabilities>
Apr 12 15:55:18 user nova-compute[71874]:  {{(pid=71874) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 12 15:55:18 user nova-compute[71874]: DEBUG nova.virt.libvirt.host [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Apr 12 15:55:18 user nova-compute[71874]: <domainCapabilities>
Apr 12 15:55:18 user nova-compute[71874]:   <path>/usr/bin/qemu-system-x86_64</path>
Apr 12 15:55:18 user nova-compute[71874]:   <domain>kvm</domain>
Apr 12 15:55:18 user nova-compute[71874]:   <machine>pc-i440fx-jammy</machine>
Apr 12 15:55:18 user nova-compute[71874]:   <arch>x86_64</arch>
Apr 12 15:55:18 user nova-compute[71874]:   <vcpu max='255'/>
Apr 12 15:55:18 user nova-compute[71874]:   <iothreads supported='yes'/>
Apr 12 15:55:18 user nova-compute[71874]:   <os supported='yes'>
Apr 12 15:55:18 user nova-compute[71874]:     <enum name='firmware'>
Apr 12 15:55:18 user nova-compute[71874]:       <value>efi</value>
Apr 12 15:55:18 user nova-compute[71874]:     </enum>
Apr 12 15:55:18 user nova-compute[71874]:     <loader supported='yes'>
Apr 12 15:55:18 user nova-compute[71874]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='type'>
Apr 12 15:55:18 user nova-compute[71874]:         <value>rom</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>pflash</value>
Apr 12 15:55:18 user nova-compute[71874]:       </enum>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='readonly'>
Apr 12 15:55:18 user nova-compute[71874]:         <value>yes</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>no</value>
Apr 12 15:55:18 user nova-compute[71874]:       </enum>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='secure'>
Apr 12 15:55:18 user nova-compute[71874]:         <value>no</value>
Apr 12 15:55:18 user nova-compute[71874]:       </enum>
Apr 12 15:55:18 user nova-compute[71874]:     </loader>
Apr 12 15:55:18 user nova-compute[71874]:   </os>
Apr 12 15:55:18 user nova-compute[71874]:   <cpu>
Apr 12 15:55:18 user nova-compute[71874]:     <mode name='host-passthrough' supported='yes'>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='hostPassthroughMigratable'>
Apr 12 15:55:18 user nova-compute[71874]:         <value>on</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>off</value>
Apr 12 15:55:18 user nova-compute[71874]:       </enum>
Apr 12 15:55:18 user nova-compute[71874]:     </mode>
Apr 12 15:55:18 user nova-compute[71874]:     <mode name='maximum' supported='yes'>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='maximumMigratable'>
Apr 12 15:55:18 user nova-compute[71874]:         <value>on</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>off</value>
Apr 12 15:55:18 user nova-compute[71874]:       </enum>
Apr 12 15:55:18 user nova-compute[71874]:     </mode>
Apr 12 15:55:18 user nova-compute[71874]:     <mode name='host-model' supported='yes'>
Apr 12 15:55:18 user nova-compute[71874]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 12 15:55:18 user nova-compute[71874]:       <vendor>Intel</vendor>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='require' name='ss'/>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='require' name='vmx'/>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='require' name='pcid'/>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='require' name='hypervisor'/>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='require' name='arat'/>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='require' name='tsc_adjust'/>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='require' name='umip'/>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='require' name='md-clear'/>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='require' name='stibp'/>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='require' name='arch-capabilities'/>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='require' name='ssbd'/>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='require' name='invtsc'/>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='require' name='ibpb'/>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='require' name='ibrs'/>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='require' name='amd-stibp'/>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='require' name='amd-ssbd'/>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='require' name='rsba'/>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='require' name='pschange-mc-no'/>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='disable' name='erms'/>
Apr 12 15:55:18 user nova-compute[71874]:       <feature policy='disable' name='xsaveopt'/>
Apr 12 15:55:18 user nova-compute[71874]:     </mode>
Apr 12 15:55:18 user nova-compute[71874]:     <mode name='custom' supported='yes'>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>qemu64</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='yes'>qemu32</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>phenom</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='yes'>pentium3</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='yes'>pentium2</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='yes'>pentium</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>n270</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='yes'>kvm64</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='yes'>kvm32</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='yes'>coreduo</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='yes'>core2duo</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>athlon</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='yes'>Westmere-IBRS</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='yes'>Westmere</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Snowridge</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Skylake-Server</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Skylake-Client</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>SandyBridge</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='yes'>Penryn</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Opteron_G5</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Opteron_G4</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Opteron_G3</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Opteron_G2</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='yes'>Opteron_G1</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='yes'>Nehalem-IBRS</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='yes'>Nehalem</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>IvyBridge</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Icelake-Server</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Haswell-noTSX</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Haswell-IBRS</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Haswell</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>EPYC-Rome</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>EPYC-Milan</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>EPYC-IBPB</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>EPYC</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Dhyana</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Cooperlake</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='yes'>Conroe</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Cascadelake-Server</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Broadwell-noTSX</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Broadwell-IBRS</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='no'>Broadwell</model>
Apr 12 15:55:18 user nova-compute[71874]:       <model usable='yes'>486</model>
Apr 12 15:55:18 user nova-compute[71874]:     </mode>
Apr 12 15:55:18 user nova-compute[71874]:   </cpu>
Apr 12 15:55:18 user nova-compute[71874]:   <memoryBacking supported='yes'>
Apr 12 15:55:18 user nova-compute[71874]:     <enum name='sourceType'>
Apr 12 15:55:18 user nova-compute[71874]:       <value>file</value>
Apr 12 15:55:18 user nova-compute[71874]:       <value>anonymous</value>
Apr 12 15:55:18 user nova-compute[71874]:       <value>memfd</value>
Apr 12 15:55:18 user nova-compute[71874]:     </enum>
Apr 12 15:55:18 user nova-compute[71874]:   </memoryBacking>
Apr 12 15:55:18 user nova-compute[71874]:   <devices>
Apr 12 15:55:18 user nova-compute[71874]:     <disk supported='yes'>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='diskDevice'>
Apr 12 15:55:18 user nova-compute[71874]:         <value>disk</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>cdrom</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>floppy</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>lun</value>
Apr 12 15:55:18 user nova-compute[71874]:       </enum>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='bus'>
Apr 12 15:55:18 user nova-compute[71874]:         <value>ide</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>fdc</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>scsi</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>virtio</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>usb</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>sata</value>
Apr 12 15:55:18 user nova-compute[71874]:       </enum>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='model'>
Apr 12 15:55:18 user nova-compute[71874]:         <value>virtio</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>virtio-transitional</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>virtio-non-transitional</value>
Apr 12 15:55:18 user nova-compute[71874]:       </enum>
Apr 12 15:55:18 user nova-compute[71874]:     </disk>
Apr 12 15:55:18 user nova-compute[71874]:     <graphics supported='yes'>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='type'>
Apr 12 15:55:18 user nova-compute[71874]:         <value>sdl</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>vnc</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>spice</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>egl-headless</value>
Apr 12 15:55:18 user nova-compute[71874]:       </enum>
Apr 12 15:55:18 user nova-compute[71874]:     </graphics>
Apr 12 15:55:18 user nova-compute[71874]:     <video supported='yes'>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='modelType'>
Apr 12 15:55:18 user nova-compute[71874]:         <value>vga</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>cirrus</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>vmvga</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>qxl</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>virtio</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>none</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>bochs</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>ramfb</value>
Apr 12 15:55:18 user nova-compute[71874]:       </enum>
Apr 12 15:55:18 user nova-compute[71874]:     </video>
Apr 12 15:55:18 user nova-compute[71874]:     <hostdev supported='yes'>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='mode'>
Apr 12 15:55:18 user nova-compute[71874]:         <value>subsystem</value>
Apr 12 15:55:18 user nova-compute[71874]:       </enum>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='startupPolicy'>
Apr 12 15:55:18 user nova-compute[71874]:         <value>default</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>mandatory</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>requisite</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>optional</value>
Apr 12 15:55:18 user nova-compute[71874]:       </enum>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='subsysType'>
Apr 12 15:55:18 user nova-compute[71874]:         <value>usb</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>pci</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>scsi</value>
Apr 12 15:55:18 user nova-compute[71874]:       </enum>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='capsType'/>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='pciBackend'/>
Apr 12 15:55:18 user nova-compute[71874]:     </hostdev>
Apr 12 15:55:18 user nova-compute[71874]:     <rng supported='yes'>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='model'>
Apr 12 15:55:18 user nova-compute[71874]:         <value>virtio</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>virtio-transitional</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>virtio-non-transitional</value>
Apr 12 15:55:18 user nova-compute[71874]:       </enum>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='backendModel'>
Apr 12 15:55:18 user nova-compute[71874]:         <value>random</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>egd</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>builtin</value>
Apr 12 15:55:18 user nova-compute[71874]:       </enum>
Apr 12 15:55:18 user nova-compute[71874]:     </rng>
Apr 12 15:55:18 user nova-compute[71874]:     <filesystem supported='yes'>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='driverType'>
Apr 12 15:55:18 user nova-compute[71874]:         <value>path</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>handle</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>virtiofs</value>
Apr 12 15:55:18 user nova-compute[71874]:       </enum>
Apr 12 15:55:18 user nova-compute[71874]:     </filesystem>
Apr 12 15:55:18 user nova-compute[71874]:     <tpm supported='yes'>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='model'>
Apr 12 15:55:18 user nova-compute[71874]:         <value>tpm-tis</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>tpm-crb</value>
Apr 12 15:55:18 user nova-compute[71874]:       </enum>
Apr 12 15:55:18 user nova-compute[71874]:       <enum name='backendModel'>
Apr 12 15:55:18 user nova-compute[71874]:         <value>passthrough</value>
Apr 12 15:55:18 user nova-compute[71874]:         <value>emulator</value>
Apr 12 15:55:18 user nova-compute[71874]:       </enum>
Apr 12 15:55:18 user nova-compute[71874]:     </tpm>
Apr 12 15:55:18 user nova-compute[71874]:   </devices>
Apr 12 15:55:18 user nova-compute[71874]:   <features>
Apr 12 15:55:18 user nova-compute[71874]:     <gic supported='no'/>
Apr 12 15:55:18 user nova-compute[71874]:     <vmcoreinfo supported='yes'/>
Apr 12 15:55:18 user nova-compute[71874]:     <genid supported='yes'/>
Apr 12 15:55:18 user nova-compute[71874]:     <backingStoreInput supported='yes'/>
Apr 12 15:55:18 user nova-compute[71874]:     <backup supported='yes'/>
Apr 12 15:55:18 user nova-compute[71874]:     <sev supported='no'/>
Apr 12 15:55:18 user nova-compute[71874]:   </features>
Apr 12 15:55:18 user nova-compute[71874]: </domainCapabilities>
Apr 12 15:55:18 user nova-compute[71874]:  {{(pid=71874) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 12 15:55:18 user nova-compute[71874]: DEBUG nova.virt.libvirt.host [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=71874) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 15:55:18 user nova-compute[71874]: DEBUG nova.virt.libvirt.host [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=71874) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 15:55:18 user nova-compute[71874]: DEBUG nova.virt.libvirt.host [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=71874) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 15:55:18 user nova-compute[71874]: DEBUG nova.virt.libvirt.host [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=71874) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 15:55:18 user nova-compute[71874]: DEBUG nova.virt.libvirt.host [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Checking secure boot support for host arch (x86_64) {{(pid=71874) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1750}}
Apr 12 15:55:18 user nova-compute[71874]: INFO nova.virt.libvirt.host [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Secure Boot support detected
Apr 12 15:55:18 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] cpu compare xml: <cpu match="exact">
Apr 12 15:55:18 user nova-compute[71874]:   <model>Nehalem</model>
Apr 12 15:55:18 user nova-compute[71874]: </cpu>
Apr 12 15:55:18 user nova-compute[71874]:  {{(pid=71874) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:9996}}
Apr 12 15:55:18 user nova-compute[71874]: INFO nova.virt.node [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Generated node identity 0e94b4c8-cd49-45e4-9133-d36eb4b2456b
Apr 12 15:55:18 user nova-compute[71874]: INFO nova.virt.node [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Wrote node identity 0e94b4c8-cd49-45e4-9133-d36eb4b2456b to /opt/stack/data/nova/compute_id
Apr 12 15:55:18 user nova-compute[71874]: WARNING nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Compute nodes ['0e94b4c8-cd49-45e4-9133-d36eb4b2456b'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Apr 12 15:55:18 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Apr 12 15:55:18 user nova-compute[71874]: WARNING nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Apr 12 15:55:18 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 15:55:18 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 15:55:18 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 15:55:18 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Auditing locally available compute resources for user (node: user) {{(pid=71874) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 15:55:18 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 15:55:18 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 15:55:18 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Hypervisor/Node resource view: name=user free_ram=10799MB free_disk=26.87359619140625GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71874) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 15:55:18 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 15:55:18 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 15:55:18 user nova-compute[71874]: WARNING nova.compute.resource_tracker [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] No compute node record for user:0e94b4c8-cd49-45e4-9133-d36eb4b2456b: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 0e94b4c8-cd49-45e4-9133-d36eb4b2456b could not be found.
Apr 12 15:55:18 user nova-compute[71874]: INFO nova.compute.resource_tracker [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Compute node record created for user:user with uuid: 0e94b4c8-cd49-45e4-9133-d36eb4b2456b
Apr 12 15:55:18 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 15:55:18 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 15:55:18 user nova-compute[71874]: INFO nova.scheduler.client.report [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [req-945cf31b-89c9-4858-af4d-32a5c52b07df] Created resource provider record via placement API for resource provider with UUID 0e94b4c8-cd49-45e4-9133-d36eb4b2456b and name user.
Apr 12 15:55:19 user nova-compute[71874]: DEBUG nova.virt.libvirt.host [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=71874) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1766}}
Apr 12 15:55:19 user nova-compute[71874]: INFO nova.virt.libvirt.host [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] kernel doesn't support AMD SEV
Apr 12 15:55:19 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Updating inventory in ProviderTree for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b with inventory: {'MEMORY_MB': {'total': 16023, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 12 15:55:19 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71874) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 15:55:19 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Libvirt baseline CPU <cpu>
Apr 12 15:55:19 user nova-compute[71874]:   <arch>x86_64</arch>
Apr 12 15:55:19 user nova-compute[71874]:   <model>Nehalem</model>
Apr 12 15:55:19 user nova-compute[71874]:   <vendor>Intel</vendor>
Apr 12 15:55:19 user nova-compute[71874]:   <topology sockets="6" cores="1" threads="1"/>
Apr 12 15:55:19 user nova-compute[71874]: </cpu>
Apr 12 15:55:19 user nova-compute[71874]:  {{(pid=71874) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12486}}
Apr 12 15:55:19 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Updated inventory for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16023, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=71874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Apr 12 15:55:19 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Updating resource provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b generation from 0 to 1 during operation: update_inventory {{(pid=71874) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Apr 12 15:55:19 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Updating inventory in ProviderTree for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b with inventory: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 12 15:55:19 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Updating resource provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b generation from 1 to 2 during operation: update_traits {{(pid=71874) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Apr 12 15:55:19 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Compute_service record updated for user:user {{(pid=71874) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 15:55:19 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.605s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 15:55:19 user nova-compute[71874]: DEBUG nova.service [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Creating RPC server for service compute {{(pid=71874) start /opt/stack/nova/nova/service.py:182}}
Apr 12 15:55:19 user nova-compute[71874]: DEBUG nova.service [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Join ServiceGroup membership for this service compute {{(pid=71874) start /opt/stack/nova/nova/service.py:199}}
Apr 12 15:55:19 user nova-compute[71874]: DEBUG nova.servicegroup.drivers.db [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=71874) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Apr 12 15:56:05 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._sync_power_states {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 15:56:05 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 15:56:09 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 15:56:09 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 15:56:09 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Starting heal instance info cache {{(pid=71874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 15:56:09 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Rebuilding the list of instances to heal {{(pid=71874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 15:56:09 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Didn't find any instances for network info cache update. {{(pid=71874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 12 15:56:09 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 15:56:09 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 15:56:09 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 15:56:09 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 15:56:09 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 15:56:09 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 15:56:09 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71874) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 15:56:09 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 15:56:10 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 15:56:10 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 15:56:10 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 15:56:10 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Auditing locally available compute resources for user (node: user) {{(pid=71874) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 15:56:10 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 15:56:10 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 15:56:10 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Hypervisor/Node resource view: name=user free_ram=10180MB free_disk=26.787338256835938GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71874) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 15:56:10 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 15:56:10 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 15:56:10 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 15:56:10 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 15:56:10 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Inventory has not changed in ProviderTree for provider: 0e94b4c8-cd49-45e4-9133-d36eb4b2456b {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 15:56:10 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Inventory has not changed for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 15:56:10 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Compute_service record updated for user:user {{(pid=71874) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 15:56:10 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.143s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 15:57:10 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 15:57:10 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 15:57:10 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71874) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 15:57:10 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 15:57:10 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 15:57:10 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Starting heal instance info cache {{(pid=71874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 15:57:10 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Rebuilding the list of instances to heal {{(pid=71874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 15:57:10 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Didn't find any instances for network info cache update. {{(pid=71874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 12 15:57:10 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 15:57:10 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 15:57:10 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 15:57:10 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 15:57:10 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 15:57:10 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 15:57:10 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Auditing locally available compute resources for user (node: user) {{(pid=71874) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 15:57:11 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 15:57:11 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 15:57:11 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Hypervisor/Node resource view: name=user free_ram=10179MB free_disk=26.832382202148438GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71874) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 15:57:11 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 15:57:11 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 15:57:11 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 15:57:11 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 15:57:11 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Inventory has not changed in ProviderTree for provider: 0e94b4c8-cd49-45e4-9133-d36eb4b2456b {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 15:57:11 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Inventory has not changed for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 15:57:11 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Compute_service record updated for user:user {{(pid=71874) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 15:57:11 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.098s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 15:57:12 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 15:57:12 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 15:57:12 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 15:58:09 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 15:58:09 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71874) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 15:58:10 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 15:58:10 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Starting heal instance info cache {{(pid=71874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 15:58:10 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Rebuilding the list of instances to heal {{(pid=71874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 15:58:10 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Didn't find any instances for network info cache update. {{(pid=71874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 12 15:58:11 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 15:58:11 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 15:58:11 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 15:58:11 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 15:58:11 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 15:58:11 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 15:58:11 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 15:58:11 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 15:58:11 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 15:58:11 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 15:58:11 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Auditing locally available compute resources for user (node: user) {{(pid=71874) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 15:58:12 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 15:58:12 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 15:58:12 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Hypervisor/Node resource view: name=user free_ram=10163MB free_disk=26.609512329101562GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71874) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 15:58:12 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 15:58:12 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 15:58:12 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 15:58:12 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 15:58:12 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Inventory has not changed in ProviderTree for provider: 0e94b4c8-cd49-45e4-9133-d36eb4b2456b {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 15:58:12 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Inventory has not changed for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 15:58:12 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Compute_service record updated for user:user {{(pid=71874) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 15:58:12 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.134s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 15:59:11 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 15:59:11 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Starting heal instance info cache {{(pid=71874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 15:59:11 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Rebuilding the list of instances to heal {{(pid=71874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 15:59:11 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Didn't find any instances for network info cache update. {{(pid=71874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 12 15:59:11 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 15:59:11 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71874) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 15:59:11 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 15:59:11 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 15:59:11 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 15:59:11 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 15:59:12 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 15:59:12 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 15:59:12 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 15:59:12 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 15:59:12 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 15:59:12 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Auditing locally available compute resources for user (node: user) {{(pid=71874) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 15:59:13 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 15:59:13 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 15:59:13 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Hypervisor/Node resource view: name=user free_ram=9421MB free_disk=26.631980895996094GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71874) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 15:59:13 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 15:59:13 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 15:59:13 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 15:59:13 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 15:59:13 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Inventory has not changed in ProviderTree for provider: 0e94b4c8-cd49-45e4-9133-d36eb4b2456b {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 15:59:13 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Inventory has not changed for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 15:59:13 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Compute_service record updated for user:user {{(pid=71874) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 15:59:13 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.186s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 15:59:14 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 15:59:14 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 15:59:19 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-a07c7925-cadc-4133-8820-43d94fea3323 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Acquiring lock "afebffae-dbf6-4876-8c9f-0364f0fde49c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 15:59:19 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-a07c7925-cadc-4133-8820-43d94fea3323 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "afebffae-dbf6-4876-8c9f-0364f0fde49c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 15:59:19 user nova-compute[71874]: DEBUG nova.compute.manager [None req-a07c7925-cadc-4133-8820-43d94fea3323 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] Starting instance... {{(pid=71874) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 15:59:19 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-a07c7925-cadc-4133-8820-43d94fea3323 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 15:59:19 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-a07c7925-cadc-4133-8820-43d94fea3323 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 15:59:19 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-a07c7925-cadc-4133-8820-43d94fea3323 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71874) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 15:59:19 user nova-compute[71874]: INFO nova.compute.claims [None req-a07c7925-cadc-4133-8820-43d94fea3323 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] Claim successful on node user
Apr 12 15:59:20 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-a07c7925-cadc-4133-8820-43d94fea3323 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Inventory has not changed in ProviderTree for provider: 0e94b4c8-cd49-45e4-9133-d36eb4b2456b {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 15:59:20 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-a07c7925-cadc-4133-8820-43d94fea3323 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Inventory has not changed for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 15:59:20 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-a07c7925-cadc-4133-8820-43d94fea3323 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.383s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 15:59:20 user nova-compute[71874]: DEBUG nova.compute.manager [None req-a07c7925-cadc-4133-8820-43d94fea3323 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] Start building networks asynchronously for instance. {{(pid=71874) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 15:59:20 user nova-compute[71874]: DEBUG nova.compute.manager [None req-a07c7925-cadc-4133-8820-43d94fea3323 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] Allocating IP information in the background. {{(pid=71874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 15:59:20 user nova-compute[71874]: DEBUG nova.network.neutron [None req-a07c7925-cadc-4133-8820-43d94fea3323 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] allocate_for_instance() {{(pid=71874) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 15:59:20 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-a07c7925-cadc-4133-8820-43d94fea3323 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 15:59:20 user nova-compute[71874]: DEBUG nova.compute.manager [None req-a07c7925-cadc-4133-8820-43d94fea3323 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] Start building block device mappings for instance. {{(pid=71874) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 15:59:20 user nova-compute[71874]: DEBUG nova.compute.manager [None req-a07c7925-cadc-4133-8820-43d94fea3323 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] Start spawning the instance on the hypervisor. {{(pid=71874) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 15:59:20 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-a07c7925-cadc-4133-8820-43d94fea3323 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] Creating instance directory {{(pid=71874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 15:59:20 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-a07c7925-cadc-4133-8820-43d94fea3323 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] Creating image(s)
Apr 12 15:59:20 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-a07c7925-cadc-4133-8820-43d94fea3323 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Acquiring lock "/opt/stack/data/nova/instances/afebffae-dbf6-4876-8c9f-0364f0fde49c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 15:59:20 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-a07c7925-cadc-4133-8820-43d94fea3323 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "/opt/stack/data/nova/instances/afebffae-dbf6-4876-8c9f-0364f0fde49c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 15:59:20 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-a07c7925-cadc-4133-8820-43d94fea3323 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "/opt/stack/data/nova/instances/afebffae-dbf6-4876-8c9f-0364f0fde49c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 15:59:20 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-a07c7925-cadc-4133-8820-43d94fea3323 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Acquiring lock "b88df1b37cb431f52bc53b5616015c89b5bec411" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 15:59:20 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-a07c7925-cadc-4133-8820-43d94fea3323 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "b88df1b37cb431f52bc53b5616015c89b5bec411" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 15:59:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-a07c7925-cadc-4133-8820-43d94fea3323 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411.part --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 15:59:21 user nova-compute[71874]: DEBUG nova.policy [None req-a07c7925-cadc-4133-8820-43d94fea3323 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '880266e3fa4d4dd889648c10208a1f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fe48a3b7d846a195f1e47cc7f69695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71874) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 15:59:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-a07c7925-cadc-4133-8820-43d94fea3323 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411.part --force-share --output=json" returned: 0 in 0.165s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 15:59:21 user nova-compute[71874]: DEBUG nova.virt.images [None req-a07c7925-cadc-4133-8820-43d94fea3323 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] 9dc63f14-8b70-4e72-89f2-13464f2f5c7c was qcow2, converting to raw {{(pid=71874) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 12 15:59:21 user nova-compute[71874]: DEBUG nova.privsep.utils [None req-a07c7925-cadc-4133-8820-43d94fea3323 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71874) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 12 15:59:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-a07c7925-cadc-4133-8820-43d94fea3323 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411.part /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411.converted {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 15:59:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-a07c7925-cadc-4133-8820-43d94fea3323 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411.part /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411.converted" returned: 0 in 0.137s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 15:59:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-a07c7925-cadc-4133-8820-43d94fea3323 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411.converted --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 15:59:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-a07c7925-cadc-4133-8820-43d94fea3323 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411.converted --force-share --output=json" returned: 0 in 0.160s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 15:59:21 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-a07c7925-cadc-4133-8820-43d94fea3323 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "b88df1b37cb431f52bc53b5616015c89b5bec411" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.832s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 15:59:21 user nova-compute[71874]: INFO oslo.privsep.daemon [None req-a07c7925-cadc-4133-8820-43d94fea3323 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpia77yiin/privsep.sock']
Apr 12 15:59:21 user sudo[80684]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpia77yiin/privsep.sock
Apr 12 15:59:21 user sudo[80684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Apr 12 15:59:22 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8b1b83d-8e2f-4d43-b639-9cf3663f6a65 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Acquiring lock "473a30c4-5aa4-481c-8859-fda815d14872" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 15:59:22 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8b1b83d-8e2f-4d43-b639-9cf3663f6a65 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "473a30c4-5aa4-481c-8859-fda815d14872" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 15:59:22 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8b1b83d-8e2f-4d43-b639-9cf3663f6a65 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: 473a30c4-5aa4-481c-8859-fda815d14872] Starting instance... {{(pid=71874) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 15:59:22 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8b1b83d-8e2f-4d43-b639-9cf3663f6a65 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 15:59:22 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8b1b83d-8e2f-4d43-b639-9cf3663f6a65 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 15:59:22 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-d8b1b83d-8e2f-4d43-b639-9cf3663f6a65 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71874) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 15:59:22 user nova-compute[71874]: INFO nova.compute.claims [None req-d8b1b83d-8e2f-4d43-b639-9cf3663f6a65 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: 473a30c4-5aa4-481c-8859-fda815d14872] Claim successful on node user
Apr 12 15:59:22 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-d8b1b83d-8e2f-4d43-b639-9cf3663f6a65 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Inventory has not changed in ProviderTree for provider: 0e94b4c8-cd49-45e4-9133-d36eb4b2456b {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 15:59:22 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-d8b1b83d-8e2f-4d43-b639-9cf3663f6a65 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Inventory has not changed for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 15:59:22 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8b1b83d-8e2f-4d43-b639-9cf3663f6a65 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.362s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 15:59:22 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8b1b83d-8e2f-4d43-b639-9cf3663f6a65 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: 473a30c4-5aa4-481c-8859-fda815d14872] Start building networks asynchronously for instance. {{(pid=71874) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 15:59:23 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-de4d3742-7901-4946-86ff-3e9c2a36ac58 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Acquiring lock "608fbea2-b42b-4bb9-94a7-2b76dcdc2001" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 15:59:23 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-de4d3742-7901-4946-86ff-3e9c2a36ac58 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "608fbea2-b42b-4bb9-94a7-2b76dcdc2001" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 15:59:23 user nova-compute[71874]: DEBUG nova.compute.manager [None req-de4d3742-7901-4946-86ff-3e9c2a36ac58 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 608fbea2-b42b-4bb9-94a7-2b76dcdc2001] Starting instance... {{(pid=71874) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 15:59:23 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8b1b83d-8e2f-4d43-b639-9cf3663f6a65 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: 473a30c4-5aa4-481c-8859-fda815d14872] Allocating IP information in the background. {{(pid=71874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 15:59:23 user nova-compute[71874]: DEBUG nova.network.neutron [None req-d8b1b83d-8e2f-4d43-b639-9cf3663f6a65 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: 473a30c4-5aa4-481c-8859-fda815d14872] allocate_for_instance() {{(pid=71874) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 15:59:23 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-d8b1b83d-8e2f-4d43-b639-9cf3663f6a65 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: 473a30c4-5aa4-481c-8859-fda815d14872] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 15:59:23 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8b1b83d-8e2f-4d43-b639-9cf3663f6a65 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: 473a30c4-5aa4-481c-8859-fda815d14872] Start building block device mappings for instance. {{(pid=71874) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 15:59:23 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-de4d3742-7901-4946-86ff-3e9c2a36ac58 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 15:59:23 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-de4d3742-7901-4946-86ff-3e9c2a36ac58 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 15:59:23 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-de4d3742-7901-4946-86ff-3e9c2a36ac58 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71874) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 15:59:23 user nova-compute[71874]: INFO nova.compute.claims [None req-de4d3742-7901-4946-86ff-3e9c2a36ac58 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 608fbea2-b42b-4bb9-94a7-2b76dcdc2001] Claim successful on node user
Apr 12 15:59:23 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8b1b83d-8e2f-4d43-b639-9cf3663f6a65 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: 473a30c4-5aa4-481c-8859-fda815d14872] Start spawning the instance on the hypervisor. {{(pid=71874) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 15:59:23 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d8b1b83d-8e2f-4d43-b639-9cf3663f6a65 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: 473a30c4-5aa4-481c-8859-fda815d14872] Creating instance directory {{(pid=71874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 15:59:23 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-d8b1b83d-8e2f-4d43-b639-9cf3663f6a65 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: 473a30c4-5aa4-481c-8859-fda815d14872] Creating image(s)
Apr 12 15:59:23 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8b1b83d-8e2f-4d43-b639-9cf3663f6a65 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Acquiring lock "/opt/stack/data/nova/instances/473a30c4-5aa4-481c-8859-fda815d14872/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 15:59:23 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8b1b83d-8e2f-4d43-b639-9cf3663f6a65 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "/opt/stack/data/nova/instances/473a30c4-5aa4-481c-8859-fda815d14872/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 15:59:23 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8b1b83d-8e2f-4d43-b639-9cf3663f6a65 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "/opt/stack/data/nova/instances/473a30c4-5aa4-481c-8859-fda815d14872/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 15:59:23 user sudo[80684]: pam_unix(sudo:session): session closed for user root
Apr 12 15:59:23 user nova-compute[71874]: INFO oslo.privsep.daemon [None req-a07c7925-cadc-4133-8820-43d94fea3323 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Spawned new privsep daemon via rootwrap
Apr 12 15:59:23 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-de4d3742-7901-4946-86ff-3e9c2a36ac58 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Inventory has not changed in ProviderTree for provider: 0e94b4c8-cd49-45e4-9133-d36eb4b2456b {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 15:59:23 user nova-compute[71874]: INFO oslo.privsep.daemon [-] privsep daemon starting
Apr 12 15:59:23 user nova-compute[71874]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Apr 12 15:59:23 user nova-compute[71874]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Apr 12 15:59:23 user nova-compute[71874]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 80703
Apr 12 15:59:23 user nova-compute[71874]: WARNING oslo_privsep.priv_context [None req-d8b1b83d-8e2f-4d43-b639-9cf3663f6a65 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] privsep daemon already running
Apr 12 15:59:23 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-de4d3742-7901-4946-86ff-3e9c2a36ac58 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Inventory has not changed for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 15:59:23 user nova-compute[71874]: DEBUG nova.policy [None req-d8b1b83d-8e2f-4d43-b639-9cf3663f6a65 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '880266e3fa4d4dd889648c10208a1f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fe48a3b7d846a195f1e47cc7f69695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71874) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 15:59:23 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-de4d3742-7901-4946-86ff-3e9c2a36ac58 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.353s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 15:59:23 user nova-compute[71874]: DEBUG nova.compute.manager [None req-de4d3742-7901-4946-86ff-3e9c2a36ac58 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 608fbea2-b42b-4bb9-94a7-2b76dcdc2001] Start building networks asynchronously for instance. {{(pid=71874) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 15:59:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-a07c7925-cadc-4133-8820-43d94fea3323 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 15:59:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8b1b83d-8e2f-4d43-b639-9cf3663f6a65 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 15:59:23 user nova-compute[71874]: DEBUG nova.compute.manager [None req-de4d3742-7901-4946-86ff-3e9c2a36ac58 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 608fbea2-b42b-4bb9-94a7-2b76dcdc2001] Allocating IP information in the background. {{(pid=71874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 15:59:23 user nova-compute[71874]: DEBUG nova.network.neutron [None req-de4d3742-7901-4946-86ff-3e9c2a36ac58 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 608fbea2-b42b-4bb9-94a7-2b76dcdc2001] allocate_for_instance() {{(pid=71874) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 15:59:23 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-de4d3742-7901-4946-86ff-3e9c2a36ac58 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 608fbea2-b42b-4bb9-94a7-2b76dcdc2001] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 15:59:23 user nova-compute[71874]: DEBUG nova.compute.manager [None req-de4d3742-7901-4946-86ff-3e9c2a36ac58 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 608fbea2-b42b-4bb9-94a7-2b76dcdc2001] Start building block device mappings for instance. {{(pid=71874) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 15:59:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-a07c7925-cadc-4133-8820-43d94fea3323 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json" returned: 0 in 0.127s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 15:59:23 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-a07c7925-cadc-4133-8820-43d94fea3323 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Acquiring lock "b88df1b37cb431f52bc53b5616015c89b5bec411" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 15:59:23 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-a07c7925-cadc-4133-8820-43d94fea3323 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "b88df1b37cb431f52bc53b5616015c89b5bec411" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 15:59:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-a07c7925-cadc-4133-8820-43d94fea3323 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 15:59:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8b1b83d-8e2f-4d43-b639-9cf3663f6a65 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json" returned: 0 in 0.138s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 15:59:23 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8b1b83d-8e2f-4d43-b639-9cf3663f6a65 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Acquiring lock "b88df1b37cb431f52bc53b5616015c89b5bec411" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 15:59:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-a07c7925-cadc-4133-8820-43d94fea3323 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json" returned: 0 in 0.134s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 15:59:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-a07c7925-cadc-4133-8820-43d94fea3323 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411,backing_fmt=raw /opt/stack/data/nova/instances/afebffae-dbf6-4876-8c9f-0364f0fde49c/disk 1073741824 {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 15:59:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-a07c7925-cadc-4133-8820-43d94fea3323 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411,backing_fmt=raw /opt/stack/data/nova/instances/afebffae-dbf6-4876-8c9f-0364f0fde49c/disk 1073741824" returned: 0 in 0.039s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 15:59:23 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-a07c7925-cadc-4133-8820-43d94fea3323 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "b88df1b37cb431f52bc53b5616015c89b5bec411" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.177s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 15:59:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-a07c7925-cadc-4133-8820-43d94fea3323 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 15:59:23 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8b1b83d-8e2f-4d43-b639-9cf3663f6a65 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "b88df1b37cb431f52bc53b5616015c89b5bec411" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.177s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 15:59:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8b1b83d-8e2f-4d43-b639-9cf3663f6a65 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 15:59:23 user nova-compute[71874]: DEBUG nova.compute.manager [None req-de4d3742-7901-4946-86ff-3e9c2a36ac58 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 608fbea2-b42b-4bb9-94a7-2b76dcdc2001] Start spawning the instance on the hypervisor. {{(pid=71874) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 15:59:23 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-de4d3742-7901-4946-86ff-3e9c2a36ac58 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 608fbea2-b42b-4bb9-94a7-2b76dcdc2001] Creating instance directory {{(pid=71874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 15:59:23 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-de4d3742-7901-4946-86ff-3e9c2a36ac58 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 608fbea2-b42b-4bb9-94a7-2b76dcdc2001] Creating image(s)
Apr 12 15:59:23 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-de4d3742-7901-4946-86ff-3e9c2a36ac58 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Acquiring lock "/opt/stack/data/nova/instances/608fbea2-b42b-4bb9-94a7-2b76dcdc2001/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 15:59:23 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-de4d3742-7901-4946-86ff-3e9c2a36ac58 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "/opt/stack/data/nova/instances/608fbea2-b42b-4bb9-94a7-2b76dcdc2001/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 15:59:23 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-de4d3742-7901-4946-86ff-3e9c2a36ac58 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "/opt/stack/data/nova/instances/608fbea2-b42b-4bb9-94a7-2b76dcdc2001/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 15:59:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-de4d3742-7901-4946-86ff-3e9c2a36ac58 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 15:59:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-a07c7925-cadc-4133-8820-43d94fea3323 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json" returned: 0 in 0.155s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 15:59:23 user nova-compute[71874]: DEBUG nova.virt.disk.api [None req-a07c7925-cadc-4133-8820-43d94fea3323 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Checking if we can resize image /opt/stack/data/nova/instances/afebffae-dbf6-4876-8c9f-0364f0fde49c/disk. size=1073741824 {{(pid=71874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 15:59:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-a07c7925-cadc-4133-8820-43d94fea3323 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afebffae-dbf6-4876-8c9f-0364f0fde49c/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 15:59:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8b1b83d-8e2f-4d43-b639-9cf3663f6a65 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json" returned: 0 in 0.156s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 15:59:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8b1b83d-8e2f-4d43-b639-9cf3663f6a65 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411,backing_fmt=raw /opt/stack/data/nova/instances/473a30c4-5aa4-481c-8859-fda815d14872/disk 1073741824 {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 15:59:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8b1b83d-8e2f-4d43-b639-9cf3663f6a65 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411,backing_fmt=raw /opt/stack/data/nova/instances/473a30c4-5aa4-481c-8859-fda815d14872/disk 1073741824" returned: 0 in 0.045s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 15:59:24 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8b1b83d-8e2f-4d43-b639-9cf3663f6a65 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "b88df1b37cb431f52bc53b5616015c89b5bec411" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.207s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 15:59:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8b1b83d-8e2f-4d43-b639-9cf3663f6a65 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 15:59:24 user nova-compute[71874]: DEBUG nova.network.neutron [None req-a07c7925-cadc-4133-8820-43d94fea3323 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] Successfully created port: c4b29e0b-0ad8-4897-acf3-76004ac0338b {{(pid=71874) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 15:59:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-de4d3742-7901-4946-86ff-3e9c2a36ac58 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json" returned: 0 in 0.194s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 15:59:24 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-de4d3742-7901-4946-86ff-3e9c2a36ac58 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Acquiring lock "b88df1b37cb431f52bc53b5616015c89b5bec411" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 15:59:24 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-de4d3742-7901-4946-86ff-3e9c2a36ac58 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "b88df1b37cb431f52bc53b5616015c89b5bec411" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 15:59:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-de4d3742-7901-4946-86ff-3e9c2a36ac58 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 15:59:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-a07c7925-cadc-4133-8820-43d94fea3323 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afebffae-dbf6-4876-8c9f-0364f0fde49c/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 15:59:24 user nova-compute[71874]: DEBUG nova.virt.disk.api [None req-a07c7925-cadc-4133-8820-43d94fea3323 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Cannot resize image /opt/stack/data/nova/instances/afebffae-dbf6-4876-8c9f-0364f0fde49c/disk to a smaller size. {{(pid=71874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 15:59:24 user nova-compute[71874]: DEBUG nova.objects.instance [None req-a07c7925-cadc-4133-8820-43d94fea3323 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lazy-loading 'migration_context' on Instance uuid afebffae-dbf6-4876-8c9f-0364f0fde49c {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 15:59:24 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-a07c7925-cadc-4133-8820-43d94fea3323 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] Created local disks {{(pid=71874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 15:59:24 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-a07c7925-cadc-4133-8820-43d94fea3323 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] Ensure instance console log exists: /opt/stack/data/nova/instances/afebffae-dbf6-4876-8c9f-0364f0fde49c/console.log {{(pid=71874) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 15:59:24 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-a07c7925-cadc-4133-8820-43d94fea3323 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 15:59:24 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-a07c7925-cadc-4133-8820-43d94fea3323 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 15:59:24 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-a07c7925-cadc-4133-8820-43d94fea3323 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 15:59:24 user nova-compute[71874]: DEBUG nova.policy [None req-de4d3742-7901-4946-86ff-3e9c2a36ac58 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '73f9fa5bc22a4824b3cdcb8cf7bb380c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9210f81232304e179d3e09914a492442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71874) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 15:59:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8b1b83d-8e2f-4d43-b639-9cf3663f6a65 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json" returned: 0 in 0.143s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 15:59:24 user nova-compute[71874]: DEBUG nova.virt.disk.api [None req-d8b1b83d-8e2f-4d43-b639-9cf3663f6a65 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Checking if we can resize image /opt/stack/data/nova/instances/473a30c4-5aa4-481c-8859-fda815d14872/disk. size=1073741824 {{(pid=71874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 15:59:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8b1b83d-8e2f-4d43-b639-9cf3663f6a65 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473a30c4-5aa4-481c-8859-fda815d14872/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 15:59:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-de4d3742-7901-4946-86ff-3e9c2a36ac58 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json" returned: 0 in 0.143s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 15:59:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-de4d3742-7901-4946-86ff-3e9c2a36ac58 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411,backing_fmt=raw /opt/stack/data/nova/instances/608fbea2-b42b-4bb9-94a7-2b76dcdc2001/disk 1073741824 {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 15:59:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-de4d3742-7901-4946-86ff-3e9c2a36ac58 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411,backing_fmt=raw /opt/stack/data/nova/instances/608fbea2-b42b-4bb9-94a7-2b76dcdc2001/disk 1073741824" returned: 0 in 0.049s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 15:59:24 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-de4d3742-7901-4946-86ff-3e9c2a36ac58 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "b88df1b37cb431f52bc53b5616015c89b5bec411" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.195s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 15:59:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-de4d3742-7901-4946-86ff-3e9c2a36ac58 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 15:59:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8b1b83d-8e2f-4d43-b639-9cf3663f6a65 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473a30c4-5aa4-481c-8859-fda815d14872/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 15:59:24 user nova-compute[71874]: DEBUG nova.virt.disk.api [None req-d8b1b83d-8e2f-4d43-b639-9cf3663f6a65 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Cannot resize image /opt/stack/data/nova/instances/473a30c4-5aa4-481c-8859-fda815d14872/disk to a smaller size. {{(pid=71874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 15:59:24 user nova-compute[71874]: DEBUG nova.objects.instance [None req-d8b1b83d-8e2f-4d43-b639-9cf3663f6a65 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lazy-loading 'migration_context' on Instance uuid 473a30c4-5aa4-481c-8859-fda815d14872 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 15:59:24 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d8b1b83d-8e2f-4d43-b639-9cf3663f6a65 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: 473a30c4-5aa4-481c-8859-fda815d14872] Created local disks {{(pid=71874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 15:59:24 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d8b1b83d-8e2f-4d43-b639-9cf3663f6a65 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: 473a30c4-5aa4-481c-8859-fda815d14872] Ensure instance console log exists: /opt/stack/data/nova/instances/473a30c4-5aa4-481c-8859-fda815d14872/console.log {{(pid=71874) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 15:59:24 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8b1b83d-8e2f-4d43-b639-9cf3663f6a65 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 15:59:24 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8b1b83d-8e2f-4d43-b639-9cf3663f6a65 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 15:59:24 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8b1b83d-8e2f-4d43-b639-9cf3663f6a65 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 15:59:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-de4d3742-7901-4946-86ff-3e9c2a36ac58 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json" returned: 0 in 0.152s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 15:59:24 user nova-compute[71874]: DEBUG nova.virt.disk.api [None req-de4d3742-7901-4946-86ff-3e9c2a36ac58 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Checking if we can resize image /opt/stack/data/nova/instances/608fbea2-b42b-4bb9-94a7-2b76dcdc2001/disk. size=1073741824 {{(pid=71874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 15:59:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-de4d3742-7901-4946-86ff-3e9c2a36ac58 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/608fbea2-b42b-4bb9-94a7-2b76dcdc2001/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 15:59:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-de4d3742-7901-4946-86ff-3e9c2a36ac58 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/608fbea2-b42b-4bb9-94a7-2b76dcdc2001/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 15:59:24 user nova-compute[71874]: DEBUG nova.virt.disk.api [None req-de4d3742-7901-4946-86ff-3e9c2a36ac58 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Cannot resize image /opt/stack/data/nova/instances/608fbea2-b42b-4bb9-94a7-2b76dcdc2001/disk to a smaller size. {{(pid=71874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 15:59:24 user nova-compute[71874]: DEBUG nova.objects.instance [None req-de4d3742-7901-4946-86ff-3e9c2a36ac58 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lazy-loading 'migration_context' on Instance uuid 608fbea2-b42b-4bb9-94a7-2b76dcdc2001 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 15:59:24 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-de4d3742-7901-4946-86ff-3e9c2a36ac58 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 608fbea2-b42b-4bb9-94a7-2b76dcdc2001] Created local disks {{(pid=71874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 15:59:24 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-de4d3742-7901-4946-86ff-3e9c2a36ac58 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 608fbea2-b42b-4bb9-94a7-2b76dcdc2001] Ensure instance console log exists: /opt/stack/data/nova/instances/608fbea2-b42b-4bb9-94a7-2b76dcdc2001/console.log {{(pid=71874) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 15:59:24 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-de4d3742-7901-4946-86ff-3e9c2a36ac58 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 15:59:24 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-de4d3742-7901-4946-86ff-3e9c2a36ac58 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 15:59:24 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-de4d3742-7901-4946-86ff-3e9c2a36ac58 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 15:59:25 user nova-compute[71874]: DEBUG nova.network.neutron [None req-d8b1b83d-8e2f-4d43-b639-9cf3663f6a65 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: 473a30c4-5aa4-481c-8859-fda815d14872] Successfully created port: 556d7c96-2d40-43fc-83fe-2059479a5265 {{(pid=71874) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 15:59:28 user nova-compute[71874]: DEBUG nova.network.neutron [None req-a07c7925-cadc-4133-8820-43d94fea3323 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] Successfully updated port: c4b29e0b-0ad8-4897-acf3-76004ac0338b {{(pid=71874) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 15:59:28 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-a07c7925-cadc-4133-8820-43d94fea3323 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Acquiring lock "refresh_cache-afebffae-dbf6-4876-8c9f-0364f0fde49c" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 15:59:28 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-a07c7925-cadc-4133-8820-43d94fea3323 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Acquired lock "refresh_cache-afebffae-dbf6-4876-8c9f-0364f0fde49c" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 15:59:28 user nova-compute[71874]: DEBUG nova.network.neutron [None req-a07c7925-cadc-4133-8820-43d94fea3323 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] Building network info cache for instance {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 15:59:28 user nova-compute[71874]: DEBUG nova.network.neutron [None req-a07c7925-cadc-4133-8820-43d94fea3323 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] Instance cache missing network info. {{(pid=71874) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 15:59:28 user nova-compute[71874]: DEBUG nova.compute.manager [req-4bf47603-8f9f-424f-9497-0d9c9c2165b7 req-a31f7e26-9f8f-450f-9e65-a6d5fff244fc service nova] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] Received event network-changed-c4b29e0b-0ad8-4897-acf3-76004ac0338b {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 15:59:28 user nova-compute[71874]: DEBUG nova.compute.manager [req-4bf47603-8f9f-424f-9497-0d9c9c2165b7 req-a31f7e26-9f8f-450f-9e65-a6d5fff244fc service nova] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] Refreshing instance network info cache due to event network-changed-c4b29e0b-0ad8-4897-acf3-76004ac0338b. {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 15:59:28 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-4bf47603-8f9f-424f-9497-0d9c9c2165b7 req-a31f7e26-9f8f-450f-9e65-a6d5fff244fc service nova] Acquiring lock "refresh_cache-afebffae-dbf6-4876-8c9f-0364f0fde49c" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 15:59:28 user nova-compute[71874]: DEBUG nova.network.neutron [None req-de4d3742-7901-4946-86ff-3e9c2a36ac58 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 608fbea2-b42b-4bb9-94a7-2b76dcdc2001] Successfully created port: 246d47a5-6953-4e38-8546-63953a8721cf {{(pid=71874) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 15:59:29 user nova-compute[71874]: DEBUG nova.network.neutron [None req-d8b1b83d-8e2f-4d43-b639-9cf3663f6a65 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: 473a30c4-5aa4-481c-8859-fda815d14872] Successfully updated port: 556d7c96-2d40-43fc-83fe-2059479a5265 {{(pid=71874) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 15:59:29 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8b1b83d-8e2f-4d43-b639-9cf3663f6a65 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Acquiring lock "refresh_cache-473a30c4-5aa4-481c-8859-fda815d14872" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 15:59:29 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8b1b83d-8e2f-4d43-b639-9cf3663f6a65 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Acquired lock "refresh_cache-473a30c4-5aa4-481c-8859-fda815d14872" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 15:59:29 user nova-compute[71874]: DEBUG nova.network.neutron [None req-d8b1b83d-8e2f-4d43-b639-9cf3663f6a65 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: 473a30c4-5aa4-481c-8859-fda815d14872] Building network info cache for instance {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 15:59:29 user nova-compute[71874]: DEBUG nova.network.neutron [None req-a07c7925-cadc-4133-8820-43d94fea3323 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] Updating instance_info_cache with network_info: [{"id": "c4b29e0b-0ad8-4897-acf3-76004ac0338b", "address": "fa:16:3e:b8:23:a7", "network": {"id": "06fae0be-02dd-4962-a1ac-fd0413772758", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1493924857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3fe48a3b7d846a195f1e47cc7f69695", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4b29e0b-0a", "ovs_interfaceid": "c4b29e0b-0ad8-4897-acf3-76004ac0338b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 15:59:29 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-a07c7925-cadc-4133-8820-43d94fea3323 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Releasing lock "refresh_cache-afebffae-dbf6-4876-8c9f-0364f0fde49c" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 15:59:29 user nova-compute[71874]: DEBUG nova.compute.manager [None req-a07c7925-cadc-4133-8820-43d94fea3323 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] Instance network_info: |[{"id": "c4b29e0b-0ad8-4897-acf3-76004ac0338b", "address": "fa:16:3e:b8:23:a7", "network": {"id": "06fae0be-02dd-4962-a1ac-fd0413772758", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1493924857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3fe48a3b7d846a195f1e47cc7f69695", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4b29e0b-0a", "ovs_interfaceid": "c4b29e0b-0ad8-4897-acf3-76004ac0338b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 15:59:29 user nova-compute[71874]: DEBUG nova.network.neutron [None req-d8b1b83d-8e2f-4d43-b639-9cf3663f6a65 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: 473a30c4-5aa4-481c-8859-fda815d14872] Instance cache missing network info. {{(pid=71874) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 15:59:29 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-4bf47603-8f9f-424f-9497-0d9c9c2165b7 req-a31f7e26-9f8f-450f-9e65-a6d5fff244fc service nova] Acquired lock "refresh_cache-afebffae-dbf6-4876-8c9f-0364f0fde49c" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 15:59:29 user nova-compute[71874]: DEBUG nova.network.neutron [req-4bf47603-8f9f-424f-9497-0d9c9c2165b7 req-a31f7e26-9f8f-450f-9e65-a6d5fff244fc service nova] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] Refreshing network info cache for port c4b29e0b-0ad8-4897-acf3-76004ac0338b {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 15:59:29 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-a07c7925-cadc-4133-8820-43d94fea3323 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] Start _get_guest_xml network_info=[{"id": "c4b29e0b-0ad8-4897-acf3-76004ac0338b", "address": "fa:16:3e:b8:23:a7", "network": {"id": "06fae0be-02dd-4962-a1ac-fd0413772758", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1493924857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3fe48a3b7d846a195f1e47cc7f69695", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4b29e0b-0a", "ovs_interfaceid": "c4b29e0b-0ad8-4897-acf3-76004ac0338b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T15:55:37Z,direct_url=<?>,disk_format='qcow2',id=9dc63f14-8b70-4e72-89f2-13464f2f5c7c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='61a4936d9b7744c0b488d81c9b7746b6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T15:55:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_options': None, 'image_id': '9dc63f14-8b70-4e72-89f2-13464f2f5c7c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 15:59:29 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-a07c7925-cadc-4133-8820-43d94fea3323 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 15:59:29 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-a07c7925-cadc-4133-8820-43d94fea3323 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 15:59:29 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-a07c7925-cadc-4133-8820-43d94fea3323 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71874) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 15:59:29 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-a07c7925-cadc-4133-8820-43d94fea3323 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T15:56:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T15:55:37Z,direct_url=<?>,disk_format='qcow2',id=9dc63f14-8b70-4e72-89f2-13464f2f5c7c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='61a4936d9b7744c0b488d81c9b7746b6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T15:55:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 15:59:29 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-a07c7925-cadc-4133-8820-43d94fea3323 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Flavor limits 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 15:59:29 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-a07c7925-cadc-4133-8820-43d94fea3323 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Image limits 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 15:59:29 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-a07c7925-cadc-4133-8820-43d94fea3323 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Flavor pref 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 15:59:29 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-a07c7925-cadc-4133-8820-43d94fea3323 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Image pref 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 15:59:29 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-a07c7925-cadc-4133-8820-43d94fea3323 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 15:59:29 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-a07c7925-cadc-4133-8820-43d94fea3323 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 15:59:29 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-a07c7925-cadc-4133-8820-43d94fea3323 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 15:59:29 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-a07c7925-cadc-4133-8820-43d94fea3323 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Got 1 possible topologies {{(pid=71874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 15:59:29 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-a07c7925-cadc-4133-8820-43d94fea3323 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 15:59:29 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-a07c7925-cadc-4133-8820-43d94fea3323 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 15:59:30 user nova-compute[71874]: DEBUG nova.privsep.utils [None req-a07c7925-cadc-4133-8820-43d94fea3323 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71874) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 12 15:59:30 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-a07c7925-cadc-4133-8820-43d94fea3323 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T15:59:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1230796191',display_name='tempest-ServerRescueNegativeTestJSON-server-1230796191',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1230796191',id=1,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b3fe48a3b7d846a195f1e47cc7f69695',ramdisk_id='',reservation_id='r-fjmy00j3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-984710343',owner_user_name='tempest-ServerRescueNegativeTestJSON-984710343-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T15:59:21Z,user_data=None,user_id='880266e3fa4d4dd889648c10208a1f8e',uuid=afebffae-dbf6-4876-8c9f-0364f0fde49c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c4b29e0b-0ad8-4897-acf3-76004ac0338b", "address": "fa:16:3e:b8:23:a7", "network": {"id": "06fae0be-02dd-4962-a1ac-fd0413772758", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1493924857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3fe48a3b7d846a195f1e47cc7f69695", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4b29e0b-0a", "ovs_interfaceid": "c4b29e0b-0ad8-4897-acf3-76004ac0338b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 15:59:30 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-a07c7925-cadc-4133-8820-43d94fea3323 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Converting VIF {"id": "c4b29e0b-0ad8-4897-acf3-76004ac0338b", "address": "fa:16:3e:b8:23:a7", "network": {"id": "06fae0be-02dd-4962-a1ac-fd0413772758", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1493924857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3fe48a3b7d846a195f1e47cc7f69695", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4b29e0b-0a", "ovs_interfaceid": "c4b29e0b-0ad8-4897-acf3-76004ac0338b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 15:59:30 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-a07c7925-cadc-4133-8820-43d94fea3323 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:23:a7,bridge_name='br-int',has_traffic_filtering=True,id=c4b29e0b-0ad8-4897-acf3-76004ac0338b,network=Network(06fae0be-02dd-4962-a1ac-fd0413772758),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4b29e0b-0a') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 15:59:30 user nova-compute[71874]: DEBUG nova.objects.instance [None req-a07c7925-cadc-4133-8820-43d94fea3323 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lazy-loading 'pci_devices' on Instance uuid afebffae-dbf6-4876-8c9f-0364f0fde49c {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 15:59:30 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-a07c7925-cadc-4133-8820-43d94fea3323 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] End _get_guest_xml xml=<domain type="kvm">
Apr 12 15:59:30 user nova-compute[71874]:   <uuid>afebffae-dbf6-4876-8c9f-0364f0fde49c</uuid>
Apr 12 15:59:30 user nova-compute[71874]:   <name>instance-00000001</name>
Apr 12 15:59:30 user nova-compute[71874]:   <memory>131072</memory>
Apr 12 15:59:30 user nova-compute[71874]:   <vcpu>1</vcpu>
Apr 12 15:59:30 user nova-compute[71874]:   <metadata>
Apr 12 15:59:30 user nova-compute[71874]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 15:59:30 user nova-compute[71874]:       <nova:package version="0.0.0"/>
Apr 12 15:59:30 user nova-compute[71874]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1230796191</nova:name>
Apr 12 15:59:30 user nova-compute[71874]:       <nova:creationTime>2023-04-12 15:59:29</nova:creationTime>
Apr 12 15:59:30 user nova-compute[71874]:       <nova:flavor name="m1.nano">
Apr 12 15:59:30 user nova-compute[71874]:         <nova:memory>128</nova:memory>
Apr 12 15:59:30 user nova-compute[71874]:         <nova:disk>1</nova:disk>
Apr 12 15:59:30 user nova-compute[71874]:         <nova:swap>0</nova:swap>
Apr 12 15:59:30 user nova-compute[71874]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 15:59:30 user nova-compute[71874]:         <nova:vcpus>1</nova:vcpus>
Apr 12 15:59:30 user nova-compute[71874]:       </nova:flavor>
Apr 12 15:59:30 user nova-compute[71874]:       <nova:owner>
Apr 12 15:59:30 user nova-compute[71874]:         <nova:user uuid="880266e3fa4d4dd889648c10208a1f8e">tempest-ServerRescueNegativeTestJSON-984710343-project-member</nova:user>
Apr 12 15:59:30 user nova-compute[71874]:         <nova:project uuid="b3fe48a3b7d846a195f1e47cc7f69695">tempest-ServerRescueNegativeTestJSON-984710343</nova:project>
Apr 12 15:59:30 user nova-compute[71874]:       </nova:owner>
Apr 12 15:59:30 user nova-compute[71874]:       <nova:root type="image" uuid="9dc63f14-8b70-4e72-89f2-13464f2f5c7c"/>
Apr 12 15:59:30 user nova-compute[71874]:       <nova:ports>
Apr 12 15:59:30 user nova-compute[71874]:         <nova:port uuid="c4b29e0b-0ad8-4897-acf3-76004ac0338b">
Apr 12 15:59:30 user nova-compute[71874]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 12 15:59:30 user nova-compute[71874]:         </nova:port>
Apr 12 15:59:30 user nova-compute[71874]:       </nova:ports>
Apr 12 15:59:30 user nova-compute[71874]:     </nova:instance>
Apr 12 15:59:30 user nova-compute[71874]:   </metadata>
Apr 12 15:59:30 user nova-compute[71874]:   <sysinfo type="smbios">
Apr 12 15:59:30 user nova-compute[71874]:     <system>
Apr 12 15:59:30 user nova-compute[71874]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 15:59:30 user nova-compute[71874]:       <entry name="product">OpenStack Nova</entry>
Apr 12 15:59:30 user nova-compute[71874]:       <entry name="version">0.0.0</entry>
Apr 12 15:59:30 user nova-compute[71874]:       <entry name="serial">afebffae-dbf6-4876-8c9f-0364f0fde49c</entry>
Apr 12 15:59:30 user nova-compute[71874]:       <entry name="uuid">afebffae-dbf6-4876-8c9f-0364f0fde49c</entry>
Apr 12 15:59:30 user nova-compute[71874]:       <entry name="family">Virtual Machine</entry>
Apr 12 15:59:30 user nova-compute[71874]:     </system>
Apr 12 15:59:30 user nova-compute[71874]:   </sysinfo>
Apr 12 15:59:30 user nova-compute[71874]:   <os>
Apr 12 15:59:30 user nova-compute[71874]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 15:59:30 user nova-compute[71874]:     <boot dev="hd"/>
Apr 12 15:59:30 user nova-compute[71874]:     <smbios mode="sysinfo"/>
Apr 12 15:59:30 user nova-compute[71874]:   </os>
Apr 12 15:59:30 user nova-compute[71874]:   <features>
Apr 12 15:59:30 user nova-compute[71874]:     <acpi/>
Apr 12 15:59:30 user nova-compute[71874]:     <apic/>
Apr 12 15:59:30 user nova-compute[71874]:     <vmcoreinfo/>
Apr 12 15:59:30 user nova-compute[71874]:   </features>
Apr 12 15:59:30 user nova-compute[71874]:   <clock offset="utc">
Apr 12 15:59:30 user nova-compute[71874]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 15:59:30 user nova-compute[71874]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 15:59:30 user nova-compute[71874]:     <timer name="hpet" present="no"/>
Apr 12 15:59:30 user nova-compute[71874]:   </clock>
Apr 12 15:59:30 user nova-compute[71874]:   <cpu mode="custom" match="exact">
Apr 12 15:59:30 user nova-compute[71874]:     <model>Nehalem</model>
Apr 12 15:59:30 user nova-compute[71874]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 15:59:30 user nova-compute[71874]:   </cpu>
Apr 12 15:59:30 user nova-compute[71874]:   <devices>
Apr 12 15:59:30 user nova-compute[71874]:     <disk type="file" device="disk">
Apr 12 15:59:30 user nova-compute[71874]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 15:59:30 user nova-compute[71874]:       <source file="/opt/stack/data/nova/instances/afebffae-dbf6-4876-8c9f-0364f0fde49c/disk"/>
Apr 12 15:59:30 user nova-compute[71874]:       <target dev="vda" bus="virtio"/>
Apr 12 15:59:30 user nova-compute[71874]:     </disk>
Apr 12 15:59:30 user nova-compute[71874]:     <interface type="ethernet">
Apr 12 15:59:30 user nova-compute[71874]:       <mac address="fa:16:3e:b8:23:a7"/>
Apr 12 15:59:30 user nova-compute[71874]:       <model type="virtio"/>
Apr 12 15:59:30 user nova-compute[71874]:       <mtu size="1442"/>
Apr 12 15:59:30 user nova-compute[71874]:       <target dev="tapc4b29e0b-0a"/>
Apr 12 15:59:30 user nova-compute[71874]:     </interface>
Apr 12 15:59:30 user nova-compute[71874]:     <serial type="pty">
Apr 12 15:59:30 user nova-compute[71874]:       <log file="/opt/stack/data/nova/instances/afebffae-dbf6-4876-8c9f-0364f0fde49c/console.log" append="off"/>
Apr 12 15:59:30 user nova-compute[71874]:     </serial>
Apr 12 15:59:30 user nova-compute[71874]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 15:59:30 user nova-compute[71874]:     <video>
Apr 12 15:59:30 user nova-compute[71874]:       <model type="virtio"/>
Apr 12 15:59:30 user nova-compute[71874]:     </video>
Apr 12 15:59:30 user nova-compute[71874]:     <rng model="virtio">
Apr 12 15:59:30 user nova-compute[71874]:       <backend model="random">/dev/urandom</backend>
Apr 12 15:59:30 user nova-compute[71874]:     </rng>
Apr 12 15:59:30 user nova-compute[71874]:     <controller type="usb" index="0" model="none"/>
Apr 12 15:59:30 user nova-compute[71874]:     <memballoon model="virtio">
Apr 12 15:59:30 user nova-compute[71874]:       <stats period="10"/>
Apr 12 15:59:30 user nova-compute[71874]:     </memballoon>
Apr 12 15:59:30 user nova-compute[71874]:   </devices>
Apr 12 15:59:30 user nova-compute[71874]: </domain>
Apr 12 15:59:30 user nova-compute[71874]:  {{(pid=71874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 15:59:30 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-a07c7925-cadc-4133-8820-43d94fea3323 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T15:59:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1230796191',display_name='tempest-ServerRescueNegativeTestJSON-server-1230796191',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1230796191',id=1,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b3fe48a3b7d846a195f1e47cc7f69695',ramdisk_id='',reservation_id='r-fjmy00j3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-984710343',owner_user_name='tempest-ServerRescueNegativeTestJSON-984710343-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T15:59:21Z,user_data=None,user_id='880266e3fa4d4dd889648c10208a1f8e',uuid=afebffae-dbf6-4876-8c9f-0364f0fde49c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c4b29e0b-0ad8-4897-acf3-76004ac0338b", "address": "fa:16:3e:b8:23:a7", "network": {"id": "06fae0be-02dd-4962-a1ac-fd0413772758", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1493924857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3fe48a3b7d846a195f1e47cc7f69695", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4b29e0b-0a", "ovs_interfaceid": "c4b29e0b-0ad8-4897-acf3-76004ac0338b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 15:59:30 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-a07c7925-cadc-4133-8820-43d94fea3323 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Converting VIF {"id": "c4b29e0b-0ad8-4897-acf3-76004ac0338b", "address": "fa:16:3e:b8:23:a7", "network": {"id": "06fae0be-02dd-4962-a1ac-fd0413772758", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1493924857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3fe48a3b7d846a195f1e47cc7f69695", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4b29e0b-0a", "ovs_interfaceid": "c4b29e0b-0ad8-4897-acf3-76004ac0338b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 15:59:30 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-a07c7925-cadc-4133-8820-43d94fea3323 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:23:a7,bridge_name='br-int',has_traffic_filtering=True,id=c4b29e0b-0ad8-4897-acf3-76004ac0338b,network=Network(06fae0be-02dd-4962-a1ac-fd0413772758),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4b29e0b-0a') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 15:59:30 user nova-compute[71874]: DEBUG os_vif [None req-a07c7925-cadc-4133-8820-43d94fea3323 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:23:a7,bridge_name='br-int',has_traffic_filtering=True,id=c4b29e0b-0ad8-4897-acf3-76004ac0338b,network=Network(06fae0be-02dd-4962-a1ac-fd0413772758),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4b29e0b-0a') {{(pid=71874) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 15:59:30 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl [None req-a07c7925-cadc-4133-8820-43d94fea3323 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Created schema index Interface.name {{(pid=71874) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 12 15:59:30 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl [None req-a07c7925-cadc-4133-8820-43d94fea3323 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Created schema index Port.name {{(pid=71874) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 12 15:59:30 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl [None req-a07c7925-cadc-4133-8820-43d94fea3323 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Created schema index Bridge.name {{(pid=71874) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 12 15:59:30 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-a07c7925-cadc-4133-8820-43d94fea3323 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=71874) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 15:59:30 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-a07c7925-cadc-4133-8820-43d94fea3323 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [POLLOUT] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 15:59:30 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-a07c7925-cadc-4133-8820-43d94fea3323 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71874) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 15:59:30 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-a07c7925-cadc-4133-8820-43d94fea3323 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 15:59:30 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-878f65b4-ca24-4534-a673-60e2a3e09283 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 15:59:30 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-878f65b4-ca24-4534-a673-60e2a3e09283 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 15:59:30 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 15:59:30 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 15:59:30 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 15:59:30 user nova-compute[71874]: INFO oslo.privsep.daemon [None req-a07c7925-cadc-4133-8820-43d94fea3323 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpagdw67ug/privsep.sock']
Apr 12 15:59:30 user sudo[80755]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpagdw67ug/privsep.sock
Apr 12 15:59:30 user sudo[80755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Apr 12 15:59:30 user nova-compute[71874]: DEBUG nova.compute.manager [None req-878f65b4-ca24-4534-a673-60e2a3e09283 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Starting instance... {{(pid=71874) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 15:59:30 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 15:59:30 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-878f65b4-ca24-4534-a673-60e2a3e09283 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 15:59:30 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-878f65b4-ca24-4534-a673-60e2a3e09283 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 15:59:30 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-878f65b4-ca24-4534-a673-60e2a3e09283 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71874) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 15:59:30 user nova-compute[71874]: INFO nova.compute.claims [None req-878f65b4-ca24-4534-a673-60e2a3e09283 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Claim successful on node user
Apr 12 15:59:30 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-67f42bed-1688-4a3a-8778-9347e686bc33 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Acquiring lock "fc19fd8d-3285-4ceb-8714-a0ba139f3045" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 15:59:30 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-67f42bed-1688-4a3a-8778-9347e686bc33 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "fc19fd8d-3285-4ceb-8714-a0ba139f3045" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 15:59:30 user nova-compute[71874]: DEBUG nova.compute.manager [None req-67f42bed-1688-4a3a-8778-9347e686bc33 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] Starting instance... {{(pid=71874) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 15:59:30 user nova-compute[71874]: DEBUG nova.compute.manager [req-b3a943de-97b4-4f61-a056-d7830da84616 req-73873cdd-1c80-4dbd-a4b5-52494f23eb63 service nova] [instance: 473a30c4-5aa4-481c-8859-fda815d14872] Received event network-changed-556d7c96-2d40-43fc-83fe-2059479a5265 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 15:59:30 user nova-compute[71874]: DEBUG nova.compute.manager [req-b3a943de-97b4-4f61-a056-d7830da84616 req-73873cdd-1c80-4dbd-a4b5-52494f23eb63 service nova] [instance: 473a30c4-5aa4-481c-8859-fda815d14872] Refreshing instance network info cache due to event network-changed-556d7c96-2d40-43fc-83fe-2059479a5265. {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 15:59:30 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-b3a943de-97b4-4f61-a056-d7830da84616 req-73873cdd-1c80-4dbd-a4b5-52494f23eb63 service nova] Acquiring lock "refresh_cache-473a30c4-5aa4-481c-8859-fda815d14872" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 15:59:30 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-67f42bed-1688-4a3a-8778-9347e686bc33 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 15:59:30 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-878f65b4-ca24-4534-a673-60e2a3e09283 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Inventory has not changed in ProviderTree for provider: 0e94b4c8-cd49-45e4-9133-d36eb4b2456b {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 15:59:30 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-878f65b4-ca24-4534-a673-60e2a3e09283 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Inventory has not changed for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 15:59:30 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-878f65b4-ca24-4534-a673-60e2a3e09283 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.353s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 15:59:30 user nova-compute[71874]: DEBUG nova.compute.manager [None req-878f65b4-ca24-4534-a673-60e2a3e09283 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Start building networks asynchronously for instance. {{(pid=71874) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 15:59:30 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-67f42bed-1688-4a3a-8778-9347e686bc33 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.057s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 15:59:30 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-67f42bed-1688-4a3a-8778-9347e686bc33 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71874) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 15:59:30 user nova-compute[71874]: INFO nova.compute.claims [None req-67f42bed-1688-4a3a-8778-9347e686bc33 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] Claim successful on node user
Apr 12 15:59:30 user nova-compute[71874]: DEBUG nova.compute.manager [None req-878f65b4-ca24-4534-a673-60e2a3e09283 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Allocating IP information in the background. {{(pid=71874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 15:59:30 user nova-compute[71874]: DEBUG nova.network.neutron [None req-878f65b4-ca24-4534-a673-60e2a3e09283 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] allocate_for_instance() {{(pid=71874) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 15:59:30 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-878f65b4-ca24-4534-a673-60e2a3e09283 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 15:59:30 user nova-compute[71874]: DEBUG nova.compute.manager [None req-878f65b4-ca24-4534-a673-60e2a3e09283 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Start building block device mappings for instance. {{(pid=71874) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 15:59:30 user nova-compute[71874]: DEBUG nova.policy [None req-878f65b4-ca24-4534-a673-60e2a3e09283 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1a699b3ba8304eadb8a53d465ea340cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ea81bd1962466bbe552424973f71a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71874) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 15:59:31 user nova-compute[71874]: DEBUG nova.compute.manager [None req-878f65b4-ca24-4534-a673-60e2a3e09283 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Start spawning the instance on the hypervisor. {{(pid=71874) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 15:59:31 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-878f65b4-ca24-4534-a673-60e2a3e09283 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Creating instance directory {{(pid=71874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 15:59:31 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-878f65b4-ca24-4534-a673-60e2a3e09283 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Creating image(s)
Apr 12 15:59:31 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-878f65b4-ca24-4534-a673-60e2a3e09283 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "/opt/stack/data/nova/instances/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 15:59:31 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-878f65b4-ca24-4534-a673-60e2a3e09283 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "/opt/stack/data/nova/instances/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 15:59:31 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-878f65b4-ca24-4534-a673-60e2a3e09283 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "/opt/stack/data/nova/instances/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 15:59:31 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-878f65b4-ca24-4534-a673-60e2a3e09283 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 15:59:31 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-67f42bed-1688-4a3a-8778-9347e686bc33 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Inventory has not changed in ProviderTree for provider: 0e94b4c8-cd49-45e4-9133-d36eb4b2456b {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 15:59:31 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-67f42bed-1688-4a3a-8778-9347e686bc33 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Inventory has not changed for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 15:59:31 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-67f42bed-1688-4a3a-8778-9347e686bc33 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.403s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 15:59:31 user nova-compute[71874]: DEBUG nova.compute.manager [None req-67f42bed-1688-4a3a-8778-9347e686bc33 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] Start building networks asynchronously for instance. {{(pid=71874) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 15:59:31 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-878f65b4-ca24-4534-a673-60e2a3e09283 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json" returned: 0 in 0.142s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 15:59:31 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-878f65b4-ca24-4534-a673-60e2a3e09283 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "b88df1b37cb431f52bc53b5616015c89b5bec411" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 15:59:31 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-878f65b4-ca24-4534-a673-60e2a3e09283 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "b88df1b37cb431f52bc53b5616015c89b5bec411" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 15:59:31 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-878f65b4-ca24-4534-a673-60e2a3e09283 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 15:59:31 user nova-compute[71874]: DEBUG nova.compute.manager [None req-67f42bed-1688-4a3a-8778-9347e686bc33 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] Allocating IP information in the background. {{(pid=71874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 15:59:31 user nova-compute[71874]: DEBUG nova.network.neutron [None req-67f42bed-1688-4a3a-8778-9347e686bc33 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] allocate_for_instance() {{(pid=71874) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 15:59:31 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-67f42bed-1688-4a3a-8778-9347e686bc33 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 15:59:31 user nova-compute[71874]: DEBUG nova.compute.manager [None req-67f42bed-1688-4a3a-8778-9347e686bc33 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] Start building block device mappings for instance. {{(pid=71874) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 15:59:31 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-878f65b4-ca24-4534-a673-60e2a3e09283 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json" returned: 0 in 0.133s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 15:59:31 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-878f65b4-ca24-4534-a673-60e2a3e09283 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411,backing_fmt=raw /opt/stack/data/nova/instances/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1/disk 1073741824 {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 15:59:31 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-878f65b4-ca24-4534-a673-60e2a3e09283 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411,backing_fmt=raw /opt/stack/data/nova/instances/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1/disk 1073741824" returned: 0 in 0.052s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 15:59:31 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-878f65b4-ca24-4534-a673-60e2a3e09283 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "b88df1b37cb431f52bc53b5616015c89b5bec411" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.189s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 15:59:31 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-878f65b4-ca24-4534-a673-60e2a3e09283 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 15:59:31 user nova-compute[71874]: DEBUG nova.compute.manager [None req-67f42bed-1688-4a3a-8778-9347e686bc33 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] Start spawning the instance on the hypervisor. {{(pid=71874) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 15:59:31 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-67f42bed-1688-4a3a-8778-9347e686bc33 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] Creating instance directory {{(pid=71874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 15:59:31 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-67f42bed-1688-4a3a-8778-9347e686bc33 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] Creating image(s)
Apr 12 15:59:31 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-67f42bed-1688-4a3a-8778-9347e686bc33 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Acquiring lock "/opt/stack/data/nova/instances/fc19fd8d-3285-4ceb-8714-a0ba139f3045/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 15:59:31 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-67f42bed-1688-4a3a-8778-9347e686bc33 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "/opt/stack/data/nova/instances/fc19fd8d-3285-4ceb-8714-a0ba139f3045/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 15:59:31 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-67f42bed-1688-4a3a-8778-9347e686bc33 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "/opt/stack/data/nova/instances/fc19fd8d-3285-4ceb-8714-a0ba139f3045/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 15:59:31 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-67f42bed-1688-4a3a-8778-9347e686bc33 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 15:59:31 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-878f65b4-ca24-4534-a673-60e2a3e09283 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json" returned: 0 in 0.116s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 15:59:31 user nova-compute[71874]: DEBUG nova.virt.disk.api [None req-878f65b4-ca24-4534-a673-60e2a3e09283 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Checking if we can resize image /opt/stack/data/nova/instances/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1/disk. size=1073741824 {{(pid=71874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 15:59:31 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-878f65b4-ca24-4534-a673-60e2a3e09283 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 15:59:31 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-67f42bed-1688-4a3a-8778-9347e686bc33 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json" returned: 0 in 0.128s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 15:59:31 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-67f42bed-1688-4a3a-8778-9347e686bc33 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Acquiring lock "b88df1b37cb431f52bc53b5616015c89b5bec411" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 15:59:31 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-67f42bed-1688-4a3a-8778-9347e686bc33 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "b88df1b37cb431f52bc53b5616015c89b5bec411" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 15:59:31 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-67f42bed-1688-4a3a-8778-9347e686bc33 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 15:59:31 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-878f65b4-ca24-4534-a673-60e2a3e09283 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1/disk --force-share --output=json" returned: 0 in 0.122s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 15:59:31 user nova-compute[71874]: DEBUG nova.virt.disk.api [None req-878f65b4-ca24-4534-a673-60e2a3e09283 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Cannot resize image /opt/stack/data/nova/instances/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1/disk to a smaller size. {{(pid=71874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 15:59:31 user nova-compute[71874]: DEBUG nova.objects.instance [None req-878f65b4-ca24-4534-a673-60e2a3e09283 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lazy-loading 'migration_context' on Instance uuid dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 15:59:31 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-878f65b4-ca24-4534-a673-60e2a3e09283 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Created local disks {{(pid=71874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 15:59:31 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-878f65b4-ca24-4534-a673-60e2a3e09283 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Ensure instance console log exists: /opt/stack/data/nova/instances/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1/console.log {{(pid=71874) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 15:59:31 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-878f65b4-ca24-4534-a673-60e2a3e09283 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 15:59:31 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-878f65b4-ca24-4534-a673-60e2a3e09283 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 15:59:31 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-878f65b4-ca24-4534-a673-60e2a3e09283 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 15:59:31 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-67f42bed-1688-4a3a-8778-9347e686bc33 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json" returned: 0 in 0.115s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 15:59:31 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-67f42bed-1688-4a3a-8778-9347e686bc33 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411,backing_fmt=raw /opt/stack/data/nova/instances/fc19fd8d-3285-4ceb-8714-a0ba139f3045/disk 1073741824 {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 15:59:31 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-67f42bed-1688-4a3a-8778-9347e686bc33 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411,backing_fmt=raw /opt/stack/data/nova/instances/fc19fd8d-3285-4ceb-8714-a0ba139f3045/disk 1073741824" returned: 0 in 0.050s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 15:59:31 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-67f42bed-1688-4a3a-8778-9347e686bc33 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "b88df1b37cb431f52bc53b5616015c89b5bec411" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.168s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 15:59:31 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-67f42bed-1688-4a3a-8778-9347e686bc33 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 15:59:31 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 15:59:31 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-67f42bed-1688-4a3a-8778-9347e686bc33 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json" returned: 0 in 0.138s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 15:59:31 user nova-compute[71874]: DEBUG nova.virt.disk.api [None req-67f42bed-1688-4a3a-8778-9347e686bc33 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fc19fd8d-3285-4ceb-8714-a0ba139f3045/disk. size=1073741824 {{(pid=71874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 15:59:31 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-67f42bed-1688-4a3a-8778-9347e686bc33 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc19fd8d-3285-4ceb-8714-a0ba139f3045/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 15:59:31 user sudo[80755]: pam_unix(sudo:session): session closed for user root
Apr 12 15:59:31 user nova-compute[71874]: INFO oslo.privsep.daemon [None req-a07c7925-cadc-4133-8820-43d94fea3323 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Spawned new privsep daemon via rootwrap
Apr 12 15:59:31 user nova-compute[71874]: DEBUG nova.policy [None req-67f42bed-1688-4a3a-8778-9347e686bc33 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c1abec24caf74dc8a27b64c21a9d4a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fa122cbabe94c6f93c862b4daf31e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71874) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 15:59:31 user nova-compute[71874]: INFO oslo.privsep.daemon [-] privsep daemon starting
Apr 12 15:59:31 user nova-compute[71874]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Apr 12 15:59:31 user nova-compute[71874]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Apr 12 15:59:31 user nova-compute[71874]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 80779
Apr 12 15:59:31 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-67f42bed-1688-4a3a-8778-9347e686bc33 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc19fd8d-3285-4ceb-8714-a0ba139f3045/disk --force-share --output=json" returned: 0 in 0.126s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 15:59:31 user nova-compute[71874]: DEBUG nova.virt.disk.api [None req-67f42bed-1688-4a3a-8778-9347e686bc33 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Cannot resize image /opt/stack/data/nova/instances/fc19fd8d-3285-4ceb-8714-a0ba139f3045/disk to a smaller size. {{(pid=71874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 15:59:31 user nova-compute[71874]: DEBUG nova.objects.instance [None req-67f42bed-1688-4a3a-8778-9347e686bc33 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lazy-loading 'migration_context' on Instance uuid fc19fd8d-3285-4ceb-8714-a0ba139f3045 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 15:59:31 user nova-compute[71874]: DEBUG nova.network.neutron [None req-de4d3742-7901-4946-86ff-3e9c2a36ac58 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 608fbea2-b42b-4bb9-94a7-2b76dcdc2001] Successfully updated port: 246d47a5-6953-4e38-8546-63953a8721cf {{(pid=71874) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 15:59:32 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-67f42bed-1688-4a3a-8778-9347e686bc33 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] Created local disks {{(pid=71874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 15:59:32 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-67f42bed-1688-4a3a-8778-9347e686bc33 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] Ensure instance console log exists: /opt/stack/data/nova/instances/fc19fd8d-3285-4ceb-8714-a0ba139f3045/console.log {{(pid=71874) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 15:59:32 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-67f42bed-1688-4a3a-8778-9347e686bc33 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 15:59:32 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-67f42bed-1688-4a3a-8778-9347e686bc33 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 15:59:32 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-67f42bed-1688-4a3a-8778-9347e686bc33 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 15:59:32 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-de4d3742-7901-4946-86ff-3e9c2a36ac58 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Acquiring lock "refresh_cache-608fbea2-b42b-4bb9-94a7-2b76dcdc2001" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 15:59:32 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-de4d3742-7901-4946-86ff-3e9c2a36ac58 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Acquired lock "refresh_cache-608fbea2-b42b-4bb9-94a7-2b76dcdc2001" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 15:59:32 user nova-compute[71874]: DEBUG nova.network.neutron [None req-de4d3742-7901-4946-86ff-3e9c2a36ac58 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 608fbea2-b42b-4bb9-94a7-2b76dcdc2001] Building network info cache for instance {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 15:59:32 user nova-compute[71874]: DEBUG nova.network.neutron [None req-d8b1b83d-8e2f-4d43-b639-9cf3663f6a65 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: 473a30c4-5aa4-481c-8859-fda815d14872] Updating instance_info_cache with network_info: [{"id": "556d7c96-2d40-43fc-83fe-2059479a5265", "address": "fa:16:3e:f3:a2:9e", "network": {"id": "06fae0be-02dd-4962-a1ac-fd0413772758", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1493924857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3fe48a3b7d846a195f1e47cc7f69695", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap556d7c96-2d", "ovs_interfaceid": "556d7c96-2d40-43fc-83fe-2059479a5265", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 15:59:32 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8b1b83d-8e2f-4d43-b639-9cf3663f6a65 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Releasing lock "refresh_cache-473a30c4-5aa4-481c-8859-fda815d14872" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 15:59:32 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8b1b83d-8e2f-4d43-b639-9cf3663f6a65 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: 473a30c4-5aa4-481c-8859-fda815d14872] Instance network_info: |[{"id": "556d7c96-2d40-43fc-83fe-2059479a5265", "address": "fa:16:3e:f3:a2:9e", "network": {"id": "06fae0be-02dd-4962-a1ac-fd0413772758", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1493924857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3fe48a3b7d846a195f1e47cc7f69695", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap556d7c96-2d", "ovs_interfaceid": "556d7c96-2d40-43fc-83fe-2059479a5265", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 15:59:32 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-b3a943de-97b4-4f61-a056-d7830da84616 req-73873cdd-1c80-4dbd-a4b5-52494f23eb63 service nova] Acquired lock "refresh_cache-473a30c4-5aa4-481c-8859-fda815d14872" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 15:59:32 user nova-compute[71874]: DEBUG nova.network.neutron [req-b3a943de-97b4-4f61-a056-d7830da84616 req-73873cdd-1c80-4dbd-a4b5-52494f23eb63 service nova] [instance: 473a30c4-5aa4-481c-8859-fda815d14872] Refreshing network info cache for port 556d7c96-2d40-43fc-83fe-2059479a5265 {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 15:59:32 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d8b1b83d-8e2f-4d43-b639-9cf3663f6a65 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: 473a30c4-5aa4-481c-8859-fda815d14872] Start _get_guest_xml network_info=[{"id": "556d7c96-2d40-43fc-83fe-2059479a5265", "address": "fa:16:3e:f3:a2:9e", "network": {"id": "06fae0be-02dd-4962-a1ac-fd0413772758", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1493924857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3fe48a3b7d846a195f1e47cc7f69695", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap556d7c96-2d", "ovs_interfaceid": "556d7c96-2d40-43fc-83fe-2059479a5265", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T15:55:37Z,direct_url=<?>,disk_format='qcow2',id=9dc63f14-8b70-4e72-89f2-13464f2f5c7c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='61a4936d9b7744c0b488d81c9b7746b6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T15:55:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_options': None, 'image_id': '9dc63f14-8b70-4e72-89f2-13464f2f5c7c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 15:59:32 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-d8b1b83d-8e2f-4d43-b639-9cf3663f6a65 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 15:59:32 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-d8b1b83d-8e2f-4d43-b639-9cf3663f6a65 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 15:59:32 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d8b1b83d-8e2f-4d43-b639-9cf3663f6a65 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71874) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 15:59:32 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-d8b1b83d-8e2f-4d43-b639-9cf3663f6a65 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T15:56:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T15:55:37Z,direct_url=<?>,disk_format='qcow2',id=9dc63f14-8b70-4e72-89f2-13464f2f5c7c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='61a4936d9b7744c0b488d81c9b7746b6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T15:55:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 15:59:32 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-d8b1b83d-8e2f-4d43-b639-9cf3663f6a65 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Flavor limits 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 15:59:32 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-d8b1b83d-8e2f-4d43-b639-9cf3663f6a65 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Image limits 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 15:59:32 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-d8b1b83d-8e2f-4d43-b639-9cf3663f6a65 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Flavor pref 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 15:59:32 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-d8b1b83d-8e2f-4d43-b639-9cf3663f6a65 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Image pref 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 15:59:32 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-d8b1b83d-8e2f-4d43-b639-9cf3663f6a65 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 15:59:32 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-d8b1b83d-8e2f-4d43-b639-9cf3663f6a65 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 15:59:32 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-d8b1b83d-8e2f-4d43-b639-9cf3663f6a65 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 15:59:32 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-d8b1b83d-8e2f-4d43-b639-9cf3663f6a65 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Got 1 possible topologies {{(pid=71874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 15:59:32 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-d8b1b83d-8e2f-4d43-b639-9cf3663f6a65 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 15:59:32 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-d8b1b83d-8e2f-4d43-b639-9cf3663f6a65 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 15:59:32 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-d8b1b83d-8e2f-4d43-b639-9cf3663f6a65 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T15:59:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-908306689',display_name='tempest-ServerRescueNegativeTestJSON-server-908306689',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-908306689',id=2,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b3fe48a3b7d846a195f1e47cc7f69695',ramdisk_id='',reservation_id='r-r5sj1znk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-984710343',owner_user_name='tempest-ServerRescueNegativeTestJSON-984710343-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T15:59:23Z,user_data=None,user_id='880266e3fa4d4dd889648c10208a1f8e',uuid=473a30c4-5aa4-481c-8859-fda815d14872,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "556d7c96-2d40-43fc-83fe-2059479a5265", "address": "fa:16:3e:f3:a2:9e", "network": {"id": "06fae0be-02dd-4962-a1ac-fd0413772758", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1493924857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3fe48a3b7d846a195f1e47cc7f69695", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap556d7c96-2d", "ovs_interfaceid": "556d7c96-2d40-43fc-83fe-2059479a5265", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 15:59:32 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-d8b1b83d-8e2f-4d43-b639-9cf3663f6a65 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Converting VIF {"id": "556d7c96-2d40-43fc-83fe-2059479a5265", "address": "fa:16:3e:f3:a2:9e", "network": {"id": "06fae0be-02dd-4962-a1ac-fd0413772758", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1493924857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3fe48a3b7d846a195f1e47cc7f69695", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap556d7c96-2d", "ovs_interfaceid": "556d7c96-2d40-43fc-83fe-2059479a5265", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 15:59:32 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-d8b1b83d-8e2f-4d43-b639-9cf3663f6a65 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:a2:9e,bridge_name='br-int',has_traffic_filtering=True,id=556d7c96-2d40-43fc-83fe-2059479a5265,network=Network(06fae0be-02dd-4962-a1ac-fd0413772758),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap556d7c96-2d') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 15:59:32 user nova-compute[71874]: DEBUG nova.objects.instance [None req-d8b1b83d-8e2f-4d43-b639-9cf3663f6a65 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lazy-loading 'pci_devices' on Instance uuid 473a30c4-5aa4-481c-8859-fda815d14872 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 15:59:32 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d8b1b83d-8e2f-4d43-b639-9cf3663f6a65 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: 473a30c4-5aa4-481c-8859-fda815d14872] End _get_guest_xml xml=<domain type="kvm">
Apr 12 15:59:32 user nova-compute[71874]:   <uuid>473a30c4-5aa4-481c-8859-fda815d14872</uuid>
Apr 12 15:59:32 user nova-compute[71874]:   <name>instance-00000002</name>
Apr 12 15:59:32 user nova-compute[71874]:   <memory>131072</memory>
Apr 12 15:59:32 user nova-compute[71874]:   <vcpu>1</vcpu>
Apr 12 15:59:32 user nova-compute[71874]:   <metadata>
Apr 12 15:59:32 user nova-compute[71874]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 15:59:32 user nova-compute[71874]:       <nova:package version="0.0.0"/>
Apr 12 15:59:32 user nova-compute[71874]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-908306689</nova:name>
Apr 12 15:59:32 user nova-compute[71874]:       <nova:creationTime>2023-04-12 15:59:32</nova:creationTime>
Apr 12 15:59:32 user nova-compute[71874]:       <nova:flavor name="m1.nano">
Apr 12 15:59:32 user nova-compute[71874]:         <nova:memory>128</nova:memory>
Apr 12 15:59:32 user nova-compute[71874]:         <nova:disk>1</nova:disk>
Apr 12 15:59:32 user nova-compute[71874]:         <nova:swap>0</nova:swap>
Apr 12 15:59:32 user nova-compute[71874]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 15:59:32 user nova-compute[71874]:         <nova:vcpus>1</nova:vcpus>
Apr 12 15:59:32 user nova-compute[71874]:       </nova:flavor>
Apr 12 15:59:32 user nova-compute[71874]:       <nova:owner>
Apr 12 15:59:32 user nova-compute[71874]:         <nova:user uuid="880266e3fa4d4dd889648c10208a1f8e">tempest-ServerRescueNegativeTestJSON-984710343-project-member</nova:user>
Apr 12 15:59:32 user nova-compute[71874]:         <nova:project uuid="b3fe48a3b7d846a195f1e47cc7f69695">tempest-ServerRescueNegativeTestJSON-984710343</nova:project>
Apr 12 15:59:32 user nova-compute[71874]:       </nova:owner>
Apr 12 15:59:32 user nova-compute[71874]:       <nova:root type="image" uuid="9dc63f14-8b70-4e72-89f2-13464f2f5c7c"/>
Apr 12 15:59:32 user nova-compute[71874]:       <nova:ports>
Apr 12 15:59:32 user nova-compute[71874]:         <nova:port uuid="556d7c96-2d40-43fc-83fe-2059479a5265">
Apr 12 15:59:32 user nova-compute[71874]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 12 15:59:32 user nova-compute[71874]:         </nova:port>
Apr 12 15:59:32 user nova-compute[71874]:       </nova:ports>
Apr 12 15:59:32 user nova-compute[71874]:     </nova:instance>
Apr 12 15:59:32 user nova-compute[71874]:   </metadata>
Apr 12 15:59:32 user nova-compute[71874]:   <sysinfo type="smbios">
Apr 12 15:59:32 user nova-compute[71874]:     <system>
Apr 12 15:59:32 user nova-compute[71874]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 15:59:32 user nova-compute[71874]:       <entry name="product">OpenStack Nova</entry>
Apr 12 15:59:32 user nova-compute[71874]:       <entry name="version">0.0.0</entry>
Apr 12 15:59:32 user nova-compute[71874]:       <entry name="serial">473a30c4-5aa4-481c-8859-fda815d14872</entry>
Apr 12 15:59:32 user nova-compute[71874]:       <entry name="uuid">473a30c4-5aa4-481c-8859-fda815d14872</entry>
Apr 12 15:59:32 user nova-compute[71874]:       <entry name="family">Virtual Machine</entry>
Apr 12 15:59:32 user nova-compute[71874]:     </system>
Apr 12 15:59:32 user nova-compute[71874]:   </sysinfo>
Apr 12 15:59:32 user nova-compute[71874]:   <os>
Apr 12 15:59:32 user nova-compute[71874]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 15:59:32 user nova-compute[71874]:     <boot dev="hd"/>
Apr 12 15:59:32 user nova-compute[71874]:     <smbios mode="sysinfo"/>
Apr 12 15:59:32 user nova-compute[71874]:   </os>
Apr 12 15:59:32 user nova-compute[71874]:   <features>
Apr 12 15:59:32 user nova-compute[71874]:     <acpi/>
Apr 12 15:59:32 user nova-compute[71874]:     <apic/>
Apr 12 15:59:32 user nova-compute[71874]:     <vmcoreinfo/>
Apr 12 15:59:32 user nova-compute[71874]:   </features>
Apr 12 15:59:32 user nova-compute[71874]:   <clock offset="utc">
Apr 12 15:59:32 user nova-compute[71874]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 15:59:32 user nova-compute[71874]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 15:59:32 user nova-compute[71874]:     <timer name="hpet" present="no"/>
Apr 12 15:59:32 user nova-compute[71874]:   </clock>
Apr 12 15:59:32 user nova-compute[71874]:   <cpu mode="custom" match="exact">
Apr 12 15:59:32 user nova-compute[71874]:     <model>Nehalem</model>
Apr 12 15:59:32 user nova-compute[71874]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 15:59:32 user nova-compute[71874]:   </cpu>
Apr 12 15:59:32 user nova-compute[71874]:   <devices>
Apr 12 15:59:32 user nova-compute[71874]:     <disk type="file" device="disk">
Apr 12 15:59:32 user nova-compute[71874]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 15:59:32 user nova-compute[71874]:       <source file="/opt/stack/data/nova/instances/473a30c4-5aa4-481c-8859-fda815d14872/disk"/>
Apr 12 15:59:32 user nova-compute[71874]:       <target dev="vda" bus="virtio"/>
Apr 12 15:59:32 user nova-compute[71874]:     </disk>
Apr 12 15:59:32 user nova-compute[71874]:     <interface type="ethernet">
Apr 12 15:59:32 user nova-compute[71874]:       <mac address="fa:16:3e:f3:a2:9e"/>
Apr 12 15:59:32 user nova-compute[71874]:       <model type="virtio"/>
Apr 12 15:59:32 user nova-compute[71874]:       <mtu size="1442"/>
Apr 12 15:59:32 user nova-compute[71874]:       <target dev="tap556d7c96-2d"/>
Apr 12 15:59:32 user nova-compute[71874]:     </interface>
Apr 12 15:59:32 user nova-compute[71874]:     <serial type="pty">
Apr 12 15:59:32 user nova-compute[71874]:       <log file="/opt/stack/data/nova/instances/473a30c4-5aa4-481c-8859-fda815d14872/console.log" append="off"/>
Apr 12 15:59:32 user nova-compute[71874]:     </serial>
Apr 12 15:59:32 user nova-compute[71874]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 15:59:32 user nova-compute[71874]:     <video>
Apr 12 15:59:32 user nova-compute[71874]:       <model type="virtio"/>
Apr 12 15:59:32 user nova-compute[71874]:     </video>
Apr 12 15:59:32 user nova-compute[71874]:     <rng model="virtio">
Apr 12 15:59:32 user nova-compute[71874]:       <backend model="random">/dev/urandom</backend>
Apr 12 15:59:32 user nova-compute[71874]:     </rng>
Apr 12 15:59:32 user nova-compute[71874]:     <controller type="usb" index="0" model="none"/>
Apr 12 15:59:32 user nova-compute[71874]:     <memballoon model="virtio">
Apr 12 15:59:32 user nova-compute[71874]:       <stats period="10"/>
Apr 12 15:59:32 user nova-compute[71874]:     </memballoon>
Apr 12 15:59:32 user nova-compute[71874]:   </devices>
Apr 12 15:59:32 user nova-compute[71874]: </domain>
Apr 12 15:59:32 user nova-compute[71874]:  {{(pid=71874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 15:59:32 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-d8b1b83d-8e2f-4d43-b639-9cf3663f6a65 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T15:59:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-908306689',display_name='tempest-ServerRescueNegativeTestJSON-server-908306689',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-908306689',id=2,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b3fe48a3b7d846a195f1e47cc7f69695',ramdisk_id='',reservation_id='r-r5sj1znk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-984710343',owner_user_name='tempest-ServerRescueNegativeTestJSON-984710343-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T15:59:23Z,user_data=None,user_id='880266e3fa4d4dd889648c10208a1f8e',uuid=473a30c4-5aa4-481c-8859-fda815d14872,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "556d7c96-2d40-43fc-83fe-2059479a5265", "address": "fa:16:3e:f3:a2:9e", "network": {"id": "06fae0be-02dd-4962-a1ac-fd0413772758", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1493924857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3fe48a3b7d846a195f1e47cc7f69695", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap556d7c96-2d", "ovs_interfaceid": "556d7c96-2d40-43fc-83fe-2059479a5265", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 15:59:32 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-d8b1b83d-8e2f-4d43-b639-9cf3663f6a65 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Converting VIF {"id": "556d7c96-2d40-43fc-83fe-2059479a5265", "address": "fa:16:3e:f3:a2:9e", "network": {"id": "06fae0be-02dd-4962-a1ac-fd0413772758", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1493924857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3fe48a3b7d846a195f1e47cc7f69695", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap556d7c96-2d", "ovs_interfaceid": "556d7c96-2d40-43fc-83fe-2059479a5265", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 15:59:32 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-d8b1b83d-8e2f-4d43-b639-9cf3663f6a65 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:a2:9e,bridge_name='br-int',has_traffic_filtering=True,id=556d7c96-2d40-43fc-83fe-2059479a5265,network=Network(06fae0be-02dd-4962-a1ac-fd0413772758),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap556d7c96-2d') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 15:59:32 user nova-compute[71874]: DEBUG os_vif [None req-d8b1b83d-8e2f-4d43-b639-9cf3663f6a65 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:a2:9e,bridge_name='br-int',has_traffic_filtering=True,id=556d7c96-2d40-43fc-83fe-2059479a5265,network=Network(06fae0be-02dd-4962-a1ac-fd0413772758),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap556d7c96-2d') {{(pid=71874) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 15:59:32 user nova-compute[71874]: DEBUG nova.network.neutron [None req-de4d3742-7901-4946-86ff-3e9c2a36ac58 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 608fbea2-b42b-4bb9-94a7-2b76dcdc2001] Instance cache missing network info. {{(pid=71874) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 15:59:32 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 15:59:32 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 15:59:32 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 15:59:32 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 15:59:32 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 15:59:32 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc4b29e0b-0a, may_exist=True) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 15:59:32 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc4b29e0b-0a, col_values=(('external_ids', {'iface-id': 'c4b29e0b-0ad8-4897-acf3-76004ac0338b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b8:23:a7', 'vm-uuid': 'afebffae-dbf6-4876-8c9f-0364f0fde49c'}),)) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 15:59:32 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 15:59:32 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 15:59:32 user nova-compute[71874]: INFO os_vif [None req-a07c7925-cadc-4133-8820-43d94fea3323 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:23:a7,bridge_name='br-int',has_traffic_filtering=True,id=c4b29e0b-0ad8-4897-acf3-76004ac0338b,network=Network(06fae0be-02dd-4962-a1ac-fd0413772758),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4b29e0b-0a')
Apr 12 15:59:32 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 15:59:32 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap556d7c96-2d, may_exist=True) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 15:59:32 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap556d7c96-2d, col_values=(('external_ids', {'iface-id': '556d7c96-2d40-43fc-83fe-2059479a5265', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f3:a2:9e', 'vm-uuid': '473a30c4-5aa4-481c-8859-fda815d14872'}),)) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 15:59:32 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 15:59:32 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 15:59:32 user nova-compute[71874]: INFO os_vif [None req-d8b1b83d-8e2f-4d43-b639-9cf3663f6a65 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:a2:9e,bridge_name='br-int',has_traffic_filtering=True,id=556d7c96-2d40-43fc-83fe-2059479a5265,network=Network(06fae0be-02dd-4962-a1ac-fd0413772758),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap556d7c96-2d')
Apr 12 15:59:32 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-a07c7925-cadc-4133-8820-43d94fea3323 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] No BDM found with device name vda, not building metadata. {{(pid=71874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 15:59:32 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-a07c7925-cadc-4133-8820-43d94fea3323 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] No VIF found with MAC fa:16:3e:b8:23:a7, not building metadata {{(pid=71874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 15:59:32 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d8b1b83d-8e2f-4d43-b639-9cf3663f6a65 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] No BDM found with device name vda, not building metadata. {{(pid=71874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 15:59:32 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d8b1b83d-8e2f-4d43-b639-9cf3663f6a65 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] No VIF found with MAC fa:16:3e:f3:a2:9e, not building metadata {{(pid=71874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 15:59:32 user nova-compute[71874]: DEBUG nova.network.neutron [req-4bf47603-8f9f-424f-9497-0d9c9c2165b7 req-a31f7e26-9f8f-450f-9e65-a6d5fff244fc service nova] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] Updated VIF entry in instance network info cache for port c4b29e0b-0ad8-4897-acf3-76004ac0338b. {{(pid=71874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 15:59:32 user nova-compute[71874]: DEBUG nova.network.neutron [req-4bf47603-8f9f-424f-9497-0d9c9c2165b7 req-a31f7e26-9f8f-450f-9e65-a6d5fff244fc service nova] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] Updating instance_info_cache with network_info: [{"id": "c4b29e0b-0ad8-4897-acf3-76004ac0338b", "address": "fa:16:3e:b8:23:a7", "network": {"id": "06fae0be-02dd-4962-a1ac-fd0413772758", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1493924857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3fe48a3b7d846a195f1e47cc7f69695", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4b29e0b-0a", "ovs_interfaceid": "c4b29e0b-0ad8-4897-acf3-76004ac0338b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 15:59:32 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-4bf47603-8f9f-424f-9497-0d9c9c2165b7 req-a31f7e26-9f8f-450f-9e65-a6d5fff244fc service nova] Releasing lock "refresh_cache-afebffae-dbf6-4876-8c9f-0364f0fde49c" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 15:59:32 user nova-compute[71874]: DEBUG nova.compute.manager [req-1b4c5183-a068-4d64-897e-97bb0fe36012 req-221c3529-18b8-4570-a9e0-6811ac4b63ff service nova] [instance: 608fbea2-b42b-4bb9-94a7-2b76dcdc2001] Received event network-changed-246d47a5-6953-4e38-8546-63953a8721cf {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 15:59:32 user nova-compute[71874]: DEBUG nova.compute.manager [req-1b4c5183-a068-4d64-897e-97bb0fe36012 req-221c3529-18b8-4570-a9e0-6811ac4b63ff service nova] [instance: 608fbea2-b42b-4bb9-94a7-2b76dcdc2001] Refreshing instance network info cache due to event network-changed-246d47a5-6953-4e38-8546-63953a8721cf. {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 15:59:32 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-1b4c5183-a068-4d64-897e-97bb0fe36012 req-221c3529-18b8-4570-a9e0-6811ac4b63ff service nova] Acquiring lock "refresh_cache-608fbea2-b42b-4bb9-94a7-2b76dcdc2001" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 15:59:32 user nova-compute[71874]: DEBUG nova.network.neutron [None req-de4d3742-7901-4946-86ff-3e9c2a36ac58 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 608fbea2-b42b-4bb9-94a7-2b76dcdc2001] Updating instance_info_cache with network_info: [{"id": "246d47a5-6953-4e38-8546-63953a8721cf", "address": "fa:16:3e:64:93:eb", "network": {"id": "b36306e0-04c5-4b1b-8022-05ff121c4e43", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1503204786-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9210f81232304e179d3e09914a492442", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap246d47a5-69", "ovs_interfaceid": "246d47a5-6953-4e38-8546-63953a8721cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 15:59:33 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-de4d3742-7901-4946-86ff-3e9c2a36ac58 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Releasing lock "refresh_cache-608fbea2-b42b-4bb9-94a7-2b76dcdc2001" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 15:59:33 user nova-compute[71874]: DEBUG nova.compute.manager [None req-de4d3742-7901-4946-86ff-3e9c2a36ac58 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 608fbea2-b42b-4bb9-94a7-2b76dcdc2001] Instance network_info: |[{"id": "246d47a5-6953-4e38-8546-63953a8721cf", "address": "fa:16:3e:64:93:eb", "network": {"id": "b36306e0-04c5-4b1b-8022-05ff121c4e43", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1503204786-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9210f81232304e179d3e09914a492442", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap246d47a5-69", "ovs_interfaceid": "246d47a5-6953-4e38-8546-63953a8721cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 15:59:33 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-1b4c5183-a068-4d64-897e-97bb0fe36012 req-221c3529-18b8-4570-a9e0-6811ac4b63ff service nova] Acquired lock "refresh_cache-608fbea2-b42b-4bb9-94a7-2b76dcdc2001" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 15:59:33 user nova-compute[71874]: DEBUG nova.network.neutron [req-1b4c5183-a068-4d64-897e-97bb0fe36012 req-221c3529-18b8-4570-a9e0-6811ac4b63ff service nova] [instance: 608fbea2-b42b-4bb9-94a7-2b76dcdc2001] Refreshing network info cache for port 246d47a5-6953-4e38-8546-63953a8721cf {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 15:59:33 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-de4d3742-7901-4946-86ff-3e9c2a36ac58 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 608fbea2-b42b-4bb9-94a7-2b76dcdc2001] Start _get_guest_xml network_info=[{"id": "246d47a5-6953-4e38-8546-63953a8721cf", "address": "fa:16:3e:64:93:eb", "network": {"id": "b36306e0-04c5-4b1b-8022-05ff121c4e43", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1503204786-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9210f81232304e179d3e09914a492442", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap246d47a5-69", "ovs_interfaceid": "246d47a5-6953-4e38-8546-63953a8721cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T15:55:37Z,direct_url=<?>,disk_format='qcow2',id=9dc63f14-8b70-4e72-89f2-13464f2f5c7c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='61a4936d9b7744c0b488d81c9b7746b6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T15:55:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_options': None, 'image_id': '9dc63f14-8b70-4e72-89f2-13464f2f5c7c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 15:59:33 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-de4d3742-7901-4946-86ff-3e9c2a36ac58 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 15:59:33 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-de4d3742-7901-4946-86ff-3e9c2a36ac58 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 15:59:33 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-de4d3742-7901-4946-86ff-3e9c2a36ac58 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71874) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 15:59:33 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-de4d3742-7901-4946-86ff-3e9c2a36ac58 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T15:56:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T15:55:37Z,direct_url=<?>,disk_format='qcow2',id=9dc63f14-8b70-4e72-89f2-13464f2f5c7c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='61a4936d9b7744c0b488d81c9b7746b6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T15:55:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 15:59:33 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-de4d3742-7901-4946-86ff-3e9c2a36ac58 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Flavor limits 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 15:59:33 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-de4d3742-7901-4946-86ff-3e9c2a36ac58 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Image limits 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 15:59:33 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-de4d3742-7901-4946-86ff-3e9c2a36ac58 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Flavor pref 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 15:59:33 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-de4d3742-7901-4946-86ff-3e9c2a36ac58 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Image pref 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 15:59:33 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-de4d3742-7901-4946-86ff-3e9c2a36ac58 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 15:59:33 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-de4d3742-7901-4946-86ff-3e9c2a36ac58 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 15:59:33 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-de4d3742-7901-4946-86ff-3e9c2a36ac58 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 15:59:33 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-de4d3742-7901-4946-86ff-3e9c2a36ac58 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Got 1 possible topologies {{(pid=71874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 15:59:33 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-de4d3742-7901-4946-86ff-3e9c2a36ac58 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 15:59:33 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-de4d3742-7901-4946-86ff-3e9c2a36ac58 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 15:59:33 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-de4d3742-7901-4946-86ff-3e9c2a36ac58 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T15:59:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1280952745',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1280952745',id=3,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9210f81232304e179d3e09914a492442',ramdisk_id='',reservation_id='r-1qz32z1g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1443944578',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T15:59:24Z,user_data=None,user_id='73f9fa5bc22a4824b3cdcb8cf7bb380c',uuid=608fbea2-b42b-4bb9-94a7-2b76dcdc2001,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "246d47a5-6953-4e38-8546-63953a8721cf", "address": "fa:16:3e:64:93:eb", "network": {"id": "b36306e0-04c5-4b1b-8022-05ff121c4e43", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1503204786-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9210f81232304e179d3e09914a492442", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap246d47a5-69", "ovs_interfaceid": "246d47a5-6953-4e38-8546-63953a8721cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 15:59:33 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-de4d3742-7901-4946-86ff-3e9c2a36ac58 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Converting VIF {"id": "246d47a5-6953-4e38-8546-63953a8721cf", "address": "fa:16:3e:64:93:eb", "network": {"id": "b36306e0-04c5-4b1b-8022-05ff121c4e43", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1503204786-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9210f81232304e179d3e09914a492442", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap246d47a5-69", "ovs_interfaceid": "246d47a5-6953-4e38-8546-63953a8721cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 15:59:33 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-de4d3742-7901-4946-86ff-3e9c2a36ac58 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:93:eb,bridge_name='br-int',has_traffic_filtering=True,id=246d47a5-6953-4e38-8546-63953a8721cf,network=Network(b36306e0-04c5-4b1b-8022-05ff121c4e43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap246d47a5-69') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 15:59:33 user nova-compute[71874]: DEBUG nova.objects.instance [None req-de4d3742-7901-4946-86ff-3e9c2a36ac58 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lazy-loading 'pci_devices' on Instance uuid 608fbea2-b42b-4bb9-94a7-2b76dcdc2001 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 15:59:33 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-de4d3742-7901-4946-86ff-3e9c2a36ac58 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 608fbea2-b42b-4bb9-94a7-2b76dcdc2001] End _get_guest_xml xml=<domain type="kvm">
Apr 12 15:59:33 user nova-compute[71874]:   <uuid>608fbea2-b42b-4bb9-94a7-2b76dcdc2001</uuid>
Apr 12 15:59:33 user nova-compute[71874]:   <name>instance-00000003</name>
Apr 12 15:59:33 user nova-compute[71874]:   <memory>131072</memory>
Apr 12 15:59:33 user nova-compute[71874]:   <vcpu>1</vcpu>
Apr 12 15:59:33 user nova-compute[71874]:   <metadata>
Apr 12 15:59:33 user nova-compute[71874]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 15:59:33 user nova-compute[71874]:       <nova:package version="0.0.0"/>
Apr 12 15:59:33 user nova-compute[71874]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1280952745</nova:name>
Apr 12 15:59:33 user nova-compute[71874]:       <nova:creationTime>2023-04-12 15:59:33</nova:creationTime>
Apr 12 15:59:33 user nova-compute[71874]:       <nova:flavor name="m1.nano">
Apr 12 15:59:33 user nova-compute[71874]:         <nova:memory>128</nova:memory>
Apr 12 15:59:33 user nova-compute[71874]:         <nova:disk>1</nova:disk>
Apr 12 15:59:33 user nova-compute[71874]:         <nova:swap>0</nova:swap>
Apr 12 15:59:33 user nova-compute[71874]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 15:59:33 user nova-compute[71874]:         <nova:vcpus>1</nova:vcpus>
Apr 12 15:59:33 user nova-compute[71874]:       </nova:flavor>
Apr 12 15:59:33 user nova-compute[71874]:       <nova:owner>
Apr 12 15:59:33 user nova-compute[71874]:         <nova:user uuid="73f9fa5bc22a4824b3cdcb8cf7bb380c">tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member</nova:user>
Apr 12 15:59:33 user nova-compute[71874]:         <nova:project uuid="9210f81232304e179d3e09914a492442">tempest-ServerBootFromVolumeStableRescueTest-1443944578</nova:project>
Apr 12 15:59:33 user nova-compute[71874]:       </nova:owner>
Apr 12 15:59:33 user nova-compute[71874]:       <nova:root type="image" uuid="9dc63f14-8b70-4e72-89f2-13464f2f5c7c"/>
Apr 12 15:59:33 user nova-compute[71874]:       <nova:ports>
Apr 12 15:59:33 user nova-compute[71874]:         <nova:port uuid="246d47a5-6953-4e38-8546-63953a8721cf">
Apr 12 15:59:33 user nova-compute[71874]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 12 15:59:33 user nova-compute[71874]:         </nova:port>
Apr 12 15:59:33 user nova-compute[71874]:       </nova:ports>
Apr 12 15:59:33 user nova-compute[71874]:     </nova:instance>
Apr 12 15:59:33 user nova-compute[71874]:   </metadata>
Apr 12 15:59:33 user nova-compute[71874]:   <sysinfo type="smbios">
Apr 12 15:59:33 user nova-compute[71874]:     <system>
Apr 12 15:59:33 user nova-compute[71874]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 15:59:33 user nova-compute[71874]:       <entry name="product">OpenStack Nova</entry>
Apr 12 15:59:33 user nova-compute[71874]:       <entry name="version">0.0.0</entry>
Apr 12 15:59:33 user nova-compute[71874]:       <entry name="serial">608fbea2-b42b-4bb9-94a7-2b76dcdc2001</entry>
Apr 12 15:59:33 user nova-compute[71874]:       <entry name="uuid">608fbea2-b42b-4bb9-94a7-2b76dcdc2001</entry>
Apr 12 15:59:33 user nova-compute[71874]:       <entry name="family">Virtual Machine</entry>
Apr 12 15:59:33 user nova-compute[71874]:     </system>
Apr 12 15:59:33 user nova-compute[71874]:   </sysinfo>
Apr 12 15:59:33 user nova-compute[71874]:   <os>
Apr 12 15:59:33 user nova-compute[71874]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 15:59:33 user nova-compute[71874]:     <boot dev="hd"/>
Apr 12 15:59:33 user nova-compute[71874]:     <smbios mode="sysinfo"/>
Apr 12 15:59:33 user nova-compute[71874]:   </os>
Apr 12 15:59:33 user nova-compute[71874]:   <features>
Apr 12 15:59:33 user nova-compute[71874]:     <acpi/>
Apr 12 15:59:33 user nova-compute[71874]:     <apic/>
Apr 12 15:59:33 user nova-compute[71874]:     <vmcoreinfo/>
Apr 12 15:59:33 user nova-compute[71874]:   </features>
Apr 12 15:59:33 user nova-compute[71874]:   <clock offset="utc">
Apr 12 15:59:33 user nova-compute[71874]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 15:59:33 user nova-compute[71874]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 15:59:33 user nova-compute[71874]:     <timer name="hpet" present="no"/>
Apr 12 15:59:33 user nova-compute[71874]:   </clock>
Apr 12 15:59:33 user nova-compute[71874]:   <cpu mode="custom" match="exact">
Apr 12 15:59:33 user nova-compute[71874]:     <model>Nehalem</model>
Apr 12 15:59:33 user nova-compute[71874]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 15:59:33 user nova-compute[71874]:   </cpu>
Apr 12 15:59:33 user nova-compute[71874]:   <devices>
Apr 12 15:59:33 user nova-compute[71874]:     <disk type="file" device="disk">
Apr 12 15:59:33 user nova-compute[71874]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 15:59:33 user nova-compute[71874]:       <source file="/opt/stack/data/nova/instances/608fbea2-b42b-4bb9-94a7-2b76dcdc2001/disk"/>
Apr 12 15:59:33 user nova-compute[71874]:       <target dev="vda" bus="virtio"/>
Apr 12 15:59:33 user nova-compute[71874]:     </disk>
Apr 12 15:59:33 user nova-compute[71874]:     <interface type="ethernet">
Apr 12 15:59:33 user nova-compute[71874]:       <mac address="fa:16:3e:64:93:eb"/>
Apr 12 15:59:33 user nova-compute[71874]:       <model type="virtio"/>
Apr 12 15:59:33 user nova-compute[71874]:       <mtu size="1442"/>
Apr 12 15:59:33 user nova-compute[71874]:       <target dev="tap246d47a5-69"/>
Apr 12 15:59:33 user nova-compute[71874]:     </interface>
Apr 12 15:59:33 user nova-compute[71874]:     <serial type="pty">
Apr 12 15:59:33 user nova-compute[71874]:       <log file="/opt/stack/data/nova/instances/608fbea2-b42b-4bb9-94a7-2b76dcdc2001/console.log" append="off"/>
Apr 12 15:59:33 user nova-compute[71874]:     </serial>
Apr 12 15:59:33 user nova-compute[71874]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 15:59:33 user nova-compute[71874]:     <video>
Apr 12 15:59:33 user nova-compute[71874]:       <model type="virtio"/>
Apr 12 15:59:33 user nova-compute[71874]:     </video>
Apr 12 15:59:33 user nova-compute[71874]:     <rng model="virtio">
Apr 12 15:59:33 user nova-compute[71874]:       <backend model="random">/dev/urandom</backend>
Apr 12 15:59:33 user nova-compute[71874]:     </rng>
Apr 12 15:59:33 user nova-compute[71874]:     <controller type="usb" index="0" model="none"/>
Apr 12 15:59:33 user nova-compute[71874]:     <memballoon model="virtio">
Apr 12 15:59:33 user nova-compute[71874]:       <stats period="10"/>
Apr 12 15:59:33 user nova-compute[71874]:     </memballoon>
Apr 12 15:59:33 user nova-compute[71874]:   </devices>
Apr 12 15:59:33 user nova-compute[71874]: </domain>
Apr 12 15:59:33 user nova-compute[71874]:  {{(pid=71874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 15:59:33 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-de4d3742-7901-4946-86ff-3e9c2a36ac58 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T15:59:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1280952745',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1280952745',id=3,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9210f81232304e179d3e09914a492442',ramdisk_id='',reservation_id='r-1qz32z1g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1443944578',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T15:59:24Z,user_data=None,user_id='73f9fa5bc22a4824b3cdcb8cf7bb380c',uuid=608fbea2-b42b-4bb9-94a7-2b76dcdc2001,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "246d47a5-6953-4e38-8546-63953a8721cf", "address": "fa:16:3e:64:93:eb", "network": {"id": "b36306e0-04c5-4b1b-8022-05ff121c4e43", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1503204786-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9210f81232304e179d3e09914a492442", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap246d47a5-69", "ovs_interfaceid": "246d47a5-6953-4e38-8546-63953a8721cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 15:59:33 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-de4d3742-7901-4946-86ff-3e9c2a36ac58 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Converting VIF {"id": "246d47a5-6953-4e38-8546-63953a8721cf", "address": "fa:16:3e:64:93:eb", "network": {"id": "b36306e0-04c5-4b1b-8022-05ff121c4e43", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1503204786-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9210f81232304e179d3e09914a492442", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap246d47a5-69", "ovs_interfaceid": "246d47a5-6953-4e38-8546-63953a8721cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 15:59:33 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-de4d3742-7901-4946-86ff-3e9c2a36ac58 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:93:eb,bridge_name='br-int',has_traffic_filtering=True,id=246d47a5-6953-4e38-8546-63953a8721cf,network=Network(b36306e0-04c5-4b1b-8022-05ff121c4e43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap246d47a5-69') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 15:59:33 user nova-compute[71874]: DEBUG os_vif [None req-de4d3742-7901-4946-86ff-3e9c2a36ac58 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:93:eb,bridge_name='br-int',has_traffic_filtering=True,id=246d47a5-6953-4e38-8546-63953a8721cf,network=Network(b36306e0-04c5-4b1b-8022-05ff121c4e43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap246d47a5-69') {{(pid=71874) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 15:59:33 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 15:59:33 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 15:59:33 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 15:59:33 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 15:59:33 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap246d47a5-69, may_exist=True) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 15:59:33 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap246d47a5-69, col_values=(('external_ids', {'iface-id': '246d47a5-6953-4e38-8546-63953a8721cf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:64:93:eb', 'vm-uuid': '608fbea2-b42b-4bb9-94a7-2b76dcdc2001'}),)) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 15:59:33 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 15:59:33 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 15:59:33 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 15:59:33 user nova-compute[71874]: INFO os_vif [None req-de4d3742-7901-4946-86ff-3e9c2a36ac58 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:93:eb,bridge_name='br-int',has_traffic_filtering=True,id=246d47a5-6953-4e38-8546-63953a8721cf,network=Network(b36306e0-04c5-4b1b-8022-05ff121c4e43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap246d47a5-69')
Apr 12 15:59:33 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-de4d3742-7901-4946-86ff-3e9c2a36ac58 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] No BDM found with device name vda, not building metadata. {{(pid=71874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 15:59:33 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-de4d3742-7901-4946-86ff-3e9c2a36ac58 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] No VIF found with MAC fa:16:3e:64:93:eb, not building metadata {{(pid=71874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 15:59:33 user nova-compute[71874]: DEBUG nova.network.neutron [req-b3a943de-97b4-4f61-a056-d7830da84616 req-73873cdd-1c80-4dbd-a4b5-52494f23eb63 service nova] [instance: 473a30c4-5aa4-481c-8859-fda815d14872] Updated VIF entry in instance network info cache for port 556d7c96-2d40-43fc-83fe-2059479a5265. {{(pid=71874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 15:59:33 user nova-compute[71874]: DEBUG nova.network.neutron [req-b3a943de-97b4-4f61-a056-d7830da84616 req-73873cdd-1c80-4dbd-a4b5-52494f23eb63 service nova] [instance: 473a30c4-5aa4-481c-8859-fda815d14872] Updating instance_info_cache with network_info: [{"id": "556d7c96-2d40-43fc-83fe-2059479a5265", "address": "fa:16:3e:f3:a2:9e", "network": {"id": "06fae0be-02dd-4962-a1ac-fd0413772758", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1493924857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3fe48a3b7d846a195f1e47cc7f69695", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap556d7c96-2d", "ovs_interfaceid": "556d7c96-2d40-43fc-83fe-2059479a5265", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 15:59:33 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-b3a943de-97b4-4f61-a056-d7830da84616 req-73873cdd-1c80-4dbd-a4b5-52494f23eb63 service nova] Releasing lock "refresh_cache-473a30c4-5aa4-481c-8859-fda815d14872" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 15:59:34 user nova-compute[71874]: DEBUG nova.network.neutron [req-1b4c5183-a068-4d64-897e-97bb0fe36012 req-221c3529-18b8-4570-a9e0-6811ac4b63ff service nova] [instance: 608fbea2-b42b-4bb9-94a7-2b76dcdc2001] Updated VIF entry in instance network info cache for port 246d47a5-6953-4e38-8546-63953a8721cf. {{(pid=71874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 15:59:34 user nova-compute[71874]: DEBUG nova.network.neutron [req-1b4c5183-a068-4d64-897e-97bb0fe36012 req-221c3529-18b8-4570-a9e0-6811ac4b63ff service nova] [instance: 608fbea2-b42b-4bb9-94a7-2b76dcdc2001] Updating instance_info_cache with network_info: [{"id": "246d47a5-6953-4e38-8546-63953a8721cf", "address": "fa:16:3e:64:93:eb", "network": {"id": "b36306e0-04c5-4b1b-8022-05ff121c4e43", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1503204786-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9210f81232304e179d3e09914a492442", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap246d47a5-69", "ovs_interfaceid": "246d47a5-6953-4e38-8546-63953a8721cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 15:59:34 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-1b4c5183-a068-4d64-897e-97bb0fe36012 req-221c3529-18b8-4570-a9e0-6811ac4b63ff service nova] Releasing lock "refresh_cache-608fbea2-b42b-4bb9-94a7-2b76dcdc2001" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 15:59:35 user nova-compute[71874]: DEBUG nova.network.neutron [None req-878f65b4-ca24-4534-a673-60e2a3e09283 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Successfully created port: 18196ae0-d9c1-4814-8803-c4ba8ad4ab45 {{(pid=71874) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 15:59:35 user nova-compute[71874]: DEBUG nova.network.neutron [None req-67f42bed-1688-4a3a-8778-9347e686bc33 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] Successfully created port: 12acc77d-6a56-426a-acda-16438c358c44 {{(pid=71874) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 15:59:35 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 15:59:35 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 15:59:35 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 15:59:35 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 15:59:35 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 15:59:36 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 15:59:36 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 15:59:36 user nova-compute[71874]: DEBUG nova.compute.manager [req-b0606c8b-5334-49dd-b576-f477f7363a44 req-54eec8ec-10ac-48d0-9f2d-a3730a35b6c2 service nova] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] Received event network-vif-plugged-c4b29e0b-0ad8-4897-acf3-76004ac0338b {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 15:59:36 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-b0606c8b-5334-49dd-b576-f477f7363a44 req-54eec8ec-10ac-48d0-9f2d-a3730a35b6c2 service nova] Acquiring lock "afebffae-dbf6-4876-8c9f-0364f0fde49c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 15:59:36 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-b0606c8b-5334-49dd-b576-f477f7363a44 req-54eec8ec-10ac-48d0-9f2d-a3730a35b6c2 service nova] Lock "afebffae-dbf6-4876-8c9f-0364f0fde49c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 15:59:36 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-b0606c8b-5334-49dd-b576-f477f7363a44 req-54eec8ec-10ac-48d0-9f2d-a3730a35b6c2 service nova] Lock "afebffae-dbf6-4876-8c9f-0364f0fde49c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 15:59:36 user nova-compute[71874]: DEBUG nova.compute.manager [req-b0606c8b-5334-49dd-b576-f477f7363a44 req-54eec8ec-10ac-48d0-9f2d-a3730a35b6c2 service nova] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] No waiting events found dispatching network-vif-plugged-c4b29e0b-0ad8-4897-acf3-76004ac0338b {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 15:59:36 user nova-compute[71874]: WARNING nova.compute.manager [req-b0606c8b-5334-49dd-b576-f477f7363a44 req-54eec8ec-10ac-48d0-9f2d-a3730a35b6c2 service nova] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] Received unexpected event network-vif-plugged-c4b29e0b-0ad8-4897-acf3-76004ac0338b for instance with vm_state building and task_state spawning.
Apr 12 15:59:36 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 15:59:36 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 15:59:37 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 15:59:37 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 15:59:38 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 15:59:38 user nova-compute[71874]: DEBUG nova.virt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Emitting event <LifecycleEvent: 1681315178.3873682, 608fbea2-b42b-4bb9-94a7-2b76dcdc2001 => Resumed> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 15:59:38 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 608fbea2-b42b-4bb9-94a7-2b76dcdc2001] VM Resumed (Lifecycle Event)
Apr 12 15:59:38 user nova-compute[71874]: DEBUG nova.compute.manager [None req-de4d3742-7901-4946-86ff-3e9c2a36ac58 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 608fbea2-b42b-4bb9-94a7-2b76dcdc2001] Instance event wait completed in 0 seconds for  {{(pid=71874) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 15:59:38 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-de4d3742-7901-4946-86ff-3e9c2a36ac58 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 608fbea2-b42b-4bb9-94a7-2b76dcdc2001] Guest created on hypervisor {{(pid=71874) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 15:59:38 user nova-compute[71874]: DEBUG nova.compute.manager [None req-a07c7925-cadc-4133-8820-43d94fea3323 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] Instance event wait completed in 0 seconds for  {{(pid=71874) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 15:59:38 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-a07c7925-cadc-4133-8820-43d94fea3323 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] Guest created on hypervisor {{(pid=71874) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 15:59:38 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8b1b83d-8e2f-4d43-b639-9cf3663f6a65 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: 473a30c4-5aa4-481c-8859-fda815d14872] Instance event wait completed in 0 seconds for  {{(pid=71874) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 15:59:38 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d8b1b83d-8e2f-4d43-b639-9cf3663f6a65 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: 473a30c4-5aa4-481c-8859-fda815d14872] Guest created on hypervisor {{(pid=71874) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 15:59:38 user nova-compute[71874]: INFO nova.virt.libvirt.driver [-] [instance: 608fbea2-b42b-4bb9-94a7-2b76dcdc2001] Instance spawned successfully.
Apr 12 15:59:38 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-de4d3742-7901-4946-86ff-3e9c2a36ac58 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 608fbea2-b42b-4bb9-94a7-2b76dcdc2001] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 15:59:38 user nova-compute[71874]: INFO nova.virt.libvirt.driver [-] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] Instance spawned successfully.
Apr 12 15:59:38 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-a07c7925-cadc-4133-8820-43d94fea3323 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 15:59:38 user nova-compute[71874]: INFO nova.virt.libvirt.driver [-] [instance: 473a30c4-5aa4-481c-8859-fda815d14872] Instance spawned successfully.
Apr 12 15:59:38 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d8b1b83d-8e2f-4d43-b639-9cf3663f6a65 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: 473a30c4-5aa4-481c-8859-fda815d14872] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 15:59:38 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 608fbea2-b42b-4bb9-94a7-2b76dcdc2001] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 15:59:38 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 608fbea2-b42b-4bb9-94a7-2b76dcdc2001] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 15:59:38 user nova-compute[71874]: DEBUG nova.compute.manager [req-08634167-c0eb-4d74-a2a3-ed732805d682 req-d724ef3f-6854-4e04-a7a0-f395cd0f76ff service nova] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] Received event network-vif-plugged-c4b29e0b-0ad8-4897-acf3-76004ac0338b {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 15:59:38 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-08634167-c0eb-4d74-a2a3-ed732805d682 req-d724ef3f-6854-4e04-a7a0-f395cd0f76ff service nova] Acquiring lock "afebffae-dbf6-4876-8c9f-0364f0fde49c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 15:59:38 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-08634167-c0eb-4d74-a2a3-ed732805d682 req-d724ef3f-6854-4e04-a7a0-f395cd0f76ff service nova] Lock "afebffae-dbf6-4876-8c9f-0364f0fde49c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 15:59:38 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-08634167-c0eb-4d74-a2a3-ed732805d682 req-d724ef3f-6854-4e04-a7a0-f395cd0f76ff service nova] Lock "afebffae-dbf6-4876-8c9f-0364f0fde49c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 15:59:38 user nova-compute[71874]: DEBUG nova.compute.manager [req-08634167-c0eb-4d74-a2a3-ed732805d682 req-d724ef3f-6854-4e04-a7a0-f395cd0f76ff service nova] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] No waiting events found dispatching network-vif-plugged-c4b29e0b-0ad8-4897-acf3-76004ac0338b {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 15:59:38 user nova-compute[71874]: WARNING nova.compute.manager [req-08634167-c0eb-4d74-a2a3-ed732805d682 req-d724ef3f-6854-4e04-a7a0-f395cd0f76ff service nova] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] Received unexpected event network-vif-plugged-c4b29e0b-0ad8-4897-acf3-76004ac0338b for instance with vm_state building and task_state spawning.
Apr 12 15:59:38 user nova-compute[71874]: DEBUG nova.compute.manager [req-08634167-c0eb-4d74-a2a3-ed732805d682 req-d724ef3f-6854-4e04-a7a0-f395cd0f76ff service nova] [instance: 608fbea2-b42b-4bb9-94a7-2b76dcdc2001] Received event network-vif-plugged-246d47a5-6953-4e38-8546-63953a8721cf {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 15:59:38 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-08634167-c0eb-4d74-a2a3-ed732805d682 req-d724ef3f-6854-4e04-a7a0-f395cd0f76ff service nova] Acquiring lock "608fbea2-b42b-4bb9-94a7-2b76dcdc2001-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 15:59:38 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-08634167-c0eb-4d74-a2a3-ed732805d682 req-d724ef3f-6854-4e04-a7a0-f395cd0f76ff service nova] Lock "608fbea2-b42b-4bb9-94a7-2b76dcdc2001-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 15:59:38 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-08634167-c0eb-4d74-a2a3-ed732805d682 req-d724ef3f-6854-4e04-a7a0-f395cd0f76ff service nova] Lock "608fbea2-b42b-4bb9-94a7-2b76dcdc2001-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 15:59:38 user nova-compute[71874]: DEBUG nova.compute.manager [req-08634167-c0eb-4d74-a2a3-ed732805d682 req-d724ef3f-6854-4e04-a7a0-f395cd0f76ff service nova] [instance: 608fbea2-b42b-4bb9-94a7-2b76dcdc2001] No waiting events found dispatching network-vif-plugged-246d47a5-6953-4e38-8546-63953a8721cf {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 15:59:38 user nova-compute[71874]: WARNING nova.compute.manager [req-08634167-c0eb-4d74-a2a3-ed732805d682 req-d724ef3f-6854-4e04-a7a0-f395cd0f76ff service nova] [instance: 608fbea2-b42b-4bb9-94a7-2b76dcdc2001] Received unexpected event network-vif-plugged-246d47a5-6953-4e38-8546-63953a8721cf for instance with vm_state building and task_state spawning.
Apr 12 15:59:38 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-a07c7925-cadc-4133-8820-43d94fea3323 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] Found default for hw_cdrom_bus of ide {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 15:59:38 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-a07c7925-cadc-4133-8820-43d94fea3323 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] Found default for hw_disk_bus of virtio {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 15:59:38 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-a07c7925-cadc-4133-8820-43d94fea3323 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] Found default for hw_input_bus of None {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 15:59:38 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-a07c7925-cadc-4133-8820-43d94fea3323 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] Found default for hw_pointer_model of None {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 15:59:38 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-a07c7925-cadc-4133-8820-43d94fea3323 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] Found default for hw_video_model of virtio {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 15:59:38 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-a07c7925-cadc-4133-8820-43d94fea3323 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] Found default for hw_vif_model of virtio {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 15:59:38 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d8b1b83d-8e2f-4d43-b639-9cf3663f6a65 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: 473a30c4-5aa4-481c-8859-fda815d14872] Found default for hw_cdrom_bus of ide {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 15:59:38 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d8b1b83d-8e2f-4d43-b639-9cf3663f6a65 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: 473a30c4-5aa4-481c-8859-fda815d14872] Found default for hw_disk_bus of virtio {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 15:59:38 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d8b1b83d-8e2f-4d43-b639-9cf3663f6a65 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: 473a30c4-5aa4-481c-8859-fda815d14872] Found default for hw_input_bus of None {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 15:59:38 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d8b1b83d-8e2f-4d43-b639-9cf3663f6a65 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: 473a30c4-5aa4-481c-8859-fda815d14872] Found default for hw_pointer_model of None {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 15:59:38 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d8b1b83d-8e2f-4d43-b639-9cf3663f6a65 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: 473a30c4-5aa4-481c-8859-fda815d14872] Found default for hw_video_model of virtio {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 15:59:38 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d8b1b83d-8e2f-4d43-b639-9cf3663f6a65 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: 473a30c4-5aa4-481c-8859-fda815d14872] Found default for hw_vif_model of virtio {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 15:59:38 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-de4d3742-7901-4946-86ff-3e9c2a36ac58 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 608fbea2-b42b-4bb9-94a7-2b76dcdc2001] Found default for hw_cdrom_bus of ide {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 15:59:38 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-de4d3742-7901-4946-86ff-3e9c2a36ac58 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 608fbea2-b42b-4bb9-94a7-2b76dcdc2001] Found default for hw_disk_bus of virtio {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 15:59:38 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-de4d3742-7901-4946-86ff-3e9c2a36ac58 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 608fbea2-b42b-4bb9-94a7-2b76dcdc2001] Found default for hw_input_bus of None {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 15:59:38 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-de4d3742-7901-4946-86ff-3e9c2a36ac58 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 608fbea2-b42b-4bb9-94a7-2b76dcdc2001] Found default for hw_pointer_model of None {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 15:59:38 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-de4d3742-7901-4946-86ff-3e9c2a36ac58 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 608fbea2-b42b-4bb9-94a7-2b76dcdc2001] Found default for hw_video_model of virtio {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 15:59:38 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-de4d3742-7901-4946-86ff-3e9c2a36ac58 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 608fbea2-b42b-4bb9-94a7-2b76dcdc2001] Found default for hw_vif_model of virtio {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 15:59:38 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 608fbea2-b42b-4bb9-94a7-2b76dcdc2001] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 15:59:38 user nova-compute[71874]: DEBUG nova.virt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Emitting event <LifecycleEvent: 1681315178.3875365, 608fbea2-b42b-4bb9-94a7-2b76dcdc2001 => Started> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 15:59:38 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 608fbea2-b42b-4bb9-94a7-2b76dcdc2001] VM Started (Lifecycle Event)
Apr 12 15:59:38 user nova-compute[71874]: DEBUG nova.network.neutron [None req-878f65b4-ca24-4534-a673-60e2a3e09283 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Successfully updated port: 18196ae0-d9c1-4814-8803-c4ba8ad4ab45 {{(pid=71874) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 15:59:38 user nova-compute[71874]: INFO nova.compute.manager [None req-de4d3742-7901-4946-86ff-3e9c2a36ac58 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 608fbea2-b42b-4bb9-94a7-2b76dcdc2001] Took 14.76 seconds to spawn the instance on the hypervisor.
Apr 12 15:59:38 user nova-compute[71874]: DEBUG nova.compute.manager [None req-de4d3742-7901-4946-86ff-3e9c2a36ac58 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 608fbea2-b42b-4bb9-94a7-2b76dcdc2001] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 15:59:38 user nova-compute[71874]: INFO nova.compute.manager [None req-d8b1b83d-8e2f-4d43-b639-9cf3663f6a65 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: 473a30c4-5aa4-481c-8859-fda815d14872] Took 15.42 seconds to spawn the instance on the hypervisor.
Apr 12 15:59:38 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8b1b83d-8e2f-4d43-b639-9cf3663f6a65 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: 473a30c4-5aa4-481c-8859-fda815d14872] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 15:59:38 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 608fbea2-b42b-4bb9-94a7-2b76dcdc2001] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 15:59:38 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-878f65b4-ca24-4534-a673-60e2a3e09283 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "refresh_cache-dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 15:59:38 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-878f65b4-ca24-4534-a673-60e2a3e09283 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquired lock "refresh_cache-dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 15:59:38 user nova-compute[71874]: DEBUG nova.network.neutron [None req-878f65b4-ca24-4534-a673-60e2a3e09283 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Building network info cache for instance {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 15:59:38 user nova-compute[71874]: INFO nova.compute.manager [None req-a07c7925-cadc-4133-8820-43d94fea3323 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] Took 18.03 seconds to spawn the instance on the hypervisor.
Apr 12 15:59:38 user nova-compute[71874]: DEBUG nova.compute.manager [None req-a07c7925-cadc-4133-8820-43d94fea3323 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 15:59:38 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 608fbea2-b42b-4bb9-94a7-2b76dcdc2001] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 15:59:38 user nova-compute[71874]: INFO nova.compute.manager [None req-de4d3742-7901-4946-86ff-3e9c2a36ac58 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 608fbea2-b42b-4bb9-94a7-2b76dcdc2001] Took 15.66 seconds to build instance.
Apr 12 15:59:38 user nova-compute[71874]: DEBUG nova.virt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Emitting event <LifecycleEvent: 1681315178.3950822, afebffae-dbf6-4876-8c9f-0364f0fde49c => Resumed> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 15:59:38 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] VM Resumed (Lifecycle Event)
Apr 12 15:59:38 user nova-compute[71874]: DEBUG nova.network.neutron [None req-67f42bed-1688-4a3a-8778-9347e686bc33 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] Successfully updated port: 12acc77d-6a56-426a-acda-16438c358c44 {{(pid=71874) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 15:59:38 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 15:59:38 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 15:59:38 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-67f42bed-1688-4a3a-8778-9347e686bc33 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Acquiring lock "refresh_cache-fc19fd8d-3285-4ceb-8714-a0ba139f3045" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 15:59:38 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-67f42bed-1688-4a3a-8778-9347e686bc33 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Acquired lock "refresh_cache-fc19fd8d-3285-4ceb-8714-a0ba139f3045" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 15:59:38 user nova-compute[71874]: DEBUG nova.network.neutron [None req-67f42bed-1688-4a3a-8778-9347e686bc33 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] Building network info cache for instance {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 15:59:38 user nova-compute[71874]: INFO nova.compute.manager [None req-a07c7925-cadc-4133-8820-43d94fea3323 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] Took 19.03 seconds to build instance.
Apr 12 15:59:38 user nova-compute[71874]: INFO nova.compute.manager [None req-d8b1b83d-8e2f-4d43-b639-9cf3663f6a65 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: 473a30c4-5aa4-481c-8859-fda815d14872] Took 16.30 seconds to build instance.
Apr 12 15:59:38 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-de4d3742-7901-4946-86ff-3e9c2a36ac58 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "608fbea2-b42b-4bb9-94a7-2b76dcdc2001" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.882s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 15:59:38 user nova-compute[71874]: DEBUG nova.virt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Emitting event <LifecycleEvent: 1681315178.3977232, afebffae-dbf6-4876-8c9f-0364f0fde49c => Started> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 15:59:38 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] VM Started (Lifecycle Event)
Apr 12 15:59:38 user nova-compute[71874]: DEBUG nova.network.neutron [None req-878f65b4-ca24-4534-a673-60e2a3e09283 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Instance cache missing network info. {{(pid=71874) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 15:59:38 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 15:59:38 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-a07c7925-cadc-4133-8820-43d94fea3323 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "afebffae-dbf6-4876-8c9f-0364f0fde49c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.274s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 15:59:38 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8b1b83d-8e2f-4d43-b639-9cf3663f6a65 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "473a30c4-5aa4-481c-8859-fda815d14872" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.464s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 15:59:38 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 15:59:38 user nova-compute[71874]: DEBUG nova.virt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Emitting event <LifecycleEvent: 1681315178.4216492, 473a30c4-5aa4-481c-8859-fda815d14872 => Resumed> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 15:59:38 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 473a30c4-5aa4-481c-8859-fda815d14872] VM Resumed (Lifecycle Event)
Apr 12 15:59:39 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 473a30c4-5aa4-481c-8859-fda815d14872] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 15:59:39 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 473a30c4-5aa4-481c-8859-fda815d14872] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 15:59:39 user nova-compute[71874]: DEBUG nova.virt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Emitting event <LifecycleEvent: 1681315178.4217293, 473a30c4-5aa4-481c-8859-fda815d14872 => Started> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 15:59:39 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 473a30c4-5aa4-481c-8859-fda815d14872] VM Started (Lifecycle Event)
Apr 12 15:59:39 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 473a30c4-5aa4-481c-8859-fda815d14872] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 15:59:39 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 473a30c4-5aa4-481c-8859-fda815d14872] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 15:59:39 user nova-compute[71874]: DEBUG nova.network.neutron [None req-67f42bed-1688-4a3a-8778-9347e686bc33 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] Instance cache missing network info. {{(pid=71874) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 15:59:39 user nova-compute[71874]: DEBUG nova.compute.manager [req-dff64ee4-af5a-4f88-9bf4-b54a9ebac77a req-686715ed-e9b2-4c21-b10a-c11af2f3d742 service nova] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Received event network-changed-18196ae0-d9c1-4814-8803-c4ba8ad4ab45 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 15:59:39 user nova-compute[71874]: DEBUG nova.compute.manager [req-dff64ee4-af5a-4f88-9bf4-b54a9ebac77a req-686715ed-e9b2-4c21-b10a-c11af2f3d742 service nova] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Refreshing instance network info cache due to event network-changed-18196ae0-d9c1-4814-8803-c4ba8ad4ab45. {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 15:59:39 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-dff64ee4-af5a-4f88-9bf4-b54a9ebac77a req-686715ed-e9b2-4c21-b10a-c11af2f3d742 service nova] Acquiring lock "refresh_cache-dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 15:59:39 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-39e6eeb6-57ed-4b35-80b3-7b3a8f425cc0 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "920c6512-180d-46e1-b0cf-240d34c3fc97" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 15:59:39 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-39e6eeb6-57ed-4b35-80b3-7b3a8f425cc0 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "920c6512-180d-46e1-b0cf-240d34c3fc97" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 15:59:39 user nova-compute[71874]: DEBUG nova.compute.manager [None req-39e6eeb6-57ed-4b35-80b3-7b3a8f425cc0 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: 920c6512-180d-46e1-b0cf-240d34c3fc97] Starting instance... {{(pid=71874) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 15:59:39 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-39e6eeb6-57ed-4b35-80b3-7b3a8f425cc0 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 15:59:39 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-39e6eeb6-57ed-4b35-80b3-7b3a8f425cc0 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 15:59:39 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-39e6eeb6-57ed-4b35-80b3-7b3a8f425cc0 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71874) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 15:59:39 user nova-compute[71874]: INFO nova.compute.claims [None req-39e6eeb6-57ed-4b35-80b3-7b3a8f425cc0 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: 920c6512-180d-46e1-b0cf-240d34c3fc97] Claim successful on node user
Apr 12 15:59:40 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-39e6eeb6-57ed-4b35-80b3-7b3a8f425cc0 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Inventory has not changed in ProviderTree for provider: 0e94b4c8-cd49-45e4-9133-d36eb4b2456b {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 15:59:40 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-39e6eeb6-57ed-4b35-80b3-7b3a8f425cc0 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Inventory has not changed for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 15:59:40 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-39e6eeb6-57ed-4b35-80b3-7b3a8f425cc0 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.547s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 15:59:40 user nova-compute[71874]: DEBUG nova.compute.manager [None req-39e6eeb6-57ed-4b35-80b3-7b3a8f425cc0 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: 920c6512-180d-46e1-b0cf-240d34c3fc97] Start building networks asynchronously for instance. {{(pid=71874) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 15:59:40 user nova-compute[71874]: DEBUG nova.compute.manager [None req-39e6eeb6-57ed-4b35-80b3-7b3a8f425cc0 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: 920c6512-180d-46e1-b0cf-240d34c3fc97] Allocating IP information in the background. {{(pid=71874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 15:59:40 user nova-compute[71874]: DEBUG nova.network.neutron [None req-39e6eeb6-57ed-4b35-80b3-7b3a8f425cc0 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: 920c6512-180d-46e1-b0cf-240d34c3fc97] allocate_for_instance() {{(pid=71874) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 15:59:40 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-39e6eeb6-57ed-4b35-80b3-7b3a8f425cc0 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: 920c6512-180d-46e1-b0cf-240d34c3fc97] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 15:59:40 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 15:59:40 user nova-compute[71874]: DEBUG nova.compute.manager [None req-39e6eeb6-57ed-4b35-80b3-7b3a8f425cc0 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: 920c6512-180d-46e1-b0cf-240d34c3fc97] Start building block device mappings for instance. {{(pid=71874) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 15:59:40 user nova-compute[71874]: DEBUG nova.compute.manager [req-ad90b704-f5a6-47cd-bdf6-98a9001f1e76 req-64a4c0f0-dfdf-47df-9045-2b561bea6c40 service nova] [instance: 608fbea2-b42b-4bb9-94a7-2b76dcdc2001] Received event network-vif-plugged-246d47a5-6953-4e38-8546-63953a8721cf {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 15:59:40 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-ad90b704-f5a6-47cd-bdf6-98a9001f1e76 req-64a4c0f0-dfdf-47df-9045-2b561bea6c40 service nova] Acquiring lock "608fbea2-b42b-4bb9-94a7-2b76dcdc2001-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 15:59:40 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-ad90b704-f5a6-47cd-bdf6-98a9001f1e76 req-64a4c0f0-dfdf-47df-9045-2b561bea6c40 service nova] Lock "608fbea2-b42b-4bb9-94a7-2b76dcdc2001-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 15:59:40 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-ad90b704-f5a6-47cd-bdf6-98a9001f1e76 req-64a4c0f0-dfdf-47df-9045-2b561bea6c40 service nova] Lock "608fbea2-b42b-4bb9-94a7-2b76dcdc2001-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 15:59:40 user nova-compute[71874]: DEBUG nova.compute.manager [req-ad90b704-f5a6-47cd-bdf6-98a9001f1e76 req-64a4c0f0-dfdf-47df-9045-2b561bea6c40 service nova] [instance: 608fbea2-b42b-4bb9-94a7-2b76dcdc2001] No waiting events found dispatching network-vif-plugged-246d47a5-6953-4e38-8546-63953a8721cf {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 15:59:40 user nova-compute[71874]: WARNING nova.compute.manager [req-ad90b704-f5a6-47cd-bdf6-98a9001f1e76 req-64a4c0f0-dfdf-47df-9045-2b561bea6c40 service nova] [instance: 608fbea2-b42b-4bb9-94a7-2b76dcdc2001] Received unexpected event network-vif-plugged-246d47a5-6953-4e38-8546-63953a8721cf for instance with vm_state active and task_state None.
Apr 12 15:59:40 user nova-compute[71874]: DEBUG nova.compute.manager [req-ad90b704-f5a6-47cd-bdf6-98a9001f1e76 req-64a4c0f0-dfdf-47df-9045-2b561bea6c40 service nova] [instance: 473a30c4-5aa4-481c-8859-fda815d14872] Received event network-vif-plugged-556d7c96-2d40-43fc-83fe-2059479a5265 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 15:59:40 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-ad90b704-f5a6-47cd-bdf6-98a9001f1e76 req-64a4c0f0-dfdf-47df-9045-2b561bea6c40 service nova] Acquiring lock "473a30c4-5aa4-481c-8859-fda815d14872-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 15:59:40 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-ad90b704-f5a6-47cd-bdf6-98a9001f1e76 req-64a4c0f0-dfdf-47df-9045-2b561bea6c40 service nova] Lock "473a30c4-5aa4-481c-8859-fda815d14872-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 15:59:40 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-ad90b704-f5a6-47cd-bdf6-98a9001f1e76 req-64a4c0f0-dfdf-47df-9045-2b561bea6c40 service nova] Lock "473a30c4-5aa4-481c-8859-fda815d14872-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 15:59:40 user nova-compute[71874]: DEBUG nova.compute.manager [req-ad90b704-f5a6-47cd-bdf6-98a9001f1e76 req-64a4c0f0-dfdf-47df-9045-2b561bea6c40 service nova] [instance: 473a30c4-5aa4-481c-8859-fda815d14872] No waiting events found dispatching network-vif-plugged-556d7c96-2d40-43fc-83fe-2059479a5265 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 15:59:40 user nova-compute[71874]: WARNING nova.compute.manager [req-ad90b704-f5a6-47cd-bdf6-98a9001f1e76 req-64a4c0f0-dfdf-47df-9045-2b561bea6c40 service nova] [instance: 473a30c4-5aa4-481c-8859-fda815d14872] Received unexpected event network-vif-plugged-556d7c96-2d40-43fc-83fe-2059479a5265 for instance with vm_state active and task_state None.
Apr 12 15:59:40 user nova-compute[71874]: DEBUG nova.compute.manager [req-ad90b704-f5a6-47cd-bdf6-98a9001f1e76 req-64a4c0f0-dfdf-47df-9045-2b561bea6c40 service nova] [instance: 473a30c4-5aa4-481c-8859-fda815d14872] Received event network-vif-plugged-556d7c96-2d40-43fc-83fe-2059479a5265 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 15:59:40 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-ad90b704-f5a6-47cd-bdf6-98a9001f1e76 req-64a4c0f0-dfdf-47df-9045-2b561bea6c40 service nova] Acquiring lock "473a30c4-5aa4-481c-8859-fda815d14872-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 15:59:40 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-ad90b704-f5a6-47cd-bdf6-98a9001f1e76 req-64a4c0f0-dfdf-47df-9045-2b561bea6c40 service nova] Lock "473a30c4-5aa4-481c-8859-fda815d14872-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 15:59:40 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-ad90b704-f5a6-47cd-bdf6-98a9001f1e76 req-64a4c0f0-dfdf-47df-9045-2b561bea6c40 service nova] Lock "473a30c4-5aa4-481c-8859-fda815d14872-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 15:59:40 user nova-compute[71874]: DEBUG nova.compute.manager [req-ad90b704-f5a6-47cd-bdf6-98a9001f1e76 req-64a4c0f0-dfdf-47df-9045-2b561bea6c40 service nova] [instance: 473a30c4-5aa4-481c-8859-fda815d14872] No waiting events found dispatching network-vif-plugged-556d7c96-2d40-43fc-83fe-2059479a5265 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 15:59:40 user nova-compute[71874]: WARNING nova.compute.manager [req-ad90b704-f5a6-47cd-bdf6-98a9001f1e76 req-64a4c0f0-dfdf-47df-9045-2b561bea6c40 service nova] [instance: 473a30c4-5aa4-481c-8859-fda815d14872] Received unexpected event network-vif-plugged-556d7c96-2d40-43fc-83fe-2059479a5265 for instance with vm_state active and task_state None.
Apr 12 15:59:40 user nova-compute[71874]: DEBUG nova.network.neutron [None req-878f65b4-ca24-4534-a673-60e2a3e09283 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Updating instance_info_cache with network_info: [{"id": "18196ae0-d9c1-4814-8803-c4ba8ad4ab45", "address": "fa:16:3e:98:72:fa", "network": {"id": "e6694358-e361-4952-b859-93755c11721e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-667152893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97ea81bd1962466bbe552424973f71a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18196ae0-d9", "ovs_interfaceid": "18196ae0-d9c1-4814-8803-c4ba8ad4ab45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 15:59:40 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-878f65b4-ca24-4534-a673-60e2a3e09283 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Releasing lock "refresh_cache-dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 15:59:40 user nova-compute[71874]: DEBUG nova.compute.manager [None req-878f65b4-ca24-4534-a673-60e2a3e09283 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Instance network_info: |[{"id": "18196ae0-d9c1-4814-8803-c4ba8ad4ab45", "address": "fa:16:3e:98:72:fa", "network": {"id": "e6694358-e361-4952-b859-93755c11721e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-667152893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97ea81bd1962466bbe552424973f71a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18196ae0-d9", "ovs_interfaceid": "18196ae0-d9c1-4814-8803-c4ba8ad4ab45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 15:59:40 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-dff64ee4-af5a-4f88-9bf4-b54a9ebac77a req-686715ed-e9b2-4c21-b10a-c11af2f3d742 service nova] Acquired lock "refresh_cache-dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 15:59:40 user nova-compute[71874]: DEBUG nova.network.neutron [req-dff64ee4-af5a-4f88-9bf4-b54a9ebac77a req-686715ed-e9b2-4c21-b10a-c11af2f3d742 service nova] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Refreshing network info cache for port 18196ae0-d9c1-4814-8803-c4ba8ad4ab45 {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 15:59:40 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-878f65b4-ca24-4534-a673-60e2a3e09283 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Start _get_guest_xml network_info=[{"id": "18196ae0-d9c1-4814-8803-c4ba8ad4ab45", "address": "fa:16:3e:98:72:fa", "network": {"id": "e6694358-e361-4952-b859-93755c11721e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-667152893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97ea81bd1962466bbe552424973f71a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18196ae0-d9", "ovs_interfaceid": "18196ae0-d9c1-4814-8803-c4ba8ad4ab45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T15:55:37Z,direct_url=<?>,disk_format='qcow2',id=9dc63f14-8b70-4e72-89f2-13464f2f5c7c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='61a4936d9b7744c0b488d81c9b7746b6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T15:55:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_options': None, 'image_id': '9dc63f14-8b70-4e72-89f2-13464f2f5c7c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 15:59:40 user nova-compute[71874]: DEBUG nova.network.neutron [None req-67f42bed-1688-4a3a-8778-9347e686bc33 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] Updating instance_info_cache with network_info: [{"id": "12acc77d-6a56-426a-acda-16438c358c44", "address": "fa:16:3e:9f:92:7f", "network": {"id": "eb4dd4b5-96d4-4b53-b510-d41e2775b92f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-596111273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fa122cbabe94c6f93c862b4daf31e50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12acc77d-6a", "ovs_interfaceid": "12acc77d-6a56-426a-acda-16438c358c44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 15:59:40 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-67f42bed-1688-4a3a-8778-9347e686bc33 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Releasing lock "refresh_cache-fc19fd8d-3285-4ceb-8714-a0ba139f3045" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 15:59:40 user nova-compute[71874]: DEBUG nova.compute.manager [None req-67f42bed-1688-4a3a-8778-9347e686bc33 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] Instance network_info: |[{"id": "12acc77d-6a56-426a-acda-16438c358c44", "address": "fa:16:3e:9f:92:7f", "network": {"id": "eb4dd4b5-96d4-4b53-b510-d41e2775b92f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-596111273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fa122cbabe94c6f93c862b4daf31e50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12acc77d-6a", "ovs_interfaceid": "12acc77d-6a56-426a-acda-16438c358c44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 15:59:40 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-67f42bed-1688-4a3a-8778-9347e686bc33 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] Start _get_guest_xml network_info=[{"id": "12acc77d-6a56-426a-acda-16438c358c44", "address": "fa:16:3e:9f:92:7f", "network": {"id": "eb4dd4b5-96d4-4b53-b510-d41e2775b92f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-596111273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fa122cbabe94c6f93c862b4daf31e50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12acc77d-6a", "ovs_interfaceid": "12acc77d-6a56-426a-acda-16438c358c44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T15:55:37Z,direct_url=<?>,disk_format='qcow2',id=9dc63f14-8b70-4e72-89f2-13464f2f5c7c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='61a4936d9b7744c0b488d81c9b7746b6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T15:55:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_options': None, 'image_id': '9dc63f14-8b70-4e72-89f2-13464f2f5c7c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 15:59:40 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-878f65b4-ca24-4534-a673-60e2a3e09283 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 15:59:40 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-878f65b4-ca24-4534-a673-60e2a3e09283 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 15:59:40 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-878f65b4-ca24-4534-a673-60e2a3e09283 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71874) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 15:59:40 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-878f65b4-ca24-4534-a673-60e2a3e09283 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T15:56:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T15:55:37Z,direct_url=<?>,disk_format='qcow2',id=9dc63f14-8b70-4e72-89f2-13464f2f5c7c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='61a4936d9b7744c0b488d81c9b7746b6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T15:55:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 15:59:40 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-878f65b4-ca24-4534-a673-60e2a3e09283 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Flavor limits 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 15:59:40 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-878f65b4-ca24-4534-a673-60e2a3e09283 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Image limits 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 15:59:40 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-878f65b4-ca24-4534-a673-60e2a3e09283 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Flavor pref 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 15:59:40 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-878f65b4-ca24-4534-a673-60e2a3e09283 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Image pref 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 15:59:40 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-878f65b4-ca24-4534-a673-60e2a3e09283 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 15:59:40 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-878f65b4-ca24-4534-a673-60e2a3e09283 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 15:59:40 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-878f65b4-ca24-4534-a673-60e2a3e09283 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 15:59:40 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-878f65b4-ca24-4534-a673-60e2a3e09283 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Got 1 possible topologies {{(pid=71874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 15:59:40 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-878f65b4-ca24-4534-a673-60e2a3e09283 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 15:59:40 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-878f65b4-ca24-4534-a673-60e2a3e09283 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 15:59:40 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-878f65b4-ca24-4534-a673-60e2a3e09283 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T15:59:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1390712116',display_name='tempest-ServerActionsTestJSON-server-1390712116',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1390712116',id=4,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNmXVADjvoPSh3uGCGCTNS/vcfcDtUjn/vZEaV3bCllfz1ZO8VIgFuZhP+mAsa+G/KA4ubi5U9Vj41YtHGsakdPR5VoByhorvfUv/PIWtER2tn1LWX2mlFyT+T8AEJplPw==',key_name='tempest-keypair-1923467613',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='97ea81bd1962466bbe552424973f71a8',ramdisk_id='',reservation_id='r-y3c7iw20',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-631887779',owner_user_name='tempest-ServerActionsTestJSON-631887779-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T15:59:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1a699b3ba8304eadb8a53d465ea340cf',uuid=dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "18196ae0-d9c1-4814-8803-c4ba8ad4ab45", "address": "fa:16:3e:98:72:fa", "network": {"id": "e6694358-e361-4952-b859-93755c11721e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-667152893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97ea81bd1962466bbe552424973f71a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18196ae0-d9", "ovs_interfaceid": "18196ae0-d9c1-4814-8803-c4ba8ad4ab45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 15:59:40 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-878f65b4-ca24-4534-a673-60e2a3e09283 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Converting VIF {"id": "18196ae0-d9c1-4814-8803-c4ba8ad4ab45", "address": "fa:16:3e:98:72:fa", "network": {"id": "e6694358-e361-4952-b859-93755c11721e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-667152893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97ea81bd1962466bbe552424973f71a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18196ae0-d9", "ovs_interfaceid": "18196ae0-d9c1-4814-8803-c4ba8ad4ab45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 15:59:40 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-878f65b4-ca24-4534-a673-60e2a3e09283 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:72:fa,bridge_name='br-int',has_traffic_filtering=True,id=18196ae0-d9c1-4814-8803-c4ba8ad4ab45,network=Network(e6694358-e361-4952-b859-93755c11721e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18196ae0-d9') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 15:59:40 user nova-compute[71874]: DEBUG nova.objects.instance [None req-878f65b4-ca24-4534-a673-60e2a3e09283 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lazy-loading 'pci_devices' on Instance uuid dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 15:59:40 user nova-compute[71874]: DEBUG nova.compute.manager [None req-39e6eeb6-57ed-4b35-80b3-7b3a8f425cc0 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: 920c6512-180d-46e1-b0cf-240d34c3fc97] Start spawning the instance on the hypervisor. {{(pid=71874) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 15:59:40 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-39e6eeb6-57ed-4b35-80b3-7b3a8f425cc0 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: 920c6512-180d-46e1-b0cf-240d34c3fc97] Creating instance directory {{(pid=71874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 15:59:40 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-39e6eeb6-57ed-4b35-80b3-7b3a8f425cc0 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: 920c6512-180d-46e1-b0cf-240d34c3fc97] Creating image(s)
Apr 12 15:59:40 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-39e6eeb6-57ed-4b35-80b3-7b3a8f425cc0 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "/opt/stack/data/nova/instances/920c6512-180d-46e1-b0cf-240d34c3fc97/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 15:59:40 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-39e6eeb6-57ed-4b35-80b3-7b3a8f425cc0 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "/opt/stack/data/nova/instances/920c6512-180d-46e1-b0cf-240d34c3fc97/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 15:59:40 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-39e6eeb6-57ed-4b35-80b3-7b3a8f425cc0 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "/opt/stack/data/nova/instances/920c6512-180d-46e1-b0cf-240d34c3fc97/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 15:59:40 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-39e6eeb6-57ed-4b35-80b3-7b3a8f425cc0 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 15:59:40 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-878f65b4-ca24-4534-a673-60e2a3e09283 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] End _get_guest_xml xml=<domain type="kvm">
Apr 12 15:59:40 user nova-compute[71874]:   <uuid>dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1</uuid>
Apr 12 15:59:40 user nova-compute[71874]:   <name>instance-00000004</name>
Apr 12 15:59:40 user nova-compute[71874]:   <memory>131072</memory>
Apr 12 15:59:40 user nova-compute[71874]:   <vcpu>1</vcpu>
Apr 12 15:59:40 user nova-compute[71874]:   <metadata>
Apr 12 15:59:40 user nova-compute[71874]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 15:59:40 user nova-compute[71874]:       <nova:package version="0.0.0"/>
Apr 12 15:59:40 user nova-compute[71874]:       <nova:name>tempest-ServerActionsTestJSON-server-1390712116</nova:name>
Apr 12 15:59:40 user nova-compute[71874]:       <nova:creationTime>2023-04-12 15:59:40</nova:creationTime>
Apr 12 15:59:40 user nova-compute[71874]:       <nova:flavor name="m1.nano">
Apr 12 15:59:40 user nova-compute[71874]:         <nova:memory>128</nova:memory>
Apr 12 15:59:40 user nova-compute[71874]:         <nova:disk>1</nova:disk>
Apr 12 15:59:40 user nova-compute[71874]:         <nova:swap>0</nova:swap>
Apr 12 15:59:40 user nova-compute[71874]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 15:59:40 user nova-compute[71874]:         <nova:vcpus>1</nova:vcpus>
Apr 12 15:59:40 user nova-compute[71874]:       </nova:flavor>
Apr 12 15:59:40 user nova-compute[71874]:       <nova:owner>
Apr 12 15:59:40 user nova-compute[71874]:         <nova:user uuid="1a699b3ba8304eadb8a53d465ea340cf">tempest-ServerActionsTestJSON-631887779-project-member</nova:user>
Apr 12 15:59:40 user nova-compute[71874]:         <nova:project uuid="97ea81bd1962466bbe552424973f71a8">tempest-ServerActionsTestJSON-631887779</nova:project>
Apr 12 15:59:40 user nova-compute[71874]:       </nova:owner>
Apr 12 15:59:40 user nova-compute[71874]:       <nova:root type="image" uuid="9dc63f14-8b70-4e72-89f2-13464f2f5c7c"/>
Apr 12 15:59:40 user nova-compute[71874]:       <nova:ports>
Apr 12 15:59:40 user nova-compute[71874]:         <nova:port uuid="18196ae0-d9c1-4814-8803-c4ba8ad4ab45">
Apr 12 15:59:40 user nova-compute[71874]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 12 15:59:40 user nova-compute[71874]:         </nova:port>
Apr 12 15:59:40 user nova-compute[71874]:       </nova:ports>
Apr 12 15:59:40 user nova-compute[71874]:     </nova:instance>
Apr 12 15:59:40 user nova-compute[71874]:   </metadata>
Apr 12 15:59:40 user nova-compute[71874]:   <sysinfo type="smbios">
Apr 12 15:59:40 user nova-compute[71874]:     <system>
Apr 12 15:59:40 user nova-compute[71874]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 15:59:40 user nova-compute[71874]:       <entry name="product">OpenStack Nova</entry>
Apr 12 15:59:40 user nova-compute[71874]:       <entry name="version">0.0.0</entry>
Apr 12 15:59:40 user nova-compute[71874]:       <entry name="serial">dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1</entry>
Apr 12 15:59:40 user nova-compute[71874]:       <entry name="uuid">dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1</entry>
Apr 12 15:59:40 user nova-compute[71874]:       <entry name="family">Virtual Machine</entry>
Apr 12 15:59:40 user nova-compute[71874]:     </system>
Apr 12 15:59:40 user nova-compute[71874]:   </sysinfo>
Apr 12 15:59:40 user nova-compute[71874]:   <os>
Apr 12 15:59:40 user nova-compute[71874]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 15:59:40 user nova-compute[71874]:     <boot dev="hd"/>
Apr 12 15:59:40 user nova-compute[71874]:     <smbios mode="sysinfo"/>
Apr 12 15:59:40 user nova-compute[71874]:   </os>
Apr 12 15:59:40 user nova-compute[71874]:   <features>
Apr 12 15:59:40 user nova-compute[71874]:     <acpi/>
Apr 12 15:59:40 user nova-compute[71874]:     <apic/>
Apr 12 15:59:40 user nova-compute[71874]:     <vmcoreinfo/>
Apr 12 15:59:40 user nova-compute[71874]:   </features>
Apr 12 15:59:40 user nova-compute[71874]:   <clock offset="utc">
Apr 12 15:59:40 user nova-compute[71874]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 15:59:40 user nova-compute[71874]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 15:59:40 user nova-compute[71874]:     <timer name="hpet" present="no"/>
Apr 12 15:59:40 user nova-compute[71874]:   </clock>
Apr 12 15:59:40 user nova-compute[71874]:   <cpu mode="custom" match="exact">
Apr 12 15:59:40 user nova-compute[71874]:     <model>Nehalem</model>
Apr 12 15:59:40 user nova-compute[71874]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 15:59:40 user nova-compute[71874]:   </cpu>
Apr 12 15:59:40 user nova-compute[71874]:   <devices>
Apr 12 15:59:40 user nova-compute[71874]:     <disk type="file" device="disk">
Apr 12 15:59:40 user nova-compute[71874]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 15:59:40 user nova-compute[71874]:       <source file="/opt/stack/data/nova/instances/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1/disk"/>
Apr 12 15:59:40 user nova-compute[71874]:       <target dev="vda" bus="virtio"/>
Apr 12 15:59:40 user nova-compute[71874]:     </disk>
Apr 12 15:59:40 user nova-compute[71874]:     <interface type="ethernet">
Apr 12 15:59:40 user nova-compute[71874]:       <mac address="fa:16:3e:98:72:fa"/>
Apr 12 15:59:40 user nova-compute[71874]:       <model type="virtio"/>
Apr 12 15:59:40 user nova-compute[71874]:       <mtu size="1442"/>
Apr 12 15:59:40 user nova-compute[71874]:       <target dev="tap18196ae0-d9"/>
Apr 12 15:59:40 user nova-compute[71874]:     </interface>
Apr 12 15:59:40 user nova-compute[71874]:     <serial type="pty">
Apr 12 15:59:40 user nova-compute[71874]:       <log file="/opt/stack/data/nova/instances/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1/console.log" append="off"/>
Apr 12 15:59:40 user nova-compute[71874]:     </serial>
Apr 12 15:59:40 user nova-compute[71874]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 15:59:40 user nova-compute[71874]:     <video>
Apr 12 15:59:40 user nova-compute[71874]:       <model type="virtio"/>
Apr 12 15:59:40 user nova-compute[71874]:     </video>
Apr 12 15:59:40 user nova-compute[71874]:     <rng model="virtio">
Apr 12 15:59:40 user nova-compute[71874]:       <backend model="random">/dev/urandom</backend>
Apr 12 15:59:40 user nova-compute[71874]:     </rng>
Apr 12 15:59:40 user nova-compute[71874]:     <controller type="usb" index="0" model="none"/>
Apr 12 15:59:40 user nova-compute[71874]:     <memballoon model="virtio">
Apr 12 15:59:40 user nova-compute[71874]:       <stats period="10"/>
Apr 12 15:59:40 user nova-compute[71874]:     </memballoon>
Apr 12 15:59:40 user nova-compute[71874]:   </devices>
Apr 12 15:59:40 user nova-compute[71874]: </domain>
Apr 12 15:59:40 user nova-compute[71874]:  {{(pid=71874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 15:59:40 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-878f65b4-ca24-4534-a673-60e2a3e09283 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T15:59:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1390712116',display_name='tempest-ServerActionsTestJSON-server-1390712116',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1390712116',id=4,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNmXVADjvoPSh3uGCGCTNS/vcfcDtUjn/vZEaV3bCllfz1ZO8VIgFuZhP+mAsa+G/KA4ubi5U9Vj41YtHGsakdPR5VoByhorvfUv/PIWtER2tn1LWX2mlFyT+T8AEJplPw==',key_name='tempest-keypair-1923467613',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='97ea81bd1962466bbe552424973f71a8',ramdisk_id='',reservation_id='r-y3c7iw20',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-631887779',owner_user_name='tempest-ServerActionsTestJSON-631887779-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T15:59:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1a699b3ba8304eadb8a53d465ea340cf',uuid=dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "18196ae0-d9c1-4814-8803-c4ba8ad4ab45", "address": "fa:16:3e:98:72:fa", "network": {"id": "e6694358-e361-4952-b859-93755c11721e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-667152893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97ea81bd1962466bbe552424973f71a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18196ae0-d9", "ovs_interfaceid": "18196ae0-d9c1-4814-8803-c4ba8ad4ab45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 15:59:40 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-878f65b4-ca24-4534-a673-60e2a3e09283 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Converting VIF {"id": "18196ae0-d9c1-4814-8803-c4ba8ad4ab45", "address": "fa:16:3e:98:72:fa", "network": {"id": "e6694358-e361-4952-b859-93755c11721e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-667152893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97ea81bd1962466bbe552424973f71a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18196ae0-d9", "ovs_interfaceid": "18196ae0-d9c1-4814-8803-c4ba8ad4ab45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 15:59:40 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-878f65b4-ca24-4534-a673-60e2a3e09283 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:72:fa,bridge_name='br-int',has_traffic_filtering=True,id=18196ae0-d9c1-4814-8803-c4ba8ad4ab45,network=Network(e6694358-e361-4952-b859-93755c11721e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18196ae0-d9') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 15:59:40 user nova-compute[71874]: DEBUG os_vif [None req-878f65b4-ca24-4534-a673-60e2a3e09283 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:72:fa,bridge_name='br-int',has_traffic_filtering=True,id=18196ae0-d9c1-4814-8803-c4ba8ad4ab45,network=Network(e6694358-e361-4952-b859-93755c11721e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18196ae0-d9') {{(pid=71874) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 15:59:40 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 15:59:40 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 15:59:40 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 15:59:40 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 15:59:40 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap18196ae0-d9, may_exist=True) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 15:59:40 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap18196ae0-d9, col_values=(('external_ids', {'iface-id': '18196ae0-d9c1-4814-8803-c4ba8ad4ab45', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:98:72:fa', 'vm-uuid': 'dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1'}),)) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 15:59:40 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 15:59:40 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-67f42bed-1688-4a3a-8778-9347e686bc33 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 15:59:40 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-67f42bed-1688-4a3a-8778-9347e686bc33 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 15:59:40 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-67f42bed-1688-4a3a-8778-9347e686bc33 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71874) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 15:59:40 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-67f42bed-1688-4a3a-8778-9347e686bc33 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T15:56:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T15:55:37Z,direct_url=<?>,disk_format='qcow2',id=9dc63f14-8b70-4e72-89f2-13464f2f5c7c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='61a4936d9b7744c0b488d81c9b7746b6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T15:55:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 15:59:40 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-67f42bed-1688-4a3a-8778-9347e686bc33 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Flavor limits 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 15:59:40 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-67f42bed-1688-4a3a-8778-9347e686bc33 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Image limits 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 15:59:40 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-67f42bed-1688-4a3a-8778-9347e686bc33 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Flavor pref 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 15:59:40 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-67f42bed-1688-4a3a-8778-9347e686bc33 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Image pref 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 15:59:40 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-67f42bed-1688-4a3a-8778-9347e686bc33 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 15:59:40 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-67f42bed-1688-4a3a-8778-9347e686bc33 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 15:59:40 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-67f42bed-1688-4a3a-8778-9347e686bc33 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 15:59:40 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-67f42bed-1688-4a3a-8778-9347e686bc33 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Got 1 possible topologies {{(pid=71874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 15:59:40 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-67f42bed-1688-4a3a-8778-9347e686bc33 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 15:59:40 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-67f42bed-1688-4a3a-8778-9347e686bc33 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 15:59:41 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-67f42bed-1688-4a3a-8778-9347e686bc33 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T15:59:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-791161427',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-791161427',id=5,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP/Xq604Ni9GyIbrWoJD7InG3g/r5BKu6klFR/hZ1bKdq3Hy1Mk7Pe+nAKjrfzX5p0VIQ/uMvcVFsrX06k2D5Iq1KlW5EZ6pMRc39ATodyZ/r0xBGzk9bUr1v/CNzPJ0EQ==',key_name='tempest-keypair-1362669684',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1fa122cbabe94c6f93c862b4daf31e50',ramdisk_id='',reservation_id='r-z1kj5zi3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-292107264',owner_user_name='tempest-AttachVolumeShelveTestJSON-292107264-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T15:59:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c1abec24caf74dc8a27b64c21a9d4a59',uuid=fc19fd8d-3285-4ceb-8714-a0ba139f3045,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "12acc77d-6a56-426a-acda-16438c358c44", "address": "fa:16:3e:9f:92:7f", "network": {"id": "eb4dd4b5-96d4-4b53-b510-d41e2775b92f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-596111273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fa122cbabe94c6f93c862b4daf31e50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12acc77d-6a", "ovs_interfaceid": "12acc77d-6a56-426a-acda-16438c358c44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 15:59:41 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-67f42bed-1688-4a3a-8778-9347e686bc33 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Converting VIF {"id": "12acc77d-6a56-426a-acda-16438c358c44", "address": "fa:16:3e:9f:92:7f", "network": {"id": "eb4dd4b5-96d4-4b53-b510-d41e2775b92f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-596111273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fa122cbabe94c6f93c862b4daf31e50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12acc77d-6a", "ovs_interfaceid": "12acc77d-6a56-426a-acda-16438c358c44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 15:59:41 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-67f42bed-1688-4a3a-8778-9347e686bc33 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:92:7f,bridge_name='br-int',has_traffic_filtering=True,id=12acc77d-6a56-426a-acda-16438c358c44,network=Network(eb4dd4b5-96d4-4b53-b510-d41e2775b92f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12acc77d-6a') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 15:59:41 user nova-compute[71874]: DEBUG nova.objects.instance [None req-67f42bed-1688-4a3a-8778-9347e686bc33 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lazy-loading 'pci_devices' on Instance uuid fc19fd8d-3285-4ceb-8714-a0ba139f3045 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 15:59:41 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 15:59:41 user nova-compute[71874]: INFO os_vif [None req-878f65b4-ca24-4534-a673-60e2a3e09283 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:72:fa,bridge_name='br-int',has_traffic_filtering=True,id=18196ae0-d9c1-4814-8803-c4ba8ad4ab45,network=Network(e6694358-e361-4952-b859-93755c11721e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18196ae0-d9')
Apr 12 15:59:41 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-67f42bed-1688-4a3a-8778-9347e686bc33 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] End _get_guest_xml xml=<domain type="kvm">
Apr 12 15:59:41 user nova-compute[71874]:   <uuid>fc19fd8d-3285-4ceb-8714-a0ba139f3045</uuid>
Apr 12 15:59:41 user nova-compute[71874]:   <name>instance-00000005</name>
Apr 12 15:59:41 user nova-compute[71874]:   <memory>131072</memory>
Apr 12 15:59:41 user nova-compute[71874]:   <vcpu>1</vcpu>
Apr 12 15:59:41 user nova-compute[71874]:   <metadata>
Apr 12 15:59:41 user nova-compute[71874]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 15:59:41 user nova-compute[71874]:       <nova:package version="0.0.0"/>
Apr 12 15:59:41 user nova-compute[71874]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-791161427</nova:name>
Apr 12 15:59:41 user nova-compute[71874]:       <nova:creationTime>2023-04-12 15:59:40</nova:creationTime>
Apr 12 15:59:41 user nova-compute[71874]:       <nova:flavor name="m1.nano">
Apr 12 15:59:41 user nova-compute[71874]:         <nova:memory>128</nova:memory>
Apr 12 15:59:41 user nova-compute[71874]:         <nova:disk>1</nova:disk>
Apr 12 15:59:41 user nova-compute[71874]:         <nova:swap>0</nova:swap>
Apr 12 15:59:41 user nova-compute[71874]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 15:59:41 user nova-compute[71874]:         <nova:vcpus>1</nova:vcpus>
Apr 12 15:59:41 user nova-compute[71874]:       </nova:flavor>
Apr 12 15:59:41 user nova-compute[71874]:       <nova:owner>
Apr 12 15:59:41 user nova-compute[71874]:         <nova:user uuid="c1abec24caf74dc8a27b64c21a9d4a59">tempest-AttachVolumeShelveTestJSON-292107264-project-member</nova:user>
Apr 12 15:59:41 user nova-compute[71874]:         <nova:project uuid="1fa122cbabe94c6f93c862b4daf31e50">tempest-AttachVolumeShelveTestJSON-292107264</nova:project>
Apr 12 15:59:41 user nova-compute[71874]:       </nova:owner>
Apr 12 15:59:41 user nova-compute[71874]:       <nova:root type="image" uuid="9dc63f14-8b70-4e72-89f2-13464f2f5c7c"/>
Apr 12 15:59:41 user nova-compute[71874]:       <nova:ports>
Apr 12 15:59:41 user nova-compute[71874]:         <nova:port uuid="12acc77d-6a56-426a-acda-16438c358c44">
Apr 12 15:59:41 user nova-compute[71874]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 12 15:59:41 user nova-compute[71874]:         </nova:port>
Apr 12 15:59:41 user nova-compute[71874]:       </nova:ports>
Apr 12 15:59:41 user nova-compute[71874]:     </nova:instance>
Apr 12 15:59:41 user nova-compute[71874]:   </metadata>
Apr 12 15:59:41 user nova-compute[71874]:   <sysinfo type="smbios">
Apr 12 15:59:41 user nova-compute[71874]:     <system>
Apr 12 15:59:41 user nova-compute[71874]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 15:59:41 user nova-compute[71874]:       <entry name="product">OpenStack Nova</entry>
Apr 12 15:59:41 user nova-compute[71874]:       <entry name="version">0.0.0</entry>
Apr 12 15:59:41 user nova-compute[71874]:       <entry name="serial">fc19fd8d-3285-4ceb-8714-a0ba139f3045</entry>
Apr 12 15:59:41 user nova-compute[71874]:       <entry name="uuid">fc19fd8d-3285-4ceb-8714-a0ba139f3045</entry>
Apr 12 15:59:41 user nova-compute[71874]:       <entry name="family">Virtual Machine</entry>
Apr 12 15:59:41 user nova-compute[71874]:     </system>
Apr 12 15:59:41 user nova-compute[71874]:   </sysinfo>
Apr 12 15:59:41 user nova-compute[71874]:   <os>
Apr 12 15:59:41 user nova-compute[71874]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 15:59:41 user nova-compute[71874]:     <boot dev="hd"/>
Apr 12 15:59:41 user nova-compute[71874]:     <smbios mode="sysinfo"/>
Apr 12 15:59:41 user nova-compute[71874]:   </os>
Apr 12 15:59:41 user nova-compute[71874]:   <features>
Apr 12 15:59:41 user nova-compute[71874]:     <acpi/>
Apr 12 15:59:41 user nova-compute[71874]:     <apic/>
Apr 12 15:59:41 user nova-compute[71874]:     <vmcoreinfo/>
Apr 12 15:59:41 user nova-compute[71874]:   </features>
Apr 12 15:59:41 user nova-compute[71874]:   <clock offset="utc">
Apr 12 15:59:41 user nova-compute[71874]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 15:59:41 user nova-compute[71874]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 15:59:41 user nova-compute[71874]:     <timer name="hpet" present="no"/>
Apr 12 15:59:41 user nova-compute[71874]:   </clock>
Apr 12 15:59:41 user nova-compute[71874]:   <cpu mode="custom" match="exact">
Apr 12 15:59:41 user nova-compute[71874]:     <model>Nehalem</model>
Apr 12 15:59:41 user nova-compute[71874]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 15:59:41 user nova-compute[71874]:   </cpu>
Apr 12 15:59:41 user nova-compute[71874]:   <devices>
Apr 12 15:59:41 user nova-compute[71874]:     <disk type="file" device="disk">
Apr 12 15:59:41 user nova-compute[71874]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 15:59:41 user nova-compute[71874]:       <source file="/opt/stack/data/nova/instances/fc19fd8d-3285-4ceb-8714-a0ba139f3045/disk"/>
Apr 12 15:59:41 user nova-compute[71874]:       <target dev="vda" bus="virtio"/>
Apr 12 15:59:41 user nova-compute[71874]:     </disk>
Apr 12 15:59:41 user nova-compute[71874]:     <interface type="ethernet">
Apr 12 15:59:41 user nova-compute[71874]:       <mac address="fa:16:3e:9f:92:7f"/>
Apr 12 15:59:41 user nova-compute[71874]:       <model type="virtio"/>
Apr 12 15:59:41 user nova-compute[71874]:       <mtu size="1442"/>
Apr 12 15:59:41 user nova-compute[71874]:       <target dev="tap12acc77d-6a"/>
Apr 12 15:59:41 user nova-compute[71874]:     </interface>
Apr 12 15:59:41 user nova-compute[71874]:     <serial type="pty">
Apr 12 15:59:41 user nova-compute[71874]:       <log file="/opt/stack/data/nova/instances/fc19fd8d-3285-4ceb-8714-a0ba139f3045/console.log" append="off"/>
Apr 12 15:59:41 user nova-compute[71874]:     </serial>
Apr 12 15:59:41 user nova-compute[71874]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 15:59:41 user nova-compute[71874]:     <video>
Apr 12 15:59:41 user nova-compute[71874]:       <model type="virtio"/>
Apr 12 15:59:41 user nova-compute[71874]:     </video>
Apr 12 15:59:41 user nova-compute[71874]:     <rng model="virtio">
Apr 12 15:59:41 user nova-compute[71874]:       <backend model="random">/dev/urandom</backend>
Apr 12 15:59:41 user nova-compute[71874]:     </rng>
Apr 12 15:59:41 user nova-compute[71874]:     <controller type="usb" index="0" model="none"/>
Apr 12 15:59:41 user nova-compute[71874]:     <memballoon model="virtio">
Apr 12 15:59:41 user nova-compute[71874]:       <stats period="10"/>
Apr 12 15:59:41 user nova-compute[71874]:     </memballoon>
Apr 12 15:59:41 user nova-compute[71874]:   </devices>
Apr 12 15:59:41 user nova-compute[71874]: </domain>
Apr 12 15:59:41 user nova-compute[71874]:  {{(pid=71874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 15:59:41 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-67f42bed-1688-4a3a-8778-9347e686bc33 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T15:59:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-791161427',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-791161427',id=5,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP/Xq604Ni9GyIbrWoJD7InG3g/r5BKu6klFR/hZ1bKdq3Hy1Mk7Pe+nAKjrfzX5p0VIQ/uMvcVFsrX06k2D5Iq1KlW5EZ6pMRc39ATodyZ/r0xBGzk9bUr1v/CNzPJ0EQ==',key_name='tempest-keypair-1362669684',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1fa122cbabe94c6f93c862b4daf31e50',ramdisk_id='',reservation_id='r-z1kj5zi3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-292107264',owner_user_name='tempest-AttachVolumeShelveTestJSON-292107264-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T15:59:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c1abec24caf74dc8a27b64c21a9d4a59',uuid=fc19fd8d-3285-4ceb-8714-a0ba139f3045,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "12acc77d-6a56-426a-acda-16438c358c44", "address": "fa:16:3e:9f:92:7f", "network": {"id": "eb4dd4b5-96d4-4b53-b510-d41e2775b92f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-596111273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fa122cbabe94c6f93c862b4daf31e50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12acc77d-6a", "ovs_interfaceid": "12acc77d-6a56-426a-acda-16438c358c44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 15:59:41 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-67f42bed-1688-4a3a-8778-9347e686bc33 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Converting VIF {"id": "12acc77d-6a56-426a-acda-16438c358c44", "address": "fa:16:3e:9f:92:7f", "network": {"id": "eb4dd4b5-96d4-4b53-b510-d41e2775b92f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-596111273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fa122cbabe94c6f93c862b4daf31e50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12acc77d-6a", "ovs_interfaceid": "12acc77d-6a56-426a-acda-16438c358c44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 15:59:41 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-67f42bed-1688-4a3a-8778-9347e686bc33 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:92:7f,bridge_name='br-int',has_traffic_filtering=True,id=12acc77d-6a56-426a-acda-16438c358c44,network=Network(eb4dd4b5-96d4-4b53-b510-d41e2775b92f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12acc77d-6a') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 15:59:41 user nova-compute[71874]: DEBUG os_vif [None req-67f42bed-1688-4a3a-8778-9347e686bc33 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:92:7f,bridge_name='br-int',has_traffic_filtering=True,id=12acc77d-6a56-426a-acda-16438c358c44,network=Network(eb4dd4b5-96d4-4b53-b510-d41e2775b92f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12acc77d-6a') {{(pid=71874) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 15:59:41 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 15:59:41 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 15:59:41 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 15:59:41 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 15:59:41 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap12acc77d-6a, may_exist=True) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 15:59:41 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap12acc77d-6a, col_values=(('external_ids', {'iface-id': '12acc77d-6a56-426a-acda-16438c358c44', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9f:92:7f', 'vm-uuid': 'fc19fd8d-3285-4ceb-8714-a0ba139f3045'}),)) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 15:59:41 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-39e6eeb6-57ed-4b35-80b3-7b3a8f425cc0 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json" returned: 0 in 0.196s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 15:59:41 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 15:59:41 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-39e6eeb6-57ed-4b35-80b3-7b3a8f425cc0 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "b88df1b37cb431f52bc53b5616015c89b5bec411" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 15:59:41 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-39e6eeb6-57ed-4b35-80b3-7b3a8f425cc0 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "b88df1b37cb431f52bc53b5616015c89b5bec411" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 15:59:41 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-39e6eeb6-57ed-4b35-80b3-7b3a8f425cc0 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 15:59:41 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 15:59:41 user nova-compute[71874]: INFO os_vif [None req-67f42bed-1688-4a3a-8778-9347e686bc33 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:92:7f,bridge_name='br-int',has_traffic_filtering=True,id=12acc77d-6a56-426a-acda-16438c358c44,network=Network(eb4dd4b5-96d4-4b53-b510-d41e2775b92f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12acc77d-6a')
Apr 12 15:59:41 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-878f65b4-ca24-4534-a673-60e2a3e09283 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] No BDM found with device name vda, not building metadata. {{(pid=71874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 15:59:41 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-878f65b4-ca24-4534-a673-60e2a3e09283 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] No VIF found with MAC fa:16:3e:98:72:fa, not building metadata {{(pid=71874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 15:59:41 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-67f42bed-1688-4a3a-8778-9347e686bc33 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] No BDM found with device name vda, not building metadata. {{(pid=71874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 15:59:41 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-67f42bed-1688-4a3a-8778-9347e686bc33 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] No VIF found with MAC fa:16:3e:9f:92:7f, not building metadata {{(pid=71874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 15:59:41 user nova-compute[71874]: DEBUG nova.compute.manager [req-3e134bfd-d8c2-4fea-8505-05886826eb03 req-1ec0e2d7-2699-4511-8320-b4b98e61cc5f service nova] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] Received event network-changed-12acc77d-6a56-426a-acda-16438c358c44 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 15:59:41 user nova-compute[71874]: DEBUG nova.compute.manager [req-3e134bfd-d8c2-4fea-8505-05886826eb03 req-1ec0e2d7-2699-4511-8320-b4b98e61cc5f service nova] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] Refreshing instance network info cache due to event network-changed-12acc77d-6a56-426a-acda-16438c358c44. {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 15:59:41 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-3e134bfd-d8c2-4fea-8505-05886826eb03 req-1ec0e2d7-2699-4511-8320-b4b98e61cc5f service nova] Acquiring lock "refresh_cache-fc19fd8d-3285-4ceb-8714-a0ba139f3045" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 15:59:41 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-3e134bfd-d8c2-4fea-8505-05886826eb03 req-1ec0e2d7-2699-4511-8320-b4b98e61cc5f service nova] Acquired lock "refresh_cache-fc19fd8d-3285-4ceb-8714-a0ba139f3045" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 15:59:41 user nova-compute[71874]: DEBUG nova.network.neutron [req-3e134bfd-d8c2-4fea-8505-05886826eb03 req-1ec0e2d7-2699-4511-8320-b4b98e61cc5f service nova] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] Refreshing network info cache for port 12acc77d-6a56-426a-acda-16438c358c44 {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 15:59:41 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-39e6eeb6-57ed-4b35-80b3-7b3a8f425cc0 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json" returned: 0 in 0.204s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 15:59:41 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-39e6eeb6-57ed-4b35-80b3-7b3a8f425cc0 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411,backing_fmt=raw /opt/stack/data/nova/instances/920c6512-180d-46e1-b0cf-240d34c3fc97/disk 1073741824 {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 15:59:41 user nova-compute[71874]: DEBUG nova.policy [None req-39e6eeb6-57ed-4b35-80b3-7b3a8f425cc0 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5a514f6d877a4ab0bec597fee13ce9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d940eae5394293b87cfced45911ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71874) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 15:59:41 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-39e6eeb6-57ed-4b35-80b3-7b3a8f425cc0 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411,backing_fmt=raw /opt/stack/data/nova/instances/920c6512-180d-46e1-b0cf-240d34c3fc97/disk 1073741824" returned: 0 in 0.095s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 15:59:41 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-39e6eeb6-57ed-4b35-80b3-7b3a8f425cc0 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "b88df1b37cb431f52bc53b5616015c89b5bec411" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.308s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 15:59:41 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-39e6eeb6-57ed-4b35-80b3-7b3a8f425cc0 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 15:59:41 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-39e6eeb6-57ed-4b35-80b3-7b3a8f425cc0 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json" returned: 0 in 0.198s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 15:59:41 user nova-compute[71874]: DEBUG nova.virt.disk.api [None req-39e6eeb6-57ed-4b35-80b3-7b3a8f425cc0 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Checking if we can resize image /opt/stack/data/nova/instances/920c6512-180d-46e1-b0cf-240d34c3fc97/disk. size=1073741824 {{(pid=71874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 15:59:41 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-39e6eeb6-57ed-4b35-80b3-7b3a8f425cc0 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/920c6512-180d-46e1-b0cf-240d34c3fc97/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 15:59:41 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-39e6eeb6-57ed-4b35-80b3-7b3a8f425cc0 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/920c6512-180d-46e1-b0cf-240d34c3fc97/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 15:59:41 user nova-compute[71874]: DEBUG nova.virt.disk.api [None req-39e6eeb6-57ed-4b35-80b3-7b3a8f425cc0 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Cannot resize image /opt/stack/data/nova/instances/920c6512-180d-46e1-b0cf-240d34c3fc97/disk to a smaller size. {{(pid=71874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 15:59:41 user nova-compute[71874]: DEBUG nova.objects.instance [None req-39e6eeb6-57ed-4b35-80b3-7b3a8f425cc0 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lazy-loading 'migration_context' on Instance uuid 920c6512-180d-46e1-b0cf-240d34c3fc97 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 15:59:41 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-39e6eeb6-57ed-4b35-80b3-7b3a8f425cc0 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: 920c6512-180d-46e1-b0cf-240d34c3fc97] Created local disks {{(pid=71874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 15:59:41 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-39e6eeb6-57ed-4b35-80b3-7b3a8f425cc0 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: 920c6512-180d-46e1-b0cf-240d34c3fc97] Ensure instance console log exists: /opt/stack/data/nova/instances/920c6512-180d-46e1-b0cf-240d34c3fc97/console.log {{(pid=71874) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 15:59:41 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-39e6eeb6-57ed-4b35-80b3-7b3a8f425cc0 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 15:59:41 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-39e6eeb6-57ed-4b35-80b3-7b3a8f425cc0 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 15:59:41 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-39e6eeb6-57ed-4b35-80b3-7b3a8f425cc0 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 15:59:42 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 15:59:42 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 15:59:42 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 15:59:42 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 15:59:42 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 15:59:42 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 15:59:42 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 15:59:42 user nova-compute[71874]: DEBUG nova.network.neutron [req-dff64ee4-af5a-4f88-9bf4-b54a9ebac77a req-686715ed-e9b2-4c21-b10a-c11af2f3d742 service nova] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Updated VIF entry in instance network info cache for port 18196ae0-d9c1-4814-8803-c4ba8ad4ab45. {{(pid=71874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 15:59:42 user nova-compute[71874]: DEBUG nova.network.neutron [req-dff64ee4-af5a-4f88-9bf4-b54a9ebac77a req-686715ed-e9b2-4c21-b10a-c11af2f3d742 service nova] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Updating instance_info_cache with network_info: [{"id": "18196ae0-d9c1-4814-8803-c4ba8ad4ab45", "address": "fa:16:3e:98:72:fa", "network": {"id": "e6694358-e361-4952-b859-93755c11721e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-667152893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97ea81bd1962466bbe552424973f71a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18196ae0-d9", "ovs_interfaceid": "18196ae0-d9c1-4814-8803-c4ba8ad4ab45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 15:59:43 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-dff64ee4-af5a-4f88-9bf4-b54a9ebac77a req-686715ed-e9b2-4c21-b10a-c11af2f3d742 service nova] Releasing lock "refresh_cache-dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 15:59:43 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 15:59:43 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 15:59:43 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 15:59:43 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 15:59:44 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 15:59:44 user nova-compute[71874]: DEBUG nova.network.neutron [req-3e134bfd-d8c2-4fea-8505-05886826eb03 req-1ec0e2d7-2699-4511-8320-b4b98e61cc5f service nova] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] Updated VIF entry in instance network info cache for port 12acc77d-6a56-426a-acda-16438c358c44. {{(pid=71874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 15:59:44 user nova-compute[71874]: DEBUG nova.network.neutron [req-3e134bfd-d8c2-4fea-8505-05886826eb03 req-1ec0e2d7-2699-4511-8320-b4b98e61cc5f service nova] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] Updating instance_info_cache with network_info: [{"id": "12acc77d-6a56-426a-acda-16438c358c44", "address": "fa:16:3e:9f:92:7f", "network": {"id": "eb4dd4b5-96d4-4b53-b510-d41e2775b92f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-596111273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fa122cbabe94c6f93c862b4daf31e50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12acc77d-6a", "ovs_interfaceid": "12acc77d-6a56-426a-acda-16438c358c44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 15:59:44 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 15:59:44 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 15:59:44 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 15:59:44 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-3e134bfd-d8c2-4fea-8505-05886826eb03 req-1ec0e2d7-2699-4511-8320-b4b98e61cc5f service nova] Releasing lock "refresh_cache-fc19fd8d-3285-4ceb-8714-a0ba139f3045" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 15:59:44 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 15:59:44 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 15:59:44 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 15:59:44 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 15:59:44 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 15:59:44 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 15:59:44 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 15:59:44 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 15:59:44 user nova-compute[71874]: DEBUG nova.network.neutron [None req-39e6eeb6-57ed-4b35-80b3-7b3a8f425cc0 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: 920c6512-180d-46e1-b0cf-240d34c3fc97] Successfully created port: f0f2f7c4-d9e5-4b71-88d0-1f66e8d7a81e {{(pid=71874) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 15:59:45 user nova-compute[71874]: DEBUG nova.compute.manager [req-bdd2ba2f-ec94-4d15-b8ec-e37ce3846f6a req-08393d9c-c348-4af1-a9a8-e3d1d49c8218 service nova] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Received event network-vif-plugged-18196ae0-d9c1-4814-8803-c4ba8ad4ab45 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 15:59:45 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-bdd2ba2f-ec94-4d15-b8ec-e37ce3846f6a req-08393d9c-c348-4af1-a9a8-e3d1d49c8218 service nova] Acquiring lock "dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 15:59:45 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-bdd2ba2f-ec94-4d15-b8ec-e37ce3846f6a req-08393d9c-c348-4af1-a9a8-e3d1d49c8218 service nova] Lock "dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 15:59:45 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-bdd2ba2f-ec94-4d15-b8ec-e37ce3846f6a req-08393d9c-c348-4af1-a9a8-e3d1d49c8218 service nova] Lock "dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 15:59:45 user nova-compute[71874]: DEBUG nova.compute.manager [req-bdd2ba2f-ec94-4d15-b8ec-e37ce3846f6a req-08393d9c-c348-4af1-a9a8-e3d1d49c8218 service nova] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] No waiting events found dispatching network-vif-plugged-18196ae0-d9c1-4814-8803-c4ba8ad4ab45 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 15:59:45 user nova-compute[71874]: WARNING nova.compute.manager [req-bdd2ba2f-ec94-4d15-b8ec-e37ce3846f6a req-08393d9c-c348-4af1-a9a8-e3d1d49c8218 service nova] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Received unexpected event network-vif-plugged-18196ae0-d9c1-4814-8803-c4ba8ad4ab45 for instance with vm_state building and task_state spawning.
Apr 12 15:59:45 user nova-compute[71874]: DEBUG nova.compute.manager [req-59d4dde2-ca1e-4ce6-a6f6-a3db319ca0f0 req-b9ce2d36-2bd6-4a94-a90c-a9be9cb7f6dd service nova] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] Received event network-vif-plugged-12acc77d-6a56-426a-acda-16438c358c44 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 15:59:45 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-59d4dde2-ca1e-4ce6-a6f6-a3db319ca0f0 req-b9ce2d36-2bd6-4a94-a90c-a9be9cb7f6dd service nova] Acquiring lock "fc19fd8d-3285-4ceb-8714-a0ba139f3045-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 15:59:45 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-59d4dde2-ca1e-4ce6-a6f6-a3db319ca0f0 req-b9ce2d36-2bd6-4a94-a90c-a9be9cb7f6dd service nova] Lock "fc19fd8d-3285-4ceb-8714-a0ba139f3045-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 15:59:45 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-59d4dde2-ca1e-4ce6-a6f6-a3db319ca0f0 req-b9ce2d36-2bd6-4a94-a90c-a9be9cb7f6dd service nova] Lock "fc19fd8d-3285-4ceb-8714-a0ba139f3045-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 15:59:45 user nova-compute[71874]: DEBUG nova.compute.manager [req-59d4dde2-ca1e-4ce6-a6f6-a3db319ca0f0 req-b9ce2d36-2bd6-4a94-a90c-a9be9cb7f6dd service nova] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] No waiting events found dispatching network-vif-plugged-12acc77d-6a56-426a-acda-16438c358c44 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 15:59:45 user nova-compute[71874]: WARNING nova.compute.manager [req-59d4dde2-ca1e-4ce6-a6f6-a3db319ca0f0 req-b9ce2d36-2bd6-4a94-a90c-a9be9cb7f6dd service nova] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] Received unexpected event network-vif-plugged-12acc77d-6a56-426a-acda-16438c358c44 for instance with vm_state building and task_state spawning.
Apr 12 15:59:45 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 15:59:45 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 15:59:45 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 15:59:45 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 15:59:46 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 15:59:46 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 15:59:46 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 15:59:46 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 15:59:46 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 15:59:47 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 15:59:47 user nova-compute[71874]: DEBUG nova.compute.manager [req-d576cf9b-a914-4672-80c7-b5f09bc68d21 req-8bd35c0f-57e6-40e9-bfd3-fad13aeb4939 service nova] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Received event network-vif-plugged-18196ae0-d9c1-4814-8803-c4ba8ad4ab45 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 15:59:47 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-d576cf9b-a914-4672-80c7-b5f09bc68d21 req-8bd35c0f-57e6-40e9-bfd3-fad13aeb4939 service nova] Acquiring lock "dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 15:59:47 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-d576cf9b-a914-4672-80c7-b5f09bc68d21 req-8bd35c0f-57e6-40e9-bfd3-fad13aeb4939 service nova] Lock "dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 15:59:47 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-d576cf9b-a914-4672-80c7-b5f09bc68d21 req-8bd35c0f-57e6-40e9-bfd3-fad13aeb4939 service nova] Lock "dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 15:59:47 user nova-compute[71874]: DEBUG nova.compute.manager [req-d576cf9b-a914-4672-80c7-b5f09bc68d21 req-8bd35c0f-57e6-40e9-bfd3-fad13aeb4939 service nova] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] No waiting events found dispatching network-vif-plugged-18196ae0-d9c1-4814-8803-c4ba8ad4ab45 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 15:59:47 user nova-compute[71874]: WARNING nova.compute.manager [req-d576cf9b-a914-4672-80c7-b5f09bc68d21 req-8bd35c0f-57e6-40e9-bfd3-fad13aeb4939 service nova] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Received unexpected event network-vif-plugged-18196ae0-d9c1-4814-8803-c4ba8ad4ab45 for instance with vm_state building and task_state spawning.
Apr 12 15:59:47 user nova-compute[71874]: DEBUG nova.virt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Emitting event <LifecycleEvent: 1681315187.2806396, dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 => Resumed> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 15:59:47 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] VM Resumed (Lifecycle Event)
Apr 12 15:59:47 user nova-compute[71874]: DEBUG nova.compute.manager [None req-878f65b4-ca24-4534-a673-60e2a3e09283 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Instance event wait completed in 0 seconds for  {{(pid=71874) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 15:59:47 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-878f65b4-ca24-4534-a673-60e2a3e09283 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Guest created on hypervisor {{(pid=71874) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 15:59:47 user nova-compute[71874]: DEBUG nova.compute.manager [None req-67f42bed-1688-4a3a-8778-9347e686bc33 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] Instance event wait completed in 0 seconds for  {{(pid=71874) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 15:59:47 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-67f42bed-1688-4a3a-8778-9347e686bc33 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] Guest created on hypervisor {{(pid=71874) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 15:59:47 user nova-compute[71874]: INFO nova.virt.libvirt.driver [-] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Instance spawned successfully.
Apr 12 15:59:47 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-878f65b4-ca24-4534-a673-60e2a3e09283 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 15:59:47 user nova-compute[71874]: INFO nova.virt.libvirt.driver [-] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] Instance spawned successfully.
Apr 12 15:59:47 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-67f42bed-1688-4a3a-8778-9347e686bc33 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 15:59:47 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 15:59:47 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 15:59:47 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 15:59:47 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-67f42bed-1688-4a3a-8778-9347e686bc33 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] Found default for hw_cdrom_bus of ide {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 15:59:47 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-67f42bed-1688-4a3a-8778-9347e686bc33 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] Found default for hw_disk_bus of virtio {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 15:59:47 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-67f42bed-1688-4a3a-8778-9347e686bc33 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] Found default for hw_input_bus of None {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 15:59:47 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-67f42bed-1688-4a3a-8778-9347e686bc33 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] Found default for hw_pointer_model of None {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 15:59:47 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-67f42bed-1688-4a3a-8778-9347e686bc33 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] Found default for hw_video_model of virtio {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 15:59:47 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-67f42bed-1688-4a3a-8778-9347e686bc33 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] Found default for hw_vif_model of virtio {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 15:59:47 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 15:59:47 user nova-compute[71874]: DEBUG nova.virt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Emitting event <LifecycleEvent: 1681315187.2831578, dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 => Started> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 15:59:47 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] VM Started (Lifecycle Event)
Apr 12 15:59:47 user nova-compute[71874]: DEBUG nova.compute.manager [req-a751832c-aa2c-4759-8f5a-b0cdd57494ff req-294b6c85-f8cb-426f-a5a3-9f4b785a10a2 service nova] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] Received event network-vif-plugged-12acc77d-6a56-426a-acda-16438c358c44 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 15:59:47 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-a751832c-aa2c-4759-8f5a-b0cdd57494ff req-294b6c85-f8cb-426f-a5a3-9f4b785a10a2 service nova] Acquiring lock "fc19fd8d-3285-4ceb-8714-a0ba139f3045-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 15:59:47 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-a751832c-aa2c-4759-8f5a-b0cdd57494ff req-294b6c85-f8cb-426f-a5a3-9f4b785a10a2 service nova] Lock "fc19fd8d-3285-4ceb-8714-a0ba139f3045-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 15:59:47 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-a751832c-aa2c-4759-8f5a-b0cdd57494ff req-294b6c85-f8cb-426f-a5a3-9f4b785a10a2 service nova] Lock "fc19fd8d-3285-4ceb-8714-a0ba139f3045-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 15:59:47 user nova-compute[71874]: DEBUG nova.compute.manager [req-a751832c-aa2c-4759-8f5a-b0cdd57494ff req-294b6c85-f8cb-426f-a5a3-9f4b785a10a2 service nova] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] No waiting events found dispatching network-vif-plugged-12acc77d-6a56-426a-acda-16438c358c44 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 15:59:47 user nova-compute[71874]: WARNING nova.compute.manager [req-a751832c-aa2c-4759-8f5a-b0cdd57494ff req-294b6c85-f8cb-426f-a5a3-9f4b785a10a2 service nova] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] Received unexpected event network-vif-plugged-12acc77d-6a56-426a-acda-16438c358c44 for instance with vm_state building and task_state spawning.
Apr 12 15:59:47 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-878f65b4-ca24-4534-a673-60e2a3e09283 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Found default for hw_cdrom_bus of ide {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 15:59:47 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-878f65b4-ca24-4534-a673-60e2a3e09283 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Found default for hw_disk_bus of virtio {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 15:59:47 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-878f65b4-ca24-4534-a673-60e2a3e09283 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Found default for hw_input_bus of None {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 15:59:47 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-878f65b4-ca24-4534-a673-60e2a3e09283 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Found default for hw_pointer_model of None {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 15:59:47 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-878f65b4-ca24-4534-a673-60e2a3e09283 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Found default for hw_video_model of virtio {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 15:59:47 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-878f65b4-ca24-4534-a673-60e2a3e09283 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Found default for hw_vif_model of virtio {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 15:59:47 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 15:59:47 user nova-compute[71874]: DEBUG nova.network.neutron [None req-39e6eeb6-57ed-4b35-80b3-7b3a8f425cc0 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: 920c6512-180d-46e1-b0cf-240d34c3fc97] Successfully updated port: f0f2f7c4-d9e5-4b71-88d0-1f66e8d7a81e {{(pid=71874) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 15:59:47 user nova-compute[71874]: INFO nova.compute.manager [None req-67f42bed-1688-4a3a-8778-9347e686bc33 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] Took 16.19 seconds to spawn the instance on the hypervisor.
Apr 12 15:59:47 user nova-compute[71874]: DEBUG nova.compute.manager [None req-67f42bed-1688-4a3a-8778-9347e686bc33 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 15:59:47 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-39e6eeb6-57ed-4b35-80b3-7b3a8f425cc0 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "refresh_cache-920c6512-180d-46e1-b0cf-240d34c3fc97" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 15:59:47 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-39e6eeb6-57ed-4b35-80b3-7b3a8f425cc0 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquired lock "refresh_cache-920c6512-180d-46e1-b0cf-240d34c3fc97" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 15:59:47 user nova-compute[71874]: DEBUG nova.network.neutron [None req-39e6eeb6-57ed-4b35-80b3-7b3a8f425cc0 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: 920c6512-180d-46e1-b0cf-240d34c3fc97] Building network info cache for instance {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 15:59:47 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 15:59:47 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 15:59:47 user nova-compute[71874]: DEBUG nova.virt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Emitting event <LifecycleEvent: 1681315187.2942204, fc19fd8d-3285-4ceb-8714-a0ba139f3045 => Resumed> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 15:59:47 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] VM Resumed (Lifecycle Event)
Apr 12 15:59:47 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 15:59:47 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 15:59:47 user nova-compute[71874]: DEBUG nova.network.neutron [None req-39e6eeb6-57ed-4b35-80b3-7b3a8f425cc0 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: 920c6512-180d-46e1-b0cf-240d34c3fc97] Instance cache missing network info. {{(pid=71874) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 15:59:47 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 15:59:47 user nova-compute[71874]: DEBUG nova.virt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Emitting event <LifecycleEvent: 1681315187.2944822, fc19fd8d-3285-4ceb-8714-a0ba139f3045 => Started> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 15:59:47 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] VM Started (Lifecycle Event)
Apr 12 15:59:47 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 15:59:47 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 15:59:47 user nova-compute[71874]: INFO nova.compute.manager [None req-878f65b4-ca24-4534-a673-60e2a3e09283 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Took 16.82 seconds to spawn the instance on the hypervisor.
Apr 12 15:59:47 user nova-compute[71874]: DEBUG nova.compute.manager [None req-878f65b4-ca24-4534-a673-60e2a3e09283 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 15:59:47 user nova-compute[71874]: INFO nova.compute.manager [None req-67f42bed-1688-4a3a-8778-9347e686bc33 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] Took 17.20 seconds to build instance.
Apr 12 15:59:47 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-67f42bed-1688-4a3a-8778-9347e686bc33 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "fc19fd8d-3285-4ceb-8714-a0ba139f3045" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.317s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 15:59:47 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 15:59:48 user nova-compute[71874]: INFO nova.compute.manager [None req-878f65b4-ca24-4534-a673-60e2a3e09283 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Took 17.67 seconds to build instance.
Apr 12 15:59:48 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-878f65b4-ca24-4534-a673-60e2a3e09283 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.813s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 15:59:48 user nova-compute[71874]: DEBUG nova.network.neutron [None req-39e6eeb6-57ed-4b35-80b3-7b3a8f425cc0 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: 920c6512-180d-46e1-b0cf-240d34c3fc97] Updating instance_info_cache with network_info: [{"id": "f0f2f7c4-d9e5-4b71-88d0-1f66e8d7a81e", "address": "fa:16:3e:5f:51:3d", "network": {"id": "e71b9966-9a95-4f66-b3b1-36b05d05853c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-310205564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28d940eae5394293b87cfced45911ab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0f2f7c4-d9", "ovs_interfaceid": "f0f2f7c4-d9e5-4b71-88d0-1f66e8d7a81e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 15:59:48 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-39e6eeb6-57ed-4b35-80b3-7b3a8f425cc0 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Releasing lock "refresh_cache-920c6512-180d-46e1-b0cf-240d34c3fc97" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 15:59:48 user nova-compute[71874]: DEBUG nova.compute.manager [None req-39e6eeb6-57ed-4b35-80b3-7b3a8f425cc0 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: 920c6512-180d-46e1-b0cf-240d34c3fc97] Instance network_info: |[{"id": "f0f2f7c4-d9e5-4b71-88d0-1f66e8d7a81e", "address": "fa:16:3e:5f:51:3d", "network": {"id": "e71b9966-9a95-4f66-b3b1-36b05d05853c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-310205564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28d940eae5394293b87cfced45911ab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0f2f7c4-d9", "ovs_interfaceid": "f0f2f7c4-d9e5-4b71-88d0-1f66e8d7a81e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 15:59:48 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-39e6eeb6-57ed-4b35-80b3-7b3a8f425cc0 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: 920c6512-180d-46e1-b0cf-240d34c3fc97] Start _get_guest_xml network_info=[{"id": "f0f2f7c4-d9e5-4b71-88d0-1f66e8d7a81e", "address": "fa:16:3e:5f:51:3d", "network": {"id": "e71b9966-9a95-4f66-b3b1-36b05d05853c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-310205564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28d940eae5394293b87cfced45911ab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0f2f7c4-d9", "ovs_interfaceid": "f0f2f7c4-d9e5-4b71-88d0-1f66e8d7a81e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T15:55:37Z,direct_url=<?>,disk_format='qcow2',id=9dc63f14-8b70-4e72-89f2-13464f2f5c7c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='61a4936d9b7744c0b488d81c9b7746b6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T15:55:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_options': None, 'image_id': '9dc63f14-8b70-4e72-89f2-13464f2f5c7c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 15:59:48 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-39e6eeb6-57ed-4b35-80b3-7b3a8f425cc0 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 15:59:48 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-39e6eeb6-57ed-4b35-80b3-7b3a8f425cc0 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 15:59:48 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-39e6eeb6-57ed-4b35-80b3-7b3a8f425cc0 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71874) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 15:59:48 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-39e6eeb6-57ed-4b35-80b3-7b3a8f425cc0 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T15:56:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T15:55:37Z,direct_url=<?>,disk_format='qcow2',id=9dc63f14-8b70-4e72-89f2-13464f2f5c7c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='61a4936d9b7744c0b488d81c9b7746b6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T15:55:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 15:59:48 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-39e6eeb6-57ed-4b35-80b3-7b3a8f425cc0 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Flavor limits 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 15:59:48 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-39e6eeb6-57ed-4b35-80b3-7b3a8f425cc0 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Image limits 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 15:59:48 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-39e6eeb6-57ed-4b35-80b3-7b3a8f425cc0 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Flavor pref 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 15:59:48 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-39e6eeb6-57ed-4b35-80b3-7b3a8f425cc0 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Image pref 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 15:59:48 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-39e6eeb6-57ed-4b35-80b3-7b3a8f425cc0 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 15:59:48 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-39e6eeb6-57ed-4b35-80b3-7b3a8f425cc0 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 15:59:48 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-39e6eeb6-57ed-4b35-80b3-7b3a8f425cc0 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 15:59:48 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-39e6eeb6-57ed-4b35-80b3-7b3a8f425cc0 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Got 1 possible topologies {{(pid=71874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 15:59:48 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-39e6eeb6-57ed-4b35-80b3-7b3a8f425cc0 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 15:59:48 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-39e6eeb6-57ed-4b35-80b3-7b3a8f425cc0 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 15:59:48 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-39e6eeb6-57ed-4b35-80b3-7b3a8f425cc0 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T15:59:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-564264734',display_name='tempest-AttachVolumeNegativeTest-server-564264734',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-564264734',id=6,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKL8mRKoQBwSpXabs7lbNBcQQ+v0lDGL36wi/OpmOmwBfUVFldN2KTVLXYYnjIUA6HtcnsAqIEqMv/Fg1gZorrfhXrwT58AUeYmBczJa1dUqudRokgSOxtQEOgjrUHlOaQ==',key_name='tempest-keypair-774364981',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='28d940eae5394293b87cfced45911ab4',ramdisk_id='',reservation_id='r-06mtljg2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-288610953',owner_user_name='tempest-AttachVolumeNegativeTest-288610953-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T15:59:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5a514f6d877a4ab0bec597fee13ce9db',uuid=920c6512-180d-46e1-b0cf-240d34c3fc97,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f0f2f7c4-d9e5-4b71-88d0-1f66e8d7a81e", "address": "fa:16:3e:5f:51:3d", "network": {"id": "e71b9966-9a95-4f66-b3b1-36b05d05853c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-310205564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28d940eae5394293b87cfced45911ab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0f2f7c4-d9", "ovs_interfaceid": "f0f2f7c4-d9e5-4b71-88d0-1f66e8d7a81e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 15:59:48 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-39e6eeb6-57ed-4b35-80b3-7b3a8f425cc0 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Converting VIF {"id": "f0f2f7c4-d9e5-4b71-88d0-1f66e8d7a81e", "address": "fa:16:3e:5f:51:3d", "network": {"id": "e71b9966-9a95-4f66-b3b1-36b05d05853c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-310205564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28d940eae5394293b87cfced45911ab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0f2f7c4-d9", "ovs_interfaceid": "f0f2f7c4-d9e5-4b71-88d0-1f66e8d7a81e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 15:59:48 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-39e6eeb6-57ed-4b35-80b3-7b3a8f425cc0 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:51:3d,bridge_name='br-int',has_traffic_filtering=True,id=f0f2f7c4-d9e5-4b71-88d0-1f66e8d7a81e,network=Network(e71b9966-9a95-4f66-b3b1-36b05d05853c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0f2f7c4-d9') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 15:59:48 user nova-compute[71874]: DEBUG nova.objects.instance [None req-39e6eeb6-57ed-4b35-80b3-7b3a8f425cc0 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lazy-loading 'pci_devices' on Instance uuid 920c6512-180d-46e1-b0cf-240d34c3fc97 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 15:59:48 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-39e6eeb6-57ed-4b35-80b3-7b3a8f425cc0 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: 920c6512-180d-46e1-b0cf-240d34c3fc97] End _get_guest_xml xml=<domain type="kvm">
Apr 12 15:59:48 user nova-compute[71874]:   <uuid>920c6512-180d-46e1-b0cf-240d34c3fc97</uuid>
Apr 12 15:59:48 user nova-compute[71874]:   <name>instance-00000006</name>
Apr 12 15:59:48 user nova-compute[71874]:   <memory>131072</memory>
Apr 12 15:59:48 user nova-compute[71874]:   <vcpu>1</vcpu>
Apr 12 15:59:48 user nova-compute[71874]:   <metadata>
Apr 12 15:59:48 user nova-compute[71874]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 15:59:48 user nova-compute[71874]:       <nova:package version="0.0.0"/>
Apr 12 15:59:48 user nova-compute[71874]:       <nova:name>tempest-AttachVolumeNegativeTest-server-564264734</nova:name>
Apr 12 15:59:48 user nova-compute[71874]:       <nova:creationTime>2023-04-12 15:59:48</nova:creationTime>
Apr 12 15:59:48 user nova-compute[71874]:       <nova:flavor name="m1.nano">
Apr 12 15:59:48 user nova-compute[71874]:         <nova:memory>128</nova:memory>
Apr 12 15:59:48 user nova-compute[71874]:         <nova:disk>1</nova:disk>
Apr 12 15:59:48 user nova-compute[71874]:         <nova:swap>0</nova:swap>
Apr 12 15:59:48 user nova-compute[71874]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 15:59:48 user nova-compute[71874]:         <nova:vcpus>1</nova:vcpus>
Apr 12 15:59:48 user nova-compute[71874]:       </nova:flavor>
Apr 12 15:59:48 user nova-compute[71874]:       <nova:owner>
Apr 12 15:59:48 user nova-compute[71874]:         <nova:user uuid="5a514f6d877a4ab0bec597fee13ce9db">tempest-AttachVolumeNegativeTest-288610953-project-member</nova:user>
Apr 12 15:59:48 user nova-compute[71874]:         <nova:project uuid="28d940eae5394293b87cfced45911ab4">tempest-AttachVolumeNegativeTest-288610953</nova:project>
Apr 12 15:59:48 user nova-compute[71874]:       </nova:owner>
Apr 12 15:59:48 user nova-compute[71874]:       <nova:root type="image" uuid="9dc63f14-8b70-4e72-89f2-13464f2f5c7c"/>
Apr 12 15:59:48 user nova-compute[71874]:       <nova:ports>
Apr 12 15:59:48 user nova-compute[71874]:         <nova:port uuid="f0f2f7c4-d9e5-4b71-88d0-1f66e8d7a81e">
Apr 12 15:59:48 user nova-compute[71874]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 12 15:59:48 user nova-compute[71874]:         </nova:port>
Apr 12 15:59:48 user nova-compute[71874]:       </nova:ports>
Apr 12 15:59:48 user nova-compute[71874]:     </nova:instance>
Apr 12 15:59:48 user nova-compute[71874]:   </metadata>
Apr 12 15:59:48 user nova-compute[71874]:   <sysinfo type="smbios">
Apr 12 15:59:48 user nova-compute[71874]:     <system>
Apr 12 15:59:48 user nova-compute[71874]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 15:59:48 user nova-compute[71874]:       <entry name="product">OpenStack Nova</entry>
Apr 12 15:59:48 user nova-compute[71874]:       <entry name="version">0.0.0</entry>
Apr 12 15:59:48 user nova-compute[71874]:       <entry name="serial">920c6512-180d-46e1-b0cf-240d34c3fc97</entry>
Apr 12 15:59:48 user nova-compute[71874]:       <entry name="uuid">920c6512-180d-46e1-b0cf-240d34c3fc97</entry>
Apr 12 15:59:48 user nova-compute[71874]:       <entry name="family">Virtual Machine</entry>
Apr 12 15:59:48 user nova-compute[71874]:     </system>
Apr 12 15:59:48 user nova-compute[71874]:   </sysinfo>
Apr 12 15:59:48 user nova-compute[71874]:   <os>
Apr 12 15:59:48 user nova-compute[71874]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 15:59:48 user nova-compute[71874]:     <boot dev="hd"/>
Apr 12 15:59:48 user nova-compute[71874]:     <smbios mode="sysinfo"/>
Apr 12 15:59:48 user nova-compute[71874]:   </os>
Apr 12 15:59:48 user nova-compute[71874]:   <features>
Apr 12 15:59:48 user nova-compute[71874]:     <acpi/>
Apr 12 15:59:48 user nova-compute[71874]:     <apic/>
Apr 12 15:59:48 user nova-compute[71874]:     <vmcoreinfo/>
Apr 12 15:59:48 user nova-compute[71874]:   </features>
Apr 12 15:59:48 user nova-compute[71874]:   <clock offset="utc">
Apr 12 15:59:48 user nova-compute[71874]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 15:59:48 user nova-compute[71874]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 15:59:48 user nova-compute[71874]:     <timer name="hpet" present="no"/>
Apr 12 15:59:48 user nova-compute[71874]:   </clock>
Apr 12 15:59:48 user nova-compute[71874]:   <cpu mode="custom" match="exact">
Apr 12 15:59:48 user nova-compute[71874]:     <model>Nehalem</model>
Apr 12 15:59:48 user nova-compute[71874]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 15:59:48 user nova-compute[71874]:   </cpu>
Apr 12 15:59:48 user nova-compute[71874]:   <devices>
Apr 12 15:59:48 user nova-compute[71874]:     <disk type="file" device="disk">
Apr 12 15:59:48 user nova-compute[71874]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 15:59:48 user nova-compute[71874]:       <source file="/opt/stack/data/nova/instances/920c6512-180d-46e1-b0cf-240d34c3fc97/disk"/>
Apr 12 15:59:48 user nova-compute[71874]:       <target dev="vda" bus="virtio"/>
Apr 12 15:59:48 user nova-compute[71874]:     </disk>
Apr 12 15:59:48 user nova-compute[71874]:     <interface type="ethernet">
Apr 12 15:59:48 user nova-compute[71874]:       <mac address="fa:16:3e:5f:51:3d"/>
Apr 12 15:59:48 user nova-compute[71874]:       <model type="virtio"/>
Apr 12 15:59:48 user nova-compute[71874]:       <mtu size="1442"/>
Apr 12 15:59:48 user nova-compute[71874]:       <target dev="tapf0f2f7c4-d9"/>
Apr 12 15:59:48 user nova-compute[71874]:     </interface>
Apr 12 15:59:48 user nova-compute[71874]:     <serial type="pty">
Apr 12 15:59:48 user nova-compute[71874]:       <log file="/opt/stack/data/nova/instances/920c6512-180d-46e1-b0cf-240d34c3fc97/console.log" append="off"/>
Apr 12 15:59:48 user nova-compute[71874]:     </serial>
Apr 12 15:59:48 user nova-compute[71874]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 15:59:48 user nova-compute[71874]:     <video>
Apr 12 15:59:48 user nova-compute[71874]:       <model type="virtio"/>
Apr 12 15:59:48 user nova-compute[71874]:     </video>
Apr 12 15:59:48 user nova-compute[71874]:     <rng model="virtio">
Apr 12 15:59:48 user nova-compute[71874]:       <backend model="random">/dev/urandom</backend>
Apr 12 15:59:48 user nova-compute[71874]:     </rng>
Apr 12 15:59:48 user nova-compute[71874]:     <controller type="usb" index="0" model="none"/>
Apr 12 15:59:48 user nova-compute[71874]:     <memballoon model="virtio">
Apr 12 15:59:48 user nova-compute[71874]:       <stats period="10"/>
Apr 12 15:59:48 user nova-compute[71874]:     </memballoon>
Apr 12 15:59:48 user nova-compute[71874]:   </devices>
Apr 12 15:59:48 user nova-compute[71874]: </domain>
Apr 12 15:59:48 user nova-compute[71874]:  {{(pid=71874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 15:59:48 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-39e6eeb6-57ed-4b35-80b3-7b3a8f425cc0 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T15:59:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-564264734',display_name='tempest-AttachVolumeNegativeTest-server-564264734',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-564264734',id=6,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKL8mRKoQBwSpXabs7lbNBcQQ+v0lDGL36wi/OpmOmwBfUVFldN2KTVLXYYnjIUA6HtcnsAqIEqMv/Fg1gZorrfhXrwT58AUeYmBczJa1dUqudRokgSOxtQEOgjrUHlOaQ==',key_name='tempest-keypair-774364981',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='28d940eae5394293b87cfced45911ab4',ramdisk_id='',reservation_id='r-06mtljg2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-288610953',owner_user_name='tempest-AttachVolumeNegativeTest-288610953-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T15:59:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5a514f6d877a4ab0bec597fee13ce9db',uuid=920c6512-180d-46e1-b0cf-240d34c3fc97,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f0f2f7c4-d9e5-4b71-88d0-1f66e8d7a81e", "address": "fa:16:3e:5f:51:3d", "network": {"id": "e71b9966-9a95-4f66-b3b1-36b05d05853c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-310205564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28d940eae5394293b87cfced45911ab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0f2f7c4-d9", "ovs_interfaceid": "f0f2f7c4-d9e5-4b71-88d0-1f66e8d7a81e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 15:59:48 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-39e6eeb6-57ed-4b35-80b3-7b3a8f425cc0 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Converting VIF {"id": "f0f2f7c4-d9e5-4b71-88d0-1f66e8d7a81e", "address": "fa:16:3e:5f:51:3d", "network": {"id": "e71b9966-9a95-4f66-b3b1-36b05d05853c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-310205564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28d940eae5394293b87cfced45911ab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0f2f7c4-d9", "ovs_interfaceid": "f0f2f7c4-d9e5-4b71-88d0-1f66e8d7a81e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 15:59:48 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-39e6eeb6-57ed-4b35-80b3-7b3a8f425cc0 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:51:3d,bridge_name='br-int',has_traffic_filtering=True,id=f0f2f7c4-d9e5-4b71-88d0-1f66e8d7a81e,network=Network(e71b9966-9a95-4f66-b3b1-36b05d05853c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0f2f7c4-d9') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 15:59:48 user nova-compute[71874]: DEBUG os_vif [None req-39e6eeb6-57ed-4b35-80b3-7b3a8f425cc0 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:51:3d,bridge_name='br-int',has_traffic_filtering=True,id=f0f2f7c4-d9e5-4b71-88d0-1f66e8d7a81e,network=Network(e71b9966-9a95-4f66-b3b1-36b05d05853c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0f2f7c4-d9') {{(pid=71874) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 15:59:48 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 15:59:48 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 15:59:48 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 15:59:48 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 15:59:48 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf0f2f7c4-d9, may_exist=True) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 15:59:48 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf0f2f7c4-d9, col_values=(('external_ids', {'iface-id': 'f0f2f7c4-d9e5-4b71-88d0-1f66e8d7a81e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5f:51:3d', 'vm-uuid': '920c6512-180d-46e1-b0cf-240d34c3fc97'}),)) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 15:59:48 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 15:59:48 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 15:59:48 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 15:59:48 user nova-compute[71874]: INFO os_vif [None req-39e6eeb6-57ed-4b35-80b3-7b3a8f425cc0 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:51:3d,bridge_name='br-int',has_traffic_filtering=True,id=f0f2f7c4-d9e5-4b71-88d0-1f66e8d7a81e,network=Network(e71b9966-9a95-4f66-b3b1-36b05d05853c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0f2f7c4-d9')
Apr 12 15:59:48 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-39e6eeb6-57ed-4b35-80b3-7b3a8f425cc0 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] No BDM found with device name vda, not building metadata. {{(pid=71874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 15:59:48 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-39e6eeb6-57ed-4b35-80b3-7b3a8f425cc0 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] No VIF found with MAC fa:16:3e:5f:51:3d, not building metadata {{(pid=71874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 15:59:49 user nova-compute[71874]: DEBUG nova.compute.manager [req-4681d3bb-a5d4-45f2-86fb-a105dda38f38 req-a13bd578-864e-4db8-aa53-14fb81fc24ef service nova] [instance: 920c6512-180d-46e1-b0cf-240d34c3fc97] Received event network-changed-f0f2f7c4-d9e5-4b71-88d0-1f66e8d7a81e {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 15:59:49 user nova-compute[71874]: DEBUG nova.compute.manager [req-4681d3bb-a5d4-45f2-86fb-a105dda38f38 req-a13bd578-864e-4db8-aa53-14fb81fc24ef service nova] [instance: 920c6512-180d-46e1-b0cf-240d34c3fc97] Refreshing instance network info cache due to event network-changed-f0f2f7c4-d9e5-4b71-88d0-1f66e8d7a81e. {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 15:59:49 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-4681d3bb-a5d4-45f2-86fb-a105dda38f38 req-a13bd578-864e-4db8-aa53-14fb81fc24ef service nova] Acquiring lock "refresh_cache-920c6512-180d-46e1-b0cf-240d34c3fc97" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 15:59:49 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-4681d3bb-a5d4-45f2-86fb-a105dda38f38 req-a13bd578-864e-4db8-aa53-14fb81fc24ef service nova] Acquired lock "refresh_cache-920c6512-180d-46e1-b0cf-240d34c3fc97" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 15:59:49 user nova-compute[71874]: DEBUG nova.network.neutron [req-4681d3bb-a5d4-45f2-86fb-a105dda38f38 req-a13bd578-864e-4db8-aa53-14fb81fc24ef service nova] [instance: 920c6512-180d-46e1-b0cf-240d34c3fc97] Refreshing network info cache for port f0f2f7c4-d9e5-4b71-88d0-1f66e8d7a81e {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 15:59:50 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 15:59:50 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 15:59:50 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 15:59:50 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 15:59:50 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 15:59:51 user nova-compute[71874]: DEBUG nova.compute.manager [req-2fecab4c-fc9d-4ed3-b682-5c8d55078a80 req-63068e34-ef54-419c-b9e4-2410efc21309 service nova] [instance: 920c6512-180d-46e1-b0cf-240d34c3fc97] Received event network-vif-plugged-f0f2f7c4-d9e5-4b71-88d0-1f66e8d7a81e {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 15:59:51 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-2fecab4c-fc9d-4ed3-b682-5c8d55078a80 req-63068e34-ef54-419c-b9e4-2410efc21309 service nova] Acquiring lock "920c6512-180d-46e1-b0cf-240d34c3fc97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 15:59:51 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-2fecab4c-fc9d-4ed3-b682-5c8d55078a80 req-63068e34-ef54-419c-b9e4-2410efc21309 service nova] Lock "920c6512-180d-46e1-b0cf-240d34c3fc97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 15:59:51 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-2fecab4c-fc9d-4ed3-b682-5c8d55078a80 req-63068e34-ef54-419c-b9e4-2410efc21309 service nova] Lock "920c6512-180d-46e1-b0cf-240d34c3fc97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 15:59:51 user nova-compute[71874]: DEBUG nova.compute.manager [req-2fecab4c-fc9d-4ed3-b682-5c8d55078a80 req-63068e34-ef54-419c-b9e4-2410efc21309 service nova] [instance: 920c6512-180d-46e1-b0cf-240d34c3fc97] No waiting events found dispatching network-vif-plugged-f0f2f7c4-d9e5-4b71-88d0-1f66e8d7a81e {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 15:59:51 user nova-compute[71874]: WARNING nova.compute.manager [req-2fecab4c-fc9d-4ed3-b682-5c8d55078a80 req-63068e34-ef54-419c-b9e4-2410efc21309 service nova] [instance: 920c6512-180d-46e1-b0cf-240d34c3fc97] Received unexpected event network-vif-plugged-f0f2f7c4-d9e5-4b71-88d0-1f66e8d7a81e for instance with vm_state building and task_state spawning.
Apr 12 15:59:51 user nova-compute[71874]: DEBUG nova.network.neutron [req-4681d3bb-a5d4-45f2-86fb-a105dda38f38 req-a13bd578-864e-4db8-aa53-14fb81fc24ef service nova] [instance: 920c6512-180d-46e1-b0cf-240d34c3fc97] Updated VIF entry in instance network info cache for port f0f2f7c4-d9e5-4b71-88d0-1f66e8d7a81e. {{(pid=71874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 15:59:51 user nova-compute[71874]: DEBUG nova.network.neutron [req-4681d3bb-a5d4-45f2-86fb-a105dda38f38 req-a13bd578-864e-4db8-aa53-14fb81fc24ef service nova] [instance: 920c6512-180d-46e1-b0cf-240d34c3fc97] Updating instance_info_cache with network_info: [{"id": "f0f2f7c4-d9e5-4b71-88d0-1f66e8d7a81e", "address": "fa:16:3e:5f:51:3d", "network": {"id": "e71b9966-9a95-4f66-b3b1-36b05d05853c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-310205564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28d940eae5394293b87cfced45911ab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0f2f7c4-d9", "ovs_interfaceid": "f0f2f7c4-d9e5-4b71-88d0-1f66e8d7a81e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 15:59:51 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-4681d3bb-a5d4-45f2-86fb-a105dda38f38 req-a13bd578-864e-4db8-aa53-14fb81fc24ef service nova] Releasing lock "refresh_cache-920c6512-180d-46e1-b0cf-240d34c3fc97" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 15:59:51 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 15:59:51 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 15:59:51 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 15:59:52 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 15:59:53 user nova-compute[71874]: DEBUG nova.compute.manager [req-0f0beb50-d61e-40af-b9cb-baa84a7d9732 req-a7fe0b78-7ca7-49fe-89e8-7e639613b67a service nova] [instance: 920c6512-180d-46e1-b0cf-240d34c3fc97] Received event network-vif-plugged-f0f2f7c4-d9e5-4b71-88d0-1f66e8d7a81e {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 15:59:53 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-0f0beb50-d61e-40af-b9cb-baa84a7d9732 req-a7fe0b78-7ca7-49fe-89e8-7e639613b67a service nova] Acquiring lock "920c6512-180d-46e1-b0cf-240d34c3fc97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 15:59:53 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-0f0beb50-d61e-40af-b9cb-baa84a7d9732 req-a7fe0b78-7ca7-49fe-89e8-7e639613b67a service nova] Lock "920c6512-180d-46e1-b0cf-240d34c3fc97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 15:59:53 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-0f0beb50-d61e-40af-b9cb-baa84a7d9732 req-a7fe0b78-7ca7-49fe-89e8-7e639613b67a service nova] Lock "920c6512-180d-46e1-b0cf-240d34c3fc97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 15:59:53 user nova-compute[71874]: DEBUG nova.compute.manager [req-0f0beb50-d61e-40af-b9cb-baa84a7d9732 req-a7fe0b78-7ca7-49fe-89e8-7e639613b67a service nova] [instance: 920c6512-180d-46e1-b0cf-240d34c3fc97] No waiting events found dispatching network-vif-plugged-f0f2f7c4-d9e5-4b71-88d0-1f66e8d7a81e {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 15:59:53 user nova-compute[71874]: WARNING nova.compute.manager [req-0f0beb50-d61e-40af-b9cb-baa84a7d9732 req-a7fe0b78-7ca7-49fe-89e8-7e639613b67a service nova] [instance: 920c6512-180d-46e1-b0cf-240d34c3fc97] Received unexpected event network-vif-plugged-f0f2f7c4-d9e5-4b71-88d0-1f66e8d7a81e for instance with vm_state building and task_state spawning.
Apr 12 15:59:53 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 15:59:53 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 15:59:53 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 15:59:53 user nova-compute[71874]: DEBUG nova.virt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Emitting event <LifecycleEvent: 1681315193.9252508, 920c6512-180d-46e1-b0cf-240d34c3fc97 => Resumed> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 15:59:53 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 920c6512-180d-46e1-b0cf-240d34c3fc97] VM Resumed (Lifecycle Event)
Apr 12 15:59:53 user nova-compute[71874]: DEBUG nova.compute.manager [None req-39e6eeb6-57ed-4b35-80b3-7b3a8f425cc0 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: 920c6512-180d-46e1-b0cf-240d34c3fc97] Instance event wait completed in 0 seconds for  {{(pid=71874) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 15:59:53 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-39e6eeb6-57ed-4b35-80b3-7b3a8f425cc0 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: 920c6512-180d-46e1-b0cf-240d34c3fc97] Guest created on hypervisor {{(pid=71874) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 15:59:53 user nova-compute[71874]: INFO nova.virt.libvirt.driver [-] [instance: 920c6512-180d-46e1-b0cf-240d34c3fc97] Instance spawned successfully.
Apr 12 15:59:53 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-39e6eeb6-57ed-4b35-80b3-7b3a8f425cc0 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: 920c6512-180d-46e1-b0cf-240d34c3fc97] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 15:59:53 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 920c6512-180d-46e1-b0cf-240d34c3fc97] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 15:59:54 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-39e6eeb6-57ed-4b35-80b3-7b3a8f425cc0 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: 920c6512-180d-46e1-b0cf-240d34c3fc97] Found default for hw_cdrom_bus of ide {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 15:59:54 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-39e6eeb6-57ed-4b35-80b3-7b3a8f425cc0 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: 920c6512-180d-46e1-b0cf-240d34c3fc97] Found default for hw_disk_bus of virtio {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 15:59:54 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-39e6eeb6-57ed-4b35-80b3-7b3a8f425cc0 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: 920c6512-180d-46e1-b0cf-240d34c3fc97] Found default for hw_input_bus of None {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 15:59:54 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-39e6eeb6-57ed-4b35-80b3-7b3a8f425cc0 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: 920c6512-180d-46e1-b0cf-240d34c3fc97] Found default for hw_pointer_model of None {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 15:59:54 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-39e6eeb6-57ed-4b35-80b3-7b3a8f425cc0 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: 920c6512-180d-46e1-b0cf-240d34c3fc97] Found default for hw_video_model of virtio {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 15:59:54 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-39e6eeb6-57ed-4b35-80b3-7b3a8f425cc0 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: 920c6512-180d-46e1-b0cf-240d34c3fc97] Found default for hw_vif_model of virtio {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 15:59:54 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-b4d6b129-8c2f-474e-9540-10960542114b tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Acquiring lock "55aff314-eb5e-4752-af9f-a4021e970cac" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 15:59:54 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-b4d6b129-8c2f-474e-9540-10960542114b tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Lock "55aff314-eb5e-4752-af9f-a4021e970cac" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 15:59:54 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 920c6512-180d-46e1-b0cf-240d34c3fc97] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 15:59:54 user nova-compute[71874]: DEBUG nova.compute.manager [None req-b4d6b129-8c2f-474e-9540-10960542114b tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] [instance: 55aff314-eb5e-4752-af9f-a4021e970cac] Starting instance... {{(pid=71874) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 15:59:54 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 920c6512-180d-46e1-b0cf-240d34c3fc97] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 15:59:54 user nova-compute[71874]: DEBUG nova.virt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Emitting event <LifecycleEvent: 1681315193.9275048, 920c6512-180d-46e1-b0cf-240d34c3fc97 => Started> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 15:59:54 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 920c6512-180d-46e1-b0cf-240d34c3fc97] VM Started (Lifecycle Event)
Apr 12 15:59:54 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 920c6512-180d-46e1-b0cf-240d34c3fc97] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 15:59:54 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 920c6512-180d-46e1-b0cf-240d34c3fc97] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 15:59:54 user nova-compute[71874]: INFO nova.compute.manager [None req-39e6eeb6-57ed-4b35-80b3-7b3a8f425cc0 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: 920c6512-180d-46e1-b0cf-240d34c3fc97] Took 13.31 seconds to spawn the instance on the hypervisor.
Apr 12 15:59:54 user nova-compute[71874]: DEBUG nova.compute.manager [None req-39e6eeb6-57ed-4b35-80b3-7b3a8f425cc0 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: 920c6512-180d-46e1-b0cf-240d34c3fc97] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 15:59:54 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 920c6512-180d-46e1-b0cf-240d34c3fc97] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 15:59:54 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-b4d6b129-8c2f-474e-9540-10960542114b tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 15:59:54 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-b4d6b129-8c2f-474e-9540-10960542114b tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 15:59:54 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-b4d6b129-8c2f-474e-9540-10960542114b tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71874) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 15:59:54 user nova-compute[71874]: INFO nova.compute.claims [None req-b4d6b129-8c2f-474e-9540-10960542114b tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] [instance: 55aff314-eb5e-4752-af9f-a4021e970cac] Claim successful on node user
Apr 12 15:59:54 user nova-compute[71874]: INFO nova.compute.manager [None req-39e6eeb6-57ed-4b35-80b3-7b3a8f425cc0 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: 920c6512-180d-46e1-b0cf-240d34c3fc97] Took 14.86 seconds to build instance.
Apr 12 15:59:54 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-39e6eeb6-57ed-4b35-80b3-7b3a8f425cc0 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "920c6512-180d-46e1-b0cf-240d34c3fc97" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.039s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 15:59:54 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-b4d6b129-8c2f-474e-9540-10960542114b tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Inventory has not changed in ProviderTree for provider: 0e94b4c8-cd49-45e4-9133-d36eb4b2456b {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 15:59:54 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-b4d6b129-8c2f-474e-9540-10960542114b tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Inventory has not changed for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 15:59:55 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-b4d6b129-8c2f-474e-9540-10960542114b tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.698s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 15:59:55 user nova-compute[71874]: DEBUG nova.compute.manager [None req-b4d6b129-8c2f-474e-9540-10960542114b tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] [instance: 55aff314-eb5e-4752-af9f-a4021e970cac] Start building networks asynchronously for instance. {{(pid=71874) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 15:59:55 user nova-compute[71874]: DEBUG nova.compute.manager [None req-b4d6b129-8c2f-474e-9540-10960542114b tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] [instance: 55aff314-eb5e-4752-af9f-a4021e970cac] Allocating IP information in the background. {{(pid=71874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 15:59:55 user nova-compute[71874]: DEBUG nova.network.neutron [None req-b4d6b129-8c2f-474e-9540-10960542114b tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] [instance: 55aff314-eb5e-4752-af9f-a4021e970cac] allocate_for_instance() {{(pid=71874) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 15:59:55 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-b4d6b129-8c2f-474e-9540-10960542114b tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] [instance: 55aff314-eb5e-4752-af9f-a4021e970cac] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 15:59:55 user nova-compute[71874]: DEBUG nova.compute.manager [None req-b4d6b129-8c2f-474e-9540-10960542114b tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] [instance: 55aff314-eb5e-4752-af9f-a4021e970cac] Start building block device mappings for instance. {{(pid=71874) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 15:59:55 user nova-compute[71874]: DEBUG nova.compute.manager [None req-b4d6b129-8c2f-474e-9540-10960542114b tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] [instance: 55aff314-eb5e-4752-af9f-a4021e970cac] Start spawning the instance on the hypervisor. {{(pid=71874) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 15:59:55 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-b4d6b129-8c2f-474e-9540-10960542114b tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] [instance: 55aff314-eb5e-4752-af9f-a4021e970cac] Creating instance directory {{(pid=71874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 15:59:55 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-b4d6b129-8c2f-474e-9540-10960542114b tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] [instance: 55aff314-eb5e-4752-af9f-a4021e970cac] Creating image(s)
Apr 12 15:59:55 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-b4d6b129-8c2f-474e-9540-10960542114b tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Acquiring lock "/opt/stack/data/nova/instances/55aff314-eb5e-4752-af9f-a4021e970cac/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 15:59:55 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-b4d6b129-8c2f-474e-9540-10960542114b tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Lock "/opt/stack/data/nova/instances/55aff314-eb5e-4752-af9f-a4021e970cac/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 15:59:55 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-b4d6b129-8c2f-474e-9540-10960542114b tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Lock "/opt/stack/data/nova/instances/55aff314-eb5e-4752-af9f-a4021e970cac/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 15:59:55 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-b4d6b129-8c2f-474e-9540-10960542114b tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 15:59:55 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-b4d6b129-8c2f-474e-9540-10960542114b tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json" returned: 0 in 0.280s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 15:59:55 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-b4d6b129-8c2f-474e-9540-10960542114b tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Acquiring lock "b88df1b37cb431f52bc53b5616015c89b5bec411" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 15:59:55 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-b4d6b129-8c2f-474e-9540-10960542114b tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Lock "b88df1b37cb431f52bc53b5616015c89b5bec411" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 15:59:55 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-b4d6b129-8c2f-474e-9540-10960542114b tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 15:59:56 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-b4d6b129-8c2f-474e-9540-10960542114b tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json" returned: 0 in 0.235s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 15:59:56 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-b4d6b129-8c2f-474e-9540-10960542114b tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411,backing_fmt=raw /opt/stack/data/nova/instances/55aff314-eb5e-4752-af9f-a4021e970cac/disk 1073741824 {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 15:59:56 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-b4d6b129-8c2f-474e-9540-10960542114b tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411,backing_fmt=raw /opt/stack/data/nova/instances/55aff314-eb5e-4752-af9f-a4021e970cac/disk 1073741824" returned: 0 in 0.141s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 15:59:56 user nova-compute[71874]: DEBUG nova.policy [None req-b4d6b129-8c2f-474e-9540-10960542114b tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '324eb9033e62405ca2b322bcb6da9a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8197a98d7ebc4230899aca82b073ab15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71874) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 15:59:56 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-b4d6b129-8c2f-474e-9540-10960542114b tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Lock "b88df1b37cb431f52bc53b5616015c89b5bec411" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.398s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 15:59:56 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-b4d6b129-8c2f-474e-9540-10960542114b tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 15:59:56 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-b4d6b129-8c2f-474e-9540-10960542114b tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json" returned: 0 in 0.167s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 15:59:56 user nova-compute[71874]: DEBUG nova.virt.disk.api [None req-b4d6b129-8c2f-474e-9540-10960542114b tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Checking if we can resize image /opt/stack/data/nova/instances/55aff314-eb5e-4752-af9f-a4021e970cac/disk. size=1073741824 {{(pid=71874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 15:59:56 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-b4d6b129-8c2f-474e-9540-10960542114b tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55aff314-eb5e-4752-af9f-a4021e970cac/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 15:59:56 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-b4d6b129-8c2f-474e-9540-10960542114b tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55aff314-eb5e-4752-af9f-a4021e970cac/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 15:59:56 user nova-compute[71874]: DEBUG nova.virt.disk.api [None req-b4d6b129-8c2f-474e-9540-10960542114b tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Cannot resize image /opt/stack/data/nova/instances/55aff314-eb5e-4752-af9f-a4021e970cac/disk to a smaller size. {{(pid=71874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 15:59:56 user nova-compute[71874]: DEBUG nova.objects.instance [None req-b4d6b129-8c2f-474e-9540-10960542114b tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Lazy-loading 'migration_context' on Instance uuid 55aff314-eb5e-4752-af9f-a4021e970cac {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 15:59:56 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-b4d6b129-8c2f-474e-9540-10960542114b tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] [instance: 55aff314-eb5e-4752-af9f-a4021e970cac] Created local disks {{(pid=71874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 15:59:56 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-b4d6b129-8c2f-474e-9540-10960542114b tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] [instance: 55aff314-eb5e-4752-af9f-a4021e970cac] Ensure instance console log exists: /opt/stack/data/nova/instances/55aff314-eb5e-4752-af9f-a4021e970cac/console.log {{(pid=71874) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 15:59:56 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-b4d6b129-8c2f-474e-9540-10960542114b tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 15:59:56 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-b4d6b129-8c2f-474e-9540-10960542114b tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.003s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 15:59:56 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-b4d6b129-8c2f-474e-9540-10960542114b tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 15:59:57 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 15:59:58 user nova-compute[71874]: DEBUG nova.network.neutron [None req-b4d6b129-8c2f-474e-9540-10960542114b tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] [instance: 55aff314-eb5e-4752-af9f-a4021e970cac] Successfully created port: 4a51084d-9fff-4a53-9387-4542bfd6a4a7 {{(pid=71874) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 15:59:58 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 15:59:59 user nova-compute[71874]: DEBUG nova.network.neutron [None req-b4d6b129-8c2f-474e-9540-10960542114b tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] [instance: 55aff314-eb5e-4752-af9f-a4021e970cac] Successfully updated port: 4a51084d-9fff-4a53-9387-4542bfd6a4a7 {{(pid=71874) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 15:59:59 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-b4d6b129-8c2f-474e-9540-10960542114b tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Acquiring lock "refresh_cache-55aff314-eb5e-4752-af9f-a4021e970cac" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 15:59:59 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-b4d6b129-8c2f-474e-9540-10960542114b tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Acquired lock "refresh_cache-55aff314-eb5e-4752-af9f-a4021e970cac" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 15:59:59 user nova-compute[71874]: DEBUG nova.network.neutron [None req-b4d6b129-8c2f-474e-9540-10960542114b tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] [instance: 55aff314-eb5e-4752-af9f-a4021e970cac] Building network info cache for instance {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 15:59:59 user nova-compute[71874]: DEBUG nova.compute.manager [req-5bbabf36-a832-4441-80d7-a51fd75bd177 req-c8184506-58c7-4194-acef-3e5d8be7eb17 service nova] [instance: 55aff314-eb5e-4752-af9f-a4021e970cac] Received event network-changed-4a51084d-9fff-4a53-9387-4542bfd6a4a7 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 15:59:59 user nova-compute[71874]: DEBUG nova.compute.manager [req-5bbabf36-a832-4441-80d7-a51fd75bd177 req-c8184506-58c7-4194-acef-3e5d8be7eb17 service nova] [instance: 55aff314-eb5e-4752-af9f-a4021e970cac] Refreshing instance network info cache due to event network-changed-4a51084d-9fff-4a53-9387-4542bfd6a4a7. {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 15:59:59 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-5bbabf36-a832-4441-80d7-a51fd75bd177 req-c8184506-58c7-4194-acef-3e5d8be7eb17 service nova] Acquiring lock "refresh_cache-55aff314-eb5e-4752-af9f-a4021e970cac" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 15:59:59 user nova-compute[71874]: DEBUG nova.network.neutron [None req-b4d6b129-8c2f-474e-9540-10960542114b tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] [instance: 55aff314-eb5e-4752-af9f-a4021e970cac] Instance cache missing network info. {{(pid=71874) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 16:00:00 user nova-compute[71874]: DEBUG nova.network.neutron [None req-b4d6b129-8c2f-474e-9540-10960542114b tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] [instance: 55aff314-eb5e-4752-af9f-a4021e970cac] Updating instance_info_cache with network_info: [{"id": "4a51084d-9fff-4a53-9387-4542bfd6a4a7", "address": "fa:16:3e:5a:aa:4d", "network": {"id": "95c64a1b-8b44-403f-8c4c-32730720d7a7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-87023330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8197a98d7ebc4230899aca82b073ab15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a51084d-9f", "ovs_interfaceid": "4a51084d-9fff-4a53-9387-4542bfd6a4a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:00:00 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-b4d6b129-8c2f-474e-9540-10960542114b tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Releasing lock "refresh_cache-55aff314-eb5e-4752-af9f-a4021e970cac" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:00:00 user nova-compute[71874]: DEBUG nova.compute.manager [None req-b4d6b129-8c2f-474e-9540-10960542114b tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] [instance: 55aff314-eb5e-4752-af9f-a4021e970cac] Instance network_info: |[{"id": "4a51084d-9fff-4a53-9387-4542bfd6a4a7", "address": "fa:16:3e:5a:aa:4d", "network": {"id": "95c64a1b-8b44-403f-8c4c-32730720d7a7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-87023330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8197a98d7ebc4230899aca82b073ab15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a51084d-9f", "ovs_interfaceid": "4a51084d-9fff-4a53-9387-4542bfd6a4a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 16:00:00 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-5bbabf36-a832-4441-80d7-a51fd75bd177 req-c8184506-58c7-4194-acef-3e5d8be7eb17 service nova] Acquired lock "refresh_cache-55aff314-eb5e-4752-af9f-a4021e970cac" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:00:00 user nova-compute[71874]: DEBUG nova.network.neutron [req-5bbabf36-a832-4441-80d7-a51fd75bd177 req-c8184506-58c7-4194-acef-3e5d8be7eb17 service nova] [instance: 55aff314-eb5e-4752-af9f-a4021e970cac] Refreshing network info cache for port 4a51084d-9fff-4a53-9387-4542bfd6a4a7 {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 16:00:00 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-b4d6b129-8c2f-474e-9540-10960542114b tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] [instance: 55aff314-eb5e-4752-af9f-a4021e970cac] Start _get_guest_xml network_info=[{"id": "4a51084d-9fff-4a53-9387-4542bfd6a4a7", "address": "fa:16:3e:5a:aa:4d", "network": {"id": "95c64a1b-8b44-403f-8c4c-32730720d7a7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-87023330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8197a98d7ebc4230899aca82b073ab15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a51084d-9f", "ovs_interfaceid": "4a51084d-9fff-4a53-9387-4542bfd6a4a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T15:55:37Z,direct_url=<?>,disk_format='qcow2',id=9dc63f14-8b70-4e72-89f2-13464f2f5c7c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='61a4936d9b7744c0b488d81c9b7746b6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T15:55:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_options': None, 'image_id': '9dc63f14-8b70-4e72-89f2-13464f2f5c7c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 16:00:00 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-b4d6b129-8c2f-474e-9540-10960542114b tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:00:00 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-b4d6b129-8c2f-474e-9540-10960542114b tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:00:00 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-b4d6b129-8c2f-474e-9540-10960542114b tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71874) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 16:00:00 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-b4d6b129-8c2f-474e-9540-10960542114b tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T15:56:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T15:55:37Z,direct_url=<?>,disk_format='qcow2',id=9dc63f14-8b70-4e72-89f2-13464f2f5c7c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='61a4936d9b7744c0b488d81c9b7746b6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T15:55:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 16:00:00 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-b4d6b129-8c2f-474e-9540-10960542114b tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Flavor limits 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 16:00:00 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-b4d6b129-8c2f-474e-9540-10960542114b tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Image limits 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 16:00:00 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-b4d6b129-8c2f-474e-9540-10960542114b tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Flavor pref 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 16:00:00 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-b4d6b129-8c2f-474e-9540-10960542114b tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Image pref 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 16:00:00 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-b4d6b129-8c2f-474e-9540-10960542114b tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 16:00:00 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-b4d6b129-8c2f-474e-9540-10960542114b tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 16:00:00 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-b4d6b129-8c2f-474e-9540-10960542114b tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 16:00:00 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-b4d6b129-8c2f-474e-9540-10960542114b tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Got 1 possible topologies {{(pid=71874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 16:00:00 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-b4d6b129-8c2f-474e-9540-10960542114b tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 16:00:00 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-b4d6b129-8c2f-474e-9540-10960542114b tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 16:00:00 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-b4d6b129-8c2f-474e-9540-10960542114b tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T15:59:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1331285489',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1331285489',id=7,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEJbHdIj6Qnsbz5sPRJ4ye2dl2IsI8e0vfQ09uKxN501bN+DgkHVMylQpwrl7ZvLZ8swmrO3BjtPpMg/5nOMgbnum5uHS/qZKbdglyI6E6LnkEx0Cctk5Q87Mk68+Dgi4A==',key_name='tempest-keypair-2057580771',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8197a98d7ebc4230899aca82b073ab15',ramdisk_id='',reservation_id='r-ncvxejnb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-475014275',owner_user_name='tempest-TaggedAttachmentsTest-475014275-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T15:59:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='324eb9033e62405ca2b322bcb6da9a04',uuid=55aff314-eb5e-4752-af9f-a4021e970cac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4a51084d-9fff-4a53-9387-4542bfd6a4a7", "address": "fa:16:3e:5a:aa:4d", "network": {"id": "95c64a1b-8b44-403f-8c4c-32730720d7a7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-87023330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8197a98d7ebc4230899aca82b073ab15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a51084d-9f", "ovs_interfaceid": "4a51084d-9fff-4a53-9387-4542bfd6a4a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 16:00:00 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-b4d6b129-8c2f-474e-9540-10960542114b tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Converting VIF {"id": "4a51084d-9fff-4a53-9387-4542bfd6a4a7", "address": "fa:16:3e:5a:aa:4d", "network": {"id": "95c64a1b-8b44-403f-8c4c-32730720d7a7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-87023330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8197a98d7ebc4230899aca82b073ab15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a51084d-9f", "ovs_interfaceid": "4a51084d-9fff-4a53-9387-4542bfd6a4a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:00:00 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-b4d6b129-8c2f-474e-9540-10960542114b tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:aa:4d,bridge_name='br-int',has_traffic_filtering=True,id=4a51084d-9fff-4a53-9387-4542bfd6a4a7,network=Network(95c64a1b-8b44-403f-8c4c-32730720d7a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a51084d-9f') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:00:00 user nova-compute[71874]: DEBUG nova.objects.instance [None req-b4d6b129-8c2f-474e-9540-10960542114b tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Lazy-loading 'pci_devices' on Instance uuid 55aff314-eb5e-4752-af9f-a4021e970cac {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:00:00 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-b4d6b129-8c2f-474e-9540-10960542114b tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] [instance: 55aff314-eb5e-4752-af9f-a4021e970cac] End _get_guest_xml xml=<domain type="kvm">
Apr 12 16:00:00 user nova-compute[71874]:   <uuid>55aff314-eb5e-4752-af9f-a4021e970cac</uuid>
Apr 12 16:00:00 user nova-compute[71874]:   <name>instance-00000007</name>
Apr 12 16:00:00 user nova-compute[71874]:   <memory>131072</memory>
Apr 12 16:00:00 user nova-compute[71874]:   <vcpu>1</vcpu>
Apr 12 16:00:00 user nova-compute[71874]:   <metadata>
Apr 12 16:00:00 user nova-compute[71874]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 16:00:00 user nova-compute[71874]:       <nova:package version="0.0.0"/>
Apr 12 16:00:00 user nova-compute[71874]:       <nova:name>tempest-device-tagging-server-1331285489</nova:name>
Apr 12 16:00:00 user nova-compute[71874]:       <nova:creationTime>2023-04-12 16:00:00</nova:creationTime>
Apr 12 16:00:00 user nova-compute[71874]:       <nova:flavor name="m1.nano">
Apr 12 16:00:00 user nova-compute[71874]:         <nova:memory>128</nova:memory>
Apr 12 16:00:00 user nova-compute[71874]:         <nova:disk>1</nova:disk>
Apr 12 16:00:00 user nova-compute[71874]:         <nova:swap>0</nova:swap>
Apr 12 16:00:00 user nova-compute[71874]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 16:00:00 user nova-compute[71874]:         <nova:vcpus>1</nova:vcpus>
Apr 12 16:00:00 user nova-compute[71874]:       </nova:flavor>
Apr 12 16:00:00 user nova-compute[71874]:       <nova:owner>
Apr 12 16:00:00 user nova-compute[71874]:         <nova:user uuid="324eb9033e62405ca2b322bcb6da9a04">tempest-TaggedAttachmentsTest-475014275-project-member</nova:user>
Apr 12 16:00:00 user nova-compute[71874]:         <nova:project uuid="8197a98d7ebc4230899aca82b073ab15">tempest-TaggedAttachmentsTest-475014275</nova:project>
Apr 12 16:00:00 user nova-compute[71874]:       </nova:owner>
Apr 12 16:00:00 user nova-compute[71874]:       <nova:root type="image" uuid="9dc63f14-8b70-4e72-89f2-13464f2f5c7c"/>
Apr 12 16:00:00 user nova-compute[71874]:       <nova:ports>
Apr 12 16:00:00 user nova-compute[71874]:         <nova:port uuid="4a51084d-9fff-4a53-9387-4542bfd6a4a7">
Apr 12 16:00:00 user nova-compute[71874]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 12 16:00:00 user nova-compute[71874]:         </nova:port>
Apr 12 16:00:00 user nova-compute[71874]:       </nova:ports>
Apr 12 16:00:00 user nova-compute[71874]:     </nova:instance>
Apr 12 16:00:00 user nova-compute[71874]:   </metadata>
Apr 12 16:00:00 user nova-compute[71874]:   <sysinfo type="smbios">
Apr 12 16:00:00 user nova-compute[71874]:     <system>
Apr 12 16:00:00 user nova-compute[71874]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 16:00:00 user nova-compute[71874]:       <entry name="product">OpenStack Nova</entry>
Apr 12 16:00:00 user nova-compute[71874]:       <entry name="version">0.0.0</entry>
Apr 12 16:00:00 user nova-compute[71874]:       <entry name="serial">55aff314-eb5e-4752-af9f-a4021e970cac</entry>
Apr 12 16:00:00 user nova-compute[71874]:       <entry name="uuid">55aff314-eb5e-4752-af9f-a4021e970cac</entry>
Apr 12 16:00:00 user nova-compute[71874]:       <entry name="family">Virtual Machine</entry>
Apr 12 16:00:00 user nova-compute[71874]:     </system>
Apr 12 16:00:00 user nova-compute[71874]:   </sysinfo>
Apr 12 16:00:00 user nova-compute[71874]:   <os>
Apr 12 16:00:00 user nova-compute[71874]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 16:00:00 user nova-compute[71874]:     <boot dev="hd"/>
Apr 12 16:00:00 user nova-compute[71874]:     <smbios mode="sysinfo"/>
Apr 12 16:00:00 user nova-compute[71874]:   </os>
Apr 12 16:00:00 user nova-compute[71874]:   <features>
Apr 12 16:00:00 user nova-compute[71874]:     <acpi/>
Apr 12 16:00:00 user nova-compute[71874]:     <apic/>
Apr 12 16:00:00 user nova-compute[71874]:     <vmcoreinfo/>
Apr 12 16:00:00 user nova-compute[71874]:   </features>
Apr 12 16:00:00 user nova-compute[71874]:   <clock offset="utc">
Apr 12 16:00:00 user nova-compute[71874]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 16:00:00 user nova-compute[71874]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 16:00:00 user nova-compute[71874]:     <timer name="hpet" present="no"/>
Apr 12 16:00:00 user nova-compute[71874]:   </clock>
Apr 12 16:00:00 user nova-compute[71874]:   <cpu mode="custom" match="exact">
Apr 12 16:00:00 user nova-compute[71874]:     <model>Nehalem</model>
Apr 12 16:00:00 user nova-compute[71874]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 16:00:00 user nova-compute[71874]:   </cpu>
Apr 12 16:00:00 user nova-compute[71874]:   <devices>
Apr 12 16:00:00 user nova-compute[71874]:     <disk type="file" device="disk">
Apr 12 16:00:00 user nova-compute[71874]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 16:00:00 user nova-compute[71874]:       <source file="/opt/stack/data/nova/instances/55aff314-eb5e-4752-af9f-a4021e970cac/disk"/>
Apr 12 16:00:00 user nova-compute[71874]:       <target dev="vda" bus="virtio"/>
Apr 12 16:00:00 user nova-compute[71874]:     </disk>
Apr 12 16:00:00 user nova-compute[71874]:     <disk type="file" device="cdrom">
Apr 12 16:00:00 user nova-compute[71874]:       <driver name="qemu" type="raw" cache="none"/>
Apr 12 16:00:00 user nova-compute[71874]:       <source file="/opt/stack/data/nova/instances/55aff314-eb5e-4752-af9f-a4021e970cac/disk.config"/>
Apr 12 16:00:00 user nova-compute[71874]:       <target dev="hda" bus="ide"/>
Apr 12 16:00:00 user nova-compute[71874]:     </disk>
Apr 12 16:00:00 user nova-compute[71874]:     <interface type="ethernet">
Apr 12 16:00:00 user nova-compute[71874]:       <mac address="fa:16:3e:5a:aa:4d"/>
Apr 12 16:00:00 user nova-compute[71874]:       <model type="virtio"/>
Apr 12 16:00:00 user nova-compute[71874]:       <mtu size="1442"/>
Apr 12 16:00:00 user nova-compute[71874]:       <target dev="tap4a51084d-9f"/>
Apr 12 16:00:00 user nova-compute[71874]:     </interface>
Apr 12 16:00:00 user nova-compute[71874]:     <serial type="pty">
Apr 12 16:00:00 user nova-compute[71874]:       <log file="/opt/stack/data/nova/instances/55aff314-eb5e-4752-af9f-a4021e970cac/console.log" append="off"/>
Apr 12 16:00:00 user nova-compute[71874]:     </serial>
Apr 12 16:00:00 user nova-compute[71874]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 16:00:00 user nova-compute[71874]:     <video>
Apr 12 16:00:00 user nova-compute[71874]:       <model type="virtio"/>
Apr 12 16:00:00 user nova-compute[71874]:     </video>
Apr 12 16:00:00 user nova-compute[71874]:     <rng model="virtio">
Apr 12 16:00:00 user nova-compute[71874]:       <backend model="random">/dev/urandom</backend>
Apr 12 16:00:00 user nova-compute[71874]:     </rng>
Apr 12 16:00:00 user nova-compute[71874]:     <controller type="usb" index="0" model="none"/>
Apr 12 16:00:00 user nova-compute[71874]:     <memballoon model="virtio">
Apr 12 16:00:00 user nova-compute[71874]:       <stats period="10"/>
Apr 12 16:00:00 user nova-compute[71874]:     </memballoon>
Apr 12 16:00:00 user nova-compute[71874]:   </devices>
Apr 12 16:00:00 user nova-compute[71874]: </domain>
Apr 12 16:00:00 user nova-compute[71874]:  {{(pid=71874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 16:00:00 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-b4d6b129-8c2f-474e-9540-10960542114b tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T15:59:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1331285489',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1331285489',id=7,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEJbHdIj6Qnsbz5sPRJ4ye2dl2IsI8e0vfQ09uKxN501bN+DgkHVMylQpwrl7ZvLZ8swmrO3BjtPpMg/5nOMgbnum5uHS/qZKbdglyI6E6LnkEx0Cctk5Q87Mk68+Dgi4A==',key_name='tempest-keypair-2057580771',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8197a98d7ebc4230899aca82b073ab15',ramdisk_id='',reservation_id='r-ncvxejnb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-475014275',owner_user_name='tempest-TaggedAttachmentsTest-475014275-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T15:59:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='324eb9033e62405ca2b322bcb6da9a04',uuid=55aff314-eb5e-4752-af9f-a4021e970cac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4a51084d-9fff-4a53-9387-4542bfd6a4a7", "address": "fa:16:3e:5a:aa:4d", "network": {"id": "95c64a1b-8b44-403f-8c4c-32730720d7a7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-87023330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8197a98d7ebc4230899aca82b073ab15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a51084d-9f", "ovs_interfaceid": "4a51084d-9fff-4a53-9387-4542bfd6a4a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 16:00:00 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-b4d6b129-8c2f-474e-9540-10960542114b tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Converting VIF {"id": "4a51084d-9fff-4a53-9387-4542bfd6a4a7", "address": "fa:16:3e:5a:aa:4d", "network": {"id": "95c64a1b-8b44-403f-8c4c-32730720d7a7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-87023330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8197a98d7ebc4230899aca82b073ab15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a51084d-9f", "ovs_interfaceid": "4a51084d-9fff-4a53-9387-4542bfd6a4a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:00:00 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-b4d6b129-8c2f-474e-9540-10960542114b tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:aa:4d,bridge_name='br-int',has_traffic_filtering=True,id=4a51084d-9fff-4a53-9387-4542bfd6a4a7,network=Network(95c64a1b-8b44-403f-8c4c-32730720d7a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a51084d-9f') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:00:00 user nova-compute[71874]: DEBUG os_vif [None req-b4d6b129-8c2f-474e-9540-10960542114b tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:aa:4d,bridge_name='br-int',has_traffic_filtering=True,id=4a51084d-9fff-4a53-9387-4542bfd6a4a7,network=Network(95c64a1b-8b44-403f-8c4c-32730720d7a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a51084d-9f') {{(pid=71874) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 16:00:00 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:00 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:00:00 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 16:00:00 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:00 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4a51084d-9f, may_exist=True) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:00:00 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4a51084d-9f, col_values=(('external_ids', {'iface-id': '4a51084d-9fff-4a53-9387-4542bfd6a4a7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5a:aa:4d', 'vm-uuid': '55aff314-eb5e-4752-af9f-a4021e970cac'}),)) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:00:00 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:00:00 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:00 user nova-compute[71874]: INFO os_vif [None req-b4d6b129-8c2f-474e-9540-10960542114b tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:aa:4d,bridge_name='br-int',has_traffic_filtering=True,id=4a51084d-9fff-4a53-9387-4542bfd6a4a7,network=Network(95c64a1b-8b44-403f-8c4c-32730720d7a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a51084d-9f')
Apr 12 16:00:00 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-b4d6b129-8c2f-474e-9540-10960542114b tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] No BDM found with device name vda, not building metadata. {{(pid=71874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 16:00:00 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-b4d6b129-8c2f-474e-9540-10960542114b tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] No BDM found with device name hda, not building metadata. {{(pid=71874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 16:00:00 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-b4d6b129-8c2f-474e-9540-10960542114b tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] No VIF found with MAC fa:16:3e:5a:aa:4d, not building metadata {{(pid=71874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 16:00:00 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-b4d6b129-8c2f-474e-9540-10960542114b tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] [instance: 55aff314-eb5e-4752-af9f-a4021e970cac] Using config drive
Apr 12 16:00:00 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-7eefda50-4ec2-4ca9-a470-b369e2aedc10 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Acquiring lock "e85aa869-0d2a-40ff-9697-f979a6b110cb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:00:00 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-7eefda50-4ec2-4ca9-a470-b369e2aedc10 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Lock "e85aa869-0d2a-40ff-9697-f979a6b110cb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:00:00 user nova-compute[71874]: DEBUG nova.compute.manager [None req-7eefda50-4ec2-4ca9-a470-b369e2aedc10 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] [instance: e85aa869-0d2a-40ff-9697-f979a6b110cb] Starting instance... {{(pid=71874) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 16:00:00 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-b4d6b129-8c2f-474e-9540-10960542114b tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] [instance: 55aff314-eb5e-4752-af9f-a4021e970cac] Creating config drive at /opt/stack/data/nova/instances/55aff314-eb5e-4752-af9f-a4021e970cac/disk.config
Apr 12 16:00:00 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-b4d6b129-8c2f-474e-9540-10960542114b tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/55aff314-eb5e-4752-af9f-a4021e970cac/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpm4pibnrd {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:00 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-7eefda50-4ec2-4ca9-a470-b369e2aedc10 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:00:00 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-7eefda50-4ec2-4ca9-a470-b369e2aedc10 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.004s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:00:00 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-b4d6b129-8c2f-474e-9540-10960542114b tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/55aff314-eb5e-4752-af9f-a4021e970cac/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpm4pibnrd" returned: 0 in 0.098s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:00:00 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-7eefda50-4ec2-4ca9-a470-b369e2aedc10 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71874) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 16:00:00 user nova-compute[71874]: INFO nova.compute.claims [None req-7eefda50-4ec2-4ca9-a470-b369e2aedc10 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] [instance: e85aa869-0d2a-40ff-9697-f979a6b110cb] Claim successful on node user
Apr 12 16:00:01 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:01 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-7eefda50-4ec2-4ca9-a470-b369e2aedc10 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Inventory has not changed in ProviderTree for provider: 0e94b4c8-cd49-45e4-9133-d36eb4b2456b {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 16:00:01 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-7eefda50-4ec2-4ca9-a470-b369e2aedc10 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Inventory has not changed for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 16:00:01 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-7eefda50-4ec2-4ca9-a470-b369e2aedc10 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.593s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:00:01 user nova-compute[71874]: DEBUG nova.compute.manager [None req-7eefda50-4ec2-4ca9-a470-b369e2aedc10 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] [instance: e85aa869-0d2a-40ff-9697-f979a6b110cb] Start building networks asynchronously for instance. {{(pid=71874) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 16:00:01 user nova-compute[71874]: DEBUG nova.network.neutron [req-5bbabf36-a832-4441-80d7-a51fd75bd177 req-c8184506-58c7-4194-acef-3e5d8be7eb17 service nova] [instance: 55aff314-eb5e-4752-af9f-a4021e970cac] Updated VIF entry in instance network info cache for port 4a51084d-9fff-4a53-9387-4542bfd6a4a7. {{(pid=71874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 16:00:01 user nova-compute[71874]: DEBUG nova.network.neutron [req-5bbabf36-a832-4441-80d7-a51fd75bd177 req-c8184506-58c7-4194-acef-3e5d8be7eb17 service nova] [instance: 55aff314-eb5e-4752-af9f-a4021e970cac] Updating instance_info_cache with network_info: [{"id": "4a51084d-9fff-4a53-9387-4542bfd6a4a7", "address": "fa:16:3e:5a:aa:4d", "network": {"id": "95c64a1b-8b44-403f-8c4c-32730720d7a7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-87023330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8197a98d7ebc4230899aca82b073ab15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a51084d-9f", "ovs_interfaceid": "4a51084d-9fff-4a53-9387-4542bfd6a4a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:00:01 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-5bbabf36-a832-4441-80d7-a51fd75bd177 req-c8184506-58c7-4194-acef-3e5d8be7eb17 service nova] Releasing lock "refresh_cache-55aff314-eb5e-4752-af9f-a4021e970cac" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:00:01 user nova-compute[71874]: DEBUG nova.compute.manager [None req-7eefda50-4ec2-4ca9-a470-b369e2aedc10 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] [instance: e85aa869-0d2a-40ff-9697-f979a6b110cb] Allocating IP information in the background. {{(pid=71874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 16:00:01 user nova-compute[71874]: DEBUG nova.network.neutron [None req-7eefda50-4ec2-4ca9-a470-b369e2aedc10 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] [instance: e85aa869-0d2a-40ff-9697-f979a6b110cb] allocate_for_instance() {{(pid=71874) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 16:00:01 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-7eefda50-4ec2-4ca9-a470-b369e2aedc10 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] [instance: e85aa869-0d2a-40ff-9697-f979a6b110cb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 16:00:01 user nova-compute[71874]: DEBUG nova.compute.manager [None req-7eefda50-4ec2-4ca9-a470-b369e2aedc10 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] [instance: e85aa869-0d2a-40ff-9697-f979a6b110cb] Start building block device mappings for instance. {{(pid=71874) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 16:00:01 user nova-compute[71874]: DEBUG nova.compute.manager [None req-7eefda50-4ec2-4ca9-a470-b369e2aedc10 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] [instance: e85aa869-0d2a-40ff-9697-f979a6b110cb] Start spawning the instance on the hypervisor. {{(pid=71874) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 16:00:01 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-7eefda50-4ec2-4ca9-a470-b369e2aedc10 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] [instance: e85aa869-0d2a-40ff-9697-f979a6b110cb] Creating instance directory {{(pid=71874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 16:00:01 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-7eefda50-4ec2-4ca9-a470-b369e2aedc10 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] [instance: e85aa869-0d2a-40ff-9697-f979a6b110cb] Creating image(s)
Apr 12 16:00:01 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-7eefda50-4ec2-4ca9-a470-b369e2aedc10 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Acquiring lock "/opt/stack/data/nova/instances/e85aa869-0d2a-40ff-9697-f979a6b110cb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:00:01 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-7eefda50-4ec2-4ca9-a470-b369e2aedc10 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Lock "/opt/stack/data/nova/instances/e85aa869-0d2a-40ff-9697-f979a6b110cb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:00:01 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-7eefda50-4ec2-4ca9-a470-b369e2aedc10 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Lock "/opt/stack/data/nova/instances/e85aa869-0d2a-40ff-9697-f979a6b110cb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:00:01 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-7eefda50-4ec2-4ca9-a470-b369e2aedc10 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:01 user nova-compute[71874]: DEBUG nova.policy [None req-7eefda50-4ec2-4ca9-a470-b369e2aedc10 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd2e5f900d0b144f9942de733017fb396', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8e21d4dae04fd08951f8306cff0624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71874) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 16:00:01 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-7eefda50-4ec2-4ca9-a470-b369e2aedc10 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json" returned: 0 in 0.181s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:00:01 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-7eefda50-4ec2-4ca9-a470-b369e2aedc10 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Acquiring lock "b88df1b37cb431f52bc53b5616015c89b5bec411" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:00:01 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-7eefda50-4ec2-4ca9-a470-b369e2aedc10 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Lock "b88df1b37cb431f52bc53b5616015c89b5bec411" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:00:01 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-7eefda50-4ec2-4ca9-a470-b369e2aedc10 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:02 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:02 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-7eefda50-4ec2-4ca9-a470-b369e2aedc10 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json" returned: 0 in 0.174s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:00:02 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-7eefda50-4ec2-4ca9-a470-b369e2aedc10 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411,backing_fmt=raw /opt/stack/data/nova/instances/e85aa869-0d2a-40ff-9697-f979a6b110cb/disk 1073741824 {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:02 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-7eefda50-4ec2-4ca9-a470-b369e2aedc10 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411,backing_fmt=raw /opt/stack/data/nova/instances/e85aa869-0d2a-40ff-9697-f979a6b110cb/disk 1073741824" returned: 0 in 0.070s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:00:02 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-7eefda50-4ec2-4ca9-a470-b369e2aedc10 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Lock "b88df1b37cb431f52bc53b5616015c89b5bec411" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:00:02 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-7eefda50-4ec2-4ca9-a470-b369e2aedc10 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:02 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:02 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:02 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-7eefda50-4ec2-4ca9-a470-b369e2aedc10 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json" returned: 0 in 0.249s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:00:02 user nova-compute[71874]: DEBUG nova.virt.disk.api [None req-7eefda50-4ec2-4ca9-a470-b369e2aedc10 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e85aa869-0d2a-40ff-9697-f979a6b110cb/disk. size=1073741824 {{(pid=71874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 16:00:02 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-7eefda50-4ec2-4ca9-a470-b369e2aedc10 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e85aa869-0d2a-40ff-9697-f979a6b110cb/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:02 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-7eefda50-4ec2-4ca9-a470-b369e2aedc10 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e85aa869-0d2a-40ff-9697-f979a6b110cb/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:00:02 user nova-compute[71874]: DEBUG nova.virt.disk.api [None req-7eefda50-4ec2-4ca9-a470-b369e2aedc10 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Cannot resize image /opt/stack/data/nova/instances/e85aa869-0d2a-40ff-9697-f979a6b110cb/disk to a smaller size. {{(pid=71874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 16:00:02 user nova-compute[71874]: DEBUG nova.objects.instance [None req-7eefda50-4ec2-4ca9-a470-b369e2aedc10 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Lazy-loading 'migration_context' on Instance uuid e85aa869-0d2a-40ff-9697-f979a6b110cb {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:00:02 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-7eefda50-4ec2-4ca9-a470-b369e2aedc10 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] [instance: e85aa869-0d2a-40ff-9697-f979a6b110cb] Created local disks {{(pid=71874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 16:00:02 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-7eefda50-4ec2-4ca9-a470-b369e2aedc10 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] [instance: e85aa869-0d2a-40ff-9697-f979a6b110cb] Ensure instance console log exists: /opt/stack/data/nova/instances/e85aa869-0d2a-40ff-9697-f979a6b110cb/console.log {{(pid=71874) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 16:00:02 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-7eefda50-4ec2-4ca9-a470-b369e2aedc10 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:00:02 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-7eefda50-4ec2-4ca9-a470-b369e2aedc10 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:00:02 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-7eefda50-4ec2-4ca9-a470-b369e2aedc10 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:00:03 user nova-compute[71874]: DEBUG nova.compute.manager [req-0c1ee7f5-5470-4857-a505-3e8e415553f1 req-30a059ab-66a5-4956-b18e-31ff19d37724 service nova] [instance: 55aff314-eb5e-4752-af9f-a4021e970cac] Received event network-vif-plugged-4a51084d-9fff-4a53-9387-4542bfd6a4a7 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:00:03 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-0c1ee7f5-5470-4857-a505-3e8e415553f1 req-30a059ab-66a5-4956-b18e-31ff19d37724 service nova] Acquiring lock "55aff314-eb5e-4752-af9f-a4021e970cac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:00:03 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-0c1ee7f5-5470-4857-a505-3e8e415553f1 req-30a059ab-66a5-4956-b18e-31ff19d37724 service nova] Lock "55aff314-eb5e-4752-af9f-a4021e970cac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:00:03 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-0c1ee7f5-5470-4857-a505-3e8e415553f1 req-30a059ab-66a5-4956-b18e-31ff19d37724 service nova] Lock "55aff314-eb5e-4752-af9f-a4021e970cac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:00:03 user nova-compute[71874]: DEBUG nova.compute.manager [req-0c1ee7f5-5470-4857-a505-3e8e415553f1 req-30a059ab-66a5-4956-b18e-31ff19d37724 service nova] [instance: 55aff314-eb5e-4752-af9f-a4021e970cac] No waiting events found dispatching network-vif-plugged-4a51084d-9fff-4a53-9387-4542bfd6a4a7 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:00:03 user nova-compute[71874]: WARNING nova.compute.manager [req-0c1ee7f5-5470-4857-a505-3e8e415553f1 req-30a059ab-66a5-4956-b18e-31ff19d37724 service nova] [instance: 55aff314-eb5e-4752-af9f-a4021e970cac] Received unexpected event network-vif-plugged-4a51084d-9fff-4a53-9387-4542bfd6a4a7 for instance with vm_state building and task_state spawning.
Apr 12 16:00:03 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:03 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:03 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:04 user nova-compute[71874]: DEBUG nova.network.neutron [None req-7eefda50-4ec2-4ca9-a470-b369e2aedc10 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] [instance: e85aa869-0d2a-40ff-9697-f979a6b110cb] Successfully created port: 0db939d7-60c3-48af-8d8d-0f5528f41bb6 {{(pid=71874) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 16:00:04 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-86a55a41-b7cc-416d-b059-dc8294942a87 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Acquiring lock "6614f2c0-399b-43d2-86c9-5790c57575e9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:00:04 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-86a55a41-b7cc-416d-b059-dc8294942a87 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Lock "6614f2c0-399b-43d2-86c9-5790c57575e9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:00:04 user nova-compute[71874]: DEBUG nova.compute.manager [None req-86a55a41-b7cc-416d-b059-dc8294942a87 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] [instance: 6614f2c0-399b-43d2-86c9-5790c57575e9] Starting instance... {{(pid=71874) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 16:00:04 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-86a55a41-b7cc-416d-b059-dc8294942a87 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:00:04 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-86a55a41-b7cc-416d-b059-dc8294942a87 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:00:04 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-86a55a41-b7cc-416d-b059-dc8294942a87 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71874) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 16:00:04 user nova-compute[71874]: INFO nova.compute.claims [None req-86a55a41-b7cc-416d-b059-dc8294942a87 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] [instance: 6614f2c0-399b-43d2-86c9-5790c57575e9] Claim successful on node user
Apr 12 16:00:04 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-86a55a41-b7cc-416d-b059-dc8294942a87 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Inventory has not changed in ProviderTree for provider: 0e94b4c8-cd49-45e4-9133-d36eb4b2456b {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 16:00:04 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-86a55a41-b7cc-416d-b059-dc8294942a87 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Inventory has not changed for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 16:00:05 user nova-compute[71874]: DEBUG nova.virt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Emitting event <LifecycleEvent: 1681315205.0052283, 55aff314-eb5e-4752-af9f-a4021e970cac => Resumed> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:00:05 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 55aff314-eb5e-4752-af9f-a4021e970cac] VM Resumed (Lifecycle Event)
Apr 12 16:00:05 user nova-compute[71874]: DEBUG nova.compute.manager [None req-b4d6b129-8c2f-474e-9540-10960542114b tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] [instance: 55aff314-eb5e-4752-af9f-a4021e970cac] Instance event wait completed in 0 seconds for  {{(pid=71874) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 16:00:05 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-b4d6b129-8c2f-474e-9540-10960542114b tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] [instance: 55aff314-eb5e-4752-af9f-a4021e970cac] Guest created on hypervisor {{(pid=71874) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 16:00:05 user nova-compute[71874]: INFO nova.virt.libvirt.driver [-] [instance: 55aff314-eb5e-4752-af9f-a4021e970cac] Instance spawned successfully.
Apr 12 16:00:05 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-b4d6b129-8c2f-474e-9540-10960542114b tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] [instance: 55aff314-eb5e-4752-af9f-a4021e970cac] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 16:00:05 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-86a55a41-b7cc-416d-b059-dc8294942a87 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.516s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:00:05 user nova-compute[71874]: DEBUG nova.compute.manager [None req-86a55a41-b7cc-416d-b059-dc8294942a87 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] [instance: 6614f2c0-399b-43d2-86c9-5790c57575e9] Start building networks asynchronously for instance. {{(pid=71874) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 16:00:05 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 55aff314-eb5e-4752-af9f-a4021e970cac] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:00:05 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-b4d6b129-8c2f-474e-9540-10960542114b tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] [instance: 55aff314-eb5e-4752-af9f-a4021e970cac] Found default for hw_cdrom_bus of ide {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:00:05 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-b4d6b129-8c2f-474e-9540-10960542114b tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] [instance: 55aff314-eb5e-4752-af9f-a4021e970cac] Found default for hw_disk_bus of virtio {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:00:05 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-b4d6b129-8c2f-474e-9540-10960542114b tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] [instance: 55aff314-eb5e-4752-af9f-a4021e970cac] Found default for hw_input_bus of None {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:00:05 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-b4d6b129-8c2f-474e-9540-10960542114b tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] [instance: 55aff314-eb5e-4752-af9f-a4021e970cac] Found default for hw_pointer_model of None {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:00:05 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-b4d6b129-8c2f-474e-9540-10960542114b tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] [instance: 55aff314-eb5e-4752-af9f-a4021e970cac] Found default for hw_video_model of virtio {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:00:05 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-b4d6b129-8c2f-474e-9540-10960542114b tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] [instance: 55aff314-eb5e-4752-af9f-a4021e970cac] Found default for hw_vif_model of virtio {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:00:05 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 55aff314-eb5e-4752-af9f-a4021e970cac] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 16:00:05 user nova-compute[71874]: DEBUG nova.compute.manager [None req-86a55a41-b7cc-416d-b059-dc8294942a87 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] [instance: 6614f2c0-399b-43d2-86c9-5790c57575e9] Allocating IP information in the background. {{(pid=71874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 16:00:05 user nova-compute[71874]: DEBUG nova.network.neutron [None req-86a55a41-b7cc-416d-b059-dc8294942a87 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] [instance: 6614f2c0-399b-43d2-86c9-5790c57575e9] allocate_for_instance() {{(pid=71874) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 16:00:05 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 55aff314-eb5e-4752-af9f-a4021e970cac] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 16:00:05 user nova-compute[71874]: DEBUG nova.virt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Emitting event <LifecycleEvent: 1681315205.0091403, 55aff314-eb5e-4752-af9f-a4021e970cac => Started> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:00:05 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 55aff314-eb5e-4752-af9f-a4021e970cac] VM Started (Lifecycle Event)
Apr 12 16:00:05 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-86a55a41-b7cc-416d-b059-dc8294942a87 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] [instance: 6614f2c0-399b-43d2-86c9-5790c57575e9] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Apr 12 16:00:05 user nova-compute[71874]: DEBUG nova.compute.manager [req-14272877-82d0-4d0e-ace9-23c92448f71d req-8d5d2ac5-85b5-4aab-8194-e82e3bab1e63 service nova] [instance: 55aff314-eb5e-4752-af9f-a4021e970cac] Received event network-vif-plugged-4a51084d-9fff-4a53-9387-4542bfd6a4a7 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:00:05 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-14272877-82d0-4d0e-ace9-23c92448f71d req-8d5d2ac5-85b5-4aab-8194-e82e3bab1e63 service nova] Acquiring lock "55aff314-eb5e-4752-af9f-a4021e970cac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:00:05 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-14272877-82d0-4d0e-ace9-23c92448f71d req-8d5d2ac5-85b5-4aab-8194-e82e3bab1e63 service nova] Lock "55aff314-eb5e-4752-af9f-a4021e970cac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:00:05 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-14272877-82d0-4d0e-ace9-23c92448f71d req-8d5d2ac5-85b5-4aab-8194-e82e3bab1e63 service nova] Lock "55aff314-eb5e-4752-af9f-a4021e970cac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:00:05 user nova-compute[71874]: DEBUG nova.compute.manager [req-14272877-82d0-4d0e-ace9-23c92448f71d req-8d5d2ac5-85b5-4aab-8194-e82e3bab1e63 service nova] [instance: 55aff314-eb5e-4752-af9f-a4021e970cac] No waiting events found dispatching network-vif-plugged-4a51084d-9fff-4a53-9387-4542bfd6a4a7 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:00:05 user nova-compute[71874]: WARNING nova.compute.manager [req-14272877-82d0-4d0e-ace9-23c92448f71d req-8d5d2ac5-85b5-4aab-8194-e82e3bab1e63 service nova] [instance: 55aff314-eb5e-4752-af9f-a4021e970cac] Received unexpected event network-vif-plugged-4a51084d-9fff-4a53-9387-4542bfd6a4a7 for instance with vm_state building and task_state spawning.
Apr 12 16:00:05 user nova-compute[71874]: DEBUG nova.compute.manager [None req-86a55a41-b7cc-416d-b059-dc8294942a87 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] [instance: 6614f2c0-399b-43d2-86c9-5790c57575e9] Start building block device mappings for instance. {{(pid=71874) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 16:00:05 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 55aff314-eb5e-4752-af9f-a4021e970cac] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:00:05 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 55aff314-eb5e-4752-af9f-a4021e970cac] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 16:00:05 user nova-compute[71874]: INFO nova.compute.manager [None req-b4d6b129-8c2f-474e-9540-10960542114b tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] [instance: 55aff314-eb5e-4752-af9f-a4021e970cac] Took 9.56 seconds to spawn the instance on the hypervisor.
Apr 12 16:00:05 user nova-compute[71874]: DEBUG nova.compute.manager [None req-b4d6b129-8c2f-474e-9540-10960542114b tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] [instance: 55aff314-eb5e-4752-af9f-a4021e970cac] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:00:05 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 55aff314-eb5e-4752-af9f-a4021e970cac] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 16:00:05 user nova-compute[71874]: DEBUG nova.policy [None req-86a55a41-b7cc-416d-b059-dc8294942a87 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '16ff4a8d98bc4dfa85f0f7d9c0fcebea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672dcb2ce6454ab4aeae3de7550ca8e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71874) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 16:00:05 user nova-compute[71874]: INFO nova.compute.manager [None req-b4d6b129-8c2f-474e-9540-10960542114b tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] [instance: 55aff314-eb5e-4752-af9f-a4021e970cac] Took 11.02 seconds to build instance.
Apr 12 16:00:05 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:05 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-b4d6b129-8c2f-474e-9540-10960542114b tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Lock "55aff314-eb5e-4752-af9f-a4021e970cac" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.286s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:00:05 user nova-compute[71874]: DEBUG nova.compute.manager [None req-86a55a41-b7cc-416d-b059-dc8294942a87 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] [instance: 6614f2c0-399b-43d2-86c9-5790c57575e9] Start spawning the instance on the hypervisor. {{(pid=71874) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 16:00:05 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-86a55a41-b7cc-416d-b059-dc8294942a87 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] [instance: 6614f2c0-399b-43d2-86c9-5790c57575e9] Creating instance directory {{(pid=71874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 16:00:05 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-86a55a41-b7cc-416d-b059-dc8294942a87 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] [instance: 6614f2c0-399b-43d2-86c9-5790c57575e9] Creating image(s)
Apr 12 16:00:05 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-86a55a41-b7cc-416d-b059-dc8294942a87 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Acquiring lock "/opt/stack/data/nova/instances/6614f2c0-399b-43d2-86c9-5790c57575e9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:00:05 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-86a55a41-b7cc-416d-b059-dc8294942a87 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Lock "/opt/stack/data/nova/instances/6614f2c0-399b-43d2-86c9-5790c57575e9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:00:05 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-86a55a41-b7cc-416d-b059-dc8294942a87 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Lock "/opt/stack/data/nova/instances/6614f2c0-399b-43d2-86c9-5790c57575e9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:00:05 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-86a55a41-b7cc-416d-b059-dc8294942a87 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Acquiring lock "5f626c5fcf57547e9fed6604b1b1d5a7c969b77c" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:00:05 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-86a55a41-b7cc-416d-b059-dc8294942a87 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Lock "5f626c5fcf57547e9fed6604b1b1d5a7c969b77c" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:00:05 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-86a55a41-b7cc-416d-b059-dc8294942a87 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5f626c5fcf57547e9fed6604b1b1d5a7c969b77c.part --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:05 user nova-compute[71874]: DEBUG nova.network.neutron [None req-7eefda50-4ec2-4ca9-a470-b369e2aedc10 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] [instance: e85aa869-0d2a-40ff-9697-f979a6b110cb] Successfully updated port: 0db939d7-60c3-48af-8d8d-0f5528f41bb6 {{(pid=71874) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 16:00:05 user nova-compute[71874]: DEBUG nova.compute.manager [req-bb416a69-7ffa-45d9-b837-6bdbd5b81d7f req-af2ed33d-235f-47dc-905d-86522a863e51 service nova] [instance: e85aa869-0d2a-40ff-9697-f979a6b110cb] Received event network-changed-0db939d7-60c3-48af-8d8d-0f5528f41bb6 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:00:05 user nova-compute[71874]: DEBUG nova.compute.manager [req-bb416a69-7ffa-45d9-b837-6bdbd5b81d7f req-af2ed33d-235f-47dc-905d-86522a863e51 service nova] [instance: e85aa869-0d2a-40ff-9697-f979a6b110cb] Refreshing instance network info cache due to event network-changed-0db939d7-60c3-48af-8d8d-0f5528f41bb6. {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 16:00:05 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-bb416a69-7ffa-45d9-b837-6bdbd5b81d7f req-af2ed33d-235f-47dc-905d-86522a863e51 service nova] Acquiring lock "refresh_cache-e85aa869-0d2a-40ff-9697-f979a6b110cb" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:00:05 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-bb416a69-7ffa-45d9-b837-6bdbd5b81d7f req-af2ed33d-235f-47dc-905d-86522a863e51 service nova] Acquired lock "refresh_cache-e85aa869-0d2a-40ff-9697-f979a6b110cb" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:00:05 user nova-compute[71874]: DEBUG nova.network.neutron [req-bb416a69-7ffa-45d9-b837-6bdbd5b81d7f req-af2ed33d-235f-47dc-905d-86522a863e51 service nova] [instance: e85aa869-0d2a-40ff-9697-f979a6b110cb] Refreshing network info cache for port 0db939d7-60c3-48af-8d8d-0f5528f41bb6 {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 16:00:05 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-7eefda50-4ec2-4ca9-a470-b369e2aedc10 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Acquiring lock "refresh_cache-e85aa869-0d2a-40ff-9697-f979a6b110cb" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:00:05 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-86a55a41-b7cc-416d-b059-dc8294942a87 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5f626c5fcf57547e9fed6604b1b1d5a7c969b77c.part --force-share --output=json" returned: 0 in 0.184s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:00:05 user nova-compute[71874]: DEBUG nova.virt.images [None req-86a55a41-b7cc-416d-b059-dc8294942a87 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] bfacce9c-c119-4e9b-9797-bddc83436fec was qcow2, converting to raw {{(pid=71874) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 12 16:00:05 user nova-compute[71874]: DEBUG nova.privsep.utils [None req-86a55a41-b7cc-416d-b059-dc8294942a87 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71874) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 12 16:00:05 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-86a55a41-b7cc-416d-b059-dc8294942a87 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5f626c5fcf57547e9fed6604b1b1d5a7c969b77c.part /opt/stack/data/nova/instances/_base/5f626c5fcf57547e9fed6604b1b1d5a7c969b77c.converted {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:05 user nova-compute[71874]: DEBUG nova.network.neutron [req-bb416a69-7ffa-45d9-b837-6bdbd5b81d7f req-af2ed33d-235f-47dc-905d-86522a863e51 service nova] [instance: e85aa869-0d2a-40ff-9697-f979a6b110cb] Instance cache missing network info. {{(pid=71874) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 16:00:06 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-86a55a41-b7cc-416d-b059-dc8294942a87 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5f626c5fcf57547e9fed6604b1b1d5a7c969b77c.part /opt/stack/data/nova/instances/_base/5f626c5fcf57547e9fed6604b1b1d5a7c969b77c.converted" returned: 0 in 0.149s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:00:06 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-86a55a41-b7cc-416d-b059-dc8294942a87 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5f626c5fcf57547e9fed6604b1b1d5a7c969b77c.converted --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:06 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:06 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-86a55a41-b7cc-416d-b059-dc8294942a87 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5f626c5fcf57547e9fed6604b1b1d5a7c969b77c.converted --force-share --output=json" returned: 0 in 0.164s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:00:06 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-86a55a41-b7cc-416d-b059-dc8294942a87 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Lock "5f626c5fcf57547e9fed6604b1b1d5a7c969b77c" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.905s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:00:06 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-86a55a41-b7cc-416d-b059-dc8294942a87 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5f626c5fcf57547e9fed6604b1b1d5a7c969b77c --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:06 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-86a55a41-b7cc-416d-b059-dc8294942a87 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5f626c5fcf57547e9fed6604b1b1d5a7c969b77c --force-share --output=json" returned: 0 in 0.168s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:00:06 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-86a55a41-b7cc-416d-b059-dc8294942a87 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Acquiring lock "5f626c5fcf57547e9fed6604b1b1d5a7c969b77c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:00:06 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-86a55a41-b7cc-416d-b059-dc8294942a87 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Lock "5f626c5fcf57547e9fed6604b1b1d5a7c969b77c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:00:06 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-86a55a41-b7cc-416d-b059-dc8294942a87 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5f626c5fcf57547e9fed6604b1b1d5a7c969b77c --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:06 user nova-compute[71874]: DEBUG nova.network.neutron [None req-86a55a41-b7cc-416d-b059-dc8294942a87 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] [instance: 6614f2c0-399b-43d2-86c9-5790c57575e9] Successfully created port: f1aab2a2-67f1-4ec5-9aeb-dffdec2170e3 {{(pid=71874) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 16:00:06 user nova-compute[71874]: DEBUG nova.network.neutron [req-bb416a69-7ffa-45d9-b837-6bdbd5b81d7f req-af2ed33d-235f-47dc-905d-86522a863e51 service nova] [instance: e85aa869-0d2a-40ff-9697-f979a6b110cb] Updating instance_info_cache with network_info: [] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:00:06 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-bb416a69-7ffa-45d9-b837-6bdbd5b81d7f req-af2ed33d-235f-47dc-905d-86522a863e51 service nova] Releasing lock "refresh_cache-e85aa869-0d2a-40ff-9697-f979a6b110cb" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:00:06 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-7eefda50-4ec2-4ca9-a470-b369e2aedc10 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Acquired lock "refresh_cache-e85aa869-0d2a-40ff-9697-f979a6b110cb" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:00:06 user nova-compute[71874]: DEBUG nova.network.neutron [None req-7eefda50-4ec2-4ca9-a470-b369e2aedc10 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] [instance: e85aa869-0d2a-40ff-9697-f979a6b110cb] Building network info cache for instance {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 16:00:06 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-86a55a41-b7cc-416d-b059-dc8294942a87 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5f626c5fcf57547e9fed6604b1b1d5a7c969b77c --force-share --output=json" returned: 0 in 0.208s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:00:06 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-86a55a41-b7cc-416d-b059-dc8294942a87 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5f626c5fcf57547e9fed6604b1b1d5a7c969b77c,backing_fmt=raw /opt/stack/data/nova/instances/6614f2c0-399b-43d2-86c9-5790c57575e9/disk 1073741824 {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:06 user nova-compute[71874]: DEBUG nova.network.neutron [None req-7eefda50-4ec2-4ca9-a470-b369e2aedc10 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] [instance: e85aa869-0d2a-40ff-9697-f979a6b110cb] Instance cache missing network info. {{(pid=71874) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 16:00:06 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-86a55a41-b7cc-416d-b059-dc8294942a87 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5f626c5fcf57547e9fed6604b1b1d5a7c969b77c,backing_fmt=raw /opt/stack/data/nova/instances/6614f2c0-399b-43d2-86c9-5790c57575e9/disk 1073741824" returned: 0 in 0.069s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:00:06 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-86a55a41-b7cc-416d-b059-dc8294942a87 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Lock "5f626c5fcf57547e9fed6604b1b1d5a7c969b77c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.281s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:00:06 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-86a55a41-b7cc-416d-b059-dc8294942a87 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5f626c5fcf57547e9fed6604b1b1d5a7c969b77c --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:06 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-86a55a41-b7cc-416d-b059-dc8294942a87 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5f626c5fcf57547e9fed6604b1b1d5a7c969b77c --force-share --output=json" returned: 0 in 0.169s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:00:06 user nova-compute[71874]: DEBUG nova.virt.disk.api [None req-86a55a41-b7cc-416d-b059-dc8294942a87 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6614f2c0-399b-43d2-86c9-5790c57575e9/disk. size=1073741824 {{(pid=71874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 16:00:06 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-86a55a41-b7cc-416d-b059-dc8294942a87 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6614f2c0-399b-43d2-86c9-5790c57575e9/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:07 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-86a55a41-b7cc-416d-b059-dc8294942a87 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6614f2c0-399b-43d2-86c9-5790c57575e9/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:00:07 user nova-compute[71874]: DEBUG nova.virt.disk.api [None req-86a55a41-b7cc-416d-b059-dc8294942a87 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Cannot resize image /opt/stack/data/nova/instances/6614f2c0-399b-43d2-86c9-5790c57575e9/disk to a smaller size. {{(pid=71874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 16:00:07 user nova-compute[71874]: DEBUG nova.objects.instance [None req-86a55a41-b7cc-416d-b059-dc8294942a87 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Lazy-loading 'migration_context' on Instance uuid 6614f2c0-399b-43d2-86c9-5790c57575e9 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:00:07 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-86a55a41-b7cc-416d-b059-dc8294942a87 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] [instance: 6614f2c0-399b-43d2-86c9-5790c57575e9] Created local disks {{(pid=71874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 16:00:07 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-86a55a41-b7cc-416d-b059-dc8294942a87 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] [instance: 6614f2c0-399b-43d2-86c9-5790c57575e9] Ensure instance console log exists: /opt/stack/data/nova/instances/6614f2c0-399b-43d2-86c9-5790c57575e9/console.log {{(pid=71874) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 16:00:07 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-86a55a41-b7cc-416d-b059-dc8294942a87 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:00:07 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-86a55a41-b7cc-416d-b059-dc8294942a87 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:00:07 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-86a55a41-b7cc-416d-b059-dc8294942a87 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:00:07 user nova-compute[71874]: DEBUG nova.network.neutron [None req-7eefda50-4ec2-4ca9-a470-b369e2aedc10 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] [instance: e85aa869-0d2a-40ff-9697-f979a6b110cb] Updating instance_info_cache with network_info: [{"id": "0db939d7-60c3-48af-8d8d-0f5528f41bb6", "address": "fa:16:3e:c9:39:5d", "network": {"id": "1316768e-1461-4bd9-b6df-2a43928b62b2", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1176895361-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a8e21d4dae04fd08951f8306cff0624", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0db939d7-60", "ovs_interfaceid": "0db939d7-60c3-48af-8d8d-0f5528f41bb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:00:07 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-7eefda50-4ec2-4ca9-a470-b369e2aedc10 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Releasing lock "refresh_cache-e85aa869-0d2a-40ff-9697-f979a6b110cb" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:00:07 user nova-compute[71874]: DEBUG nova.compute.manager [None req-7eefda50-4ec2-4ca9-a470-b369e2aedc10 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] [instance: e85aa869-0d2a-40ff-9697-f979a6b110cb] Instance network_info: |[{"id": "0db939d7-60c3-48af-8d8d-0f5528f41bb6", "address": "fa:16:3e:c9:39:5d", "network": {"id": "1316768e-1461-4bd9-b6df-2a43928b62b2", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1176895361-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a8e21d4dae04fd08951f8306cff0624", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0db939d7-60", "ovs_interfaceid": "0db939d7-60c3-48af-8d8d-0f5528f41bb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 16:00:07 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-7eefda50-4ec2-4ca9-a470-b369e2aedc10 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] [instance: e85aa869-0d2a-40ff-9697-f979a6b110cb] Start _get_guest_xml network_info=[{"id": "0db939d7-60c3-48af-8d8d-0f5528f41bb6", "address": "fa:16:3e:c9:39:5d", "network": {"id": "1316768e-1461-4bd9-b6df-2a43928b62b2", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1176895361-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a8e21d4dae04fd08951f8306cff0624", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0db939d7-60", "ovs_interfaceid": "0db939d7-60c3-48af-8d8d-0f5528f41bb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T15:55:37Z,direct_url=<?>,disk_format='qcow2',id=9dc63f14-8b70-4e72-89f2-13464f2f5c7c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='61a4936d9b7744c0b488d81c9b7746b6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T15:55:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_options': None, 'image_id': '9dc63f14-8b70-4e72-89f2-13464f2f5c7c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 16:00:07 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-7eefda50-4ec2-4ca9-a470-b369e2aedc10 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:00:07 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-7eefda50-4ec2-4ca9-a470-b369e2aedc10 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:00:07 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-7eefda50-4ec2-4ca9-a470-b369e2aedc10 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71874) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 16:00:07 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-7eefda50-4ec2-4ca9-a470-b369e2aedc10 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T15:56:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T15:55:37Z,direct_url=<?>,disk_format='qcow2',id=9dc63f14-8b70-4e72-89f2-13464f2f5c7c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='61a4936d9b7744c0b488d81c9b7746b6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T15:55:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 16:00:07 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-7eefda50-4ec2-4ca9-a470-b369e2aedc10 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Flavor limits 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 16:00:07 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-7eefda50-4ec2-4ca9-a470-b369e2aedc10 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Image limits 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 16:00:07 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-7eefda50-4ec2-4ca9-a470-b369e2aedc10 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Flavor pref 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 16:00:07 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-7eefda50-4ec2-4ca9-a470-b369e2aedc10 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Image pref 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 16:00:07 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-7eefda50-4ec2-4ca9-a470-b369e2aedc10 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 16:00:07 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-7eefda50-4ec2-4ca9-a470-b369e2aedc10 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 16:00:07 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-7eefda50-4ec2-4ca9-a470-b369e2aedc10 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 16:00:07 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-7eefda50-4ec2-4ca9-a470-b369e2aedc10 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Got 1 possible topologies {{(pid=71874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 16:00:07 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-7eefda50-4ec2-4ca9-a470-b369e2aedc10 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 16:00:07 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-7eefda50-4ec2-4ca9-a470-b369e2aedc10 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 16:00:07 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-7eefda50-4ec2-4ca9-a470-b369e2aedc10 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T15:59:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1426192575',display_name='tempest-TestVolumeSwap-server-1426192575',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1426192575',id=8,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF1Wd2ociOIFyjLM0vn+nY1bwPOFKVzmKcdhIhfpYlk3fUbGjg3MnW5Ty147Fnic93nKiDzHzxGNd6ERR69ZW9ZlfleRTXR5NIDgI9vygcdWTL7ncaqq0O00R7QkB5KROw==',key_name='tempest-keypair-1069057277',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5a8e21d4dae04fd08951f8306cff0624',ramdisk_id='',reservation_id='r-4jpqp070',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-432048888',owner_user_name='tempest-TestVolumeSwap-432048888-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T16:00:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d2e5f900d0b144f9942de733017fb396',uuid=e85aa869-0d2a-40ff-9697-f979a6b110cb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0db939d7-60c3-48af-8d8d-0f5528f41bb6", "address": "fa:16:3e:c9:39:5d", "network": {"id": "1316768e-1461-4bd9-b6df-2a43928b62b2", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1176895361-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a8e21d4dae04fd08951f8306cff0624", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0db939d7-60", "ovs_interfaceid": "0db939d7-60c3-48af-8d8d-0f5528f41bb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 16:00:07 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-7eefda50-4ec2-4ca9-a470-b369e2aedc10 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Converting VIF {"id": "0db939d7-60c3-48af-8d8d-0f5528f41bb6", "address": "fa:16:3e:c9:39:5d", "network": {"id": "1316768e-1461-4bd9-b6df-2a43928b62b2", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1176895361-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a8e21d4dae04fd08951f8306cff0624", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0db939d7-60", "ovs_interfaceid": "0db939d7-60c3-48af-8d8d-0f5528f41bb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:00:07 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-7eefda50-4ec2-4ca9-a470-b369e2aedc10 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:39:5d,bridge_name='br-int',has_traffic_filtering=True,id=0db939d7-60c3-48af-8d8d-0f5528f41bb6,network=Network(1316768e-1461-4bd9-b6df-2a43928b62b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0db939d7-60') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:00:07 user nova-compute[71874]: DEBUG nova.objects.instance [None req-7eefda50-4ec2-4ca9-a470-b369e2aedc10 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Lazy-loading 'pci_devices' on Instance uuid e85aa869-0d2a-40ff-9697-f979a6b110cb {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:00:07 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-7eefda50-4ec2-4ca9-a470-b369e2aedc10 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] [instance: e85aa869-0d2a-40ff-9697-f979a6b110cb] End _get_guest_xml xml=<domain type="kvm">
Apr 12 16:00:07 user nova-compute[71874]:   <uuid>e85aa869-0d2a-40ff-9697-f979a6b110cb</uuid>
Apr 12 16:00:07 user nova-compute[71874]:   <name>instance-00000008</name>
Apr 12 16:00:07 user nova-compute[71874]:   <memory>131072</memory>
Apr 12 16:00:07 user nova-compute[71874]:   <vcpu>1</vcpu>
Apr 12 16:00:07 user nova-compute[71874]:   <metadata>
Apr 12 16:00:07 user nova-compute[71874]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 16:00:07 user nova-compute[71874]:       <nova:package version="0.0.0"/>
Apr 12 16:00:07 user nova-compute[71874]:       <nova:name>tempest-TestVolumeSwap-server-1426192575</nova:name>
Apr 12 16:00:07 user nova-compute[71874]:       <nova:creationTime>2023-04-12 16:00:07</nova:creationTime>
Apr 12 16:00:07 user nova-compute[71874]:       <nova:flavor name="m1.nano">
Apr 12 16:00:07 user nova-compute[71874]:         <nova:memory>128</nova:memory>
Apr 12 16:00:07 user nova-compute[71874]:         <nova:disk>1</nova:disk>
Apr 12 16:00:07 user nova-compute[71874]:         <nova:swap>0</nova:swap>
Apr 12 16:00:07 user nova-compute[71874]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 16:00:07 user nova-compute[71874]:         <nova:vcpus>1</nova:vcpus>
Apr 12 16:00:07 user nova-compute[71874]:       </nova:flavor>
Apr 12 16:00:07 user nova-compute[71874]:       <nova:owner>
Apr 12 16:00:07 user nova-compute[71874]:         <nova:user uuid="d2e5f900d0b144f9942de733017fb396">tempest-TestVolumeSwap-432048888-project-member</nova:user>
Apr 12 16:00:07 user nova-compute[71874]:         <nova:project uuid="5a8e21d4dae04fd08951f8306cff0624">tempest-TestVolumeSwap-432048888</nova:project>
Apr 12 16:00:07 user nova-compute[71874]:       </nova:owner>
Apr 12 16:00:07 user nova-compute[71874]:       <nova:root type="image" uuid="9dc63f14-8b70-4e72-89f2-13464f2f5c7c"/>
Apr 12 16:00:07 user nova-compute[71874]:       <nova:ports>
Apr 12 16:00:07 user nova-compute[71874]:         <nova:port uuid="0db939d7-60c3-48af-8d8d-0f5528f41bb6">
Apr 12 16:00:07 user nova-compute[71874]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Apr 12 16:00:07 user nova-compute[71874]:         </nova:port>
Apr 12 16:00:07 user nova-compute[71874]:       </nova:ports>
Apr 12 16:00:07 user nova-compute[71874]:     </nova:instance>
Apr 12 16:00:07 user nova-compute[71874]:   </metadata>
Apr 12 16:00:07 user nova-compute[71874]:   <sysinfo type="smbios">
Apr 12 16:00:07 user nova-compute[71874]:     <system>
Apr 12 16:00:07 user nova-compute[71874]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 16:00:07 user nova-compute[71874]:       <entry name="product">OpenStack Nova</entry>
Apr 12 16:00:07 user nova-compute[71874]:       <entry name="version">0.0.0</entry>
Apr 12 16:00:07 user nova-compute[71874]:       <entry name="serial">e85aa869-0d2a-40ff-9697-f979a6b110cb</entry>
Apr 12 16:00:07 user nova-compute[71874]:       <entry name="uuid">e85aa869-0d2a-40ff-9697-f979a6b110cb</entry>
Apr 12 16:00:07 user nova-compute[71874]:       <entry name="family">Virtual Machine</entry>
Apr 12 16:00:07 user nova-compute[71874]:     </system>
Apr 12 16:00:07 user nova-compute[71874]:   </sysinfo>
Apr 12 16:00:07 user nova-compute[71874]:   <os>
Apr 12 16:00:07 user nova-compute[71874]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 16:00:07 user nova-compute[71874]:     <boot dev="hd"/>
Apr 12 16:00:07 user nova-compute[71874]:     <smbios mode="sysinfo"/>
Apr 12 16:00:07 user nova-compute[71874]:   </os>
Apr 12 16:00:07 user nova-compute[71874]:   <features>
Apr 12 16:00:07 user nova-compute[71874]:     <acpi/>
Apr 12 16:00:07 user nova-compute[71874]:     <apic/>
Apr 12 16:00:07 user nova-compute[71874]:     <vmcoreinfo/>
Apr 12 16:00:07 user nova-compute[71874]:   </features>
Apr 12 16:00:07 user nova-compute[71874]:   <clock offset="utc">
Apr 12 16:00:07 user nova-compute[71874]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 16:00:07 user nova-compute[71874]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 16:00:07 user nova-compute[71874]:     <timer name="hpet" present="no"/>
Apr 12 16:00:07 user nova-compute[71874]:   </clock>
Apr 12 16:00:07 user nova-compute[71874]:   <cpu mode="custom" match="exact">
Apr 12 16:00:07 user nova-compute[71874]:     <model>Nehalem</model>
Apr 12 16:00:07 user nova-compute[71874]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 16:00:07 user nova-compute[71874]:   </cpu>
Apr 12 16:00:07 user nova-compute[71874]:   <devices>
Apr 12 16:00:07 user nova-compute[71874]:     <disk type="file" device="disk">
Apr 12 16:00:07 user nova-compute[71874]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 16:00:07 user nova-compute[71874]:       <source file="/opt/stack/data/nova/instances/e85aa869-0d2a-40ff-9697-f979a6b110cb/disk"/>
Apr 12 16:00:07 user nova-compute[71874]:       <target dev="vda" bus="virtio"/>
Apr 12 16:00:07 user nova-compute[71874]:     </disk>
Apr 12 16:00:07 user nova-compute[71874]:     <interface type="ethernet">
Apr 12 16:00:07 user nova-compute[71874]:       <mac address="fa:16:3e:c9:39:5d"/>
Apr 12 16:00:07 user nova-compute[71874]:       <model type="virtio"/>
Apr 12 16:00:07 user nova-compute[71874]:       <mtu size="1442"/>
Apr 12 16:00:07 user nova-compute[71874]:       <target dev="tap0db939d7-60"/>
Apr 12 16:00:07 user nova-compute[71874]:     </interface>
Apr 12 16:00:07 user nova-compute[71874]:     <serial type="pty">
Apr 12 16:00:07 user nova-compute[71874]:       <log file="/opt/stack/data/nova/instances/e85aa869-0d2a-40ff-9697-f979a6b110cb/console.log" append="off"/>
Apr 12 16:00:07 user nova-compute[71874]:     </serial>
Apr 12 16:00:07 user nova-compute[71874]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 16:00:07 user nova-compute[71874]:     <video>
Apr 12 16:00:07 user nova-compute[71874]:       <model type="virtio"/>
Apr 12 16:00:07 user nova-compute[71874]:     </video>
Apr 12 16:00:07 user nova-compute[71874]:     <rng model="virtio">
Apr 12 16:00:07 user nova-compute[71874]:       <backend model="random">/dev/urandom</backend>
Apr 12 16:00:07 user nova-compute[71874]:     </rng>
Apr 12 16:00:07 user nova-compute[71874]:     <controller type="usb" index="0" model="none"/>
Apr 12 16:00:07 user nova-compute[71874]:     <memballoon model="virtio">
Apr 12 16:00:07 user nova-compute[71874]:       <stats period="10"/>
Apr 12 16:00:07 user nova-compute[71874]:     </memballoon>
Apr 12 16:00:07 user nova-compute[71874]:   </devices>
Apr 12 16:00:07 user nova-compute[71874]: </domain>
Apr 12 16:00:07 user nova-compute[71874]:  {{(pid=71874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 16:00:07 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-7eefda50-4ec2-4ca9-a470-b369e2aedc10 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T15:59:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1426192575',display_name='tempest-TestVolumeSwap-server-1426192575',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1426192575',id=8,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF1Wd2ociOIFyjLM0vn+nY1bwPOFKVzmKcdhIhfpYlk3fUbGjg3MnW5Ty147Fnic93nKiDzHzxGNd6ERR69ZW9ZlfleRTXR5NIDgI9vygcdWTL7ncaqq0O00R7QkB5KROw==',key_name='tempest-keypair-1069057277',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5a8e21d4dae04fd08951f8306cff0624',ramdisk_id='',reservation_id='r-4jpqp070',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-432048888',owner_user_name='tempest-TestVolumeSwap-432048888-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T16:00:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d2e5f900d0b144f9942de733017fb396',uuid=e85aa869-0d2a-40ff-9697-f979a6b110cb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0db939d7-60c3-48af-8d8d-0f5528f41bb6", "address": "fa:16:3e:c9:39:5d", "network": {"id": "1316768e-1461-4bd9-b6df-2a43928b62b2", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1176895361-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a8e21d4dae04fd08951f8306cff0624", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0db939d7-60", "ovs_interfaceid": "0db939d7-60c3-48af-8d8d-0f5528f41bb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 16:00:07 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-7eefda50-4ec2-4ca9-a470-b369e2aedc10 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Converting VIF {"id": "0db939d7-60c3-48af-8d8d-0f5528f41bb6", "address": "fa:16:3e:c9:39:5d", "network": {"id": "1316768e-1461-4bd9-b6df-2a43928b62b2", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1176895361-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a8e21d4dae04fd08951f8306cff0624", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0db939d7-60", "ovs_interfaceid": "0db939d7-60c3-48af-8d8d-0f5528f41bb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:00:07 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-7eefda50-4ec2-4ca9-a470-b369e2aedc10 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:39:5d,bridge_name='br-int',has_traffic_filtering=True,id=0db939d7-60c3-48af-8d8d-0f5528f41bb6,network=Network(1316768e-1461-4bd9-b6df-2a43928b62b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0db939d7-60') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:00:07 user nova-compute[71874]: DEBUG os_vif [None req-7eefda50-4ec2-4ca9-a470-b369e2aedc10 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:39:5d,bridge_name='br-int',has_traffic_filtering=True,id=0db939d7-60c3-48af-8d8d-0f5528f41bb6,network=Network(1316768e-1461-4bd9-b6df-2a43928b62b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0db939d7-60') {{(pid=71874) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 16:00:07 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:07 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:00:07 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 16:00:07 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:07 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0db939d7-60, may_exist=True) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:00:07 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0db939d7-60, col_values=(('external_ids', {'iface-id': '0db939d7-60c3-48af-8d8d-0f5528f41bb6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c9:39:5d', 'vm-uuid': 'e85aa869-0d2a-40ff-9697-f979a6b110cb'}),)) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:00:07 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:07 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:00:07 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:07 user nova-compute[71874]: INFO os_vif [None req-7eefda50-4ec2-4ca9-a470-b369e2aedc10 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:39:5d,bridge_name='br-int',has_traffic_filtering=True,id=0db939d7-60c3-48af-8d8d-0f5528f41bb6,network=Network(1316768e-1461-4bd9-b6df-2a43928b62b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0db939d7-60')
Apr 12 16:00:07 user nova-compute[71874]: DEBUG nova.network.neutron [None req-86a55a41-b7cc-416d-b059-dc8294942a87 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] [instance: 6614f2c0-399b-43d2-86c9-5790c57575e9] Successfully updated port: f1aab2a2-67f1-4ec5-9aeb-dffdec2170e3 {{(pid=71874) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 16:00:07 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-7eefda50-4ec2-4ca9-a470-b369e2aedc10 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] No BDM found with device name vda, not building metadata. {{(pid=71874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 16:00:07 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-7eefda50-4ec2-4ca9-a470-b369e2aedc10 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] No VIF found with MAC fa:16:3e:c9:39:5d, not building metadata {{(pid=71874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 16:00:07 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-86a55a41-b7cc-416d-b059-dc8294942a87 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Acquiring lock "refresh_cache-6614f2c0-399b-43d2-86c9-5790c57575e9" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:00:07 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-86a55a41-b7cc-416d-b059-dc8294942a87 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Acquired lock "refresh_cache-6614f2c0-399b-43d2-86c9-5790c57575e9" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:00:07 user nova-compute[71874]: DEBUG nova.network.neutron [None req-86a55a41-b7cc-416d-b059-dc8294942a87 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] [instance: 6614f2c0-399b-43d2-86c9-5790c57575e9] Building network info cache for instance {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 16:00:07 user nova-compute[71874]: DEBUG nova.network.neutron [None req-86a55a41-b7cc-416d-b059-dc8294942a87 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] [instance: 6614f2c0-399b-43d2-86c9-5790c57575e9] Instance cache missing network info. {{(pid=71874) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 16:00:07 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:07 user nova-compute[71874]: DEBUG nova.compute.manager [req-e64e6da2-e4f6-454d-98be-84131265e580 req-46b4fbce-e373-4928-8c4c-3c454c8993cc service nova] [instance: 6614f2c0-399b-43d2-86c9-5790c57575e9] Received event network-changed-f1aab2a2-67f1-4ec5-9aeb-dffdec2170e3 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:00:07 user nova-compute[71874]: DEBUG nova.compute.manager [req-e64e6da2-e4f6-454d-98be-84131265e580 req-46b4fbce-e373-4928-8c4c-3c454c8993cc service nova] [instance: 6614f2c0-399b-43d2-86c9-5790c57575e9] Refreshing instance network info cache due to event network-changed-f1aab2a2-67f1-4ec5-9aeb-dffdec2170e3. {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 16:00:07 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-e64e6da2-e4f6-454d-98be-84131265e580 req-46b4fbce-e373-4928-8c4c-3c454c8993cc service nova] Acquiring lock "refresh_cache-6614f2c0-399b-43d2-86c9-5790c57575e9" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:00:07 user nova-compute[71874]: DEBUG nova.network.neutron [None req-86a55a41-b7cc-416d-b059-dc8294942a87 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] [instance: 6614f2c0-399b-43d2-86c9-5790c57575e9] Updating instance_info_cache with network_info: [{"id": "f1aab2a2-67f1-4ec5-9aeb-dffdec2170e3", "address": "fa:16:3e:75:cb:77", "network": {"id": "f4226065-ecee-4c2b-bbaa-df0406d0d0f6", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1167048120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "672dcb2ce6454ab4aeae3de7550ca8e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1aab2a2-67", "ovs_interfaceid": "f1aab2a2-67f1-4ec5-9aeb-dffdec2170e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:00:07 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-86a55a41-b7cc-416d-b059-dc8294942a87 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Releasing lock "refresh_cache-6614f2c0-399b-43d2-86c9-5790c57575e9" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:00:07 user nova-compute[71874]: DEBUG nova.compute.manager [None req-86a55a41-b7cc-416d-b059-dc8294942a87 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] [instance: 6614f2c0-399b-43d2-86c9-5790c57575e9] Instance network_info: |[{"id": "f1aab2a2-67f1-4ec5-9aeb-dffdec2170e3", "address": "fa:16:3e:75:cb:77", "network": {"id": "f4226065-ecee-4c2b-bbaa-df0406d0d0f6", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1167048120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "672dcb2ce6454ab4aeae3de7550ca8e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1aab2a2-67", "ovs_interfaceid": "f1aab2a2-67f1-4ec5-9aeb-dffdec2170e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 16:00:07 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-e64e6da2-e4f6-454d-98be-84131265e580 req-46b4fbce-e373-4928-8c4c-3c454c8993cc service nova] Acquired lock "refresh_cache-6614f2c0-399b-43d2-86c9-5790c57575e9" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:00:07 user nova-compute[71874]: DEBUG nova.network.neutron [req-e64e6da2-e4f6-454d-98be-84131265e580 req-46b4fbce-e373-4928-8c4c-3c454c8993cc service nova] [instance: 6614f2c0-399b-43d2-86c9-5790c57575e9] Refreshing network info cache for port f1aab2a2-67f1-4ec5-9aeb-dffdec2170e3 {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 16:00:07 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-86a55a41-b7cc-416d-b059-dc8294942a87 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] [instance: 6614f2c0-399b-43d2-86c9-5790c57575e9] Start _get_guest_xml network_info=[{"id": "f1aab2a2-67f1-4ec5-9aeb-dffdec2170e3", "address": "fa:16:3e:75:cb:77", "network": {"id": "f4226065-ecee-4c2b-bbaa-df0406d0d0f6", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1167048120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "672dcb2ce6454ab4aeae3de7550ca8e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1aab2a2-67", "ovs_interfaceid": "f1aab2a2-67f1-4ec5-9aeb-dffdec2170e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T15:59:56Z,direct_url=<?>,disk_format='qcow2',id=bfacce9c-c119-4e9b-9797-bddc83436fec,min_disk=0,min_ram=0,name='',owner='a0676e674cd8405b940afac8d077deb5',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T15:59:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/sda', 'device_type': 'disk', 'disk_bus': 'scsi', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_options': None, 'image_id': 'bfacce9c-c119-4e9b-9797-bddc83436fec'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 16:00:07 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-86a55a41-b7cc-416d-b059-dc8294942a87 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:00:07 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-86a55a41-b7cc-416d-b059-dc8294942a87 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:00:07 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-86a55a41-b7cc-416d-b059-dc8294942a87 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71874) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 16:00:07 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-86a55a41-b7cc-416d-b059-dc8294942a87 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T15:56:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T15:59:56Z,direct_url=<?>,disk_format='qcow2',id=bfacce9c-c119-4e9b-9797-bddc83436fec,min_disk=0,min_ram=0,name='',owner='a0676e674cd8405b940afac8d077deb5',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T15:59:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 16:00:07 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-86a55a41-b7cc-416d-b059-dc8294942a87 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Flavor limits 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 16:00:07 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-86a55a41-b7cc-416d-b059-dc8294942a87 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Image limits 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 16:00:07 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-86a55a41-b7cc-416d-b059-dc8294942a87 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Flavor pref 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 16:00:07 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-86a55a41-b7cc-416d-b059-dc8294942a87 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Image pref 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 16:00:07 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-86a55a41-b7cc-416d-b059-dc8294942a87 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 16:00:07 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-86a55a41-b7cc-416d-b059-dc8294942a87 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 16:00:07 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-86a55a41-b7cc-416d-b059-dc8294942a87 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 16:00:07 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-86a55a41-b7cc-416d-b059-dc8294942a87 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Got 1 possible topologies {{(pid=71874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 16:00:07 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-86a55a41-b7cc-416d-b059-dc8294942a87 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 16:00:07 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-86a55a41-b7cc-416d-b059-dc8294942a87 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 16:00:07 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-86a55a41-b7cc-416d-b059-dc8294942a87 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T16:00:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-179674331',display_name='tempest-AttachSCSIVolumeTestJSON-server-179674331',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-179674331',id=9,image_ref='bfacce9c-c119-4e9b-9797-bddc83436fec',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO19lsCNGEgoB2HHAQYuTR3Xz/r7iAXIlSkC7qzeVq0k3Wmxoc0KYdp4AolUci+hjmn40whJ+Pl38vCo+I61Aw/7to0Te/LrgRb9gUOAeMD8WGVk+4AtHE5vS4Vk7211aA==',key_name='tempest-keypair-393786',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='672dcb2ce6454ab4aeae3de7550ca8e0',ramdisk_id='',reservation_id='r-dumsxd1w',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfacce9c-c119-4e9b-9797-bddc83436fec',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-526027473',owner_user_name='tempest-AttachSCSIVolumeTestJSON-526027473-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T16:00:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='16ff4a8d98bc4dfa85f0f7d9c0fcebea',uuid=6614f2c0-399b-43d2-86c9-5790c57575e9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f1aab2a2-67f1-4ec5-9aeb-dffdec2170e3", "address": "fa:16:3e:75:cb:77", "network": {"id": "f4226065-ecee-4c2b-bbaa-df0406d0d0f6", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1167048120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "672dcb2ce6454ab4aeae3de7550ca8e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1aab2a2-67", "ovs_interfaceid": "f1aab2a2-67f1-4ec5-9aeb-dffdec2170e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 16:00:07 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-86a55a41-b7cc-416d-b059-dc8294942a87 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Converting VIF {"id": "f1aab2a2-67f1-4ec5-9aeb-dffdec2170e3", "address": "fa:16:3e:75:cb:77", "network": {"id": "f4226065-ecee-4c2b-bbaa-df0406d0d0f6", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1167048120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "672dcb2ce6454ab4aeae3de7550ca8e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1aab2a2-67", "ovs_interfaceid": "f1aab2a2-67f1-4ec5-9aeb-dffdec2170e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:00:07 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-86a55a41-b7cc-416d-b059-dc8294942a87 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:cb:77,bridge_name='br-int',has_traffic_filtering=True,id=f1aab2a2-67f1-4ec5-9aeb-dffdec2170e3,network=Network(f4226065-ecee-4c2b-bbaa-df0406d0d0f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1aab2a2-67') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:00:07 user nova-compute[71874]: DEBUG nova.objects.instance [None req-86a55a41-b7cc-416d-b059-dc8294942a87 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Lazy-loading 'pci_devices' on Instance uuid 6614f2c0-399b-43d2-86c9-5790c57575e9 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:00:07 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-86a55a41-b7cc-416d-b059-dc8294942a87 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] [instance: 6614f2c0-399b-43d2-86c9-5790c57575e9] End _get_guest_xml xml=<domain type="kvm">
Apr 12 16:00:07 user nova-compute[71874]:   <uuid>6614f2c0-399b-43d2-86c9-5790c57575e9</uuid>
Apr 12 16:00:07 user nova-compute[71874]:   <name>instance-00000009</name>
Apr 12 16:00:07 user nova-compute[71874]:   <memory>131072</memory>
Apr 12 16:00:07 user nova-compute[71874]:   <vcpu>1</vcpu>
Apr 12 16:00:07 user nova-compute[71874]:   <metadata>
Apr 12 16:00:07 user nova-compute[71874]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 16:00:07 user nova-compute[71874]:       <nova:package version="0.0.0"/>
Apr 12 16:00:07 user nova-compute[71874]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-179674331</nova:name>
Apr 12 16:00:07 user nova-compute[71874]:       <nova:creationTime>2023-04-12 16:00:07</nova:creationTime>
Apr 12 16:00:07 user nova-compute[71874]:       <nova:flavor name="m1.nano">
Apr 12 16:00:07 user nova-compute[71874]:         <nova:memory>128</nova:memory>
Apr 12 16:00:07 user nova-compute[71874]:         <nova:disk>1</nova:disk>
Apr 12 16:00:07 user nova-compute[71874]:         <nova:swap>0</nova:swap>
Apr 12 16:00:07 user nova-compute[71874]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 16:00:07 user nova-compute[71874]:         <nova:vcpus>1</nova:vcpus>
Apr 12 16:00:07 user nova-compute[71874]:       </nova:flavor>
Apr 12 16:00:07 user nova-compute[71874]:       <nova:owner>
Apr 12 16:00:07 user nova-compute[71874]:         <nova:user uuid="16ff4a8d98bc4dfa85f0f7d9c0fcebea">tempest-AttachSCSIVolumeTestJSON-526027473-project-member</nova:user>
Apr 12 16:00:07 user nova-compute[71874]:         <nova:project uuid="672dcb2ce6454ab4aeae3de7550ca8e0">tempest-AttachSCSIVolumeTestJSON-526027473</nova:project>
Apr 12 16:00:07 user nova-compute[71874]:       </nova:owner>
Apr 12 16:00:07 user nova-compute[71874]:       <nova:root type="image" uuid="bfacce9c-c119-4e9b-9797-bddc83436fec"/>
Apr 12 16:00:07 user nova-compute[71874]:       <nova:ports>
Apr 12 16:00:07 user nova-compute[71874]:         <nova:port uuid="f1aab2a2-67f1-4ec5-9aeb-dffdec2170e3">
Apr 12 16:00:07 user nova-compute[71874]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 12 16:00:07 user nova-compute[71874]:         </nova:port>
Apr 12 16:00:07 user nova-compute[71874]:       </nova:ports>
Apr 12 16:00:07 user nova-compute[71874]:     </nova:instance>
Apr 12 16:00:07 user nova-compute[71874]:   </metadata>
Apr 12 16:00:07 user nova-compute[71874]:   <sysinfo type="smbios">
Apr 12 16:00:07 user nova-compute[71874]:     <system>
Apr 12 16:00:07 user nova-compute[71874]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 16:00:07 user nova-compute[71874]:       <entry name="product">OpenStack Nova</entry>
Apr 12 16:00:07 user nova-compute[71874]:       <entry name="version">0.0.0</entry>
Apr 12 16:00:07 user nova-compute[71874]:       <entry name="serial">6614f2c0-399b-43d2-86c9-5790c57575e9</entry>
Apr 12 16:00:07 user nova-compute[71874]:       <entry name="uuid">6614f2c0-399b-43d2-86c9-5790c57575e9</entry>
Apr 12 16:00:07 user nova-compute[71874]:       <entry name="family">Virtual Machine</entry>
Apr 12 16:00:07 user nova-compute[71874]:     </system>
Apr 12 16:00:07 user nova-compute[71874]:   </sysinfo>
Apr 12 16:00:07 user nova-compute[71874]:   <os>
Apr 12 16:00:07 user nova-compute[71874]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 16:00:07 user nova-compute[71874]:     <boot dev="hd"/>
Apr 12 16:00:07 user nova-compute[71874]:     <smbios mode="sysinfo"/>
Apr 12 16:00:07 user nova-compute[71874]:   </os>
Apr 12 16:00:07 user nova-compute[71874]:   <features>
Apr 12 16:00:07 user nova-compute[71874]:     <acpi/>
Apr 12 16:00:07 user nova-compute[71874]:     <apic/>
Apr 12 16:00:07 user nova-compute[71874]:     <vmcoreinfo/>
Apr 12 16:00:07 user nova-compute[71874]:   </features>
Apr 12 16:00:07 user nova-compute[71874]:   <clock offset="utc">
Apr 12 16:00:07 user nova-compute[71874]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 16:00:07 user nova-compute[71874]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 16:00:07 user nova-compute[71874]:     <timer name="hpet" present="no"/>
Apr 12 16:00:07 user nova-compute[71874]:   </clock>
Apr 12 16:00:07 user nova-compute[71874]:   <cpu mode="custom" match="exact">
Apr 12 16:00:07 user nova-compute[71874]:     <model>Nehalem</model>
Apr 12 16:00:07 user nova-compute[71874]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 16:00:07 user nova-compute[71874]:   </cpu>
Apr 12 16:00:07 user nova-compute[71874]:   <devices>
Apr 12 16:00:07 user nova-compute[71874]:     <disk type="file" device="disk">
Apr 12 16:00:07 user nova-compute[71874]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 16:00:07 user nova-compute[71874]:       <source file="/opt/stack/data/nova/instances/6614f2c0-399b-43d2-86c9-5790c57575e9/disk"/>
Apr 12 16:00:07 user nova-compute[71874]:       <target dev="sda" bus="scsi"/>
Apr 12 16:00:07 user nova-compute[71874]:       <address type="drive" controller="0" unit="0"/>
Apr 12 16:00:07 user nova-compute[71874]:     </disk>
Apr 12 16:00:07 user nova-compute[71874]:     <disk type="file" device="cdrom">
Apr 12 16:00:07 user nova-compute[71874]:       <driver name="qemu" type="raw" cache="none"/>
Apr 12 16:00:07 user nova-compute[71874]:       <source file="/opt/stack/data/nova/instances/6614f2c0-399b-43d2-86c9-5790c57575e9/disk.config"/>
Apr 12 16:00:07 user nova-compute[71874]:       <target dev="sdb" bus="scsi"/>
Apr 12 16:00:07 user nova-compute[71874]:       <address type="drive" controller="0" unit="1"/>
Apr 12 16:00:07 user nova-compute[71874]:     </disk>
Apr 12 16:00:07 user nova-compute[71874]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Apr 12 16:00:07 user nova-compute[71874]:     <interface type="ethernet">
Apr 12 16:00:07 user nova-compute[71874]:       <mac address="fa:16:3e:75:cb:77"/>
Apr 12 16:00:07 user nova-compute[71874]:       <model type="virtio"/>
Apr 12 16:00:07 user nova-compute[71874]:       <mtu size="1442"/>
Apr 12 16:00:07 user nova-compute[71874]:       <target dev="tapf1aab2a2-67"/>
Apr 12 16:00:07 user nova-compute[71874]:     </interface>
Apr 12 16:00:07 user nova-compute[71874]:     <serial type="pty">
Apr 12 16:00:07 user nova-compute[71874]:       <log file="/opt/stack/data/nova/instances/6614f2c0-399b-43d2-86c9-5790c57575e9/console.log" append="off"/>
Apr 12 16:00:07 user nova-compute[71874]:     </serial>
Apr 12 16:00:07 user nova-compute[71874]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 16:00:07 user nova-compute[71874]:     <video>
Apr 12 16:00:07 user nova-compute[71874]:       <model type="virtio"/>
Apr 12 16:00:07 user nova-compute[71874]:     </video>
Apr 12 16:00:07 user nova-compute[71874]:     <rng model="virtio">
Apr 12 16:00:07 user nova-compute[71874]:       <backend model="random">/dev/urandom</backend>
Apr 12 16:00:07 user nova-compute[71874]:     </rng>
Apr 12 16:00:07 user nova-compute[71874]:     <controller type="usb" index="0" model="none"/>
Apr 12 16:00:07 user nova-compute[71874]:     <memballoon model="virtio">
Apr 12 16:00:07 user nova-compute[71874]:       <stats period="10"/>
Apr 12 16:00:07 user nova-compute[71874]:     </memballoon>
Apr 12 16:00:07 user nova-compute[71874]:   </devices>
Apr 12 16:00:07 user nova-compute[71874]: </domain>
Apr 12 16:00:07 user nova-compute[71874]:  {{(pid=71874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 16:00:07 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-86a55a41-b7cc-416d-b059-dc8294942a87 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T16:00:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-179674331',display_name='tempest-AttachSCSIVolumeTestJSON-server-179674331',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-179674331',id=9,image_ref='bfacce9c-c119-4e9b-9797-bddc83436fec',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO19lsCNGEgoB2HHAQYuTR3Xz/r7iAXIlSkC7qzeVq0k3Wmxoc0KYdp4AolUci+hjmn40whJ+Pl38vCo+I61Aw/7to0Te/LrgRb9gUOAeMD8WGVk+4AtHE5vS4Vk7211aA==',key_name='tempest-keypair-393786',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='672dcb2ce6454ab4aeae3de7550ca8e0',ramdisk_id='',reservation_id='r-dumsxd1w',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfacce9c-c119-4e9b-9797-bddc83436fec',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-526027473',owner_user_name='tempest-AttachSCSIVolumeTestJSON-526027473-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T16:00:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='16ff4a8d98bc4dfa85f0f7d9c0fcebea',uuid=6614f2c0-399b-43d2-86c9-5790c57575e9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f1aab2a2-67f1-4ec5-9aeb-dffdec2170e3", "address": "fa:16:3e:75:cb:77", "network": {"id": "f4226065-ecee-4c2b-bbaa-df0406d0d0f6", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1167048120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "672dcb2ce6454ab4aeae3de7550ca8e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1aab2a2-67", "ovs_interfaceid": "f1aab2a2-67f1-4ec5-9aeb-dffdec2170e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 16:00:07 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-86a55a41-b7cc-416d-b059-dc8294942a87 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Converting VIF {"id": "f1aab2a2-67f1-4ec5-9aeb-dffdec2170e3", "address": "fa:16:3e:75:cb:77", "network": {"id": "f4226065-ecee-4c2b-bbaa-df0406d0d0f6", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1167048120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "672dcb2ce6454ab4aeae3de7550ca8e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1aab2a2-67", "ovs_interfaceid": "f1aab2a2-67f1-4ec5-9aeb-dffdec2170e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:00:07 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-86a55a41-b7cc-416d-b059-dc8294942a87 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:cb:77,bridge_name='br-int',has_traffic_filtering=True,id=f1aab2a2-67f1-4ec5-9aeb-dffdec2170e3,network=Network(f4226065-ecee-4c2b-bbaa-df0406d0d0f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1aab2a2-67') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:00:07 user nova-compute[71874]: DEBUG os_vif [None req-86a55a41-b7cc-416d-b059-dc8294942a87 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:cb:77,bridge_name='br-int',has_traffic_filtering=True,id=f1aab2a2-67f1-4ec5-9aeb-dffdec2170e3,network=Network(f4226065-ecee-4c2b-bbaa-df0406d0d0f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1aab2a2-67') {{(pid=71874) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 16:00:07 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:07 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:00:07 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 16:00:07 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:07 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf1aab2a2-67, may_exist=True) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:00:07 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf1aab2a2-67, col_values=(('external_ids', {'iface-id': 'f1aab2a2-67f1-4ec5-9aeb-dffdec2170e3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:75:cb:77', 'vm-uuid': '6614f2c0-399b-43d2-86c9-5790c57575e9'}),)) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:00:07 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:07 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:00:07 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:07 user nova-compute[71874]: INFO os_vif [None req-86a55a41-b7cc-416d-b059-dc8294942a87 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:cb:77,bridge_name='br-int',has_traffic_filtering=True,id=f1aab2a2-67f1-4ec5-9aeb-dffdec2170e3,network=Network(f4226065-ecee-4c2b-bbaa-df0406d0d0f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1aab2a2-67')
Apr 12 16:00:08 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-86a55a41-b7cc-416d-b059-dc8294942a87 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] No BDM found with device name sda, not building metadata. {{(pid=71874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 16:00:08 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-86a55a41-b7cc-416d-b059-dc8294942a87 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] No BDM found with device name sdb, not building metadata. {{(pid=71874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 16:00:08 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-86a55a41-b7cc-416d-b059-dc8294942a87 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] No VIF found with MAC fa:16:3e:75:cb:77, not building metadata {{(pid=71874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 16:00:08 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-86a55a41-b7cc-416d-b059-dc8294942a87 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] [instance: 6614f2c0-399b-43d2-86c9-5790c57575e9] Using config drive
Apr 12 16:00:08 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-86a55a41-b7cc-416d-b059-dc8294942a87 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] [instance: 6614f2c0-399b-43d2-86c9-5790c57575e9] Creating config drive at /opt/stack/data/nova/instances/6614f2c0-399b-43d2-86c9-5790c57575e9/disk.config
Apr 12 16:00:08 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-86a55a41-b7cc-416d-b059-dc8294942a87 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/6614f2c0-399b-43d2-86c9-5790c57575e9/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp6dff2fs5 {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:08 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-86a55a41-b7cc-416d-b059-dc8294942a87 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/6614f2c0-399b-43d2-86c9-5790c57575e9/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp6dff2fs5" returned: 0 in 0.059s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:00:08 user nova-compute[71874]: DEBUG nova.network.neutron [req-e64e6da2-e4f6-454d-98be-84131265e580 req-46b4fbce-e373-4928-8c4c-3c454c8993cc service nova] [instance: 6614f2c0-399b-43d2-86c9-5790c57575e9] Updated VIF entry in instance network info cache for port f1aab2a2-67f1-4ec5-9aeb-dffdec2170e3. {{(pid=71874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 16:00:08 user nova-compute[71874]: DEBUG nova.network.neutron [req-e64e6da2-e4f6-454d-98be-84131265e580 req-46b4fbce-e373-4928-8c4c-3c454c8993cc service nova] [instance: 6614f2c0-399b-43d2-86c9-5790c57575e9] Updating instance_info_cache with network_info: [{"id": "f1aab2a2-67f1-4ec5-9aeb-dffdec2170e3", "address": "fa:16:3e:75:cb:77", "network": {"id": "f4226065-ecee-4c2b-bbaa-df0406d0d0f6", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1167048120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "672dcb2ce6454ab4aeae3de7550ca8e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1aab2a2-67", "ovs_interfaceid": "f1aab2a2-67f1-4ec5-9aeb-dffdec2170e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:00:08 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-e64e6da2-e4f6-454d-98be-84131265e580 req-46b4fbce-e373-4928-8c4c-3c454c8993cc service nova] Releasing lock "refresh_cache-6614f2c0-399b-43d2-86c9-5790c57575e9" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:00:09 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:00:09 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Cleaning up deleted instances {{(pid=71874) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 12 16:00:09 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:09 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] There are 0 instances to clean {{(pid=71874) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 12 16:00:09 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:00:09 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71874) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 12 16:00:09 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:00:09 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:09 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:09 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:10 user nova-compute[71874]: DEBUG nova.compute.manager [req-fbbf2312-bcc5-4831-84fa-cac54893b314 req-e4841de1-9015-4346-83cb-24f886b80677 service nova] [instance: e85aa869-0d2a-40ff-9697-f979a6b110cb] Received event network-vif-plugged-0db939d7-60c3-48af-8d8d-0f5528f41bb6 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:00:10 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-fbbf2312-bcc5-4831-84fa-cac54893b314 req-e4841de1-9015-4346-83cb-24f886b80677 service nova] Acquiring lock "e85aa869-0d2a-40ff-9697-f979a6b110cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:00:10 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-fbbf2312-bcc5-4831-84fa-cac54893b314 req-e4841de1-9015-4346-83cb-24f886b80677 service nova] Lock "e85aa869-0d2a-40ff-9697-f979a6b110cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:00:10 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-fbbf2312-bcc5-4831-84fa-cac54893b314 req-e4841de1-9015-4346-83cb-24f886b80677 service nova] Lock "e85aa869-0d2a-40ff-9697-f979a6b110cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:00:10 user nova-compute[71874]: DEBUG nova.compute.manager [req-fbbf2312-bcc5-4831-84fa-cac54893b314 req-e4841de1-9015-4346-83cb-24f886b80677 service nova] [instance: e85aa869-0d2a-40ff-9697-f979a6b110cb] No waiting events found dispatching network-vif-plugged-0db939d7-60c3-48af-8d8d-0f5528f41bb6 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:00:10 user nova-compute[71874]: WARNING nova.compute.manager [req-fbbf2312-bcc5-4831-84fa-cac54893b314 req-e4841de1-9015-4346-83cb-24f886b80677 service nova] [instance: e85aa869-0d2a-40ff-9697-f979a6b110cb] Received unexpected event network-vif-plugged-0db939d7-60c3-48af-8d8d-0f5528f41bb6 for instance with vm_state building and task_state spawning.
Apr 12 16:00:10 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:10 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:10 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:10 user nova-compute[71874]: DEBUG nova.compute.manager [req-1e846313-7cf2-4b9d-8ec0-86effabd1d16 req-29f13a02-7481-4467-acb1-7d96eba3da4d service nova] [instance: 6614f2c0-399b-43d2-86c9-5790c57575e9] Received event network-vif-plugged-f1aab2a2-67f1-4ec5-9aeb-dffdec2170e3 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:00:10 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-1e846313-7cf2-4b9d-8ec0-86effabd1d16 req-29f13a02-7481-4467-acb1-7d96eba3da4d service nova] Acquiring lock "6614f2c0-399b-43d2-86c9-5790c57575e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:00:10 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-1e846313-7cf2-4b9d-8ec0-86effabd1d16 req-29f13a02-7481-4467-acb1-7d96eba3da4d service nova] Lock "6614f2c0-399b-43d2-86c9-5790c57575e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:00:10 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-1e846313-7cf2-4b9d-8ec0-86effabd1d16 req-29f13a02-7481-4467-acb1-7d96eba3da4d service nova] Lock "6614f2c0-399b-43d2-86c9-5790c57575e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:00:10 user nova-compute[71874]: DEBUG nova.compute.manager [req-1e846313-7cf2-4b9d-8ec0-86effabd1d16 req-29f13a02-7481-4467-acb1-7d96eba3da4d service nova] [instance: 6614f2c0-399b-43d2-86c9-5790c57575e9] No waiting events found dispatching network-vif-plugged-f1aab2a2-67f1-4ec5-9aeb-dffdec2170e3 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:00:10 user nova-compute[71874]: WARNING nova.compute.manager [req-1e846313-7cf2-4b9d-8ec0-86effabd1d16 req-29f13a02-7481-4467-acb1-7d96eba3da4d service nova] [instance: 6614f2c0-399b-43d2-86c9-5790c57575e9] Received unexpected event network-vif-plugged-f1aab2a2-67f1-4ec5-9aeb-dffdec2170e3 for instance with vm_state building and task_state spawning.
Apr 12 16:00:10 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:10 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d9579462-8181-486a-b3d6-3f39720a280e tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Acquiring lock "abbb6742-17d0-46b3-87ba-c14abc06738f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:00:10 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d9579462-8181-486a-b3d6-3f39720a280e tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Lock "abbb6742-17d0-46b3-87ba-c14abc06738f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:00:10 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d9579462-8181-486a-b3d6-3f39720a280e tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] [instance: abbb6742-17d0-46b3-87ba-c14abc06738f] Starting instance... {{(pid=71874) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 16:00:10 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d9579462-8181-486a-b3d6-3f39720a280e tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:00:10 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d9579462-8181-486a-b3d6-3f39720a280e tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:00:10 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-d9579462-8181-486a-b3d6-3f39720a280e tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71874) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 16:00:10 user nova-compute[71874]: INFO nova.compute.claims [None req-d9579462-8181-486a-b3d6-3f39720a280e tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] [instance: abbb6742-17d0-46b3-87ba-c14abc06738f] Claim successful on node user
Apr 12 16:00:11 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-d9579462-8181-486a-b3d6-3f39720a280e tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Inventory has not changed in ProviderTree for provider: 0e94b4c8-cd49-45e4-9133-d36eb4b2456b {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 16:00:11 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-d9579462-8181-486a-b3d6-3f39720a280e tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Inventory has not changed for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 16:00:11 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d9579462-8181-486a-b3d6-3f39720a280e tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.487s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:00:11 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d9579462-8181-486a-b3d6-3f39720a280e tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] [instance: abbb6742-17d0-46b3-87ba-c14abc06738f] Start building networks asynchronously for instance. {{(pid=71874) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 16:00:11 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:11 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:11 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d9579462-8181-486a-b3d6-3f39720a280e tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] [instance: abbb6742-17d0-46b3-87ba-c14abc06738f] Allocating IP information in the background. {{(pid=71874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 16:00:11 user nova-compute[71874]: DEBUG nova.network.neutron [None req-d9579462-8181-486a-b3d6-3f39720a280e tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] [instance: abbb6742-17d0-46b3-87ba-c14abc06738f] allocate_for_instance() {{(pid=71874) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 16:00:11 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-d9579462-8181-486a-b3d6-3f39720a280e tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] [instance: abbb6742-17d0-46b3-87ba-c14abc06738f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 16:00:11 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:11 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d9579462-8181-486a-b3d6-3f39720a280e tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] [instance: abbb6742-17d0-46b3-87ba-c14abc06738f] Start building block device mappings for instance. {{(pid=71874) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 16:00:11 user nova-compute[71874]: DEBUG nova.policy [None req-d9579462-8181-486a-b3d6-3f39720a280e tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c5d01dd905404e4aa08a31f25fa53338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bde51ff8bde4dcdb14fcda0fc92d564', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71874) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 16:00:11 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d9579462-8181-486a-b3d6-3f39720a280e tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] [instance: abbb6742-17d0-46b3-87ba-c14abc06738f] Start spawning the instance on the hypervisor. {{(pid=71874) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 16:00:11 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d9579462-8181-486a-b3d6-3f39720a280e tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] [instance: abbb6742-17d0-46b3-87ba-c14abc06738f] Creating instance directory {{(pid=71874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 16:00:11 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-d9579462-8181-486a-b3d6-3f39720a280e tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] [instance: abbb6742-17d0-46b3-87ba-c14abc06738f] Creating image(s)
Apr 12 16:00:11 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d9579462-8181-486a-b3d6-3f39720a280e tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Acquiring lock "/opt/stack/data/nova/instances/abbb6742-17d0-46b3-87ba-c14abc06738f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:00:11 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d9579462-8181-486a-b3d6-3f39720a280e tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Lock "/opt/stack/data/nova/instances/abbb6742-17d0-46b3-87ba-c14abc06738f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:00:11 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d9579462-8181-486a-b3d6-3f39720a280e tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Lock "/opt/stack/data/nova/instances/abbb6742-17d0-46b3-87ba-c14abc06738f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:00:11 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d9579462-8181-486a-b3d6-3f39720a280e tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:11 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d9579462-8181-486a-b3d6-3f39720a280e tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json" returned: 0 in 0.166s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:00:11 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d9579462-8181-486a-b3d6-3f39720a280e tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Acquiring lock "b88df1b37cb431f52bc53b5616015c89b5bec411" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:00:11 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d9579462-8181-486a-b3d6-3f39720a280e tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Lock "b88df1b37cb431f52bc53b5616015c89b5bec411" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:00:11 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d9579462-8181-486a-b3d6-3f39720a280e tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:11 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:00:11 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Starting heal instance info cache {{(pid=71874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 16:00:11 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Rebuilding the list of instances to heal {{(pid=71874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 16:00:12 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] [instance: e85aa869-0d2a-40ff-9697-f979a6b110cb] Skipping network cache update for instance because it is Building. {{(pid=71874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9805}}
Apr 12 16:00:12 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] [instance: 6614f2c0-399b-43d2-86c9-5790c57575e9] Skipping network cache update for instance because it is Building. {{(pid=71874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9805}}
Apr 12 16:00:12 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] [instance: abbb6742-17d0-46b3-87ba-c14abc06738f] Skipping network cache update for instance because it is Building. {{(pid=71874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9805}}
Apr 12 16:00:12 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d9579462-8181-486a-b3d6-3f39720a280e tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json" returned: 0 in 0.171s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:00:12 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d9579462-8181-486a-b3d6-3f39720a280e tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411,backing_fmt=raw /opt/stack/data/nova/instances/abbb6742-17d0-46b3-87ba-c14abc06738f/disk 1073741824 {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:12 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquiring lock "refresh_cache-afebffae-dbf6-4876-8c9f-0364f0fde49c" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:00:12 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquired lock "refresh_cache-afebffae-dbf6-4876-8c9f-0364f0fde49c" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:00:12 user nova-compute[71874]: DEBUG nova.network.neutron [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] Forcefully refreshing network info cache for instance {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 16:00:12 user nova-compute[71874]: DEBUG nova.objects.instance [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lazy-loading 'info_cache' on Instance uuid afebffae-dbf6-4876-8c9f-0364f0fde49c {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:00:12 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d9579462-8181-486a-b3d6-3f39720a280e tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411,backing_fmt=raw /opt/stack/data/nova/instances/abbb6742-17d0-46b3-87ba-c14abc06738f/disk 1073741824" returned: 0 in 0.061s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:00:12 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d9579462-8181-486a-b3d6-3f39720a280e tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Lock "b88df1b37cb431f52bc53b5616015c89b5bec411" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:00:12 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d9579462-8181-486a-b3d6-3f39720a280e tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:12 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d9579462-8181-486a-b3d6-3f39720a280e tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json" returned: 0 in 0.160s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:00:12 user nova-compute[71874]: DEBUG nova.virt.disk.api [None req-d9579462-8181-486a-b3d6-3f39720a280e tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Checking if we can resize image /opt/stack/data/nova/instances/abbb6742-17d0-46b3-87ba-c14abc06738f/disk. size=1073741824 {{(pid=71874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 16:00:12 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d9579462-8181-486a-b3d6-3f39720a280e tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abbb6742-17d0-46b3-87ba-c14abc06738f/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:12 user nova-compute[71874]: DEBUG nova.compute.manager [req-e5c6f874-8beb-411e-bc9a-1d7c15be62dd req-d5448c5d-8517-48bc-b3d9-beff8dadafce service nova] [instance: e85aa869-0d2a-40ff-9697-f979a6b110cb] Received event network-vif-plugged-0db939d7-60c3-48af-8d8d-0f5528f41bb6 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:00:12 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-e5c6f874-8beb-411e-bc9a-1d7c15be62dd req-d5448c5d-8517-48bc-b3d9-beff8dadafce service nova] Acquiring lock "e85aa869-0d2a-40ff-9697-f979a6b110cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:00:12 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-e5c6f874-8beb-411e-bc9a-1d7c15be62dd req-d5448c5d-8517-48bc-b3d9-beff8dadafce service nova] Lock "e85aa869-0d2a-40ff-9697-f979a6b110cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:00:12 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-e5c6f874-8beb-411e-bc9a-1d7c15be62dd req-d5448c5d-8517-48bc-b3d9-beff8dadafce service nova] Lock "e85aa869-0d2a-40ff-9697-f979a6b110cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:00:12 user nova-compute[71874]: DEBUG nova.compute.manager [req-e5c6f874-8beb-411e-bc9a-1d7c15be62dd req-d5448c5d-8517-48bc-b3d9-beff8dadafce service nova] [instance: e85aa869-0d2a-40ff-9697-f979a6b110cb] No waiting events found dispatching network-vif-plugged-0db939d7-60c3-48af-8d8d-0f5528f41bb6 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:00:12 user nova-compute[71874]: WARNING nova.compute.manager [req-e5c6f874-8beb-411e-bc9a-1d7c15be62dd req-d5448c5d-8517-48bc-b3d9-beff8dadafce service nova] [instance: e85aa869-0d2a-40ff-9697-f979a6b110cb] Received unexpected event network-vif-plugged-0db939d7-60c3-48af-8d8d-0f5528f41bb6 for instance with vm_state building and task_state spawning.
Apr 12 16:00:12 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:12 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d9579462-8181-486a-b3d6-3f39720a280e tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abbb6742-17d0-46b3-87ba-c14abc06738f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:00:12 user nova-compute[71874]: DEBUG nova.virt.disk.api [None req-d9579462-8181-486a-b3d6-3f39720a280e tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Cannot resize image /opt/stack/data/nova/instances/abbb6742-17d0-46b3-87ba-c14abc06738f/disk to a smaller size. {{(pid=71874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 16:00:12 user nova-compute[71874]: DEBUG nova.objects.instance [None req-d9579462-8181-486a-b3d6-3f39720a280e tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Lazy-loading 'migration_context' on Instance uuid abbb6742-17d0-46b3-87ba-c14abc06738f {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:00:12 user nova-compute[71874]: DEBUG nova.network.neutron [None req-d9579462-8181-486a-b3d6-3f39720a280e tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] [instance: abbb6742-17d0-46b3-87ba-c14abc06738f] Successfully created port: fb7d3715-f433-4db0-b9ac-8d5a2b0070e9 {{(pid=71874) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 16:00:12 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d9579462-8181-486a-b3d6-3f39720a280e tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] [instance: abbb6742-17d0-46b3-87ba-c14abc06738f] Created local disks {{(pid=71874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 16:00:12 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d9579462-8181-486a-b3d6-3f39720a280e tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] [instance: abbb6742-17d0-46b3-87ba-c14abc06738f] Ensure instance console log exists: /opt/stack/data/nova/instances/abbb6742-17d0-46b3-87ba-c14abc06738f/console.log {{(pid=71874) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 16:00:12 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d9579462-8181-486a-b3d6-3f39720a280e tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:00:12 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d9579462-8181-486a-b3d6-3f39720a280e tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:00:12 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d9579462-8181-486a-b3d6-3f39720a280e tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:00:12 user nova-compute[71874]: DEBUG nova.compute.manager [req-280a30b8-4d6b-40f6-976d-f5597da0a5ab req-cc1856c6-f8ff-4c83-8748-6b1536cf01ca service nova] [instance: 6614f2c0-399b-43d2-86c9-5790c57575e9] Received event network-vif-plugged-f1aab2a2-67f1-4ec5-9aeb-dffdec2170e3 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:00:12 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-280a30b8-4d6b-40f6-976d-f5597da0a5ab req-cc1856c6-f8ff-4c83-8748-6b1536cf01ca service nova] Acquiring lock "6614f2c0-399b-43d2-86c9-5790c57575e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:00:12 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-280a30b8-4d6b-40f6-976d-f5597da0a5ab req-cc1856c6-f8ff-4c83-8748-6b1536cf01ca service nova] Lock "6614f2c0-399b-43d2-86c9-5790c57575e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:00:12 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-280a30b8-4d6b-40f6-976d-f5597da0a5ab req-cc1856c6-f8ff-4c83-8748-6b1536cf01ca service nova] Lock "6614f2c0-399b-43d2-86c9-5790c57575e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:00:12 user nova-compute[71874]: DEBUG nova.compute.manager [req-280a30b8-4d6b-40f6-976d-f5597da0a5ab req-cc1856c6-f8ff-4c83-8748-6b1536cf01ca service nova] [instance: 6614f2c0-399b-43d2-86c9-5790c57575e9] No waiting events found dispatching network-vif-plugged-f1aab2a2-67f1-4ec5-9aeb-dffdec2170e3 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:00:12 user nova-compute[71874]: WARNING nova.compute.manager [req-280a30b8-4d6b-40f6-976d-f5597da0a5ab req-cc1856c6-f8ff-4c83-8748-6b1536cf01ca service nova] [instance: 6614f2c0-399b-43d2-86c9-5790c57575e9] Received unexpected event network-vif-plugged-f1aab2a2-67f1-4ec5-9aeb-dffdec2170e3 for instance with vm_state building and task_state spawning.
Apr 12 16:00:12 user nova-compute[71874]: DEBUG nova.network.neutron [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] Updating instance_info_cache with network_info: [{"id": "c4b29e0b-0ad8-4897-acf3-76004ac0338b", "address": "fa:16:3e:b8:23:a7", "network": {"id": "06fae0be-02dd-4962-a1ac-fd0413772758", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1493924857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3fe48a3b7d846a195f1e47cc7f69695", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4b29e0b-0a", "ovs_interfaceid": "c4b29e0b-0ad8-4897-acf3-76004ac0338b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:00:12 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Releasing lock "refresh_cache-afebffae-dbf6-4876-8c9f-0364f0fde49c" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:00:12 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] Updated the network info_cache for instance {{(pid=71874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 16:00:12 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:00:12 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:00:12 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71874) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 16:00:12 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:13 user nova-compute[71874]: DEBUG nova.virt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Emitting event <LifecycleEvent: 1681315213.0028455, e85aa869-0d2a-40ff-9697-f979a6b110cb => Resumed> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:00:13 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: e85aa869-0d2a-40ff-9697-f979a6b110cb] VM Resumed (Lifecycle Event)
Apr 12 16:00:13 user nova-compute[71874]: DEBUG nova.compute.manager [None req-7eefda50-4ec2-4ca9-a470-b369e2aedc10 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] [instance: e85aa869-0d2a-40ff-9697-f979a6b110cb] Instance event wait completed in 0 seconds for  {{(pid=71874) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 16:00:13 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-7eefda50-4ec2-4ca9-a470-b369e2aedc10 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] [instance: e85aa869-0d2a-40ff-9697-f979a6b110cb] Guest created on hypervisor {{(pid=71874) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 16:00:13 user nova-compute[71874]: DEBUG nova.compute.manager [None req-86a55a41-b7cc-416d-b059-dc8294942a87 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] [instance: 6614f2c0-399b-43d2-86c9-5790c57575e9] Instance event wait completed in 0 seconds for  {{(pid=71874) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 16:00:13 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-86a55a41-b7cc-416d-b059-dc8294942a87 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] [instance: 6614f2c0-399b-43d2-86c9-5790c57575e9] Guest created on hypervisor {{(pid=71874) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 16:00:13 user nova-compute[71874]: INFO nova.virt.libvirt.driver [-] [instance: e85aa869-0d2a-40ff-9697-f979a6b110cb] Instance spawned successfully.
Apr 12 16:00:13 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-7eefda50-4ec2-4ca9-a470-b369e2aedc10 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] [instance: e85aa869-0d2a-40ff-9697-f979a6b110cb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 16:00:13 user nova-compute[71874]: INFO nova.virt.libvirt.driver [-] [instance: 6614f2c0-399b-43d2-86c9-5790c57575e9] Instance spawned successfully.
Apr 12 16:00:13 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-86a55a41-b7cc-416d-b059-dc8294942a87 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] [instance: 6614f2c0-399b-43d2-86c9-5790c57575e9] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 16:00:13 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: e85aa869-0d2a-40ff-9697-f979a6b110cb] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:00:13 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-86a55a41-b7cc-416d-b059-dc8294942a87 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] [instance: 6614f2c0-399b-43d2-86c9-5790c57575e9] Found default for hw_input_bus of None {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:00:13 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-86a55a41-b7cc-416d-b059-dc8294942a87 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] [instance: 6614f2c0-399b-43d2-86c9-5790c57575e9] Found default for hw_pointer_model of None {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:00:13 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-86a55a41-b7cc-416d-b059-dc8294942a87 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] [instance: 6614f2c0-399b-43d2-86c9-5790c57575e9] Found default for hw_video_model of virtio {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:00:13 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-86a55a41-b7cc-416d-b059-dc8294942a87 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] [instance: 6614f2c0-399b-43d2-86c9-5790c57575e9] Found default for hw_vif_model of virtio {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:00:13 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: e85aa869-0d2a-40ff-9697-f979a6b110cb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 16:00:13 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-7eefda50-4ec2-4ca9-a470-b369e2aedc10 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] [instance: e85aa869-0d2a-40ff-9697-f979a6b110cb] Found default for hw_cdrom_bus of ide {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:00:13 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-7eefda50-4ec2-4ca9-a470-b369e2aedc10 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] [instance: e85aa869-0d2a-40ff-9697-f979a6b110cb] Found default for hw_disk_bus of virtio {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:00:13 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-7eefda50-4ec2-4ca9-a470-b369e2aedc10 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] [instance: e85aa869-0d2a-40ff-9697-f979a6b110cb] Found default for hw_input_bus of None {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:00:13 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-7eefda50-4ec2-4ca9-a470-b369e2aedc10 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] [instance: e85aa869-0d2a-40ff-9697-f979a6b110cb] Found default for hw_pointer_model of None {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:00:13 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-7eefda50-4ec2-4ca9-a470-b369e2aedc10 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] [instance: e85aa869-0d2a-40ff-9697-f979a6b110cb] Found default for hw_video_model of virtio {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:00:13 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-7eefda50-4ec2-4ca9-a470-b369e2aedc10 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] [instance: e85aa869-0d2a-40ff-9697-f979a6b110cb] Found default for hw_vif_model of virtio {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:00:13 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: e85aa869-0d2a-40ff-9697-f979a6b110cb] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 16:00:13 user nova-compute[71874]: DEBUG nova.virt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Emitting event <LifecycleEvent: 1681315213.004823, e85aa869-0d2a-40ff-9697-f979a6b110cb => Started> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:00:13 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: e85aa869-0d2a-40ff-9697-f979a6b110cb] VM Started (Lifecycle Event)
Apr 12 16:00:13 user nova-compute[71874]: INFO nova.compute.manager [None req-86a55a41-b7cc-416d-b059-dc8294942a87 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] [instance: 6614f2c0-399b-43d2-86c9-5790c57575e9] Took 7.80 seconds to spawn the instance on the hypervisor.
Apr 12 16:00:13 user nova-compute[71874]: DEBUG nova.compute.manager [None req-86a55a41-b7cc-416d-b059-dc8294942a87 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] [instance: 6614f2c0-399b-43d2-86c9-5790c57575e9] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:00:13 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: e85aa869-0d2a-40ff-9697-f979a6b110cb] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:00:13 user nova-compute[71874]: INFO nova.compute.manager [None req-7eefda50-4ec2-4ca9-a470-b369e2aedc10 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] [instance: e85aa869-0d2a-40ff-9697-f979a6b110cb] Took 11.43 seconds to spawn the instance on the hypervisor.
Apr 12 16:00:13 user nova-compute[71874]: DEBUG nova.compute.manager [None req-7eefda50-4ec2-4ca9-a470-b369e2aedc10 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] [instance: e85aa869-0d2a-40ff-9697-f979a6b110cb] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:00:13 user nova-compute[71874]: DEBUG nova.network.neutron [None req-d9579462-8181-486a-b3d6-3f39720a280e tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] [instance: abbb6742-17d0-46b3-87ba-c14abc06738f] Successfully updated port: fb7d3715-f433-4db0-b9ac-8d5a2b0070e9 {{(pid=71874) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 16:00:13 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: e85aa869-0d2a-40ff-9697-f979a6b110cb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 16:00:13 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d9579462-8181-486a-b3d6-3f39720a280e tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Acquiring lock "refresh_cache-abbb6742-17d0-46b3-87ba-c14abc06738f" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:00:13 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d9579462-8181-486a-b3d6-3f39720a280e tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Acquired lock "refresh_cache-abbb6742-17d0-46b3-87ba-c14abc06738f" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:00:13 user nova-compute[71874]: DEBUG nova.network.neutron [None req-d9579462-8181-486a-b3d6-3f39720a280e tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] [instance: abbb6742-17d0-46b3-87ba-c14abc06738f] Building network info cache for instance {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 16:00:13 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: e85aa869-0d2a-40ff-9697-f979a6b110cb] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 16:00:13 user nova-compute[71874]: DEBUG nova.virt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Emitting event <LifecycleEvent: 1681315213.0062666, 6614f2c0-399b-43d2-86c9-5790c57575e9 => Resumed> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:00:13 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 6614f2c0-399b-43d2-86c9-5790c57575e9] VM Resumed (Lifecycle Event)
Apr 12 16:00:13 user nova-compute[71874]: DEBUG nova.compute.manager [req-23cb3b38-95c0-417a-a978-09e992c2c391 req-9c972340-cc90-4e92-b417-c843c9b46cac service nova] [instance: abbb6742-17d0-46b3-87ba-c14abc06738f] Received event network-changed-fb7d3715-f433-4db0-b9ac-8d5a2b0070e9 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:00:13 user nova-compute[71874]: DEBUG nova.compute.manager [req-23cb3b38-95c0-417a-a978-09e992c2c391 req-9c972340-cc90-4e92-b417-c843c9b46cac service nova] [instance: abbb6742-17d0-46b3-87ba-c14abc06738f] Refreshing instance network info cache due to event network-changed-fb7d3715-f433-4db0-b9ac-8d5a2b0070e9. {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 16:00:13 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-23cb3b38-95c0-417a-a978-09e992c2c391 req-9c972340-cc90-4e92-b417-c843c9b46cac service nova] Acquiring lock "refresh_cache-abbb6742-17d0-46b3-87ba-c14abc06738f" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:00:13 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 6614f2c0-399b-43d2-86c9-5790c57575e9] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:00:13 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 6614f2c0-399b-43d2-86c9-5790c57575e9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 16:00:13 user nova-compute[71874]: DEBUG nova.network.neutron [None req-d9579462-8181-486a-b3d6-3f39720a280e tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] [instance: abbb6742-17d0-46b3-87ba-c14abc06738f] Instance cache missing network info. {{(pid=71874) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 16:00:13 user nova-compute[71874]: DEBUG nova.virt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Emitting event <LifecycleEvent: 1681315213.008994, 6614f2c0-399b-43d2-86c9-5790c57575e9 => Started> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:00:13 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 6614f2c0-399b-43d2-86c9-5790c57575e9] VM Started (Lifecycle Event)
Apr 12 16:00:13 user nova-compute[71874]: INFO nova.compute.manager [None req-86a55a41-b7cc-416d-b059-dc8294942a87 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] [instance: 6614f2c0-399b-43d2-86c9-5790c57575e9] Took 8.87 seconds to build instance.
Apr 12 16:00:13 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 6614f2c0-399b-43d2-86c9-5790c57575e9] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:00:13 user nova-compute[71874]: INFO nova.compute.manager [None req-7eefda50-4ec2-4ca9-a470-b369e2aedc10 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] [instance: e85aa869-0d2a-40ff-9697-f979a6b110cb] Took 12.67 seconds to build instance.
Apr 12 16:00:13 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-86a55a41-b7cc-416d-b059-dc8294942a87 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Lock "6614f2c0-399b-43d2-86c9-5790c57575e9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:00:13 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 6614f2c0-399b-43d2-86c9-5790c57575e9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 16:00:13 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-7eefda50-4ec2-4ca9-a470-b369e2aedc10 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Lock "e85aa869-0d2a-40ff-9697-f979a6b110cb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.795s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:00:13 user nova-compute[71874]: DEBUG nova.network.neutron [None req-d9579462-8181-486a-b3d6-3f39720a280e tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] [instance: abbb6742-17d0-46b3-87ba-c14abc06738f] Updating instance_info_cache with network_info: [{"id": "fb7d3715-f433-4db0-b9ac-8d5a2b0070e9", "address": "fa:16:3e:7c:33:e2", "network": {"id": "33052061-3a43-449e-b742-4ffa29dfc039", "bridge": "br-int", "label": "tempest-VolumesActionsTest-564180421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "1bde51ff8bde4dcdb14fcda0fc92d564", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb7d3715-f4", "ovs_interfaceid": "fb7d3715-f433-4db0-b9ac-8d5a2b0070e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:00:13 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d9579462-8181-486a-b3d6-3f39720a280e tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Releasing lock "refresh_cache-abbb6742-17d0-46b3-87ba-c14abc06738f" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:00:13 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d9579462-8181-486a-b3d6-3f39720a280e tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] [instance: abbb6742-17d0-46b3-87ba-c14abc06738f] Instance network_info: |[{"id": "fb7d3715-f433-4db0-b9ac-8d5a2b0070e9", "address": "fa:16:3e:7c:33:e2", "network": {"id": "33052061-3a43-449e-b742-4ffa29dfc039", "bridge": "br-int", "label": "tempest-VolumesActionsTest-564180421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "1bde51ff8bde4dcdb14fcda0fc92d564", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb7d3715-f4", "ovs_interfaceid": "fb7d3715-f433-4db0-b9ac-8d5a2b0070e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 16:00:13 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-23cb3b38-95c0-417a-a978-09e992c2c391 req-9c972340-cc90-4e92-b417-c843c9b46cac service nova] Acquired lock "refresh_cache-abbb6742-17d0-46b3-87ba-c14abc06738f" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:00:13 user nova-compute[71874]: DEBUG nova.network.neutron [req-23cb3b38-95c0-417a-a978-09e992c2c391 req-9c972340-cc90-4e92-b417-c843c9b46cac service nova] [instance: abbb6742-17d0-46b3-87ba-c14abc06738f] Refreshing network info cache for port fb7d3715-f433-4db0-b9ac-8d5a2b0070e9 {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 16:00:13 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d9579462-8181-486a-b3d6-3f39720a280e tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] [instance: abbb6742-17d0-46b3-87ba-c14abc06738f] Start _get_guest_xml network_info=[{"id": "fb7d3715-f433-4db0-b9ac-8d5a2b0070e9", "address": "fa:16:3e:7c:33:e2", "network": {"id": "33052061-3a43-449e-b742-4ffa29dfc039", "bridge": "br-int", "label": "tempest-VolumesActionsTest-564180421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "1bde51ff8bde4dcdb14fcda0fc92d564", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb7d3715-f4", "ovs_interfaceid": "fb7d3715-f433-4db0-b9ac-8d5a2b0070e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T15:55:37Z,direct_url=<?>,disk_format='qcow2',id=9dc63f14-8b70-4e72-89f2-13464f2f5c7c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='61a4936d9b7744c0b488d81c9b7746b6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T15:55:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_options': None, 'image_id': '9dc63f14-8b70-4e72-89f2-13464f2f5c7c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 16:00:13 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-d9579462-8181-486a-b3d6-3f39720a280e tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:00:13 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-d9579462-8181-486a-b3d6-3f39720a280e tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:00:13 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d9579462-8181-486a-b3d6-3f39720a280e tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71874) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 16:00:13 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-d9579462-8181-486a-b3d6-3f39720a280e tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T15:56:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T15:55:37Z,direct_url=<?>,disk_format='qcow2',id=9dc63f14-8b70-4e72-89f2-13464f2f5c7c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='61a4936d9b7744c0b488d81c9b7746b6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T15:55:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 16:00:13 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-d9579462-8181-486a-b3d6-3f39720a280e tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Flavor limits 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 16:00:13 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-d9579462-8181-486a-b3d6-3f39720a280e tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Image limits 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 16:00:13 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-d9579462-8181-486a-b3d6-3f39720a280e tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Flavor pref 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 16:00:13 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-d9579462-8181-486a-b3d6-3f39720a280e tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Image pref 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 16:00:13 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-d9579462-8181-486a-b3d6-3f39720a280e tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 16:00:13 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-d9579462-8181-486a-b3d6-3f39720a280e tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 16:00:13 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-d9579462-8181-486a-b3d6-3f39720a280e tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 16:00:13 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-d9579462-8181-486a-b3d6-3f39720a280e tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Got 1 possible topologies {{(pid=71874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 16:00:13 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-d9579462-8181-486a-b3d6-3f39720a280e tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 16:00:13 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-d9579462-8181-486a-b3d6-3f39720a280e tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 16:00:13 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-d9579462-8181-486a-b3d6-3f39720a280e tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T16:00:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2046590386',display_name='tempest-VolumesActionsTest-instance-2046590386',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2046590386',id=10,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1bde51ff8bde4dcdb14fcda0fc92d564',ramdisk_id='',reservation_id='r-uz6ixsjl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-104284977',owner_user_name='tempest-VolumesActionsTest-104284977-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T16:00:12Z,user_data=None,user_id='c5d01dd905404e4aa08a31f25fa53338',uuid=abbb6742-17d0-46b3-87ba-c14abc06738f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fb7d3715-f433-4db0-b9ac-8d5a2b0070e9", "address": "fa:16:3e:7c:33:e2", "network": {"id": "33052061-3a43-449e-b742-4ffa29dfc039", "bridge": "br-int", "label": "tempest-VolumesActionsTest-564180421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "1bde51ff8bde4dcdb14fcda0fc92d564", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb7d3715-f4", "ovs_interfaceid": "fb7d3715-f433-4db0-b9ac-8d5a2b0070e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 16:00:13 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-d9579462-8181-486a-b3d6-3f39720a280e tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Converting VIF {"id": "fb7d3715-f433-4db0-b9ac-8d5a2b0070e9", "address": "fa:16:3e:7c:33:e2", "network": {"id": "33052061-3a43-449e-b742-4ffa29dfc039", "bridge": "br-int", "label": "tempest-VolumesActionsTest-564180421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "1bde51ff8bde4dcdb14fcda0fc92d564", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb7d3715-f4", "ovs_interfaceid": "fb7d3715-f433-4db0-b9ac-8d5a2b0070e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:00:13 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-d9579462-8181-486a-b3d6-3f39720a280e tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:33:e2,bridge_name='br-int',has_traffic_filtering=True,id=fb7d3715-f433-4db0-b9ac-8d5a2b0070e9,network=Network(33052061-3a43-449e-b742-4ffa29dfc039),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb7d3715-f4') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:00:13 user nova-compute[71874]: DEBUG nova.objects.instance [None req-d9579462-8181-486a-b3d6-3f39720a280e tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Lazy-loading 'pci_devices' on Instance uuid abbb6742-17d0-46b3-87ba-c14abc06738f {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:00:13 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d9579462-8181-486a-b3d6-3f39720a280e tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] [instance: abbb6742-17d0-46b3-87ba-c14abc06738f] End _get_guest_xml xml=<domain type="kvm">
Apr 12 16:00:13 user nova-compute[71874]:   <uuid>abbb6742-17d0-46b3-87ba-c14abc06738f</uuid>
Apr 12 16:00:13 user nova-compute[71874]:   <name>instance-0000000a</name>
Apr 12 16:00:13 user nova-compute[71874]:   <memory>131072</memory>
Apr 12 16:00:13 user nova-compute[71874]:   <vcpu>1</vcpu>
Apr 12 16:00:13 user nova-compute[71874]:   <metadata>
Apr 12 16:00:13 user nova-compute[71874]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 16:00:13 user nova-compute[71874]:       <nova:package version="0.0.0"/>
Apr 12 16:00:13 user nova-compute[71874]:       <nova:name>tempest-VolumesActionsTest-instance-2046590386</nova:name>
Apr 12 16:00:13 user nova-compute[71874]:       <nova:creationTime>2023-04-12 16:00:13</nova:creationTime>
Apr 12 16:00:13 user nova-compute[71874]:       <nova:flavor name="m1.nano">
Apr 12 16:00:13 user nova-compute[71874]:         <nova:memory>128</nova:memory>
Apr 12 16:00:13 user nova-compute[71874]:         <nova:disk>1</nova:disk>
Apr 12 16:00:13 user nova-compute[71874]:         <nova:swap>0</nova:swap>
Apr 12 16:00:13 user nova-compute[71874]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 16:00:13 user nova-compute[71874]:         <nova:vcpus>1</nova:vcpus>
Apr 12 16:00:13 user nova-compute[71874]:       </nova:flavor>
Apr 12 16:00:13 user nova-compute[71874]:       <nova:owner>
Apr 12 16:00:13 user nova-compute[71874]:         <nova:user uuid="c5d01dd905404e4aa08a31f25fa53338">tempest-VolumesActionsTest-104284977-project-member</nova:user>
Apr 12 16:00:13 user nova-compute[71874]:         <nova:project uuid="1bde51ff8bde4dcdb14fcda0fc92d564">tempest-VolumesActionsTest-104284977</nova:project>
Apr 12 16:00:13 user nova-compute[71874]:       </nova:owner>
Apr 12 16:00:13 user nova-compute[71874]:       <nova:root type="image" uuid="9dc63f14-8b70-4e72-89f2-13464f2f5c7c"/>
Apr 12 16:00:13 user nova-compute[71874]:       <nova:ports>
Apr 12 16:00:13 user nova-compute[71874]:         <nova:port uuid="fb7d3715-f433-4db0-b9ac-8d5a2b0070e9">
Apr 12 16:00:13 user nova-compute[71874]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 12 16:00:13 user nova-compute[71874]:         </nova:port>
Apr 12 16:00:13 user nova-compute[71874]:       </nova:ports>
Apr 12 16:00:13 user nova-compute[71874]:     </nova:instance>
Apr 12 16:00:13 user nova-compute[71874]:   </metadata>
Apr 12 16:00:13 user nova-compute[71874]:   <sysinfo type="smbios">
Apr 12 16:00:13 user nova-compute[71874]:     <system>
Apr 12 16:00:13 user nova-compute[71874]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 16:00:13 user nova-compute[71874]:       <entry name="product">OpenStack Nova</entry>
Apr 12 16:00:13 user nova-compute[71874]:       <entry name="version">0.0.0</entry>
Apr 12 16:00:13 user nova-compute[71874]:       <entry name="serial">abbb6742-17d0-46b3-87ba-c14abc06738f</entry>
Apr 12 16:00:13 user nova-compute[71874]:       <entry name="uuid">abbb6742-17d0-46b3-87ba-c14abc06738f</entry>
Apr 12 16:00:13 user nova-compute[71874]:       <entry name="family">Virtual Machine</entry>
Apr 12 16:00:13 user nova-compute[71874]:     </system>
Apr 12 16:00:13 user nova-compute[71874]:   </sysinfo>
Apr 12 16:00:13 user nova-compute[71874]:   <os>
Apr 12 16:00:13 user nova-compute[71874]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 16:00:13 user nova-compute[71874]:     <boot dev="hd"/>
Apr 12 16:00:13 user nova-compute[71874]:     <smbios mode="sysinfo"/>
Apr 12 16:00:13 user nova-compute[71874]:   </os>
Apr 12 16:00:13 user nova-compute[71874]:   <features>
Apr 12 16:00:13 user nova-compute[71874]:     <acpi/>
Apr 12 16:00:13 user nova-compute[71874]:     <apic/>
Apr 12 16:00:13 user nova-compute[71874]:     <vmcoreinfo/>
Apr 12 16:00:13 user nova-compute[71874]:   </features>
Apr 12 16:00:13 user nova-compute[71874]:   <clock offset="utc">
Apr 12 16:00:13 user nova-compute[71874]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 16:00:13 user nova-compute[71874]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 16:00:13 user nova-compute[71874]:     <timer name="hpet" present="no"/>
Apr 12 16:00:13 user nova-compute[71874]:   </clock>
Apr 12 16:00:13 user nova-compute[71874]:   <cpu mode="custom" match="exact">
Apr 12 16:00:13 user nova-compute[71874]:     <model>Nehalem</model>
Apr 12 16:00:13 user nova-compute[71874]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 16:00:13 user nova-compute[71874]:   </cpu>
Apr 12 16:00:13 user nova-compute[71874]:   <devices>
Apr 12 16:00:13 user nova-compute[71874]:     <disk type="file" device="disk">
Apr 12 16:00:13 user nova-compute[71874]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 16:00:13 user nova-compute[71874]:       <source file="/opt/stack/data/nova/instances/abbb6742-17d0-46b3-87ba-c14abc06738f/disk"/>
Apr 12 16:00:13 user nova-compute[71874]:       <target dev="vda" bus="virtio"/>
Apr 12 16:00:13 user nova-compute[71874]:     </disk>
Apr 12 16:00:13 user nova-compute[71874]:     <interface type="ethernet">
Apr 12 16:00:13 user nova-compute[71874]:       <mac address="fa:16:3e:7c:33:e2"/>
Apr 12 16:00:13 user nova-compute[71874]:       <model type="virtio"/>
Apr 12 16:00:13 user nova-compute[71874]:       <mtu size="1442"/>
Apr 12 16:00:13 user nova-compute[71874]:       <target dev="tapfb7d3715-f4"/>
Apr 12 16:00:13 user nova-compute[71874]:     </interface>
Apr 12 16:00:13 user nova-compute[71874]:     <serial type="pty">
Apr 12 16:00:13 user nova-compute[71874]:       <log file="/opt/stack/data/nova/instances/abbb6742-17d0-46b3-87ba-c14abc06738f/console.log" append="off"/>
Apr 12 16:00:13 user nova-compute[71874]:     </serial>
Apr 12 16:00:13 user nova-compute[71874]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 16:00:13 user nova-compute[71874]:     <video>
Apr 12 16:00:13 user nova-compute[71874]:       <model type="virtio"/>
Apr 12 16:00:13 user nova-compute[71874]:     </video>
Apr 12 16:00:13 user nova-compute[71874]:     <rng model="virtio">
Apr 12 16:00:13 user nova-compute[71874]:       <backend model="random">/dev/urandom</backend>
Apr 12 16:00:13 user nova-compute[71874]:     </rng>
Apr 12 16:00:13 user nova-compute[71874]:     <controller type="usb" index="0" model="none"/>
Apr 12 16:00:13 user nova-compute[71874]:     <memballoon model="virtio">
Apr 12 16:00:13 user nova-compute[71874]:       <stats period="10"/>
Apr 12 16:00:13 user nova-compute[71874]:     </memballoon>
Apr 12 16:00:13 user nova-compute[71874]:   </devices>
Apr 12 16:00:13 user nova-compute[71874]: </domain>
Apr 12 16:00:13 user nova-compute[71874]:  {{(pid=71874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 16:00:13 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-d9579462-8181-486a-b3d6-3f39720a280e tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T16:00:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2046590386',display_name='tempest-VolumesActionsTest-instance-2046590386',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2046590386',id=10,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1bde51ff8bde4dcdb14fcda0fc92d564',ramdisk_id='',reservation_id='r-uz6ixsjl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-104284977',owner_user_name='tempest-VolumesActionsTest-104284977-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T16:00:12Z,user_data=None,user_id='c5d01dd905404e4aa08a31f25fa53338',uuid=abbb6742-17d0-46b3-87ba-c14abc06738f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fb7d3715-f433-4db0-b9ac-8d5a2b0070e9", "address": "fa:16:3e:7c:33:e2", "network": {"id": "33052061-3a43-449e-b742-4ffa29dfc039", "bridge": "br-int", "label": "tempest-VolumesActionsTest-564180421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "1bde51ff8bde4dcdb14fcda0fc92d564", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb7d3715-f4", "ovs_interfaceid": "fb7d3715-f433-4db0-b9ac-8d5a2b0070e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 16:00:13 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-d9579462-8181-486a-b3d6-3f39720a280e tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Converting VIF {"id": "fb7d3715-f433-4db0-b9ac-8d5a2b0070e9", "address": "fa:16:3e:7c:33:e2", "network": {"id": "33052061-3a43-449e-b742-4ffa29dfc039", "bridge": "br-int", "label": "tempest-VolumesActionsTest-564180421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "1bde51ff8bde4dcdb14fcda0fc92d564", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb7d3715-f4", "ovs_interfaceid": "fb7d3715-f433-4db0-b9ac-8d5a2b0070e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:00:13 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-d9579462-8181-486a-b3d6-3f39720a280e tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:33:e2,bridge_name='br-int',has_traffic_filtering=True,id=fb7d3715-f433-4db0-b9ac-8d5a2b0070e9,network=Network(33052061-3a43-449e-b742-4ffa29dfc039),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb7d3715-f4') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:00:13 user nova-compute[71874]: DEBUG os_vif [None req-d9579462-8181-486a-b3d6-3f39720a280e tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:33:e2,bridge_name='br-int',has_traffic_filtering=True,id=fb7d3715-f433-4db0-b9ac-8d5a2b0070e9,network=Network(33052061-3a43-449e-b742-4ffa29dfc039),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb7d3715-f4') {{(pid=71874) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 16:00:13 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:13 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:00:13 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 16:00:13 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:13 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfb7d3715-f4, may_exist=True) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:00:13 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfb7d3715-f4, col_values=(('external_ids', {'iface-id': 'fb7d3715-f433-4db0-b9ac-8d5a2b0070e9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7c:33:e2', 'vm-uuid': 'abbb6742-17d0-46b3-87ba-c14abc06738f'}),)) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:00:13 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:13 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:00:13 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:00:13 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:00:13 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:13 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:00:13 user nova-compute[71874]: INFO os_vif [None req-d9579462-8181-486a-b3d6-3f39720a280e tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:33:e2,bridge_name='br-int',has_traffic_filtering=True,id=fb7d3715-f433-4db0-b9ac-8d5a2b0070e9,network=Network(33052061-3a43-449e-b742-4ffa29dfc039),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb7d3715-f4')
Apr 12 16:00:13 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d9579462-8181-486a-b3d6-3f39720a280e tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] No BDM found with device name vda, not building metadata. {{(pid=71874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 16:00:13 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d9579462-8181-486a-b3d6-3f39720a280e tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] No VIF found with MAC fa:16:3e:7c:33:e2, not building metadata {{(pid=71874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 16:00:14 user nova-compute[71874]: DEBUG nova.network.neutron [req-23cb3b38-95c0-417a-a978-09e992c2c391 req-9c972340-cc90-4e92-b417-c843c9b46cac service nova] [instance: abbb6742-17d0-46b3-87ba-c14abc06738f] Updated VIF entry in instance network info cache for port fb7d3715-f433-4db0-b9ac-8d5a2b0070e9. {{(pid=71874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 16:00:14 user nova-compute[71874]: DEBUG nova.network.neutron [req-23cb3b38-95c0-417a-a978-09e992c2c391 req-9c972340-cc90-4e92-b417-c843c9b46cac service nova] [instance: abbb6742-17d0-46b3-87ba-c14abc06738f] Updating instance_info_cache with network_info: [{"id": "fb7d3715-f433-4db0-b9ac-8d5a2b0070e9", "address": "fa:16:3e:7c:33:e2", "network": {"id": "33052061-3a43-449e-b742-4ffa29dfc039", "bridge": "br-int", "label": "tempest-VolumesActionsTest-564180421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "1bde51ff8bde4dcdb14fcda0fc92d564", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb7d3715-f4", "ovs_interfaceid": "fb7d3715-f433-4db0-b9ac-8d5a2b0070e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:00:14 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-23cb3b38-95c0-417a-a978-09e992c2c391 req-9c972340-cc90-4e92-b417-c843c9b46cac service nova] Releasing lock "refresh_cache-abbb6742-17d0-46b3-87ba-c14abc06738f" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:00:14 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:00:14 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:00:14 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:00:14 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:00:14 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:00:14 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:00:14 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Auditing locally available compute resources for user (node: user) {{(pid=71874) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 16:00:15 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:15 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:15 user nova-compute[71874]: DEBUG nova.compute.manager [req-e1f1201c-5f77-4e66-83b7-1879ba118749 req-ab63872c-93fa-41f3-9320-87237885c440 service nova] [instance: abbb6742-17d0-46b3-87ba-c14abc06738f] Received event network-vif-plugged-fb7d3715-f433-4db0-b9ac-8d5a2b0070e9 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:00:15 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-e1f1201c-5f77-4e66-83b7-1879ba118749 req-ab63872c-93fa-41f3-9320-87237885c440 service nova] Acquiring lock "abbb6742-17d0-46b3-87ba-c14abc06738f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:00:15 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-e1f1201c-5f77-4e66-83b7-1879ba118749 req-ab63872c-93fa-41f3-9320-87237885c440 service nova] Lock "abbb6742-17d0-46b3-87ba-c14abc06738f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:00:15 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-e1f1201c-5f77-4e66-83b7-1879ba118749 req-ab63872c-93fa-41f3-9320-87237885c440 service nova] Lock "abbb6742-17d0-46b3-87ba-c14abc06738f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:00:15 user nova-compute[71874]: DEBUG nova.compute.manager [req-e1f1201c-5f77-4e66-83b7-1879ba118749 req-ab63872c-93fa-41f3-9320-87237885c440 service nova] [instance: abbb6742-17d0-46b3-87ba-c14abc06738f] No waiting events found dispatching network-vif-plugged-fb7d3715-f433-4db0-b9ac-8d5a2b0070e9 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:00:15 user nova-compute[71874]: WARNING nova.compute.manager [req-e1f1201c-5f77-4e66-83b7-1879ba118749 req-ab63872c-93fa-41f3-9320-87237885c440 service nova] [instance: abbb6742-17d0-46b3-87ba-c14abc06738f] Received unexpected event network-vif-plugged-fb7d3715-f433-4db0-b9ac-8d5a2b0070e9 for instance with vm_state building and task_state spawning.
Apr 12 16:00:16 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc19fd8d-3285-4ceb-8714-a0ba139f3045/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:16 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc19fd8d-3285-4ceb-8714-a0ba139f3045/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:00:16 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc19fd8d-3285-4ceb-8714-a0ba139f3045/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:16 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc19fd8d-3285-4ceb-8714-a0ba139f3045/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:00:16 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abbb6742-17d0-46b3-87ba-c14abc06738f/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:16 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abbb6742-17d0-46b3-87ba-c14abc06738f/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:00:16 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abbb6742-17d0-46b3-87ba-c14abc06738f/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:16 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abbb6742-17d0-46b3-87ba-c14abc06738f/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:00:16 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afebffae-dbf6-4876-8c9f-0364f0fde49c/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:17 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afebffae-dbf6-4876-8c9f-0364f0fde49c/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:00:17 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afebffae-dbf6-4876-8c9f-0364f0fde49c/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:17 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afebffae-dbf6-4876-8c9f-0364f0fde49c/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:00:17 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/608fbea2-b42b-4bb9-94a7-2b76dcdc2001/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:17 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/608fbea2-b42b-4bb9-94a7-2b76dcdc2001/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:00:17 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/608fbea2-b42b-4bb9-94a7-2b76dcdc2001/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:17 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:17 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/608fbea2-b42b-4bb9-94a7-2b76dcdc2001/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:00:17 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55aff314-eb5e-4752-af9f-a4021e970cac/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:17 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55aff314-eb5e-4752-af9f-a4021e970cac/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:00:17 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55aff314-eb5e-4752-af9f-a4021e970cac/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:17 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55aff314-eb5e-4752-af9f-a4021e970cac/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:00:17 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/920c6512-180d-46e1-b0cf-240d34c3fc97/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:17 user nova-compute[71874]: DEBUG nova.compute.manager [req-d0893008-c0b1-43d7-a0bb-82cfe2ba1cf8 req-7135f797-861f-49e1-9758-a33a19137cc1 service nova] [instance: abbb6742-17d0-46b3-87ba-c14abc06738f] Received event network-vif-plugged-fb7d3715-f433-4db0-b9ac-8d5a2b0070e9 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:00:17 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-d0893008-c0b1-43d7-a0bb-82cfe2ba1cf8 req-7135f797-861f-49e1-9758-a33a19137cc1 service nova] Acquiring lock "abbb6742-17d0-46b3-87ba-c14abc06738f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:00:17 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-d0893008-c0b1-43d7-a0bb-82cfe2ba1cf8 req-7135f797-861f-49e1-9758-a33a19137cc1 service nova] Lock "abbb6742-17d0-46b3-87ba-c14abc06738f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:00:17 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-d0893008-c0b1-43d7-a0bb-82cfe2ba1cf8 req-7135f797-861f-49e1-9758-a33a19137cc1 service nova] Lock "abbb6742-17d0-46b3-87ba-c14abc06738f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:00:17 user nova-compute[71874]: DEBUG nova.compute.manager [req-d0893008-c0b1-43d7-a0bb-82cfe2ba1cf8 req-7135f797-861f-49e1-9758-a33a19137cc1 service nova] [instance: abbb6742-17d0-46b3-87ba-c14abc06738f] No waiting events found dispatching network-vif-plugged-fb7d3715-f433-4db0-b9ac-8d5a2b0070e9 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:00:17 user nova-compute[71874]: WARNING nova.compute.manager [req-d0893008-c0b1-43d7-a0bb-82cfe2ba1cf8 req-7135f797-861f-49e1-9758-a33a19137cc1 service nova] [instance: abbb6742-17d0-46b3-87ba-c14abc06738f] Received unexpected event network-vif-plugged-fb7d3715-f433-4db0-b9ac-8d5a2b0070e9 for instance with vm_state building and task_state spawning.
Apr 12 16:00:18 user nova-compute[71874]: DEBUG nova.virt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Emitting event <LifecycleEvent: 1681315218.0677476, abbb6742-17d0-46b3-87ba-c14abc06738f => Resumed> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:00:18 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: abbb6742-17d0-46b3-87ba-c14abc06738f] VM Resumed (Lifecycle Event)
Apr 12 16:00:18 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d9579462-8181-486a-b3d6-3f39720a280e tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] [instance: abbb6742-17d0-46b3-87ba-c14abc06738f] Instance event wait completed in 0 seconds for  {{(pid=71874) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 16:00:18 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d9579462-8181-486a-b3d6-3f39720a280e tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] [instance: abbb6742-17d0-46b3-87ba-c14abc06738f] Guest created on hypervisor {{(pid=71874) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 16:00:18 user nova-compute[71874]: INFO nova.virt.libvirt.driver [-] [instance: abbb6742-17d0-46b3-87ba-c14abc06738f] Instance spawned successfully.
Apr 12 16:00:18 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d9579462-8181-486a-b3d6-3f39720a280e tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] [instance: abbb6742-17d0-46b3-87ba-c14abc06738f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 16:00:18 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: abbb6742-17d0-46b3-87ba-c14abc06738f] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:00:18 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/920c6512-180d-46e1-b0cf-240d34c3fc97/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:00:18 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/920c6512-180d-46e1-b0cf-240d34c3fc97/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:18 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: abbb6742-17d0-46b3-87ba-c14abc06738f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 16:00:18 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: abbb6742-17d0-46b3-87ba-c14abc06738f] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 16:00:18 user nova-compute[71874]: DEBUG nova.virt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Emitting event <LifecycleEvent: 1681315218.0727801, abbb6742-17d0-46b3-87ba-c14abc06738f => Started> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:00:18 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: abbb6742-17d0-46b3-87ba-c14abc06738f] VM Started (Lifecycle Event)
Apr 12 16:00:18 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d9579462-8181-486a-b3d6-3f39720a280e tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] [instance: abbb6742-17d0-46b3-87ba-c14abc06738f] Found default for hw_cdrom_bus of ide {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:00:18 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d9579462-8181-486a-b3d6-3f39720a280e tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] [instance: abbb6742-17d0-46b3-87ba-c14abc06738f] Found default for hw_disk_bus of virtio {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:00:18 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d9579462-8181-486a-b3d6-3f39720a280e tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] [instance: abbb6742-17d0-46b3-87ba-c14abc06738f] Found default for hw_input_bus of None {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:00:18 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d9579462-8181-486a-b3d6-3f39720a280e tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] [instance: abbb6742-17d0-46b3-87ba-c14abc06738f] Found default for hw_pointer_model of None {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:00:18 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d9579462-8181-486a-b3d6-3f39720a280e tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] [instance: abbb6742-17d0-46b3-87ba-c14abc06738f] Found default for hw_video_model of virtio {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:00:18 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d9579462-8181-486a-b3d6-3f39720a280e tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] [instance: abbb6742-17d0-46b3-87ba-c14abc06738f] Found default for hw_vif_model of virtio {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:00:18 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: abbb6742-17d0-46b3-87ba-c14abc06738f] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:00:18 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: abbb6742-17d0-46b3-87ba-c14abc06738f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 16:00:18 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/920c6512-180d-46e1-b0cf-240d34c3fc97/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:00:18 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473a30c4-5aa4-481c-8859-fda815d14872/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:18 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: abbb6742-17d0-46b3-87ba-c14abc06738f] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 16:00:18 user nova-compute[71874]: INFO nova.compute.manager [None req-d9579462-8181-486a-b3d6-3f39720a280e tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] [instance: abbb6742-17d0-46b3-87ba-c14abc06738f] Took 6.68 seconds to spawn the instance on the hypervisor.
Apr 12 16:00:18 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d9579462-8181-486a-b3d6-3f39720a280e tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] [instance: abbb6742-17d0-46b3-87ba-c14abc06738f] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:00:18 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473a30c4-5aa4-481c-8859-fda815d14872/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:00:18 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473a30c4-5aa4-481c-8859-fda815d14872/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:18 user nova-compute[71874]: INFO nova.compute.manager [None req-d9579462-8181-486a-b3d6-3f39720a280e tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] [instance: abbb6742-17d0-46b3-87ba-c14abc06738f] Took 7.61 seconds to build instance.
Apr 12 16:00:18 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d9579462-8181-486a-b3d6-3f39720a280e tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Lock "abbb6742-17d0-46b3-87ba-c14abc06738f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.716s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:00:18 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473a30c4-5aa4-481c-8859-fda815d14872/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:00:18 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e85aa869-0d2a-40ff-9697-f979a6b110cb/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:18 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e85aa869-0d2a-40ff-9697-f979a6b110cb/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:00:18 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e85aa869-0d2a-40ff-9697-f979a6b110cb/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:18 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:18 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8eb1b94-364c-4285-9f8a-15ad4eb217af tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Acquiring lock "85b91251-9735-4812-9f11-003a7951a6f3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:00:18 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8eb1b94-364c-4285-9f8a-15ad4eb217af tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Lock "85b91251-9735-4812-9f11-003a7951a6f3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:00:18 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8eb1b94-364c-4285-9f8a-15ad4eb217af tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] Starting instance... {{(pid=71874) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 16:00:18 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e85aa869-0d2a-40ff-9697-f979a6b110cb/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:00:18 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:19 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1/disk --force-share --output=json" returned: 0 in 0.342s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:00:19 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:19 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8eb1b94-364c-4285-9f8a-15ad4eb217af tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:00:19 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8eb1b94-364c-4285-9f8a-15ad4eb217af tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:00:19 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-d8eb1b94-364c-4285-9f8a-15ad4eb217af tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71874) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 16:00:19 user nova-compute[71874]: INFO nova.compute.claims [None req-d8eb1b94-364c-4285-9f8a-15ad4eb217af tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] Claim successful on node user
Apr 12 16:00:19 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:00:19 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6614f2c0-399b-43d2-86c9-5790c57575e9/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:19 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6614f2c0-399b-43d2-86c9-5790c57575e9/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:00:19 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6614f2c0-399b-43d2-86c9-5790c57575e9/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:19 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-d8eb1b94-364c-4285-9f8a-15ad4eb217af tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Refreshing inventories for resource provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b {{(pid=71874) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 12 16:00:19 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-d8eb1b94-364c-4285-9f8a-15ad4eb217af tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Updating ProviderTree inventory for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 12 16:00:19 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-d8eb1b94-364c-4285-9f8a-15ad4eb217af tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Updating inventory in ProviderTree for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 12 16:00:19 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-d8eb1b94-364c-4285-9f8a-15ad4eb217af tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Refreshing aggregate associations for resource provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b, aggregates: None {{(pid=71874) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 12 16:00:19 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6614f2c0-399b-43d2-86c9-5790c57575e9/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:00:19 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-d8eb1b94-364c-4285-9f8a-15ad4eb217af tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Refreshing trait associations for resource provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b, traits: COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_ACCELERATORS,HW_CPU_X86_MMX,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE2,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_FDC,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE {{(pid=71874) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 12 16:00:20 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:00:20 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:00:20 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Hypervisor/Node resource view: name=user free_ram=7620MB free_disk=26.39944839477539GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71874) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 16:00:20 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:00:20 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-d8eb1b94-364c-4285-9f8a-15ad4eb217af tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Inventory has not changed in ProviderTree for provider: 0e94b4c8-cd49-45e4-9133-d36eb4b2456b {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 16:00:20 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-d8eb1b94-364c-4285-9f8a-15ad4eb217af tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Inventory has not changed for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 16:00:20 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8eb1b94-364c-4285-9f8a-15ad4eb217af tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.432s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:00:20 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8eb1b94-364c-4285-9f8a-15ad4eb217af tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] Start building networks asynchronously for instance. {{(pid=71874) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 16:00:20 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.397s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:00:20 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8eb1b94-364c-4285-9f8a-15ad4eb217af tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] Allocating IP information in the background. {{(pid=71874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 16:00:20 user nova-compute[71874]: DEBUG nova.network.neutron [None req-d8eb1b94-364c-4285-9f8a-15ad4eb217af tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] allocate_for_instance() {{(pid=71874) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 16:00:20 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-d8eb1b94-364c-4285-9f8a-15ad4eb217af tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 16:00:20 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8eb1b94-364c-4285-9f8a-15ad4eb217af tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] Start building block device mappings for instance. {{(pid=71874) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 16:00:21 user nova-compute[71874]: DEBUG nova.policy [None req-d8eb1b94-364c-4285-9f8a-15ad4eb217af tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6acbd977c4b4494db95f879777184489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46b4e80a65541d6bab94b5edfc26e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71874) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 16:00:21 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance abbb6742-17d0-46b3-87ba-c14abc06738f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:00:21 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance fc19fd8d-3285-4ceb-8714-a0ba139f3045 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:00:21 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 920c6512-180d-46e1-b0cf-240d34c3fc97 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:00:21 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance e85aa869-0d2a-40ff-9697-f979a6b110cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:00:21 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 6614f2c0-399b-43d2-86c9-5790c57575e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:00:21 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 55aff314-eb5e-4752-af9f-a4021e970cac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:00:21 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 608fbea2-b42b-4bb9-94a7-2b76dcdc2001 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:00:21 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:00:21 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 85b91251-9735-4812-9f11-003a7951a6f3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:00:21 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 473a30c4-5aa4-481c-8859-fda815d14872 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:00:21 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance afebffae-dbf6-4876-8c9f-0364f0fde49c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:00:21 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=71874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 16:00:21 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Final resource view: name=user phys_ram=16023MB used_ram=1920MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=71874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 16:00:21 user nova-compute[71874]: INFO nova.virt.block_device [None req-d8eb1b94-364c-4285-9f8a-15ad4eb217af tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] Booting with volume 863633c1-6f4e-41f5-b72c-91ca428b73b2 at /dev/vda
Apr 12 16:00:21 user nova-compute[71874]: DEBUG os_brick.utils [None req-d8eb1b94-364c-4285-9f8a-15ad4eb217af tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:00:21 user nova-compute[71874]: INFO oslo.privsep.daemon [None req-d8eb1b94-364c-4285-9f8a-15ad4eb217af tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmp36l_1ovk/privsep.sock']
Apr 12 16:00:21 user sudo[82381]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmp36l_1ovk/privsep.sock
Apr 12 16:00:21 user sudo[82381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Apr 12 16:00:21 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Inventory has not changed in ProviderTree for provider: 0e94b4c8-cd49-45e4-9133-d36eb4b2456b {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 16:00:21 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Inventory has not changed for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 16:00:21 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Compute_service record updated for user:user {{(pid=71874) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 16:00:21 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.693s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:00:21 user nova-compute[71874]: DEBUG nova.network.neutron [None req-d8eb1b94-364c-4285-9f8a-15ad4eb217af tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] Successfully created port: 567c632f-4b91-46d8-ade5-c694ee9023c1 {{(pid=71874) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 16:00:22 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:22 user nova-compute[71874]: DEBUG nova.network.neutron [None req-d8eb1b94-364c-4285-9f8a-15ad4eb217af tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] Successfully updated port: 567c632f-4b91-46d8-ade5-c694ee9023c1 {{(pid=71874) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 16:00:22 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8eb1b94-364c-4285-9f8a-15ad4eb217af tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Acquiring lock "refresh_cache-85b91251-9735-4812-9f11-003a7951a6f3" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:00:22 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8eb1b94-364c-4285-9f8a-15ad4eb217af tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Acquired lock "refresh_cache-85b91251-9735-4812-9f11-003a7951a6f3" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:00:22 user nova-compute[71874]: DEBUG nova.network.neutron [None req-d8eb1b94-364c-4285-9f8a-15ad4eb217af tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] Building network info cache for instance {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 16:00:22 user nova-compute[71874]: DEBUG nova.compute.manager [req-d5dbb82e-2fb3-43fc-80fb-179e854aa854 req-e11e9d6b-4166-4ca1-b927-1c45e86c353e service nova] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] Received event network-changed-567c632f-4b91-46d8-ade5-c694ee9023c1 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:00:22 user nova-compute[71874]: DEBUG nova.compute.manager [req-d5dbb82e-2fb3-43fc-80fb-179e854aa854 req-e11e9d6b-4166-4ca1-b927-1c45e86c353e service nova] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] Refreshing instance network info cache due to event network-changed-567c632f-4b91-46d8-ade5-c694ee9023c1. {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 16:00:22 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-d5dbb82e-2fb3-43fc-80fb-179e854aa854 req-e11e9d6b-4166-4ca1-b927-1c45e86c353e service nova] Acquiring lock "refresh_cache-85b91251-9735-4812-9f11-003a7951a6f3" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:00:22 user nova-compute[71874]: DEBUG nova.network.neutron [None req-d8eb1b94-364c-4285-9f8a-15ad4eb217af tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] Instance cache missing network info. {{(pid=71874) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 16:00:23 user sudo[82381]: pam_unix(sudo:session): session closed for user root
Apr 12 16:00:23 user nova-compute[71874]: INFO oslo.privsep.daemon [None req-d8eb1b94-364c-4285-9f8a-15ad4eb217af tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Spawned new privsep daemon via rootwrap
Apr 12 16:00:23 user nova-compute[71874]: INFO oslo.privsep.daemon [-] privsep daemon starting
Apr 12 16:00:23 user nova-compute[71874]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Apr 12 16:00:23 user nova-compute[71874]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Apr 12 16:00:23 user nova-compute[71874]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82384
Apr 12 16:00:23 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b1bb7b1-a7d0-4ba4-b67c-2b50025bad6c]: (2,) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:00:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:00:23 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[d82d7c6d-4e09-44fe-bb8f-6fc97621e377]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:61a48d4489d2\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:00:23 user nova-compute[71874]: WARNING os_brick.initiator.connectors.nvmeof [None req-d8eb1b94-364c-4285-9f8a-15ad4eb217af tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Apr 12 16:00:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:23 user nova-compute[71874]: DEBUG nova.network.neutron [None req-d8eb1b94-364c-4285-9f8a-15ad4eb217af tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] Updating instance_info_cache with network_info: [{"id": "567c632f-4b91-46d8-ade5-c694ee9023c1", "address": "fa:16:3e:d5:b1:e0", "network": {"id": "0b7c67f6-057a-4bb5-aa44-db5290d55865", "bridge": "br-int", "label": "tempest-TestShelveInstance-825161862-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a46b4e80a65541d6bab94b5edfc26e5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap567c632f-4b", "ovs_interfaceid": "567c632f-4b91-46d8-ade5-c694ee9023c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:00:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:00:23 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aa376db-337b-4766-b445-70f92ddfa20d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:00:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:23 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8eb1b94-364c-4285-9f8a-15ad4eb217af tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Releasing lock "refresh_cache-85b91251-9735-4812-9f11-003a7951a6f3" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:00:23 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8eb1b94-364c-4285-9f8a-15ad4eb217af tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] Instance network_info: |[{"id": "567c632f-4b91-46d8-ade5-c694ee9023c1", "address": "fa:16:3e:d5:b1:e0", "network": {"id": "0b7c67f6-057a-4bb5-aa44-db5290d55865", "bridge": "br-int", "label": "tempest-TestShelveInstance-825161862-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a46b4e80a65541d6bab94b5edfc26e5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap567c632f-4b", "ovs_interfaceid": "567c632f-4b91-46d8-ade5-c694ee9023c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 16:00:23 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-d5dbb82e-2fb3-43fc-80fb-179e854aa854 req-e11e9d6b-4166-4ca1-b927-1c45e86c353e service nova] Acquired lock "refresh_cache-85b91251-9735-4812-9f11-003a7951a6f3" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:00:23 user nova-compute[71874]: DEBUG nova.network.neutron [req-d5dbb82e-2fb3-43fc-80fb-179e854aa854 req-e11e9d6b-4166-4ca1-b927-1c45e86c353e service nova] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] Refreshing network info cache for port 567c632f-4b91-46d8-ade5-c694ee9023c1 {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 16:00:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:00:23 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[745ca178-da40-49a5-8bfc-df554ed541d2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:00:23 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[2555a242-96cb-493b-acbd-5c3aa442ee87]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:00:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8eb1b94-364c-4285-9f8a-15ad4eb217af tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Running cmd (subprocess): nvme version {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8eb1b94-364c-4285-9f8a-15ad4eb217af tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] 'nvme version' failed. Not Retrying. {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 16:00:23 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d8eb1b94-364c-4285-9f8a-15ad4eb217af tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] nvme not present on system {{(pid=71874) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 16:00:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 16:00:23 user nova-compute[71874]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 16:00:23 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[43679417-f182-4912-afb2-302a9461c425]: (4, '') {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:00:23 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.lightos [None req-d8eb1b94-364c-4285-9f8a-15ad4eb217af tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71874) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 16:00:23 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.lightos [None req-d8eb1b94-364c-4285-9f8a-15ad4eb217af tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71874) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 16:00:23 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.lightos [None req-d8eb1b94-364c-4285-9f8a-15ad4eb217af tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] LIGHTOS: no hostnqn found. {{(pid=71874) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 16:00:23 user nova-compute[71874]: DEBUG os_brick.utils [None req-d8eb1b94-364c-4285-9f8a-15ad4eb217af tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] <== get_connector_properties: return (2187ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:61a48d4489d2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:00:23 user nova-compute[71874]: DEBUG nova.virt.block_device [None req-d8eb1b94-364c-4285-9f8a-15ad4eb217af tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] Updating existing volume attachment record: eb8d9877-9f4d-4742-bc15-4ab4460b6e36 {{(pid=71874) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 16:00:23 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:24 user nova-compute[71874]: DEBUG nova.network.neutron [req-d5dbb82e-2fb3-43fc-80fb-179e854aa854 req-e11e9d6b-4166-4ca1-b927-1c45e86c353e service nova] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] Updated VIF entry in instance network info cache for port 567c632f-4b91-46d8-ade5-c694ee9023c1. {{(pid=71874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 16:00:24 user nova-compute[71874]: DEBUG nova.network.neutron [req-d5dbb82e-2fb3-43fc-80fb-179e854aa854 req-e11e9d6b-4166-4ca1-b927-1c45e86c353e service nova] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] Updating instance_info_cache with network_info: [{"id": "567c632f-4b91-46d8-ade5-c694ee9023c1", "address": "fa:16:3e:d5:b1:e0", "network": {"id": "0b7c67f6-057a-4bb5-aa44-db5290d55865", "bridge": "br-int", "label": "tempest-TestShelveInstance-825161862-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a46b4e80a65541d6bab94b5edfc26e5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap567c632f-4b", "ovs_interfaceid": "567c632f-4b91-46d8-ade5-c694ee9023c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:00:24 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-d5dbb82e-2fb3-43fc-80fb-179e854aa854 req-e11e9d6b-4166-4ca1-b927-1c45e86c353e service nova] Releasing lock "refresh_cache-85b91251-9735-4812-9f11-003a7951a6f3" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:00:27 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:28 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8eb1b94-364c-4285-9f8a-15ad4eb217af tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] Start spawning the instance on the hypervisor. {{(pid=71874) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 16:00:28 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d8eb1b94-364c-4285-9f8a-15ad4eb217af tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] Creating instance directory {{(pid=71874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 16:00:28 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-d8eb1b94-364c-4285-9f8a-15ad4eb217af tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] Creating image(s)
Apr 12 16:00:28 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d8eb1b94-364c-4285-9f8a-15ad4eb217af tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] Did not create local disks {{(pid=71874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 12 16:00:28 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d8eb1b94-364c-4285-9f8a-15ad4eb217af tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] Ensure instance console log exists: /opt/stack/data/nova/instances/85b91251-9735-4812-9f11-003a7951a6f3/console.log {{(pid=71874) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 16:00:28 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8eb1b94-364c-4285-9f8a-15ad4eb217af tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:00:28 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8eb1b94-364c-4285-9f8a-15ad4eb217af tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:00:28 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8eb1b94-364c-4285-9f8a-15ad4eb217af tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:00:28 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d8eb1b94-364c-4285-9f8a-15ad4eb217af tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] Start _get_guest_xml network_info=[{"id": "567c632f-4b91-46d8-ade5-c694ee9023c1", "address": "fa:16:3e:d5:b1:e0", "network": {"id": "0b7c67f6-057a-4bb5-aa44-db5290d55865", "bridge": "br-int", "label": "tempest-TestShelveInstance-825161862-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a46b4e80a65541d6bab94b5edfc26e5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap567c632f-4b", "ovs_interfaceid": "567c632f-4b91-46d8-ade5-c694ee9023c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'delete_on_termination': True, 'attachment_id': 'eb8d9877-9f4d-4742-bc15-4ab4460b6e36', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xHtihcnd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '85b91251-9735-4812-9f11-003a7951a6f3', 'attached_at': '', 'detached_at': '', 'volume_id': '863633c1-6f4e-41f5-b72c-91ca428b73b2', 'serial': '863633c1-6f4e-41f5-b72c-91ca428b73b2'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'volume_type': None} {{(pid=71874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 16:00:28 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-d8eb1b94-364c-4285-9f8a-15ad4eb217af tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:00:28 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-d8eb1b94-364c-4285-9f8a-15ad4eb217af tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:00:28 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d8eb1b94-364c-4285-9f8a-15ad4eb217af tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71874) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 16:00:28 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-d8eb1b94-364c-4285-9f8a-15ad4eb217af tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T15:56:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 16:00:28 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-d8eb1b94-364c-4285-9f8a-15ad4eb217af tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Flavor limits 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 16:00:28 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-d8eb1b94-364c-4285-9f8a-15ad4eb217af tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Image limits 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 16:00:28 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-d8eb1b94-364c-4285-9f8a-15ad4eb217af tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Flavor pref 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 16:00:28 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-d8eb1b94-364c-4285-9f8a-15ad4eb217af tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Image pref 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 16:00:28 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-d8eb1b94-364c-4285-9f8a-15ad4eb217af tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 16:00:28 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-d8eb1b94-364c-4285-9f8a-15ad4eb217af tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 16:00:28 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-d8eb1b94-364c-4285-9f8a-15ad4eb217af tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 16:00:28 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-d8eb1b94-364c-4285-9f8a-15ad4eb217af tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Got 1 possible topologies {{(pid=71874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 16:00:28 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-d8eb1b94-364c-4285-9f8a-15ad4eb217af tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 16:00:28 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-d8eb1b94-364c-4285-9f8a-15ad4eb217af tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 16:00:28 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8eb1b94-364c-4285-9f8a-15ad4eb217af tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:00:28 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8eb1b94-364c-4285-9f8a-15ad4eb217af tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:00:28 user nova-compute[71874]: DEBUG os_brick.initiator.connector [None req-d8eb1b94-364c-4285-9f8a-15ad4eb217af tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Factory for ISCSI on None {{(pid=71874) factory /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connector.py:281}}
Apr 12 16:00:28 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8eb1b94-364c-4285-9f8a-15ad4eb217af tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.004s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:00:28 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d8eb1b94-364c-4285-9f8a-15ad4eb217af tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] Calling os-brick to attach iSCSI Volume {{(pid=71874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 16:00:28 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8eb1b94-364c-4285-9f8a-15ad4eb217af tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3c0216320>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xHtihcnd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:00:28 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-d8eb1b94-364c-4285-9f8a-15ad4eb217af tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:00:28 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-d8eb1b94-364c-4285-9f8a-15ad4eb217af tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:00:28 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-d8eb1b94-364c-4285-9f8a-15ad4eb217af tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:00:28 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-d8eb1b94-364c-4285-9f8a-15ad4eb217af tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:00:28 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-d8eb1b94-364c-4285-9f8a-15ad4eb217af tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:00:28 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-d8eb1b94-364c-4285-9f8a-15ad4eb217af tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:00:28 user nova-compute[71874]: INFO os_brick.initiator.connectors.iscsi [None req-d8eb1b94-364c-4285-9f8a-15ad4eb217af tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 16:00:28 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 -p 172.16.0.220:3260 {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:28 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:00:28 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[45c36538-3eb4-44bd-8fac-8fa6006c7de5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:00:28 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8eb1b94-364c-4285-9f8a-15ad4eb217af tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 16:00:28 user nova-compute[71874]:  {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:00:28 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 -p 172.16.0.220:3260 --interface default --op new {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:28 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:00:28 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3a2c3ee-a235-4014-8c14-895557616812]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2] added\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:00:28 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8eb1b94-364c-4285-9f8a-15ad4eb217af tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2] added
Apr 12 16:00:28 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:00:28 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:28 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:00:28 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[19c87c6b-b6af-4ba0-86b0-013fa0cd27e3]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:00:28 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8eb1b94-364c-4285-9f8a-15ad4eb217af tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:00:28 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:28 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:28 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:00:28 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8385bdf-9d17-4d15-a50e-4c752fa0b70f]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:00:28 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8eb1b94-364c-4285-9f8a-15ad4eb217af tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:00:28 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xHtihcnd {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:28 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xHtihcnd" returned: 0 in 0.032s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:00:28 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[8af33823-fda0-4667-97c6-cbd0ac4f91ce]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:00:28 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8eb1b94-364c-4285-9f8a-15ad4eb217af tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xHtihcnd'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:00:28 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:28 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:00:28 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[53217e8a-cd37-45b5-8ff8-798ea37e8d05]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:00:28 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8eb1b94-364c-4285-9f8a-15ad4eb217af tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:00:28 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:28 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:00:28 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1cffc1e-75be-4590-8326-d4b70d002dbd]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:00:28 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8eb1b94-364c-4285-9f8a-15ad4eb217af tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 12 16:00:28 user nova-compute[71874]:  {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:00:28 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8eb1b94-364c-4285-9f8a-15ad4eb217af tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 12 16:00:28 user nova-compute[71874]:  {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:00:28 user nova-compute[71874]: WARNING os_brick.initiator.connectors.iscsi [None req-d8eb1b94-364c-4285-9f8a-15ad4eb217af tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 12 16:00:28 user nova-compute[71874]: 
Apr 12 16:00:28 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 -p 172.16.0.220:3260 --login {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:28 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:00:28 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7a58c7a-ec06-472c-88dc-d76dba9cc19b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:00:28 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8eb1b94-364c-4285-9f8a-15ad4eb217af tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2, portal: 172.16.0.220,3260]
Apr 12 16:00:28 user nova-compute[71874]: Login to [iface: default, target: iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2, portal: 172.16.0.220,3260] successful.
Apr 12 16:00:28 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:00:28 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:29 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:00:29 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[de5d63e3-6cb7-4fa2-929d-5f228c614aac]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:00:29 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8eb1b94-364c-4285-9f8a-15ad4eb217af tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:00:29 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:29 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:00:29 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc369610-0ce4-41c6-8c0b-c3e418ca2580]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:00:29 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8eb1b94-364c-4285-9f8a-15ad4eb217af tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 (non-flash)
Apr 12 16:00:29 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:00:29 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8eb1b94-364c-4285-9f8a-15ad4eb217af tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 (non-flash)
Apr 12 16:00:29 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:00:29 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-d8eb1b94-364c-4285-9f8a-15ad4eb217af tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:00:29 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8eb1b94-364c-4285-9f8a-15ad4eb217af tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Connected to 172.16.0.220:3260 {{(pid=71874) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 16:00:29 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-d8eb1b94-364c-4285-9f8a-15ad4eb217af tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=71874) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 16:00:29 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-d8eb1b94-364c-4285-9f8a-15ad4eb217af tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71874) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 16:00:29 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:29 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:00:29 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d530586-e0f4-4457-b045-f500636c5732]: (4, ('- - 0', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:00:29 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-d8eb1b94-364c-4285-9f8a-15ad4eb217af tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71874) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 16:00:29 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8eb1b94-364c-4285-9f8a-15ad4eb217af tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xHtihcnd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71874) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 16:00:30 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-d8eb1b94-364c-4285-9f8a-15ad4eb217af tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.321s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:00:30 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8eb1b94-364c-4285-9f8a-15ad4eb217af tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] <== connect_volume: return (1323ms) {'type': 'block', 'scsi_wwn': '26462626239333262', 'path': '/dev/sdb'} {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:00:30 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d8eb1b94-364c-4285-9f8a-15ad4eb217af tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26462626239333262', 'path': '/dev/sdb'} {{(pid=71874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 16:00:30 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-d8eb1b94-364c-4285-9f8a-15ad4eb217af tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T16:00:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1745076225',display_name='tempest-TestShelveInstance-server-1745076225',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1745076225',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGrjGxRBnu9rsB4dVnF551Ir+USJO3Xww91Gyq7pzJHhLIC+yf3sqYFIB7zX6y2mMrg16l4hILlV14T+O7phmEsFD6kmLB6HpztKchow4NACtmWzqkjfiJtDlHrmoWu0KQ==',key_name='tempest-TestShelveInstance-509475392',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a46b4e80a65541d6bab94b5edfc26e5b',ramdisk_id='',reservation_id='r-ffojuop7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-346701715',owner_user_name='tempest-TestShelveInstance-346701715-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T16:00:21Z,user_data=None,user_id='6acbd977c4b4494db95f879777184489',uuid=85b91251-9735-4812-9f11-003a7951a6f3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "567c632f-4b91-46d8-ade5-c694ee9023c1", "address": "fa:16:3e:d5:b1:e0", "network": {"id": "0b7c67f6-057a-4bb5-aa44-db5290d55865", "bridge": "br-int", "label": "tempest-TestShelveInstance-825161862-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a46b4e80a65541d6bab94b5edfc26e5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap567c632f-4b", "ovs_interfaceid": "567c632f-4b91-46d8-ade5-c694ee9023c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 16:00:30 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-d8eb1b94-364c-4285-9f8a-15ad4eb217af tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Converting VIF {"id": "567c632f-4b91-46d8-ade5-c694ee9023c1", "address": "fa:16:3e:d5:b1:e0", "network": {"id": "0b7c67f6-057a-4bb5-aa44-db5290d55865", "bridge": "br-int", "label": "tempest-TestShelveInstance-825161862-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a46b4e80a65541d6bab94b5edfc26e5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap567c632f-4b", "ovs_interfaceid": "567c632f-4b91-46d8-ade5-c694ee9023c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:00:30 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-d8eb1b94-364c-4285-9f8a-15ad4eb217af tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:b1:e0,bridge_name='br-int',has_traffic_filtering=True,id=567c632f-4b91-46d8-ade5-c694ee9023c1,network=Network(0b7c67f6-057a-4bb5-aa44-db5290d55865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap567c632f-4b') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:00:30 user nova-compute[71874]: DEBUG nova.objects.instance [None req-d8eb1b94-364c-4285-9f8a-15ad4eb217af tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Lazy-loading 'pci_devices' on Instance uuid 85b91251-9735-4812-9f11-003a7951a6f3 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:00:30 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d8eb1b94-364c-4285-9f8a-15ad4eb217af tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] End _get_guest_xml xml=<domain type="kvm">
Apr 12 16:00:30 user nova-compute[71874]:   <uuid>85b91251-9735-4812-9f11-003a7951a6f3</uuid>
Apr 12 16:00:30 user nova-compute[71874]:   <name>instance-0000000b</name>
Apr 12 16:00:30 user nova-compute[71874]:   <memory>131072</memory>
Apr 12 16:00:30 user nova-compute[71874]:   <vcpu>1</vcpu>
Apr 12 16:00:30 user nova-compute[71874]:   <metadata>
Apr 12 16:00:30 user nova-compute[71874]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 16:00:30 user nova-compute[71874]:       <nova:package version="0.0.0"/>
Apr 12 16:00:30 user nova-compute[71874]:       <nova:name>tempest-TestShelveInstance-server-1745076225</nova:name>
Apr 12 16:00:30 user nova-compute[71874]:       <nova:creationTime>2023-04-12 16:00:28</nova:creationTime>
Apr 12 16:00:30 user nova-compute[71874]:       <nova:flavor name="m1.nano">
Apr 12 16:00:30 user nova-compute[71874]:         <nova:memory>128</nova:memory>
Apr 12 16:00:30 user nova-compute[71874]:         <nova:disk>1</nova:disk>
Apr 12 16:00:30 user nova-compute[71874]:         <nova:swap>0</nova:swap>
Apr 12 16:00:30 user nova-compute[71874]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 16:00:30 user nova-compute[71874]:         <nova:vcpus>1</nova:vcpus>
Apr 12 16:00:30 user nova-compute[71874]:       </nova:flavor>
Apr 12 16:00:30 user nova-compute[71874]:       <nova:owner>
Apr 12 16:00:30 user nova-compute[71874]:         <nova:user uuid="6acbd977c4b4494db95f879777184489">tempest-TestShelveInstance-346701715-project-member</nova:user>
Apr 12 16:00:30 user nova-compute[71874]:         <nova:project uuid="a46b4e80a65541d6bab94b5edfc26e5b">tempest-TestShelveInstance-346701715</nova:project>
Apr 12 16:00:30 user nova-compute[71874]:       </nova:owner>
Apr 12 16:00:30 user nova-compute[71874]:       <nova:ports>
Apr 12 16:00:30 user nova-compute[71874]:         <nova:port uuid="567c632f-4b91-46d8-ade5-c694ee9023c1">
Apr 12 16:00:30 user nova-compute[71874]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 12 16:00:30 user nova-compute[71874]:         </nova:port>
Apr 12 16:00:30 user nova-compute[71874]:       </nova:ports>
Apr 12 16:00:30 user nova-compute[71874]:     </nova:instance>
Apr 12 16:00:30 user nova-compute[71874]:   </metadata>
Apr 12 16:00:30 user nova-compute[71874]:   <sysinfo type="smbios">
Apr 12 16:00:30 user nova-compute[71874]:     <system>
Apr 12 16:00:30 user nova-compute[71874]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 16:00:30 user nova-compute[71874]:       <entry name="product">OpenStack Nova</entry>
Apr 12 16:00:30 user nova-compute[71874]:       <entry name="version">0.0.0</entry>
Apr 12 16:00:30 user nova-compute[71874]:       <entry name="serial">85b91251-9735-4812-9f11-003a7951a6f3</entry>
Apr 12 16:00:30 user nova-compute[71874]:       <entry name="uuid">85b91251-9735-4812-9f11-003a7951a6f3</entry>
Apr 12 16:00:30 user nova-compute[71874]:       <entry name="family">Virtual Machine</entry>
Apr 12 16:00:30 user nova-compute[71874]:     </system>
Apr 12 16:00:30 user nova-compute[71874]:   </sysinfo>
Apr 12 16:00:30 user nova-compute[71874]:   <os>
Apr 12 16:00:30 user nova-compute[71874]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 16:00:30 user nova-compute[71874]:     <boot dev="hd"/>
Apr 12 16:00:30 user nova-compute[71874]:     <smbios mode="sysinfo"/>
Apr 12 16:00:30 user nova-compute[71874]:   </os>
Apr 12 16:00:30 user nova-compute[71874]:   <features>
Apr 12 16:00:30 user nova-compute[71874]:     <acpi/>
Apr 12 16:00:30 user nova-compute[71874]:     <apic/>
Apr 12 16:00:30 user nova-compute[71874]:     <vmcoreinfo/>
Apr 12 16:00:30 user nova-compute[71874]:   </features>
Apr 12 16:00:30 user nova-compute[71874]:   <clock offset="utc">
Apr 12 16:00:30 user nova-compute[71874]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 16:00:30 user nova-compute[71874]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 16:00:30 user nova-compute[71874]:     <timer name="hpet" present="no"/>
Apr 12 16:00:30 user nova-compute[71874]:   </clock>
Apr 12 16:00:30 user nova-compute[71874]:   <cpu mode="custom" match="exact">
Apr 12 16:00:30 user nova-compute[71874]:     <model>Nehalem</model>
Apr 12 16:00:30 user nova-compute[71874]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 16:00:30 user nova-compute[71874]:   </cpu>
Apr 12 16:00:30 user nova-compute[71874]:   <devices>
Apr 12 16:00:30 user nova-compute[71874]:     <disk type="block" device="disk">
Apr 12 16:00:30 user nova-compute[71874]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 16:00:30 user nova-compute[71874]:       <source dev="/dev/sdb"/>
Apr 12 16:00:30 user nova-compute[71874]:       <target dev="vda" bus="virtio"/>
Apr 12 16:00:30 user nova-compute[71874]:       <serial>863633c1-6f4e-41f5-b72c-91ca428b73b2</serial>
Apr 12 16:00:30 user nova-compute[71874]:     </disk>
Apr 12 16:00:30 user nova-compute[71874]:     <interface type="ethernet">
Apr 12 16:00:30 user nova-compute[71874]:       <mac address="fa:16:3e:d5:b1:e0"/>
Apr 12 16:00:30 user nova-compute[71874]:       <model type="virtio"/>
Apr 12 16:00:30 user nova-compute[71874]:       <mtu size="1442"/>
Apr 12 16:00:30 user nova-compute[71874]:       <target dev="tap567c632f-4b"/>
Apr 12 16:00:30 user nova-compute[71874]:     </interface>
Apr 12 16:00:30 user nova-compute[71874]:     <serial type="pty">
Apr 12 16:00:30 user nova-compute[71874]:       <log file="/opt/stack/data/nova/instances/85b91251-9735-4812-9f11-003a7951a6f3/console.log" append="off"/>
Apr 12 16:00:30 user nova-compute[71874]:     </serial>
Apr 12 16:00:30 user nova-compute[71874]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 16:00:30 user nova-compute[71874]:     <video>
Apr 12 16:00:30 user nova-compute[71874]:       <model type="virtio"/>
Apr 12 16:00:30 user nova-compute[71874]:     </video>
Apr 12 16:00:30 user nova-compute[71874]:     <rng model="virtio">
Apr 12 16:00:30 user nova-compute[71874]:       <backend model="random">/dev/urandom</backend>
Apr 12 16:00:30 user nova-compute[71874]:     </rng>
Apr 12 16:00:30 user nova-compute[71874]:     <controller type="usb" index="0" model="none"/>
Apr 12 16:00:30 user nova-compute[71874]:     <memballoon model="virtio">
Apr 12 16:00:30 user nova-compute[71874]:       <stats period="10"/>
Apr 12 16:00:30 user nova-compute[71874]:     </memballoon>
Apr 12 16:00:30 user nova-compute[71874]:   </devices>
Apr 12 16:00:30 user nova-compute[71874]: </domain>
Apr 12 16:00:30 user nova-compute[71874]:  {{(pid=71874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 16:00:30 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-d8eb1b94-364c-4285-9f8a-15ad4eb217af tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T16:00:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1745076225',display_name='tempest-TestShelveInstance-server-1745076225',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1745076225',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGrjGxRBnu9rsB4dVnF551Ir+USJO3Xww91Gyq7pzJHhLIC+yf3sqYFIB7zX6y2mMrg16l4hILlV14T+O7phmEsFD6kmLB6HpztKchow4NACtmWzqkjfiJtDlHrmoWu0KQ==',key_name='tempest-TestShelveInstance-509475392',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a46b4e80a65541d6bab94b5edfc26e5b',ramdisk_id='',reservation_id='r-ffojuop7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-346701715',owner_user_name='tempest-TestShelveInstance-346701715-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T16:00:21Z,user_data=None,user_id='6acbd977c4b4494db95f879777184489',uuid=85b91251-9735-4812-9f11-003a7951a6f3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "567c632f-4b91-46d8-ade5-c694ee9023c1", "address": "fa:16:3e:d5:b1:e0", "network": {"id": "0b7c67f6-057a-4bb5-aa44-db5290d55865", "bridge": "br-int", "label": "tempest-TestShelveInstance-825161862-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a46b4e80a65541d6bab94b5edfc26e5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap567c632f-4b", "ovs_interfaceid": "567c632f-4b91-46d8-ade5-c694ee9023c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 16:00:30 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-d8eb1b94-364c-4285-9f8a-15ad4eb217af tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Converting VIF {"id": "567c632f-4b91-46d8-ade5-c694ee9023c1", "address": "fa:16:3e:d5:b1:e0", "network": {"id": "0b7c67f6-057a-4bb5-aa44-db5290d55865", "bridge": "br-int", "label": "tempest-TestShelveInstance-825161862-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a46b4e80a65541d6bab94b5edfc26e5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap567c632f-4b", "ovs_interfaceid": "567c632f-4b91-46d8-ade5-c694ee9023c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:00:30 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-d8eb1b94-364c-4285-9f8a-15ad4eb217af tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:b1:e0,bridge_name='br-int',has_traffic_filtering=True,id=567c632f-4b91-46d8-ade5-c694ee9023c1,network=Network(0b7c67f6-057a-4bb5-aa44-db5290d55865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap567c632f-4b') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:00:30 user nova-compute[71874]: DEBUG os_vif [None req-d8eb1b94-364c-4285-9f8a-15ad4eb217af tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:b1:e0,bridge_name='br-int',has_traffic_filtering=True,id=567c632f-4b91-46d8-ade5-c694ee9023c1,network=Network(0b7c67f6-057a-4bb5-aa44-db5290d55865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap567c632f-4b') {{(pid=71874) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 16:00:30 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:30 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:00:30 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 16:00:30 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:30 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap567c632f-4b, may_exist=True) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:00:30 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap567c632f-4b, col_values=(('external_ids', {'iface-id': '567c632f-4b91-46d8-ade5-c694ee9023c1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d5:b1:e0', 'vm-uuid': '85b91251-9735-4812-9f11-003a7951a6f3'}),)) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:00:30 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:30 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:00:30 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:30 user nova-compute[71874]: INFO os_vif [None req-d8eb1b94-364c-4285-9f8a-15ad4eb217af tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:b1:e0,bridge_name='br-int',has_traffic_filtering=True,id=567c632f-4b91-46d8-ade5-c694ee9023c1,network=Network(0b7c67f6-057a-4bb5-aa44-db5290d55865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap567c632f-4b')
Apr 12 16:00:30 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d8eb1b94-364c-4285-9f8a-15ad4eb217af tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] No BDM found with device name vda, not building metadata. {{(pid=71874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 16:00:30 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d8eb1b94-364c-4285-9f8a-15ad4eb217af tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] No VIF found with MAC fa:16:3e:d5:b1:e0, not building metadata {{(pid=71874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 16:00:30 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Acquiring lock "026ab036-1481-4689-af70-661493e9451c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:00:30 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Lock "026ab036-1481-4689-af70-661493e9451c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:00:30 user nova-compute[71874]: DEBUG nova.compute.manager [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] [instance: 026ab036-1481-4689-af70-661493e9451c] Starting instance... {{(pid=71874) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 16:00:30 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:00:30 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:00:30 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71874) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 16:00:30 user nova-compute[71874]: INFO nova.compute.claims [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] [instance: 026ab036-1481-4689-af70-661493e9451c] Claim successful on node user
Apr 12 16:00:31 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Inventory has not changed in ProviderTree for provider: 0e94b4c8-cd49-45e4-9133-d36eb4b2456b {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 16:00:31 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Inventory has not changed for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 16:00:31 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.428s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:00:31 user nova-compute[71874]: DEBUG nova.compute.manager [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] [instance: 026ab036-1481-4689-af70-661493e9451c] Start building networks asynchronously for instance. {{(pid=71874) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 16:00:31 user nova-compute[71874]: DEBUG nova.compute.manager [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] [instance: 026ab036-1481-4689-af70-661493e9451c] Allocating IP information in the background. {{(pid=71874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 16:00:31 user nova-compute[71874]: DEBUG nova.network.neutron [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] [instance: 026ab036-1481-4689-af70-661493e9451c] allocate_for_instance() {{(pid=71874) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 16:00:31 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] [instance: 026ab036-1481-4689-af70-661493e9451c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 16:00:31 user nova-compute[71874]: DEBUG nova.compute.manager [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] [instance: 026ab036-1481-4689-af70-661493e9451c] Start building block device mappings for instance. {{(pid=71874) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 16:00:31 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:31 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:31 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:31 user nova-compute[71874]: INFO nova.virt.block_device [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] [instance: 026ab036-1481-4689-af70-661493e9451c] Booting with volume b2fde1cb-bd86-48a5-8aca-463fdf3444b0 at /dev/vda
Apr 12 16:00:31 user nova-compute[71874]: DEBUG os_brick.utils [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:00:31 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:31 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:00:31 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcde7e8f-132f-4fca-8fbb-543e6f69689a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:61a48d4489d2\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:00:31 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:31 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:00:31 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d371a47-818b-4f8b-b9dd-5f8310672ac3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:00:31 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:31 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:00:31 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[146bd3bc-11d5-44ab-af8d-7392f6df8277]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:00:31 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd4d0aed-3f8b-46b4-b91b-e30e8eca3e18]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:00:31 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Running cmd (subprocess): nvme version {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:31 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] 'nvme version' failed. Not Retrying. {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 16:00:31 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.nvmeof [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] nvme not present on system {{(pid=71874) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 16:00:31 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:31 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 16:00:31 user nova-compute[71874]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 16:00:31 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[3629c66b-9695-4a58-b720-cf8062394f01]: (4, '') {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:00:31 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.lightos [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71874) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 16:00:31 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.lightos [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71874) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 16:00:31 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.lightos [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] LIGHTOS: no hostnqn found. {{(pid=71874) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 16:00:31 user nova-compute[71874]: DEBUG os_brick.utils [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:61a48d4489d2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:00:31 user nova-compute[71874]: DEBUG nova.virt.block_device [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] [instance: 026ab036-1481-4689-af70-661493e9451c] Updating existing volume attachment record: 417a5322-fef2-439c-a3ba-442371f77f83 {{(pid=71874) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 16:00:32 user nova-compute[71874]: DEBUG nova.policy [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '896a788283bf4e88b30528ef2721e90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14aea401da6344858416fd2543bc10ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71874) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 16:00:32 user nova-compute[71874]: DEBUG nova.compute.manager [req-cac16505-dac9-45c7-a2be-8d1349733f65 req-f04c6ba5-4308-43e2-a38d-5946a3dbdcd8 service nova] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] Received event network-vif-plugged-567c632f-4b91-46d8-ade5-c694ee9023c1 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:00:32 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-cac16505-dac9-45c7-a2be-8d1349733f65 req-f04c6ba5-4308-43e2-a38d-5946a3dbdcd8 service nova] Acquiring lock "85b91251-9735-4812-9f11-003a7951a6f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:00:32 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-cac16505-dac9-45c7-a2be-8d1349733f65 req-f04c6ba5-4308-43e2-a38d-5946a3dbdcd8 service nova] Lock "85b91251-9735-4812-9f11-003a7951a6f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:00:32 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-cac16505-dac9-45c7-a2be-8d1349733f65 req-f04c6ba5-4308-43e2-a38d-5946a3dbdcd8 service nova] Lock "85b91251-9735-4812-9f11-003a7951a6f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:00:32 user nova-compute[71874]: DEBUG nova.compute.manager [req-cac16505-dac9-45c7-a2be-8d1349733f65 req-f04c6ba5-4308-43e2-a38d-5946a3dbdcd8 service nova] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] No waiting events found dispatching network-vif-plugged-567c632f-4b91-46d8-ade5-c694ee9023c1 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:00:32 user nova-compute[71874]: WARNING nova.compute.manager [req-cac16505-dac9-45c7-a2be-8d1349733f65 req-f04c6ba5-4308-43e2-a38d-5946a3dbdcd8 service nova] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] Received unexpected event network-vif-plugged-567c632f-4b91-46d8-ade5-c694ee9023c1 for instance with vm_state building and task_state spawning.
Apr 12 16:00:32 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:32 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:32 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:32 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:33 user nova-compute[71874]: DEBUG nova.network.neutron [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] [instance: 026ab036-1481-4689-af70-661493e9451c] Successfully created port: 0d6194a7-a3c4-47f9-8c37-960cb622ce28 {{(pid=71874) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 16:00:33 user nova-compute[71874]: DEBUG nova.virt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Emitting event <LifecycleEvent: 1681315233.8072891, 85b91251-9735-4812-9f11-003a7951a6f3 => Resumed> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:00:33 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] VM Resumed (Lifecycle Event)
Apr 12 16:00:33 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8eb1b94-364c-4285-9f8a-15ad4eb217af tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] Instance event wait completed in 0 seconds for  {{(pid=71874) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 16:00:33 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d8eb1b94-364c-4285-9f8a-15ad4eb217af tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] Guest created on hypervisor {{(pid=71874) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 16:00:33 user nova-compute[71874]: INFO nova.virt.libvirt.driver [-] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] Instance spawned successfully.
Apr 12 16:00:33 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d8eb1b94-364c-4285-9f8a-15ad4eb217af tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 16:00:33 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:00:33 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 16:00:33 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d8eb1b94-364c-4285-9f8a-15ad4eb217af tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] Found default for hw_cdrom_bus of ide {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:00:33 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d8eb1b94-364c-4285-9f8a-15ad4eb217af tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] Found default for hw_disk_bus of virtio {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:00:33 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d8eb1b94-364c-4285-9f8a-15ad4eb217af tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] Found default for hw_input_bus of None {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:00:33 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d8eb1b94-364c-4285-9f8a-15ad4eb217af tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] Found default for hw_pointer_model of None {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:00:33 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d8eb1b94-364c-4285-9f8a-15ad4eb217af tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] Found default for hw_video_model of virtio {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:00:33 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d8eb1b94-364c-4285-9f8a-15ad4eb217af tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] Found default for hw_vif_model of virtio {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:00:33 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 16:00:33 user nova-compute[71874]: DEBUG nova.virt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Emitting event <LifecycleEvent: 1681315233.810115, 85b91251-9735-4812-9f11-003a7951a6f3 => Started> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:00:33 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] VM Started (Lifecycle Event)
Apr 12 16:00:33 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:00:33 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 16:00:33 user nova-compute[71874]: INFO nova.compute.manager [None req-d8eb1b94-364c-4285-9f8a-15ad4eb217af tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] Took 5.24 seconds to spawn the instance on the hypervisor.
Apr 12 16:00:33 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8eb1b94-364c-4285-9f8a-15ad4eb217af tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:00:33 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 16:00:34 user nova-compute[71874]: INFO nova.compute.manager [None req-d8eb1b94-364c-4285-9f8a-15ad4eb217af tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] Took 14.88 seconds to build instance.
Apr 12 16:00:34 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8eb1b94-364c-4285-9f8a-15ad4eb217af tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Lock "85b91251-9735-4812-9f11-003a7951a6f3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.190s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:00:34 user nova-compute[71874]: DEBUG nova.compute.manager [req-3a1db241-96e4-46fd-8573-afcab837d432 req-ac112e76-a5b6-4e7a-a004-e7068bba435c service nova] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] Received event network-vif-plugged-567c632f-4b91-46d8-ade5-c694ee9023c1 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:00:34 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-3a1db241-96e4-46fd-8573-afcab837d432 req-ac112e76-a5b6-4e7a-a004-e7068bba435c service nova] Acquiring lock "85b91251-9735-4812-9f11-003a7951a6f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:00:34 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-3a1db241-96e4-46fd-8573-afcab837d432 req-ac112e76-a5b6-4e7a-a004-e7068bba435c service nova] Lock "85b91251-9735-4812-9f11-003a7951a6f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:00:34 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-3a1db241-96e4-46fd-8573-afcab837d432 req-ac112e76-a5b6-4e7a-a004-e7068bba435c service nova] Lock "85b91251-9735-4812-9f11-003a7951a6f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:00:34 user nova-compute[71874]: DEBUG nova.compute.manager [req-3a1db241-96e4-46fd-8573-afcab837d432 req-ac112e76-a5b6-4e7a-a004-e7068bba435c service nova] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] No waiting events found dispatching network-vif-plugged-567c632f-4b91-46d8-ade5-c694ee9023c1 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:00:34 user nova-compute[71874]: WARNING nova.compute.manager [req-3a1db241-96e4-46fd-8573-afcab837d432 req-ac112e76-a5b6-4e7a-a004-e7068bba435c service nova] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] Received unexpected event network-vif-plugged-567c632f-4b91-46d8-ade5-c694ee9023c1 for instance with vm_state active and task_state None.
Apr 12 16:00:34 user nova-compute[71874]: DEBUG nova.network.neutron [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] [instance: 026ab036-1481-4689-af70-661493e9451c] Successfully created port: 264de72a-d4f4-4a6a-b3ab-1e8ea8b9a30b {{(pid=71874) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 16:00:35 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:35 user nova-compute[71874]: DEBUG nova.network.neutron [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] [instance: 026ab036-1481-4689-af70-661493e9451c] Successfully created port: e3f484fe-17dd-4cef-babd-ad78cf557b03 {{(pid=71874) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 16:00:36 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Acquiring lock "9ea56377-20bc-48cc-a248-5fad6db060cb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:00:36 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Lock "9ea56377-20bc-48cc-a248-5fad6db060cb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:00:36 user nova-compute[71874]: DEBUG nova.compute.manager [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Starting instance... {{(pid=71874) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 16:00:36 user nova-compute[71874]: DEBUG nova.network.neutron [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] [instance: 026ab036-1481-4689-af70-661493e9451c] Successfully created port: 0b2175eb-de94-4274-b200-14894dbcbda0 {{(pid=71874) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 16:00:36 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:00:36 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:00:36 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71874) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 16:00:36 user nova-compute[71874]: INFO nova.compute.claims [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Claim successful on node user
Apr 12 16:00:36 user nova-compute[71874]: INFO nova.virt.block_device [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] [instance: 026ab036-1481-4689-af70-661493e9451c] Booting with volume 33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4 at /dev/vdb
Apr 12 16:00:36 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Inventory has not changed in ProviderTree for provider: 0e94b4c8-cd49-45e4-9133-d36eb4b2456b {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 16:00:36 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Inventory has not changed for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 16:00:36 user nova-compute[71874]: DEBUG os_brick.utils [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:00:36 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:36 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:00:36 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0d6e08b-6bfc-4f01-bd86-c376c762b0aa]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:61a48d4489d2\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:00:36 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:36 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.502s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:00:36 user nova-compute[71874]: DEBUG nova.compute.manager [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Start building networks asynchronously for instance. {{(pid=71874) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 16:00:36 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:00:36 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b727971-4e68-499e-9984-6e2371a9dc1e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:00:36 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:36 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:00:36 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[646e309c-d7bd-40c9-b404-fe5af92b5090]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:00:36 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cc9557f-6cec-4896-a4ce-974929de644b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:00:36 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Running cmd (subprocess): nvme version {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:36 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] 'nvme version' failed. Not Retrying. {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 16:00:36 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.nvmeof [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] nvme not present on system {{(pid=71874) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 16:00:36 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:36 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 16:00:36 user nova-compute[71874]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 16:00:36 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[899d3a68-d3a8-48a3-98db-d7670099edc3]: (4, '') {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:00:36 user nova-compute[71874]: DEBUG nova.compute.manager [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Allocating IP information in the background. {{(pid=71874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 16:00:36 user nova-compute[71874]: DEBUG nova.network.neutron [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] allocate_for_instance() {{(pid=71874) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 16:00:36 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.lightos [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71874) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 16:00:36 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.lightos [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71874) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 16:00:36 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.lightos [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] LIGHTOS: no hostnqn found. {{(pid=71874) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 16:00:36 user nova-compute[71874]: DEBUG os_brick.utils [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:61a48d4489d2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:00:36 user nova-compute[71874]: DEBUG nova.virt.block_device [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] [instance: 026ab036-1481-4689-af70-661493e9451c] Updating existing volume attachment record: af84bd42-6519-44b4-9f12-e31317969fc2 {{(pid=71874) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 16:00:36 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 16:00:36 user nova-compute[71874]: DEBUG nova.compute.manager [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Start building block device mappings for instance. {{(pid=71874) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 16:00:37 user nova-compute[71874]: INFO nova.virt.block_device [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Booting with volume 5a3e6bdc-d274-4e4a-ac05-59caa88e13d4 at /dev/vda
Apr 12 16:00:37 user nova-compute[71874]: DEBUG nova.network.neutron [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] [instance: 026ab036-1481-4689-af70-661493e9451c] Successfully created port: 5796cf52-4e81-4c40-954e-86819f5557c8 {{(pid=71874) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 16:00:37 user nova-compute[71874]: DEBUG os_brick.utils [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:00:37 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:37 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:00:37 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b5e8402-96e0-4a89-8181-748231c14879]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:61a48d4489d2\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:00:37 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:37 user nova-compute[71874]: DEBUG nova.policy [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '51e8a84c876249dd9b588305926ffdff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020f60d454f846d5a18dfbe1d88b65da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71874) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 16:00:37 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:00:37 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e8d6510-e03a-4077-b88d-b33a68bb9326]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:00:37 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:37 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:00:37 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8c1999c-d279-4fcb-9627-9e65f1072e26]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:00:37 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[f56eb2bc-1779-428c-9d3f-9f3ca1f3eb69]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:00:37 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Running cmd (subprocess): nvme version {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:37 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] 'nvme version' failed. Not Retrying. {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 16:00:37 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.nvmeof [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] nvme not present on system {{(pid=71874) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 16:00:37 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:37 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 16:00:37 user nova-compute[71874]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 16:00:37 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[3df44743-055c-48a4-ae7d-bc95c714b66c]: (4, '') {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:00:37 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.lightos [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71874) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 16:00:37 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.lightos [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71874) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 16:00:37 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.lightos [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] LIGHTOS: no hostnqn found. {{(pid=71874) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 16:00:37 user nova-compute[71874]: DEBUG os_brick.utils [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:61a48d4489d2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:00:37 user nova-compute[71874]: DEBUG nova.virt.block_device [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Updating existing volume attachment record: a7c272d1-5f30-4faf-9e64-26cc177da72c {{(pid=71874) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 16:00:37 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:37 user nova-compute[71874]: DEBUG nova.network.neutron [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Successfully created port: 7ae43e60-f63a-448e-9a89-0d6bff272104 {{(pid=71874) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 16:00:37 user nova-compute[71874]: DEBUG nova.network.neutron [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] [instance: 026ab036-1481-4689-af70-661493e9451c] Successfully updated port: 0d6194a7-a3c4-47f9-8c37-960cb622ce28 {{(pid=71874) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 16:00:37 user nova-compute[71874]: DEBUG nova.compute.manager [req-65f09eaf-d15f-451a-82fd-9624cd7e60de req-66819754-7c36-4dfe-a6db-c27bd6d4ae5f service nova] [instance: 026ab036-1481-4689-af70-661493e9451c] Received event network-changed-0d6194a7-a3c4-47f9-8c37-960cb622ce28 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:00:37 user nova-compute[71874]: DEBUG nova.compute.manager [req-65f09eaf-d15f-451a-82fd-9624cd7e60de req-66819754-7c36-4dfe-a6db-c27bd6d4ae5f service nova] [instance: 026ab036-1481-4689-af70-661493e9451c] Refreshing instance network info cache due to event network-changed-0d6194a7-a3c4-47f9-8c37-960cb622ce28. {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 16:00:37 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-65f09eaf-d15f-451a-82fd-9624cd7e60de req-66819754-7c36-4dfe-a6db-c27bd6d4ae5f service nova] Acquiring lock "refresh_cache-026ab036-1481-4689-af70-661493e9451c" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:00:37 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-65f09eaf-d15f-451a-82fd-9624cd7e60de req-66819754-7c36-4dfe-a6db-c27bd6d4ae5f service nova] Acquired lock "refresh_cache-026ab036-1481-4689-af70-661493e9451c" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:00:37 user nova-compute[71874]: DEBUG nova.network.neutron [req-65f09eaf-d15f-451a-82fd-9624cd7e60de req-66819754-7c36-4dfe-a6db-c27bd6d4ae5f service nova] [instance: 026ab036-1481-4689-af70-661493e9451c] Refreshing network info cache for port 0d6194a7-a3c4-47f9-8c37-960cb622ce28 {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 16:00:38 user nova-compute[71874]: DEBUG nova.network.neutron [req-65f09eaf-d15f-451a-82fd-9624cd7e60de req-66819754-7c36-4dfe-a6db-c27bd6d4ae5f service nova] [instance: 026ab036-1481-4689-af70-661493e9451c] Instance cache missing network info. {{(pid=71874) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 16:00:38 user nova-compute[71874]: DEBUG nova.network.neutron [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Successfully created port: f76aae02-12c4-41d6-951a-201330ea7693 {{(pid=71874) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 16:00:38 user nova-compute[71874]: DEBUG nova.network.neutron [req-65f09eaf-d15f-451a-82fd-9624cd7e60de req-66819754-7c36-4dfe-a6db-c27bd6d4ae5f service nova] [instance: 026ab036-1481-4689-af70-661493e9451c] Updating instance_info_cache with network_info: [] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:00:38 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-65f09eaf-d15f-451a-82fd-9624cd7e60de req-66819754-7c36-4dfe-a6db-c27bd6d4ae5f service nova] Releasing lock "refresh_cache-026ab036-1481-4689-af70-661493e9451c" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:00:38 user nova-compute[71874]: DEBUG nova.network.neutron [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Successfully created port: b85b7f43-1f5d-441a-bf3e-380900194e10 {{(pid=71874) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 16:00:39 user nova-compute[71874]: DEBUG nova.network.neutron [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] [instance: 026ab036-1481-4689-af70-661493e9451c] Successfully updated port: 8ebc1d23-a473-4640-aa39-31cbed300c07 {{(pid=71874) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 16:00:39 user nova-compute[71874]: DEBUG nova.network.neutron [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Successfully created port: c5c4abf8-1b9b-4385-adf7-b34b27a8bc6b {{(pid=71874) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 16:00:40 user nova-compute[71874]: DEBUG nova.compute.manager [req-835f12b1-d5d9-4545-a1a9-b9a54e3b6b09 req-237235e4-1fd2-4a1a-aab3-f4aeb3a675fb service nova] [instance: 026ab036-1481-4689-af70-661493e9451c] Received event network-changed-8ebc1d23-a473-4640-aa39-31cbed300c07 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:00:40 user nova-compute[71874]: DEBUG nova.compute.manager [req-835f12b1-d5d9-4545-a1a9-b9a54e3b6b09 req-237235e4-1fd2-4a1a-aab3-f4aeb3a675fb service nova] [instance: 026ab036-1481-4689-af70-661493e9451c] Refreshing instance network info cache due to event network-changed-8ebc1d23-a473-4640-aa39-31cbed300c07. {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 16:00:40 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-835f12b1-d5d9-4545-a1a9-b9a54e3b6b09 req-237235e4-1fd2-4a1a-aab3-f4aeb3a675fb service nova] Acquiring lock "refresh_cache-026ab036-1481-4689-af70-661493e9451c" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:00:40 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-835f12b1-d5d9-4545-a1a9-b9a54e3b6b09 req-237235e4-1fd2-4a1a-aab3-f4aeb3a675fb service nova] Acquired lock "refresh_cache-026ab036-1481-4689-af70-661493e9451c" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:00:40 user nova-compute[71874]: DEBUG nova.network.neutron [req-835f12b1-d5d9-4545-a1a9-b9a54e3b6b09 req-237235e4-1fd2-4a1a-aab3-f4aeb3a675fb service nova] [instance: 026ab036-1481-4689-af70-661493e9451c] Refreshing network info cache for port 8ebc1d23-a473-4640-aa39-31cbed300c07 {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 16:00:40 user nova-compute[71874]: DEBUG nova.network.neutron [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] [instance: 026ab036-1481-4689-af70-661493e9451c] Successfully updated port: 7f36bae3-c729-4d85-8c31-075b2b100abe {{(pid=71874) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 16:00:40 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:40 user nova-compute[71874]: DEBUG nova.network.neutron [req-835f12b1-d5d9-4545-a1a9-b9a54e3b6b09 req-237235e4-1fd2-4a1a-aab3-f4aeb3a675fb service nova] [instance: 026ab036-1481-4689-af70-661493e9451c] Instance cache missing network info. {{(pid=71874) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 16:00:40 user nova-compute[71874]: DEBUG nova.network.neutron [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Successfully created port: 1d70ad7b-92c6-47fa-a411-cef9d6159e90 {{(pid=71874) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 16:00:40 user nova-compute[71874]: DEBUG nova.network.neutron [req-835f12b1-d5d9-4545-a1a9-b9a54e3b6b09 req-237235e4-1fd2-4a1a-aab3-f4aeb3a675fb service nova] [instance: 026ab036-1481-4689-af70-661493e9451c] Updating instance_info_cache with network_info: [] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:00:40 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-835f12b1-d5d9-4545-a1a9-b9a54e3b6b09 req-237235e4-1fd2-4a1a-aab3-f4aeb3a675fb service nova] Releasing lock "refresh_cache-026ab036-1481-4689-af70-661493e9451c" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:00:40 user nova-compute[71874]: DEBUG nova.network.neutron [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Successfully updated port: 7ae43e60-f63a-448e-9a89-0d6bff272104 {{(pid=71874) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 16:00:40 user nova-compute[71874]: DEBUG nova.compute.manager [req-870e2918-0df0-42aa-a552-d16352a7b38f req-947c5838-43a0-4347-9bff-50a188a65804 service nova] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Received event network-changed-7ae43e60-f63a-448e-9a89-0d6bff272104 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:00:40 user nova-compute[71874]: DEBUG nova.compute.manager [req-870e2918-0df0-42aa-a552-d16352a7b38f req-947c5838-43a0-4347-9bff-50a188a65804 service nova] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Refreshing instance network info cache due to event network-changed-7ae43e60-f63a-448e-9a89-0d6bff272104. {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 16:00:40 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-870e2918-0df0-42aa-a552-d16352a7b38f req-947c5838-43a0-4347-9bff-50a188a65804 service nova] Acquiring lock "refresh_cache-9ea56377-20bc-48cc-a248-5fad6db060cb" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:00:40 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-870e2918-0df0-42aa-a552-d16352a7b38f req-947c5838-43a0-4347-9bff-50a188a65804 service nova] Acquired lock "refresh_cache-9ea56377-20bc-48cc-a248-5fad6db060cb" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:00:40 user nova-compute[71874]: DEBUG nova.network.neutron [req-870e2918-0df0-42aa-a552-d16352a7b38f req-947c5838-43a0-4347-9bff-50a188a65804 service nova] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Refreshing network info cache for port 7ae43e60-f63a-448e-9a89-0d6bff272104 {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 16:00:41 user nova-compute[71874]: DEBUG nova.network.neutron [req-870e2918-0df0-42aa-a552-d16352a7b38f req-947c5838-43a0-4347-9bff-50a188a65804 service nova] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Instance cache missing network info. {{(pid=71874) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 16:00:41 user nova-compute[71874]: DEBUG nova.network.neutron [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] [instance: 026ab036-1481-4689-af70-661493e9451c] Successfully updated port: 264de72a-d4f4-4a6a-b3ab-1e8ea8b9a30b {{(pid=71874) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 16:00:41 user nova-compute[71874]: DEBUG nova.network.neutron [req-870e2918-0df0-42aa-a552-d16352a7b38f req-947c5838-43a0-4347-9bff-50a188a65804 service nova] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Updating instance_info_cache with network_info: [] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:00:41 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-870e2918-0df0-42aa-a552-d16352a7b38f req-947c5838-43a0-4347-9bff-50a188a65804 service nova] Releasing lock "refresh_cache-9ea56377-20bc-48cc-a248-5fad6db060cb" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:00:41 user nova-compute[71874]: INFO nova.virt.block_device [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] [instance: 026ab036-1481-4689-af70-661493e9451c] Booting with volume a0100e6d-5149-423c-aadc-0c4f2635196b at /dev/vdc
Apr 12 16:00:41 user nova-compute[71874]: DEBUG os_brick.utils [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:00:41 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:41 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:00:41 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[b44732fd-679e-4f0d-828a-0f9ef1612fcc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:61a48d4489d2\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:00:41 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:41 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:00:41 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[7696eab0-059c-4070-86c0-2775dfbf8aca]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:00:41 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:41 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:00:41 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[5be61e97-46c1-4e1e-813b-9b00a1bf45ae]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:00:41 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7491d53-a14b-4b41-ba2f-62a30b71acc8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:00:41 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Running cmd (subprocess): nvme version {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:41 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] 'nvme version' failed. Not Retrying. {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 16:00:41 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.nvmeof [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] nvme not present on system {{(pid=71874) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 16:00:41 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:41 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 16:00:41 user nova-compute[71874]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 16:00:41 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[551bc1c9-acf8-4883-a581-dbc0a5f3a0fd]: (4, '') {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:00:41 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.lightos [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71874) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 16:00:41 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.lightos [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71874) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 16:00:41 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.lightos [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] LIGHTOS: no hostnqn found. {{(pid=71874) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 16:00:41 user nova-compute[71874]: DEBUG os_brick.utils [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:61a48d4489d2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:00:41 user nova-compute[71874]: DEBUG nova.virt.block_device [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] [instance: 026ab036-1481-4689-af70-661493e9451c] Updating existing volume attachment record: 9c374613-50be-4799-bd36-a8cf9aa062de {{(pid=71874) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 16:00:41 user nova-compute[71874]: DEBUG nova.network.neutron [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Successfully updated port: 6c9be856-3e7e-4166-8d71-a1f5330aa82f {{(pid=71874) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 16:00:42 user nova-compute[71874]: INFO nova.virt.block_device [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Booting with volume 1c11ebd7-2275-4a31-9558-6af01638a09b at /dev/vdb
Apr 12 16:00:42 user nova-compute[71874]: DEBUG os_brick.utils [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:00:42 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:42 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:00:42 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3abeadf-f89f-4037-b093-9e70bb35ef17]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:61a48d4489d2\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:00:42 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:42 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:00:42 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[283b0051-7aed-42c3-a5f1-199f9a91e87b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:00:42 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:42 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:00:42 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[572be715-3cbc-4bc1-96a8-06528a144f78]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:00:42 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[76378f64-39d6-4e70-8a92-d5143a756c55]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:00:42 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Running cmd (subprocess): nvme version {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:42 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] 'nvme version' failed. Not Retrying. {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 16:00:42 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.nvmeof [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] nvme not present on system {{(pid=71874) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 16:00:42 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:42 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 16:00:42 user nova-compute[71874]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 16:00:42 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f5833ee-e3c1-4993-9559-971107ac2aaa]: (4, '') {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:00:42 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.lightos [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71874) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 16:00:42 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.lightos [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71874) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 16:00:42 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.lightos [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] LIGHTOS: no hostnqn found. {{(pid=71874) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 16:00:42 user nova-compute[71874]: DEBUG os_brick.utils [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:61a48d4489d2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:00:42 user nova-compute[71874]: DEBUG nova.virt.block_device [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Updating existing volume attachment record: e2561eca-67fe-43ed-8497-630cfc3a31ae {{(pid=71874) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 16:00:42 user nova-compute[71874]: DEBUG nova.compute.manager [req-944c370c-dffc-497a-8488-bb22747dfdc4 req-de097f8b-5771-4fc5-bd97-f0852a2cccf3 service nova] [instance: 026ab036-1481-4689-af70-661493e9451c] Received event network-changed-7f36bae3-c729-4d85-8c31-075b2b100abe {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:00:42 user nova-compute[71874]: DEBUG nova.compute.manager [req-944c370c-dffc-497a-8488-bb22747dfdc4 req-de097f8b-5771-4fc5-bd97-f0852a2cccf3 service nova] [instance: 026ab036-1481-4689-af70-661493e9451c] Refreshing instance network info cache due to event network-changed-7f36bae3-c729-4d85-8c31-075b2b100abe. {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 16:00:42 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-944c370c-dffc-497a-8488-bb22747dfdc4 req-de097f8b-5771-4fc5-bd97-f0852a2cccf3 service nova] Acquiring lock "refresh_cache-026ab036-1481-4689-af70-661493e9451c" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:00:42 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-944c370c-dffc-497a-8488-bb22747dfdc4 req-de097f8b-5771-4fc5-bd97-f0852a2cccf3 service nova] Acquired lock "refresh_cache-026ab036-1481-4689-af70-661493e9451c" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:00:42 user nova-compute[71874]: DEBUG nova.network.neutron [req-944c370c-dffc-497a-8488-bb22747dfdc4 req-de097f8b-5771-4fc5-bd97-f0852a2cccf3 service nova] [instance: 026ab036-1481-4689-af70-661493e9451c] Refreshing network info cache for port 7f36bae3-c729-4d85-8c31-075b2b100abe {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 16:00:42 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:42 user nova-compute[71874]: DEBUG nova.network.neutron [req-944c370c-dffc-497a-8488-bb22747dfdc4 req-de097f8b-5771-4fc5-bd97-f0852a2cccf3 service nova] [instance: 026ab036-1481-4689-af70-661493e9451c] Instance cache missing network info. {{(pid=71874) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 16:00:42 user nova-compute[71874]: DEBUG nova.network.neutron [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] [instance: 026ab036-1481-4689-af70-661493e9451c] Successfully updated port: e3f484fe-17dd-4cef-babd-ad78cf557b03 {{(pid=71874) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 16:00:42 user nova-compute[71874]: DEBUG nova.network.neutron [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Successfully updated port: cd2391ad-cb7a-47be-b062-b0dbbc1f8475 {{(pid=71874) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 16:00:42 user nova-compute[71874]: DEBUG nova.network.neutron [req-944c370c-dffc-497a-8488-bb22747dfdc4 req-de097f8b-5771-4fc5-bd97-f0852a2cccf3 service nova] [instance: 026ab036-1481-4689-af70-661493e9451c] Updating instance_info_cache with network_info: [] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:00:42 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-944c370c-dffc-497a-8488-bb22747dfdc4 req-de097f8b-5771-4fc5-bd97-f0852a2cccf3 service nova] Releasing lock "refresh_cache-026ab036-1481-4689-af70-661493e9451c" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:00:42 user nova-compute[71874]: DEBUG nova.compute.manager [req-944c370c-dffc-497a-8488-bb22747dfdc4 req-de097f8b-5771-4fc5-bd97-f0852a2cccf3 service nova] [instance: 026ab036-1481-4689-af70-661493e9451c] Received event network-changed-264de72a-d4f4-4a6a-b3ab-1e8ea8b9a30b {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:00:42 user nova-compute[71874]: DEBUG nova.compute.manager [req-944c370c-dffc-497a-8488-bb22747dfdc4 req-de097f8b-5771-4fc5-bd97-f0852a2cccf3 service nova] [instance: 026ab036-1481-4689-af70-661493e9451c] Refreshing instance network info cache due to event network-changed-264de72a-d4f4-4a6a-b3ab-1e8ea8b9a30b. {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 16:00:42 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-944c370c-dffc-497a-8488-bb22747dfdc4 req-de097f8b-5771-4fc5-bd97-f0852a2cccf3 service nova] Acquiring lock "refresh_cache-026ab036-1481-4689-af70-661493e9451c" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:00:42 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-944c370c-dffc-497a-8488-bb22747dfdc4 req-de097f8b-5771-4fc5-bd97-f0852a2cccf3 service nova] Acquired lock "refresh_cache-026ab036-1481-4689-af70-661493e9451c" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:00:42 user nova-compute[71874]: DEBUG nova.network.neutron [req-944c370c-dffc-497a-8488-bb22747dfdc4 req-de097f8b-5771-4fc5-bd97-f0852a2cccf3 service nova] [instance: 026ab036-1481-4689-af70-661493e9451c] Refreshing network info cache for port 264de72a-d4f4-4a6a-b3ab-1e8ea8b9a30b {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 16:00:42 user nova-compute[71874]: DEBUG nova.network.neutron [req-944c370c-dffc-497a-8488-bb22747dfdc4 req-de097f8b-5771-4fc5-bd97-f0852a2cccf3 service nova] [instance: 026ab036-1481-4689-af70-661493e9451c] Instance cache missing network info. {{(pid=71874) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 16:00:43 user nova-compute[71874]: DEBUG nova.compute.manager [req-e5fb56a1-037c-4c47-92e8-4e1d1fd6412e req-0c6cf205-3282-4565-ac54-8f12a13c5479 service nova] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Received event network-changed-6c9be856-3e7e-4166-8d71-a1f5330aa82f {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:00:43 user nova-compute[71874]: DEBUG nova.compute.manager [req-e5fb56a1-037c-4c47-92e8-4e1d1fd6412e req-0c6cf205-3282-4565-ac54-8f12a13c5479 service nova] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Refreshing instance network info cache due to event network-changed-6c9be856-3e7e-4166-8d71-a1f5330aa82f. {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 16:00:43 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-e5fb56a1-037c-4c47-92e8-4e1d1fd6412e req-0c6cf205-3282-4565-ac54-8f12a13c5479 service nova] Acquiring lock "refresh_cache-9ea56377-20bc-48cc-a248-5fad6db060cb" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:00:43 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-e5fb56a1-037c-4c47-92e8-4e1d1fd6412e req-0c6cf205-3282-4565-ac54-8f12a13c5479 service nova] Acquired lock "refresh_cache-9ea56377-20bc-48cc-a248-5fad6db060cb" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:00:43 user nova-compute[71874]: DEBUG nova.network.neutron [req-e5fb56a1-037c-4c47-92e8-4e1d1fd6412e req-0c6cf205-3282-4565-ac54-8f12a13c5479 service nova] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Refreshing network info cache for port 6c9be856-3e7e-4166-8d71-a1f5330aa82f {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 16:00:43 user nova-compute[71874]: DEBUG nova.network.neutron [req-e5fb56a1-037c-4c47-92e8-4e1d1fd6412e req-0c6cf205-3282-4565-ac54-8f12a13c5479 service nova] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Instance cache missing network info. {{(pid=71874) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 16:00:43 user nova-compute[71874]: DEBUG nova.network.neutron [req-944c370c-dffc-497a-8488-bb22747dfdc4 req-de097f8b-5771-4fc5-bd97-f0852a2cccf3 service nova] [instance: 026ab036-1481-4689-af70-661493e9451c] Updating instance_info_cache with network_info: [] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:00:43 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-944c370c-dffc-497a-8488-bb22747dfdc4 req-de097f8b-5771-4fc5-bd97-f0852a2cccf3 service nova] Releasing lock "refresh_cache-026ab036-1481-4689-af70-661493e9451c" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:00:43 user nova-compute[71874]: DEBUG nova.network.neutron [req-e5fb56a1-037c-4c47-92e8-4e1d1fd6412e req-0c6cf205-3282-4565-ac54-8f12a13c5479 service nova] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Updating instance_info_cache with network_info: [] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:00:43 user nova-compute[71874]: DEBUG nova.network.neutron [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Successfully updated port: f76aae02-12c4-41d6-951a-201330ea7693 {{(pid=71874) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 16:00:43 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-e5fb56a1-037c-4c47-92e8-4e1d1fd6412e req-0c6cf205-3282-4565-ac54-8f12a13c5479 service nova] Releasing lock "refresh_cache-9ea56377-20bc-48cc-a248-5fad6db060cb" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:00:43 user nova-compute[71874]: DEBUG nova.compute.manager [req-e5fb56a1-037c-4c47-92e8-4e1d1fd6412e req-0c6cf205-3282-4565-ac54-8f12a13c5479 service nova] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Received event network-changed-cd2391ad-cb7a-47be-b062-b0dbbc1f8475 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:00:43 user nova-compute[71874]: DEBUG nova.compute.manager [req-e5fb56a1-037c-4c47-92e8-4e1d1fd6412e req-0c6cf205-3282-4565-ac54-8f12a13c5479 service nova] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Refreshing instance network info cache due to event network-changed-cd2391ad-cb7a-47be-b062-b0dbbc1f8475. {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 16:00:43 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-e5fb56a1-037c-4c47-92e8-4e1d1fd6412e req-0c6cf205-3282-4565-ac54-8f12a13c5479 service nova] Acquiring lock "refresh_cache-9ea56377-20bc-48cc-a248-5fad6db060cb" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:00:43 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-e5fb56a1-037c-4c47-92e8-4e1d1fd6412e req-0c6cf205-3282-4565-ac54-8f12a13c5479 service nova] Acquired lock "refresh_cache-9ea56377-20bc-48cc-a248-5fad6db060cb" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:00:43 user nova-compute[71874]: DEBUG nova.network.neutron [req-e5fb56a1-037c-4c47-92e8-4e1d1fd6412e req-0c6cf205-3282-4565-ac54-8f12a13c5479 service nova] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Refreshing network info cache for port cd2391ad-cb7a-47be-b062-b0dbbc1f8475 {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 16:00:43 user nova-compute[71874]: DEBUG nova.network.neutron [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] [instance: 026ab036-1481-4689-af70-661493e9451c] Successfully updated port: 0b2175eb-de94-4274-b200-14894dbcbda0 {{(pid=71874) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 16:00:43 user nova-compute[71874]: DEBUG nova.network.neutron [req-e5fb56a1-037c-4c47-92e8-4e1d1fd6412e req-0c6cf205-3282-4565-ac54-8f12a13c5479 service nova] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Instance cache missing network info. {{(pid=71874) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 16:00:43 user nova-compute[71874]: DEBUG nova.network.neutron [req-e5fb56a1-037c-4c47-92e8-4e1d1fd6412e req-0c6cf205-3282-4565-ac54-8f12a13c5479 service nova] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Updating instance_info_cache with network_info: [] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:00:43 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-e5fb56a1-037c-4c47-92e8-4e1d1fd6412e req-0c6cf205-3282-4565-ac54-8f12a13c5479 service nova] Releasing lock "refresh_cache-9ea56377-20bc-48cc-a248-5fad6db060cb" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:00:44 user nova-compute[71874]: DEBUG nova.network.neutron [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] [instance: 026ab036-1481-4689-af70-661493e9451c] Successfully updated port: 5796cf52-4e81-4c40-954e-86819f5557c8 {{(pid=71874) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 16:00:44 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Acquiring lock "refresh_cache-026ab036-1481-4689-af70-661493e9451c" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:00:44 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Acquired lock "refresh_cache-026ab036-1481-4689-af70-661493e9451c" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:00:44 user nova-compute[71874]: DEBUG nova.network.neutron [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] [instance: 026ab036-1481-4689-af70-661493e9451c] Building network info cache for instance {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 16:00:44 user nova-compute[71874]: DEBUG nova.network.neutron [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Successfully updated port: b85b7f43-1f5d-441a-bf3e-380900194e10 {{(pid=71874) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 16:00:44 user nova-compute[71874]: DEBUG nova.network.neutron [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] [instance: 026ab036-1481-4689-af70-661493e9451c] Instance cache missing network info. {{(pid=71874) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 16:00:44 user nova-compute[71874]: DEBUG nova.compute.manager [req-9a2b1083-3ba0-489a-bf25-200b0cd7d4ed req-79dfa6ba-1077-4394-a9e7-86a6cfaa387d service nova] [instance: 026ab036-1481-4689-af70-661493e9451c] Received event network-changed-e3f484fe-17dd-4cef-babd-ad78cf557b03 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:00:44 user nova-compute[71874]: DEBUG nova.compute.manager [req-9a2b1083-3ba0-489a-bf25-200b0cd7d4ed req-79dfa6ba-1077-4394-a9e7-86a6cfaa387d service nova] [instance: 026ab036-1481-4689-af70-661493e9451c] Refreshing instance network info cache due to event network-changed-e3f484fe-17dd-4cef-babd-ad78cf557b03. {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 16:00:44 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-9a2b1083-3ba0-489a-bf25-200b0cd7d4ed req-79dfa6ba-1077-4394-a9e7-86a6cfaa387d service nova] Acquiring lock "refresh_cache-026ab036-1481-4689-af70-661493e9451c" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:00:45 user nova-compute[71874]: DEBUG nova.network.neutron [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Successfully updated port: c5c4abf8-1b9b-4385-adf7-b34b27a8bc6b {{(pid=71874) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 16:00:45 user nova-compute[71874]: DEBUG nova.compute.manager [req-9a8f8659-d4be-4d2e-b91a-16fce1d9bc5c req-8005dedb-0044-4a57-9b16-c09fcab47b0d service nova] [instance: 026ab036-1481-4689-af70-661493e9451c] Received event network-changed-0b2175eb-de94-4274-b200-14894dbcbda0 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:00:45 user nova-compute[71874]: DEBUG nova.compute.manager [req-9a8f8659-d4be-4d2e-b91a-16fce1d9bc5c req-8005dedb-0044-4a57-9b16-c09fcab47b0d service nova] [instance: 026ab036-1481-4689-af70-661493e9451c] Refreshing instance network info cache due to event network-changed-0b2175eb-de94-4274-b200-14894dbcbda0. {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 16:00:45 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-9a8f8659-d4be-4d2e-b91a-16fce1d9bc5c req-8005dedb-0044-4a57-9b16-c09fcab47b0d service nova] Acquiring lock "refresh_cache-026ab036-1481-4689-af70-661493e9451c" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:00:45 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:45 user nova-compute[71874]: DEBUG nova.network.neutron [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Successfully updated port: 1d70ad7b-92c6-47fa-a411-cef9d6159e90 {{(pid=71874) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 16:00:45 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Acquiring lock "refresh_cache-9ea56377-20bc-48cc-a248-5fad6db060cb" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:00:45 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Acquired lock "refresh_cache-9ea56377-20bc-48cc-a248-5fad6db060cb" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:00:45 user nova-compute[71874]: DEBUG nova.network.neutron [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Building network info cache for instance {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 16:00:45 user nova-compute[71874]: DEBUG nova.network.neutron [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Instance cache missing network info. {{(pid=71874) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 16:00:46 user nova-compute[71874]: DEBUG nova.network.neutron [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] [instance: 026ab036-1481-4689-af70-661493e9451c] Updating instance_info_cache with network_info: [{"id": "0d6194a7-a3c4-47f9-8c37-960cb622ce28", "address": "fa:16:3e:9c:84:d7", "network": {"id": "77f1158d-0720-49c1-9530-29d3cdca64df", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1458658917-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14aea401da6344858416fd2543bc10ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d6194a7-a3", "ovs_interfaceid": "0d6194a7-a3c4-47f9-8c37-960cb622ce28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8ebc1d23-a473-4640-aa39-31cbed300c07", "address": "fa:16:3e:d5:95:9e", "network": {"id": "9b0c9550-d764-4db6-b28b-09ab59801170", "bridge": "br-int", "label": "tempest-device-tagging-net1-638686183", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.180", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14aea401da6344858416fd2543bc10ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ebc1d23-a4", "ovs_interfaceid": "8ebc1d23-a473-4640-aa39-31cbed300c07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7f36bae3-c729-4d85-8c31-075b2b100abe", "address": "fa:16:3e:99:5c:8b", "network": {"id": "9b0c9550-d764-4db6-b28b-09ab59801170", "bridge": "br-int", "label": "tempest-device-tagging-net1-638686183", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14aea401da6344858416fd2543bc10ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f36bae3-c7", "ovs_interfaceid": "7f36bae3-c729-4d85-8c31-075b2b100abe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "264de72a-d4f4-4a6a-b3ab-1e8ea8b9a30b", "address": "fa:16:3e:da:a9:6d", "network": {"id": "9b0c9550-d764-4db6-b28b-09ab59801170", "bridge": "br-int", "label": "tempest-device-tagging-net1-638686183", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14aea401da6344858416fd2543bc10ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap264de72a-d4", "ovs_interfaceid": "264de72a-d4f4-4a6a-b3ab-1e8ea8b9a30b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e3f484fe-17dd-4cef-babd-ad78cf557b03", "address": "fa:16:3e:e6:0d:58", "network": {"id": "9b0c9550-d764-4db6-b28b-09ab59801170", "bridge": "br-int", "label": "tempest-device-tagging-net1-638686183", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14aea401da6344858416fd2543bc10ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3f484fe-17", "ovs_interfaceid": "e3f484fe-17dd-4cef-babd-ad78cf557b03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0b2175eb-de94-4274-b200-14894dbcbda0", "address": "fa:16:3e:0f:80:1c", "network": {"id": "92fe4d7e-c0cd-45f1-9e92-a120ab22f6f1", "bridge": "br-int", "label": "tempest-device-tagging-net2-367644823", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "14aea401da6344858416fd2543bc10ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b2175eb-de", "ovs_interfaceid": "0b2175eb-de94-4274-b200-14894dbcbda0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5796cf52-4e81-4c40-954e-86819f5557c8", "address": "fa:16:3e:b7:67:83", "network": {"id": "92fe4d7e-c0cd-45f1-9e92-a120ab22f6f1", "bridge": "br-int", "label": "tempest-device-tagging-net2-367644823", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "14aea401da6344858416fd2543bc10ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5796cf52-4e", "ovs_interfaceid": "5796cf52-4e81-4c40-954e-86819f5557c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:00:46 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Releasing lock "refresh_cache-026ab036-1481-4689-af70-661493e9451c" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:00:46 user nova-compute[71874]: DEBUG nova.compute.manager [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] [instance: 026ab036-1481-4689-af70-661493e9451c] Instance network_info: |[{"id": "0d6194a7-a3c4-47f9-8c37-960cb622ce28", "address": "fa:16:3e:9c:84:d7", "network": {"id": "77f1158d-0720-49c1-9530-29d3cdca64df", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1458658917-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14aea401da6344858416fd2543bc10ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d6194a7-a3", "ovs_interfaceid": "0d6194a7-a3c4-47f9-8c37-960cb622ce28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8ebc1d23-a473-4640-aa39-31cbed300c07", "address": "fa:16:3e:d5:95:9e", "network": {"id": "9b0c9550-d764-4db6-b28b-09ab59801170", "bridge": "br-int", "label": "tempest-device-tagging-net1-638686183", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.180", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14aea401da6344858416fd2543bc10ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ebc1d23-a4", "ovs_interfaceid": "8ebc1d23-a473-4640-aa39-31cbed300c07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7f36bae3-c729-4d85-8c31-075b2b100abe", "address": "fa:16:3e:99:5c:8b", "network": {"id": "9b0c9550-d764-4db6-b28b-09ab59801170", "bridge": "br-int", "label": "tempest-device-tagging-net1-638686183", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14aea401da6344858416fd2543bc10ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f36bae3-c7", "ovs_interfaceid": "7f36bae3-c729-4d85-8c31-075b2b100abe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "264de72a-d4f4-4a6a-b3ab-1e8ea8b9a30b", "address": "fa:16:3e:da:a9:6d", "network": {"id": "9b0c9550-d764-4db6-b28b-09ab59801170", "bridge": "br-int", "label": "tempest-device-tagging-net1-638686183", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14aea401da6344858416fd2543bc10ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap264de72a-d4", "ovs_interfaceid": "264de72a-d4f4-4a6a-b3ab-1e8ea8b9a30b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e3f484fe-17dd-4cef-babd-ad78cf557b03", "address": "fa:16:3e:e6:0d:58", "network": {"id": "9b0c9550-d764-4db6-b28b-09ab59801170", "bridge": "br-int", "label": "tempest-device-tagging-net1-638686183", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14aea401da6344858416fd2543bc10ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3f484fe-17", "ovs_interfaceid": "e3f484fe-17dd-4cef-babd-ad78cf557b03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0b2175eb-de94-4274-b200-14894dbcbda0", "address": "fa:16:3e:0f:80:1c", "network": {"id": "92fe4d7e-c0cd-45f1-9e92-a120ab22f6f1", "bridge": "br-int", "label": "tempest-device-tagging-net2-367644823", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "14aea401da6344858416fd2543bc10ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b2175eb-de", "ovs_interfaceid": "0b2175eb-de94-4274-b200-14894dbcbda0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5796cf52-4e81-4c40-954e-86819f5557c8", "address": "fa:16:3e:b7:67:83", "network": {"id": "92fe4d7e-c0cd-45f1-9e92-a120ab22f6f1", "bridge": "br-int", "label": "tempest-device-tagging-net2-367644823", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "14aea401da6344858416fd2543bc10ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5796cf52-4e", "ovs_interfaceid": "5796cf52-4e81-4c40-954e-86819f5557c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 16:00:46 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-9a2b1083-3ba0-489a-bf25-200b0cd7d4ed req-79dfa6ba-1077-4394-a9e7-86a6cfaa387d service nova] Acquired lock "refresh_cache-026ab036-1481-4689-af70-661493e9451c" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:00:46 user nova-compute[71874]: DEBUG nova.network.neutron [req-9a2b1083-3ba0-489a-bf25-200b0cd7d4ed req-79dfa6ba-1077-4394-a9e7-86a6cfaa387d service nova] [instance: 026ab036-1481-4689-af70-661493e9451c] Refreshing network info cache for port e3f484fe-17dd-4cef-babd-ad78cf557b03 {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 16:00:46 user nova-compute[71874]: DEBUG nova.compute.manager [req-3bcfce5f-a066-495c-b4a5-22f3c0094601 req-dda2539e-09f7-40dc-9c08-e77b591c873d service nova] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Received event network-changed-c5c4abf8-1b9b-4385-adf7-b34b27a8bc6b {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:00:46 user nova-compute[71874]: DEBUG nova.compute.manager [req-3bcfce5f-a066-495c-b4a5-22f3c0094601 req-dda2539e-09f7-40dc-9c08-e77b591c873d service nova] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Refreshing instance network info cache due to event network-changed-c5c4abf8-1b9b-4385-adf7-b34b27a8bc6b. {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 16:00:46 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-3bcfce5f-a066-495c-b4a5-22f3c0094601 req-dda2539e-09f7-40dc-9c08-e77b591c873d service nova] Acquiring lock "refresh_cache-9ea56377-20bc-48cc-a248-5fad6db060cb" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:00:47 user nova-compute[71874]: DEBUG nova.network.neutron [req-9a2b1083-3ba0-489a-bf25-200b0cd7d4ed req-79dfa6ba-1077-4394-a9e7-86a6cfaa387d service nova] [instance: 026ab036-1481-4689-af70-661493e9451c] Updated VIF entry in instance network info cache for port e3f484fe-17dd-4cef-babd-ad78cf557b03. {{(pid=71874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 16:00:47 user nova-compute[71874]: DEBUG nova.network.neutron [req-9a2b1083-3ba0-489a-bf25-200b0cd7d4ed req-79dfa6ba-1077-4394-a9e7-86a6cfaa387d service nova] [instance: 026ab036-1481-4689-af70-661493e9451c] Updating instance_info_cache with network_info: [{"id": "0d6194a7-a3c4-47f9-8c37-960cb622ce28", "address": "fa:16:3e:9c:84:d7", "network": {"id": "77f1158d-0720-49c1-9530-29d3cdca64df", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1458658917-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14aea401da6344858416fd2543bc10ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d6194a7-a3", "ovs_interfaceid": "0d6194a7-a3c4-47f9-8c37-960cb622ce28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8ebc1d23-a473-4640-aa39-31cbed300c07", "address": "fa:16:3e:d5:95:9e", "network": {"id": "9b0c9550-d764-4db6-b28b-09ab59801170", "bridge": "br-int", "label": "tempest-device-tagging-net1-638686183", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.180", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14aea401da6344858416fd2543bc10ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ebc1d23-a4", "ovs_interfaceid": "8ebc1d23-a473-4640-aa39-31cbed300c07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7f36bae3-c729-4d85-8c31-075b2b100abe", "address": "fa:16:3e:99:5c:8b", "network": {"id": "9b0c9550-d764-4db6-b28b-09ab59801170", "bridge": "br-int", "label": "tempest-device-tagging-net1-638686183", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14aea401da6344858416fd2543bc10ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f36bae3-c7", "ovs_interfaceid": "7f36bae3-c729-4d85-8c31-075b2b100abe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "264de72a-d4f4-4a6a-b3ab-1e8ea8b9a30b", "address": "fa:16:3e:da:a9:6d", "network": {"id": "9b0c9550-d764-4db6-b28b-09ab59801170", "bridge": "br-int", "label": "tempest-device-tagging-net1-638686183", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14aea401da6344858416fd2543bc10ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap264de72a-d4", "ovs_interfaceid": "264de72a-d4f4-4a6a-b3ab-1e8ea8b9a30b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e3f484fe-17dd-4cef-babd-ad78cf557b03", "address": "fa:16:3e:e6:0d:58", "network": {"id": "9b0c9550-d764-4db6-b28b-09ab59801170", "bridge": "br-int", "label": "tempest-device-tagging-net1-638686183", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14aea401da6344858416fd2543bc10ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3f484fe-17", "ovs_interfaceid": "e3f484fe-17dd-4cef-babd-ad78cf557b03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0b2175eb-de94-4274-b200-14894dbcbda0", "address": "fa:16:3e:0f:80:1c", "network": {"id": "92fe4d7e-c0cd-45f1-9e92-a120ab22f6f1", "bridge": "br-int", "label": "tempest-device-tagging-net2-367644823", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "14aea401da6344858416fd2543bc10ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b2175eb-de", "ovs_interfaceid": "0b2175eb-de94-4274-b200-14894dbcbda0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5796cf52-4e81-4c40-954e-86819f5557c8", "address": "fa:16:3e:b7:67:83", "network": {"id": "92fe4d7e-c0cd-45f1-9e92-a120ab22f6f1", "bridge": "br-int", "label": "tempest-device-tagging-net2-367644823", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "14aea401da6344858416fd2543bc10ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5796cf52-4e", "ovs_interfaceid": "5796cf52-4e81-4c40-954e-86819f5557c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:00:47 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-9a2b1083-3ba0-489a-bf25-200b0cd7d4ed req-79dfa6ba-1077-4394-a9e7-86a6cfaa387d service nova] Releasing lock "refresh_cache-026ab036-1481-4689-af70-661493e9451c" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:00:47 user nova-compute[71874]: DEBUG nova.compute.manager [req-9a2b1083-3ba0-489a-bf25-200b0cd7d4ed req-79dfa6ba-1077-4394-a9e7-86a6cfaa387d service nova] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Received event network-changed-f76aae02-12c4-41d6-951a-201330ea7693 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:00:47 user nova-compute[71874]: DEBUG nova.compute.manager [req-9a2b1083-3ba0-489a-bf25-200b0cd7d4ed req-79dfa6ba-1077-4394-a9e7-86a6cfaa387d service nova] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Refreshing instance network info cache due to event network-changed-f76aae02-12c4-41d6-951a-201330ea7693. {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 16:00:47 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-9a2b1083-3ba0-489a-bf25-200b0cd7d4ed req-79dfa6ba-1077-4394-a9e7-86a6cfaa387d service nova] Acquiring lock "refresh_cache-9ea56377-20bc-48cc-a248-5fad6db060cb" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:00:47 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-9a8f8659-d4be-4d2e-b91a-16fce1d9bc5c req-8005dedb-0044-4a57-9b16-c09fcab47b0d service nova] Acquired lock "refresh_cache-026ab036-1481-4689-af70-661493e9451c" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:00:47 user nova-compute[71874]: DEBUG nova.network.neutron [req-9a8f8659-d4be-4d2e-b91a-16fce1d9bc5c req-8005dedb-0044-4a57-9b16-c09fcab47b0d service nova] [instance: 026ab036-1481-4689-af70-661493e9451c] Refreshing network info cache for port 0b2175eb-de94-4274-b200-14894dbcbda0 {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 16:00:47 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:47 user nova-compute[71874]: DEBUG nova.network.neutron [req-9a8f8659-d4be-4d2e-b91a-16fce1d9bc5c req-8005dedb-0044-4a57-9b16-c09fcab47b0d service nova] [instance: 026ab036-1481-4689-af70-661493e9451c] Updated VIF entry in instance network info cache for port 0b2175eb-de94-4274-b200-14894dbcbda0. {{(pid=71874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 16:00:47 user nova-compute[71874]: DEBUG nova.network.neutron [req-9a8f8659-d4be-4d2e-b91a-16fce1d9bc5c req-8005dedb-0044-4a57-9b16-c09fcab47b0d service nova] [instance: 026ab036-1481-4689-af70-661493e9451c] Updating instance_info_cache with network_info: [{"id": "0d6194a7-a3c4-47f9-8c37-960cb622ce28", "address": "fa:16:3e:9c:84:d7", "network": {"id": "77f1158d-0720-49c1-9530-29d3cdca64df", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1458658917-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14aea401da6344858416fd2543bc10ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d6194a7-a3", "ovs_interfaceid": "0d6194a7-a3c4-47f9-8c37-960cb622ce28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8ebc1d23-a473-4640-aa39-31cbed300c07", "address": "fa:16:3e:d5:95:9e", "network": {"id": "9b0c9550-d764-4db6-b28b-09ab59801170", "bridge": "br-int", "label": "tempest-device-tagging-net1-638686183", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.180", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14aea401da6344858416fd2543bc10ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ebc1d23-a4", "ovs_interfaceid": "8ebc1d23-a473-4640-aa39-31cbed300c07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7f36bae3-c729-4d85-8c31-075b2b100abe", "address": "fa:16:3e:99:5c:8b", "network": {"id": "9b0c9550-d764-4db6-b28b-09ab59801170", "bridge": "br-int", "label": "tempest-device-tagging-net1-638686183", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14aea401da6344858416fd2543bc10ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f36bae3-c7", "ovs_interfaceid": "7f36bae3-c729-4d85-8c31-075b2b100abe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "264de72a-d4f4-4a6a-b3ab-1e8ea8b9a30b", "address": "fa:16:3e:da:a9:6d", "network": {"id": "9b0c9550-d764-4db6-b28b-09ab59801170", "bridge": "br-int", "label": "tempest-device-tagging-net1-638686183", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14aea401da6344858416fd2543bc10ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap264de72a-d4", "ovs_interfaceid": "264de72a-d4f4-4a6a-b3ab-1e8ea8b9a30b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e3f484fe-17dd-4cef-babd-ad78cf557b03", "address": "fa:16:3e:e6:0d:58", "network": {"id": "9b0c9550-d764-4db6-b28b-09ab59801170", "bridge": "br-int", "label": "tempest-device-tagging-net1-638686183", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14aea401da6344858416fd2543bc10ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3f484fe-17", "ovs_interfaceid": "e3f484fe-17dd-4cef-babd-ad78cf557b03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0b2175eb-de94-4274-b200-14894dbcbda0", "address": "fa:16:3e:0f:80:1c", "network": {"id": "92fe4d7e-c0cd-45f1-9e92-a120ab22f6f1", "bridge": "br-int", "label": "tempest-device-tagging-net2-367644823", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "14aea401da6344858416fd2543bc10ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b2175eb-de", "ovs_interfaceid": "0b2175eb-de94-4274-b200-14894dbcbda0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5796cf52-4e81-4c40-954e-86819f5557c8", "address": "fa:16:3e:b7:67:83", "network": {"id": "92fe4d7e-c0cd-45f1-9e92-a120ab22f6f1", "bridge": "br-int", "label": "tempest-device-tagging-net2-367644823", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "14aea401da6344858416fd2543bc10ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5796cf52-4e", "ovs_interfaceid": "5796cf52-4e81-4c40-954e-86819f5557c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:00:47 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-9a8f8659-d4be-4d2e-b91a-16fce1d9bc5c req-8005dedb-0044-4a57-9b16-c09fcab47b0d service nova] Releasing lock "refresh_cache-026ab036-1481-4689-af70-661493e9451c" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:00:47 user nova-compute[71874]: DEBUG nova.compute.manager [req-9a8f8659-d4be-4d2e-b91a-16fce1d9bc5c req-8005dedb-0044-4a57-9b16-c09fcab47b0d service nova] [instance: 026ab036-1481-4689-af70-661493e9451c] Received event network-changed-5796cf52-4e81-4c40-954e-86819f5557c8 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:00:47 user nova-compute[71874]: DEBUG nova.compute.manager [req-9a8f8659-d4be-4d2e-b91a-16fce1d9bc5c req-8005dedb-0044-4a57-9b16-c09fcab47b0d service nova] [instance: 026ab036-1481-4689-af70-661493e9451c] Refreshing instance network info cache due to event network-changed-5796cf52-4e81-4c40-954e-86819f5557c8. {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 16:00:47 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-9a8f8659-d4be-4d2e-b91a-16fce1d9bc5c req-8005dedb-0044-4a57-9b16-c09fcab47b0d service nova] Acquiring lock "refresh_cache-026ab036-1481-4689-af70-661493e9451c" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:00:47 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-9a8f8659-d4be-4d2e-b91a-16fce1d9bc5c req-8005dedb-0044-4a57-9b16-c09fcab47b0d service nova] Acquired lock "refresh_cache-026ab036-1481-4689-af70-661493e9451c" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:00:47 user nova-compute[71874]: DEBUG nova.network.neutron [req-9a8f8659-d4be-4d2e-b91a-16fce1d9bc5c req-8005dedb-0044-4a57-9b16-c09fcab47b0d service nova] [instance: 026ab036-1481-4689-af70-661493e9451c] Refreshing network info cache for port 5796cf52-4e81-4c40-954e-86819f5557c8 {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 16:00:48 user nova-compute[71874]: DEBUG nova.network.neutron [req-9a8f8659-d4be-4d2e-b91a-16fce1d9bc5c req-8005dedb-0044-4a57-9b16-c09fcab47b0d service nova] [instance: 026ab036-1481-4689-af70-661493e9451c] Updated VIF entry in instance network info cache for port 5796cf52-4e81-4c40-954e-86819f5557c8. {{(pid=71874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 16:00:48 user nova-compute[71874]: DEBUG nova.network.neutron [req-9a8f8659-d4be-4d2e-b91a-16fce1d9bc5c req-8005dedb-0044-4a57-9b16-c09fcab47b0d service nova] [instance: 026ab036-1481-4689-af70-661493e9451c] Updating instance_info_cache with network_info: [{"id": "0d6194a7-a3c4-47f9-8c37-960cb622ce28", "address": "fa:16:3e:9c:84:d7", "network": {"id": "77f1158d-0720-49c1-9530-29d3cdca64df", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1458658917-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14aea401da6344858416fd2543bc10ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d6194a7-a3", "ovs_interfaceid": "0d6194a7-a3c4-47f9-8c37-960cb622ce28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8ebc1d23-a473-4640-aa39-31cbed300c07", "address": "fa:16:3e:d5:95:9e", "network": {"id": "9b0c9550-d764-4db6-b28b-09ab59801170", "bridge": "br-int", "label": "tempest-device-tagging-net1-638686183", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.180", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14aea401da6344858416fd2543bc10ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ebc1d23-a4", "ovs_interfaceid": "8ebc1d23-a473-4640-aa39-31cbed300c07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7f36bae3-c729-4d85-8c31-075b2b100abe", "address": "fa:16:3e:99:5c:8b", "network": {"id": "9b0c9550-d764-4db6-b28b-09ab59801170", "bridge": "br-int", "label": "tempest-device-tagging-net1-638686183", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14aea401da6344858416fd2543bc10ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f36bae3-c7", "ovs_interfaceid": "7f36bae3-c729-4d85-8c31-075b2b100abe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "264de72a-d4f4-4a6a-b3ab-1e8ea8b9a30b", "address": "fa:16:3e:da:a9:6d", "network": {"id": "9b0c9550-d764-4db6-b28b-09ab59801170", "bridge": "br-int", "label": "tempest-device-tagging-net1-638686183", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14aea401da6344858416fd2543bc10ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap264de72a-d4", "ovs_interfaceid": "264de72a-d4f4-4a6a-b3ab-1e8ea8b9a30b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e3f484fe-17dd-4cef-babd-ad78cf557b03", "address": "fa:16:3e:e6:0d:58", "network": {"id": "9b0c9550-d764-4db6-b28b-09ab59801170", "bridge": "br-int", "label": "tempest-device-tagging-net1-638686183", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14aea401da6344858416fd2543bc10ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3f484fe-17", "ovs_interfaceid": "e3f484fe-17dd-4cef-babd-ad78cf557b03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0b2175eb-de94-4274-b200-14894dbcbda0", "address": "fa:16:3e:0f:80:1c", "network": {"id": "92fe4d7e-c0cd-45f1-9e92-a120ab22f6f1", "bridge": "br-int", "label": "tempest-device-tagging-net2-367644823", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "14aea401da6344858416fd2543bc10ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b2175eb-de", "ovs_interfaceid": "0b2175eb-de94-4274-b200-14894dbcbda0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5796cf52-4e81-4c40-954e-86819f5557c8", "address": "fa:16:3e:b7:67:83", "network": {"id": "92fe4d7e-c0cd-45f1-9e92-a120ab22f6f1", "bridge": "br-int", "label": "tempest-device-tagging-net2-367644823", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "14aea401da6344858416fd2543bc10ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5796cf52-4e", "ovs_interfaceid": "5796cf52-4e81-4c40-954e-86819f5557c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:00:48 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-9a8f8659-d4be-4d2e-b91a-16fce1d9bc5c req-8005dedb-0044-4a57-9b16-c09fcab47b0d service nova] Releasing lock "refresh_cache-026ab036-1481-4689-af70-661493e9451c" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:00:48 user nova-compute[71874]: DEBUG nova.network.neutron [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Updating instance_info_cache with network_info: [{"id": "7ae43e60-f63a-448e-9a89-0d6bff272104", "address": "fa:16:3e:b7:f0:f6", "network": {"id": "db8367a7-06c5-4e83-987a-c92d02009fef", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-612559343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "020f60d454f846d5a18dfbe1d88b65da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ae43e60-f6", "ovs_interfaceid": "7ae43e60-f63a-448e-9a89-0d6bff272104", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6c9be856-3e7e-4166-8d71-a1f5330aa82f", "address": "fa:16:3e:44:ca:b6", "network": {"id": "a491fcd5-d137-491a-9854-a743afbd448d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1608054323", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "020f60d454f846d5a18dfbe1d88b65da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9be856-3e", "ovs_interfaceid": "6c9be856-3e7e-4166-8d71-a1f5330aa82f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cd2391ad-cb7a-47be-b062-b0dbbc1f8475", "address": "fa:16:3e:89:21:2f", "network": {"id": "a491fcd5-d137-491a-9854-a743afbd448d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1608054323", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.38", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "020f60d454f846d5a18dfbe1d88b65da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd2391ad-cb", "ovs_interfaceid": "cd2391ad-cb7a-47be-b062-b0dbbc1f8475", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f76aae02-12c4-41d6-951a-201330ea7693", "address": "fa:16:3e:13:a6:2d", "network": {"id": "a491fcd5-d137-491a-9854-a743afbd448d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1608054323", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.239", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "020f60d454f846d5a18dfbe1d88b65da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf76aae02-12", "ovs_interfaceid": "f76aae02-12c4-41d6-951a-201330ea7693", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b85b7f43-1f5d-441a-bf3e-380900194e10", "address": "fa:16:3e:2f:65:2e", "network": {"id": "a491fcd5-d137-491a-9854-a743afbd448d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1608054323", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "020f60d454f846d5a18dfbe1d88b65da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb85b7f43-1f", "ovs_interfaceid": "b85b7f43-1f5d-441a-bf3e-380900194e10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c5c4abf8-1b9b-4385-adf7-b34b27a8bc6b", "address": "fa:16:3e:10:b7:d0", "network": {"id": "c543f5eb-b28c-4113-a560-8d6790713d19", "bridge": "br-int", "label": "tempest-device-tagging-net2-1828870959", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "020f60d454f846d5a18dfbe1d88b65da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5c4abf8-1b", "ovs_interfaceid": "c5c4abf8-1b9b-4385-adf7-b34b27a8bc6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1d70ad7b-92c6-47fa-a411-cef9d6159e90", "address": "fa:16:3e:46:54:b4", "network": {"id": "c543f5eb-b28c-4113-a560-8d6790713d19", "bridge": "br-int", "label": "tempest-device-tagging-net2-1828870959", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "020f60d454f846d5a18dfbe1d88b65da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d70ad7b-92", "ovs_interfaceid": "1d70ad7b-92c6-47fa-a411-cef9d6159e90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:00:48 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Releasing lock "refresh_cache-9ea56377-20bc-48cc-a248-5fad6db060cb" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:00:48 user nova-compute[71874]: DEBUG nova.compute.manager [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Instance network_info: |[{"id": "7ae43e60-f63a-448e-9a89-0d6bff272104", "address": "fa:16:3e:b7:f0:f6", "network": {"id": "db8367a7-06c5-4e83-987a-c92d02009fef", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-612559343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "020f60d454f846d5a18dfbe1d88b65da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ae43e60-f6", "ovs_interfaceid": "7ae43e60-f63a-448e-9a89-0d6bff272104", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6c9be856-3e7e-4166-8d71-a1f5330aa82f", "address": "fa:16:3e:44:ca:b6", "network": {"id": "a491fcd5-d137-491a-9854-a743afbd448d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1608054323", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "020f60d454f846d5a18dfbe1d88b65da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9be856-3e", "ovs_interfaceid": "6c9be856-3e7e-4166-8d71-a1f5330aa82f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cd2391ad-cb7a-47be-b062-b0dbbc1f8475", "address": "fa:16:3e:89:21:2f", "network": {"id": "a491fcd5-d137-491a-9854-a743afbd448d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1608054323", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.38", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "020f60d454f846d5a18dfbe1d88b65da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd2391ad-cb", "ovs_interfaceid": "cd2391ad-cb7a-47be-b062-b0dbbc1f8475", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f76aae02-12c4-41d6-951a-201330ea7693", "address": "fa:16:3e:13:a6:2d", "network": {"id": "a491fcd5-d137-491a-9854-a743afbd448d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1608054323", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.239", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "020f60d454f846d5a18dfbe1d88b65da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf76aae02-12", "ovs_interfaceid": "f76aae02-12c4-41d6-951a-201330ea7693", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b85b7f43-1f5d-441a-bf3e-380900194e10", "address": "fa:16:3e:2f:65:2e", "network": {"id": "a491fcd5-d137-491a-9854-a743afbd448d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1608054323", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "020f60d454f846d5a18dfbe1d88b65da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb85b7f43-1f", "ovs_interfaceid": "b85b7f43-1f5d-441a-bf3e-380900194e10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c5c4abf8-1b9b-4385-adf7-b34b27a8bc6b", "address": "fa:16:3e:10:b7:d0", "network": {"id": "c543f5eb-b28c-4113-a560-8d6790713d19", "bridge": "br-int", "label": "tempest-device-tagging-net2-1828870959", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "020f60d454f846d5a18dfbe1d88b65da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5c4abf8-1b", "ovs_interfaceid": "c5c4abf8-1b9b-4385-adf7-b34b27a8bc6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1d70ad7b-92c6-47fa-a411-cef9d6159e90", "address": "fa:16:3e:46:54:b4", "network": {"id": "c543f5eb-b28c-4113-a560-8d6790713d19", "bridge": "br-int", "label": "tempest-device-tagging-net2-1828870959", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "020f60d454f846d5a18dfbe1d88b65da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d70ad7b-92", "ovs_interfaceid": "1d70ad7b-92c6-47fa-a411-cef9d6159e90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 16:00:48 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-3bcfce5f-a066-495c-b4a5-22f3c0094601 req-dda2539e-09f7-40dc-9c08-e77b591c873d service nova] Acquired lock "refresh_cache-9ea56377-20bc-48cc-a248-5fad6db060cb" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:00:48 user nova-compute[71874]: DEBUG nova.network.neutron [req-3bcfce5f-a066-495c-b4a5-22f3c0094601 req-dda2539e-09f7-40dc-9c08-e77b591c873d service nova] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Refreshing network info cache for port c5c4abf8-1b9b-4385-adf7-b34b27a8bc6b {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 16:00:48 user nova-compute[71874]: INFO nova.virt.block_device [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Booting with volume 9b990634-7cec-49db-9df4-81d3a3f3b0fd at /dev/vdc
Apr 12 16:00:48 user nova-compute[71874]: DEBUG nova.compute.manager [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] [instance: 026ab036-1481-4689-af70-661493e9451c] Start spawning the instance on the hypervisor. {{(pid=71874) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 16:00:48 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] [instance: 026ab036-1481-4689-af70-661493e9451c] Creating instance directory {{(pid=71874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 16:00:48 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] [instance: 026ab036-1481-4689-af70-661493e9451c] Creating image(s)
Apr 12 16:00:48 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] [instance: 026ab036-1481-4689-af70-661493e9451c] Did not create local disks {{(pid=71874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 12 16:00:48 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] [instance: 026ab036-1481-4689-af70-661493e9451c] Ensure instance console log exists: /opt/stack/data/nova/instances/026ab036-1481-4689-af70-661493e9451c/console.log {{(pid=71874) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 16:00:48 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:00:48 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:00:48 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:00:48 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] [instance: 026ab036-1481-4689-af70-661493e9451c] Start _get_guest_xml network_info=[{"id": "0d6194a7-a3c4-47f9-8c37-960cb622ce28", "address": "fa:16:3e:9c:84:d7", "network": {"id": "77f1158d-0720-49c1-9530-29d3cdca64df", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1458658917-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14aea401da6344858416fd2543bc10ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d6194a7-a3", "ovs_interfaceid": "0d6194a7-a3c4-47f9-8c37-960cb622ce28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8ebc1d23-a473-4640-aa39-31cbed300c07", "address": "fa:16:3e:d5:95:9e", "network": {"id": "9b0c9550-d764-4db6-b28b-09ab59801170", "bridge": "br-int", "label": "tempest-device-tagging-net1-638686183", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.180", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14aea401da6344858416fd2543bc10ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ebc1d23-a4", "ovs_interfaceid": "8ebc1d23-a473-4640-aa39-31cbed300c07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7f36bae3-c729-4d85-8c31-075b2b100abe", "address": "fa:16:3e:99:5c:8b", "network": {"id": "9b0c9550-d764-4db6-b28b-09ab59801170", "bridge": "br-int", "label": "tempest-device-tagging-net1-638686183", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14aea401da6344858416fd2543bc10ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f36bae3-c7", "ovs_interfaceid": "7f36bae3-c729-4d85-8c31-075b2b100abe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "264de72a-d4f4-4a6a-b3ab-1e8ea8b9a30b", "address": "fa:16:3e:da:a9:6d", "network": {"id": "9b0c9550-d764-4db6-b28b-09ab59801170", "bridge": "br-int", "label": "tempest-device-tagging-net1-638686183", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14aea401da6344858416fd2543bc10ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap264de72a-d4", "ovs_interfaceid": "264de72a-d4f4-4a6a-b3ab-1e8ea8b9a30b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e3f484fe-17dd-4cef-babd-ad78cf557b03", "address": "fa:16:3e:e6:0d:58", "network": {"id": "9b0c9550-d764-4db6-b28b-09ab59801170", "bridge": "br-int", "label": "tempest-device-tagging-net1-638686183", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14aea401da6344858416fd2543bc10ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3f484fe-17", "ovs_interfaceid": "e3f484fe-17dd-4cef-babd-ad78cf557b03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0b2175eb-de94-4274-b200-14894dbcbda0", "address": "fa:16:3e:0f:80:1c", "network": {"id": "92fe4d7e-c0cd-45f1-9e92-a120ab22f6f1", "bridge": "br-int", "label": "tempest-device-tagging-net2-367644823", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "14aea401da6344858416fd2543bc10ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b2175eb-de", "ovs_interfaceid": "0b2175eb-de94-4274-b200-14894dbcbda0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5796cf52-4e81-4c40-954e-86819f5557c8", "address": "fa:16:3e:b7:67:83", "network": {"id": "92fe4d7e-c0cd-45f1-9e92-a120ab22f6f1", "bridge": "br-int", "label": "tempest-device-tagging-net2-367644823", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "14aea401da6344858416fd2543bc10ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5796cf52-4e", "ovs_interfaceid": "5796cf52-4e81-4c40-954e-86819f5557c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T15:55:37Z,direct_url=<?>,disk_format='qcow2',id=9dc63f14-8b70-4e72-89f2-13464f2f5c7c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='61a4936d9b7744c0b488d81c9b7746b6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T15:55:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'delete_on_termination': False, 'attachment_id': '417a5322-fef2-439c-a3ba-442371f77f83', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b2fde1cb-bd86-48a5-8aca-463fdf3444b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TNLIkhgb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '026ab036-1481-4689-af70-661493e9451c', 'attached_at': '', 'detached_at': '', 'volume_id': 'b2fde1cb-bd86-48a5-8aca-463fdf3444b0', 'serial': 'b2fde1cb-bd86-48a5-8aca-463fdf3444b0'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'volume_type': None}, {'guest_format': None, 'delete_on_termination': False, 'attachment_id': 'af84bd42-6519-44b4-9f12-e31317969fc2', 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FsfOvogi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '026ab036-1481-4689-af70-661493e9451c', 'attached_at': '', 'detached_at': '', 'volume_id': '33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4', 'serial': '33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 1, 'volume_type': None}, {'guest_format': None, 'delete_on_termination': False, 'attachment_id': '9c374613-50be-4799-bd36-a8cf9aa062de', 'mount_device': '/dev/vdc', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a0100e6d-5149-423c-aadc-0c4f2635196b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'msHTjcxK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '026ab036-1481-4689-af70-661493e9451c', 'attached_at': '', 'detached_at': '', 'volume_id': 'a0100e6d-5149-423c-aadc-0c4f2635196b', 'serial': 'a0100e6d-5149-423c-aadc-0c4f2635196b'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 2, 'volume_type': None} {{(pid=71874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 16:00:48 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:00:48 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:00:48 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71874) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 16:00:48 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T15:56:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T15:55:37Z,direct_url=<?>,disk_format='qcow2',id=9dc63f14-8b70-4e72-89f2-13464f2f5c7c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='61a4936d9b7744c0b488d81c9b7746b6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T15:55:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 16:00:48 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Flavor limits 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 16:00:48 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Image limits 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 16:00:48 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Flavor pref 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 16:00:48 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Image pref 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 16:00:48 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 16:00:48 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 16:00:48 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 16:00:48 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Got 1 possible topologies {{(pid=71874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 16:00:48 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 16:00:48 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 16:00:48 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] [instance: 026ab036-1481-4689-af70-661493e9451c] Calling os-brick to attach iSCSI Volume {{(pid=71874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 16:00:48 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3c0216320>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b2fde1cb-bd86-48a5-8aca-463fdf3444b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TNLIkhgb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:00:48 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:00:48 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:00:48 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:00:48 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:00:48 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b2fde1cb-bd86-48a5-8aca-463fdf3444b0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:00:48 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b2fde1cb-bd86-48a5-8aca-463fdf3444b0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:00:48 user nova-compute[71874]: INFO os_brick.initiator.connectors.iscsi [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 16:00:48 user nova-compute[71874]: DEBUG os_brick.utils [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:00:48 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2fde1cb-bd86-48a5-8aca-463fdf3444b0 -p 172.16.0.220:3260 {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:48 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:48 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2fde1cb-bd86-48a5-8aca-463fdf3444b0 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:00:48 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[808eee38-3b2b-4a0b-aaaf-457c64a2cfc0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:00:48 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 16:00:48 user nova-compute[71874]:  {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:00:48 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:00:48 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2fde1cb-bd86-48a5-8aca-463fdf3444b0 -p 172.16.0.220:3260 --interface default --op new {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:48 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec31e2d2-15fb-49b3-a756-6433052eb29c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:61a48d4489d2\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:00:48 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:48 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2fde1cb-bd86-48a5-8aca-463fdf3444b0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:00:48 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[37e2c21c-080d-4415-9659-4391e7bb98a1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b2fde1cb-bd86-48a5-8aca-463fdf3444b0] added\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:00:48 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b2fde1cb-bd86-48a5-8aca-463fdf3444b0] added
Apr 12 16:00:48 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:00:48 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2fde1cb-bd86-48a5-8aca-463fdf3444b0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:48 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:00:48 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[0828f98b-7b64-4b17-9153-b2898b88cfd9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:00:48 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:48 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2fde1cb-bd86-48a5-8aca-463fdf3444b0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:00:48 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[82e15492-e884-46b3-af28-f8db15fe2c10]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:00:48 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:00:48 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2fde1cb-bd86-48a5-8aca-463fdf3444b0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:48 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:00:48 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d067f0d-7fe1-466d-a2c7-f7e399631ac7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:00:48 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[8adbe7b0-bec5-4ad2-a555-6c5df6e419b0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:00:48 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Running cmd (subprocess): nvme version {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:48 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] 'nvme version' failed. Not Retrying. {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 16:00:48 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2fde1cb-bd86-48a5-8aca-463fdf3444b0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:00:48 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcebe5bd-bcd9-4743-ab06-f3536254a497]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:00:48 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.nvmeof [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] nvme not present on system {{(pid=71874) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 16:00:48 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:00:48 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:48 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2fde1cb-bd86-48a5-8aca-463fdf3444b0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TNLIkhgb {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:48 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 16:00:48 user nova-compute[71874]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 16:00:48 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bab0143-e84c-4fcc-a150-8cd86f969200]: (4, '') {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:00:48 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.lightos [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71874) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 16:00:48 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.lightos [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71874) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 16:00:48 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.lightos [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] LIGHTOS: no hostnqn found. {{(pid=71874) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 16:00:48 user nova-compute[71874]: DEBUG os_brick.utils [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:61a48d4489d2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:00:48 user nova-compute[71874]: DEBUG nova.virt.block_device [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Updating existing volume attachment record: 43df2b8b-47be-491a-bdfa-89c84bda8bae {{(pid=71874) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 16:00:48 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2fde1cb-bd86-48a5-8aca-463fdf3444b0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TNLIkhgb" returned: 0 in 0.019s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:00:48 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a1d5d40-459a-455c-91a2-6e2e9e966038]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:00:48 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TNLIkhgb'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:00:48 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2fde1cb-bd86-48a5-8aca-463fdf3444b0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:48 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2fde1cb-bd86-48a5-8aca-463fdf3444b0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:00:48 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ead169d-8740-46a0-bb01-97aa42cd6bdc]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:00:48 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:00:48 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:48 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:00:48 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[5253048f-ae08-46a7-a0b2-c7d078b8ead4]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:00:48 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 (non-flash)
Apr 12 16:00:48 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:00:48 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 (non-flash)
Apr 12 16:00:48 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:00:48 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2fde1cb-bd86-48a5-8aca-463fdf3444b0 -p 172.16.0.220:3260 --login {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:48 user nova-compute[71874]: DEBUG nova.network.neutron [req-3bcfce5f-a066-495c-b4a5-22f3c0094601 req-dda2539e-09f7-40dc-9c08-e77b591c873d service nova] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Updated VIF entry in instance network info cache for port c5c4abf8-1b9b-4385-adf7-b34b27a8bc6b. {{(pid=71874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 16:00:48 user nova-compute[71874]: DEBUG nova.network.neutron [req-3bcfce5f-a066-495c-b4a5-22f3c0094601 req-dda2539e-09f7-40dc-9c08-e77b591c873d service nova] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Updating instance_info_cache with network_info: [{"id": "7ae43e60-f63a-448e-9a89-0d6bff272104", "address": "fa:16:3e:b7:f0:f6", "network": {"id": "db8367a7-06c5-4e83-987a-c92d02009fef", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-612559343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "020f60d454f846d5a18dfbe1d88b65da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ae43e60-f6", "ovs_interfaceid": "7ae43e60-f63a-448e-9a89-0d6bff272104", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6c9be856-3e7e-4166-8d71-a1f5330aa82f", "address": "fa:16:3e:44:ca:b6", "network": {"id": "a491fcd5-d137-491a-9854-a743afbd448d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1608054323", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "020f60d454f846d5a18dfbe1d88b65da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9be856-3e", "ovs_interfaceid": "6c9be856-3e7e-4166-8d71-a1f5330aa82f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cd2391ad-cb7a-47be-b062-b0dbbc1f8475", "address": "fa:16:3e:89:21:2f", "network": {"id": "a491fcd5-d137-491a-9854-a743afbd448d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1608054323", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.38", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "020f60d454f846d5a18dfbe1d88b65da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd2391ad-cb", "ovs_interfaceid": "cd2391ad-cb7a-47be-b062-b0dbbc1f8475", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f76aae02-12c4-41d6-951a-201330ea7693", "address": "fa:16:3e:13:a6:2d", "network": {"id": "a491fcd5-d137-491a-9854-a743afbd448d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1608054323", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.239", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "020f60d454f846d5a18dfbe1d88b65da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf76aae02-12", "ovs_interfaceid": "f76aae02-12c4-41d6-951a-201330ea7693", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b85b7f43-1f5d-441a-bf3e-380900194e10", "address": "fa:16:3e:2f:65:2e", "network": {"id": "a491fcd5-d137-491a-9854-a743afbd448d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1608054323", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "020f60d454f846d5a18dfbe1d88b65da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb85b7f43-1f", "ovs_interfaceid": "b85b7f43-1f5d-441a-bf3e-380900194e10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c5c4abf8-1b9b-4385-adf7-b34b27a8bc6b", "address": "fa:16:3e:10:b7:d0", "network": {"id": "c543f5eb-b28c-4113-a560-8d6790713d19", "bridge": "br-int", "label": "tempest-device-tagging-net2-1828870959", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "020f60d454f846d5a18dfbe1d88b65da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5c4abf8-1b", "ovs_interfaceid": "c5c4abf8-1b9b-4385-adf7-b34b27a8bc6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1d70ad7b-92c6-47fa-a411-cef9d6159e90", "address": "fa:16:3e:46:54:b4", "network": {"id": "c543f5eb-b28c-4113-a560-8d6790713d19", "bridge": "br-int", "label": "tempest-device-tagging-net2-1828870959", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "020f60d454f846d5a18dfbe1d88b65da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d70ad7b-92", "ovs_interfaceid": "1d70ad7b-92c6-47fa-a411-cef9d6159e90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:00:48 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2fde1cb-bd86-48a5-8aca-463fdf3444b0 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:00:48 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb86e17f-e7d5-493d-a4a7-0083f30d7863]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b2fde1cb-bd86-48a5-8aca-463fdf3444b0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b2fde1cb-bd86-48a5-8aca-463fdf3444b0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:00:48 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b2fde1cb-bd86-48a5-8aca-463fdf3444b0, portal: 172.16.0.220,3260]
Apr 12 16:00:48 user nova-compute[71874]: Login to [iface: default, target: iqn.2010-10.org.openstack:b2fde1cb-bd86-48a5-8aca-463fdf3444b0, portal: 172.16.0.220,3260] successful.
Apr 12 16:00:48 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:00:48 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2fde1cb-bd86-48a5-8aca-463fdf3444b0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:48 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-3bcfce5f-a066-495c-b4a5-22f3c0094601 req-dda2539e-09f7-40dc-9c08-e77b591c873d service nova] Releasing lock "refresh_cache-9ea56377-20bc-48cc-a248-5fad6db060cb" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:00:48 user nova-compute[71874]: DEBUG nova.compute.manager [req-3bcfce5f-a066-495c-b4a5-22f3c0094601 req-dda2539e-09f7-40dc-9c08-e77b591c873d service nova] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Received event network-changed-1d70ad7b-92c6-47fa-a411-cef9d6159e90 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:00:48 user nova-compute[71874]: DEBUG nova.compute.manager [req-3bcfce5f-a066-495c-b4a5-22f3c0094601 req-dda2539e-09f7-40dc-9c08-e77b591c873d service nova] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Refreshing instance network info cache due to event network-changed-1d70ad7b-92c6-47fa-a411-cef9d6159e90. {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 16:00:48 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-3bcfce5f-a066-495c-b4a5-22f3c0094601 req-dda2539e-09f7-40dc-9c08-e77b591c873d service nova] Acquiring lock "refresh_cache-9ea56377-20bc-48cc-a248-5fad6db060cb" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:00:48 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-3bcfce5f-a066-495c-b4a5-22f3c0094601 req-dda2539e-09f7-40dc-9c08-e77b591c873d service nova] Acquired lock "refresh_cache-9ea56377-20bc-48cc-a248-5fad6db060cb" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:00:48 user nova-compute[71874]: DEBUG nova.network.neutron [req-3bcfce5f-a066-495c-b4a5-22f3c0094601 req-dda2539e-09f7-40dc-9c08-e77b591c873d service nova] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Refreshing network info cache for port 1d70ad7b-92c6-47fa-a411-cef9d6159e90 {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 16:00:48 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2fde1cb-bd86-48a5-8aca-463fdf3444b0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:00:48 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d7826a1-d29c-46be-8b63-c28e7c207a82]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:00:48 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:00:48 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:48 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:00:48 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fefedde-dd7f-4467-953f-3831e15ea6d7]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fde1cb-bd86-48a5-8aca-463fdf3444b0 (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:00:48 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 (non-flash)
Apr 12 16:00:48 user nova-compute[71874]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fde1cb-bd86-48a5-8aca-463fdf3444b0 (non-flash)
Apr 12 16:00:48 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:00:48 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 (non-flash)
Apr 12 16:00:48 user nova-compute[71874]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fde1cb-bd86-48a5-8aca-463fdf3444b0 (non-flash)
Apr 12 16:00:48 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:00:48 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b2fde1cb-bd86-48a5-8aca-463fdf3444b0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.313s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:00:48 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Connected to 172.16.0.220:3260 {{(pid=71874) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 16:00:48 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=71874) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 16:00:48 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71874) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 16:00:48 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:48 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:00:48 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[f47e5a73-f6c2-4aa3-b026-50fc6e4d1b5d]: (4, ('- - 0', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:00:48 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71874) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 16:00:48 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:b2fde1cb-bd86-48a5-8aca-463fdf3444b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TNLIkhgb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71874) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 16:00:49 user nova-compute[71874]: DEBUG nova.network.neutron [req-3bcfce5f-a066-495c-b4a5-22f3c0094601 req-dda2539e-09f7-40dc-9c08-e77b591c873d service nova] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Updated VIF entry in instance network info cache for port 1d70ad7b-92c6-47fa-a411-cef9d6159e90. {{(pid=71874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 16:00:49 user nova-compute[71874]: DEBUG nova.network.neutron [req-3bcfce5f-a066-495c-b4a5-22f3c0094601 req-dda2539e-09f7-40dc-9c08-e77b591c873d service nova] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Updating instance_info_cache with network_info: [{"id": "7ae43e60-f63a-448e-9a89-0d6bff272104", "address": "fa:16:3e:b7:f0:f6", "network": {"id": "db8367a7-06c5-4e83-987a-c92d02009fef", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-612559343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "020f60d454f846d5a18dfbe1d88b65da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ae43e60-f6", "ovs_interfaceid": "7ae43e60-f63a-448e-9a89-0d6bff272104", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6c9be856-3e7e-4166-8d71-a1f5330aa82f", "address": "fa:16:3e:44:ca:b6", "network": {"id": "a491fcd5-d137-491a-9854-a743afbd448d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1608054323", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "020f60d454f846d5a18dfbe1d88b65da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9be856-3e", "ovs_interfaceid": "6c9be856-3e7e-4166-8d71-a1f5330aa82f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cd2391ad-cb7a-47be-b062-b0dbbc1f8475", "address": "fa:16:3e:89:21:2f", "network": {"id": "a491fcd5-d137-491a-9854-a743afbd448d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1608054323", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.38", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "020f60d454f846d5a18dfbe1d88b65da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd2391ad-cb", "ovs_interfaceid": "cd2391ad-cb7a-47be-b062-b0dbbc1f8475", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f76aae02-12c4-41d6-951a-201330ea7693", "address": "fa:16:3e:13:a6:2d", "network": {"id": "a491fcd5-d137-491a-9854-a743afbd448d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1608054323", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.239", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "020f60d454f846d5a18dfbe1d88b65da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf76aae02-12", "ovs_interfaceid": "f76aae02-12c4-41d6-951a-201330ea7693", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b85b7f43-1f5d-441a-bf3e-380900194e10", "address": "fa:16:3e:2f:65:2e", "network": {"id": "a491fcd5-d137-491a-9854-a743afbd448d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1608054323", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "020f60d454f846d5a18dfbe1d88b65da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb85b7f43-1f", "ovs_interfaceid": "b85b7f43-1f5d-441a-bf3e-380900194e10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c5c4abf8-1b9b-4385-adf7-b34b27a8bc6b", "address": "fa:16:3e:10:b7:d0", "network": {"id": "c543f5eb-b28c-4113-a560-8d6790713d19", "bridge": "br-int", "label": "tempest-device-tagging-net2-1828870959", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "020f60d454f846d5a18dfbe1d88b65da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5c4abf8-1b", "ovs_interfaceid": "c5c4abf8-1b9b-4385-adf7-b34b27a8bc6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1d70ad7b-92c6-47fa-a411-cef9d6159e90", "address": "fa:16:3e:46:54:b4", "network": {"id": "c543f5eb-b28c-4113-a560-8d6790713d19", "bridge": "br-int", "label": "tempest-device-tagging-net2-1828870959", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "020f60d454f846d5a18dfbe1d88b65da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d70ad7b-92", "ovs_interfaceid": "1d70ad7b-92c6-47fa-a411-cef9d6159e90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:00:49 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-3bcfce5f-a066-495c-b4a5-22f3c0094601 req-dda2539e-09f7-40dc-9c08-e77b591c873d service nova] Releasing lock "refresh_cache-9ea56377-20bc-48cc-a248-5fad6db060cb" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:00:49 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-9a2b1083-3ba0-489a-bf25-200b0cd7d4ed req-79dfa6ba-1077-4394-a9e7-86a6cfaa387d service nova] Acquired lock "refresh_cache-9ea56377-20bc-48cc-a248-5fad6db060cb" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:00:49 user nova-compute[71874]: DEBUG nova.network.neutron [req-9a2b1083-3ba0-489a-bf25-200b0cd7d4ed req-79dfa6ba-1077-4394-a9e7-86a6cfaa387d service nova] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Refreshing network info cache for port f76aae02-12c4-41d6-951a-201330ea7693 {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 16:00:49 user nova-compute[71874]: DEBUG nova.network.neutron [req-9a2b1083-3ba0-489a-bf25-200b0cd7d4ed req-79dfa6ba-1077-4394-a9e7-86a6cfaa387d service nova] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Updated VIF entry in instance network info cache for port f76aae02-12c4-41d6-951a-201330ea7693. {{(pid=71874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 16:00:49 user nova-compute[71874]: DEBUG nova.network.neutron [req-9a2b1083-3ba0-489a-bf25-200b0cd7d4ed req-79dfa6ba-1077-4394-a9e7-86a6cfaa387d service nova] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Updating instance_info_cache with network_info: [{"id": "7ae43e60-f63a-448e-9a89-0d6bff272104", "address": "fa:16:3e:b7:f0:f6", "network": {"id": "db8367a7-06c5-4e83-987a-c92d02009fef", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-612559343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "020f60d454f846d5a18dfbe1d88b65da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ae43e60-f6", "ovs_interfaceid": "7ae43e60-f63a-448e-9a89-0d6bff272104", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6c9be856-3e7e-4166-8d71-a1f5330aa82f", "address": "fa:16:3e:44:ca:b6", "network": {"id": "a491fcd5-d137-491a-9854-a743afbd448d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1608054323", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "020f60d454f846d5a18dfbe1d88b65da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9be856-3e", "ovs_interfaceid": "6c9be856-3e7e-4166-8d71-a1f5330aa82f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cd2391ad-cb7a-47be-b062-b0dbbc1f8475", "address": "fa:16:3e:89:21:2f", "network": {"id": "a491fcd5-d137-491a-9854-a743afbd448d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1608054323", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.38", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "020f60d454f846d5a18dfbe1d88b65da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd2391ad-cb", "ovs_interfaceid": "cd2391ad-cb7a-47be-b062-b0dbbc1f8475", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f76aae02-12c4-41d6-951a-201330ea7693", "address": "fa:16:3e:13:a6:2d", "network": {"id": "a491fcd5-d137-491a-9854-a743afbd448d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1608054323", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.239", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "020f60d454f846d5a18dfbe1d88b65da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf76aae02-12", "ovs_interfaceid": "f76aae02-12c4-41d6-951a-201330ea7693", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b85b7f43-1f5d-441a-bf3e-380900194e10", "address": "fa:16:3e:2f:65:2e", "network": {"id": "a491fcd5-d137-491a-9854-a743afbd448d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1608054323", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "020f60d454f846d5a18dfbe1d88b65da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb85b7f43-1f", "ovs_interfaceid": "b85b7f43-1f5d-441a-bf3e-380900194e10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c5c4abf8-1b9b-4385-adf7-b34b27a8bc6b", "address": "fa:16:3e:10:b7:d0", "network": {"id": "c543f5eb-b28c-4113-a560-8d6790713d19", "bridge": "br-int", "label": "tempest-device-tagging-net2-1828870959", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "020f60d454f846d5a18dfbe1d88b65da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5c4abf8-1b", "ovs_interfaceid": "c5c4abf8-1b9b-4385-adf7-b34b27a8bc6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1d70ad7b-92c6-47fa-a411-cef9d6159e90", "address": "fa:16:3e:46:54:b4", "network": {"id": "c543f5eb-b28c-4113-a560-8d6790713d19", "bridge": "br-int", "label": "tempest-device-tagging-net2-1828870959", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "020f60d454f846d5a18dfbe1d88b65da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d70ad7b-92", "ovs_interfaceid": "1d70ad7b-92c6-47fa-a411-cef9d6159e90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:00:49 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-9a2b1083-3ba0-489a-bf25-200b0cd7d4ed req-79dfa6ba-1077-4394-a9e7-86a6cfaa387d service nova] Releasing lock "refresh_cache-9ea56377-20bc-48cc-a248-5fad6db060cb" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:00:49 user nova-compute[71874]: DEBUG nova.compute.manager [req-9a2b1083-3ba0-489a-bf25-200b0cd7d4ed req-79dfa6ba-1077-4394-a9e7-86a6cfaa387d service nova] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Received event network-changed-b85b7f43-1f5d-441a-bf3e-380900194e10 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:00:49 user nova-compute[71874]: DEBUG nova.compute.manager [req-9a2b1083-3ba0-489a-bf25-200b0cd7d4ed req-79dfa6ba-1077-4394-a9e7-86a6cfaa387d service nova] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Refreshing instance network info cache due to event network-changed-b85b7f43-1f5d-441a-bf3e-380900194e10. {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 16:00:49 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-9a2b1083-3ba0-489a-bf25-200b0cd7d4ed req-79dfa6ba-1077-4394-a9e7-86a6cfaa387d service nova] Acquiring lock "refresh_cache-9ea56377-20bc-48cc-a248-5fad6db060cb" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:00:49 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-9a2b1083-3ba0-489a-bf25-200b0cd7d4ed req-79dfa6ba-1077-4394-a9e7-86a6cfaa387d service nova] Acquired lock "refresh_cache-9ea56377-20bc-48cc-a248-5fad6db060cb" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:00:49 user nova-compute[71874]: DEBUG nova.network.neutron [req-9a2b1083-3ba0-489a-bf25-200b0cd7d4ed req-79dfa6ba-1077-4394-a9e7-86a6cfaa387d service nova] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Refreshing network info cache for port b85b7f43-1f5d-441a-bf3e-380900194e10 {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 16:00:49 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.348s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:00:49 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] <== connect_volume: return (1350ms) {'type': 'block', 'scsi_wwn': '23366653639356566', 'path': '/dev/sdc'} {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:00:49 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] [instance: 026ab036-1481-4689-af70-661493e9451c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23366653639356566', 'path': '/dev/sdc'} {{(pid=71874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 16:00:49 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] [instance: 026ab036-1481-4689-af70-661493e9451c] Calling os-brick to attach iSCSI Volume {{(pid=71874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 16:00:49 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3c0216320>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FsfOvogi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:00:49 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:00:49 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:00:49 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:00:49 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:00:49 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:00:49 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:00:49 user nova-compute[71874]: INFO os_brick.initiator.connectors.iscsi [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 16:00:49 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4 -p 172.16.0.220:3260 {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:49 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:00:49 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[be5c7d7a-fc18-4bcb-b186-c7b46265aa34]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:00:49 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 16:00:49 user nova-compute[71874]:  {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:00:49 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4 -p 172.16.0.220:3260 --interface default --op new {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:49 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:00:49 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[9707f8b7-034a-4e60-a60f-0fc99dbdcd81]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4] added\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:00:49 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4] added
Apr 12 16:00:49 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:00:49 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:49 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:00:49 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[32d5cfc5-4c5c-47b0-b503-6e53fd334d29]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:00:49 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:00:49 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:49 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:00:49 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[e39da945-33ee-4663-acbd-42ba7e965f88]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:00:49 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:00:49 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FsfOvogi {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:50 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FsfOvogi" returned: 0 in 0.018s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:00:50 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[24191d43-eef5-485b-8618-a077e62a3395]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:00:50 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FsfOvogi'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:00:50 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:50 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:00:50 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[348aa83e-b086-4036-a87b-7577090694d4]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:00:50 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:00:50 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:50 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:00:50 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[54bfc9f8-7e5a-4d91-beb6-bd8d77f95994]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fde1cb-bd86-48a5-8aca-463fdf3444b0 (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:00:50 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 (non-flash)
Apr 12 16:00:50 user nova-compute[71874]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fde1cb-bd86-48a5-8aca-463fdf3444b0 (non-flash)
Apr 12 16:00:50 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:00:50 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 (non-flash)
Apr 12 16:00:50 user nova-compute[71874]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fde1cb-bd86-48a5-8aca-463fdf3444b0 (non-flash)
Apr 12 16:00:50 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:00:50 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4 -p 172.16.0.220:3260 --login {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:50 user nova-compute[71874]: DEBUG nova.network.neutron [req-9a2b1083-3ba0-489a-bf25-200b0cd7d4ed req-79dfa6ba-1077-4394-a9e7-86a6cfaa387d service nova] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Updated VIF entry in instance network info cache for port b85b7f43-1f5d-441a-bf3e-380900194e10. {{(pid=71874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 16:00:50 user nova-compute[71874]: DEBUG nova.network.neutron [req-9a2b1083-3ba0-489a-bf25-200b0cd7d4ed req-79dfa6ba-1077-4394-a9e7-86a6cfaa387d service nova] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Updating instance_info_cache with network_info: [{"id": "7ae43e60-f63a-448e-9a89-0d6bff272104", "address": "fa:16:3e:b7:f0:f6", "network": {"id": "db8367a7-06c5-4e83-987a-c92d02009fef", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-612559343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "020f60d454f846d5a18dfbe1d88b65da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ae43e60-f6", "ovs_interfaceid": "7ae43e60-f63a-448e-9a89-0d6bff272104", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6c9be856-3e7e-4166-8d71-a1f5330aa82f", "address": "fa:16:3e:44:ca:b6", "network": {"id": "a491fcd5-d137-491a-9854-a743afbd448d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1608054323", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "020f60d454f846d5a18dfbe1d88b65da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9be856-3e", "ovs_interfaceid": "6c9be856-3e7e-4166-8d71-a1f5330aa82f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cd2391ad-cb7a-47be-b062-b0dbbc1f8475", "address": "fa:16:3e:89:21:2f", "network": {"id": "a491fcd5-d137-491a-9854-a743afbd448d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1608054323", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.38", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "020f60d454f846d5a18dfbe1d88b65da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd2391ad-cb", "ovs_interfaceid": "cd2391ad-cb7a-47be-b062-b0dbbc1f8475", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f76aae02-12c4-41d6-951a-201330ea7693", "address": "fa:16:3e:13:a6:2d", "network": {"id": "a491fcd5-d137-491a-9854-a743afbd448d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1608054323", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.239", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "020f60d454f846d5a18dfbe1d88b65da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf76aae02-12", "ovs_interfaceid": "f76aae02-12c4-41d6-951a-201330ea7693", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b85b7f43-1f5d-441a-bf3e-380900194e10", "address": "fa:16:3e:2f:65:2e", "network": {"id": "a491fcd5-d137-491a-9854-a743afbd448d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1608054323", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "020f60d454f846d5a18dfbe1d88b65da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb85b7f43-1f", "ovs_interfaceid": "b85b7f43-1f5d-441a-bf3e-380900194e10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c5c4abf8-1b9b-4385-adf7-b34b27a8bc6b", "address": "fa:16:3e:10:b7:d0", "network": {"id": "c543f5eb-b28c-4113-a560-8d6790713d19", "bridge": "br-int", "label": "tempest-device-tagging-net2-1828870959", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "020f60d454f846d5a18dfbe1d88b65da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5c4abf8-1b", "ovs_interfaceid": "c5c4abf8-1b9b-4385-adf7-b34b27a8bc6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1d70ad7b-92c6-47fa-a411-cef9d6159e90", "address": "fa:16:3e:46:54:b4", "network": {"id": "c543f5eb-b28c-4113-a560-8d6790713d19", "bridge": "br-int", "label": "tempest-device-tagging-net2-1828870959", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "020f60d454f846d5a18dfbe1d88b65da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d70ad7b-92", "ovs_interfaceid": "1d70ad7b-92c6-47fa-a411-cef9d6159e90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:00:50 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:00:50 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[297927b3-10d9-4171-a1c8-926fc0a6b4eb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:00:50 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4, portal: 172.16.0.220,3260]
Apr 12 16:00:50 user nova-compute[71874]: Login to [iface: default, target: iqn.2010-10.org.openstack:33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4, portal: 172.16.0.220,3260] successful.
Apr 12 16:00:50 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:00:50 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:50 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-9a2b1083-3ba0-489a-bf25-200b0cd7d4ed req-79dfa6ba-1077-4394-a9e7-86a6cfaa387d service nova] Releasing lock "refresh_cache-9ea56377-20bc-48cc-a248-5fad6db060cb" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:00:50 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:00:50 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea29e3be-568a-4e9f-ba4e-3193cb99f984]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:00:50 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:00:50 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:50 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:50 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:00:50 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0a10316-6f59-4ae2-9def-d7a503e28520]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fde1cb-bd86-48a5-8aca-463fdf3444b0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4 (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:00:50 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 (non-flash)
Apr 12 16:00:50 user nova-compute[71874]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fde1cb-bd86-48a5-8aca-463fdf3444b0 (non-flash)
Apr 12 16:00:50 user nova-compute[71874]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4 (non-flash)
Apr 12 16:00:50 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:00:50 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 (non-flash)
Apr 12 16:00:50 user nova-compute[71874]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fde1cb-bd86-48a5-8aca-463fdf3444b0 (non-flash)
Apr 12 16:00:50 user nova-compute[71874]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4 (non-flash)
Apr 12 16:00:50 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:00:50 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.282s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:00:50 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Connected to 172.16.0.220:3260 {{(pid=71874) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 16:00:50 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=71874) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 16:00:50 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71874) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 16:00:50 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:50 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:00:50 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c1169a5-5244-426b-82b9-0b9688d5546e]: (4, ('- - 0', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:00:50 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71874) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 16:00:50 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FsfOvogi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71874) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 16:00:51 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.318s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:00:51 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] <== connect_volume: return (1319ms) {'type': 'block', 'scsi_wwn': '26466346332343563', 'path': '/dev/sdd'} {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:00:51 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] [instance: 026ab036-1481-4689-af70-661493e9451c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26466346332343563', 'path': '/dev/sdd'} {{(pid=71874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 16:00:51 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] [instance: 026ab036-1481-4689-af70-661493e9451c] Calling os-brick to attach iSCSI Volume {{(pid=71874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 16:00:51 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3c0216320>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a0100e6d-5149-423c-aadc-0c4f2635196b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'msHTjcxK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:00:51 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:00:51 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:00:51 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:00:51 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:00:51 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a0100e6d-5149-423c-aadc-0c4f2635196b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:00:51 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a0100e6d-5149-423c-aadc-0c4f2635196b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:00:51 user nova-compute[71874]: INFO os_brick.initiator.connectors.iscsi [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 16:00:51 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0100e6d-5149-423c-aadc-0c4f2635196b -p 172.16.0.220:3260 {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:51 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0100e6d-5149-423c-aadc-0c4f2635196b -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:00:51 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[f541433a-5041-4967-95b8-c4e1e4f90d45]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:00:51 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 16:00:51 user nova-compute[71874]:  {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:00:51 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0100e6d-5149-423c-aadc-0c4f2635196b -p 172.16.0.220:3260 --interface default --op new {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:51 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0100e6d-5149-423c-aadc-0c4f2635196b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:00:51 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a1f4b8e-9c21-4e25-acf9-72b37090322d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a0100e6d-5149-423c-aadc-0c4f2635196b] added\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:00:51 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a0100e6d-5149-423c-aadc-0c4f2635196b] added
Apr 12 16:00:51 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:00:51 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0100e6d-5149-423c-aadc-0c4f2635196b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:51 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0100e6d-5149-423c-aadc-0c4f2635196b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:00:51 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bdf0814-1292-405a-bb54-13302b03871d]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:00:51 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:00:51 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0100e6d-5149-423c-aadc-0c4f2635196b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:51 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0100e6d-5149-423c-aadc-0c4f2635196b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:00:51 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d66a4ec-1b6e-45d4-b44c-aa8a2ba68971]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:00:51 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:00:51 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0100e6d-5149-423c-aadc-0c4f2635196b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v msHTjcxK {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:51 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0100e6d-5149-423c-aadc-0c4f2635196b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v msHTjcxK" returned: 0 in 0.019s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:00:51 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[8130c602-61db-41ef-a721-804275d562b0]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:00:51 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'msHTjcxK'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:00:51 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0100e6d-5149-423c-aadc-0c4f2635196b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:51 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0100e6d-5149-423c-aadc-0c4f2635196b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:00:51 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[825651f9-2ac7-4dfc-8f19-930389242ac5]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:00:51 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:00:51 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:51 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:00:51 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccd0022e-1df9-4127-a42b-99c880a1d383]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fde1cb-bd86-48a5-8aca-463fdf3444b0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4 (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:00:51 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 (non-flash)
Apr 12 16:00:51 user nova-compute[71874]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fde1cb-bd86-48a5-8aca-463fdf3444b0 (non-flash)
Apr 12 16:00:51 user nova-compute[71874]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4 (non-flash)
Apr 12 16:00:51 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:00:51 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 (non-flash)
Apr 12 16:00:51 user nova-compute[71874]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fde1cb-bd86-48a5-8aca-463fdf3444b0 (non-flash)
Apr 12 16:00:51 user nova-compute[71874]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4 (non-flash)
Apr 12 16:00:51 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:00:51 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0100e6d-5149-423c-aadc-0c4f2635196b -p 172.16.0.220:3260 --login {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:51 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0100e6d-5149-423c-aadc-0c4f2635196b -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:00:51 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[965ac7f5-94ac-407a-b02d-5875a905881e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a0100e6d-5149-423c-aadc-0c4f2635196b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a0100e6d-5149-423c-aadc-0c4f2635196b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:00:51 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a0100e6d-5149-423c-aadc-0c4f2635196b, portal: 172.16.0.220,3260]
Apr 12 16:00:51 user nova-compute[71874]: Login to [iface: default, target: iqn.2010-10.org.openstack:a0100e6d-5149-423c-aadc-0c4f2635196b, portal: 172.16.0.220,3260] successful.
Apr 12 16:00:51 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:00:51 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0100e6d-5149-423c-aadc-0c4f2635196b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:51 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0100e6d-5149-423c-aadc-0c4f2635196b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:00:51 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fead48c-f961-4658-8605-8a07b8efb9d6]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:00:51 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:00:51 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:51 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:00:51 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cde19a4-3fcd-46db-8c9c-11fc5e0323ae]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fde1cb-bd86-48a5-8aca-463fdf3444b0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0100e6d-5149-423c-aadc-0c4f2635196b (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:00:51 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 (non-flash)
Apr 12 16:00:51 user nova-compute[71874]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fde1cb-bd86-48a5-8aca-463fdf3444b0 (non-flash)
Apr 12 16:00:51 user nova-compute[71874]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4 (non-flash)
Apr 12 16:00:51 user nova-compute[71874]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0100e6d-5149-423c-aadc-0c4f2635196b (non-flash)
Apr 12 16:00:51 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:00:51 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 (non-flash)
Apr 12 16:00:51 user nova-compute[71874]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fde1cb-bd86-48a5-8aca-463fdf3444b0 (non-flash)
Apr 12 16:00:51 user nova-compute[71874]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4 (non-flash)
Apr 12 16:00:51 user nova-compute[71874]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0100e6d-5149-423c-aadc-0c4f2635196b (non-flash)
Apr 12 16:00:51 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:00:51 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a0100e6d-5149-423c-aadc-0c4f2635196b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:00:51 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Connected to 172.16.0.220:3260 {{(pid=71874) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 16:00:51 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=71874) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 16:00:51 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71874) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 16:00:51 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:51 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.015s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:00:51 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb49be39-3521-4eb1-88c4-8cec40780992]: (4, ('- - 0', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:00:51 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: None {{(pid=71874) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 16:00:52 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:52 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71874) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 16:00:52 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:a0100e6d-5149-423c-aadc-0c4f2635196b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'msHTjcxK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71874) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 16:00:52 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.312s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:00:52 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] <== connect_volume: return (1314ms) {'type': 'block', 'scsi_wwn': '23836303531366437', 'path': '/dev/sde'} {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:00:52 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] [instance: 026ab036-1481-4689-af70-661493e9451c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23836303531366437', 'path': '/dev/sde'} {{(pid=71874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 16:00:52 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T16:00:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-42887822',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-42887822',id=12,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLrB1DENR2pfOAjIRN9LEpsOVcpe9+tGHSdMunlhJFwYQlpEscFgY1JRfeVyTGaP039pStXo0RFjA+WSluJoqeyqAo5WqwaznRFWsI938ay0ZUrGDMwsQVNkx94RdMc5mA==',key_name='tempest-keypair-1782217974',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='14aea401da6344858416fd2543bc10ca',ramdisk_id='',reservation_id='r-dfnji3do',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1488698683',owner_user_name='tempest-TaggedBootDevicesTest_v242-1488698683-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T16:00:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='896a788283bf4e88b30528ef2721e90c',uuid=026ab036-1481-4689-af70-661493e9451c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0d6194a7-a3c4-47f9-8c37-960cb622ce28", "address": "fa:16:3e:9c:84:d7", "network": {"id": "77f1158d-0720-49c1-9530-29d3cdca64df", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1458658917-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14aea401da6344858416fd2543bc10ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d6194a7-a3", "ovs_interfaceid": "0d6194a7-a3c4-47f9-8c37-960cb622ce28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 16:00:52 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Converting VIF {"id": "0d6194a7-a3c4-47f9-8c37-960cb622ce28", "address": "fa:16:3e:9c:84:d7", "network": {"id": "77f1158d-0720-49c1-9530-29d3cdca64df", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1458658917-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14aea401da6344858416fd2543bc10ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d6194a7-a3", "ovs_interfaceid": "0d6194a7-a3c4-47f9-8c37-960cb622ce28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:00:52 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:84:d7,bridge_name='br-int',has_traffic_filtering=True,id=0d6194a7-a3c4-47f9-8c37-960cb622ce28,network=Network(77f1158d-0720-49c1-9530-29d3cdca64df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d6194a7-a3') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:00:52 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T16:00:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-42887822',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-42887822',id=12,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLrB1DENR2pfOAjIRN9LEpsOVcpe9+tGHSdMunlhJFwYQlpEscFgY1JRfeVyTGaP039pStXo0RFjA+WSluJoqeyqAo5WqwaznRFWsI938ay0ZUrGDMwsQVNkx94RdMc5mA==',key_name='tempest-keypair-1782217974',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='14aea401da6344858416fd2543bc10ca',ramdisk_id='',reservation_id='r-dfnji3do',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1488698683',owner_user_name='tempest-TaggedBootDevicesTest_v242-1488698683-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T16:00:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='896a788283bf4e88b30528ef2721e90c',uuid=026ab036-1481-4689-af70-661493e9451c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8ebc1d23-a473-4640-aa39-31cbed300c07", "address": "fa:16:3e:d5:95:9e", "network": {"id": "9b0c9550-d764-4db6-b28b-09ab59801170", "bridge": "br-int", "label": "tempest-device-tagging-net1-638686183", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.180", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14aea401da6344858416fd2543bc10ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ebc1d23-a4", "ovs_interfaceid": "8ebc1d23-a473-4640-aa39-31cbed300c07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 16:00:52 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Converting VIF {"id": "8ebc1d23-a473-4640-aa39-31cbed300c07", "address": "fa:16:3e:d5:95:9e", "network": {"id": "9b0c9550-d764-4db6-b28b-09ab59801170", "bridge": "br-int", "label": "tempest-device-tagging-net1-638686183", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.180", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14aea401da6344858416fd2543bc10ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ebc1d23-a4", "ovs_interfaceid": "8ebc1d23-a473-4640-aa39-31cbed300c07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:00:52 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:95:9e,bridge_name='br-int',has_traffic_filtering=True,id=8ebc1d23-a473-4640-aa39-31cbed300c07,network=Network(9b0c9550-d764-4db6-b28b-09ab59801170),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8ebc1d23-a4') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:00:52 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T16:00:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-42887822',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-42887822',id=12,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLrB1DENR2pfOAjIRN9LEpsOVcpe9+tGHSdMunlhJFwYQlpEscFgY1JRfeVyTGaP039pStXo0RFjA+WSluJoqeyqAo5WqwaznRFWsI938ay0ZUrGDMwsQVNkx94RdMc5mA==',key_name='tempest-keypair-1782217974',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='14aea401da6344858416fd2543bc10ca',ramdisk_id='',reservation_id='r-dfnji3do',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1488698683',owner_user_name='tempest-TaggedBootDevicesTest_v242-1488698683-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T16:00:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='896a788283bf4e88b30528ef2721e90c',uuid=026ab036-1481-4689-af70-661493e9451c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7f36bae3-c729-4d85-8c31-075b2b100abe", "address": "fa:16:3e:99:5c:8b", "network": {"id": "9b0c9550-d764-4db6-b28b-09ab59801170", "bridge": "br-int", "label": "tempest-device-tagging-net1-638686183", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14aea401da6344858416fd2543bc10ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f36bae3-c7", "ovs_interfaceid": "7f36bae3-c729-4d85-8c31-075b2b100abe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 16:00:52 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Converting VIF {"id": "7f36bae3-c729-4d85-8c31-075b2b100abe", "address": "fa:16:3e:99:5c:8b", "network": {"id": "9b0c9550-d764-4db6-b28b-09ab59801170", "bridge": "br-int", "label": "tempest-device-tagging-net1-638686183", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14aea401da6344858416fd2543bc10ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f36bae3-c7", "ovs_interfaceid": "7f36bae3-c729-4d85-8c31-075b2b100abe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:00:52 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:5c:8b,bridge_name='br-int',has_traffic_filtering=True,id=7f36bae3-c729-4d85-8c31-075b2b100abe,network=Network(9b0c9550-d764-4db6-b28b-09ab59801170),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7f36bae3-c7') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:00:52 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T16:00:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-42887822',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-42887822',id=12,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLrB1DENR2pfOAjIRN9LEpsOVcpe9+tGHSdMunlhJFwYQlpEscFgY1JRfeVyTGaP039pStXo0RFjA+WSluJoqeyqAo5WqwaznRFWsI938ay0ZUrGDMwsQVNkx94RdMc5mA==',key_name='tempest-keypair-1782217974',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='14aea401da6344858416fd2543bc10ca',ramdisk_id='',reservation_id='r-dfnji3do',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1488698683',owner_user_name='tempest-TaggedBootDevicesTest_v242-1488698683-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T16:00:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='896a788283bf4e88b30528ef2721e90c',uuid=026ab036-1481-4689-af70-661493e9451c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "264de72a-d4f4-4a6a-b3ab-1e8ea8b9a30b", "address": "fa:16:3e:da:a9:6d", "network": {"id": "9b0c9550-d764-4db6-b28b-09ab59801170", "bridge": "br-int", "label": "tempest-device-tagging-net1-638686183", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14aea401da6344858416fd2543bc10ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap264de72a-d4", "ovs_interfaceid": "264de72a-d4f4-4a6a-b3ab-1e8ea8b9a30b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 16:00:52 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Converting VIF {"id": "264de72a-d4f4-4a6a-b3ab-1e8ea8b9a30b", "address": "fa:16:3e:da:a9:6d", "network": {"id": "9b0c9550-d764-4db6-b28b-09ab59801170", "bridge": "br-int", "label": "tempest-device-tagging-net1-638686183", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14aea401da6344858416fd2543bc10ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap264de72a-d4", "ovs_interfaceid": "264de72a-d4f4-4a6a-b3ab-1e8ea8b9a30b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:00:52 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:a9:6d,bridge_name='br-int',has_traffic_filtering=True,id=264de72a-d4f4-4a6a-b3ab-1e8ea8b9a30b,network=Network(9b0c9550-d764-4db6-b28b-09ab59801170),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap264de72a-d4') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:00:52 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T16:00:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-42887822',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-42887822',id=12,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLrB1DENR2pfOAjIRN9LEpsOVcpe9+tGHSdMunlhJFwYQlpEscFgY1JRfeVyTGaP039pStXo0RFjA+WSluJoqeyqAo5WqwaznRFWsI938ay0ZUrGDMwsQVNkx94RdMc5mA==',key_name='tempest-keypair-1782217974',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='14aea401da6344858416fd2543bc10ca',ramdisk_id='',reservation_id='r-dfnji3do',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1488698683',owner_user_name='tempest-TaggedBootDevicesTest_v242-1488698683-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T16:00:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='896a788283bf4e88b30528ef2721e90c',uuid=026ab036-1481-4689-af70-661493e9451c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e3f484fe-17dd-4cef-babd-ad78cf557b03", "address": "fa:16:3e:e6:0d:58", "network": {"id": "9b0c9550-d764-4db6-b28b-09ab59801170", "bridge": "br-int", "label": "tempest-device-tagging-net1-638686183", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14aea401da6344858416fd2543bc10ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3f484fe-17", "ovs_interfaceid": "e3f484fe-17dd-4cef-babd-ad78cf557b03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 16:00:52 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Converting VIF {"id": "e3f484fe-17dd-4cef-babd-ad78cf557b03", "address": "fa:16:3e:e6:0d:58", "network": {"id": "9b0c9550-d764-4db6-b28b-09ab59801170", "bridge": "br-int", "label": "tempest-device-tagging-net1-638686183", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14aea401da6344858416fd2543bc10ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3f484fe-17", "ovs_interfaceid": "e3f484fe-17dd-4cef-babd-ad78cf557b03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:00:52 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:0d:58,bridge_name='br-int',has_traffic_filtering=True,id=e3f484fe-17dd-4cef-babd-ad78cf557b03,network=Network(9b0c9550-d764-4db6-b28b-09ab59801170),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3f484fe-17') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:00:52 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T16:00:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-42887822',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-42887822',id=12,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLrB1DENR2pfOAjIRN9LEpsOVcpe9+tGHSdMunlhJFwYQlpEscFgY1JRfeVyTGaP039pStXo0RFjA+WSluJoqeyqAo5WqwaznRFWsI938ay0ZUrGDMwsQVNkx94RdMc5mA==',key_name='tempest-keypair-1782217974',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='14aea401da6344858416fd2543bc10ca',ramdisk_id='',reservation_id='r-dfnji3do',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1488698683',owner_user_name='tempest-TaggedBootDevicesTest_v242-1488698683-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T16:00:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='896a788283bf4e88b30528ef2721e90c',uuid=026ab036-1481-4689-af70-661493e9451c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0b2175eb-de94-4274-b200-14894dbcbda0", "address": "fa:16:3e:0f:80:1c", "network": {"id": "92fe4d7e-c0cd-45f1-9e92-a120ab22f6f1", "bridge": "br-int", "label": "tempest-device-tagging-net2-367644823", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "14aea401da6344858416fd2543bc10ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b2175eb-de", "ovs_interfaceid": "0b2175eb-de94-4274-b200-14894dbcbda0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 16:00:52 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Converting VIF {"id": "0b2175eb-de94-4274-b200-14894dbcbda0", "address": "fa:16:3e:0f:80:1c", "network": {"id": "92fe4d7e-c0cd-45f1-9e92-a120ab22f6f1", "bridge": "br-int", "label": "tempest-device-tagging-net2-367644823", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "14aea401da6344858416fd2543bc10ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b2175eb-de", "ovs_interfaceid": "0b2175eb-de94-4274-b200-14894dbcbda0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:00:52 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:80:1c,bridge_name='br-int',has_traffic_filtering=True,id=0b2175eb-de94-4274-b200-14894dbcbda0,network=Network(92fe4d7e-c0cd-45f1-9e92-a120ab22f6f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b2175eb-de') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:00:52 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T16:00:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-42887822',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-42887822',id=12,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLrB1DENR2pfOAjIRN9LEpsOVcpe9+tGHSdMunlhJFwYQlpEscFgY1JRfeVyTGaP039pStXo0RFjA+WSluJoqeyqAo5WqwaznRFWsI938ay0ZUrGDMwsQVNkx94RdMc5mA==',key_name='tempest-keypair-1782217974',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='14aea401da6344858416fd2543bc10ca',ramdisk_id='',reservation_id='r-dfnji3do',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1488698683',owner_user_name='tempest-TaggedBootDevicesTest_v242-1488698683-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T16:00:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='896a788283bf4e88b30528ef2721e90c',uuid=026ab036-1481-4689-af70-661493e9451c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5796cf52-4e81-4c40-954e-86819f5557c8", "address": "fa:16:3e:b7:67:83", "network": {"id": "92fe4d7e-c0cd-45f1-9e92-a120ab22f6f1", "bridge": "br-int", "label": "tempest-device-tagging-net2-367644823", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "14aea401da6344858416fd2543bc10ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5796cf52-4e", "ovs_interfaceid": "5796cf52-4e81-4c40-954e-86819f5557c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 16:00:52 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Converting VIF {"id": "5796cf52-4e81-4c40-954e-86819f5557c8", "address": "fa:16:3e:b7:67:83", "network": {"id": "92fe4d7e-c0cd-45f1-9e92-a120ab22f6f1", "bridge": "br-int", "label": "tempest-device-tagging-net2-367644823", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "14aea401da6344858416fd2543bc10ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5796cf52-4e", "ovs_interfaceid": "5796cf52-4e81-4c40-954e-86819f5557c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:00:52 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:67:83,bridge_name='br-int',has_traffic_filtering=True,id=5796cf52-4e81-4c40-954e-86819f5557c8,network=Network(92fe4d7e-c0cd-45f1-9e92-a120ab22f6f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5796cf52-4e') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:00:52 user nova-compute[71874]: DEBUG nova.objects.instance [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Lazy-loading 'pci_devices' on Instance uuid 026ab036-1481-4689-af70-661493e9451c {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:00:52 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] [instance: 026ab036-1481-4689-af70-661493e9451c] End _get_guest_xml xml=<domain type="kvm">
Apr 12 16:00:52 user nova-compute[71874]:   <uuid>026ab036-1481-4689-af70-661493e9451c</uuid>
Apr 12 16:00:52 user nova-compute[71874]:   <name>instance-0000000c</name>
Apr 12 16:00:52 user nova-compute[71874]:   <memory>131072</memory>
Apr 12 16:00:52 user nova-compute[71874]:   <vcpu>1</vcpu>
Apr 12 16:00:52 user nova-compute[71874]:   <metadata>
Apr 12 16:00:52 user nova-compute[71874]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 16:00:52 user nova-compute[71874]:       <nova:package version="0.0.0"/>
Apr 12 16:00:52 user nova-compute[71874]:       <nova:name>tempest-device-tagging-server-42887822</nova:name>
Apr 12 16:00:52 user nova-compute[71874]:       <nova:creationTime>2023-04-12 16:00:48</nova:creationTime>
Apr 12 16:00:52 user nova-compute[71874]:       <nova:flavor name="m1.nano">
Apr 12 16:00:52 user nova-compute[71874]:         <nova:memory>128</nova:memory>
Apr 12 16:00:52 user nova-compute[71874]:         <nova:disk>1</nova:disk>
Apr 12 16:00:52 user nova-compute[71874]:         <nova:swap>0</nova:swap>
Apr 12 16:00:52 user nova-compute[71874]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 16:00:52 user nova-compute[71874]:         <nova:vcpus>1</nova:vcpus>
Apr 12 16:00:52 user nova-compute[71874]:       </nova:flavor>
Apr 12 16:00:52 user nova-compute[71874]:       <nova:owner>
Apr 12 16:00:52 user nova-compute[71874]:         <nova:user uuid="896a788283bf4e88b30528ef2721e90c">tempest-TaggedBootDevicesTest_v242-1488698683-project-member</nova:user>
Apr 12 16:00:52 user nova-compute[71874]:         <nova:project uuid="14aea401da6344858416fd2543bc10ca">tempest-TaggedBootDevicesTest_v242-1488698683</nova:project>
Apr 12 16:00:52 user nova-compute[71874]:       </nova:owner>
Apr 12 16:00:52 user nova-compute[71874]:       <nova:root type="image" uuid="9dc63f14-8b70-4e72-89f2-13464f2f5c7c"/>
Apr 12 16:00:52 user nova-compute[71874]:       <nova:ports>
Apr 12 16:00:52 user nova-compute[71874]:         <nova:port uuid="0d6194a7-a3c4-47f9-8c37-960cb622ce28">
Apr 12 16:00:52 user nova-compute[71874]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 12 16:00:52 user nova-compute[71874]:         </nova:port>
Apr 12 16:00:52 user nova-compute[71874]:         <nova:port uuid="8ebc1d23-a473-4640-aa39-31cbed300c07">
Apr 12 16:00:52 user nova-compute[71874]:           <nova:ip type="fixed" address="10.1.1.180" ipVersion="4"/>
Apr 12 16:00:52 user nova-compute[71874]:         </nova:port>
Apr 12 16:00:52 user nova-compute[71874]:         <nova:port uuid="7f36bae3-c729-4d85-8c31-075b2b100abe">
Apr 12 16:00:52 user nova-compute[71874]:           <nova:ip type="fixed" address="10.1.1.222" ipVersion="4"/>
Apr 12 16:00:52 user nova-compute[71874]:         </nova:port>
Apr 12 16:00:52 user nova-compute[71874]:         <nova:port uuid="264de72a-d4f4-4a6a-b3ab-1e8ea8b9a30b">
Apr 12 16:00:52 user nova-compute[71874]:           <nova:ip type="fixed" address="10.1.1.248" ipVersion="4"/>
Apr 12 16:00:52 user nova-compute[71874]:         </nova:port>
Apr 12 16:00:52 user nova-compute[71874]:         <nova:port uuid="e3f484fe-17dd-4cef-babd-ad78cf557b03">
Apr 12 16:00:52 user nova-compute[71874]:           <nova:ip type="fixed" address="10.1.1.107" ipVersion="4"/>
Apr 12 16:00:52 user nova-compute[71874]:         </nova:port>
Apr 12 16:00:52 user nova-compute[71874]:         <nova:port uuid="0b2175eb-de94-4274-b200-14894dbcbda0">
Apr 12 16:00:52 user nova-compute[71874]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Apr 12 16:00:52 user nova-compute[71874]:         </nova:port>
Apr 12 16:00:52 user nova-compute[71874]:         <nova:port uuid="5796cf52-4e81-4c40-954e-86819f5557c8">
Apr 12 16:00:52 user nova-compute[71874]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Apr 12 16:00:52 user nova-compute[71874]:         </nova:port>
Apr 12 16:00:52 user nova-compute[71874]:       </nova:ports>
Apr 12 16:00:52 user nova-compute[71874]:     </nova:instance>
Apr 12 16:00:52 user nova-compute[71874]:   </metadata>
Apr 12 16:00:52 user nova-compute[71874]:   <sysinfo type="smbios">
Apr 12 16:00:52 user nova-compute[71874]:     <system>
Apr 12 16:00:52 user nova-compute[71874]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 16:00:52 user nova-compute[71874]:       <entry name="product">OpenStack Nova</entry>
Apr 12 16:00:52 user nova-compute[71874]:       <entry name="version">0.0.0</entry>
Apr 12 16:00:52 user nova-compute[71874]:       <entry name="serial">026ab036-1481-4689-af70-661493e9451c</entry>
Apr 12 16:00:52 user nova-compute[71874]:       <entry name="uuid">026ab036-1481-4689-af70-661493e9451c</entry>
Apr 12 16:00:52 user nova-compute[71874]:       <entry name="family">Virtual Machine</entry>
Apr 12 16:00:52 user nova-compute[71874]:     </system>
Apr 12 16:00:52 user nova-compute[71874]:   </sysinfo>
Apr 12 16:00:52 user nova-compute[71874]:   <os>
Apr 12 16:00:52 user nova-compute[71874]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 16:00:52 user nova-compute[71874]:     <boot dev="hd"/>
Apr 12 16:00:52 user nova-compute[71874]:     <smbios mode="sysinfo"/>
Apr 12 16:00:52 user nova-compute[71874]:   </os>
Apr 12 16:00:52 user nova-compute[71874]:   <features>
Apr 12 16:00:52 user nova-compute[71874]:     <acpi/>
Apr 12 16:00:52 user nova-compute[71874]:     <apic/>
Apr 12 16:00:52 user nova-compute[71874]:     <vmcoreinfo/>
Apr 12 16:00:52 user nova-compute[71874]:   </features>
Apr 12 16:00:52 user nova-compute[71874]:   <clock offset="utc">
Apr 12 16:00:52 user nova-compute[71874]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 16:00:52 user nova-compute[71874]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 16:00:52 user nova-compute[71874]:     <timer name="hpet" present="no"/>
Apr 12 16:00:52 user nova-compute[71874]:   </clock>
Apr 12 16:00:52 user nova-compute[71874]:   <cpu mode="custom" match="exact">
Apr 12 16:00:52 user nova-compute[71874]:     <model>Nehalem</model>
Apr 12 16:00:52 user nova-compute[71874]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 16:00:52 user nova-compute[71874]:   </cpu>
Apr 12 16:00:52 user nova-compute[71874]:   <devices>
Apr 12 16:00:52 user nova-compute[71874]:     <disk type="file" device="cdrom">
Apr 12 16:00:52 user nova-compute[71874]:       <driver name="qemu" type="raw" cache="none"/>
Apr 12 16:00:52 user nova-compute[71874]:       <source file="/opt/stack/data/nova/instances/026ab036-1481-4689-af70-661493e9451c/disk.config"/>
Apr 12 16:00:52 user nova-compute[71874]:       <target dev="hda" bus="ide"/>
Apr 12 16:00:52 user nova-compute[71874]:     </disk>
Apr 12 16:00:52 user nova-compute[71874]:     <disk type="block" device="disk">
Apr 12 16:00:52 user nova-compute[71874]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 16:00:52 user nova-compute[71874]:       <source dev="/dev/sdc"/>
Apr 12 16:00:52 user nova-compute[71874]:       <target dev="vda" bus="virtio"/>
Apr 12 16:00:52 user nova-compute[71874]:       <serial>b2fde1cb-bd86-48a5-8aca-463fdf3444b0</serial>
Apr 12 16:00:52 user nova-compute[71874]:     </disk>
Apr 12 16:00:52 user nova-compute[71874]:     <disk type="block" device="disk">
Apr 12 16:00:52 user nova-compute[71874]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 16:00:52 user nova-compute[71874]:       <source dev="/dev/sdd"/>
Apr 12 16:00:52 user nova-compute[71874]:       <target dev="vdb" bus="virtio"/>
Apr 12 16:00:52 user nova-compute[71874]:       <serial>33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4</serial>
Apr 12 16:00:52 user nova-compute[71874]:     </disk>
Apr 12 16:00:52 user nova-compute[71874]:     <disk type="block" device="disk">
Apr 12 16:00:52 user nova-compute[71874]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 16:00:52 user nova-compute[71874]:       <source dev="/dev/sde"/>
Apr 12 16:00:52 user nova-compute[71874]:       <target dev="vdc" bus="virtio"/>
Apr 12 16:00:52 user nova-compute[71874]:       <serial>a0100e6d-5149-423c-aadc-0c4f2635196b</serial>
Apr 12 16:00:52 user nova-compute[71874]:     </disk>
Apr 12 16:00:52 user nova-compute[71874]:     <interface type="ethernet">
Apr 12 16:00:52 user nova-compute[71874]:       <mac address="fa:16:3e:9c:84:d7"/>
Apr 12 16:00:52 user nova-compute[71874]:       <model type="virtio"/>
Apr 12 16:00:52 user nova-compute[71874]:       <mtu size="1442"/>
Apr 12 16:00:52 user nova-compute[71874]:       <target dev="tap0d6194a7-a3"/>
Apr 12 16:00:52 user nova-compute[71874]:     </interface>
Apr 12 16:00:52 user nova-compute[71874]:     <interface type="ethernet">
Apr 12 16:00:52 user nova-compute[71874]:       <mac address="fa:16:3e:d5:95:9e"/>
Apr 12 16:00:52 user nova-compute[71874]:       <model type="virtio"/>
Apr 12 16:00:52 user nova-compute[71874]:       <mtu size="1442"/>
Apr 12 16:00:52 user nova-compute[71874]:       <target dev="tap8ebc1d23-a4"/>
Apr 12 16:00:52 user nova-compute[71874]:     </interface>
Apr 12 16:00:52 user nova-compute[71874]:     <interface type="ethernet">
Apr 12 16:00:52 user nova-compute[71874]:       <mac address="fa:16:3e:99:5c:8b"/>
Apr 12 16:00:52 user nova-compute[71874]:       <model type="virtio"/>
Apr 12 16:00:52 user nova-compute[71874]:       <mtu size="1442"/>
Apr 12 16:00:52 user nova-compute[71874]:       <target dev="tap7f36bae3-c7"/>
Apr 12 16:00:52 user nova-compute[71874]:     </interface>
Apr 12 16:00:52 user nova-compute[71874]:     <interface type="ethernet">
Apr 12 16:00:52 user nova-compute[71874]:       <mac address="fa:16:3e:da:a9:6d"/>
Apr 12 16:00:52 user nova-compute[71874]:       <model type="virtio"/>
Apr 12 16:00:52 user nova-compute[71874]:       <mtu size="1442"/>
Apr 12 16:00:52 user nova-compute[71874]:       <target dev="tap264de72a-d4"/>
Apr 12 16:00:52 user nova-compute[71874]:     </interface>
Apr 12 16:00:52 user nova-compute[71874]:     <interface type="ethernet">
Apr 12 16:00:52 user nova-compute[71874]:       <mac address="fa:16:3e:e6:0d:58"/>
Apr 12 16:00:52 user nova-compute[71874]:       <model type="virtio"/>
Apr 12 16:00:52 user nova-compute[71874]:       <mtu size="1442"/>
Apr 12 16:00:52 user nova-compute[71874]:       <target dev="tape3f484fe-17"/>
Apr 12 16:00:52 user nova-compute[71874]:     </interface>
Apr 12 16:00:52 user nova-compute[71874]:     <interface type="ethernet">
Apr 12 16:00:52 user nova-compute[71874]:       <mac address="fa:16:3e:0f:80:1c"/>
Apr 12 16:00:52 user nova-compute[71874]:       <model type="virtio"/>
Apr 12 16:00:52 user nova-compute[71874]:       <mtu size="1442"/>
Apr 12 16:00:52 user nova-compute[71874]:       <target dev="tap0b2175eb-de"/>
Apr 12 16:00:52 user nova-compute[71874]:     </interface>
Apr 12 16:00:52 user nova-compute[71874]:     <interface type="ethernet">
Apr 12 16:00:52 user nova-compute[71874]:       <mac address="fa:16:3e:b7:67:83"/>
Apr 12 16:00:52 user nova-compute[71874]:       <model type="virtio"/>
Apr 12 16:00:52 user nova-compute[71874]:       <mtu size="1442"/>
Apr 12 16:00:52 user nova-compute[71874]:       <target dev="tap5796cf52-4e"/>
Apr 12 16:00:52 user nova-compute[71874]:     </interface>
Apr 12 16:00:52 user nova-compute[71874]:     <serial type="pty">
Apr 12 16:00:52 user nova-compute[71874]:       <log file="/opt/stack/data/nova/instances/026ab036-1481-4689-af70-661493e9451c/console.log" append="off"/>
Apr 12 16:00:52 user nova-compute[71874]:     </serial>
Apr 12 16:00:52 user nova-compute[71874]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 16:00:52 user nova-compute[71874]:     <video>
Apr 12 16:00:52 user nova-compute[71874]:       <model type="virtio"/>
Apr 12 16:00:52 user nova-compute[71874]:     </video>
Apr 12 16:00:52 user nova-compute[71874]:     <rng model="virtio">
Apr 12 16:00:52 user nova-compute[71874]:       <backend model="random">/dev/urandom</backend>
Apr 12 16:00:52 user nova-compute[71874]:     </rng>
Apr 12 16:00:52 user nova-compute[71874]:     <controller type="usb" index="0" model="none"/>
Apr 12 16:00:52 user nova-compute[71874]:     <memballoon model="virtio">
Apr 12 16:00:52 user nova-compute[71874]:       <stats period="10"/>
Apr 12 16:00:52 user nova-compute[71874]:     </memballoon>
Apr 12 16:00:52 user nova-compute[71874]:   </devices>
Apr 12 16:00:52 user nova-compute[71874]: </domain>
Apr 12 16:00:52 user nova-compute[71874]:  {{(pid=71874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 16:00:52 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T16:00:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-42887822',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-42887822',id=12,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLrB1DENR2pfOAjIRN9LEpsOVcpe9+tGHSdMunlhJFwYQlpEscFgY1JRfeVyTGaP039pStXo0RFjA+WSluJoqeyqAo5WqwaznRFWsI938ay0ZUrGDMwsQVNkx94RdMc5mA==',key_name='tempest-keypair-1782217974',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='14aea401da6344858416fd2543bc10ca',ramdisk_id='',reservation_id='r-dfnji3do',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1488698683',owner_user_name='tempest-TaggedBootDevicesTest_v242-1488698683-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T16:00:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='896a788283bf4e88b30528ef2721e90c',uuid=026ab036-1481-4689-af70-661493e9451c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0d6194a7-a3c4-47f9-8c37-960cb622ce28", "address": "fa:16:3e:9c:84:d7", "network": {"id": "77f1158d-0720-49c1-9530-29d3cdca64df", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1458658917-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14aea401da6344858416fd2543bc10ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d6194a7-a3", "ovs_interfaceid": "0d6194a7-a3c4-47f9-8c37-960cb622ce28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 16:00:52 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Converting VIF {"id": "0d6194a7-a3c4-47f9-8c37-960cb622ce28", "address": "fa:16:3e:9c:84:d7", "network": {"id": "77f1158d-0720-49c1-9530-29d3cdca64df", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1458658917-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14aea401da6344858416fd2543bc10ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d6194a7-a3", "ovs_interfaceid": "0d6194a7-a3c4-47f9-8c37-960cb622ce28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:00:52 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:84:d7,bridge_name='br-int',has_traffic_filtering=True,id=0d6194a7-a3c4-47f9-8c37-960cb622ce28,network=Network(77f1158d-0720-49c1-9530-29d3cdca64df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d6194a7-a3') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:00:52 user nova-compute[71874]: DEBUG os_vif [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:84:d7,bridge_name='br-int',has_traffic_filtering=True,id=0d6194a7-a3c4-47f9-8c37-960cb622ce28,network=Network(77f1158d-0720-49c1-9530-29d3cdca64df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d6194a7-a3') {{(pid=71874) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 16:00:52 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:52 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:00:52 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 16:00:52 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:52 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0d6194a7-a3, may_exist=True) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:00:52 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0d6194a7-a3, col_values=(('external_ids', {'iface-id': '0d6194a7-a3c4-47f9-8c37-960cb622ce28', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9c:84:d7', 'vm-uuid': '026ab036-1481-4689-af70-661493e9451c'}),)) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:00:52 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:52 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:00:52 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:52 user nova-compute[71874]: INFO os_vif [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:84:d7,bridge_name='br-int',has_traffic_filtering=True,id=0d6194a7-a3c4-47f9-8c37-960cb622ce28,network=Network(77f1158d-0720-49c1-9530-29d3cdca64df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d6194a7-a3')
Apr 12 16:00:52 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T16:00:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-42887822',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-42887822',id=12,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLrB1DENR2pfOAjIRN9LEpsOVcpe9+tGHSdMunlhJFwYQlpEscFgY1JRfeVyTGaP039pStXo0RFjA+WSluJoqeyqAo5WqwaznRFWsI938ay0ZUrGDMwsQVNkx94RdMc5mA==',key_name='tempest-keypair-1782217974',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='14aea401da6344858416fd2543bc10ca',ramdisk_id='',reservation_id='r-dfnji3do',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1488698683',owner_user_name='tempest-TaggedBootDevicesTest_v242-1488698683-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T16:00:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='896a788283bf4e88b30528ef2721e90c',uuid=026ab036-1481-4689-af70-661493e9451c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8ebc1d23-a473-4640-aa39-31cbed300c07", "address": "fa:16:3e:d5:95:9e", "network": {"id": "9b0c9550-d764-4db6-b28b-09ab59801170", "bridge": "br-int", "label": "tempest-device-tagging-net1-638686183", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.180", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14aea401da6344858416fd2543bc10ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ebc1d23-a4", "ovs_interfaceid": "8ebc1d23-a473-4640-aa39-31cbed300c07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71874) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 16:00:52 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Converting VIF {"id": "8ebc1d23-a473-4640-aa39-31cbed300c07", "address": "fa:16:3e:d5:95:9e", "network": {"id": "9b0c9550-d764-4db6-b28b-09ab59801170", "bridge": "br-int", "label": "tempest-device-tagging-net1-638686183", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.180", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14aea401da6344858416fd2543bc10ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ebc1d23-a4", "ovs_interfaceid": "8ebc1d23-a473-4640-aa39-31cbed300c07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:00:52 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:95:9e,bridge_name='br-int',has_traffic_filtering=True,id=8ebc1d23-a473-4640-aa39-31cbed300c07,network=Network(9b0c9550-d764-4db6-b28b-09ab59801170),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8ebc1d23-a4') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:00:52 user nova-compute[71874]: DEBUG os_vif [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:95:9e,bridge_name='br-int',has_traffic_filtering=True,id=8ebc1d23-a473-4640-aa39-31cbed300c07,network=Network(9b0c9550-d764-4db6-b28b-09ab59801170),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8ebc1d23-a4') {{(pid=71874) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 16:00:52 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:52 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:00:52 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 16:00:52 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:52 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8ebc1d23-a4, may_exist=True) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:00:52 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8ebc1d23-a4, col_values=(('external_ids', {'iface-id': '8ebc1d23-a473-4640-aa39-31cbed300c07', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d5:95:9e', 'vm-uuid': '026ab036-1481-4689-af70-661493e9451c'}),)) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:00:52 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:52 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:00:52 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:52 user nova-compute[71874]: INFO os_vif [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:95:9e,bridge_name='br-int',has_traffic_filtering=True,id=8ebc1d23-a473-4640-aa39-31cbed300c07,network=Network(9b0c9550-d764-4db6-b28b-09ab59801170),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8ebc1d23-a4')
Apr 12 16:00:52 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T16:00:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-42887822',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-42887822',id=12,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLrB1DENR2pfOAjIRN9LEpsOVcpe9+tGHSdMunlhJFwYQlpEscFgY1JRfeVyTGaP039pStXo0RFjA+WSluJoqeyqAo5WqwaznRFWsI938ay0ZUrGDMwsQVNkx94RdMc5mA==',key_name='tempest-keypair-1782217974',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='14aea401da6344858416fd2543bc10ca',ramdisk_id='',reservation_id='r-dfnji3do',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1488698683',owner_user_name='tempest-TaggedBootDevicesTest_v242-1488698683-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T16:00:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='896a788283bf4e88b30528ef2721e90c',uuid=026ab036-1481-4689-af70-661493e9451c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7f36bae3-c729-4d85-8c31-075b2b100abe", "address": "fa:16:3e:99:5c:8b", "network": {"id": "9b0c9550-d764-4db6-b28b-09ab59801170", "bridge": "br-int", "label": "tempest-device-tagging-net1-638686183", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14aea401da6344858416fd2543bc10ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f36bae3-c7", "ovs_interfaceid": "7f36bae3-c729-4d85-8c31-075b2b100abe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71874) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 16:00:52 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Converting VIF {"id": "7f36bae3-c729-4d85-8c31-075b2b100abe", "address": "fa:16:3e:99:5c:8b", "network": {"id": "9b0c9550-d764-4db6-b28b-09ab59801170", "bridge": "br-int", "label": "tempest-device-tagging-net1-638686183", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14aea401da6344858416fd2543bc10ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f36bae3-c7", "ovs_interfaceid": "7f36bae3-c729-4d85-8c31-075b2b100abe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:00:52 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:5c:8b,bridge_name='br-int',has_traffic_filtering=True,id=7f36bae3-c729-4d85-8c31-075b2b100abe,network=Network(9b0c9550-d764-4db6-b28b-09ab59801170),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7f36bae3-c7') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:00:52 user nova-compute[71874]: DEBUG os_vif [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:5c:8b,bridge_name='br-int',has_traffic_filtering=True,id=7f36bae3-c729-4d85-8c31-075b2b100abe,network=Network(9b0c9550-d764-4db6-b28b-09ab59801170),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7f36bae3-c7') {{(pid=71874) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 16:00:52 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:52 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:00:52 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 16:00:52 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:52 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7f36bae3-c7, may_exist=True) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:00:52 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7f36bae3-c7, col_values=(('external_ids', {'iface-id': '7f36bae3-c729-4d85-8c31-075b2b100abe', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:99:5c:8b', 'vm-uuid': '026ab036-1481-4689-af70-661493e9451c'}),)) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:00:52 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:52 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:00:52 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:52 user nova-compute[71874]: INFO os_vif [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:5c:8b,bridge_name='br-int',has_traffic_filtering=True,id=7f36bae3-c729-4d85-8c31-075b2b100abe,network=Network(9b0c9550-d764-4db6-b28b-09ab59801170),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7f36bae3-c7')
Apr 12 16:00:52 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T16:00:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-42887822',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-42887822',id=12,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLrB1DENR2pfOAjIRN9LEpsOVcpe9+tGHSdMunlhJFwYQlpEscFgY1JRfeVyTGaP039pStXo0RFjA+WSluJoqeyqAo5WqwaznRFWsI938ay0ZUrGDMwsQVNkx94RdMc5mA==',key_name='tempest-keypair-1782217974',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='14aea401da6344858416fd2543bc10ca',ramdisk_id='',reservation_id='r-dfnji3do',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1488698683',owner_user_name='tempest-TaggedBootDevicesTest_v242-1488698683-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T16:00:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='896a788283bf4e88b30528ef2721e90c',uuid=026ab036-1481-4689-af70-661493e9451c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "264de72a-d4f4-4a6a-b3ab-1e8ea8b9a30b", "address": "fa:16:3e:da:a9:6d", "network": {"id": "9b0c9550-d764-4db6-b28b-09ab59801170", "bridge": "br-int", "label": "tempest-device-tagging-net1-638686183", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14aea401da6344858416fd2543bc10ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap264de72a-d4", "ovs_interfaceid": "264de72a-d4f4-4a6a-b3ab-1e8ea8b9a30b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 16:00:52 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Converting VIF {"id": "264de72a-d4f4-4a6a-b3ab-1e8ea8b9a30b", "address": "fa:16:3e:da:a9:6d", "network": {"id": "9b0c9550-d764-4db6-b28b-09ab59801170", "bridge": "br-int", "label": "tempest-device-tagging-net1-638686183", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14aea401da6344858416fd2543bc10ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap264de72a-d4", "ovs_interfaceid": "264de72a-d4f4-4a6a-b3ab-1e8ea8b9a30b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:00:52 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:a9:6d,bridge_name='br-int',has_traffic_filtering=True,id=264de72a-d4f4-4a6a-b3ab-1e8ea8b9a30b,network=Network(9b0c9550-d764-4db6-b28b-09ab59801170),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap264de72a-d4') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:00:52 user nova-compute[71874]: DEBUG os_vif [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:a9:6d,bridge_name='br-int',has_traffic_filtering=True,id=264de72a-d4f4-4a6a-b3ab-1e8ea8b9a30b,network=Network(9b0c9550-d764-4db6-b28b-09ab59801170),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap264de72a-d4') {{(pid=71874) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 16:00:52 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:52 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:00:52 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 16:00:52 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:52 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap264de72a-d4, may_exist=True) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:00:52 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap264de72a-d4, col_values=(('external_ids', {'iface-id': '264de72a-d4f4-4a6a-b3ab-1e8ea8b9a30b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:da:a9:6d', 'vm-uuid': '026ab036-1481-4689-af70-661493e9451c'}),)) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:00:52 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:00:52 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:52 user nova-compute[71874]: INFO os_vif [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:a9:6d,bridge_name='br-int',has_traffic_filtering=True,id=264de72a-d4f4-4a6a-b3ab-1e8ea8b9a30b,network=Network(9b0c9550-d764-4db6-b28b-09ab59801170),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap264de72a-d4')
Apr 12 16:00:52 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T16:00:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-42887822',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-42887822',id=12,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLrB1DENR2pfOAjIRN9LEpsOVcpe9+tGHSdMunlhJFwYQlpEscFgY1JRfeVyTGaP039pStXo0RFjA+WSluJoqeyqAo5WqwaznRFWsI938ay0ZUrGDMwsQVNkx94RdMc5mA==',key_name='tempest-keypair-1782217974',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='14aea401da6344858416fd2543bc10ca',ramdisk_id='',reservation_id='r-dfnji3do',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1488698683',owner_user_name='tempest-TaggedBootDevicesTest_v242-1488698683-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T16:00:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='896a788283bf4e88b30528ef2721e90c',uuid=026ab036-1481-4689-af70-661493e9451c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e3f484fe-17dd-4cef-babd-ad78cf557b03", "address": "fa:16:3e:e6:0d:58", "network": {"id": "9b0c9550-d764-4db6-b28b-09ab59801170", "bridge": "br-int", "label": "tempest-device-tagging-net1-638686183", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14aea401da6344858416fd2543bc10ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3f484fe-17", "ovs_interfaceid": "e3f484fe-17dd-4cef-babd-ad78cf557b03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 16:00:52 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Converting VIF {"id": "e3f484fe-17dd-4cef-babd-ad78cf557b03", "address": "fa:16:3e:e6:0d:58", "network": {"id": "9b0c9550-d764-4db6-b28b-09ab59801170", "bridge": "br-int", "label": "tempest-device-tagging-net1-638686183", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14aea401da6344858416fd2543bc10ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3f484fe-17", "ovs_interfaceid": "e3f484fe-17dd-4cef-babd-ad78cf557b03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:00:52 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:0d:58,bridge_name='br-int',has_traffic_filtering=True,id=e3f484fe-17dd-4cef-babd-ad78cf557b03,network=Network(9b0c9550-d764-4db6-b28b-09ab59801170),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3f484fe-17') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:00:52 user nova-compute[71874]: DEBUG os_vif [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:0d:58,bridge_name='br-int',has_traffic_filtering=True,id=e3f484fe-17dd-4cef-babd-ad78cf557b03,network=Network(9b0c9550-d764-4db6-b28b-09ab59801170),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3f484fe-17') {{(pid=71874) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 16:00:52 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:52 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:00:52 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 16:00:52 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:52 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape3f484fe-17, may_exist=True) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:00:52 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape3f484fe-17, col_values=(('external_ids', {'iface-id': 'e3f484fe-17dd-4cef-babd-ad78cf557b03', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e6:0d:58', 'vm-uuid': '026ab036-1481-4689-af70-661493e9451c'}),)) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:00:52 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:00:52 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:52 user nova-compute[71874]: INFO os_vif [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:0d:58,bridge_name='br-int',has_traffic_filtering=True,id=e3f484fe-17dd-4cef-babd-ad78cf557b03,network=Network(9b0c9550-d764-4db6-b28b-09ab59801170),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3f484fe-17')
Apr 12 16:00:52 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T16:00:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-42887822',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-42887822',id=12,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLrB1DENR2pfOAjIRN9LEpsOVcpe9+tGHSdMunlhJFwYQlpEscFgY1JRfeVyTGaP039pStXo0RFjA+WSluJoqeyqAo5WqwaznRFWsI938ay0ZUrGDMwsQVNkx94RdMc5mA==',key_name='tempest-keypair-1782217974',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='14aea401da6344858416fd2543bc10ca',ramdisk_id='',reservation_id='r-dfnji3do',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1488698683',owner_user_name='tempest-TaggedBootDevicesTest_v242-1488698683-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T16:00:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='896a788283bf4e88b30528ef2721e90c',uuid=026ab036-1481-4689-af70-661493e9451c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0b2175eb-de94-4274-b200-14894dbcbda0", "address": "fa:16:3e:0f:80:1c", "network": {"id": "92fe4d7e-c0cd-45f1-9e92-a120ab22f6f1", "bridge": "br-int", "label": "tempest-device-tagging-net2-367644823", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "14aea401da6344858416fd2543bc10ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b2175eb-de", "ovs_interfaceid": "0b2175eb-de94-4274-b200-14894dbcbda0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 16:00:52 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Converting VIF {"id": "0b2175eb-de94-4274-b200-14894dbcbda0", "address": "fa:16:3e:0f:80:1c", "network": {"id": "92fe4d7e-c0cd-45f1-9e92-a120ab22f6f1", "bridge": "br-int", "label": "tempest-device-tagging-net2-367644823", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "14aea401da6344858416fd2543bc10ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b2175eb-de", "ovs_interfaceid": "0b2175eb-de94-4274-b200-14894dbcbda0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:00:52 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:80:1c,bridge_name='br-int',has_traffic_filtering=True,id=0b2175eb-de94-4274-b200-14894dbcbda0,network=Network(92fe4d7e-c0cd-45f1-9e92-a120ab22f6f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b2175eb-de') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:00:52 user nova-compute[71874]: DEBUG os_vif [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:80:1c,bridge_name='br-int',has_traffic_filtering=True,id=0b2175eb-de94-4274-b200-14894dbcbda0,network=Network(92fe4d7e-c0cd-45f1-9e92-a120ab22f6f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b2175eb-de') {{(pid=71874) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 16:00:52 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:52 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:00:52 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 16:00:52 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:52 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0b2175eb-de, may_exist=True) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:00:52 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0b2175eb-de, col_values=(('external_ids', {'iface-id': '0b2175eb-de94-4274-b200-14894dbcbda0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0f:80:1c', 'vm-uuid': '026ab036-1481-4689-af70-661493e9451c'}),)) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:00:52 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:52 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:00:52 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:52 user nova-compute[71874]: INFO os_vif [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:80:1c,bridge_name='br-int',has_traffic_filtering=True,id=0b2175eb-de94-4274-b200-14894dbcbda0,network=Network(92fe4d7e-c0cd-45f1-9e92-a120ab22f6f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b2175eb-de')
Apr 12 16:00:52 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T16:00:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-42887822',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-42887822',id=12,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLrB1DENR2pfOAjIRN9LEpsOVcpe9+tGHSdMunlhJFwYQlpEscFgY1JRfeVyTGaP039pStXo0RFjA+WSluJoqeyqAo5WqwaznRFWsI938ay0ZUrGDMwsQVNkx94RdMc5mA==',key_name='tempest-keypair-1782217974',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='14aea401da6344858416fd2543bc10ca',ramdisk_id='',reservation_id='r-dfnji3do',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1488698683',owner_user_name='tempest-TaggedBootDevicesTest_v242-1488698683-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T16:00:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='896a788283bf4e88b30528ef2721e90c',uuid=026ab036-1481-4689-af70-661493e9451c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5796cf52-4e81-4c40-954e-86819f5557c8", "address": "fa:16:3e:b7:67:83", "network": {"id": "92fe4d7e-c0cd-45f1-9e92-a120ab22f6f1", "bridge": "br-int", "label": "tempest-device-tagging-net2-367644823", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "14aea401da6344858416fd2543bc10ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5796cf52-4e", "ovs_interfaceid": "5796cf52-4e81-4c40-954e-86819f5557c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 16:00:52 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Converting VIF {"id": "5796cf52-4e81-4c40-954e-86819f5557c8", "address": "fa:16:3e:b7:67:83", "network": {"id": "92fe4d7e-c0cd-45f1-9e92-a120ab22f6f1", "bridge": "br-int", "label": "tempest-device-tagging-net2-367644823", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "14aea401da6344858416fd2543bc10ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5796cf52-4e", "ovs_interfaceid": "5796cf52-4e81-4c40-954e-86819f5557c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:00:52 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:67:83,bridge_name='br-int',has_traffic_filtering=True,id=5796cf52-4e81-4c40-954e-86819f5557c8,network=Network(92fe4d7e-c0cd-45f1-9e92-a120ab22f6f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5796cf52-4e') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:00:52 user nova-compute[71874]: DEBUG os_vif [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:67:83,bridge_name='br-int',has_traffic_filtering=True,id=5796cf52-4e81-4c40-954e-86819f5557c8,network=Network(92fe4d7e-c0cd-45f1-9e92-a120ab22f6f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5796cf52-4e') {{(pid=71874) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 16:00:52 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:52 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:00:52 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 16:00:52 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:52 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5796cf52-4e, may_exist=True) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:00:52 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5796cf52-4e, col_values=(('external_ids', {'iface-id': '5796cf52-4e81-4c40-954e-86819f5557c8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b7:67:83', 'vm-uuid': '026ab036-1481-4689-af70-661493e9451c'}),)) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:00:52 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:52 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:00:52 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:52 user nova-compute[71874]: INFO os_vif [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:67:83,bridge_name='br-int',has_traffic_filtering=True,id=5796cf52-4e81-4c40-954e-86819f5557c8,network=Network(92fe4d7e-c0cd-45f1-9e92-a120ab22f6f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5796cf52-4e')
Apr 12 16:00:53 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] No BDM found with device name hda, not building metadata. {{(pid=71874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 16:00:53 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 16:00:53 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] No VIF found with MAC fa:16:3e:9c:84:d7, not building metadata {{(pid=71874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 16:00:53 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] No VIF found with MAC fa:16:3e:e6:0d:58, not building metadata {{(pid=71874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 16:00:53 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] [instance: 026ab036-1481-4689-af70-661493e9451c] Using config drive
Apr 12 16:00:53 user nova-compute[71874]: DEBUG nova.compute.manager [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Start spawning the instance on the hypervisor. {{(pid=71874) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 16:00:53 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Creating instance directory {{(pid=71874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 16:00:53 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Creating image(s)
Apr 12 16:00:53 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Did not create local disks {{(pid=71874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 12 16:00:53 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Ensure instance console log exists: /opt/stack/data/nova/instances/9ea56377-20bc-48cc-a248-5fad6db060cb/console.log {{(pid=71874) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 16:00:53 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:00:53 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:00:53 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:00:53 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Start _get_guest_xml network_info=[{"id": "7ae43e60-f63a-448e-9a89-0d6bff272104", "address": "fa:16:3e:b7:f0:f6", "network": {"id": "db8367a7-06c5-4e83-987a-c92d02009fef", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-612559343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "020f60d454f846d5a18dfbe1d88b65da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ae43e60-f6", "ovs_interfaceid": "7ae43e60-f63a-448e-9a89-0d6bff272104", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6c9be856-3e7e-4166-8d71-a1f5330aa82f", "address": "fa:16:3e:44:ca:b6", "network": {"id": "a491fcd5-d137-491a-9854-a743afbd448d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1608054323", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "020f60d454f846d5a18dfbe1d88b65da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9be856-3e", "ovs_interfaceid": "6c9be856-3e7e-4166-8d71-a1f5330aa82f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cd2391ad-cb7a-47be-b062-b0dbbc1f8475", "address": "fa:16:3e:89:21:2f", "network": {"id": "a491fcd5-d137-491a-9854-a743afbd448d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1608054323", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.38", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "020f60d454f846d5a18dfbe1d88b65da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd2391ad-cb", "ovs_interfaceid": "cd2391ad-cb7a-47be-b062-b0dbbc1f8475", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f76aae02-12c4-41d6-951a-201330ea7693", "address": "fa:16:3e:13:a6:2d", "network": {"id": "a491fcd5-d137-491a-9854-a743afbd448d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1608054323", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.239", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "020f60d454f846d5a18dfbe1d88b65da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf76aae02-12", "ovs_interfaceid": "f76aae02-12c4-41d6-951a-201330ea7693", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b85b7f43-1f5d-441a-bf3e-380900194e10", "address": "fa:16:3e:2f:65:2e", "network": {"id": "a491fcd5-d137-491a-9854-a743afbd448d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1608054323", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "020f60d454f846d5a18dfbe1d88b65da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb85b7f43-1f", "ovs_interfaceid": "b85b7f43-1f5d-441a-bf3e-380900194e10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c5c4abf8-1b9b-4385-adf7-b34b27a8bc6b", "address": "fa:16:3e:10:b7:d0", "network": {"id": "c543f5eb-b28c-4113-a560-8d6790713d19", "bridge": "br-int", "label": "tempest-device-tagging-net2-1828870959", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "020f60d454f846d5a18dfbe1d88b65da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5c4abf8-1b", "ovs_interfaceid": "c5c4abf8-1b9b-4385-adf7-b34b27a8bc6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1d70ad7b-92c6-47fa-a411-cef9d6159e90", "address": "fa:16:3e:46:54:b4", "network": {"id": "c543f5eb-b28c-4113-a560-8d6790713d19", "bridge": "br-int", "label": "tempest-device-tagging-net2-1828870959", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "020f60d454f846d5a18dfbe1d88b65da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d70ad7b-92", "ovs_interfaceid": "1d70ad7b-92c6-47fa-a411-cef9d6159e90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T15:55:37Z,direct_url=<?>,disk_format='qcow2',id=9dc63f14-8b70-4e72-89f2-13464f2f5c7c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='61a4936d9b7744c0b488d81c9b7746b6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T15:55:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'delete_on_termination': False, 'attachment_id': 'a7c272d1-5f30-4faf-9e64-26cc177da72c', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jXkJFWPU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9ea56377-20bc-48cc-a248-5fad6db060cb', 'attached_at': '', 'detached_at': '', 'volume_id': '5a3e6bdc-d274-4e4a-ac05-59caa88e13d4', 'serial': '5a3e6bdc-d274-4e4a-ac05-59caa88e13d4'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'volume_type': None}, {'guest_format': None, 'delete_on_termination': False, 'attachment_id': 'e2561eca-67fe-43ed-8497-630cfc3a31ae', 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ksBtruqJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9ea56377-20bc-48cc-a248-5fad6db060cb', 'attached_at': '', 'detached_at': '', 'volume_id': '1c11ebd7-2275-4a31-9558-6af01638a09b', 'serial': '1c11ebd7-2275-4a31-9558-6af01638a09b'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 1, 'volume_type': None}, {'guest_format': None, 'delete_on_termination': False, 'attachment_id': '43df2b8b-47be-491a-bdfa-89c84bda8bae', 'mount_device': '/dev/vdc', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ksialVvo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9ea56377-20bc-48cc-a248-5fad6db060cb', 'attached_at': '', 'detached_at': '', 'volume_id': '9b990634-7cec-49db-9df4-81d3a3f3b0fd', 'serial': '9b990634-7cec-49db-9df4-81d3a3f3b0fd'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 2, 'volume_type': None} {{(pid=71874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 16:00:53 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] [instance: 026ab036-1481-4689-af70-661493e9451c] Creating config drive at /opt/stack/data/nova/instances/026ab036-1481-4689-af70-661493e9451c/disk.config
Apr 12 16:00:53 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/026ab036-1481-4689-af70-661493e9451c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpaj4_q00w {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:53 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:00:53 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:00:53 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71874) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 16:00:53 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T15:56:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T15:55:37Z,direct_url=<?>,disk_format='qcow2',id=9dc63f14-8b70-4e72-89f2-13464f2f5c7c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='61a4936d9b7744c0b488d81c9b7746b6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T15:55:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 16:00:53 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Flavor limits 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 16:00:53 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Image limits 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 16:00:53 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Flavor pref 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 16:00:53 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Image pref 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 16:00:53 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 16:00:53 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 16:00:53 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 16:00:53 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Got 1 possible topologies {{(pid=71874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 16:00:53 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 16:00:53 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 16:00:53 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Calling os-brick to attach iSCSI Volume {{(pid=71874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 16:00:53 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3c0216320>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jXkJFWPU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:00:53 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:00:53 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:00:53 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:00:53 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:00:53 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:00:53 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:00:53 user nova-compute[71874]: INFO os_brick.initiator.connectors.iscsi [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 16:00:53 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/026ab036-1481-4689-af70-661493e9451c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpaj4_q00w" returned: 0 in 0.086s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:00:53 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4 -p 172.16.0.220:3260 {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:53 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:00:53 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf52ecdf-aa02-4003-8360-eb16f31fda2e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:00:53 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 16:00:53 user nova-compute[71874]:  {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:00:53 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4 -p 172.16.0.220:3260 --interface default --op new {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:53 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:00:53 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[58d80e9f-59a3-4998-aacd-5780eb7f4013]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4] added\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:00:53 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4] added
Apr 12 16:00:53 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:00:53 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:53 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:00:53 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[63e0bac8-46e5-458f-9273-772a9bc961d2]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:00:53 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:00:53 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:53 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:00:53 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3d347f0-8d18-42b0-93a0-57fe6e6387cc]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:00:53 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:00:53 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jXkJFWPU {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:53 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jXkJFWPU" returned: 0 in 0.017s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:00:53 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd5e62c7-744d-46dd-b8cb-818f69ffab51]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:00:53 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jXkJFWPU'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:00:53 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:53 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:00:53 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[d849a56a-54a3-44ed-b3f2-0eed22390ee5]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:00:53 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:00:53 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:53 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:00:53 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fd565c9-d47f-4853-b24b-a9c735e7f87a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fde1cb-bd86-48a5-8aca-463fdf3444b0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0100e6d-5149-423c-aadc-0c4f2635196b (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:00:53 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 (non-flash)
Apr 12 16:00:53 user nova-compute[71874]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fde1cb-bd86-48a5-8aca-463fdf3444b0 (non-flash)
Apr 12 16:00:53 user nova-compute[71874]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4 (non-flash)
Apr 12 16:00:53 user nova-compute[71874]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0100e6d-5149-423c-aadc-0c4f2635196b (non-flash)
Apr 12 16:00:53 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:00:53 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 (non-flash)
Apr 12 16:00:53 user nova-compute[71874]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fde1cb-bd86-48a5-8aca-463fdf3444b0 (non-flash)
Apr 12 16:00:53 user nova-compute[71874]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4 (non-flash)
Apr 12 16:00:53 user nova-compute[71874]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0100e6d-5149-423c-aadc-0c4f2635196b (non-flash)
Apr 12 16:00:53 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:00:53 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4 -p 172.16.0.220:3260 --login {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:53 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:00:53 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[60558c95-3585-47b1-becf-04a7e3ec8fbf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:00:53 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4, portal: 172.16.0.220,3260]
Apr 12 16:00:53 user nova-compute[71874]: Login to [iface: default, target: iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4, portal: 172.16.0.220,3260] successful.
Apr 12 16:00:53 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:00:53 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:53 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:00:53 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d85279f-848b-45a4-9246-6db5e54197fe]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:00:53 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:00:53 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:53 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:00:53 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7a7d9d0-219a-47ff-8e20-7ec0864fa81d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fde1cb-bd86-48a5-8aca-463fdf3444b0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0100e6d-5149-423c-aadc-0c4f2635196b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4 (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:00:53 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 (non-flash)
Apr 12 16:00:53 user nova-compute[71874]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fde1cb-bd86-48a5-8aca-463fdf3444b0 (non-flash)
Apr 12 16:00:53 user nova-compute[71874]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4 (non-flash)
Apr 12 16:00:53 user nova-compute[71874]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0100e6d-5149-423c-aadc-0c4f2635196b (non-flash)
Apr 12 16:00:53 user nova-compute[71874]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4 (non-flash)
Apr 12 16:00:53 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:00:53 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 (non-flash)
Apr 12 16:00:53 user nova-compute[71874]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fde1cb-bd86-48a5-8aca-463fdf3444b0 (non-flash)
Apr 12 16:00:53 user nova-compute[71874]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4 (non-flash)
Apr 12 16:00:53 user nova-compute[71874]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0100e6d-5149-423c-aadc-0c4f2635196b (non-flash)
Apr 12 16:00:53 user nova-compute[71874]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4 (non-flash)
Apr 12 16:00:53 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:00:53 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:00:53 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Connected to 172.16.0.220:3260 {{(pid=71874) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 16:00:53 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=71874) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 16:00:53 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=71874) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 16:00:53 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:53 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.015s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:00:53 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cf48ae6-738f-454a-b9e0-8020811f823a]: (4, ('- - 0', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:00:53 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=71874) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 16:00:53 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jXkJFWPU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71874) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 16:00:54 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.313s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:00:54 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] <== connect_volume: return (1315ms) {'type': 'block', 'scsi_wwn': '23563376262363233', 'path': '/dev/sdf'} {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:00:54 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23563376262363233', 'path': '/dev/sdf'} {{(pid=71874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 16:00:54 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:54 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Calling os-brick to attach iSCSI Volume {{(pid=71874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 16:00:54 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3c0216320>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ksBtruqJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:00:54 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:00:54 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:00:54 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:00:54 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:00:54 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:00:54 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:00:54 user nova-compute[71874]: INFO os_brick.initiator.connectors.iscsi [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 16:00:54 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:54 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b -p 172.16.0.220:3260 {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:54 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:00:54 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ff93734-eff4-4393-8b6c-cdfac461b1bf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:00:54 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 16:00:54 user nova-compute[71874]:  {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:00:54 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b -p 172.16.0.220:3260 --interface default --op new {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:54 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:00:54 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[bff24053-1511-4e17-98f8-1ec3ccc445be]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b] added\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:00:54 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b] added
Apr 12 16:00:54 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:00:54 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:54 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:54 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:54 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:00:54 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e4a0c78-4887-436f-a665-707e08f68631]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:00:54 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:00:54 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:54 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:00:54 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[3da02187-a6bd-47c7-a00c-23f062c6b147]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:00:54 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:00:54 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ksBtruqJ {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:54 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ksBtruqJ" returned: 0 in 0.021s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:00:54 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[73bb3c35-c6b1-4964-aa61-d6961b56dfec]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:00:54 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ksBtruqJ'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:00:54 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:54 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:00:54 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdffe048-2379-44de-8d32-0cbe993d3997]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:00:54 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:00:54 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:54 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:00:54 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[38ef3f22-fbc9-4cfd-8312-12aa254e2372]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fde1cb-bd86-48a5-8aca-463fdf3444b0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0100e6d-5149-423c-aadc-0c4f2635196b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4 (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:00:54 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 (non-flash)
Apr 12 16:00:54 user nova-compute[71874]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fde1cb-bd86-48a5-8aca-463fdf3444b0 (non-flash)
Apr 12 16:00:54 user nova-compute[71874]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4 (non-flash)
Apr 12 16:00:54 user nova-compute[71874]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0100e6d-5149-423c-aadc-0c4f2635196b (non-flash)
Apr 12 16:00:54 user nova-compute[71874]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4 (non-flash)
Apr 12 16:00:54 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:00:54 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 (non-flash)
Apr 12 16:00:54 user nova-compute[71874]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fde1cb-bd86-48a5-8aca-463fdf3444b0 (non-flash)
Apr 12 16:00:54 user nova-compute[71874]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4 (non-flash)
Apr 12 16:00:54 user nova-compute[71874]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0100e6d-5149-423c-aadc-0c4f2635196b (non-flash)
Apr 12 16:00:54 user nova-compute[71874]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4 (non-flash)
Apr 12 16:00:54 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:00:54 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b -p 172.16.0.220:3260 --login {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:54 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:54 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b -p 172.16.0.220:3260 --login" returned: 0 in 0.088s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:00:54 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[b318a841-0f47-42ab-9fdf-b0bc7242b7a8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:00:54 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b, portal: 172.16.0.220,3260]
Apr 12 16:00:54 user nova-compute[71874]: Login to [iface: default, target: iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b, portal: 172.16.0.220,3260] successful.
Apr 12 16:00:54 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:00:54 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:54 user nova-compute[71874]: DEBUG nova.compute.manager [req-ca91ef7a-7135-467c-b05a-6999c806b3c0 req-9668ee81-0e41-4a4f-b6ea-cd014e3bc33c service nova] [instance: 026ab036-1481-4689-af70-661493e9451c] Received event network-vif-plugged-0d6194a7-a3c4-47f9-8c37-960cb622ce28 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:00:54 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-ca91ef7a-7135-467c-b05a-6999c806b3c0 req-9668ee81-0e41-4a4f-b6ea-cd014e3bc33c service nova] Acquiring lock "026ab036-1481-4689-af70-661493e9451c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:00:54 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-ca91ef7a-7135-467c-b05a-6999c806b3c0 req-9668ee81-0e41-4a4f-b6ea-cd014e3bc33c service nova] Lock "026ab036-1481-4689-af70-661493e9451c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:00:54 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-ca91ef7a-7135-467c-b05a-6999c806b3c0 req-9668ee81-0e41-4a4f-b6ea-cd014e3bc33c service nova] Lock "026ab036-1481-4689-af70-661493e9451c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:00:54 user nova-compute[71874]: DEBUG nova.compute.manager [req-ca91ef7a-7135-467c-b05a-6999c806b3c0 req-9668ee81-0e41-4a4f-b6ea-cd014e3bc33c service nova] [instance: 026ab036-1481-4689-af70-661493e9451c] No waiting events found dispatching network-vif-plugged-0d6194a7-a3c4-47f9-8c37-960cb622ce28 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:00:54 user nova-compute[71874]: WARNING nova.compute.manager [req-ca91ef7a-7135-467c-b05a-6999c806b3c0 req-9668ee81-0e41-4a4f-b6ea-cd014e3bc33c service nova] [instance: 026ab036-1481-4689-af70-661493e9451c] Received unexpected event network-vif-plugged-0d6194a7-a3c4-47f9-8c37-960cb622ce28 for instance with vm_state building and task_state spawning.
Apr 12 16:00:54 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:00:54 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f1a67ee-eaf7-40f3-9f65-5dc7f706179a]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:00:54 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:00:54 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:54 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:00:54 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3fb7fe7-3f59-40db-af21-e50afa7653bd]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fde1cb-bd86-48a5-8aca-463fdf3444b0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0100e6d-5149-423c-aadc-0c4f2635196b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:00:54 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 (non-flash)
Apr 12 16:00:54 user nova-compute[71874]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fde1cb-bd86-48a5-8aca-463fdf3444b0 (non-flash)
Apr 12 16:00:54 user nova-compute[71874]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4 (non-flash)
Apr 12 16:00:54 user nova-compute[71874]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0100e6d-5149-423c-aadc-0c4f2635196b (non-flash)
Apr 12 16:00:54 user nova-compute[71874]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4 (non-flash)
Apr 12 16:00:54 user nova-compute[71874]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b (non-flash)
Apr 12 16:00:54 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:00:54 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 (non-flash)
Apr 12 16:00:54 user nova-compute[71874]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fde1cb-bd86-48a5-8aca-463fdf3444b0 (non-flash)
Apr 12 16:00:54 user nova-compute[71874]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4 (non-flash)
Apr 12 16:00:54 user nova-compute[71874]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0100e6d-5149-423c-aadc-0c4f2635196b (non-flash)
Apr 12 16:00:54 user nova-compute[71874]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4 (non-flash)
Apr 12 16:00:54 user nova-compute[71874]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b (non-flash)
Apr 12 16:00:54 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:00:54 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.347s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:00:54 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Connected to 172.16.0.220:3260 {{(pid=71874) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 16:00:54 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] HCTL ('38', '-', '-', 0) found on session 7 with lun 0 {{(pid=71874) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 16:00:54 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=71874) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 16:00:54 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:54 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.017s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:00:54 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[15105778-3c4a-489b-bea6-cdee83dc5142]: (4, ('- - 0', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:00:54 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Searching for a device in session 7 and hctl ['38', '*', '*', 0] yield: None {{(pid=71874) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 16:00:55 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:55 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:55 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:55 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:55 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:55 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:55 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:55 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:55 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:55 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:55 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:55 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:55 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:55 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:55 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:55 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Searching for a device in session 7 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=71874) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 16:00:55 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ksBtruqJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71874) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 16:00:55 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.376s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:00:55 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] <== connect_volume: return (1377ms) {'type': 'block', 'scsi_wwn': '26463613730616133', 'path': '/dev/sdg'} {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:00:55 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26463613730616133', 'path': '/dev/sdg'} {{(pid=71874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 16:00:56 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Calling os-brick to attach iSCSI Volume {{(pid=71874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 16:00:56 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3c0216320>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ksialVvo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:00:56 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:00:56 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:00:56 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:00:56 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:00:56 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:00:56 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:00:56 user nova-compute[71874]: INFO os_brick.initiator.connectors.iscsi [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 16:00:56 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd -p 172.16.0.220:3260 {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:56 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:00:56 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fc4da83-d696-4e2b-aadd-cdf093a94b9e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:00:56 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 16:00:56 user nova-compute[71874]:  {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:00:56 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd -p 172.16.0.220:3260 --interface default --op new {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:56 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:56 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:00:56 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e434551-265d-4e24-8ccb-449262adbec4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd] added\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:00:56 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd] added
Apr 12 16:00:56 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:00:56 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:56 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:56 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:00:56 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4ce1492-5335-42d6-87f4-f7456b071263]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:00:56 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:00:56 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:56 user nova-compute[71874]: DEBUG nova.compute.manager [req-94b1b4b0-0ebd-4067-a7bb-4fc9d0f0e1ef req-f45472fd-4c8f-4b21-8068-0b595a260d1f service nova] [instance: 026ab036-1481-4689-af70-661493e9451c] Received event network-vif-plugged-e3f484fe-17dd-4cef-babd-ad78cf557b03 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:00:56 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-94b1b4b0-0ebd-4067-a7bb-4fc9d0f0e1ef req-f45472fd-4c8f-4b21-8068-0b595a260d1f service nova] Acquiring lock "026ab036-1481-4689-af70-661493e9451c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:00:56 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-94b1b4b0-0ebd-4067-a7bb-4fc9d0f0e1ef req-f45472fd-4c8f-4b21-8068-0b595a260d1f service nova] Lock "026ab036-1481-4689-af70-661493e9451c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:00:56 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-94b1b4b0-0ebd-4067-a7bb-4fc9d0f0e1ef req-f45472fd-4c8f-4b21-8068-0b595a260d1f service nova] Lock "026ab036-1481-4689-af70-661493e9451c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:00:56 user nova-compute[71874]: DEBUG nova.compute.manager [req-94b1b4b0-0ebd-4067-a7bb-4fc9d0f0e1ef req-f45472fd-4c8f-4b21-8068-0b595a260d1f service nova] [instance: 026ab036-1481-4689-af70-661493e9451c] No waiting events found dispatching network-vif-plugged-e3f484fe-17dd-4cef-babd-ad78cf557b03 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:00:56 user nova-compute[71874]: WARNING nova.compute.manager [req-94b1b4b0-0ebd-4067-a7bb-4fc9d0f0e1ef req-f45472fd-4c8f-4b21-8068-0b595a260d1f service nova] [instance: 026ab036-1481-4689-af70-661493e9451c] Received unexpected event network-vif-plugged-e3f484fe-17dd-4cef-babd-ad78cf557b03 for instance with vm_state building and task_state spawning.
Apr 12 16:00:56 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:56 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:00:56 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdad5288-55a5-42aa-b1b0-efb937146fc5]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:00:56 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:00:56 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ksialVvo {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:56 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:56 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ksialVvo" returned: 0 in 0.027s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:00:56 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[41e4893d-a43a-4b59-9f91-8a035a7247e8]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:00:56 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ksialVvo'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:00:56 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:56 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:00:56 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[78d2e0fd-e3a8-4fe5-ba16-baaf56b1839d]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:00:56 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:00:56 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:56 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:00:56 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[6319b786-143e-4389-ab8e-2f3e114a381e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fde1cb-bd86-48a5-8aca-463fdf3444b0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0100e6d-5149-423c-aadc-0c4f2635196b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:00:56 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 (non-flash)
Apr 12 16:00:56 user nova-compute[71874]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fde1cb-bd86-48a5-8aca-463fdf3444b0 (non-flash)
Apr 12 16:00:56 user nova-compute[71874]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4 (non-flash)
Apr 12 16:00:56 user nova-compute[71874]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0100e6d-5149-423c-aadc-0c4f2635196b (non-flash)
Apr 12 16:00:56 user nova-compute[71874]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4 (non-flash)
Apr 12 16:00:56 user nova-compute[71874]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b (non-flash)
Apr 12 16:00:56 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:00:56 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 (non-flash)
Apr 12 16:00:56 user nova-compute[71874]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fde1cb-bd86-48a5-8aca-463fdf3444b0 (non-flash)
Apr 12 16:00:56 user nova-compute[71874]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4 (non-flash)
Apr 12 16:00:56 user nova-compute[71874]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0100e6d-5149-423c-aadc-0c4f2635196b (non-flash)
Apr 12 16:00:56 user nova-compute[71874]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4 (non-flash)
Apr 12 16:00:56 user nova-compute[71874]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b (non-flash)
Apr 12 16:00:56 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:00:56 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd -p 172.16.0.220:3260 --login {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:56 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:56 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:56 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd -p 172.16.0.220:3260 --login" returned: 0 in 0.098s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:00:56 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[691d971d-ee28-42ca-b878-fdaa90a47db9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:00:56 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd, portal: 172.16.0.220,3260]
Apr 12 16:00:56 user nova-compute[71874]: Login to [iface: default, target: iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd, portal: 172.16.0.220,3260] successful.
Apr 12 16:00:56 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:00:56 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:56 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:00:56 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b9a3892-a601-47fa-96d1-73aa68ccf315]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:00:56 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:00:56 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:56 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:00:56 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f20bec9-2fe7-4417-ab80-296b24435e89]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fde1cb-bd86-48a5-8aca-463fdf3444b0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0100e6d-5149-423c-aadc-0c4f2635196b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:00:56 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 (non-flash)
Apr 12 16:00:56 user nova-compute[71874]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fde1cb-bd86-48a5-8aca-463fdf3444b0 (non-flash)
Apr 12 16:00:56 user nova-compute[71874]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4 (non-flash)
Apr 12 16:00:56 user nova-compute[71874]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0100e6d-5149-423c-aadc-0c4f2635196b (non-flash)
Apr 12 16:00:56 user nova-compute[71874]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4 (non-flash)
Apr 12 16:00:56 user nova-compute[71874]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b (non-flash)
Apr 12 16:00:56 user nova-compute[71874]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd (non-flash)
Apr 12 16:00:56 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:00:56 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 (non-flash)
Apr 12 16:00:56 user nova-compute[71874]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fde1cb-bd86-48a5-8aca-463fdf3444b0 (non-flash)
Apr 12 16:00:56 user nova-compute[71874]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4 (non-flash)
Apr 12 16:00:56 user nova-compute[71874]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0100e6d-5149-423c-aadc-0c4f2635196b (non-flash)
Apr 12 16:00:56 user nova-compute[71874]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4 (non-flash)
Apr 12 16:00:56 user nova-compute[71874]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b (non-flash)
Apr 12 16:00:56 user nova-compute[71874]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd (non-flash)
Apr 12 16:00:56 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:00:56 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.389s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:00:56 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Connected to 172.16.0.220:3260 {{(pid=71874) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 16:00:56 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] HCTL ('39', '-', '-', 0) found on session 8 with lun 0 {{(pid=71874) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 16:00:56 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=71874) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 16:00:56 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:56 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.017s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:00:56 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e9a01d1-18f1-4ddd-9d34-c7f4fdab856c]: (4, ('- - 0', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:00:56 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Searching for a device in session 8 and hctl ['39', '*', '*', 0] yield: None {{(pid=71874) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 16:00:56 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:56 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:56 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:56 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:56 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:57 user nova-compute[71874]: DEBUG nova.compute.manager [req-4687ce71-4e2e-416f-82d2-283eaed57380 req-4df7d7ac-fc00-4158-a1b3-042b523a7a12 service nova] [instance: 026ab036-1481-4689-af70-661493e9451c] Received event network-vif-plugged-0d6194a7-a3c4-47f9-8c37-960cb622ce28 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:00:57 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-4687ce71-4e2e-416f-82d2-283eaed57380 req-4df7d7ac-fc00-4158-a1b3-042b523a7a12 service nova] Acquiring lock "026ab036-1481-4689-af70-661493e9451c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:00:57 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-4687ce71-4e2e-416f-82d2-283eaed57380 req-4df7d7ac-fc00-4158-a1b3-042b523a7a12 service nova] Lock "026ab036-1481-4689-af70-661493e9451c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:00:57 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-4687ce71-4e2e-416f-82d2-283eaed57380 req-4df7d7ac-fc00-4158-a1b3-042b523a7a12 service nova] Lock "026ab036-1481-4689-af70-661493e9451c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:00:57 user nova-compute[71874]: DEBUG nova.compute.manager [req-4687ce71-4e2e-416f-82d2-283eaed57380 req-4df7d7ac-fc00-4158-a1b3-042b523a7a12 service nova] [instance: 026ab036-1481-4689-af70-661493e9451c] No waiting events found dispatching network-vif-plugged-0d6194a7-a3c4-47f9-8c37-960cb622ce28 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:00:57 user nova-compute[71874]: WARNING nova.compute.manager [req-4687ce71-4e2e-416f-82d2-283eaed57380 req-4df7d7ac-fc00-4158-a1b3-042b523a7a12 service nova] [instance: 026ab036-1481-4689-af70-661493e9451c] Received unexpected event network-vif-plugged-0d6194a7-a3c4-47f9-8c37-960cb622ce28 for instance with vm_state building and task_state spawning.
Apr 12 16:00:57 user nova-compute[71874]: DEBUG nova.compute.manager [req-4687ce71-4e2e-416f-82d2-283eaed57380 req-4df7d7ac-fc00-4158-a1b3-042b523a7a12 service nova] [instance: 026ab036-1481-4689-af70-661493e9451c] Received event network-vif-plugged-8ebc1d23-a473-4640-aa39-31cbed300c07 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:00:57 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-4687ce71-4e2e-416f-82d2-283eaed57380 req-4df7d7ac-fc00-4158-a1b3-042b523a7a12 service nova] Acquiring lock "026ab036-1481-4689-af70-661493e9451c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:00:57 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-4687ce71-4e2e-416f-82d2-283eaed57380 req-4df7d7ac-fc00-4158-a1b3-042b523a7a12 service nova] Lock "026ab036-1481-4689-af70-661493e9451c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:00:57 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-4687ce71-4e2e-416f-82d2-283eaed57380 req-4df7d7ac-fc00-4158-a1b3-042b523a7a12 service nova] Lock "026ab036-1481-4689-af70-661493e9451c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:00:57 user nova-compute[71874]: DEBUG nova.compute.manager [req-4687ce71-4e2e-416f-82d2-283eaed57380 req-4df7d7ac-fc00-4158-a1b3-042b523a7a12 service nova] [instance: 026ab036-1481-4689-af70-661493e9451c] No waiting events found dispatching network-vif-plugged-8ebc1d23-a473-4640-aa39-31cbed300c07 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:00:57 user nova-compute[71874]: WARNING nova.compute.manager [req-4687ce71-4e2e-416f-82d2-283eaed57380 req-4df7d7ac-fc00-4158-a1b3-042b523a7a12 service nova] [instance: 026ab036-1481-4689-af70-661493e9451c] Received unexpected event network-vif-plugged-8ebc1d23-a473-4640-aa39-31cbed300c07 for instance with vm_state building and task_state spawning.
Apr 12 16:00:57 user nova-compute[71874]: DEBUG nova.compute.manager [req-4687ce71-4e2e-416f-82d2-283eaed57380 req-4df7d7ac-fc00-4158-a1b3-042b523a7a12 service nova] [instance: 026ab036-1481-4689-af70-661493e9451c] Received event network-vif-plugged-8ebc1d23-a473-4640-aa39-31cbed300c07 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:00:57 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-4687ce71-4e2e-416f-82d2-283eaed57380 req-4df7d7ac-fc00-4158-a1b3-042b523a7a12 service nova] Acquiring lock "026ab036-1481-4689-af70-661493e9451c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:00:57 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-4687ce71-4e2e-416f-82d2-283eaed57380 req-4df7d7ac-fc00-4158-a1b3-042b523a7a12 service nova] Lock "026ab036-1481-4689-af70-661493e9451c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:00:57 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-4687ce71-4e2e-416f-82d2-283eaed57380 req-4df7d7ac-fc00-4158-a1b3-042b523a7a12 service nova] Lock "026ab036-1481-4689-af70-661493e9451c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:00:57 user nova-compute[71874]: DEBUG nova.compute.manager [req-4687ce71-4e2e-416f-82d2-283eaed57380 req-4df7d7ac-fc00-4158-a1b3-042b523a7a12 service nova] [instance: 026ab036-1481-4689-af70-661493e9451c] No waiting events found dispatching network-vif-plugged-8ebc1d23-a473-4640-aa39-31cbed300c07 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:00:57 user nova-compute[71874]: WARNING nova.compute.manager [req-4687ce71-4e2e-416f-82d2-283eaed57380 req-4df7d7ac-fc00-4158-a1b3-042b523a7a12 service nova] [instance: 026ab036-1481-4689-af70-661493e9451c] Received unexpected event network-vif-plugged-8ebc1d23-a473-4640-aa39-31cbed300c07 for instance with vm_state building and task_state spawning.
Apr 12 16:00:57 user nova-compute[71874]: DEBUG nova.compute.manager [req-4687ce71-4e2e-416f-82d2-283eaed57380 req-4df7d7ac-fc00-4158-a1b3-042b523a7a12 service nova] [instance: 026ab036-1481-4689-af70-661493e9451c] Received event network-vif-plugged-7f36bae3-c729-4d85-8c31-075b2b100abe {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:00:57 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-4687ce71-4e2e-416f-82d2-283eaed57380 req-4df7d7ac-fc00-4158-a1b3-042b523a7a12 service nova] Acquiring lock "026ab036-1481-4689-af70-661493e9451c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:00:57 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-4687ce71-4e2e-416f-82d2-283eaed57380 req-4df7d7ac-fc00-4158-a1b3-042b523a7a12 service nova] Lock "026ab036-1481-4689-af70-661493e9451c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:00:57 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-4687ce71-4e2e-416f-82d2-283eaed57380 req-4df7d7ac-fc00-4158-a1b3-042b523a7a12 service nova] Lock "026ab036-1481-4689-af70-661493e9451c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:00:57 user nova-compute[71874]: DEBUG nova.compute.manager [req-4687ce71-4e2e-416f-82d2-283eaed57380 req-4df7d7ac-fc00-4158-a1b3-042b523a7a12 service nova] [instance: 026ab036-1481-4689-af70-661493e9451c] No waiting events found dispatching network-vif-plugged-7f36bae3-c729-4d85-8c31-075b2b100abe {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:00:57 user nova-compute[71874]: WARNING nova.compute.manager [req-4687ce71-4e2e-416f-82d2-283eaed57380 req-4df7d7ac-fc00-4158-a1b3-042b523a7a12 service nova] [instance: 026ab036-1481-4689-af70-661493e9451c] Received unexpected event network-vif-plugged-7f36bae3-c729-4d85-8c31-075b2b100abe for instance with vm_state building and task_state spawning.
Apr 12 16:00:57 user nova-compute[71874]: DEBUG nova.compute.manager [req-4687ce71-4e2e-416f-82d2-283eaed57380 req-4df7d7ac-fc00-4158-a1b3-042b523a7a12 service nova] [instance: 026ab036-1481-4689-af70-661493e9451c] Received event network-vif-plugged-7f36bae3-c729-4d85-8c31-075b2b100abe {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:00:57 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-4687ce71-4e2e-416f-82d2-283eaed57380 req-4df7d7ac-fc00-4158-a1b3-042b523a7a12 service nova] Acquiring lock "026ab036-1481-4689-af70-661493e9451c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:00:57 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-4687ce71-4e2e-416f-82d2-283eaed57380 req-4df7d7ac-fc00-4158-a1b3-042b523a7a12 service nova] Lock "026ab036-1481-4689-af70-661493e9451c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:00:57 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-4687ce71-4e2e-416f-82d2-283eaed57380 req-4df7d7ac-fc00-4158-a1b3-042b523a7a12 service nova] Lock "026ab036-1481-4689-af70-661493e9451c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:00:57 user nova-compute[71874]: DEBUG nova.compute.manager [req-4687ce71-4e2e-416f-82d2-283eaed57380 req-4df7d7ac-fc00-4158-a1b3-042b523a7a12 service nova] [instance: 026ab036-1481-4689-af70-661493e9451c] No waiting events found dispatching network-vif-plugged-7f36bae3-c729-4d85-8c31-075b2b100abe {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:00:57 user nova-compute[71874]: WARNING nova.compute.manager [req-4687ce71-4e2e-416f-82d2-283eaed57380 req-4df7d7ac-fc00-4158-a1b3-042b523a7a12 service nova] [instance: 026ab036-1481-4689-af70-661493e9451c] Received unexpected event network-vif-plugged-7f36bae3-c729-4d85-8c31-075b2b100abe for instance with vm_state building and task_state spawning.
Apr 12 16:00:57 user nova-compute[71874]: DEBUG nova.compute.manager [req-4687ce71-4e2e-416f-82d2-283eaed57380 req-4df7d7ac-fc00-4158-a1b3-042b523a7a12 service nova] [instance: 026ab036-1481-4689-af70-661493e9451c] Received event network-vif-plugged-264de72a-d4f4-4a6a-b3ab-1e8ea8b9a30b {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:00:57 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-4687ce71-4e2e-416f-82d2-283eaed57380 req-4df7d7ac-fc00-4158-a1b3-042b523a7a12 service nova] Acquiring lock "026ab036-1481-4689-af70-661493e9451c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:00:57 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-4687ce71-4e2e-416f-82d2-283eaed57380 req-4df7d7ac-fc00-4158-a1b3-042b523a7a12 service nova] Lock "026ab036-1481-4689-af70-661493e9451c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:00:57 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-4687ce71-4e2e-416f-82d2-283eaed57380 req-4df7d7ac-fc00-4158-a1b3-042b523a7a12 service nova] Lock "026ab036-1481-4689-af70-661493e9451c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:00:57 user nova-compute[71874]: DEBUG nova.compute.manager [req-4687ce71-4e2e-416f-82d2-283eaed57380 req-4df7d7ac-fc00-4158-a1b3-042b523a7a12 service nova] [instance: 026ab036-1481-4689-af70-661493e9451c] No waiting events found dispatching network-vif-plugged-264de72a-d4f4-4a6a-b3ab-1e8ea8b9a30b {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:00:57 user nova-compute[71874]: WARNING nova.compute.manager [req-4687ce71-4e2e-416f-82d2-283eaed57380 req-4df7d7ac-fc00-4158-a1b3-042b523a7a12 service nova] [instance: 026ab036-1481-4689-af70-661493e9451c] Received unexpected event network-vif-plugged-264de72a-d4f4-4a6a-b3ab-1e8ea8b9a30b for instance with vm_state building and task_state spawning.
Apr 12 16:00:57 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:57 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:57 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:57 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:57 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Searching for a device in session 8 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=71874) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 16:00:57 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ksialVvo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71874) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 16:00:57 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.418s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:00:57 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] <== connect_volume: return (1419ms) {'type': 'block', 'scsi_wwn': '23962666164326663', 'path': '/dev/sdh'} {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:00:57 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23962666164326663', 'path': '/dev/sdh'} {{(pid=71874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 16:00:57 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:57 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T16:00:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1486400569',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1486400569',id=13,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLLQXDyGxnW8Y8uGnRNVHYUbX23R7I4pLI6ZbfyCvQF/VJCuiE4FcFV1q49XDBUk5vZYnAPb/+RlfqgPWZ19CwkWt6aeUKiPxRYOkBEiwZu+X1jwZm0eXBg0fxd57kvoRA==',key_name='tempest-keypair-302611627',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='020f60d454f846d5a18dfbe1d88b65da',ramdisk_id='',reservation_id='r-pwhuoluu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-42052269',owner_user_name='tempest-TaggedBootDevicesTest-42052269-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T16:00:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='51e8a84c876249dd9b588305926ffdff',uuid=9ea56377-20bc-48cc-a248-5fad6db060cb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7ae43e60-f63a-448e-9a89-0d6bff272104", "address": "fa:16:3e:b7:f0:f6", "network": {"id": "db8367a7-06c5-4e83-987a-c92d02009fef", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-612559343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "020f60d454f846d5a18dfbe1d88b65da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ae43e60-f6", "ovs_interfaceid": "7ae43e60-f63a-448e-9a89-0d6bff272104", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 16:00:57 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Converting VIF {"id": "7ae43e60-f63a-448e-9a89-0d6bff272104", "address": "fa:16:3e:b7:f0:f6", "network": {"id": "db8367a7-06c5-4e83-987a-c92d02009fef", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-612559343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "020f60d454f846d5a18dfbe1d88b65da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ae43e60-f6", "ovs_interfaceid": "7ae43e60-f63a-448e-9a89-0d6bff272104", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:00:57 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:f0:f6,bridge_name='br-int',has_traffic_filtering=True,id=7ae43e60-f63a-448e-9a89-0d6bff272104,network=Network(db8367a7-06c5-4e83-987a-c92d02009fef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ae43e60-f6') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:00:57 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T16:00:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1486400569',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1486400569',id=13,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLLQXDyGxnW8Y8uGnRNVHYUbX23R7I4pLI6ZbfyCvQF/VJCuiE4FcFV1q49XDBUk5vZYnAPb/+RlfqgPWZ19CwkWt6aeUKiPxRYOkBEiwZu+X1jwZm0eXBg0fxd57kvoRA==',key_name='tempest-keypair-302611627',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='020f60d454f846d5a18dfbe1d88b65da',ramdisk_id='',reservation_id='r-pwhuoluu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-42052269',owner_user_name='tempest-TaggedBootDevicesTest-42052269-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T16:00:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='51e8a84c876249dd9b588305926ffdff',uuid=9ea56377-20bc-48cc-a248-5fad6db060cb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6c9be856-3e7e-4166-8d71-a1f5330aa82f", "address": "fa:16:3e:44:ca:b6", "network": {"id": "a491fcd5-d137-491a-9854-a743afbd448d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1608054323", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "020f60d454f846d5a18dfbe1d88b65da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9be856-3e", "ovs_interfaceid": "6c9be856-3e7e-4166-8d71-a1f5330aa82f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 16:00:57 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Converting VIF {"id": "6c9be856-3e7e-4166-8d71-a1f5330aa82f", "address": "fa:16:3e:44:ca:b6", "network": {"id": "a491fcd5-d137-491a-9854-a743afbd448d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1608054323", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "020f60d454f846d5a18dfbe1d88b65da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9be856-3e", "ovs_interfaceid": "6c9be856-3e7e-4166-8d71-a1f5330aa82f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:00:57 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:ca:b6,bridge_name='br-int',has_traffic_filtering=True,id=6c9be856-3e7e-4166-8d71-a1f5330aa82f,network=Network(a491fcd5-d137-491a-9854-a743afbd448d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6c9be856-3e') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:00:57 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T16:00:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1486400569',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1486400569',id=13,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLLQXDyGxnW8Y8uGnRNVHYUbX23R7I4pLI6ZbfyCvQF/VJCuiE4FcFV1q49XDBUk5vZYnAPb/+RlfqgPWZ19CwkWt6aeUKiPxRYOkBEiwZu+X1jwZm0eXBg0fxd57kvoRA==',key_name='tempest-keypair-302611627',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='020f60d454f846d5a18dfbe1d88b65da',ramdisk_id='',reservation_id='r-pwhuoluu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-42052269',owner_user_name='tempest-TaggedBootDevicesTest-42052269-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T16:00:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='51e8a84c876249dd9b588305926ffdff',uuid=9ea56377-20bc-48cc-a248-5fad6db060cb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cd2391ad-cb7a-47be-b062-b0dbbc1f8475", "address": "fa:16:3e:89:21:2f", "network": {"id": "a491fcd5-d137-491a-9854-a743afbd448d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1608054323", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.38", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "020f60d454f846d5a18dfbe1d88b65da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd2391ad-cb", "ovs_interfaceid": "cd2391ad-cb7a-47be-b062-b0dbbc1f8475", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 16:00:57 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Converting VIF {"id": "cd2391ad-cb7a-47be-b062-b0dbbc1f8475", "address": "fa:16:3e:89:21:2f", "network": {"id": "a491fcd5-d137-491a-9854-a743afbd448d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1608054323", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.38", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "020f60d454f846d5a18dfbe1d88b65da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd2391ad-cb", "ovs_interfaceid": "cd2391ad-cb7a-47be-b062-b0dbbc1f8475", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:00:57 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:21:2f,bridge_name='br-int',has_traffic_filtering=True,id=cd2391ad-cb7a-47be-b062-b0dbbc1f8475,network=Network(a491fcd5-d137-491a-9854-a743afbd448d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapcd2391ad-cb') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:00:57 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T16:00:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1486400569',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1486400569',id=13,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLLQXDyGxnW8Y8uGnRNVHYUbX23R7I4pLI6ZbfyCvQF/VJCuiE4FcFV1q49XDBUk5vZYnAPb/+RlfqgPWZ19CwkWt6aeUKiPxRYOkBEiwZu+X1jwZm0eXBg0fxd57kvoRA==',key_name='tempest-keypair-302611627',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='020f60d454f846d5a18dfbe1d88b65da',ramdisk_id='',reservation_id='r-pwhuoluu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-42052269',owner_user_name='tempest-TaggedBootDevicesTest-42052269-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T16:00:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='51e8a84c876249dd9b588305926ffdff',uuid=9ea56377-20bc-48cc-a248-5fad6db060cb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f76aae02-12c4-41d6-951a-201330ea7693", "address": "fa:16:3e:13:a6:2d", "network": {"id": "a491fcd5-d137-491a-9854-a743afbd448d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1608054323", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.239", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "020f60d454f846d5a18dfbe1d88b65da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf76aae02-12", "ovs_interfaceid": "f76aae02-12c4-41d6-951a-201330ea7693", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 16:00:57 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Converting VIF {"id": "f76aae02-12c4-41d6-951a-201330ea7693", "address": "fa:16:3e:13:a6:2d", "network": {"id": "a491fcd5-d137-491a-9854-a743afbd448d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1608054323", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.239", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "020f60d454f846d5a18dfbe1d88b65da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf76aae02-12", "ovs_interfaceid": "f76aae02-12c4-41d6-951a-201330ea7693", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:00:57 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:a6:2d,bridge_name='br-int',has_traffic_filtering=True,id=f76aae02-12c4-41d6-951a-201330ea7693,network=Network(a491fcd5-d137-491a-9854-a743afbd448d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf76aae02-12') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:00:57 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T16:00:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1486400569',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1486400569',id=13,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLLQXDyGxnW8Y8uGnRNVHYUbX23R7I4pLI6ZbfyCvQF/VJCuiE4FcFV1q49XDBUk5vZYnAPb/+RlfqgPWZ19CwkWt6aeUKiPxRYOkBEiwZu+X1jwZm0eXBg0fxd57kvoRA==',key_name='tempest-keypair-302611627',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='020f60d454f846d5a18dfbe1d88b65da',ramdisk_id='',reservation_id='r-pwhuoluu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-42052269',owner_user_name='tempest-TaggedBootDevicesTest-42052269-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T16:00:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='51e8a84c876249dd9b588305926ffdff',uuid=9ea56377-20bc-48cc-a248-5fad6db060cb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b85b7f43-1f5d-441a-bf3e-380900194e10", "address": "fa:16:3e:2f:65:2e", "network": {"id": "a491fcd5-d137-491a-9854-a743afbd448d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1608054323", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "020f60d454f846d5a18dfbe1d88b65da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb85b7f43-1f", "ovs_interfaceid": "b85b7f43-1f5d-441a-bf3e-380900194e10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 16:00:57 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Converting VIF {"id": "b85b7f43-1f5d-441a-bf3e-380900194e10", "address": "fa:16:3e:2f:65:2e", "network": {"id": "a491fcd5-d137-491a-9854-a743afbd448d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1608054323", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "020f60d454f846d5a18dfbe1d88b65da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb85b7f43-1f", "ovs_interfaceid": "b85b7f43-1f5d-441a-bf3e-380900194e10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:00:57 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:65:2e,bridge_name='br-int',has_traffic_filtering=True,id=b85b7f43-1f5d-441a-bf3e-380900194e10,network=Network(a491fcd5-d137-491a-9854-a743afbd448d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb85b7f43-1f') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:00:57 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T16:00:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1486400569',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1486400569',id=13,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLLQXDyGxnW8Y8uGnRNVHYUbX23R7I4pLI6ZbfyCvQF/VJCuiE4FcFV1q49XDBUk5vZYnAPb/+RlfqgPWZ19CwkWt6aeUKiPxRYOkBEiwZu+X1jwZm0eXBg0fxd57kvoRA==',key_name='tempest-keypair-302611627',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='020f60d454f846d5a18dfbe1d88b65da',ramdisk_id='',reservation_id='r-pwhuoluu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-42052269',owner_user_name='tempest-TaggedBootDevicesTest-42052269-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T16:00:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='51e8a84c876249dd9b588305926ffdff',uuid=9ea56377-20bc-48cc-a248-5fad6db060cb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c5c4abf8-1b9b-4385-adf7-b34b27a8bc6b", "address": "fa:16:3e:10:b7:d0", "network": {"id": "c543f5eb-b28c-4113-a560-8d6790713d19", "bridge": "br-int", "label": "tempest-device-tagging-net2-1828870959", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "020f60d454f846d5a18dfbe1d88b65da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5c4abf8-1b", "ovs_interfaceid": "c5c4abf8-1b9b-4385-adf7-b34b27a8bc6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 16:00:57 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Converting VIF {"id": "c5c4abf8-1b9b-4385-adf7-b34b27a8bc6b", "address": "fa:16:3e:10:b7:d0", "network": {"id": "c543f5eb-b28c-4113-a560-8d6790713d19", "bridge": "br-int", "label": "tempest-device-tagging-net2-1828870959", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "020f60d454f846d5a18dfbe1d88b65da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5c4abf8-1b", "ovs_interfaceid": "c5c4abf8-1b9b-4385-adf7-b34b27a8bc6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:00:57 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:b7:d0,bridge_name='br-int',has_traffic_filtering=True,id=c5c4abf8-1b9b-4385-adf7-b34b27a8bc6b,network=Network(c543f5eb-b28c-4113-a560-8d6790713d19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5c4abf8-1b') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:00:57 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T16:00:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1486400569',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1486400569',id=13,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLLQXDyGxnW8Y8uGnRNVHYUbX23R7I4pLI6ZbfyCvQF/VJCuiE4FcFV1q49XDBUk5vZYnAPb/+RlfqgPWZ19CwkWt6aeUKiPxRYOkBEiwZu+X1jwZm0eXBg0fxd57kvoRA==',key_name='tempest-keypair-302611627',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='020f60d454f846d5a18dfbe1d88b65da',ramdisk_id='',reservation_id='r-pwhuoluu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-42052269',owner_user_name='tempest-TaggedBootDevicesTest-42052269-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T16:00:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='51e8a84c876249dd9b588305926ffdff',uuid=9ea56377-20bc-48cc-a248-5fad6db060cb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1d70ad7b-92c6-47fa-a411-cef9d6159e90", "address": "fa:16:3e:46:54:b4", "network": {"id": "c543f5eb-b28c-4113-a560-8d6790713d19", "bridge": "br-int", "label": "tempest-device-tagging-net2-1828870959", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "020f60d454f846d5a18dfbe1d88b65da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d70ad7b-92", "ovs_interfaceid": "1d70ad7b-92c6-47fa-a411-cef9d6159e90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 16:00:57 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Converting VIF {"id": "1d70ad7b-92c6-47fa-a411-cef9d6159e90", "address": "fa:16:3e:46:54:b4", "network": {"id": "c543f5eb-b28c-4113-a560-8d6790713d19", "bridge": "br-int", "label": "tempest-device-tagging-net2-1828870959", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "020f60d454f846d5a18dfbe1d88b65da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d70ad7b-92", "ovs_interfaceid": "1d70ad7b-92c6-47fa-a411-cef9d6159e90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:00:57 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:54:b4,bridge_name='br-int',has_traffic_filtering=True,id=1d70ad7b-92c6-47fa-a411-cef9d6159e90,network=Network(c543f5eb-b28c-4113-a560-8d6790713d19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d70ad7b-92') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:00:57 user nova-compute[71874]: DEBUG nova.objects.instance [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Lazy-loading 'pci_devices' on Instance uuid 9ea56377-20bc-48cc-a248-5fad6db060cb {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:00:57 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] End _get_guest_xml xml=<domain type="kvm">
Apr 12 16:00:57 user nova-compute[71874]:   <uuid>9ea56377-20bc-48cc-a248-5fad6db060cb</uuid>
Apr 12 16:00:57 user nova-compute[71874]:   <name>instance-0000000d</name>
Apr 12 16:00:57 user nova-compute[71874]:   <memory>131072</memory>
Apr 12 16:00:57 user nova-compute[71874]:   <vcpu>1</vcpu>
Apr 12 16:00:57 user nova-compute[71874]:   <metadata>
Apr 12 16:00:57 user nova-compute[71874]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 16:00:57 user nova-compute[71874]:       <nova:package version="0.0.0"/>
Apr 12 16:00:57 user nova-compute[71874]:       <nova:name>tempest-device-tagging-server-1486400569</nova:name>
Apr 12 16:00:57 user nova-compute[71874]:       <nova:creationTime>2023-04-12 16:00:53</nova:creationTime>
Apr 12 16:00:57 user nova-compute[71874]:       <nova:flavor name="m1.nano">
Apr 12 16:00:57 user nova-compute[71874]:         <nova:memory>128</nova:memory>
Apr 12 16:00:57 user nova-compute[71874]:         <nova:disk>1</nova:disk>
Apr 12 16:00:57 user nova-compute[71874]:         <nova:swap>0</nova:swap>
Apr 12 16:00:57 user nova-compute[71874]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 16:00:57 user nova-compute[71874]:         <nova:vcpus>1</nova:vcpus>
Apr 12 16:00:57 user nova-compute[71874]:       </nova:flavor>
Apr 12 16:00:57 user nova-compute[71874]:       <nova:owner>
Apr 12 16:00:57 user nova-compute[71874]:         <nova:user uuid="51e8a84c876249dd9b588305926ffdff">tempest-TaggedBootDevicesTest-42052269-project-member</nova:user>
Apr 12 16:00:57 user nova-compute[71874]:         <nova:project uuid="020f60d454f846d5a18dfbe1d88b65da">tempest-TaggedBootDevicesTest-42052269</nova:project>
Apr 12 16:00:57 user nova-compute[71874]:       </nova:owner>
Apr 12 16:00:57 user nova-compute[71874]:       <nova:root type="image" uuid="9dc63f14-8b70-4e72-89f2-13464f2f5c7c"/>
Apr 12 16:00:57 user nova-compute[71874]:       <nova:ports>
Apr 12 16:00:57 user nova-compute[71874]:         <nova:port uuid="7ae43e60-f63a-448e-9a89-0d6bff272104">
Apr 12 16:00:57 user nova-compute[71874]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 12 16:00:57 user nova-compute[71874]:         </nova:port>
Apr 12 16:00:57 user nova-compute[71874]:         <nova:port uuid="6c9be856-3e7e-4166-8d71-a1f5330aa82f">
Apr 12 16:00:57 user nova-compute[71874]:           <nova:ip type="fixed" address="10.1.1.193" ipVersion="4"/>
Apr 12 16:00:57 user nova-compute[71874]:         </nova:port>
Apr 12 16:00:57 user nova-compute[71874]:         <nova:port uuid="cd2391ad-cb7a-47be-b062-b0dbbc1f8475">
Apr 12 16:00:57 user nova-compute[71874]:           <nova:ip type="fixed" address="10.1.1.38" ipVersion="4"/>
Apr 12 16:00:57 user nova-compute[71874]:         </nova:port>
Apr 12 16:00:57 user nova-compute[71874]:         <nova:port uuid="f76aae02-12c4-41d6-951a-201330ea7693">
Apr 12 16:00:57 user nova-compute[71874]:           <nova:ip type="fixed" address="10.1.1.239" ipVersion="4"/>
Apr 12 16:00:57 user nova-compute[71874]:         </nova:port>
Apr 12 16:00:57 user nova-compute[71874]:         <nova:port uuid="b85b7f43-1f5d-441a-bf3e-380900194e10">
Apr 12 16:00:57 user nova-compute[71874]:           <nova:ip type="fixed" address="10.1.1.163" ipVersion="4"/>
Apr 12 16:00:57 user nova-compute[71874]:         </nova:port>
Apr 12 16:00:57 user nova-compute[71874]:         <nova:port uuid="c5c4abf8-1b9b-4385-adf7-b34b27a8bc6b">
Apr 12 16:00:57 user nova-compute[71874]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Apr 12 16:00:57 user nova-compute[71874]:         </nova:port>
Apr 12 16:00:57 user nova-compute[71874]:         <nova:port uuid="1d70ad7b-92c6-47fa-a411-cef9d6159e90">
Apr 12 16:00:57 user nova-compute[71874]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Apr 12 16:00:57 user nova-compute[71874]:         </nova:port>
Apr 12 16:00:57 user nova-compute[71874]:       </nova:ports>
Apr 12 16:00:57 user nova-compute[71874]:     </nova:instance>
Apr 12 16:00:57 user nova-compute[71874]:   </metadata>
Apr 12 16:00:57 user nova-compute[71874]:   <sysinfo type="smbios">
Apr 12 16:00:57 user nova-compute[71874]:     <system>
Apr 12 16:00:57 user nova-compute[71874]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 16:00:57 user nova-compute[71874]:       <entry name="product">OpenStack Nova</entry>
Apr 12 16:00:57 user nova-compute[71874]:       <entry name="version">0.0.0</entry>
Apr 12 16:00:57 user nova-compute[71874]:       <entry name="serial">9ea56377-20bc-48cc-a248-5fad6db060cb</entry>
Apr 12 16:00:57 user nova-compute[71874]:       <entry name="uuid">9ea56377-20bc-48cc-a248-5fad6db060cb</entry>
Apr 12 16:00:57 user nova-compute[71874]:       <entry name="family">Virtual Machine</entry>
Apr 12 16:00:57 user nova-compute[71874]:     </system>
Apr 12 16:00:57 user nova-compute[71874]:   </sysinfo>
Apr 12 16:00:57 user nova-compute[71874]:   <os>
Apr 12 16:00:57 user nova-compute[71874]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 16:00:57 user nova-compute[71874]:     <boot dev="hd"/>
Apr 12 16:00:57 user nova-compute[71874]:     <smbios mode="sysinfo"/>
Apr 12 16:00:57 user nova-compute[71874]:   </os>
Apr 12 16:00:57 user nova-compute[71874]:   <features>
Apr 12 16:00:57 user nova-compute[71874]:     <acpi/>
Apr 12 16:00:57 user nova-compute[71874]:     <apic/>
Apr 12 16:00:57 user nova-compute[71874]:     <vmcoreinfo/>
Apr 12 16:00:57 user nova-compute[71874]:   </features>
Apr 12 16:00:57 user nova-compute[71874]:   <clock offset="utc">
Apr 12 16:00:57 user nova-compute[71874]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 16:00:57 user nova-compute[71874]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 16:00:57 user nova-compute[71874]:     <timer name="hpet" present="no"/>
Apr 12 16:00:57 user nova-compute[71874]:   </clock>
Apr 12 16:00:57 user nova-compute[71874]:   <cpu mode="custom" match="exact">
Apr 12 16:00:57 user nova-compute[71874]:     <model>Nehalem</model>
Apr 12 16:00:57 user nova-compute[71874]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 16:00:57 user nova-compute[71874]:   </cpu>
Apr 12 16:00:57 user nova-compute[71874]:   <devices>
Apr 12 16:00:57 user nova-compute[71874]:     <disk type="file" device="cdrom">
Apr 12 16:00:57 user nova-compute[71874]:       <driver name="qemu" type="raw" cache="none"/>
Apr 12 16:00:57 user nova-compute[71874]:       <source file="/opt/stack/data/nova/instances/9ea56377-20bc-48cc-a248-5fad6db060cb/disk.config"/>
Apr 12 16:00:57 user nova-compute[71874]:       <target dev="hda" bus="ide"/>
Apr 12 16:00:57 user nova-compute[71874]:     </disk>
Apr 12 16:00:57 user nova-compute[71874]:     <disk type="block" device="disk">
Apr 12 16:00:57 user nova-compute[71874]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 16:00:57 user nova-compute[71874]:       <source dev="/dev/sdf"/>
Apr 12 16:00:57 user nova-compute[71874]:       <target dev="vda" bus="virtio"/>
Apr 12 16:00:57 user nova-compute[71874]:       <serial>5a3e6bdc-d274-4e4a-ac05-59caa88e13d4</serial>
Apr 12 16:00:57 user nova-compute[71874]:     </disk>
Apr 12 16:00:57 user nova-compute[71874]:     <disk type="block" device="disk">
Apr 12 16:00:57 user nova-compute[71874]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 16:00:57 user nova-compute[71874]:       <source dev="/dev/sdg"/>
Apr 12 16:00:57 user nova-compute[71874]:       <target dev="vdb" bus="virtio"/>
Apr 12 16:00:57 user nova-compute[71874]:       <serial>1c11ebd7-2275-4a31-9558-6af01638a09b</serial>
Apr 12 16:00:57 user nova-compute[71874]:     </disk>
Apr 12 16:00:57 user nova-compute[71874]:     <disk type="block" device="disk">
Apr 12 16:00:57 user nova-compute[71874]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 16:00:57 user nova-compute[71874]:       <source dev="/dev/sdh"/>
Apr 12 16:00:57 user nova-compute[71874]:       <target dev="vdc" bus="virtio"/>
Apr 12 16:00:57 user nova-compute[71874]:       <serial>9b990634-7cec-49db-9df4-81d3a3f3b0fd</serial>
Apr 12 16:00:57 user nova-compute[71874]:     </disk>
Apr 12 16:00:57 user nova-compute[71874]:     <interface type="ethernet">
Apr 12 16:00:57 user nova-compute[71874]:       <mac address="fa:16:3e:b7:f0:f6"/>
Apr 12 16:00:57 user nova-compute[71874]:       <model type="virtio"/>
Apr 12 16:00:57 user nova-compute[71874]:       <mtu size="1442"/>
Apr 12 16:00:57 user nova-compute[71874]:       <target dev="tap7ae43e60-f6"/>
Apr 12 16:00:57 user nova-compute[71874]:     </interface>
Apr 12 16:00:57 user nova-compute[71874]:     <interface type="ethernet">
Apr 12 16:00:57 user nova-compute[71874]:       <mac address="fa:16:3e:44:ca:b6"/>
Apr 12 16:00:57 user nova-compute[71874]:       <model type="virtio"/>
Apr 12 16:00:57 user nova-compute[71874]:       <mtu size="1442"/>
Apr 12 16:00:57 user nova-compute[71874]:       <target dev="tap6c9be856-3e"/>
Apr 12 16:00:57 user nova-compute[71874]:     </interface>
Apr 12 16:00:57 user nova-compute[71874]:     <interface type="ethernet">
Apr 12 16:00:57 user nova-compute[71874]:       <mac address="fa:16:3e:89:21:2f"/>
Apr 12 16:00:57 user nova-compute[71874]:       <model type="virtio"/>
Apr 12 16:00:57 user nova-compute[71874]:       <mtu size="1442"/>
Apr 12 16:00:57 user nova-compute[71874]:       <target dev="tapcd2391ad-cb"/>
Apr 12 16:00:57 user nova-compute[71874]:     </interface>
Apr 12 16:00:57 user nova-compute[71874]:     <interface type="ethernet">
Apr 12 16:00:57 user nova-compute[71874]:       <mac address="fa:16:3e:13:a6:2d"/>
Apr 12 16:00:57 user nova-compute[71874]:       <model type="virtio"/>
Apr 12 16:00:57 user nova-compute[71874]:       <mtu size="1442"/>
Apr 12 16:00:57 user nova-compute[71874]:       <target dev="tapf76aae02-12"/>
Apr 12 16:00:57 user nova-compute[71874]:     </interface>
Apr 12 16:00:57 user nova-compute[71874]:     <interface type="ethernet">
Apr 12 16:00:57 user nova-compute[71874]:       <mac address="fa:16:3e:2f:65:2e"/>
Apr 12 16:00:57 user nova-compute[71874]:       <model type="virtio"/>
Apr 12 16:00:57 user nova-compute[71874]:       <mtu size="1442"/>
Apr 12 16:00:57 user nova-compute[71874]:       <target dev="tapb85b7f43-1f"/>
Apr 12 16:00:57 user nova-compute[71874]:     </interface>
Apr 12 16:00:57 user nova-compute[71874]:     <interface type="ethernet">
Apr 12 16:00:57 user nova-compute[71874]:       <mac address="fa:16:3e:10:b7:d0"/>
Apr 12 16:00:57 user nova-compute[71874]:       <model type="virtio"/>
Apr 12 16:00:57 user nova-compute[71874]:       <mtu size="1442"/>
Apr 12 16:00:57 user nova-compute[71874]:       <target dev="tapc5c4abf8-1b"/>
Apr 12 16:00:57 user nova-compute[71874]:     </interface>
Apr 12 16:00:57 user nova-compute[71874]:     <interface type="ethernet">
Apr 12 16:00:57 user nova-compute[71874]:       <mac address="fa:16:3e:46:54:b4"/>
Apr 12 16:00:57 user nova-compute[71874]:       <model type="virtio"/>
Apr 12 16:00:57 user nova-compute[71874]:       <mtu size="1442"/>
Apr 12 16:00:57 user nova-compute[71874]:       <target dev="tap1d70ad7b-92"/>
Apr 12 16:00:57 user nova-compute[71874]:     </interface>
Apr 12 16:00:57 user nova-compute[71874]:     <serial type="pty">
Apr 12 16:00:57 user nova-compute[71874]:       <log file="/opt/stack/data/nova/instances/9ea56377-20bc-48cc-a248-5fad6db060cb/console.log" append="off"/>
Apr 12 16:00:57 user nova-compute[71874]:     </serial>
Apr 12 16:00:57 user nova-compute[71874]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 16:00:57 user nova-compute[71874]:     <video>
Apr 12 16:00:57 user nova-compute[71874]:       <model type="virtio"/>
Apr 12 16:00:57 user nova-compute[71874]:     </video>
Apr 12 16:00:57 user nova-compute[71874]:     <rng model="virtio">
Apr 12 16:00:57 user nova-compute[71874]:       <backend model="random">/dev/urandom</backend>
Apr 12 16:00:57 user nova-compute[71874]:     </rng>
Apr 12 16:00:57 user nova-compute[71874]:     <controller type="usb" index="0" model="none"/>
Apr 12 16:00:57 user nova-compute[71874]:     <memballoon model="virtio">
Apr 12 16:00:57 user nova-compute[71874]:       <stats period="10"/>
Apr 12 16:00:57 user nova-compute[71874]:     </memballoon>
Apr 12 16:00:57 user nova-compute[71874]:   </devices>
Apr 12 16:00:57 user nova-compute[71874]: </domain>
Apr 12 16:00:57 user nova-compute[71874]:  {{(pid=71874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 16:00:57 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T16:00:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1486400569',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1486400569',id=13,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLLQXDyGxnW8Y8uGnRNVHYUbX23R7I4pLI6ZbfyCvQF/VJCuiE4FcFV1q49XDBUk5vZYnAPb/+RlfqgPWZ19CwkWt6aeUKiPxRYOkBEiwZu+X1jwZm0eXBg0fxd57kvoRA==',key_name='tempest-keypair-302611627',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='020f60d454f846d5a18dfbe1d88b65da',ramdisk_id='',reservation_id='r-pwhuoluu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-42052269',owner_user_name='tempest-TaggedBootDevicesTest-42052269-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T16:00:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='51e8a84c876249dd9b588305926ffdff',uuid=9ea56377-20bc-48cc-a248-5fad6db060cb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7ae43e60-f63a-448e-9a89-0d6bff272104", "address": "fa:16:3e:b7:f0:f6", "network": {"id": "db8367a7-06c5-4e83-987a-c92d02009fef", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-612559343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "020f60d454f846d5a18dfbe1d88b65da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ae43e60-f6", "ovs_interfaceid": "7ae43e60-f63a-448e-9a89-0d6bff272104", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 16:00:57 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Converting VIF {"id": "7ae43e60-f63a-448e-9a89-0d6bff272104", "address": "fa:16:3e:b7:f0:f6", "network": {"id": "db8367a7-06c5-4e83-987a-c92d02009fef", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-612559343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "020f60d454f846d5a18dfbe1d88b65da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ae43e60-f6", "ovs_interfaceid": "7ae43e60-f63a-448e-9a89-0d6bff272104", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:00:57 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:f0:f6,bridge_name='br-int',has_traffic_filtering=True,id=7ae43e60-f63a-448e-9a89-0d6bff272104,network=Network(db8367a7-06c5-4e83-987a-c92d02009fef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ae43e60-f6') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:00:57 user nova-compute[71874]: DEBUG os_vif [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:f0:f6,bridge_name='br-int',has_traffic_filtering=True,id=7ae43e60-f63a-448e-9a89-0d6bff272104,network=Network(db8367a7-06c5-4e83-987a-c92d02009fef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ae43e60-f6') {{(pid=71874) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 16:00:57 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:57 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:00:57 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 16:00:57 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:57 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7ae43e60-f6, may_exist=True) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:00:57 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7ae43e60-f6, col_values=(('external_ids', {'iface-id': '7ae43e60-f63a-448e-9a89-0d6bff272104', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b7:f0:f6', 'vm-uuid': '9ea56377-20bc-48cc-a248-5fad6db060cb'}),)) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:00:57 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:57 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:00:57 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:57 user nova-compute[71874]: INFO os_vif [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:f0:f6,bridge_name='br-int',has_traffic_filtering=True,id=7ae43e60-f63a-448e-9a89-0d6bff272104,network=Network(db8367a7-06c5-4e83-987a-c92d02009fef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ae43e60-f6')
Apr 12 16:00:57 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T16:00:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1486400569',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1486400569',id=13,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLLQXDyGxnW8Y8uGnRNVHYUbX23R7I4pLI6ZbfyCvQF/VJCuiE4FcFV1q49XDBUk5vZYnAPb/+RlfqgPWZ19CwkWt6aeUKiPxRYOkBEiwZu+X1jwZm0eXBg0fxd57kvoRA==',key_name='tempest-keypair-302611627',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='020f60d454f846d5a18dfbe1d88b65da',ramdisk_id='',reservation_id='r-pwhuoluu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-42052269',owner_user_name='tempest-TaggedBootDevicesTest-42052269-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T16:00:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='51e8a84c876249dd9b588305926ffdff',uuid=9ea56377-20bc-48cc-a248-5fad6db060cb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6c9be856-3e7e-4166-8d71-a1f5330aa82f", "address": "fa:16:3e:44:ca:b6", "network": {"id": "a491fcd5-d137-491a-9854-a743afbd448d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1608054323", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "020f60d454f846d5a18dfbe1d88b65da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9be856-3e", "ovs_interfaceid": "6c9be856-3e7e-4166-8d71-a1f5330aa82f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71874) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 16:00:57 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Converting VIF {"id": "6c9be856-3e7e-4166-8d71-a1f5330aa82f", "address": "fa:16:3e:44:ca:b6", "network": {"id": "a491fcd5-d137-491a-9854-a743afbd448d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1608054323", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "020f60d454f846d5a18dfbe1d88b65da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9be856-3e", "ovs_interfaceid": "6c9be856-3e7e-4166-8d71-a1f5330aa82f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:00:57 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:ca:b6,bridge_name='br-int',has_traffic_filtering=True,id=6c9be856-3e7e-4166-8d71-a1f5330aa82f,network=Network(a491fcd5-d137-491a-9854-a743afbd448d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6c9be856-3e') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:00:57 user nova-compute[71874]: DEBUG os_vif [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:ca:b6,bridge_name='br-int',has_traffic_filtering=True,id=6c9be856-3e7e-4166-8d71-a1f5330aa82f,network=Network(a491fcd5-d137-491a-9854-a743afbd448d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6c9be856-3e') {{(pid=71874) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 16:00:57 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:57 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:00:57 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 16:00:57 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:57 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6c9be856-3e, may_exist=True) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:00:57 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6c9be856-3e, col_values=(('external_ids', {'iface-id': '6c9be856-3e7e-4166-8d71-a1f5330aa82f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:44:ca:b6', 'vm-uuid': '9ea56377-20bc-48cc-a248-5fad6db060cb'}),)) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:00:57 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:57 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:00:57 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:57 user nova-compute[71874]: INFO os_vif [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:ca:b6,bridge_name='br-int',has_traffic_filtering=True,id=6c9be856-3e7e-4166-8d71-a1f5330aa82f,network=Network(a491fcd5-d137-491a-9854-a743afbd448d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6c9be856-3e')
Apr 12 16:00:57 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T16:00:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1486400569',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1486400569',id=13,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLLQXDyGxnW8Y8uGnRNVHYUbX23R7I4pLI6ZbfyCvQF/VJCuiE4FcFV1q49XDBUk5vZYnAPb/+RlfqgPWZ19CwkWt6aeUKiPxRYOkBEiwZu+X1jwZm0eXBg0fxd57kvoRA==',key_name='tempest-keypair-302611627',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='020f60d454f846d5a18dfbe1d88b65da',ramdisk_id='',reservation_id='r-pwhuoluu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-42052269',owner_user_name='tempest-TaggedBootDevicesTest-42052269-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T16:00:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='51e8a84c876249dd9b588305926ffdff',uuid=9ea56377-20bc-48cc-a248-5fad6db060cb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cd2391ad-cb7a-47be-b062-b0dbbc1f8475", "address": "fa:16:3e:89:21:2f", "network": {"id": "a491fcd5-d137-491a-9854-a743afbd448d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1608054323", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.38", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "020f60d454f846d5a18dfbe1d88b65da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd2391ad-cb", "ovs_interfaceid": "cd2391ad-cb7a-47be-b062-b0dbbc1f8475", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71874) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 16:00:57 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Converting VIF {"id": "cd2391ad-cb7a-47be-b062-b0dbbc1f8475", "address": "fa:16:3e:89:21:2f", "network": {"id": "a491fcd5-d137-491a-9854-a743afbd448d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1608054323", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.38", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "020f60d454f846d5a18dfbe1d88b65da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd2391ad-cb", "ovs_interfaceid": "cd2391ad-cb7a-47be-b062-b0dbbc1f8475", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:00:57 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:21:2f,bridge_name='br-int',has_traffic_filtering=True,id=cd2391ad-cb7a-47be-b062-b0dbbc1f8475,network=Network(a491fcd5-d137-491a-9854-a743afbd448d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapcd2391ad-cb') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:00:57 user nova-compute[71874]: DEBUG os_vif [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:21:2f,bridge_name='br-int',has_traffic_filtering=True,id=cd2391ad-cb7a-47be-b062-b0dbbc1f8475,network=Network(a491fcd5-d137-491a-9854-a743afbd448d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapcd2391ad-cb') {{(pid=71874) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 16:00:57 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:57 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:00:57 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 16:00:57 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:57 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcd2391ad-cb, may_exist=True) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:00:57 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapcd2391ad-cb, col_values=(('external_ids', {'iface-id': 'cd2391ad-cb7a-47be-b062-b0dbbc1f8475', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:89:21:2f', 'vm-uuid': '9ea56377-20bc-48cc-a248-5fad6db060cb'}),)) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:00:57 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:57 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:00:57 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:57 user nova-compute[71874]: INFO os_vif [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:21:2f,bridge_name='br-int',has_traffic_filtering=True,id=cd2391ad-cb7a-47be-b062-b0dbbc1f8475,network=Network(a491fcd5-d137-491a-9854-a743afbd448d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapcd2391ad-cb')
Apr 12 16:00:57 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T16:00:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1486400569',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1486400569',id=13,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLLQXDyGxnW8Y8uGnRNVHYUbX23R7I4pLI6ZbfyCvQF/VJCuiE4FcFV1q49XDBUk5vZYnAPb/+RlfqgPWZ19CwkWt6aeUKiPxRYOkBEiwZu+X1jwZm0eXBg0fxd57kvoRA==',key_name='tempest-keypair-302611627',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='020f60d454f846d5a18dfbe1d88b65da',ramdisk_id='',reservation_id='r-pwhuoluu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-42052269',owner_user_name='tempest-TaggedBootDevicesTest-42052269-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T16:00:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='51e8a84c876249dd9b588305926ffdff',uuid=9ea56377-20bc-48cc-a248-5fad6db060cb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f76aae02-12c4-41d6-951a-201330ea7693", "address": "fa:16:3e:13:a6:2d", "network": {"id": "a491fcd5-d137-491a-9854-a743afbd448d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1608054323", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.239", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "020f60d454f846d5a18dfbe1d88b65da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf76aae02-12", "ovs_interfaceid": "f76aae02-12c4-41d6-951a-201330ea7693", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 16:00:57 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Converting VIF {"id": "f76aae02-12c4-41d6-951a-201330ea7693", "address": "fa:16:3e:13:a6:2d", "network": {"id": "a491fcd5-d137-491a-9854-a743afbd448d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1608054323", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.239", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "020f60d454f846d5a18dfbe1d88b65da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf76aae02-12", "ovs_interfaceid": "f76aae02-12c4-41d6-951a-201330ea7693", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:00:57 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:a6:2d,bridge_name='br-int',has_traffic_filtering=True,id=f76aae02-12c4-41d6-951a-201330ea7693,network=Network(a491fcd5-d137-491a-9854-a743afbd448d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf76aae02-12') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:00:57 user nova-compute[71874]: DEBUG os_vif [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:a6:2d,bridge_name='br-int',has_traffic_filtering=True,id=f76aae02-12c4-41d6-951a-201330ea7693,network=Network(a491fcd5-d137-491a-9854-a743afbd448d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf76aae02-12') {{(pid=71874) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 16:00:57 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:57 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:00:57 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 16:00:57 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:57 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf76aae02-12, may_exist=True) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:00:57 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf76aae02-12, col_values=(('external_ids', {'iface-id': 'f76aae02-12c4-41d6-951a-201330ea7693', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:13:a6:2d', 'vm-uuid': '9ea56377-20bc-48cc-a248-5fad6db060cb'}),)) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:00:57 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:57 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:00:57 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:57 user nova-compute[71874]: INFO os_vif [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:a6:2d,bridge_name='br-int',has_traffic_filtering=True,id=f76aae02-12c4-41d6-951a-201330ea7693,network=Network(a491fcd5-d137-491a-9854-a743afbd448d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf76aae02-12')
Apr 12 16:00:57 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T16:00:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1486400569',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1486400569',id=13,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLLQXDyGxnW8Y8uGnRNVHYUbX23R7I4pLI6ZbfyCvQF/VJCuiE4FcFV1q49XDBUk5vZYnAPb/+RlfqgPWZ19CwkWt6aeUKiPxRYOkBEiwZu+X1jwZm0eXBg0fxd57kvoRA==',key_name='tempest-keypair-302611627',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='020f60d454f846d5a18dfbe1d88b65da',ramdisk_id='',reservation_id='r-pwhuoluu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-42052269',owner_user_name='tempest-TaggedBootDevicesTest-42052269-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T16:00:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='51e8a84c876249dd9b588305926ffdff',uuid=9ea56377-20bc-48cc-a248-5fad6db060cb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b85b7f43-1f5d-441a-bf3e-380900194e10", "address": "fa:16:3e:2f:65:2e", "network": {"id": "a491fcd5-d137-491a-9854-a743afbd448d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1608054323", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "020f60d454f846d5a18dfbe1d88b65da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb85b7f43-1f", "ovs_interfaceid": "b85b7f43-1f5d-441a-bf3e-380900194e10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 16:00:57 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Converting VIF {"id": "b85b7f43-1f5d-441a-bf3e-380900194e10", "address": "fa:16:3e:2f:65:2e", "network": {"id": "a491fcd5-d137-491a-9854-a743afbd448d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1608054323", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "020f60d454f846d5a18dfbe1d88b65da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb85b7f43-1f", "ovs_interfaceid": "b85b7f43-1f5d-441a-bf3e-380900194e10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:00:57 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:65:2e,bridge_name='br-int',has_traffic_filtering=True,id=b85b7f43-1f5d-441a-bf3e-380900194e10,network=Network(a491fcd5-d137-491a-9854-a743afbd448d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb85b7f43-1f') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:00:57 user nova-compute[71874]: DEBUG os_vif [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:65:2e,bridge_name='br-int',has_traffic_filtering=True,id=b85b7f43-1f5d-441a-bf3e-380900194e10,network=Network(a491fcd5-d137-491a-9854-a743afbd448d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb85b7f43-1f') {{(pid=71874) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 16:00:57 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:57 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:00:57 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 16:00:57 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:57 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb85b7f43-1f, may_exist=True) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:00:57 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb85b7f43-1f, col_values=(('external_ids', {'iface-id': 'b85b7f43-1f5d-441a-bf3e-380900194e10', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2f:65:2e', 'vm-uuid': '9ea56377-20bc-48cc-a248-5fad6db060cb'}),)) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:00:57 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:57 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:00:57 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:57 user nova-compute[71874]: INFO os_vif [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:65:2e,bridge_name='br-int',has_traffic_filtering=True,id=b85b7f43-1f5d-441a-bf3e-380900194e10,network=Network(a491fcd5-d137-491a-9854-a743afbd448d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb85b7f43-1f')
Apr 12 16:00:57 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T16:00:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1486400569',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1486400569',id=13,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLLQXDyGxnW8Y8uGnRNVHYUbX23R7I4pLI6ZbfyCvQF/VJCuiE4FcFV1q49XDBUk5vZYnAPb/+RlfqgPWZ19CwkWt6aeUKiPxRYOkBEiwZu+X1jwZm0eXBg0fxd57kvoRA==',key_name='tempest-keypair-302611627',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='020f60d454f846d5a18dfbe1d88b65da',ramdisk_id='',reservation_id='r-pwhuoluu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-42052269',owner_user_name='tempest-TaggedBootDevicesTest-42052269-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T16:00:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='51e8a84c876249dd9b588305926ffdff',uuid=9ea56377-20bc-48cc-a248-5fad6db060cb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c5c4abf8-1b9b-4385-adf7-b34b27a8bc6b", "address": "fa:16:3e:10:b7:d0", "network": {"id": "c543f5eb-b28c-4113-a560-8d6790713d19", "bridge": "br-int", "label": "tempest-device-tagging-net2-1828870959", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "020f60d454f846d5a18dfbe1d88b65da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5c4abf8-1b", "ovs_interfaceid": "c5c4abf8-1b9b-4385-adf7-b34b27a8bc6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 16:00:57 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Converting VIF {"id": "c5c4abf8-1b9b-4385-adf7-b34b27a8bc6b", "address": "fa:16:3e:10:b7:d0", "network": {"id": "c543f5eb-b28c-4113-a560-8d6790713d19", "bridge": "br-int", "label": "tempest-device-tagging-net2-1828870959", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "020f60d454f846d5a18dfbe1d88b65da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5c4abf8-1b", "ovs_interfaceid": "c5c4abf8-1b9b-4385-adf7-b34b27a8bc6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:00:57 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:b7:d0,bridge_name='br-int',has_traffic_filtering=True,id=c5c4abf8-1b9b-4385-adf7-b34b27a8bc6b,network=Network(c543f5eb-b28c-4113-a560-8d6790713d19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5c4abf8-1b') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:00:57 user nova-compute[71874]: DEBUG os_vif [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:b7:d0,bridge_name='br-int',has_traffic_filtering=True,id=c5c4abf8-1b9b-4385-adf7-b34b27a8bc6b,network=Network(c543f5eb-b28c-4113-a560-8d6790713d19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5c4abf8-1b') {{(pid=71874) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 16:00:57 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:57 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:00:57 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 16:00:57 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:57 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc5c4abf8-1b, may_exist=True) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:00:57 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc5c4abf8-1b, col_values=(('external_ids', {'iface-id': 'c5c4abf8-1b9b-4385-adf7-b34b27a8bc6b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:10:b7:d0', 'vm-uuid': '9ea56377-20bc-48cc-a248-5fad6db060cb'}),)) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:00:57 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:57 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:00:57 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:57 user nova-compute[71874]: INFO os_vif [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:b7:d0,bridge_name='br-int',has_traffic_filtering=True,id=c5c4abf8-1b9b-4385-adf7-b34b27a8bc6b,network=Network(c543f5eb-b28c-4113-a560-8d6790713d19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5c4abf8-1b')
Apr 12 16:00:57 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T16:00:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1486400569',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1486400569',id=13,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLLQXDyGxnW8Y8uGnRNVHYUbX23R7I4pLI6ZbfyCvQF/VJCuiE4FcFV1q49XDBUk5vZYnAPb/+RlfqgPWZ19CwkWt6aeUKiPxRYOkBEiwZu+X1jwZm0eXBg0fxd57kvoRA==',key_name='tempest-keypair-302611627',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='020f60d454f846d5a18dfbe1d88b65da',ramdisk_id='',reservation_id='r-pwhuoluu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-42052269',owner_user_name='tempest-TaggedBootDevicesTest-42052269-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T16:00:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='51e8a84c876249dd9b588305926ffdff',uuid=9ea56377-20bc-48cc-a248-5fad6db060cb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1d70ad7b-92c6-47fa-a411-cef9d6159e90", "address": "fa:16:3e:46:54:b4", "network": {"id": "c543f5eb-b28c-4113-a560-8d6790713d19", "bridge": "br-int", "label": "tempest-device-tagging-net2-1828870959", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "020f60d454f846d5a18dfbe1d88b65da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d70ad7b-92", "ovs_interfaceid": "1d70ad7b-92c6-47fa-a411-cef9d6159e90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 16:00:57 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Converting VIF {"id": "1d70ad7b-92c6-47fa-a411-cef9d6159e90", "address": "fa:16:3e:46:54:b4", "network": {"id": "c543f5eb-b28c-4113-a560-8d6790713d19", "bridge": "br-int", "label": "tempest-device-tagging-net2-1828870959", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "020f60d454f846d5a18dfbe1d88b65da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d70ad7b-92", "ovs_interfaceid": "1d70ad7b-92c6-47fa-a411-cef9d6159e90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:00:57 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:54:b4,bridge_name='br-int',has_traffic_filtering=True,id=1d70ad7b-92c6-47fa-a411-cef9d6159e90,network=Network(c543f5eb-b28c-4113-a560-8d6790713d19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d70ad7b-92') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:00:57 user nova-compute[71874]: DEBUG os_vif [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:54:b4,bridge_name='br-int',has_traffic_filtering=True,id=1d70ad7b-92c6-47fa-a411-cef9d6159e90,network=Network(c543f5eb-b28c-4113-a560-8d6790713d19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d70ad7b-92') {{(pid=71874) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 16:00:57 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:57 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:00:57 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 16:00:57 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:57 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1d70ad7b-92, may_exist=True) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:00:57 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1d70ad7b-92, col_values=(('external_ids', {'iface-id': '1d70ad7b-92c6-47fa-a411-cef9d6159e90', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:46:54:b4', 'vm-uuid': '9ea56377-20bc-48cc-a248-5fad6db060cb'}),)) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:00:57 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:57 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:00:57 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:57 user nova-compute[71874]: INFO os_vif [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:54:b4,bridge_name='br-int',has_traffic_filtering=True,id=1d70ad7b-92c6-47fa-a411-cef9d6159e90,network=Network(c543f5eb-b28c-4113-a560-8d6790713d19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d70ad7b-92')
Apr 12 16:00:57 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:58 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] No BDM found with device name hda, not building metadata. {{(pid=71874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 16:00:58 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 16:00:58 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] No VIF found with MAC fa:16:3e:b7:f0:f6, not building metadata {{(pid=71874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 16:00:58 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] No VIF found with MAC fa:16:3e:2f:65:2e, not building metadata {{(pid=71874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 16:00:58 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Using config drive
Apr 12 16:00:58 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:58 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:58 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:58 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:58 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Creating config drive at /opt/stack/data/nova/instances/9ea56377-20bc-48cc-a248-5fad6db060cb/disk.config
Apr 12 16:00:58 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/9ea56377-20bc-48cc-a248-5fad6db060cb/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpmxtj97dl {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:00:58 user nova-compute[71874]: DEBUG nova.compute.manager [req-a1b62eb0-f09f-4d53-91f2-36f75e2737d9 req-ee30e2be-dbeb-4fe9-8833-b34dfeeca753 service nova] [instance: 026ab036-1481-4689-af70-661493e9451c] Received event network-vif-plugged-e3f484fe-17dd-4cef-babd-ad78cf557b03 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:00:58 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-a1b62eb0-f09f-4d53-91f2-36f75e2737d9 req-ee30e2be-dbeb-4fe9-8833-b34dfeeca753 service nova] Acquiring lock "026ab036-1481-4689-af70-661493e9451c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:00:58 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-a1b62eb0-f09f-4d53-91f2-36f75e2737d9 req-ee30e2be-dbeb-4fe9-8833-b34dfeeca753 service nova] Lock "026ab036-1481-4689-af70-661493e9451c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.292s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:00:58 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-a1b62eb0-f09f-4d53-91f2-36f75e2737d9 req-ee30e2be-dbeb-4fe9-8833-b34dfeeca753 service nova] Lock "026ab036-1481-4689-af70-661493e9451c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:00:58 user nova-compute[71874]: DEBUG nova.compute.manager [req-a1b62eb0-f09f-4d53-91f2-36f75e2737d9 req-ee30e2be-dbeb-4fe9-8833-b34dfeeca753 service nova] [instance: 026ab036-1481-4689-af70-661493e9451c] No waiting events found dispatching network-vif-plugged-e3f484fe-17dd-4cef-babd-ad78cf557b03 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:00:58 user nova-compute[71874]: WARNING nova.compute.manager [req-a1b62eb0-f09f-4d53-91f2-36f75e2737d9 req-ee30e2be-dbeb-4fe9-8833-b34dfeeca753 service nova] [instance: 026ab036-1481-4689-af70-661493e9451c] Received unexpected event network-vif-plugged-e3f484fe-17dd-4cef-babd-ad78cf557b03 for instance with vm_state building and task_state spawning.
Apr 12 16:00:58 user nova-compute[71874]: DEBUG nova.compute.manager [req-a1b62eb0-f09f-4d53-91f2-36f75e2737d9 req-ee30e2be-dbeb-4fe9-8833-b34dfeeca753 service nova] [instance: 026ab036-1481-4689-af70-661493e9451c] Received event network-vif-plugged-0b2175eb-de94-4274-b200-14894dbcbda0 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:00:58 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-a1b62eb0-f09f-4d53-91f2-36f75e2737d9 req-ee30e2be-dbeb-4fe9-8833-b34dfeeca753 service nova] Acquiring lock "026ab036-1481-4689-af70-661493e9451c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:00:58 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-a1b62eb0-f09f-4d53-91f2-36f75e2737d9 req-ee30e2be-dbeb-4fe9-8833-b34dfeeca753 service nova] Lock "026ab036-1481-4689-af70-661493e9451c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:00:58 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-a1b62eb0-f09f-4d53-91f2-36f75e2737d9 req-ee30e2be-dbeb-4fe9-8833-b34dfeeca753 service nova] Lock "026ab036-1481-4689-af70-661493e9451c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:00:58 user nova-compute[71874]: DEBUG nova.compute.manager [req-a1b62eb0-f09f-4d53-91f2-36f75e2737d9 req-ee30e2be-dbeb-4fe9-8833-b34dfeeca753 service nova] [instance: 026ab036-1481-4689-af70-661493e9451c] No waiting events found dispatching network-vif-plugged-0b2175eb-de94-4274-b200-14894dbcbda0 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:00:58 user nova-compute[71874]: WARNING nova.compute.manager [req-a1b62eb0-f09f-4d53-91f2-36f75e2737d9 req-ee30e2be-dbeb-4fe9-8833-b34dfeeca753 service nova] [instance: 026ab036-1481-4689-af70-661493e9451c] Received unexpected event network-vif-plugged-0b2175eb-de94-4274-b200-14894dbcbda0 for instance with vm_state building and task_state spawning.
Apr 12 16:00:58 user nova-compute[71874]: DEBUG nova.compute.manager [req-a1b62eb0-f09f-4d53-91f2-36f75e2737d9 req-ee30e2be-dbeb-4fe9-8833-b34dfeeca753 service nova] [instance: 026ab036-1481-4689-af70-661493e9451c] Received event network-vif-plugged-0b2175eb-de94-4274-b200-14894dbcbda0 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:00:58 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-a1b62eb0-f09f-4d53-91f2-36f75e2737d9 req-ee30e2be-dbeb-4fe9-8833-b34dfeeca753 service nova] Acquiring lock "026ab036-1481-4689-af70-661493e9451c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:00:58 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-a1b62eb0-f09f-4d53-91f2-36f75e2737d9 req-ee30e2be-dbeb-4fe9-8833-b34dfeeca753 service nova] Lock "026ab036-1481-4689-af70-661493e9451c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:00:58 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-a1b62eb0-f09f-4d53-91f2-36f75e2737d9 req-ee30e2be-dbeb-4fe9-8833-b34dfeeca753 service nova] Lock "026ab036-1481-4689-af70-661493e9451c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:00:58 user nova-compute[71874]: DEBUG nova.compute.manager [req-a1b62eb0-f09f-4d53-91f2-36f75e2737d9 req-ee30e2be-dbeb-4fe9-8833-b34dfeeca753 service nova] [instance: 026ab036-1481-4689-af70-661493e9451c] No waiting events found dispatching network-vif-plugged-0b2175eb-de94-4274-b200-14894dbcbda0 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:00:58 user nova-compute[71874]: WARNING nova.compute.manager [req-a1b62eb0-f09f-4d53-91f2-36f75e2737d9 req-ee30e2be-dbeb-4fe9-8833-b34dfeeca753 service nova] [instance: 026ab036-1481-4689-af70-661493e9451c] Received unexpected event network-vif-plugged-0b2175eb-de94-4274-b200-14894dbcbda0 for instance with vm_state building and task_state spawning.
Apr 12 16:00:58 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/9ea56377-20bc-48cc-a248-5fad6db060cb/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpmxtj97dl" returned: 0 in 0.347s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:00:58 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:58 user nova-compute[71874]: DEBUG nova.virt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Emitting event <LifecycleEvent: 1681315258.939399, 026ab036-1481-4689-af70-661493e9451c => Resumed> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:00:58 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 026ab036-1481-4689-af70-661493e9451c] VM Resumed (Lifecycle Event)
Apr 12 16:00:58 user nova-compute[71874]: DEBUG nova.compute.manager [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] [instance: 026ab036-1481-4689-af70-661493e9451c] Instance event wait completed in 0 seconds for  {{(pid=71874) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 16:00:58 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] [instance: 026ab036-1481-4689-af70-661493e9451c] Guest created on hypervisor {{(pid=71874) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 16:00:58 user nova-compute[71874]: INFO nova.virt.libvirt.driver [-] [instance: 026ab036-1481-4689-af70-661493e9451c] Instance spawned successfully.
Apr 12 16:00:58 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] [instance: 026ab036-1481-4689-af70-661493e9451c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 16:00:58 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 026ab036-1481-4689-af70-661493e9451c] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:00:58 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 026ab036-1481-4689-af70-661493e9451c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 16:00:58 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 026ab036-1481-4689-af70-661493e9451c] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 16:00:58 user nova-compute[71874]: DEBUG nova.virt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Emitting event <LifecycleEvent: 1681315258.9436018, 026ab036-1481-4689-af70-661493e9451c => Started> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:00:58 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 026ab036-1481-4689-af70-661493e9451c] VM Started (Lifecycle Event)
Apr 12 16:00:58 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] [instance: 026ab036-1481-4689-af70-661493e9451c] Found default for hw_cdrom_bus of ide {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:00:58 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] [instance: 026ab036-1481-4689-af70-661493e9451c] Found default for hw_disk_bus of virtio {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:00:58 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] [instance: 026ab036-1481-4689-af70-661493e9451c] Found default for hw_input_bus of None {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:00:58 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] [instance: 026ab036-1481-4689-af70-661493e9451c] Found default for hw_pointer_model of None {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:00:58 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] [instance: 026ab036-1481-4689-af70-661493e9451c] Found default for hw_video_model of virtio {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:00:58 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] [instance: 026ab036-1481-4689-af70-661493e9451c] Found default for hw_vif_model of virtio {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:00:59 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 026ab036-1481-4689-af70-661493e9451c] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:00:59 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 026ab036-1481-4689-af70-661493e9451c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 16:00:59 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 026ab036-1481-4689-af70-661493e9451c] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 16:00:59 user nova-compute[71874]: DEBUG nova.compute.manager [req-f0b2546d-8b15-45d9-b147-c35ac2ffb3f3 req-e89ddc38-777b-4fa6-af10-7a1b8eae5778 service nova] [instance: 026ab036-1481-4689-af70-661493e9451c] Received event network-vif-plugged-264de72a-d4f4-4a6a-b3ab-1e8ea8b9a30b {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:00:59 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-f0b2546d-8b15-45d9-b147-c35ac2ffb3f3 req-e89ddc38-777b-4fa6-af10-7a1b8eae5778 service nova] Acquiring lock "026ab036-1481-4689-af70-661493e9451c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:00:59 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-f0b2546d-8b15-45d9-b147-c35ac2ffb3f3 req-e89ddc38-777b-4fa6-af10-7a1b8eae5778 service nova] Lock "026ab036-1481-4689-af70-661493e9451c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:00:59 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-f0b2546d-8b15-45d9-b147-c35ac2ffb3f3 req-e89ddc38-777b-4fa6-af10-7a1b8eae5778 service nova] Lock "026ab036-1481-4689-af70-661493e9451c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:00:59 user nova-compute[71874]: DEBUG nova.compute.manager [req-f0b2546d-8b15-45d9-b147-c35ac2ffb3f3 req-e89ddc38-777b-4fa6-af10-7a1b8eae5778 service nova] [instance: 026ab036-1481-4689-af70-661493e9451c] No waiting events found dispatching network-vif-plugged-264de72a-d4f4-4a6a-b3ab-1e8ea8b9a30b {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:00:59 user nova-compute[71874]: WARNING nova.compute.manager [req-f0b2546d-8b15-45d9-b147-c35ac2ffb3f3 req-e89ddc38-777b-4fa6-af10-7a1b8eae5778 service nova] [instance: 026ab036-1481-4689-af70-661493e9451c] Received unexpected event network-vif-plugged-264de72a-d4f4-4a6a-b3ab-1e8ea8b9a30b for instance with vm_state building and task_state spawning.
Apr 12 16:00:59 user nova-compute[71874]: DEBUG nova.compute.manager [req-f0b2546d-8b15-45d9-b147-c35ac2ffb3f3 req-e89ddc38-777b-4fa6-af10-7a1b8eae5778 service nova] [instance: 026ab036-1481-4689-af70-661493e9451c] Received event network-vif-plugged-5796cf52-4e81-4c40-954e-86819f5557c8 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:00:59 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-f0b2546d-8b15-45d9-b147-c35ac2ffb3f3 req-e89ddc38-777b-4fa6-af10-7a1b8eae5778 service nova] Acquiring lock "026ab036-1481-4689-af70-661493e9451c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:00:59 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-f0b2546d-8b15-45d9-b147-c35ac2ffb3f3 req-e89ddc38-777b-4fa6-af10-7a1b8eae5778 service nova] Lock "026ab036-1481-4689-af70-661493e9451c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:00:59 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-f0b2546d-8b15-45d9-b147-c35ac2ffb3f3 req-e89ddc38-777b-4fa6-af10-7a1b8eae5778 service nova] Lock "026ab036-1481-4689-af70-661493e9451c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:00:59 user nova-compute[71874]: DEBUG nova.compute.manager [req-f0b2546d-8b15-45d9-b147-c35ac2ffb3f3 req-e89ddc38-777b-4fa6-af10-7a1b8eae5778 service nova] [instance: 026ab036-1481-4689-af70-661493e9451c] No waiting events found dispatching network-vif-plugged-5796cf52-4e81-4c40-954e-86819f5557c8 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:00:59 user nova-compute[71874]: WARNING nova.compute.manager [req-f0b2546d-8b15-45d9-b147-c35ac2ffb3f3 req-e89ddc38-777b-4fa6-af10-7a1b8eae5778 service nova] [instance: 026ab036-1481-4689-af70-661493e9451c] Received unexpected event network-vif-plugged-5796cf52-4e81-4c40-954e-86819f5557c8 for instance with vm_state building and task_state spawning.
Apr 12 16:00:59 user nova-compute[71874]: DEBUG nova.compute.manager [req-f0b2546d-8b15-45d9-b147-c35ac2ffb3f3 req-e89ddc38-777b-4fa6-af10-7a1b8eae5778 service nova] [instance: 026ab036-1481-4689-af70-661493e9451c] Received event network-vif-plugged-5796cf52-4e81-4c40-954e-86819f5557c8 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:00:59 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-f0b2546d-8b15-45d9-b147-c35ac2ffb3f3 req-e89ddc38-777b-4fa6-af10-7a1b8eae5778 service nova] Acquiring lock "026ab036-1481-4689-af70-661493e9451c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:00:59 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-f0b2546d-8b15-45d9-b147-c35ac2ffb3f3 req-e89ddc38-777b-4fa6-af10-7a1b8eae5778 service nova] Lock "026ab036-1481-4689-af70-661493e9451c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:00:59 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-f0b2546d-8b15-45d9-b147-c35ac2ffb3f3 req-e89ddc38-777b-4fa6-af10-7a1b8eae5778 service nova] Lock "026ab036-1481-4689-af70-661493e9451c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:00:59 user nova-compute[71874]: DEBUG nova.compute.manager [req-f0b2546d-8b15-45d9-b147-c35ac2ffb3f3 req-e89ddc38-777b-4fa6-af10-7a1b8eae5778 service nova] [instance: 026ab036-1481-4689-af70-661493e9451c] No waiting events found dispatching network-vif-plugged-5796cf52-4e81-4c40-954e-86819f5557c8 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:00:59 user nova-compute[71874]: WARNING nova.compute.manager [req-f0b2546d-8b15-45d9-b147-c35ac2ffb3f3 req-e89ddc38-777b-4fa6-af10-7a1b8eae5778 service nova] [instance: 026ab036-1481-4689-af70-661493e9451c] Received unexpected event network-vif-plugged-5796cf52-4e81-4c40-954e-86819f5557c8 for instance with vm_state building and task_state spawning.
Apr 12 16:00:59 user nova-compute[71874]: INFO nova.compute.manager [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] [instance: 026ab036-1481-4689-af70-661493e9451c] Took 10.66 seconds to spawn the instance on the hypervisor.
Apr 12 16:00:59 user nova-compute[71874]: DEBUG nova.compute.manager [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] [instance: 026ab036-1481-4689-af70-661493e9451c] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:00:59 user nova-compute[71874]: INFO nova.compute.manager [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] [instance: 026ab036-1481-4689-af70-661493e9451c] Took 28.23 seconds to build instance.
Apr 12 16:00:59 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Lock "026ab036-1481-4689-af70-661493e9451c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 28.335s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:00:59 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:59 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:59 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:00:59 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:01:00 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:01:00 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:01:00 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:01:00 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:01:00 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:01:00 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:01:00 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:01:00 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:01:00 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:01:00 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:01:00 user nova-compute[71874]: DEBUG nova.compute.manager [req-a593aac0-d85a-4c6c-afbe-0626a3517627 req-874bf06c-1394-4c7f-a8cd-72ba13386ac8 service nova] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Received event network-vif-plugged-6c9be856-3e7e-4166-8d71-a1f5330aa82f {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:01:00 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-a593aac0-d85a-4c6c-afbe-0626a3517627 req-874bf06c-1394-4c7f-a8cd-72ba13386ac8 service nova] Acquiring lock "9ea56377-20bc-48cc-a248-5fad6db060cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:01:00 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-a593aac0-d85a-4c6c-afbe-0626a3517627 req-874bf06c-1394-4c7f-a8cd-72ba13386ac8 service nova] Lock "9ea56377-20bc-48cc-a248-5fad6db060cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:01:00 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-a593aac0-d85a-4c6c-afbe-0626a3517627 req-874bf06c-1394-4c7f-a8cd-72ba13386ac8 service nova] Lock "9ea56377-20bc-48cc-a248-5fad6db060cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:01:00 user nova-compute[71874]: DEBUG nova.compute.manager [req-a593aac0-d85a-4c6c-afbe-0626a3517627 req-874bf06c-1394-4c7f-a8cd-72ba13386ac8 service nova] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] No waiting events found dispatching network-vif-plugged-6c9be856-3e7e-4166-8d71-a1f5330aa82f {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:01:00 user nova-compute[71874]: WARNING nova.compute.manager [req-a593aac0-d85a-4c6c-afbe-0626a3517627 req-874bf06c-1394-4c7f-a8cd-72ba13386ac8 service nova] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Received unexpected event network-vif-plugged-6c9be856-3e7e-4166-8d71-a1f5330aa82f for instance with vm_state building and task_state spawning.
Apr 12 16:01:00 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:01:00 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:01:00 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:01:00 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:01:00 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:01:00 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:01:01 user nova-compute[71874]: DEBUG nova.compute.manager [req-8d11c225-719a-4781-894e-1904be55a314 req-e901e996-51e2-4a5e-bbc3-c9407dce6a0a service nova] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Received event network-vif-plugged-7ae43e60-f63a-448e-9a89-0d6bff272104 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:01:01 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-8d11c225-719a-4781-894e-1904be55a314 req-e901e996-51e2-4a5e-bbc3-c9407dce6a0a service nova] Acquiring lock "9ea56377-20bc-48cc-a248-5fad6db060cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:01:01 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-8d11c225-719a-4781-894e-1904be55a314 req-e901e996-51e2-4a5e-bbc3-c9407dce6a0a service nova] Lock "9ea56377-20bc-48cc-a248-5fad6db060cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:01:01 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-8d11c225-719a-4781-894e-1904be55a314 req-e901e996-51e2-4a5e-bbc3-c9407dce6a0a service nova] Lock "9ea56377-20bc-48cc-a248-5fad6db060cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:01:01 user nova-compute[71874]: DEBUG nova.compute.manager [req-8d11c225-719a-4781-894e-1904be55a314 req-e901e996-51e2-4a5e-bbc3-c9407dce6a0a service nova] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] No waiting events found dispatching network-vif-plugged-7ae43e60-f63a-448e-9a89-0d6bff272104 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:01:01 user nova-compute[71874]: WARNING nova.compute.manager [req-8d11c225-719a-4781-894e-1904be55a314 req-e901e996-51e2-4a5e-bbc3-c9407dce6a0a service nova] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Received unexpected event network-vif-plugged-7ae43e60-f63a-448e-9a89-0d6bff272104 for instance with vm_state building and task_state spawning.
Apr 12 16:01:01 user nova-compute[71874]: DEBUG nova.compute.manager [req-8d11c225-719a-4781-894e-1904be55a314 req-e901e996-51e2-4a5e-bbc3-c9407dce6a0a service nova] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Received event network-vif-plugged-7ae43e60-f63a-448e-9a89-0d6bff272104 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:01:01 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-8d11c225-719a-4781-894e-1904be55a314 req-e901e996-51e2-4a5e-bbc3-c9407dce6a0a service nova] Acquiring lock "9ea56377-20bc-48cc-a248-5fad6db060cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:01:01 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-8d11c225-719a-4781-894e-1904be55a314 req-e901e996-51e2-4a5e-bbc3-c9407dce6a0a service nova] Lock "9ea56377-20bc-48cc-a248-5fad6db060cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:01:01 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-8d11c225-719a-4781-894e-1904be55a314 req-e901e996-51e2-4a5e-bbc3-c9407dce6a0a service nova] Lock "9ea56377-20bc-48cc-a248-5fad6db060cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:01:01 user nova-compute[71874]: DEBUG nova.compute.manager [req-8d11c225-719a-4781-894e-1904be55a314 req-e901e996-51e2-4a5e-bbc3-c9407dce6a0a service nova] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] No waiting events found dispatching network-vif-plugged-7ae43e60-f63a-448e-9a89-0d6bff272104 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:01:01 user nova-compute[71874]: WARNING nova.compute.manager [req-8d11c225-719a-4781-894e-1904be55a314 req-e901e996-51e2-4a5e-bbc3-c9407dce6a0a service nova] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Received unexpected event network-vif-plugged-7ae43e60-f63a-448e-9a89-0d6bff272104 for instance with vm_state building and task_state spawning.
Apr 12 16:01:01 user nova-compute[71874]: DEBUG nova.compute.manager [req-8d11c225-719a-4781-894e-1904be55a314 req-e901e996-51e2-4a5e-bbc3-c9407dce6a0a service nova] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Received event network-vif-plugged-cd2391ad-cb7a-47be-b062-b0dbbc1f8475 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:01:01 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-8d11c225-719a-4781-894e-1904be55a314 req-e901e996-51e2-4a5e-bbc3-c9407dce6a0a service nova] Acquiring lock "9ea56377-20bc-48cc-a248-5fad6db060cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:01:01 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-8d11c225-719a-4781-894e-1904be55a314 req-e901e996-51e2-4a5e-bbc3-c9407dce6a0a service nova] Lock "9ea56377-20bc-48cc-a248-5fad6db060cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:01:01 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-8d11c225-719a-4781-894e-1904be55a314 req-e901e996-51e2-4a5e-bbc3-c9407dce6a0a service nova] Lock "9ea56377-20bc-48cc-a248-5fad6db060cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:01:01 user nova-compute[71874]: DEBUG nova.compute.manager [req-8d11c225-719a-4781-894e-1904be55a314 req-e901e996-51e2-4a5e-bbc3-c9407dce6a0a service nova] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] No waiting events found dispatching network-vif-plugged-cd2391ad-cb7a-47be-b062-b0dbbc1f8475 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:01:01 user nova-compute[71874]: WARNING nova.compute.manager [req-8d11c225-719a-4781-894e-1904be55a314 req-e901e996-51e2-4a5e-bbc3-c9407dce6a0a service nova] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Received unexpected event network-vif-plugged-cd2391ad-cb7a-47be-b062-b0dbbc1f8475 for instance with vm_state building and task_state spawning.
Apr 12 16:01:01 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:01:01 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:01:01 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:01:01 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:01:01 user nova-compute[71874]: DEBUG nova.compute.manager [req-4f997ecf-2eec-41f7-b5af-89b3e734a636 req-b0dcf71d-426b-40ca-9a34-a696d8ecc74b service nova] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Received event network-vif-plugged-b85b7f43-1f5d-441a-bf3e-380900194e10 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:01:01 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-4f997ecf-2eec-41f7-b5af-89b3e734a636 req-b0dcf71d-426b-40ca-9a34-a696d8ecc74b service nova] Acquiring lock "9ea56377-20bc-48cc-a248-5fad6db060cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:01:01 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-4f997ecf-2eec-41f7-b5af-89b3e734a636 req-b0dcf71d-426b-40ca-9a34-a696d8ecc74b service nova] Lock "9ea56377-20bc-48cc-a248-5fad6db060cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:01:01 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-4f997ecf-2eec-41f7-b5af-89b3e734a636 req-b0dcf71d-426b-40ca-9a34-a696d8ecc74b service nova] Lock "9ea56377-20bc-48cc-a248-5fad6db060cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.007s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:01:01 user nova-compute[71874]: DEBUG nova.compute.manager [req-4f997ecf-2eec-41f7-b5af-89b3e734a636 req-b0dcf71d-426b-40ca-9a34-a696d8ecc74b service nova] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] No waiting events found dispatching network-vif-plugged-b85b7f43-1f5d-441a-bf3e-380900194e10 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:01:01 user nova-compute[71874]: WARNING nova.compute.manager [req-4f997ecf-2eec-41f7-b5af-89b3e734a636 req-b0dcf71d-426b-40ca-9a34-a696d8ecc74b service nova] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Received unexpected event network-vif-plugged-b85b7f43-1f5d-441a-bf3e-380900194e10 for instance with vm_state building and task_state spawning.
Apr 12 16:01:01 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:01:01 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:01:01 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:01:01 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:01:01 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:01:01 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:01:01 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:01:01 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:01:01 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:01:01 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:01:02 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:01:02 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:01:02 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:01:02 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:01:02 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:01:02 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:01:02 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:01:02 user nova-compute[71874]: DEBUG nova.compute.manager [req-9d88c674-30af-49fc-bac2-ef8707918b35 req-ccc4ffcb-099f-4ce7-a307-7f36bb2fe9b4 service nova] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Received event network-vif-plugged-6c9be856-3e7e-4166-8d71-a1f5330aa82f {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:01:02 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-9d88c674-30af-49fc-bac2-ef8707918b35 req-ccc4ffcb-099f-4ce7-a307-7f36bb2fe9b4 service nova] Acquiring lock "9ea56377-20bc-48cc-a248-5fad6db060cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:01:02 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-9d88c674-30af-49fc-bac2-ef8707918b35 req-ccc4ffcb-099f-4ce7-a307-7f36bb2fe9b4 service nova] Lock "9ea56377-20bc-48cc-a248-5fad6db060cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:01:02 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-9d88c674-30af-49fc-bac2-ef8707918b35 req-ccc4ffcb-099f-4ce7-a307-7f36bb2fe9b4 service nova] Lock "9ea56377-20bc-48cc-a248-5fad6db060cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:01:02 user nova-compute[71874]: DEBUG nova.compute.manager [req-9d88c674-30af-49fc-bac2-ef8707918b35 req-ccc4ffcb-099f-4ce7-a307-7f36bb2fe9b4 service nova] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] No waiting events found dispatching network-vif-plugged-6c9be856-3e7e-4166-8d71-a1f5330aa82f {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:01:02 user nova-compute[71874]: WARNING nova.compute.manager [req-9d88c674-30af-49fc-bac2-ef8707918b35 req-ccc4ffcb-099f-4ce7-a307-7f36bb2fe9b4 service nova] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Received unexpected event network-vif-plugged-6c9be856-3e7e-4166-8d71-a1f5330aa82f for instance with vm_state building and task_state spawning.
Apr 12 16:01:02 user nova-compute[71874]: DEBUG nova.compute.manager [req-9d88c674-30af-49fc-bac2-ef8707918b35 req-ccc4ffcb-099f-4ce7-a307-7f36bb2fe9b4 service nova] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Received event network-vif-plugged-f76aae02-12c4-41d6-951a-201330ea7693 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:01:02 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-9d88c674-30af-49fc-bac2-ef8707918b35 req-ccc4ffcb-099f-4ce7-a307-7f36bb2fe9b4 service nova] Acquiring lock "9ea56377-20bc-48cc-a248-5fad6db060cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:01:02 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-9d88c674-30af-49fc-bac2-ef8707918b35 req-ccc4ffcb-099f-4ce7-a307-7f36bb2fe9b4 service nova] Lock "9ea56377-20bc-48cc-a248-5fad6db060cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:01:02 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-9d88c674-30af-49fc-bac2-ef8707918b35 req-ccc4ffcb-099f-4ce7-a307-7f36bb2fe9b4 service nova] Lock "9ea56377-20bc-48cc-a248-5fad6db060cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:01:02 user nova-compute[71874]: DEBUG nova.compute.manager [req-9d88c674-30af-49fc-bac2-ef8707918b35 req-ccc4ffcb-099f-4ce7-a307-7f36bb2fe9b4 service nova] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] No waiting events found dispatching network-vif-plugged-f76aae02-12c4-41d6-951a-201330ea7693 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:01:02 user nova-compute[71874]: WARNING nova.compute.manager [req-9d88c674-30af-49fc-bac2-ef8707918b35 req-ccc4ffcb-099f-4ce7-a307-7f36bb2fe9b4 service nova] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Received unexpected event network-vif-plugged-f76aae02-12c4-41d6-951a-201330ea7693 for instance with vm_state building and task_state spawning.
Apr 12 16:01:02 user nova-compute[71874]: DEBUG nova.compute.manager [req-9d88c674-30af-49fc-bac2-ef8707918b35 req-ccc4ffcb-099f-4ce7-a307-7f36bb2fe9b4 service nova] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Received event network-vif-plugged-f76aae02-12c4-41d6-951a-201330ea7693 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:01:02 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-9d88c674-30af-49fc-bac2-ef8707918b35 req-ccc4ffcb-099f-4ce7-a307-7f36bb2fe9b4 service nova] Acquiring lock "9ea56377-20bc-48cc-a248-5fad6db060cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:01:02 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-9d88c674-30af-49fc-bac2-ef8707918b35 req-ccc4ffcb-099f-4ce7-a307-7f36bb2fe9b4 service nova] Lock "9ea56377-20bc-48cc-a248-5fad6db060cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:01:02 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-9d88c674-30af-49fc-bac2-ef8707918b35 req-ccc4ffcb-099f-4ce7-a307-7f36bb2fe9b4 service nova] Lock "9ea56377-20bc-48cc-a248-5fad6db060cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:01:02 user nova-compute[71874]: DEBUG nova.compute.manager [req-9d88c674-30af-49fc-bac2-ef8707918b35 req-ccc4ffcb-099f-4ce7-a307-7f36bb2fe9b4 service nova] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] No waiting events found dispatching network-vif-plugged-f76aae02-12c4-41d6-951a-201330ea7693 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:01:02 user nova-compute[71874]: WARNING nova.compute.manager [req-9d88c674-30af-49fc-bac2-ef8707918b35 req-ccc4ffcb-099f-4ce7-a307-7f36bb2fe9b4 service nova] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Received unexpected event network-vif-plugged-f76aae02-12c4-41d6-951a-201330ea7693 for instance with vm_state building and task_state spawning.
Apr 12 16:01:02 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:01:03 user nova-compute[71874]: DEBUG nova.compute.manager [req-080fc052-3cc1-42a4-ba2d-35122cf083d5 req-47ee37b0-942d-4a37-b847-c1355a424734 service nova] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Received event network-vif-plugged-cd2391ad-cb7a-47be-b062-b0dbbc1f8475 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:01:03 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-080fc052-3cc1-42a4-ba2d-35122cf083d5 req-47ee37b0-942d-4a37-b847-c1355a424734 service nova] Acquiring lock "9ea56377-20bc-48cc-a248-5fad6db060cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:01:03 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-080fc052-3cc1-42a4-ba2d-35122cf083d5 req-47ee37b0-942d-4a37-b847-c1355a424734 service nova] Lock "9ea56377-20bc-48cc-a248-5fad6db060cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:01:03 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-080fc052-3cc1-42a4-ba2d-35122cf083d5 req-47ee37b0-942d-4a37-b847-c1355a424734 service nova] Lock "9ea56377-20bc-48cc-a248-5fad6db060cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:01:03 user nova-compute[71874]: DEBUG nova.compute.manager [req-080fc052-3cc1-42a4-ba2d-35122cf083d5 req-47ee37b0-942d-4a37-b847-c1355a424734 service nova] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] No waiting events found dispatching network-vif-plugged-cd2391ad-cb7a-47be-b062-b0dbbc1f8475 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:01:03 user nova-compute[71874]: WARNING nova.compute.manager [req-080fc052-3cc1-42a4-ba2d-35122cf083d5 req-47ee37b0-942d-4a37-b847-c1355a424734 service nova] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Received unexpected event network-vif-plugged-cd2391ad-cb7a-47be-b062-b0dbbc1f8475 for instance with vm_state building and task_state spawning.
Apr 12 16:01:03 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:01:03 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:01:03 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:01:03 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:01:03 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:01:03 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:01:03 user nova-compute[71874]: DEBUG nova.compute.manager [req-106fc134-8860-4762-b3c8-673bc812ffd0 req-8710cbd3-efc0-4d02-923b-2e1072820d9a service nova] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Received event network-vif-plugged-b85b7f43-1f5d-441a-bf3e-380900194e10 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:01:03 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-106fc134-8860-4762-b3c8-673bc812ffd0 req-8710cbd3-efc0-4d02-923b-2e1072820d9a service nova] Acquiring lock "9ea56377-20bc-48cc-a248-5fad6db060cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:01:03 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-106fc134-8860-4762-b3c8-673bc812ffd0 req-8710cbd3-efc0-4d02-923b-2e1072820d9a service nova] Lock "9ea56377-20bc-48cc-a248-5fad6db060cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:01:03 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-106fc134-8860-4762-b3c8-673bc812ffd0 req-8710cbd3-efc0-4d02-923b-2e1072820d9a service nova] Lock "9ea56377-20bc-48cc-a248-5fad6db060cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:01:03 user nova-compute[71874]: DEBUG nova.compute.manager [req-106fc134-8860-4762-b3c8-673bc812ffd0 req-8710cbd3-efc0-4d02-923b-2e1072820d9a service nova] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] No waiting events found dispatching network-vif-plugged-b85b7f43-1f5d-441a-bf3e-380900194e10 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:01:03 user nova-compute[71874]: WARNING nova.compute.manager [req-106fc134-8860-4762-b3c8-673bc812ffd0 req-8710cbd3-efc0-4d02-923b-2e1072820d9a service nova] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Received unexpected event network-vif-plugged-b85b7f43-1f5d-441a-bf3e-380900194e10 for instance with vm_state building and task_state spawning.
Apr 12 16:01:03 user nova-compute[71874]: DEBUG nova.compute.manager [req-106fc134-8860-4762-b3c8-673bc812ffd0 req-8710cbd3-efc0-4d02-923b-2e1072820d9a service nova] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Received event network-vif-plugged-c5c4abf8-1b9b-4385-adf7-b34b27a8bc6b {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:01:03 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-106fc134-8860-4762-b3c8-673bc812ffd0 req-8710cbd3-efc0-4d02-923b-2e1072820d9a service nova] Acquiring lock "9ea56377-20bc-48cc-a248-5fad6db060cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:01:03 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-106fc134-8860-4762-b3c8-673bc812ffd0 req-8710cbd3-efc0-4d02-923b-2e1072820d9a service nova] Lock "9ea56377-20bc-48cc-a248-5fad6db060cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:01:03 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-106fc134-8860-4762-b3c8-673bc812ffd0 req-8710cbd3-efc0-4d02-923b-2e1072820d9a service nova] Lock "9ea56377-20bc-48cc-a248-5fad6db060cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:01:03 user nova-compute[71874]: DEBUG nova.compute.manager [req-106fc134-8860-4762-b3c8-673bc812ffd0 req-8710cbd3-efc0-4d02-923b-2e1072820d9a service nova] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] No waiting events found dispatching network-vif-plugged-c5c4abf8-1b9b-4385-adf7-b34b27a8bc6b {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:01:03 user nova-compute[71874]: WARNING nova.compute.manager [req-106fc134-8860-4762-b3c8-673bc812ffd0 req-8710cbd3-efc0-4d02-923b-2e1072820d9a service nova] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Received unexpected event network-vif-plugged-c5c4abf8-1b9b-4385-adf7-b34b27a8bc6b for instance with vm_state building and task_state spawning.
Apr 12 16:01:03 user nova-compute[71874]: DEBUG nova.compute.manager [req-106fc134-8860-4762-b3c8-673bc812ffd0 req-8710cbd3-efc0-4d02-923b-2e1072820d9a service nova] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Received event network-vif-plugged-c5c4abf8-1b9b-4385-adf7-b34b27a8bc6b {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:01:03 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-106fc134-8860-4762-b3c8-673bc812ffd0 req-8710cbd3-efc0-4d02-923b-2e1072820d9a service nova] Acquiring lock "9ea56377-20bc-48cc-a248-5fad6db060cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:01:03 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-106fc134-8860-4762-b3c8-673bc812ffd0 req-8710cbd3-efc0-4d02-923b-2e1072820d9a service nova] Lock "9ea56377-20bc-48cc-a248-5fad6db060cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:01:03 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-106fc134-8860-4762-b3c8-673bc812ffd0 req-8710cbd3-efc0-4d02-923b-2e1072820d9a service nova] Lock "9ea56377-20bc-48cc-a248-5fad6db060cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:01:03 user nova-compute[71874]: DEBUG nova.compute.manager [req-106fc134-8860-4762-b3c8-673bc812ffd0 req-8710cbd3-efc0-4d02-923b-2e1072820d9a service nova] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] No waiting events found dispatching network-vif-plugged-c5c4abf8-1b9b-4385-adf7-b34b27a8bc6b {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:01:03 user nova-compute[71874]: WARNING nova.compute.manager [req-106fc134-8860-4762-b3c8-673bc812ffd0 req-8710cbd3-efc0-4d02-923b-2e1072820d9a service nova] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Received unexpected event network-vif-plugged-c5c4abf8-1b9b-4385-adf7-b34b27a8bc6b for instance with vm_state building and task_state spawning.
Apr 12 16:01:03 user nova-compute[71874]: DEBUG nova.compute.manager [req-106fc134-8860-4762-b3c8-673bc812ffd0 req-8710cbd3-efc0-4d02-923b-2e1072820d9a service nova] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Received event network-vif-plugged-1d70ad7b-92c6-47fa-a411-cef9d6159e90 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:01:03 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-106fc134-8860-4762-b3c8-673bc812ffd0 req-8710cbd3-efc0-4d02-923b-2e1072820d9a service nova] Acquiring lock "9ea56377-20bc-48cc-a248-5fad6db060cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:01:03 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-106fc134-8860-4762-b3c8-673bc812ffd0 req-8710cbd3-efc0-4d02-923b-2e1072820d9a service nova] Lock "9ea56377-20bc-48cc-a248-5fad6db060cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:01:03 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-106fc134-8860-4762-b3c8-673bc812ffd0 req-8710cbd3-efc0-4d02-923b-2e1072820d9a service nova] Lock "9ea56377-20bc-48cc-a248-5fad6db060cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:01:03 user nova-compute[71874]: DEBUG nova.compute.manager [req-106fc134-8860-4762-b3c8-673bc812ffd0 req-8710cbd3-efc0-4d02-923b-2e1072820d9a service nova] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] No waiting events found dispatching network-vif-plugged-1d70ad7b-92c6-47fa-a411-cef9d6159e90 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:01:03 user nova-compute[71874]: WARNING nova.compute.manager [req-106fc134-8860-4762-b3c8-673bc812ffd0 req-8710cbd3-efc0-4d02-923b-2e1072820d9a service nova] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Received unexpected event network-vif-plugged-1d70ad7b-92c6-47fa-a411-cef9d6159e90 for instance with vm_state building and task_state spawning.
Apr 12 16:01:03 user nova-compute[71874]: DEBUG nova.compute.manager [req-106fc134-8860-4762-b3c8-673bc812ffd0 req-8710cbd3-efc0-4d02-923b-2e1072820d9a service nova] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Received event network-vif-plugged-1d70ad7b-92c6-47fa-a411-cef9d6159e90 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:01:03 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-106fc134-8860-4762-b3c8-673bc812ffd0 req-8710cbd3-efc0-4d02-923b-2e1072820d9a service nova] Acquiring lock "9ea56377-20bc-48cc-a248-5fad6db060cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:01:03 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-106fc134-8860-4762-b3c8-673bc812ffd0 req-8710cbd3-efc0-4d02-923b-2e1072820d9a service nova] Lock "9ea56377-20bc-48cc-a248-5fad6db060cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:01:03 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-106fc134-8860-4762-b3c8-673bc812ffd0 req-8710cbd3-efc0-4d02-923b-2e1072820d9a service nova] Lock "9ea56377-20bc-48cc-a248-5fad6db060cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:01:03 user nova-compute[71874]: DEBUG nova.compute.manager [req-106fc134-8860-4762-b3c8-673bc812ffd0 req-8710cbd3-efc0-4d02-923b-2e1072820d9a service nova] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] No waiting events found dispatching network-vif-plugged-1d70ad7b-92c6-47fa-a411-cef9d6159e90 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:01:03 user nova-compute[71874]: WARNING nova.compute.manager [req-106fc134-8860-4762-b3c8-673bc812ffd0 req-8710cbd3-efc0-4d02-923b-2e1072820d9a service nova] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Received unexpected event network-vif-plugged-1d70ad7b-92c6-47fa-a411-cef9d6159e90 for instance with vm_state building and task_state spawning.
Apr 12 16:01:04 user nova-compute[71874]: DEBUG nova.virt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Emitting event <LifecycleEvent: 1681315264.2233577, 9ea56377-20bc-48cc-a248-5fad6db060cb => Resumed> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:01:04 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] VM Resumed (Lifecycle Event)
Apr 12 16:01:04 user nova-compute[71874]: DEBUG nova.compute.manager [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Instance event wait completed in 0 seconds for  {{(pid=71874) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 16:01:04 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Guest created on hypervisor {{(pid=71874) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 16:01:04 user nova-compute[71874]: INFO nova.virt.libvirt.driver [-] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Instance spawned successfully.
Apr 12 16:01:04 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 16:01:04 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:01:04 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 16:01:04 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Found default for hw_cdrom_bus of ide {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:01:04 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Found default for hw_disk_bus of virtio {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:01:04 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Found default for hw_input_bus of None {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:01:04 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Found default for hw_pointer_model of None {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:01:04 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Found default for hw_video_model of virtio {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:01:04 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Found default for hw_vif_model of virtio {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:01:04 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 16:01:04 user nova-compute[71874]: DEBUG nova.virt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Emitting event <LifecycleEvent: 1681315264.226481, 9ea56377-20bc-48cc-a248-5fad6db060cb => Started> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:01:04 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] VM Started (Lifecycle Event)
Apr 12 16:01:04 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:01:04 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 16:01:04 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 16:01:04 user nova-compute[71874]: INFO nova.compute.manager [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Took 11.21 seconds to spawn the instance on the hypervisor.
Apr 12 16:01:04 user nova-compute[71874]: DEBUG nova.compute.manager [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:01:04 user nova-compute[71874]: INFO nova.compute.manager [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Took 28.17 seconds to build instance.
Apr 12 16:01:04 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Lock "9ea56377-20bc-48cc-a248-5fad6db060cb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 28.308s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:01:07 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:01:07 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:01:12 user nova-compute[71874]: INFO nova.compute.manager [None req-4726d4e0-7ba7-443b-8b86-33cc57264b7d tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: 473a30c4-5aa4-481c-8859-fda815d14872] Rescuing
Apr 12 16:01:12 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-4726d4e0-7ba7-443b-8b86-33cc57264b7d tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Acquiring lock "refresh_cache-473a30c4-5aa4-481c-8859-fda815d14872" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:01:12 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-4726d4e0-7ba7-443b-8b86-33cc57264b7d tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Acquired lock "refresh_cache-473a30c4-5aa4-481c-8859-fda815d14872" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:01:12 user nova-compute[71874]: DEBUG nova.network.neutron [None req-4726d4e0-7ba7-443b-8b86-33cc57264b7d tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: 473a30c4-5aa4-481c-8859-fda815d14872] Building network info cache for instance {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 16:01:12 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:01:12 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:01:12 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71874) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 16:01:12 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71874) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 16:01:12 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71874) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 16:01:12 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:01:13 user nova-compute[71874]: DEBUG nova.network.neutron [None req-4726d4e0-7ba7-443b-8b86-33cc57264b7d tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: 473a30c4-5aa4-481c-8859-fda815d14872] Updating instance_info_cache with network_info: [{"id": "556d7c96-2d40-43fc-83fe-2059479a5265", "address": "fa:16:3e:f3:a2:9e", "network": {"id": "06fae0be-02dd-4962-a1ac-fd0413772758", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1493924857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3fe48a3b7d846a195f1e47cc7f69695", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap556d7c96-2d", "ovs_interfaceid": "556d7c96-2d40-43fc-83fe-2059479a5265", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:01:13 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-4726d4e0-7ba7-443b-8b86-33cc57264b7d tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Releasing lock "refresh_cache-473a30c4-5aa4-481c-8859-fda815d14872" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:01:13 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:01:13 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:01:13 user nova-compute[71874]: DEBUG nova.compute.manager [req-7cb9b50b-351d-4b11-b508-602e8cbcd3a4 req-8bc44427-f535-454a-b5bd-6e765d809f20 service nova] [instance: 473a30c4-5aa4-481c-8859-fda815d14872] Received event network-vif-unplugged-556d7c96-2d40-43fc-83fe-2059479a5265 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:01:13 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-7cb9b50b-351d-4b11-b508-602e8cbcd3a4 req-8bc44427-f535-454a-b5bd-6e765d809f20 service nova] Acquiring lock "473a30c4-5aa4-481c-8859-fda815d14872-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:01:13 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-7cb9b50b-351d-4b11-b508-602e8cbcd3a4 req-8bc44427-f535-454a-b5bd-6e765d809f20 service nova] Lock "473a30c4-5aa4-481c-8859-fda815d14872-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:01:13 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-7cb9b50b-351d-4b11-b508-602e8cbcd3a4 req-8bc44427-f535-454a-b5bd-6e765d809f20 service nova] Lock "473a30c4-5aa4-481c-8859-fda815d14872-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:01:13 user nova-compute[71874]: DEBUG nova.compute.manager [req-7cb9b50b-351d-4b11-b508-602e8cbcd3a4 req-8bc44427-f535-454a-b5bd-6e765d809f20 service nova] [instance: 473a30c4-5aa4-481c-8859-fda815d14872] No waiting events found dispatching network-vif-unplugged-556d7c96-2d40-43fc-83fe-2059479a5265 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:01:13 user nova-compute[71874]: WARNING nova.compute.manager [req-7cb9b50b-351d-4b11-b508-602e8cbcd3a4 req-8bc44427-f535-454a-b5bd-6e765d809f20 service nova] [instance: 473a30c4-5aa4-481c-8859-fda815d14872] Received unexpected event network-vif-unplugged-556d7c96-2d40-43fc-83fe-2059479a5265 for instance with vm_state active and task_state rescuing.
Apr 12 16:01:13 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:01:13 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:01:13 user nova-compute[71874]: INFO nova.virt.libvirt.driver [-] [instance: 473a30c4-5aa4-481c-8859-fda815d14872] Instance destroyed successfully.
Apr 12 16:01:13 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-4726d4e0-7ba7-443b-8b86-33cc57264b7d tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: 473a30c4-5aa4-481c-8859-fda815d14872] Attempting rescue
Apr 12 16:01:13 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-4726d4e0-7ba7-443b-8b86-33cc57264b7d tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=71874) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 12 16:01:13 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-4726d4e0-7ba7-443b-8b86-33cc57264b7d tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: 473a30c4-5aa4-481c-8859-fda815d14872] Instance directory exists: not creating {{(pid=71874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 12 16:01:13 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-4726d4e0-7ba7-443b-8b86-33cc57264b7d tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: 473a30c4-5aa4-481c-8859-fda815d14872] Creating image(s)
Apr 12 16:01:13 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-4726d4e0-7ba7-443b-8b86-33cc57264b7d tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Acquiring lock "/opt/stack/data/nova/instances/473a30c4-5aa4-481c-8859-fda815d14872/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:01:13 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-4726d4e0-7ba7-443b-8b86-33cc57264b7d tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "/opt/stack/data/nova/instances/473a30c4-5aa4-481c-8859-fda815d14872/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:01:13 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-4726d4e0-7ba7-443b-8b86-33cc57264b7d tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "/opt/stack/data/nova/instances/473a30c4-5aa4-481c-8859-fda815d14872/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:01:13 user nova-compute[71874]: DEBUG nova.objects.instance [None req-4726d4e0-7ba7-443b-8b86-33cc57264b7d tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lazy-loading 'trusted_certs' on Instance uuid 473a30c4-5aa4-481c-8859-fda815d14872 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:01:14 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-4726d4e0-7ba7-443b-8b86-33cc57264b7d tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Acquiring lock "b88df1b37cb431f52bc53b5616015c89b5bec411" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:01:14 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-4726d4e0-7ba7-443b-8b86-33cc57264b7d tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "b88df1b37cb431f52bc53b5616015c89b5bec411" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:01:14 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-4726d4e0-7ba7-443b-8b86-33cc57264b7d tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:01:14 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-4726d4e0-7ba7-443b-8b86-33cc57264b7d tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json" returned: 0 in 0.145s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:01:14 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-4726d4e0-7ba7-443b-8b86-33cc57264b7d tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411,backing_fmt=raw /opt/stack/data/nova/instances/473a30c4-5aa4-481c-8859-fda815d14872/disk.rescue {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:01:14 user nova-compute[71874]: DEBUG nova.compute.manager [None req-6f6c6da5-ca3f-49d4-9bbc-9385672c0913 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 608fbea2-b42b-4bb9-94a7-2b76dcdc2001] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:01:14 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-4726d4e0-7ba7-443b-8b86-33cc57264b7d tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411,backing_fmt=raw /opt/stack/data/nova/instances/473a30c4-5aa4-481c-8859-fda815d14872/disk.rescue" returned: 0 in 0.053s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:01:14 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-4726d4e0-7ba7-443b-8b86-33cc57264b7d tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "b88df1b37cb431f52bc53b5616015c89b5bec411" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.203s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:01:14 user nova-compute[71874]: DEBUG nova.objects.instance [None req-4726d4e0-7ba7-443b-8b86-33cc57264b7d tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lazy-loading 'migration_context' on Instance uuid 473a30c4-5aa4-481c-8859-fda815d14872 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:01:14 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-4726d4e0-7ba7-443b-8b86-33cc57264b7d tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: 473a30c4-5aa4-481c-8859-fda815d14872] Created local disks {{(pid=71874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 16:01:14 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-4726d4e0-7ba7-443b-8b86-33cc57264b7d tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: 473a30c4-5aa4-481c-8859-fda815d14872] Start _get_guest_xml network_info=[{"id": "556d7c96-2d40-43fc-83fe-2059479a5265", "address": "fa:16:3e:f3:a2:9e", "network": {"id": "06fae0be-02dd-4962-a1ac-fd0413772758", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1493924857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1493924857-network", "vif_mac": "fa:16:3e:f3:a2:9e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3fe48a3b7d846a195f1e47cc7f69695", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap556d7c96-2d", "ovs_interfaceid": "556d7c96-2d40-43fc-83fe-2059479a5265", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T15:55:37Z,direct_url=<?>,disk_format='qcow2',id=9dc63f14-8b70-4e72-89f2-13464f2f5c7c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='61a4936d9b7744c0b488d81c9b7746b6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T15:55:39Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '9dc63f14-8b70-4e72-89f2-13464f2f5c7c', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=71874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 16:01:14 user nova-compute[71874]: DEBUG nova.objects.instance [None req-4726d4e0-7ba7-443b-8b86-33cc57264b7d tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lazy-loading 'resources' on Instance uuid 473a30c4-5aa4-481c-8859-fda815d14872 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:01:14 user nova-compute[71874]: DEBUG nova.objects.instance [None req-4726d4e0-7ba7-443b-8b86-33cc57264b7d tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lazy-loading 'numa_topology' on Instance uuid 473a30c4-5aa4-481c-8859-fda815d14872 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:01:14 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-4726d4e0-7ba7-443b-8b86-33cc57264b7d tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:01:14 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-4726d4e0-7ba7-443b-8b86-33cc57264b7d tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:01:14 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-4726d4e0-7ba7-443b-8b86-33cc57264b7d tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71874) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 16:01:14 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-4726d4e0-7ba7-443b-8b86-33cc57264b7d tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T15:56:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T15:55:37Z,direct_url=<?>,disk_format='qcow2',id=9dc63f14-8b70-4e72-89f2-13464f2f5c7c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='61a4936d9b7744c0b488d81c9b7746b6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T15:55:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 16:01:14 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-4726d4e0-7ba7-443b-8b86-33cc57264b7d tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Flavor limits 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 16:01:14 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-4726d4e0-7ba7-443b-8b86-33cc57264b7d tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Image limits 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 16:01:14 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-4726d4e0-7ba7-443b-8b86-33cc57264b7d tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Flavor pref 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 16:01:14 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-4726d4e0-7ba7-443b-8b86-33cc57264b7d tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Image pref 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 16:01:14 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-4726d4e0-7ba7-443b-8b86-33cc57264b7d tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 16:01:14 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-4726d4e0-7ba7-443b-8b86-33cc57264b7d tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 16:01:14 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-4726d4e0-7ba7-443b-8b86-33cc57264b7d tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 16:01:14 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-4726d4e0-7ba7-443b-8b86-33cc57264b7d tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Got 1 possible topologies {{(pid=71874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 16:01:14 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-4726d4e0-7ba7-443b-8b86-33cc57264b7d tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 16:01:14 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-4726d4e0-7ba7-443b-8b86-33cc57264b7d tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 16:01:14 user nova-compute[71874]: DEBUG nova.objects.instance [None req-4726d4e0-7ba7-443b-8b86-33cc57264b7d tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lazy-loading 'vcpu_model' on Instance uuid 473a30c4-5aa4-481c-8859-fda815d14872 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:01:14 user nova-compute[71874]: INFO nova.compute.manager [None req-6f6c6da5-ca3f-49d4-9bbc-9385672c0913 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 608fbea2-b42b-4bb9-94a7-2b76dcdc2001] instance snapshotting
Apr 12 16:01:14 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-4726d4e0-7ba7-443b-8b86-33cc57264b7d tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T15:59:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-908306689',display_name='tempest-ServerRescueNegativeTestJSON-server-908306689',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-908306689',id=2,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T15:59:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b3fe48a3b7d846a195f1e47cc7f69695',ramdisk_id='',reservation_id='r-r5sj1znk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-984710343',owner_user_name='tempest-ServerRescueNegativeTestJSON-984710343-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T15:59:39Z,user_data=None,user_id='880266e3fa4d4dd889648c10208a1f8e',uuid=473a30c4-5aa4-481c-8859-fda815d14872,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "556d7c96-2d40-43fc-83fe-2059479a5265", "address": "fa:16:3e:f3:a2:9e", "network": {"id": "06fae0be-02dd-4962-a1ac-fd0413772758", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1493924857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1493924857-network", "vif_mac": "fa:16:3e:f3:a2:9e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3fe48a3b7d846a195f1e47cc7f69695", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap556d7c96-2d", "ovs_interfaceid": "556d7c96-2d40-43fc-83fe-2059479a5265", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 16:01:14 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-4726d4e0-7ba7-443b-8b86-33cc57264b7d tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Converting VIF {"id": "556d7c96-2d40-43fc-83fe-2059479a5265", "address": "fa:16:3e:f3:a2:9e", "network": {"id": "06fae0be-02dd-4962-a1ac-fd0413772758", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1493924857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1493924857-network", "vif_mac": "fa:16:3e:f3:a2:9e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3fe48a3b7d846a195f1e47cc7f69695", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap556d7c96-2d", "ovs_interfaceid": "556d7c96-2d40-43fc-83fe-2059479a5265", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:01:14 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-4726d4e0-7ba7-443b-8b86-33cc57264b7d tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f3:a2:9e,bridge_name='br-int',has_traffic_filtering=True,id=556d7c96-2d40-43fc-83fe-2059479a5265,network=Network(06fae0be-02dd-4962-a1ac-fd0413772758),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap556d7c96-2d') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:01:14 user nova-compute[71874]: DEBUG nova.objects.instance [None req-4726d4e0-7ba7-443b-8b86-33cc57264b7d tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lazy-loading 'pci_devices' on Instance uuid 473a30c4-5aa4-481c-8859-fda815d14872 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:01:14 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-4726d4e0-7ba7-443b-8b86-33cc57264b7d tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: 473a30c4-5aa4-481c-8859-fda815d14872] End _get_guest_xml xml=<domain type="kvm">
Apr 12 16:01:14 user nova-compute[71874]:   <uuid>473a30c4-5aa4-481c-8859-fda815d14872</uuid>
Apr 12 16:01:14 user nova-compute[71874]:   <name>instance-00000002</name>
Apr 12 16:01:14 user nova-compute[71874]:   <memory>131072</memory>
Apr 12 16:01:14 user nova-compute[71874]:   <vcpu>1</vcpu>
Apr 12 16:01:14 user nova-compute[71874]:   <metadata>
Apr 12 16:01:14 user nova-compute[71874]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 16:01:14 user nova-compute[71874]:       <nova:package version="0.0.0"/>
Apr 12 16:01:14 user nova-compute[71874]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-908306689</nova:name>
Apr 12 16:01:14 user nova-compute[71874]:       <nova:creationTime>2023-04-12 16:01:14</nova:creationTime>
Apr 12 16:01:14 user nova-compute[71874]:       <nova:flavor name="m1.nano">
Apr 12 16:01:14 user nova-compute[71874]:         <nova:memory>128</nova:memory>
Apr 12 16:01:14 user nova-compute[71874]:         <nova:disk>1</nova:disk>
Apr 12 16:01:14 user nova-compute[71874]:         <nova:swap>0</nova:swap>
Apr 12 16:01:14 user nova-compute[71874]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 16:01:14 user nova-compute[71874]:         <nova:vcpus>1</nova:vcpus>
Apr 12 16:01:14 user nova-compute[71874]:       </nova:flavor>
Apr 12 16:01:14 user nova-compute[71874]:       <nova:owner>
Apr 12 16:01:14 user nova-compute[71874]:         <nova:user uuid="880266e3fa4d4dd889648c10208a1f8e">tempest-ServerRescueNegativeTestJSON-984710343-project-member</nova:user>
Apr 12 16:01:14 user nova-compute[71874]:         <nova:project uuid="b3fe48a3b7d846a195f1e47cc7f69695">tempest-ServerRescueNegativeTestJSON-984710343</nova:project>
Apr 12 16:01:14 user nova-compute[71874]:       </nova:owner>
Apr 12 16:01:14 user nova-compute[71874]:       <nova:root type="image" uuid="9dc63f14-8b70-4e72-89f2-13464f2f5c7c"/>
Apr 12 16:01:14 user nova-compute[71874]:       <nova:ports>
Apr 12 16:01:14 user nova-compute[71874]:         <nova:port uuid="556d7c96-2d40-43fc-83fe-2059479a5265">
Apr 12 16:01:14 user nova-compute[71874]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 12 16:01:14 user nova-compute[71874]:         </nova:port>
Apr 12 16:01:14 user nova-compute[71874]:       </nova:ports>
Apr 12 16:01:14 user nova-compute[71874]:     </nova:instance>
Apr 12 16:01:14 user nova-compute[71874]:   </metadata>
Apr 12 16:01:14 user nova-compute[71874]:   <sysinfo type="smbios">
Apr 12 16:01:14 user nova-compute[71874]:     <system>
Apr 12 16:01:14 user nova-compute[71874]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 16:01:14 user nova-compute[71874]:       <entry name="product">OpenStack Nova</entry>
Apr 12 16:01:14 user nova-compute[71874]:       <entry name="version">0.0.0</entry>
Apr 12 16:01:14 user nova-compute[71874]:       <entry name="serial">473a30c4-5aa4-481c-8859-fda815d14872</entry>
Apr 12 16:01:14 user nova-compute[71874]:       <entry name="uuid">473a30c4-5aa4-481c-8859-fda815d14872</entry>
Apr 12 16:01:14 user nova-compute[71874]:       <entry name="family">Virtual Machine</entry>
Apr 12 16:01:14 user nova-compute[71874]:     </system>
Apr 12 16:01:14 user nova-compute[71874]:   </sysinfo>
Apr 12 16:01:14 user nova-compute[71874]:   <os>
Apr 12 16:01:14 user nova-compute[71874]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 16:01:14 user nova-compute[71874]:     <smbios mode="sysinfo"/>
Apr 12 16:01:14 user nova-compute[71874]:   </os>
Apr 12 16:01:14 user nova-compute[71874]:   <features>
Apr 12 16:01:14 user nova-compute[71874]:     <acpi/>
Apr 12 16:01:14 user nova-compute[71874]:     <apic/>
Apr 12 16:01:14 user nova-compute[71874]:     <vmcoreinfo/>
Apr 12 16:01:14 user nova-compute[71874]:   </features>
Apr 12 16:01:14 user nova-compute[71874]:   <clock offset="utc">
Apr 12 16:01:14 user nova-compute[71874]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 16:01:14 user nova-compute[71874]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 16:01:14 user nova-compute[71874]:     <timer name="hpet" present="no"/>
Apr 12 16:01:14 user nova-compute[71874]:   </clock>
Apr 12 16:01:14 user nova-compute[71874]:   <cpu mode="custom" match="exact">
Apr 12 16:01:14 user nova-compute[71874]:     <model>Nehalem</model>
Apr 12 16:01:14 user nova-compute[71874]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 16:01:14 user nova-compute[71874]:   </cpu>
Apr 12 16:01:14 user nova-compute[71874]:   <devices>
Apr 12 16:01:14 user nova-compute[71874]:     <disk type="file" device="disk">
Apr 12 16:01:14 user nova-compute[71874]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 16:01:14 user nova-compute[71874]:       <source file="/opt/stack/data/nova/instances/473a30c4-5aa4-481c-8859-fda815d14872/disk.rescue"/>
Apr 12 16:01:14 user nova-compute[71874]:       <target dev="vda" bus="virtio"/>
Apr 12 16:01:14 user nova-compute[71874]:     </disk>
Apr 12 16:01:14 user nova-compute[71874]:     <disk type="file" device="disk">
Apr 12 16:01:14 user nova-compute[71874]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 16:01:14 user nova-compute[71874]:       <source file="/opt/stack/data/nova/instances/473a30c4-5aa4-481c-8859-fda815d14872/disk"/>
Apr 12 16:01:14 user nova-compute[71874]:       <target dev="vdb" bus="virtio"/>
Apr 12 16:01:14 user nova-compute[71874]:     </disk>
Apr 12 16:01:14 user nova-compute[71874]:     <interface type="ethernet">
Apr 12 16:01:14 user nova-compute[71874]:       <mac address="fa:16:3e:f3:a2:9e"/>
Apr 12 16:01:14 user nova-compute[71874]:       <model type="virtio"/>
Apr 12 16:01:14 user nova-compute[71874]:       <mtu size="1442"/>
Apr 12 16:01:14 user nova-compute[71874]:       <target dev="tap556d7c96-2d"/>
Apr 12 16:01:14 user nova-compute[71874]:     </interface>
Apr 12 16:01:14 user nova-compute[71874]:     <serial type="pty">
Apr 12 16:01:14 user nova-compute[71874]:       <log file="/opt/stack/data/nova/instances/473a30c4-5aa4-481c-8859-fda815d14872/console.log" append="off"/>
Apr 12 16:01:14 user nova-compute[71874]:     </serial>
Apr 12 16:01:14 user nova-compute[71874]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 16:01:14 user nova-compute[71874]:     <video>
Apr 12 16:01:14 user nova-compute[71874]:       <model type="virtio"/>
Apr 12 16:01:14 user nova-compute[71874]:     </video>
Apr 12 16:01:14 user nova-compute[71874]:     <rng model="virtio">
Apr 12 16:01:14 user nova-compute[71874]:       <backend model="random">/dev/urandom</backend>
Apr 12 16:01:14 user nova-compute[71874]:     </rng>
Apr 12 16:01:14 user nova-compute[71874]:     <controller type="usb" index="0" model="none"/>
Apr 12 16:01:14 user nova-compute[71874]:     <memballoon model="virtio">
Apr 12 16:01:14 user nova-compute[71874]:       <stats period="10"/>
Apr 12 16:01:14 user nova-compute[71874]:     </memballoon>
Apr 12 16:01:14 user nova-compute[71874]:   </devices>
Apr 12 16:01:14 user nova-compute[71874]: </domain>
Apr 12 16:01:14 user nova-compute[71874]:  {{(pid=71874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 16:01:14 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-6f6c6da5-ca3f-49d4-9bbc-9385672c0913 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 608fbea2-b42b-4bb9-94a7-2b76dcdc2001] Beginning live snapshot process
Apr 12 16:01:14 user nova-compute[71874]: INFO nova.virt.libvirt.driver [-] [instance: 473a30c4-5aa4-481c-8859-fda815d14872] Instance destroyed successfully.
Apr 12 16:01:14 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-4726d4e0-7ba7-443b-8b86-33cc57264b7d tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] No BDM found with device name vda, not building metadata. {{(pid=71874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 16:01:14 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-4726d4e0-7ba7-443b-8b86-33cc57264b7d tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 16:01:14 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-4726d4e0-7ba7-443b-8b86-33cc57264b7d tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] No VIF found with MAC fa:16:3e:f3:a2:9e, not building metadata {{(pid=71874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 16:01:14 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-6f6c6da5-ca3f-49d4-9bbc-9385672c0913 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/608fbea2-b42b-4bb9-94a7-2b76dcdc2001/disk --force-share --output=json -f qcow2 {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:01:14 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-6f6c6da5-ca3f-49d4-9bbc-9385672c0913 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/608fbea2-b42b-4bb9-94a7-2b76dcdc2001/disk --force-share --output=json -f qcow2" returned: 0 in 0.137s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:01:14 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-6f6c6da5-ca3f-49d4-9bbc-9385672c0913 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/608fbea2-b42b-4bb9-94a7-2b76dcdc2001/disk --force-share --output=json -f qcow2 {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:01:14 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-6f6c6da5-ca3f-49d4-9bbc-9385672c0913 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/608fbea2-b42b-4bb9-94a7-2b76dcdc2001/disk --force-share --output=json -f qcow2" returned: 0 in 0.134s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:01:14 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-6f6c6da5-ca3f-49d4-9bbc-9385672c0913 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:01:15 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-6f6c6da5-ca3f-49d4-9bbc-9385672c0913 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json" returned: 0 in 0.128s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:01:15 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-6f6c6da5-ca3f-49d4-9bbc-9385672c0913 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpmxkaod0x/85ecbb41647d48e48616e2ed9a6a0d4c.delta 1073741824 {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:01:15 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-6f6c6da5-ca3f-49d4-9bbc-9385672c0913 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpmxkaod0x/85ecbb41647d48e48616e2ed9a6a0d4c.delta 1073741824" returned: 0 in 0.050s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:01:15 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-6f6c6da5-ca3f-49d4-9bbc-9385672c0913 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 608fbea2-b42b-4bb9-94a7-2b76dcdc2001] Quiescing instance not available: QEMU guest agent is not enabled.
Apr 12 16:01:15 user nova-compute[71874]: DEBUG nova.virt.libvirt.host [None req-6f6c6da5-ca3f-49d4-9bbc-9385672c0913 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Checking UEFI support for host arch (x86_64) {{(pid=71874) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1722}}
Apr 12 16:01:15 user nova-compute[71874]: INFO nova.virt.libvirt.host [None req-6f6c6da5-ca3f-49d4-9bbc-9385672c0913 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] UEFI support detected
Apr 12 16:01:15 user nova-compute[71874]: DEBUG nova.compute.manager [req-9ffccfa2-17f2-4f19-9dff-6433b6c8d120 req-e1dfe9b9-9b59-4d04-8ab4-91016fb39bda service nova] [instance: 473a30c4-5aa4-481c-8859-fda815d14872] Received event network-vif-plugged-556d7c96-2d40-43fc-83fe-2059479a5265 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:01:15 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-9ffccfa2-17f2-4f19-9dff-6433b6c8d120 req-e1dfe9b9-9b59-4d04-8ab4-91016fb39bda service nova] Acquiring lock "473a30c4-5aa4-481c-8859-fda815d14872-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:01:15 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-9ffccfa2-17f2-4f19-9dff-6433b6c8d120 req-e1dfe9b9-9b59-4d04-8ab4-91016fb39bda service nova] Lock "473a30c4-5aa4-481c-8859-fda815d14872-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:01:15 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-9ffccfa2-17f2-4f19-9dff-6433b6c8d120 req-e1dfe9b9-9b59-4d04-8ab4-91016fb39bda service nova] Lock "473a30c4-5aa4-481c-8859-fda815d14872-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:01:15 user nova-compute[71874]: DEBUG nova.compute.manager [req-9ffccfa2-17f2-4f19-9dff-6433b6c8d120 req-e1dfe9b9-9b59-4d04-8ab4-91016fb39bda service nova] [instance: 473a30c4-5aa4-481c-8859-fda815d14872] No waiting events found dispatching network-vif-plugged-556d7c96-2d40-43fc-83fe-2059479a5265 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:01:15 user nova-compute[71874]: WARNING nova.compute.manager [req-9ffccfa2-17f2-4f19-9dff-6433b6c8d120 req-e1dfe9b9-9b59-4d04-8ab4-91016fb39bda service nova] [instance: 473a30c4-5aa4-481c-8859-fda815d14872] Received unexpected event network-vif-plugged-556d7c96-2d40-43fc-83fe-2059479a5265 for instance with vm_state active and task_state rescuing.
Apr 12 16:01:16 user nova-compute[71874]: DEBUG nova.virt.libvirt.guest [None req-6f6c6da5-ca3f-49d4-9bbc-9385672c0913 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] COPY block job progress, current cursor: 0 final cursor: 43778048 {{(pid=71874) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 16:01:16 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:01:16 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:01:16 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:01:16 user nova-compute[71874]: DEBUG nova.virt.libvirt.guest [None req-6f6c6da5-ca3f-49d4-9bbc-9385672c0913 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] COPY block job progress, current cursor: 43778048 final cursor: 43778048 {{(pid=71874) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 16:01:16 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-6f6c6da5-ca3f-49d4-9bbc-9385672c0913 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 608fbea2-b42b-4bb9-94a7-2b76dcdc2001] Skipping quiescing instance: QEMU guest agent is not enabled.
Apr 12 16:01:16 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:01:16 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:01:16 user nova-compute[71874]: DEBUG nova.privsep.utils [None req-6f6c6da5-ca3f-49d4-9bbc-9385672c0913 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71874) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 12 16:01:16 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-6f6c6da5-ca3f-49d4-9bbc-9385672c0913 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpmxkaod0x/85ecbb41647d48e48616e2ed9a6a0d4c.delta /opt/stack/data/nova/instances/snapshots/tmpmxkaod0x/85ecbb41647d48e48616e2ed9a6a0d4c {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:01:17 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:01:17 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-6f6c6da5-ca3f-49d4-9bbc-9385672c0913 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpmxkaod0x/85ecbb41647d48e48616e2ed9a6a0d4c.delta /opt/stack/data/nova/instances/snapshots/tmpmxkaod0x/85ecbb41647d48e48616e2ed9a6a0d4c" returned: 0 in 0.763s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:01:17 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-6f6c6da5-ca3f-49d4-9bbc-9385672c0913 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 608fbea2-b42b-4bb9-94a7-2b76dcdc2001] Snapshot extracted, beginning image upload
Apr 12 16:01:17 user nova-compute[71874]: DEBUG nova.compute.manager [req-4c0bedbf-4971-458e-b19e-a70fe20eb270 req-87460ba8-4be6-463d-aa0c-a47e41c5fa0e service nova] [instance: 473a30c4-5aa4-481c-8859-fda815d14872] Received event network-vif-plugged-556d7c96-2d40-43fc-83fe-2059479a5265 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:01:17 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-4c0bedbf-4971-458e-b19e-a70fe20eb270 req-87460ba8-4be6-463d-aa0c-a47e41c5fa0e service nova] Acquiring lock "473a30c4-5aa4-481c-8859-fda815d14872-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:01:17 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-4c0bedbf-4971-458e-b19e-a70fe20eb270 req-87460ba8-4be6-463d-aa0c-a47e41c5fa0e service nova] Lock "473a30c4-5aa4-481c-8859-fda815d14872-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:01:17 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-4c0bedbf-4971-458e-b19e-a70fe20eb270 req-87460ba8-4be6-463d-aa0c-a47e41c5fa0e service nova] Lock "473a30c4-5aa4-481c-8859-fda815d14872-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:01:17 user nova-compute[71874]: DEBUG nova.compute.manager [req-4c0bedbf-4971-458e-b19e-a70fe20eb270 req-87460ba8-4be6-463d-aa0c-a47e41c5fa0e service nova] [instance: 473a30c4-5aa4-481c-8859-fda815d14872] No waiting events found dispatching network-vif-plugged-556d7c96-2d40-43fc-83fe-2059479a5265 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:01:17 user nova-compute[71874]: WARNING nova.compute.manager [req-4c0bedbf-4971-458e-b19e-a70fe20eb270 req-87460ba8-4be6-463d-aa0c-a47e41c5fa0e service nova] [instance: 473a30c4-5aa4-481c-8859-fda815d14872] Received unexpected event network-vif-plugged-556d7c96-2d40-43fc-83fe-2059479a5265 for instance with vm_state active and task_state rescuing.
Apr 12 16:01:17 user nova-compute[71874]: DEBUG nova.compute.manager [req-4c0bedbf-4971-458e-b19e-a70fe20eb270 req-87460ba8-4be6-463d-aa0c-a47e41c5fa0e service nova] [instance: 473a30c4-5aa4-481c-8859-fda815d14872] Received event network-vif-plugged-556d7c96-2d40-43fc-83fe-2059479a5265 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:01:17 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-4c0bedbf-4971-458e-b19e-a70fe20eb270 req-87460ba8-4be6-463d-aa0c-a47e41c5fa0e service nova] Acquiring lock "473a30c4-5aa4-481c-8859-fda815d14872-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:01:17 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-4c0bedbf-4971-458e-b19e-a70fe20eb270 req-87460ba8-4be6-463d-aa0c-a47e41c5fa0e service nova] Lock "473a30c4-5aa4-481c-8859-fda815d14872-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:01:17 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-4c0bedbf-4971-458e-b19e-a70fe20eb270 req-87460ba8-4be6-463d-aa0c-a47e41c5fa0e service nova] Lock "473a30c4-5aa4-481c-8859-fda815d14872-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:01:17 user nova-compute[71874]: DEBUG nova.compute.manager [req-4c0bedbf-4971-458e-b19e-a70fe20eb270 req-87460ba8-4be6-463d-aa0c-a47e41c5fa0e service nova] [instance: 473a30c4-5aa4-481c-8859-fda815d14872] No waiting events found dispatching network-vif-plugged-556d7c96-2d40-43fc-83fe-2059479a5265 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:01:17 user nova-compute[71874]: WARNING nova.compute.manager [req-4c0bedbf-4971-458e-b19e-a70fe20eb270 req-87460ba8-4be6-463d-aa0c-a47e41c5fa0e service nova] [instance: 473a30c4-5aa4-481c-8859-fda815d14872] Received unexpected event network-vif-plugged-556d7c96-2d40-43fc-83fe-2059479a5265 for instance with vm_state active and task_state rescuing.
Apr 12 16:01:17 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:01:18 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:01:18 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:01:18 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:01:18 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Starting heal instance info cache {{(pid=71874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 16:01:18 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquiring lock "refresh_cache-473a30c4-5aa4-481c-8859-fda815d14872" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:01:18 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquired lock "refresh_cache-473a30c4-5aa4-481c-8859-fda815d14872" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:01:18 user nova-compute[71874]: DEBUG nova.network.neutron [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] [instance: 473a30c4-5aa4-481c-8859-fda815d14872] Forcefully refreshing network info cache for instance {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 16:01:18 user nova-compute[71874]: DEBUG nova.virt.libvirt.host [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Removed pending event for 473a30c4-5aa4-481c-8859-fda815d14872 due to event {{(pid=71874) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 12 16:01:18 user nova-compute[71874]: DEBUG nova.virt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Emitting event <LifecycleEvent: 1681315278.8574777, 473a30c4-5aa4-481c-8859-fda815d14872 => Resumed> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:01:18 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 473a30c4-5aa4-481c-8859-fda815d14872] VM Resumed (Lifecycle Event)
Apr 12 16:01:18 user nova-compute[71874]: DEBUG nova.compute.manager [None req-4726d4e0-7ba7-443b-8b86-33cc57264b7d tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: 473a30c4-5aa4-481c-8859-fda815d14872] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:01:18 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 473a30c4-5aa4-481c-8859-fda815d14872] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:01:18 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 473a30c4-5aa4-481c-8859-fda815d14872] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 16:01:19 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 473a30c4-5aa4-481c-8859-fda815d14872] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 12 16:01:19 user nova-compute[71874]: DEBUG nova.virt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Emitting event <LifecycleEvent: 1681315278.8596716, 473a30c4-5aa4-481c-8859-fda815d14872 => Started> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:01:19 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 473a30c4-5aa4-481c-8859-fda815d14872] VM Started (Lifecycle Event)
Apr 12 16:01:19 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 473a30c4-5aa4-481c-8859-fda815d14872] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:01:19 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 473a30c4-5aa4-481c-8859-fda815d14872] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 16:01:19 user nova-compute[71874]: DEBUG nova.network.neutron [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] [instance: 473a30c4-5aa4-481c-8859-fda815d14872] Updating instance_info_cache with network_info: [{"id": "556d7c96-2d40-43fc-83fe-2059479a5265", "address": "fa:16:3e:f3:a2:9e", "network": {"id": "06fae0be-02dd-4962-a1ac-fd0413772758", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1493924857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3fe48a3b7d846a195f1e47cc7f69695", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap556d7c96-2d", "ovs_interfaceid": "556d7c96-2d40-43fc-83fe-2059479a5265", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:01:19 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Releasing lock "refresh_cache-473a30c4-5aa4-481c-8859-fda815d14872" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:01:19 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] [instance: 473a30c4-5aa4-481c-8859-fda815d14872] Updated the network info_cache for instance {{(pid=71874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 16:01:19 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:01:19 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:01:19 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:01:19 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:01:19 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:01:19 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:01:19 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71874) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 16:01:19 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:01:19 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:01:19 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:01:19 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:01:19 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Auditing locally available compute resources for user (node: user) {{(pid=71874) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 16:01:19 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc19fd8d-3285-4ceb-8714-a0ba139f3045/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:01:19 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc19fd8d-3285-4ceb-8714-a0ba139f3045/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:01:19 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc19fd8d-3285-4ceb-8714-a0ba139f3045/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:01:19 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc19fd8d-3285-4ceb-8714-a0ba139f3045/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:01:19 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 16:01:19 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 16:01:19 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=71874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 16:01:19 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abbb6742-17d0-46b3-87ba-c14abc06738f/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:01:19 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abbb6742-17d0-46b3-87ba-c14abc06738f/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:01:20 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abbb6742-17d0-46b3-87ba-c14abc06738f/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:01:20 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-6f6c6da5-ca3f-49d4-9bbc-9385672c0913 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 608fbea2-b42b-4bb9-94a7-2b76dcdc2001] Snapshot image upload complete
Apr 12 16:01:20 user nova-compute[71874]: INFO nova.compute.manager [None req-6f6c6da5-ca3f-49d4-9bbc-9385672c0913 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 608fbea2-b42b-4bb9-94a7-2b76dcdc2001] Took 5.83 seconds to snapshot the instance on the hypervisor.
Apr 12 16:01:20 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abbb6742-17d0-46b3-87ba-c14abc06738f/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:01:20 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afebffae-dbf6-4876-8c9f-0364f0fde49c/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:01:20 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afebffae-dbf6-4876-8c9f-0364f0fde49c/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:01:20 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afebffae-dbf6-4876-8c9f-0364f0fde49c/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:01:20 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afebffae-dbf6-4876-8c9f-0364f0fde49c/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:01:20 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=71874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 16:01:20 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=71874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 16:01:20 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] skipping disk /dev/sdh (vdc) as it is a volume {{(pid=71874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 16:01:20 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/608fbea2-b42b-4bb9-94a7-2b76dcdc2001/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:01:20 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/608fbea2-b42b-4bb9-94a7-2b76dcdc2001/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:01:20 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/608fbea2-b42b-4bb9-94a7-2b76dcdc2001/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:01:20 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/608fbea2-b42b-4bb9-94a7-2b76dcdc2001/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:01:20 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55aff314-eb5e-4752-af9f-a4021e970cac/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:01:20 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55aff314-eb5e-4752-af9f-a4021e970cac/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:01:20 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55aff314-eb5e-4752-af9f-a4021e970cac/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:01:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55aff314-eb5e-4752-af9f-a4021e970cac/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:01:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/920c6512-180d-46e1-b0cf-240d34c3fc97/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:01:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/920c6512-180d-46e1-b0cf-240d34c3fc97/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:01:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/920c6512-180d-46e1-b0cf-240d34c3fc97/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:01:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/920c6512-180d-46e1-b0cf-240d34c3fc97/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:01:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473a30c4-5aa4-481c-8859-fda815d14872/disk.rescue --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:01:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473a30c4-5aa4-481c-8859-fda815d14872/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:01:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473a30c4-5aa4-481c-8859-fda815d14872/disk.rescue --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:01:21 user nova-compute[71874]: DEBUG nova.compute.manager [req-dd713f13-0a36-4b2d-8d01-e813a2aa1a6b req-7ada7767-b9fd-4aeb-9d89-88d3308eb2e9 service nova] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Received event network-changed-18196ae0-d9c1-4814-8803-c4ba8ad4ab45 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:01:21 user nova-compute[71874]: DEBUG nova.compute.manager [req-dd713f13-0a36-4b2d-8d01-e813a2aa1a6b req-7ada7767-b9fd-4aeb-9d89-88d3308eb2e9 service nova] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Refreshing instance network info cache due to event network-changed-18196ae0-d9c1-4814-8803-c4ba8ad4ab45. {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 16:01:21 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-dd713f13-0a36-4b2d-8d01-e813a2aa1a6b req-7ada7767-b9fd-4aeb-9d89-88d3308eb2e9 service nova] Acquiring lock "refresh_cache-dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:01:21 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-dd713f13-0a36-4b2d-8d01-e813a2aa1a6b req-7ada7767-b9fd-4aeb-9d89-88d3308eb2e9 service nova] Acquired lock "refresh_cache-dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:01:21 user nova-compute[71874]: DEBUG nova.network.neutron [req-dd713f13-0a36-4b2d-8d01-e813a2aa1a6b req-7ada7767-b9fd-4aeb-9d89-88d3308eb2e9 service nova] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Refreshing network info cache for port 18196ae0-d9c1-4814-8803-c4ba8ad4ab45 {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 16:01:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473a30c4-5aa4-481c-8859-fda815d14872/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:01:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473a30c4-5aa4-481c-8859-fda815d14872/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:01:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473a30c4-5aa4-481c-8859-fda815d14872/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:01:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473a30c4-5aa4-481c-8859-fda815d14872/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:01:22 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473a30c4-5aa4-481c-8859-fda815d14872/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:01:22 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e85aa869-0d2a-40ff-9697-f979a6b110cb/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:01:22 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e85aa869-0d2a-40ff-9697-f979a6b110cb/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:01:22 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e85aa869-0d2a-40ff-9697-f979a6b110cb/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:01:22 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e85aa869-0d2a-40ff-9697-f979a6b110cb/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:01:22 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:01:22 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:01:22 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:01:22 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:01:22 user nova-compute[71874]: DEBUG nova.network.neutron [req-dd713f13-0a36-4b2d-8d01-e813a2aa1a6b req-7ada7767-b9fd-4aeb-9d89-88d3308eb2e9 service nova] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Updated VIF entry in instance network info cache for port 18196ae0-d9c1-4814-8803-c4ba8ad4ab45. {{(pid=71874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 16:01:22 user nova-compute[71874]: DEBUG nova.network.neutron [req-dd713f13-0a36-4b2d-8d01-e813a2aa1a6b req-7ada7767-b9fd-4aeb-9d89-88d3308eb2e9 service nova] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Updating instance_info_cache with network_info: [{"id": "18196ae0-d9c1-4814-8803-c4ba8ad4ab45", "address": "fa:16:3e:98:72:fa", "network": {"id": "e6694358-e361-4952-b859-93755c11721e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-667152893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97ea81bd1962466bbe552424973f71a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18196ae0-d9", "ovs_interfaceid": "18196ae0-d9c1-4814-8803-c4ba8ad4ab45", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:01:22 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-dd713f13-0a36-4b2d-8d01-e813a2aa1a6b req-7ada7767-b9fd-4aeb-9d89-88d3308eb2e9 service nova] Releasing lock "refresh_cache-dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:01:22 user nova-compute[71874]: DEBUG nova.compute.manager [req-a26d3bc3-f0b8-49eb-8e99-fd3c722e4797 req-9c9400d7-82f6-4cc5-99be-8712da5f56b7 service nova] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] Received event network-changed-12acc77d-6a56-426a-acda-16438c358c44 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:01:22 user nova-compute[71874]: DEBUG nova.compute.manager [req-a26d3bc3-f0b8-49eb-8e99-fd3c722e4797 req-9c9400d7-82f6-4cc5-99be-8712da5f56b7 service nova] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] Refreshing instance network info cache due to event network-changed-12acc77d-6a56-426a-acda-16438c358c44. {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 16:01:22 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-a26d3bc3-f0b8-49eb-8e99-fd3c722e4797 req-9c9400d7-82f6-4cc5-99be-8712da5f56b7 service nova] Acquiring lock "refresh_cache-fc19fd8d-3285-4ceb-8714-a0ba139f3045" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:01:22 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-a26d3bc3-f0b8-49eb-8e99-fd3c722e4797 req-9c9400d7-82f6-4cc5-99be-8712da5f56b7 service nova] Acquired lock "refresh_cache-fc19fd8d-3285-4ceb-8714-a0ba139f3045" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:01:22 user nova-compute[71874]: DEBUG nova.network.neutron [req-a26d3bc3-f0b8-49eb-8e99-fd3c722e4797 req-9c9400d7-82f6-4cc5-99be-8712da5f56b7 service nova] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] Refreshing network info cache for port 12acc77d-6a56-426a-acda-16438c358c44 {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 16:01:22 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:01:22 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 16:01:22 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6614f2c0-399b-43d2-86c9-5790c57575e9/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:01:22 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:01:22 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6614f2c0-399b-43d2-86c9-5790c57575e9/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:01:22 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6614f2c0-399b-43d2-86c9-5790c57575e9/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:01:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6614f2c0-399b-43d2-86c9-5790c57575e9/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:01:23 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:01:23 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:01:23 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Hypervisor/Node resource view: name=user free_ram=7042MB free_disk=26.267555236816406GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71874) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 16:01:23 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:01:23 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:01:23 user nova-compute[71874]: DEBUG nova.network.neutron [req-a26d3bc3-f0b8-49eb-8e99-fd3c722e4797 req-9c9400d7-82f6-4cc5-99be-8712da5f56b7 service nova] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] Updated VIF entry in instance network info cache for port 12acc77d-6a56-426a-acda-16438c358c44. {{(pid=71874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 16:01:23 user nova-compute[71874]: DEBUG nova.network.neutron [req-a26d3bc3-f0b8-49eb-8e99-fd3c722e4797 req-9c9400d7-82f6-4cc5-99be-8712da5f56b7 service nova] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] Updating instance_info_cache with network_info: [{"id": "12acc77d-6a56-426a-acda-16438c358c44", "address": "fa:16:3e:9f:92:7f", "network": {"id": "eb4dd4b5-96d4-4b53-b510-d41e2775b92f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-596111273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fa122cbabe94c6f93c862b4daf31e50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12acc77d-6a", "ovs_interfaceid": "12acc77d-6a56-426a-acda-16438c358c44", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:01:23 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 9ea56377-20bc-48cc-a248-5fad6db060cb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:01:23 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 026ab036-1481-4689-af70-661493e9451c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:01:23 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance abbb6742-17d0-46b3-87ba-c14abc06738f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:01:23 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance fc19fd8d-3285-4ceb-8714-a0ba139f3045 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:01:23 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 920c6512-180d-46e1-b0cf-240d34c3fc97 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:01:23 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance e85aa869-0d2a-40ff-9697-f979a6b110cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:01:23 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 6614f2c0-399b-43d2-86c9-5790c57575e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:01:23 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 55aff314-eb5e-4752-af9f-a4021e970cac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:01:23 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 608fbea2-b42b-4bb9-94a7-2b76dcdc2001 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:01:23 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:01:23 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 85b91251-9735-4812-9f11-003a7951a6f3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:01:23 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 473a30c4-5aa4-481c-8859-fda815d14872 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:01:23 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance afebffae-dbf6-4876-8c9f-0364f0fde49c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:01:23 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=71874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 16:01:23 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Final resource view: name=user phys_ram=16023MB used_ram=2176MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=71874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 16:01:24 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-a26d3bc3-f0b8-49eb-8e99-fd3c722e4797 req-9c9400d7-82f6-4cc5-99be-8712da5f56b7 service nova] Releasing lock "refresh_cache-fc19fd8d-3285-4ceb-8714-a0ba139f3045" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:01:24 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Inventory has not changed in ProviderTree for provider: 0e94b4c8-cd49-45e4-9133-d36eb4b2456b {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 16:01:24 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Inventory has not changed for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 16:01:24 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Compute_service record updated for user:user {{(pid=71874) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 16:01:24 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.616s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:01:26 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-fb212069-492d-4005-ab77-4bc33d17c70c tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Acquiring lock "fc19fd8d-3285-4ceb-8714-a0ba139f3045" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:01:26 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-fb212069-492d-4005-ab77-4bc33d17c70c tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "fc19fd8d-3285-4ceb-8714-a0ba139f3045" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:01:26 user nova-compute[71874]: INFO nova.compute.manager [None req-fb212069-492d-4005-ab77-4bc33d17c70c tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] Shelving
Apr 12 16:01:26 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:01:26 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:01:26 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:01:26 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:01:27 user nova-compute[71874]: DEBUG nova.compute.manager [req-66cb3b4b-3b5a-40a5-afe1-2ac37efa16fe req-ce012a15-c0ce-454a-9b9d-3c54c5ecd2a5 service nova] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] Received event network-vif-unplugged-12acc77d-6a56-426a-acda-16438c358c44 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:01:27 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-66cb3b4b-3b5a-40a5-afe1-2ac37efa16fe req-ce012a15-c0ce-454a-9b9d-3c54c5ecd2a5 service nova] Acquiring lock "fc19fd8d-3285-4ceb-8714-a0ba139f3045-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:01:27 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-66cb3b4b-3b5a-40a5-afe1-2ac37efa16fe req-ce012a15-c0ce-454a-9b9d-3c54c5ecd2a5 service nova] Lock "fc19fd8d-3285-4ceb-8714-a0ba139f3045-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:01:27 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-66cb3b4b-3b5a-40a5-afe1-2ac37efa16fe req-ce012a15-c0ce-454a-9b9d-3c54c5ecd2a5 service nova] Lock "fc19fd8d-3285-4ceb-8714-a0ba139f3045-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:01:27 user nova-compute[71874]: DEBUG nova.compute.manager [req-66cb3b4b-3b5a-40a5-afe1-2ac37efa16fe req-ce012a15-c0ce-454a-9b9d-3c54c5ecd2a5 service nova] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] No waiting events found dispatching network-vif-unplugged-12acc77d-6a56-426a-acda-16438c358c44 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:01:27 user nova-compute[71874]: WARNING nova.compute.manager [req-66cb3b4b-3b5a-40a5-afe1-2ac37efa16fe req-ce012a15-c0ce-454a-9b9d-3c54c5ecd2a5 service nova] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] Received unexpected event network-vif-unplugged-12acc77d-6a56-426a-acda-16438c358c44 for instance with vm_state active and task_state shelving.
Apr 12 16:01:27 user nova-compute[71874]: INFO nova.virt.libvirt.driver [-] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] Instance destroyed successfully.
Apr 12 16:01:27 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-fb212069-492d-4005-ab77-4bc33d17c70c tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] Beginning cold snapshot process
Apr 12 16:01:27 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:01:27 user nova-compute[71874]: DEBUG nova.privsep.utils [None req-fb212069-492d-4005-ab77-4bc33d17c70c tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71874) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 12 16:01:27 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-fb212069-492d-4005-ab77-4bc33d17c70c tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/fc19fd8d-3285-4ceb-8714-a0ba139f3045/disk /opt/stack/data/nova/instances/snapshots/tmpl490_v7y/de39f2a72dc24e44a0fd06e3882e43a6 {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:01:27 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:01:27 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:01:28 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-fb212069-492d-4005-ab77-4bc33d17c70c tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/fc19fd8d-3285-4ceb-8714-a0ba139f3045/disk /opt/stack/data/nova/instances/snapshots/tmpl490_v7y/de39f2a72dc24e44a0fd06e3882e43a6" returned: 0 in 0.652s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:01:28 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-fb212069-492d-4005-ab77-4bc33d17c70c tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] Snapshot extracted, beginning image upload
Apr 12 16:01:29 user nova-compute[71874]: DEBUG nova.compute.manager [req-805fca58-bafa-4932-b657-50461bb4b027 req-ab80ee74-e33e-47f9-97f0-9f540cb42ddc service nova] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] Received event network-vif-plugged-12acc77d-6a56-426a-acda-16438c358c44 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:01:29 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-805fca58-bafa-4932-b657-50461bb4b027 req-ab80ee74-e33e-47f9-97f0-9f540cb42ddc service nova] Acquiring lock "fc19fd8d-3285-4ceb-8714-a0ba139f3045-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:01:29 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-805fca58-bafa-4932-b657-50461bb4b027 req-ab80ee74-e33e-47f9-97f0-9f540cb42ddc service nova] Lock "fc19fd8d-3285-4ceb-8714-a0ba139f3045-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:01:29 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-805fca58-bafa-4932-b657-50461bb4b027 req-ab80ee74-e33e-47f9-97f0-9f540cb42ddc service nova] Lock "fc19fd8d-3285-4ceb-8714-a0ba139f3045-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:01:29 user nova-compute[71874]: DEBUG nova.compute.manager [req-805fca58-bafa-4932-b657-50461bb4b027 req-ab80ee74-e33e-47f9-97f0-9f540cb42ddc service nova] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] No waiting events found dispatching network-vif-plugged-12acc77d-6a56-426a-acda-16438c358c44 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:01:29 user nova-compute[71874]: WARNING nova.compute.manager [req-805fca58-bafa-4932-b657-50461bb4b027 req-ab80ee74-e33e-47f9-97f0-9f540cb42ddc service nova] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] Received unexpected event network-vif-plugged-12acc77d-6a56-426a-acda-16438c358c44 for instance with vm_state active and task_state shelving_image_uploading.
Apr 12 16:01:30 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-fb212069-492d-4005-ab77-4bc33d17c70c tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] Snapshot image upload complete
Apr 12 16:01:30 user nova-compute[71874]: DEBUG nova.compute.manager [None req-fb212069-492d-4005-ab77-4bc33d17c70c tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:01:30 user nova-compute[71874]: INFO nova.compute.manager [None req-fb212069-492d-4005-ab77-4bc33d17c70c tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] Shelve offloading
Apr 12 16:01:30 user nova-compute[71874]: INFO nova.virt.libvirt.driver [-] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] Instance destroyed successfully.
Apr 12 16:01:30 user nova-compute[71874]: DEBUG nova.compute.manager [None req-fb212069-492d-4005-ab77-4bc33d17c70c tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:01:30 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-fb212069-492d-4005-ab77-4bc33d17c70c tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Acquiring lock "refresh_cache-fc19fd8d-3285-4ceb-8714-a0ba139f3045" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:01:30 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-fb212069-492d-4005-ab77-4bc33d17c70c tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Acquired lock "refresh_cache-fc19fd8d-3285-4ceb-8714-a0ba139f3045" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:01:30 user nova-compute[71874]: DEBUG nova.network.neutron [None req-fb212069-492d-4005-ab77-4bc33d17c70c tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] Building network info cache for instance {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 16:01:31 user nova-compute[71874]: DEBUG nova.compute.manager [req-74d581f5-0dd5-4576-bc1d-9e0dfdf367e5 req-c3738d45-5669-4812-ab19-6e760c35bdf2 service nova] [instance: 920c6512-180d-46e1-b0cf-240d34c3fc97] Received event network-changed-f0f2f7c4-d9e5-4b71-88d0-1f66e8d7a81e {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:01:31 user nova-compute[71874]: DEBUG nova.compute.manager [req-74d581f5-0dd5-4576-bc1d-9e0dfdf367e5 req-c3738d45-5669-4812-ab19-6e760c35bdf2 service nova] [instance: 920c6512-180d-46e1-b0cf-240d34c3fc97] Refreshing instance network info cache due to event network-changed-f0f2f7c4-d9e5-4b71-88d0-1f66e8d7a81e. {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 16:01:31 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-74d581f5-0dd5-4576-bc1d-9e0dfdf367e5 req-c3738d45-5669-4812-ab19-6e760c35bdf2 service nova] Acquiring lock "refresh_cache-920c6512-180d-46e1-b0cf-240d34c3fc97" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:01:31 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-74d581f5-0dd5-4576-bc1d-9e0dfdf367e5 req-c3738d45-5669-4812-ab19-6e760c35bdf2 service nova] Acquired lock "refresh_cache-920c6512-180d-46e1-b0cf-240d34c3fc97" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:01:31 user nova-compute[71874]: DEBUG nova.network.neutron [req-74d581f5-0dd5-4576-bc1d-9e0dfdf367e5 req-c3738d45-5669-4812-ab19-6e760c35bdf2 service nova] [instance: 920c6512-180d-46e1-b0cf-240d34c3fc97] Refreshing network info cache for port f0f2f7c4-d9e5-4b71-88d0-1f66e8d7a81e {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 16:01:31 user nova-compute[71874]: DEBUG nova.network.neutron [None req-fb212069-492d-4005-ab77-4bc33d17c70c tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] Updating instance_info_cache with network_info: [{"id": "12acc77d-6a56-426a-acda-16438c358c44", "address": "fa:16:3e:9f:92:7f", "network": {"id": "eb4dd4b5-96d4-4b53-b510-d41e2775b92f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-596111273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fa122cbabe94c6f93c862b4daf31e50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12acc77d-6a", "ovs_interfaceid": "12acc77d-6a56-426a-acda-16438c358c44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:01:31 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-fb212069-492d-4005-ab77-4bc33d17c70c tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Releasing lock "refresh_cache-fc19fd8d-3285-4ceb-8714-a0ba139f3045" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:01:32 user nova-compute[71874]: DEBUG nova.network.neutron [req-74d581f5-0dd5-4576-bc1d-9e0dfdf367e5 req-c3738d45-5669-4812-ab19-6e760c35bdf2 service nova] [instance: 920c6512-180d-46e1-b0cf-240d34c3fc97] Updated VIF entry in instance network info cache for port f0f2f7c4-d9e5-4b71-88d0-1f66e8d7a81e. {{(pid=71874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 16:01:32 user nova-compute[71874]: DEBUG nova.network.neutron [req-74d581f5-0dd5-4576-bc1d-9e0dfdf367e5 req-c3738d45-5669-4812-ab19-6e760c35bdf2 service nova] [instance: 920c6512-180d-46e1-b0cf-240d34c3fc97] Updating instance_info_cache with network_info: [{"id": "f0f2f7c4-d9e5-4b71-88d0-1f66e8d7a81e", "address": "fa:16:3e:5f:51:3d", "network": {"id": "e71b9966-9a95-4f66-b3b1-36b05d05853c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-310205564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28d940eae5394293b87cfced45911ab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0f2f7c4-d9", "ovs_interfaceid": "f0f2f7c4-d9e5-4b71-88d0-1f66e8d7a81e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:01:32 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-74d581f5-0dd5-4576-bc1d-9e0dfdf367e5 req-c3738d45-5669-4812-ab19-6e760c35bdf2 service nova] Releasing lock "refresh_cache-920c6512-180d-46e1-b0cf-240d34c3fc97" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:01:32 user nova-compute[71874]: INFO nova.virt.libvirt.driver [-] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] Instance destroyed successfully.
Apr 12 16:01:32 user nova-compute[71874]: DEBUG nova.objects.instance [None req-fb212069-492d-4005-ab77-4bc33d17c70c tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lazy-loading 'resources' on Instance uuid fc19fd8d-3285-4ceb-8714-a0ba139f3045 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:01:32 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-fb212069-492d-4005-ab77-4bc33d17c70c tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T15:59:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-791161427',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-791161427',id=5,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP/Xq604Ni9GyIbrWoJD7InG3g/r5BKu6klFR/hZ1bKdq3Hy1Mk7Pe+nAKjrfzX5p0VIQ/uMvcVFsrX06k2D5Iq1KlW5EZ6pMRc39ATodyZ/r0xBGzk9bUr1v/CNzPJ0EQ==',key_name='tempest-keypair-1362669684',keypairs=<?>,launch_index=0,launched_at=2023-04-12T15:59:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='1fa122cbabe94c6f93c862b4daf31e50',ramdisk_id='',reservation_id='r-z1kj5zi3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-292107264',owner_user_name='tempest-AttachVolumeShelveTestJSON-292107264-project-member',shelved_at='2023-04-12T16:01:30.562588',shelved_host='user',shelved_image_id='aea0d05c-bce2-4503-aeaf-6f9933e25a12'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T16:01:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c1abec24caf74dc8a27b64c21a9d4a59',uuid=fc19fd8d-3285-4ceb-8714-a0ba139f3045,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "12acc77d-6a56-426a-acda-16438c358c44", "address": "fa:16:3e:9f:92:7f", "network": {"id": "eb4dd4b5-96d4-4b53-b510-d41e2775b92f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-596111273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fa122cbabe94c6f93c862b4daf31e50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12acc77d-6a", "ovs_interfaceid": "12acc77d-6a56-426a-acda-16438c358c44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 16:01:32 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-fb212069-492d-4005-ab77-4bc33d17c70c tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Converting VIF {"id": "12acc77d-6a56-426a-acda-16438c358c44", "address": "fa:16:3e:9f:92:7f", "network": {"id": "eb4dd4b5-96d4-4b53-b510-d41e2775b92f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-596111273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fa122cbabe94c6f93c862b4daf31e50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12acc77d-6a", "ovs_interfaceid": "12acc77d-6a56-426a-acda-16438c358c44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:01:32 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-fb212069-492d-4005-ab77-4bc33d17c70c tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:92:7f,bridge_name='br-int',has_traffic_filtering=True,id=12acc77d-6a56-426a-acda-16438c358c44,network=Network(eb4dd4b5-96d4-4b53-b510-d41e2775b92f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12acc77d-6a') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:01:32 user nova-compute[71874]: DEBUG os_vif [None req-fb212069-492d-4005-ab77-4bc33d17c70c tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:92:7f,bridge_name='br-int',has_traffic_filtering=True,id=12acc77d-6a56-426a-acda-16438c358c44,network=Network(eb4dd4b5-96d4-4b53-b510-d41e2775b92f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12acc77d-6a') {{(pid=71874) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 16:01:32 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:01:32 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap12acc77d-6a, bridge=br-int, if_exists=True) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:01:32 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:01:32 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:01:32 user nova-compute[71874]: INFO os_vif [None req-fb212069-492d-4005-ab77-4bc33d17c70c tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:92:7f,bridge_name='br-int',has_traffic_filtering=True,id=12acc77d-6a56-426a-acda-16438c358c44,network=Network(eb4dd4b5-96d4-4b53-b510-d41e2775b92f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12acc77d-6a')
Apr 12 16:01:32 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-fb212069-492d-4005-ab77-4bc33d17c70c tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] Deleting instance files /opt/stack/data/nova/instances/fc19fd8d-3285-4ceb-8714-a0ba139f3045_del
Apr 12 16:01:32 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-fb212069-492d-4005-ab77-4bc33d17c70c tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] Deletion of /opt/stack/data/nova/instances/fc19fd8d-3285-4ceb-8714-a0ba139f3045_del complete
Apr 12 16:01:32 user nova-compute[71874]: INFO nova.scheduler.client.report [None req-fb212069-492d-4005-ab77-4bc33d17c70c tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Deleted allocations for instance fc19fd8d-3285-4ceb-8714-a0ba139f3045
Apr 12 16:01:32 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-fb212069-492d-4005-ab77-4bc33d17c70c tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:01:32 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-fb212069-492d-4005-ab77-4bc33d17c70c tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:01:32 user nova-compute[71874]: DEBUG nova.objects.instance [None req-fb212069-492d-4005-ab77-4bc33d17c70c tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lazy-loading 'numa_topology' on Instance uuid fc19fd8d-3285-4ceb-8714-a0ba139f3045 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:01:32 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:01:32 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-fb212069-492d-4005-ab77-4bc33d17c70c tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Inventory has not changed in ProviderTree for provider: 0e94b4c8-cd49-45e4-9133-d36eb4b2456b {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 16:01:32 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-fb212069-492d-4005-ab77-4bc33d17c70c tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Inventory has not changed for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 16:01:32 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-fb212069-492d-4005-ab77-4bc33d17c70c tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.425s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:01:32 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-fb212069-492d-4005-ab77-4bc33d17c70c tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "fc19fd8d-3285-4ceb-8714-a0ba139f3045" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.370s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:01:32 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-3afac93c-dc2a-45c5-93e7-4e8ffc453b7c tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "920c6512-180d-46e1-b0cf-240d34c3fc97" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:01:32 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-3afac93c-dc2a-45c5-93e7-4e8ffc453b7c tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "920c6512-180d-46e1-b0cf-240d34c3fc97" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:01:32 user nova-compute[71874]: DEBUG nova.objects.instance [None req-3afac93c-dc2a-45c5-93e7-4e8ffc453b7c tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lazy-loading 'flavor' on Instance uuid 920c6512-180d-46e1-b0cf-240d34c3fc97 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:01:33 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-3afac93c-dc2a-45c5-93e7-4e8ffc453b7c tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "920c6512-180d-46e1-b0cf-240d34c3fc97" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.084s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:01:33 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-3afac93c-dc2a-45c5-93e7-4e8ffc453b7c tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "920c6512-180d-46e1-b0cf-240d34c3fc97" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:01:33 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-3afac93c-dc2a-45c5-93e7-4e8ffc453b7c tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "920c6512-180d-46e1-b0cf-240d34c3fc97" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:01:33 user nova-compute[71874]: INFO nova.compute.manager [None req-3afac93c-dc2a-45c5-93e7-4e8ffc453b7c tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: 920c6512-180d-46e1-b0cf-240d34c3fc97] Attaching volume 8d4e6a19-342a-43eb-b9dc-9570b802fbe6 to /dev/vdb
Apr 12 16:01:33 user nova-compute[71874]: DEBUG os_brick.utils [None req-3afac93c-dc2a-45c5-93e7-4e8ffc453b7c tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:01:33 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:01:33 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:01:33 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[f57403b2-623d-47b0-b73a-21006c23da66]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:61a48d4489d2\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:01:33 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:01:33 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:01:33 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[b591f979-5ccb-402f-b664-df6e11b0e78b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:01:33 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:01:33 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:01:33 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[8311b5e5-a7e1-4f8b-a1a5-95e61421dacd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:01:33 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[a07c6dcf-bf80-472e-b32a-16fe2aa719b9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:01:33 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-3afac93c-dc2a-45c5-93e7-4e8ffc453b7c tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Running cmd (subprocess): nvme version {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:01:33 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-3afac93c-dc2a-45c5-93e7-4e8ffc453b7c tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] 'nvme version' failed. Not Retrying. {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 16:01:33 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3afac93c-dc2a-45c5-93e7-4e8ffc453b7c tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] nvme not present on system {{(pid=71874) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 16:01:33 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:01:33 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 16:01:33 user nova-compute[71874]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 16:01:33 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[049ce5b9-501d-48f1-a2dc-76d73219d8ef]: (4, '') {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:01:33 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.lightos [None req-3afac93c-dc2a-45c5-93e7-4e8ffc453b7c tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71874) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 16:01:33 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.lightos [None req-3afac93c-dc2a-45c5-93e7-4e8ffc453b7c tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71874) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 16:01:33 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.lightos [None req-3afac93c-dc2a-45c5-93e7-4e8ffc453b7c tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] LIGHTOS: no hostnqn found. {{(pid=71874) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 16:01:33 user nova-compute[71874]: DEBUG os_brick.utils [None req-3afac93c-dc2a-45c5-93e7-4e8ffc453b7c tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:61a48d4489d2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:01:33 user nova-compute[71874]: DEBUG nova.virt.block_device [None req-3afac93c-dc2a-45c5-93e7-4e8ffc453b7c tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: 920c6512-180d-46e1-b0cf-240d34c3fc97] Updating existing volume attachment record: 889ec1c2-49ef-44b9-b67e-0f090e034a12 {{(pid=71874) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 16:01:37 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:01:37 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:01:37 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3afac93c-dc2a-45c5-93e7-4e8ffc453b7c tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: 920c6512-180d-46e1-b0cf-240d34c3fc97] Calling os-brick to attach iSCSI Volume {{(pid=71874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 16:01:37 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-3afac93c-dc2a-45c5-93e7-4e8ffc453b7c tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3c0216320>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DfEKATti', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:01:37 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-3afac93c-dc2a-45c5-93e7-4e8ffc453b7c tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:01:37 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-3afac93c-dc2a-45c5-93e7-4e8ffc453b7c tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:01:37 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-3afac93c-dc2a-45c5-93e7-4e8ffc453b7c tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:01:37 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-3afac93c-dc2a-45c5-93e7-4e8ffc453b7c tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:01:37 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-3afac93c-dc2a-45c5-93e7-4e8ffc453b7c tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:01:37 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-3afac93c-dc2a-45c5-93e7-4e8ffc453b7c tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:01:37 user nova-compute[71874]: INFO os_brick.initiator.connectors.iscsi [None req-3afac93c-dc2a-45c5-93e7-4e8ffc453b7c tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 16:01:37 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6 -p 172.16.0.220:3260 {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:01:37 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:01:37 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcbdc9b1-28bc-4c92-a021-95211d23388c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:01:37 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-3afac93c-dc2a-45c5-93e7-4e8ffc453b7c tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 16:01:37 user nova-compute[71874]:  {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:01:37 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6 -p 172.16.0.220:3260 --interface default --op new {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:01:37 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:01:37 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb479784-dfbf-4f9a-b8b3-cafeaaea07a6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6] added\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:01:37 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-3afac93c-dc2a-45c5-93e7-4e8ffc453b7c tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6] added
Apr 12 16:01:37 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:01:37 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:01:37 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:01:37 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fbb65ef-8310-4bce-961d-82edfce8ed13]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:01:37 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-3afac93c-dc2a-45c5-93e7-4e8ffc453b7c tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:01:37 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:01:37 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:01:37 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b7204ac-39fe-4a5a-acef-6683c788c98f]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:01:37 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-3afac93c-dc2a-45c5-93e7-4e8ffc453b7c tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:01:37 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DfEKATti {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:01:37 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DfEKATti" returned: 0 in 0.022s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:01:37 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[4da14013-89ff-4b6b-8cfb-651f07ae50f2]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:01:37 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-3afac93c-dc2a-45c5-93e7-4e8ffc453b7c tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DfEKATti'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:01:37 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:01:37 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:01:37 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e120b71-997b-4aba-9193-6c9e0f372317]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:01:37 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-3afac93c-dc2a-45c5-93e7-4e8ffc453b7c tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:01:37 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:01:37 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:01:37 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef99c3d2-101a-4f28-8dc1-45389560b91e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fde1cb-bd86-48a5-8aca-463fdf3444b0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0100e6d-5149-423c-aadc-0c4f2635196b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:01:37 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-3afac93c-dc2a-45c5-93e7-4e8ffc453b7c tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 (non-flash)
Apr 12 16:01:37 user nova-compute[71874]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fde1cb-bd86-48a5-8aca-463fdf3444b0 (non-flash)
Apr 12 16:01:37 user nova-compute[71874]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4 (non-flash)
Apr 12 16:01:37 user nova-compute[71874]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0100e6d-5149-423c-aadc-0c4f2635196b (non-flash)
Apr 12 16:01:37 user nova-compute[71874]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4 (non-flash)
Apr 12 16:01:37 user nova-compute[71874]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b (non-flash)
Apr 12 16:01:37 user nova-compute[71874]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd (non-flash)
Apr 12 16:01:37 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:01:37 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-3afac93c-dc2a-45c5-93e7-4e8ffc453b7c tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 (non-flash)
Apr 12 16:01:37 user nova-compute[71874]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fde1cb-bd86-48a5-8aca-463fdf3444b0 (non-flash)
Apr 12 16:01:37 user nova-compute[71874]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4 (non-flash)
Apr 12 16:01:37 user nova-compute[71874]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0100e6d-5149-423c-aadc-0c4f2635196b (non-flash)
Apr 12 16:01:37 user nova-compute[71874]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4 (non-flash)
Apr 12 16:01:37 user nova-compute[71874]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b (non-flash)
Apr 12 16:01:37 user nova-compute[71874]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd (non-flash)
Apr 12 16:01:37 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:01:37 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6 -p 172.16.0.220:3260 --login {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:01:37 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6 -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:01:37 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[d89c6819-1460-4a30-8e75-95512c029af5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:01:37 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-3afac93c-dc2a-45c5-93e7-4e8ffc453b7c tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6, portal: 172.16.0.220,3260]
Apr 12 16:01:37 user nova-compute[71874]: Login to [iface: default, target: iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6, portal: 172.16.0.220,3260] successful.
Apr 12 16:01:37 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:01:37 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:01:37 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:01:37 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[6682d89a-6d4b-4737-a27a-2aa743196ff3]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:01:37 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-3afac93c-dc2a-45c5-93e7-4e8ffc453b7c tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:01:37 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:01:37 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:01:37 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[85c16091-910b-4458-ab3b-210e1bcf8c88]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fde1cb-bd86-48a5-8aca-463fdf3444b0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0100e6d-5149-423c-aadc-0c4f2635196b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6 (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:01:37 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-3afac93c-dc2a-45c5-93e7-4e8ffc453b7c tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 (non-flash)
Apr 12 16:01:37 user nova-compute[71874]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fde1cb-bd86-48a5-8aca-463fdf3444b0 (non-flash)
Apr 12 16:01:37 user nova-compute[71874]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4 (non-flash)
Apr 12 16:01:37 user nova-compute[71874]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0100e6d-5149-423c-aadc-0c4f2635196b (non-flash)
Apr 12 16:01:37 user nova-compute[71874]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4 (non-flash)
Apr 12 16:01:37 user nova-compute[71874]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b (non-flash)
Apr 12 16:01:37 user nova-compute[71874]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd (non-flash)
Apr 12 16:01:37 user nova-compute[71874]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6 (non-flash)
Apr 12 16:01:37 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:01:37 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-3afac93c-dc2a-45c5-93e7-4e8ffc453b7c tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 (non-flash)
Apr 12 16:01:37 user nova-compute[71874]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fde1cb-bd86-48a5-8aca-463fdf3444b0 (non-flash)
Apr 12 16:01:37 user nova-compute[71874]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4 (non-flash)
Apr 12 16:01:37 user nova-compute[71874]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0100e6d-5149-423c-aadc-0c4f2635196b (non-flash)
Apr 12 16:01:37 user nova-compute[71874]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4 (non-flash)
Apr 12 16:01:37 user nova-compute[71874]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b (non-flash)
Apr 12 16:01:37 user nova-compute[71874]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd (non-flash)
Apr 12 16:01:37 user nova-compute[71874]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6 (non-flash)
Apr 12 16:01:37 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:01:37 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-3afac93c-dc2a-45c5-93e7-4e8ffc453b7c tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.329s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:01:37 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-3afac93c-dc2a-45c5-93e7-4e8ffc453b7c tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Connected to 172.16.0.220:3260 {{(pid=71874) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 16:01:37 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-3afac93c-dc2a-45c5-93e7-4e8ffc453b7c tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] HCTL ('40', '-', '-', 0) found on session 9 with lun 0 {{(pid=71874) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 16:01:37 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-3afac93c-dc2a-45c5-93e7-4e8ffc453b7c tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=71874) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 16:01:37 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:01:37 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.016s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:01:37 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d70b9eb-ab48-40f4-9d15-633dc1844a1a]: (4, ('- - 0', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:01:37 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-3afac93c-dc2a-45c5-93e7-4e8ffc453b7c tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Searching for a device in session 9 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=71874) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 16:01:37 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-3afac93c-dc2a-45c5-93e7-4e8ffc453b7c tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DfEKATti', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71874) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 16:01:38 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-3afac93c-dc2a-45c5-93e7-4e8ffc453b7c tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.368s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:01:38 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-3afac93c-dc2a-45c5-93e7-4e8ffc453b7c tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] <== connect_volume: return (1369ms) {'type': 'block', 'scsi_wwn': '23539373331653165', 'path': '/dev/sdi'} {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:01:38 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3afac93c-dc2a-45c5-93e7-4e8ffc453b7c tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: 920c6512-180d-46e1-b0cf-240d34c3fc97] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23539373331653165', 'path': '/dev/sdi'} {{(pid=71874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 16:01:38 user nova-compute[71874]: DEBUG nova.objects.instance [None req-3afac93c-dc2a-45c5-93e7-4e8ffc453b7c tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lazy-loading 'flavor' on Instance uuid 920c6512-180d-46e1-b0cf-240d34c3fc97 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:01:38 user nova-compute[71874]: DEBUG nova.virt.libvirt.guest [None req-3afac93c-dc2a-45c5-93e7-4e8ffc453b7c tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 16:01:38 user nova-compute[71874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 16:01:38 user nova-compute[71874]:   <source dev="/dev/sdi"/>
Apr 12 16:01:38 user nova-compute[71874]:   <target dev="vdb" bus="virtio"/>
Apr 12 16:01:38 user nova-compute[71874]:   <serial>8d4e6a19-342a-43eb-b9dc-9570b802fbe6</serial>
Apr 12 16:01:38 user nova-compute[71874]: </disk>
Apr 12 16:01:38 user nova-compute[71874]:  {{(pid=71874) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 16:01:39 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-3afac93c-dc2a-45c5-93e7-4e8ffc453b7c tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] No BDM found with device name vda, not building metadata. {{(pid=71874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 16:01:39 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-3afac93c-dc2a-45c5-93e7-4e8ffc453b7c tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 16:01:39 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-3afac93c-dc2a-45c5-93e7-4e8ffc453b7c tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] No VIF found with MAC fa:16:3e:5f:51:3d, not building metadata {{(pid=71874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 16:01:39 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-3afac93c-dc2a-45c5-93e7-4e8ffc453b7c tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "920c6512-180d-46e1-b0cf-240d34c3fc97" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.289s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:01:42 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:01:42 user nova-compute[71874]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681315287.303028, fc19fd8d-3285-4ceb-8714-a0ba139f3045 => Stopped> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:01:42 user nova-compute[71874]: INFO nova.compute.manager [-] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] VM Stopped (Lifecycle Event)
Apr 12 16:01:42 user nova-compute[71874]: DEBUG nova.compute.manager [None req-a4e60538-8b9d-4fe4-b387-d70345e0546d None None] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:01:42 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-fb747c59-6845-4c51-8159-c728c40b97de tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "ad0cece6-9b26-4c87-9e48-2c0437cb9190" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:01:42 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-fb747c59-6845-4c51-8159-c728c40b97de tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "ad0cece6-9b26-4c87-9e48-2c0437cb9190" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:01:42 user nova-compute[71874]: DEBUG nova.compute.manager [None req-fb747c59-6845-4c51-8159-c728c40b97de tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: ad0cece6-9b26-4c87-9e48-2c0437cb9190] Starting instance... {{(pid=71874) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 16:01:42 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:01:42 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-fb747c59-6845-4c51-8159-c728c40b97de tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:01:42 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-fb747c59-6845-4c51-8159-c728c40b97de tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:01:42 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-fb747c59-6845-4c51-8159-c728c40b97de tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71874) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 16:01:42 user nova-compute[71874]: INFO nova.compute.claims [None req-fb747c59-6845-4c51-8159-c728c40b97de tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: ad0cece6-9b26-4c87-9e48-2c0437cb9190] Claim successful on node user
Apr 12 16:01:42 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-fb747c59-6845-4c51-8159-c728c40b97de tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Inventory has not changed in ProviderTree for provider: 0e94b4c8-cd49-45e4-9133-d36eb4b2456b {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 16:01:43 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-fb747c59-6845-4c51-8159-c728c40b97de tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Inventory has not changed for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 16:01:43 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-fb747c59-6845-4c51-8159-c728c40b97de tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.456s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:01:43 user nova-compute[71874]: DEBUG nova.compute.manager [None req-fb747c59-6845-4c51-8159-c728c40b97de tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: ad0cece6-9b26-4c87-9e48-2c0437cb9190] Start building networks asynchronously for instance. {{(pid=71874) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 16:01:43 user nova-compute[71874]: DEBUG nova.compute.manager [None req-fb747c59-6845-4c51-8159-c728c40b97de tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: ad0cece6-9b26-4c87-9e48-2c0437cb9190] Allocating IP information in the background. {{(pid=71874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 16:01:43 user nova-compute[71874]: DEBUG nova.network.neutron [None req-fb747c59-6845-4c51-8159-c728c40b97de tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: ad0cece6-9b26-4c87-9e48-2c0437cb9190] allocate_for_instance() {{(pid=71874) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 16:01:43 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-fb747c59-6845-4c51-8159-c728c40b97de tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: ad0cece6-9b26-4c87-9e48-2c0437cb9190] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 16:01:43 user nova-compute[71874]: DEBUG nova.compute.manager [None req-fb747c59-6845-4c51-8159-c728c40b97de tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: ad0cece6-9b26-4c87-9e48-2c0437cb9190] Start building block device mappings for instance. {{(pid=71874) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 16:01:43 user nova-compute[71874]: DEBUG nova.policy [None req-fb747c59-6845-4c51-8159-c728c40b97de tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5a514f6d877a4ab0bec597fee13ce9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d940eae5394293b87cfced45911ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71874) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 16:01:43 user nova-compute[71874]: DEBUG nova.compute.manager [None req-fb747c59-6845-4c51-8159-c728c40b97de tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: ad0cece6-9b26-4c87-9e48-2c0437cb9190] Start spawning the instance on the hypervisor. {{(pid=71874) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 16:01:43 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-fb747c59-6845-4c51-8159-c728c40b97de tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: ad0cece6-9b26-4c87-9e48-2c0437cb9190] Creating instance directory {{(pid=71874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 16:01:43 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-fb747c59-6845-4c51-8159-c728c40b97de tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: ad0cece6-9b26-4c87-9e48-2c0437cb9190] Creating image(s)
Apr 12 16:01:43 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-fb747c59-6845-4c51-8159-c728c40b97de tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "/opt/stack/data/nova/instances/ad0cece6-9b26-4c87-9e48-2c0437cb9190/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:01:43 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-fb747c59-6845-4c51-8159-c728c40b97de tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "/opt/stack/data/nova/instances/ad0cece6-9b26-4c87-9e48-2c0437cb9190/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:01:43 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-fb747c59-6845-4c51-8159-c728c40b97de tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "/opt/stack/data/nova/instances/ad0cece6-9b26-4c87-9e48-2c0437cb9190/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:01:43 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-fb747c59-6845-4c51-8159-c728c40b97de tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:01:43 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-fb747c59-6845-4c51-8159-c728c40b97de tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json" returned: 0 in 0.135s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:01:43 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-fb747c59-6845-4c51-8159-c728c40b97de tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "b88df1b37cb431f52bc53b5616015c89b5bec411" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:01:43 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-fb747c59-6845-4c51-8159-c728c40b97de tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "b88df1b37cb431f52bc53b5616015c89b5bec411" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:01:43 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-fb747c59-6845-4c51-8159-c728c40b97de tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:01:43 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-fb747c59-6845-4c51-8159-c728c40b97de tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json" returned: 0 in 0.135s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:01:43 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-fb747c59-6845-4c51-8159-c728c40b97de tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411,backing_fmt=raw /opt/stack/data/nova/instances/ad0cece6-9b26-4c87-9e48-2c0437cb9190/disk 1073741824 {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:01:43 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-fb747c59-6845-4c51-8159-c728c40b97de tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411,backing_fmt=raw /opt/stack/data/nova/instances/ad0cece6-9b26-4c87-9e48-2c0437cb9190/disk 1073741824" returned: 0 in 0.049s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:01:43 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-fb747c59-6845-4c51-8159-c728c40b97de tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "b88df1b37cb431f52bc53b5616015c89b5bec411" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.191s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:01:43 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-fb747c59-6845-4c51-8159-c728c40b97de tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:01:43 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-fb747c59-6845-4c51-8159-c728c40b97de tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json" returned: 0 in 0.138s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:01:43 user nova-compute[71874]: DEBUG nova.virt.disk.api [None req-fb747c59-6845-4c51-8159-c728c40b97de tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ad0cece6-9b26-4c87-9e48-2c0437cb9190/disk. size=1073741824 {{(pid=71874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 16:01:43 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-fb747c59-6845-4c51-8159-c728c40b97de tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad0cece6-9b26-4c87-9e48-2c0437cb9190/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:01:43 user nova-compute[71874]: DEBUG nova.network.neutron [None req-fb747c59-6845-4c51-8159-c728c40b97de tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: ad0cece6-9b26-4c87-9e48-2c0437cb9190] Successfully created port: b734d9d7-5bb7-4ca9-a637-9c335398dfc0 {{(pid=71874) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 16:01:43 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-fb747c59-6845-4c51-8159-c728c40b97de tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad0cece6-9b26-4c87-9e48-2c0437cb9190/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:01:43 user nova-compute[71874]: DEBUG nova.virt.disk.api [None req-fb747c59-6845-4c51-8159-c728c40b97de tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Cannot resize image /opt/stack/data/nova/instances/ad0cece6-9b26-4c87-9e48-2c0437cb9190/disk to a smaller size. {{(pid=71874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 16:01:43 user nova-compute[71874]: DEBUG nova.objects.instance [None req-fb747c59-6845-4c51-8159-c728c40b97de tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lazy-loading 'migration_context' on Instance uuid ad0cece6-9b26-4c87-9e48-2c0437cb9190 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:01:43 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-fb747c59-6845-4c51-8159-c728c40b97de tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: ad0cece6-9b26-4c87-9e48-2c0437cb9190] Created local disks {{(pid=71874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 16:01:43 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-fb747c59-6845-4c51-8159-c728c40b97de tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: ad0cece6-9b26-4c87-9e48-2c0437cb9190] Ensure instance console log exists: /opt/stack/data/nova/instances/ad0cece6-9b26-4c87-9e48-2c0437cb9190/console.log {{(pid=71874) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 16:01:43 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-fb747c59-6845-4c51-8159-c728c40b97de tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:01:43 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-fb747c59-6845-4c51-8159-c728c40b97de tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:01:43 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-fb747c59-6845-4c51-8159-c728c40b97de tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:01:44 user nova-compute[71874]: DEBUG nova.network.neutron [None req-fb747c59-6845-4c51-8159-c728c40b97de tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: ad0cece6-9b26-4c87-9e48-2c0437cb9190] Successfully updated port: b734d9d7-5bb7-4ca9-a637-9c335398dfc0 {{(pid=71874) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 16:01:44 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-fb747c59-6845-4c51-8159-c728c40b97de tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "refresh_cache-ad0cece6-9b26-4c87-9e48-2c0437cb9190" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:01:44 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-fb747c59-6845-4c51-8159-c728c40b97de tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquired lock "refresh_cache-ad0cece6-9b26-4c87-9e48-2c0437cb9190" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:01:44 user nova-compute[71874]: DEBUG nova.network.neutron [None req-fb747c59-6845-4c51-8159-c728c40b97de tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: ad0cece6-9b26-4c87-9e48-2c0437cb9190] Building network info cache for instance {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 16:01:44 user nova-compute[71874]: DEBUG nova.compute.manager [req-24355eed-a689-4792-ad12-02a065c48942 req-65ca2c03-07c2-4919-abea-b131c4f95e16 service nova] [instance: ad0cece6-9b26-4c87-9e48-2c0437cb9190] Received event network-changed-b734d9d7-5bb7-4ca9-a637-9c335398dfc0 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:01:44 user nova-compute[71874]: DEBUG nova.compute.manager [req-24355eed-a689-4792-ad12-02a065c48942 req-65ca2c03-07c2-4919-abea-b131c4f95e16 service nova] [instance: ad0cece6-9b26-4c87-9e48-2c0437cb9190] Refreshing instance network info cache due to event network-changed-b734d9d7-5bb7-4ca9-a637-9c335398dfc0. {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 16:01:44 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-24355eed-a689-4792-ad12-02a065c48942 req-65ca2c03-07c2-4919-abea-b131c4f95e16 service nova] Acquiring lock "refresh_cache-ad0cece6-9b26-4c87-9e48-2c0437cb9190" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:01:44 user nova-compute[71874]: DEBUG nova.network.neutron [None req-fb747c59-6845-4c51-8159-c728c40b97de tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: ad0cece6-9b26-4c87-9e48-2c0437cb9190] Instance cache missing network info. {{(pid=71874) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 16:01:44 user nova-compute[71874]: DEBUG nova.compute.manager [req-087b29f6-b999-408c-a678-7eee2f12f46a req-ada1ec32-f1fe-4796-b892-a460ac3c7637 service nova] [instance: 55aff314-eb5e-4752-af9f-a4021e970cac] Received event network-changed-4a51084d-9fff-4a53-9387-4542bfd6a4a7 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:01:44 user nova-compute[71874]: DEBUG nova.compute.manager [req-087b29f6-b999-408c-a678-7eee2f12f46a req-ada1ec32-f1fe-4796-b892-a460ac3c7637 service nova] [instance: 55aff314-eb5e-4752-af9f-a4021e970cac] Refreshing instance network info cache due to event network-changed-4a51084d-9fff-4a53-9387-4542bfd6a4a7. {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 16:01:44 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-087b29f6-b999-408c-a678-7eee2f12f46a req-ada1ec32-f1fe-4796-b892-a460ac3c7637 service nova] Acquiring lock "refresh_cache-55aff314-eb5e-4752-af9f-a4021e970cac" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:01:44 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-087b29f6-b999-408c-a678-7eee2f12f46a req-ada1ec32-f1fe-4796-b892-a460ac3c7637 service nova] Acquired lock "refresh_cache-55aff314-eb5e-4752-af9f-a4021e970cac" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:01:44 user nova-compute[71874]: DEBUG nova.network.neutron [req-087b29f6-b999-408c-a678-7eee2f12f46a req-ada1ec32-f1fe-4796-b892-a460ac3c7637 service nova] [instance: 55aff314-eb5e-4752-af9f-a4021e970cac] Refreshing network info cache for port 4a51084d-9fff-4a53-9387-4542bfd6a4a7 {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 16:01:44 user nova-compute[71874]: DEBUG nova.network.neutron [None req-fb747c59-6845-4c51-8159-c728c40b97de tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: ad0cece6-9b26-4c87-9e48-2c0437cb9190] Updating instance_info_cache with network_info: [{"id": "b734d9d7-5bb7-4ca9-a637-9c335398dfc0", "address": "fa:16:3e:b9:28:73", "network": {"id": "e71b9966-9a95-4f66-b3b1-36b05d05853c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-310205564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28d940eae5394293b87cfced45911ab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb734d9d7-5b", "ovs_interfaceid": "b734d9d7-5bb7-4ca9-a637-9c335398dfc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:01:44 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-fb747c59-6845-4c51-8159-c728c40b97de tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Releasing lock "refresh_cache-ad0cece6-9b26-4c87-9e48-2c0437cb9190" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:01:44 user nova-compute[71874]: DEBUG nova.compute.manager [None req-fb747c59-6845-4c51-8159-c728c40b97de tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: ad0cece6-9b26-4c87-9e48-2c0437cb9190] Instance network_info: |[{"id": "b734d9d7-5bb7-4ca9-a637-9c335398dfc0", "address": "fa:16:3e:b9:28:73", "network": {"id": "e71b9966-9a95-4f66-b3b1-36b05d05853c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-310205564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28d940eae5394293b87cfced45911ab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb734d9d7-5b", "ovs_interfaceid": "b734d9d7-5bb7-4ca9-a637-9c335398dfc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 16:01:44 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-24355eed-a689-4792-ad12-02a065c48942 req-65ca2c03-07c2-4919-abea-b131c4f95e16 service nova] Acquired lock "refresh_cache-ad0cece6-9b26-4c87-9e48-2c0437cb9190" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:01:44 user nova-compute[71874]: DEBUG nova.network.neutron [req-24355eed-a689-4792-ad12-02a065c48942 req-65ca2c03-07c2-4919-abea-b131c4f95e16 service nova] [instance: ad0cece6-9b26-4c87-9e48-2c0437cb9190] Refreshing network info cache for port b734d9d7-5bb7-4ca9-a637-9c335398dfc0 {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 16:01:44 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-fb747c59-6845-4c51-8159-c728c40b97de tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: ad0cece6-9b26-4c87-9e48-2c0437cb9190] Start _get_guest_xml network_info=[{"id": "b734d9d7-5bb7-4ca9-a637-9c335398dfc0", "address": "fa:16:3e:b9:28:73", "network": {"id": "e71b9966-9a95-4f66-b3b1-36b05d05853c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-310205564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28d940eae5394293b87cfced45911ab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb734d9d7-5b", "ovs_interfaceid": "b734d9d7-5bb7-4ca9-a637-9c335398dfc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T15:55:37Z,direct_url=<?>,disk_format='qcow2',id=9dc63f14-8b70-4e72-89f2-13464f2f5c7c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='61a4936d9b7744c0b488d81c9b7746b6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T15:55:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_options': None, 'image_id': '9dc63f14-8b70-4e72-89f2-13464f2f5c7c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 16:01:44 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-fb747c59-6845-4c51-8159-c728c40b97de tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:01:44 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-fb747c59-6845-4c51-8159-c728c40b97de tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:01:44 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-fb747c59-6845-4c51-8159-c728c40b97de tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71874) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 16:01:44 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-fb747c59-6845-4c51-8159-c728c40b97de tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T15:56:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T15:55:37Z,direct_url=<?>,disk_format='qcow2',id=9dc63f14-8b70-4e72-89f2-13464f2f5c7c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='61a4936d9b7744c0b488d81c9b7746b6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T15:55:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 16:01:44 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-fb747c59-6845-4c51-8159-c728c40b97de tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Flavor limits 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 16:01:44 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-fb747c59-6845-4c51-8159-c728c40b97de tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Image limits 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 16:01:44 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-fb747c59-6845-4c51-8159-c728c40b97de tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Flavor pref 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 16:01:44 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-fb747c59-6845-4c51-8159-c728c40b97de tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Image pref 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 16:01:44 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-fb747c59-6845-4c51-8159-c728c40b97de tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 16:01:44 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-fb747c59-6845-4c51-8159-c728c40b97de tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 16:01:44 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-fb747c59-6845-4c51-8159-c728c40b97de tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 16:01:44 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-fb747c59-6845-4c51-8159-c728c40b97de tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Got 1 possible topologies {{(pid=71874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 16:01:44 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-fb747c59-6845-4c51-8159-c728c40b97de tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 16:01:44 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-fb747c59-6845-4c51-8159-c728c40b97de tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 16:01:44 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-fb747c59-6845-4c51-8159-c728c40b97de tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T16:01:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2145243343',display_name='tempest-AttachVolumeNegativeTest-server-2145243343',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2145243343',id=14,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAJELhHYsdQbAcbonk0277g3DJfP1LvsNujwWmlOlhfoJ8a2xLQrIa61OTMaRnrdudqA+4xM9N9X+ZeIYSCcD9wAL76iQKzBebuY1vOBSqr/XwJdRR6IbRCAYmOPGIb2tg==',key_name='tempest-keypair-42069222',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='28d940eae5394293b87cfced45911ab4',ramdisk_id='',reservation_id='r-uwxcw57z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-288610953',owner_user_name='tempest-AttachVolumeNegativeTest-288610953-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T16:01:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5a514f6d877a4ab0bec597fee13ce9db',uuid=ad0cece6-9b26-4c87-9e48-2c0437cb9190,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b734d9d7-5bb7-4ca9-a637-9c335398dfc0", "address": "fa:16:3e:b9:28:73", "network": {"id": "e71b9966-9a95-4f66-b3b1-36b05d05853c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-310205564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28d940eae5394293b87cfced45911ab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb734d9d7-5b", "ovs_interfaceid": "b734d9d7-5bb7-4ca9-a637-9c335398dfc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 16:01:44 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-fb747c59-6845-4c51-8159-c728c40b97de tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Converting VIF {"id": "b734d9d7-5bb7-4ca9-a637-9c335398dfc0", "address": "fa:16:3e:b9:28:73", "network": {"id": "e71b9966-9a95-4f66-b3b1-36b05d05853c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-310205564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28d940eae5394293b87cfced45911ab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb734d9d7-5b", "ovs_interfaceid": "b734d9d7-5bb7-4ca9-a637-9c335398dfc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:01:44 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-fb747c59-6845-4c51-8159-c728c40b97de tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:28:73,bridge_name='br-int',has_traffic_filtering=True,id=b734d9d7-5bb7-4ca9-a637-9c335398dfc0,network=Network(e71b9966-9a95-4f66-b3b1-36b05d05853c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb734d9d7-5b') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:01:44 user nova-compute[71874]: DEBUG nova.objects.instance [None req-fb747c59-6845-4c51-8159-c728c40b97de tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lazy-loading 'pci_devices' on Instance uuid ad0cece6-9b26-4c87-9e48-2c0437cb9190 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:01:44 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-fb747c59-6845-4c51-8159-c728c40b97de tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: ad0cece6-9b26-4c87-9e48-2c0437cb9190] End _get_guest_xml xml=<domain type="kvm">
Apr 12 16:01:44 user nova-compute[71874]:   <uuid>ad0cece6-9b26-4c87-9e48-2c0437cb9190</uuid>
Apr 12 16:01:44 user nova-compute[71874]:   <name>instance-0000000e</name>
Apr 12 16:01:44 user nova-compute[71874]:   <memory>131072</memory>
Apr 12 16:01:44 user nova-compute[71874]:   <vcpu>1</vcpu>
Apr 12 16:01:44 user nova-compute[71874]:   <metadata>
Apr 12 16:01:44 user nova-compute[71874]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 16:01:44 user nova-compute[71874]:       <nova:package version="0.0.0"/>
Apr 12 16:01:44 user nova-compute[71874]:       <nova:name>tempest-AttachVolumeNegativeTest-server-2145243343</nova:name>
Apr 12 16:01:44 user nova-compute[71874]:       <nova:creationTime>2023-04-12 16:01:44</nova:creationTime>
Apr 12 16:01:44 user nova-compute[71874]:       <nova:flavor name="m1.nano">
Apr 12 16:01:44 user nova-compute[71874]:         <nova:memory>128</nova:memory>
Apr 12 16:01:44 user nova-compute[71874]:         <nova:disk>1</nova:disk>
Apr 12 16:01:44 user nova-compute[71874]:         <nova:swap>0</nova:swap>
Apr 12 16:01:44 user nova-compute[71874]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 16:01:44 user nova-compute[71874]:         <nova:vcpus>1</nova:vcpus>
Apr 12 16:01:44 user nova-compute[71874]:       </nova:flavor>
Apr 12 16:01:44 user nova-compute[71874]:       <nova:owner>
Apr 12 16:01:44 user nova-compute[71874]:         <nova:user uuid="5a514f6d877a4ab0bec597fee13ce9db">tempest-AttachVolumeNegativeTest-288610953-project-member</nova:user>
Apr 12 16:01:44 user nova-compute[71874]:         <nova:project uuid="28d940eae5394293b87cfced45911ab4">tempest-AttachVolumeNegativeTest-288610953</nova:project>
Apr 12 16:01:44 user nova-compute[71874]:       </nova:owner>
Apr 12 16:01:44 user nova-compute[71874]:       <nova:root type="image" uuid="9dc63f14-8b70-4e72-89f2-13464f2f5c7c"/>
Apr 12 16:01:44 user nova-compute[71874]:       <nova:ports>
Apr 12 16:01:44 user nova-compute[71874]:         <nova:port uuid="b734d9d7-5bb7-4ca9-a637-9c335398dfc0">
Apr 12 16:01:44 user nova-compute[71874]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 12 16:01:44 user nova-compute[71874]:         </nova:port>
Apr 12 16:01:44 user nova-compute[71874]:       </nova:ports>
Apr 12 16:01:44 user nova-compute[71874]:     </nova:instance>
Apr 12 16:01:44 user nova-compute[71874]:   </metadata>
Apr 12 16:01:44 user nova-compute[71874]:   <sysinfo type="smbios">
Apr 12 16:01:44 user nova-compute[71874]:     <system>
Apr 12 16:01:44 user nova-compute[71874]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 16:01:44 user nova-compute[71874]:       <entry name="product">OpenStack Nova</entry>
Apr 12 16:01:44 user nova-compute[71874]:       <entry name="version">0.0.0</entry>
Apr 12 16:01:44 user nova-compute[71874]:       <entry name="serial">ad0cece6-9b26-4c87-9e48-2c0437cb9190</entry>
Apr 12 16:01:44 user nova-compute[71874]:       <entry name="uuid">ad0cece6-9b26-4c87-9e48-2c0437cb9190</entry>
Apr 12 16:01:44 user nova-compute[71874]:       <entry name="family">Virtual Machine</entry>
Apr 12 16:01:44 user nova-compute[71874]:     </system>
Apr 12 16:01:44 user nova-compute[71874]:   </sysinfo>
Apr 12 16:01:44 user nova-compute[71874]:   <os>
Apr 12 16:01:44 user nova-compute[71874]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 16:01:44 user nova-compute[71874]:     <boot dev="hd"/>
Apr 12 16:01:44 user nova-compute[71874]:     <smbios mode="sysinfo"/>
Apr 12 16:01:44 user nova-compute[71874]:   </os>
Apr 12 16:01:44 user nova-compute[71874]:   <features>
Apr 12 16:01:44 user nova-compute[71874]:     <acpi/>
Apr 12 16:01:44 user nova-compute[71874]:     <apic/>
Apr 12 16:01:44 user nova-compute[71874]:     <vmcoreinfo/>
Apr 12 16:01:44 user nova-compute[71874]:   </features>
Apr 12 16:01:44 user nova-compute[71874]:   <clock offset="utc">
Apr 12 16:01:44 user nova-compute[71874]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 16:01:44 user nova-compute[71874]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 16:01:44 user nova-compute[71874]:     <timer name="hpet" present="no"/>
Apr 12 16:01:44 user nova-compute[71874]:   </clock>
Apr 12 16:01:44 user nova-compute[71874]:   <cpu mode="custom" match="exact">
Apr 12 16:01:44 user nova-compute[71874]:     <model>Nehalem</model>
Apr 12 16:01:44 user nova-compute[71874]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 16:01:44 user nova-compute[71874]:   </cpu>
Apr 12 16:01:44 user nova-compute[71874]:   <devices>
Apr 12 16:01:44 user nova-compute[71874]:     <disk type="file" device="disk">
Apr 12 16:01:44 user nova-compute[71874]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 16:01:44 user nova-compute[71874]:       <source file="/opt/stack/data/nova/instances/ad0cece6-9b26-4c87-9e48-2c0437cb9190/disk"/>
Apr 12 16:01:44 user nova-compute[71874]:       <target dev="vda" bus="virtio"/>
Apr 12 16:01:44 user nova-compute[71874]:     </disk>
Apr 12 16:01:44 user nova-compute[71874]:     <interface type="ethernet">
Apr 12 16:01:44 user nova-compute[71874]:       <mac address="fa:16:3e:b9:28:73"/>
Apr 12 16:01:44 user nova-compute[71874]:       <model type="virtio"/>
Apr 12 16:01:44 user nova-compute[71874]:       <mtu size="1442"/>
Apr 12 16:01:44 user nova-compute[71874]:       <target dev="tapb734d9d7-5b"/>
Apr 12 16:01:44 user nova-compute[71874]:     </interface>
Apr 12 16:01:44 user nova-compute[71874]:     <serial type="pty">
Apr 12 16:01:44 user nova-compute[71874]:       <log file="/opt/stack/data/nova/instances/ad0cece6-9b26-4c87-9e48-2c0437cb9190/console.log" append="off"/>
Apr 12 16:01:44 user nova-compute[71874]:     </serial>
Apr 12 16:01:44 user nova-compute[71874]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 16:01:44 user nova-compute[71874]:     <video>
Apr 12 16:01:44 user nova-compute[71874]:       <model type="virtio"/>
Apr 12 16:01:44 user nova-compute[71874]:     </video>
Apr 12 16:01:44 user nova-compute[71874]:     <rng model="virtio">
Apr 12 16:01:44 user nova-compute[71874]:       <backend model="random">/dev/urandom</backend>
Apr 12 16:01:44 user nova-compute[71874]:     </rng>
Apr 12 16:01:44 user nova-compute[71874]:     <controller type="usb" index="0" model="none"/>
Apr 12 16:01:44 user nova-compute[71874]:     <memballoon model="virtio">
Apr 12 16:01:44 user nova-compute[71874]:       <stats period="10"/>
Apr 12 16:01:44 user nova-compute[71874]:     </memballoon>
Apr 12 16:01:44 user nova-compute[71874]:   </devices>
Apr 12 16:01:44 user nova-compute[71874]: </domain>
Apr 12 16:01:44 user nova-compute[71874]:  {{(pid=71874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 16:01:45 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-fb747c59-6845-4c51-8159-c728c40b97de tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T16:01:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2145243343',display_name='tempest-AttachVolumeNegativeTest-server-2145243343',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2145243343',id=14,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAJELhHYsdQbAcbonk0277g3DJfP1LvsNujwWmlOlhfoJ8a2xLQrIa61OTMaRnrdudqA+4xM9N9X+ZeIYSCcD9wAL76iQKzBebuY1vOBSqr/XwJdRR6IbRCAYmOPGIb2tg==',key_name='tempest-keypair-42069222',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='28d940eae5394293b87cfced45911ab4',ramdisk_id='',reservation_id='r-uwxcw57z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-288610953',owner_user_name='tempest-AttachVolumeNegativeTest-288610953-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T16:01:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5a514f6d877a4ab0bec597fee13ce9db',uuid=ad0cece6-9b26-4c87-9e48-2c0437cb9190,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b734d9d7-5bb7-4ca9-a637-9c335398dfc0", "address": "fa:16:3e:b9:28:73", "network": {"id": "e71b9966-9a95-4f66-b3b1-36b05d05853c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-310205564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28d940eae5394293b87cfced45911ab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb734d9d7-5b", "ovs_interfaceid": "b734d9d7-5bb7-4ca9-a637-9c335398dfc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 16:01:45 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-fb747c59-6845-4c51-8159-c728c40b97de tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Converting VIF {"id": "b734d9d7-5bb7-4ca9-a637-9c335398dfc0", "address": "fa:16:3e:b9:28:73", "network": {"id": "e71b9966-9a95-4f66-b3b1-36b05d05853c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-310205564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28d940eae5394293b87cfced45911ab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb734d9d7-5b", "ovs_interfaceid": "b734d9d7-5bb7-4ca9-a637-9c335398dfc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:01:45 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-fb747c59-6845-4c51-8159-c728c40b97de tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:28:73,bridge_name='br-int',has_traffic_filtering=True,id=b734d9d7-5bb7-4ca9-a637-9c335398dfc0,network=Network(e71b9966-9a95-4f66-b3b1-36b05d05853c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb734d9d7-5b') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:01:45 user nova-compute[71874]: DEBUG os_vif [None req-fb747c59-6845-4c51-8159-c728c40b97de tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:28:73,bridge_name='br-int',has_traffic_filtering=True,id=b734d9d7-5bb7-4ca9-a637-9c335398dfc0,network=Network(e71b9966-9a95-4f66-b3b1-36b05d05853c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb734d9d7-5b') {{(pid=71874) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 16:01:45 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:01:45 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:01:45 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 16:01:45 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:01:45 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb734d9d7-5b, may_exist=True) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:01:45 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb734d9d7-5b, col_values=(('external_ids', {'iface-id': 'b734d9d7-5bb7-4ca9-a637-9c335398dfc0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b9:28:73', 'vm-uuid': 'ad0cece6-9b26-4c87-9e48-2c0437cb9190'}),)) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:01:45 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:01:45 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:01:45 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:01:45 user nova-compute[71874]: INFO os_vif [None req-fb747c59-6845-4c51-8159-c728c40b97de tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:28:73,bridge_name='br-int',has_traffic_filtering=True,id=b734d9d7-5bb7-4ca9-a637-9c335398dfc0,network=Network(e71b9966-9a95-4f66-b3b1-36b05d05853c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb734d9d7-5b')
Apr 12 16:01:45 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-fb747c59-6845-4c51-8159-c728c40b97de tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] No BDM found with device name vda, not building metadata. {{(pid=71874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 16:01:45 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-fb747c59-6845-4c51-8159-c728c40b97de tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] No VIF found with MAC fa:16:3e:b9:28:73, not building metadata {{(pid=71874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 16:01:45 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-ba8ef66f-a6d2-44b5-b9f2-7e2a78aff5a2 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Acquiring lock "interface-55aff314-eb5e-4752-af9f-a4021e970cac-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:01:45 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-ba8ef66f-a6d2-44b5-b9f2-7e2a78aff5a2 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Lock "interface-55aff314-eb5e-4752-af9f-a4021e970cac-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:01:45 user nova-compute[71874]: DEBUG nova.objects.instance [None req-ba8ef66f-a6d2-44b5-b9f2-7e2a78aff5a2 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Lazy-loading 'flavor' on Instance uuid 55aff314-eb5e-4752-af9f-a4021e970cac {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:01:45 user nova-compute[71874]: DEBUG nova.network.neutron [req-087b29f6-b999-408c-a678-7eee2f12f46a req-ada1ec32-f1fe-4796-b892-a460ac3c7637 service nova] [instance: 55aff314-eb5e-4752-af9f-a4021e970cac] Updated VIF entry in instance network info cache for port 4a51084d-9fff-4a53-9387-4542bfd6a4a7. {{(pid=71874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 16:01:45 user nova-compute[71874]: DEBUG nova.network.neutron [req-087b29f6-b999-408c-a678-7eee2f12f46a req-ada1ec32-f1fe-4796-b892-a460ac3c7637 service nova] [instance: 55aff314-eb5e-4752-af9f-a4021e970cac] Updating instance_info_cache with network_info: [{"id": "4a51084d-9fff-4a53-9387-4542bfd6a4a7", "address": "fa:16:3e:5a:aa:4d", "network": {"id": "95c64a1b-8b44-403f-8c4c-32730720d7a7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-87023330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8197a98d7ebc4230899aca82b073ab15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a51084d-9f", "ovs_interfaceid": "4a51084d-9fff-4a53-9387-4542bfd6a4a7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:01:45 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-087b29f6-b999-408c-a678-7eee2f12f46a req-ada1ec32-f1fe-4796-b892-a460ac3c7637 service nova] Releasing lock "refresh_cache-55aff314-eb5e-4752-af9f-a4021e970cac" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:01:45 user nova-compute[71874]: DEBUG nova.network.neutron [req-24355eed-a689-4792-ad12-02a065c48942 req-65ca2c03-07c2-4919-abea-b131c4f95e16 service nova] [instance: ad0cece6-9b26-4c87-9e48-2c0437cb9190] Updated VIF entry in instance network info cache for port b734d9d7-5bb7-4ca9-a637-9c335398dfc0. {{(pid=71874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 16:01:45 user nova-compute[71874]: DEBUG nova.network.neutron [req-24355eed-a689-4792-ad12-02a065c48942 req-65ca2c03-07c2-4919-abea-b131c4f95e16 service nova] [instance: ad0cece6-9b26-4c87-9e48-2c0437cb9190] Updating instance_info_cache with network_info: [{"id": "b734d9d7-5bb7-4ca9-a637-9c335398dfc0", "address": "fa:16:3e:b9:28:73", "network": {"id": "e71b9966-9a95-4f66-b3b1-36b05d05853c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-310205564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28d940eae5394293b87cfced45911ab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb734d9d7-5b", "ovs_interfaceid": "b734d9d7-5bb7-4ca9-a637-9c335398dfc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:01:45 user nova-compute[71874]: DEBUG nova.objects.instance [None req-ba8ef66f-a6d2-44b5-b9f2-7e2a78aff5a2 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Lazy-loading 'pci_requests' on Instance uuid 55aff314-eb5e-4752-af9f-a4021e970cac {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:01:45 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-24355eed-a689-4792-ad12-02a065c48942 req-65ca2c03-07c2-4919-abea-b131c4f95e16 service nova] Releasing lock "refresh_cache-ad0cece6-9b26-4c87-9e48-2c0437cb9190" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:01:45 user nova-compute[71874]: DEBUG nova.network.neutron [None req-ba8ef66f-a6d2-44b5-b9f2-7e2a78aff5a2 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] [instance: 55aff314-eb5e-4752-af9f-a4021e970cac] allocate_for_instance() {{(pid=71874) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 16:01:45 user nova-compute[71874]: DEBUG nova.policy [None req-ba8ef66f-a6d2-44b5-b9f2-7e2a78aff5a2 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '324eb9033e62405ca2b322bcb6da9a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8197a98d7ebc4230899aca82b073ab15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71874) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 16:01:46 user nova-compute[71874]: DEBUG nova.network.neutron [None req-ba8ef66f-a6d2-44b5-b9f2-7e2a78aff5a2 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] [instance: 55aff314-eb5e-4752-af9f-a4021e970cac] Successfully created port: 9e66bcb0-73bf-4d5e-b20a-b26443302fca {{(pid=71874) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 16:01:46 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:01:46 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:01:46 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:01:46 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:01:46 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:01:46 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:01:46 user nova-compute[71874]: DEBUG nova.compute.manager [req-7e76f9c8-bbed-4ca4-88f4-914538af063c req-dae7b764-8ccb-41ba-bc55-17dd065a0459 service nova] [instance: ad0cece6-9b26-4c87-9e48-2c0437cb9190] Received event network-vif-plugged-b734d9d7-5bb7-4ca9-a637-9c335398dfc0 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:01:46 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-7e76f9c8-bbed-4ca4-88f4-914538af063c req-dae7b764-8ccb-41ba-bc55-17dd065a0459 service nova] Acquiring lock "ad0cece6-9b26-4c87-9e48-2c0437cb9190-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:01:46 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-7e76f9c8-bbed-4ca4-88f4-914538af063c req-dae7b764-8ccb-41ba-bc55-17dd065a0459 service nova] Lock "ad0cece6-9b26-4c87-9e48-2c0437cb9190-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:01:46 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-7e76f9c8-bbed-4ca4-88f4-914538af063c req-dae7b764-8ccb-41ba-bc55-17dd065a0459 service nova] Lock "ad0cece6-9b26-4c87-9e48-2c0437cb9190-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:01:46 user nova-compute[71874]: DEBUG nova.compute.manager [req-7e76f9c8-bbed-4ca4-88f4-914538af063c req-dae7b764-8ccb-41ba-bc55-17dd065a0459 service nova] [instance: ad0cece6-9b26-4c87-9e48-2c0437cb9190] No waiting events found dispatching network-vif-plugged-b734d9d7-5bb7-4ca9-a637-9c335398dfc0 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:01:46 user nova-compute[71874]: WARNING nova.compute.manager [req-7e76f9c8-bbed-4ca4-88f4-914538af063c req-dae7b764-8ccb-41ba-bc55-17dd065a0459 service nova] [instance: ad0cece6-9b26-4c87-9e48-2c0437cb9190] Received unexpected event network-vif-plugged-b734d9d7-5bb7-4ca9-a637-9c335398dfc0 for instance with vm_state building and task_state spawning.
Apr 12 16:01:47 user nova-compute[71874]: DEBUG nova.network.neutron [None req-ba8ef66f-a6d2-44b5-b9f2-7e2a78aff5a2 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] [instance: 55aff314-eb5e-4752-af9f-a4021e970cac] Successfully updated port: 9e66bcb0-73bf-4d5e-b20a-b26443302fca {{(pid=71874) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 16:01:47 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-ba8ef66f-a6d2-44b5-b9f2-7e2a78aff5a2 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Acquiring lock "refresh_cache-55aff314-eb5e-4752-af9f-a4021e970cac" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:01:47 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-ba8ef66f-a6d2-44b5-b9f2-7e2a78aff5a2 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Acquired lock "refresh_cache-55aff314-eb5e-4752-af9f-a4021e970cac" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:01:47 user nova-compute[71874]: DEBUG nova.network.neutron [None req-ba8ef66f-a6d2-44b5-b9f2-7e2a78aff5a2 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] [instance: 55aff314-eb5e-4752-af9f-a4021e970cac] Building network info cache for instance {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 16:01:47 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:01:47 user nova-compute[71874]: DEBUG nova.network.neutron [None req-ba8ef66f-a6d2-44b5-b9f2-7e2a78aff5a2 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] [instance: 55aff314-eb5e-4752-af9f-a4021e970cac] Updating instance_info_cache with network_info: [{"id": "4a51084d-9fff-4a53-9387-4542bfd6a4a7", "address": "fa:16:3e:5a:aa:4d", "network": {"id": "95c64a1b-8b44-403f-8c4c-32730720d7a7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-87023330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8197a98d7ebc4230899aca82b073ab15", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a51084d-9f", "ovs_interfaceid": "4a51084d-9fff-4a53-9387-4542bfd6a4a7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9e66bcb0-73bf-4d5e-b20a-b26443302fca", "address": "fa:16:3e:59:6e:ba", "network": {"id": "4080a87a-33fc-4ac1-a7a0-a514db7dcb08", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-699748812", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "8197a98d7ebc4230899aca82b073ab15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e66bcb0-73", "ovs_interfaceid": "9e66bcb0-73bf-4d5e-b20a-b26443302fca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:01:47 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-ba8ef66f-a6d2-44b5-b9f2-7e2a78aff5a2 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Releasing lock "refresh_cache-55aff314-eb5e-4752-af9f-a4021e970cac" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:01:47 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-ba8ef66f-a6d2-44b5-b9f2-7e2a78aff5a2 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T15:59:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1331285489',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1331285489',id=7,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEJbHdIj6Qnsbz5sPRJ4ye2dl2IsI8e0vfQ09uKxN501bN+DgkHVMylQpwrl7ZvLZ8swmrO3BjtPpMg/5nOMgbnum5uHS/qZKbdglyI6E6LnkEx0Cctk5Q87Mk68+Dgi4A==',key_name='tempest-keypair-2057580771',keypairs=<?>,launch_index=0,launched_at=2023-04-12T16:00:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8197a98d7ebc4230899aca82b073ab15',ramdisk_id='',reservation_id='r-ncvxejnb',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-475014275',owner_user_name='tempest-TaggedAttachmentsTest-475014275-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T16:00:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='324eb9033e62405ca2b322bcb6da9a04',uuid=55aff314-eb5e-4752-af9f-a4021e970cac,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9e66bcb0-73bf-4d5e-b20a-b26443302fca", "address": "fa:16:3e:59:6e:ba", "network": {"id": "4080a87a-33fc-4ac1-a7a0-a514db7dcb08", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-699748812", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "8197a98d7ebc4230899aca82b073ab15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e66bcb0-73", "ovs_interfaceid": "9e66bcb0-73bf-4d5e-b20a-b26443302fca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 16:01:47 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-ba8ef66f-a6d2-44b5-b9f2-7e2a78aff5a2 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Converting VIF {"id": "9e66bcb0-73bf-4d5e-b20a-b26443302fca", "address": "fa:16:3e:59:6e:ba", "network": {"id": "4080a87a-33fc-4ac1-a7a0-a514db7dcb08", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-699748812", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "8197a98d7ebc4230899aca82b073ab15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e66bcb0-73", "ovs_interfaceid": "9e66bcb0-73bf-4d5e-b20a-b26443302fca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:01:47 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-ba8ef66f-a6d2-44b5-b9f2-7e2a78aff5a2 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:6e:ba,bridge_name='br-int',has_traffic_filtering=True,id=9e66bcb0-73bf-4d5e-b20a-b26443302fca,network=Network(4080a87a-33fc-4ac1-a7a0-a514db7dcb08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e66bcb0-73') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:01:47 user nova-compute[71874]: DEBUG os_vif [None req-ba8ef66f-a6d2-44b5-b9f2-7e2a78aff5a2 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:6e:ba,bridge_name='br-int',has_traffic_filtering=True,id=9e66bcb0-73bf-4d5e-b20a-b26443302fca,network=Network(4080a87a-33fc-4ac1-a7a0-a514db7dcb08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e66bcb0-73') {{(pid=71874) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 16:01:47 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:01:47 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:01:47 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 16:01:47 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:01:47 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9e66bcb0-73, may_exist=True) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:01:47 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9e66bcb0-73, col_values=(('external_ids', {'iface-id': '9e66bcb0-73bf-4d5e-b20a-b26443302fca', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:59:6e:ba', 'vm-uuid': '55aff314-eb5e-4752-af9f-a4021e970cac'}),)) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:01:47 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:01:47 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:01:47 user nova-compute[71874]: INFO os_vif [None req-ba8ef66f-a6d2-44b5-b9f2-7e2a78aff5a2 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:6e:ba,bridge_name='br-int',has_traffic_filtering=True,id=9e66bcb0-73bf-4d5e-b20a-b26443302fca,network=Network(4080a87a-33fc-4ac1-a7a0-a514db7dcb08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e66bcb0-73')
Apr 12 16:01:47 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-ba8ef66f-a6d2-44b5-b9f2-7e2a78aff5a2 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T15:59:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1331285489',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1331285489',id=7,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEJbHdIj6Qnsbz5sPRJ4ye2dl2IsI8e0vfQ09uKxN501bN+DgkHVMylQpwrl7ZvLZ8swmrO3BjtPpMg/5nOMgbnum5uHS/qZKbdglyI6E6LnkEx0Cctk5Q87Mk68+Dgi4A==',key_name='tempest-keypair-2057580771',keypairs=<?>,launch_index=0,launched_at=2023-04-12T16:00:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8197a98d7ebc4230899aca82b073ab15',ramdisk_id='',reservation_id='r-ncvxejnb',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-475014275',owner_user_name='tempest-TaggedAttachmentsTest-475014275-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T16:00:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='324eb9033e62405ca2b322bcb6da9a04',uuid=55aff314-eb5e-4752-af9f-a4021e970cac,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9e66bcb0-73bf-4d5e-b20a-b26443302fca", "address": "fa:16:3e:59:6e:ba", "network": {"id": "4080a87a-33fc-4ac1-a7a0-a514db7dcb08", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-699748812", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "8197a98d7ebc4230899aca82b073ab15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e66bcb0-73", "ovs_interfaceid": "9e66bcb0-73bf-4d5e-b20a-b26443302fca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 16:01:47 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-ba8ef66f-a6d2-44b5-b9f2-7e2a78aff5a2 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Converting VIF {"id": "9e66bcb0-73bf-4d5e-b20a-b26443302fca", "address": "fa:16:3e:59:6e:ba", "network": {"id": "4080a87a-33fc-4ac1-a7a0-a514db7dcb08", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-699748812", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "8197a98d7ebc4230899aca82b073ab15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e66bcb0-73", "ovs_interfaceid": "9e66bcb0-73bf-4d5e-b20a-b26443302fca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:01:47 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-ba8ef66f-a6d2-44b5-b9f2-7e2a78aff5a2 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:6e:ba,bridge_name='br-int',has_traffic_filtering=True,id=9e66bcb0-73bf-4d5e-b20a-b26443302fca,network=Network(4080a87a-33fc-4ac1-a7a0-a514db7dcb08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e66bcb0-73') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:01:47 user nova-compute[71874]: DEBUG nova.virt.libvirt.guest [None req-ba8ef66f-a6d2-44b5-b9f2-7e2a78aff5a2 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] attach device xml: <interface type="ethernet">
Apr 12 16:01:47 user nova-compute[71874]:   <mac address="fa:16:3e:59:6e:ba"/>
Apr 12 16:01:47 user nova-compute[71874]:   <model type="virtio"/>
Apr 12 16:01:47 user nova-compute[71874]:   <mtu size="1442"/>
Apr 12 16:01:47 user nova-compute[71874]:   <target dev="tap9e66bcb0-73"/>
Apr 12 16:01:47 user nova-compute[71874]: </interface>
Apr 12 16:01:47 user nova-compute[71874]:  {{(pid=71874) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 16:01:47 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:01:48 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:01:48 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-ba8ef66f-a6d2-44b5-b9f2-7e2a78aff5a2 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] No BDM found with device name vda, not building metadata. {{(pid=71874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 16:01:48 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-ba8ef66f-a6d2-44b5-b9f2-7e2a78aff5a2 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] No BDM found with device name hda, not building metadata. {{(pid=71874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 16:01:48 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-ba8ef66f-a6d2-44b5-b9f2-7e2a78aff5a2 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] No VIF found with MAC fa:16:3e:5a:aa:4d, not building metadata {{(pid=71874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 16:01:48 user nova-compute[71874]: DEBUG nova.virt.libvirt.guest [None req-ba8ef66f-a6d2-44b5-b9f2-7e2a78aff5a2 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 16:01:48 user nova-compute[71874]:   <nova:package version="0.0.0"/>
Apr 12 16:01:48 user nova-compute[71874]:   <nova:name>tempest-device-tagging-server-1331285489</nova:name>
Apr 12 16:01:48 user nova-compute[71874]:   <nova:creationTime>2023-04-12 16:01:48</nova:creationTime>
Apr 12 16:01:48 user nova-compute[71874]:   <nova:flavor name="m1.nano">
Apr 12 16:01:48 user nova-compute[71874]:     <nova:memory>128</nova:memory>
Apr 12 16:01:48 user nova-compute[71874]:     <nova:disk>1</nova:disk>
Apr 12 16:01:48 user nova-compute[71874]:     <nova:swap>0</nova:swap>
Apr 12 16:01:48 user nova-compute[71874]:     <nova:ephemeral>0</nova:ephemeral>
Apr 12 16:01:48 user nova-compute[71874]:     <nova:vcpus>1</nova:vcpus>
Apr 12 16:01:48 user nova-compute[71874]:   </nova:flavor>
Apr 12 16:01:48 user nova-compute[71874]:   <nova:owner>
Apr 12 16:01:48 user nova-compute[71874]:     <nova:user uuid="324eb9033e62405ca2b322bcb6da9a04">tempest-TaggedAttachmentsTest-475014275-project-member</nova:user>
Apr 12 16:01:48 user nova-compute[71874]:     <nova:project uuid="8197a98d7ebc4230899aca82b073ab15">tempest-TaggedAttachmentsTest-475014275</nova:project>
Apr 12 16:01:48 user nova-compute[71874]:   </nova:owner>
Apr 12 16:01:48 user nova-compute[71874]:   <nova:root type="image" uuid="9dc63f14-8b70-4e72-89f2-13464f2f5c7c"/>
Apr 12 16:01:48 user nova-compute[71874]:   <nova:ports>
Apr 12 16:01:48 user nova-compute[71874]:     <nova:port uuid="4a51084d-9fff-4a53-9387-4542bfd6a4a7">
Apr 12 16:01:48 user nova-compute[71874]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 12 16:01:48 user nova-compute[71874]:     </nova:port>
Apr 12 16:01:48 user nova-compute[71874]:     <nova:port uuid="9e66bcb0-73bf-4d5e-b20a-b26443302fca">
Apr 12 16:01:48 user nova-compute[71874]:       <nova:ip type="fixed" address="10.10.10.120" ipVersion="4"/>
Apr 12 16:01:48 user nova-compute[71874]:     </nova:port>
Apr 12 16:01:48 user nova-compute[71874]:   </nova:ports>
Apr 12 16:01:48 user nova-compute[71874]: </nova:instance>
Apr 12 16:01:48 user nova-compute[71874]:  {{(pid=71874) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Apr 12 16:01:48 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-ba8ef66f-a6d2-44b5-b9f2-7e2a78aff5a2 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Lock "interface-55aff314-eb5e-4752-af9f-a4021e970cac-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.238s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:01:48 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:01:48 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:01:48 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:01:48 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:01:48 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-bbed4048-4927-42b3-adfd-56163d11e8c8 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Acquiring lock "55aff314-eb5e-4752-af9f-a4021e970cac" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:01:48 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-bbed4048-4927-42b3-adfd-56163d11e8c8 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Lock "55aff314-eb5e-4752-af9f-a4021e970cac" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:01:48 user nova-compute[71874]: DEBUG nova.virt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Emitting event <LifecycleEvent: 1681315308.6450408, ad0cece6-9b26-4c87-9e48-2c0437cb9190 => Resumed> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:01:48 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: ad0cece6-9b26-4c87-9e48-2c0437cb9190] VM Resumed (Lifecycle Event)
Apr 12 16:01:48 user nova-compute[71874]: DEBUG nova.compute.manager [None req-fb747c59-6845-4c51-8159-c728c40b97de tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: ad0cece6-9b26-4c87-9e48-2c0437cb9190] Instance event wait completed in 0 seconds for  {{(pid=71874) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 16:01:48 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-fb747c59-6845-4c51-8159-c728c40b97de tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: ad0cece6-9b26-4c87-9e48-2c0437cb9190] Guest created on hypervisor {{(pid=71874) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 16:01:48 user nova-compute[71874]: DEBUG nova.objects.instance [None req-bbed4048-4927-42b3-adfd-56163d11e8c8 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Lazy-loading 'flavor' on Instance uuid 55aff314-eb5e-4752-af9f-a4021e970cac {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:01:48 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: ad0cece6-9b26-4c87-9e48-2c0437cb9190] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:01:48 user nova-compute[71874]: INFO nova.virt.libvirt.driver [-] [instance: ad0cece6-9b26-4c87-9e48-2c0437cb9190] Instance spawned successfully.
Apr 12 16:01:48 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-fb747c59-6845-4c51-8159-c728c40b97de tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: ad0cece6-9b26-4c87-9e48-2c0437cb9190] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 16:01:48 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: ad0cece6-9b26-4c87-9e48-2c0437cb9190] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 16:01:48 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-fb747c59-6845-4c51-8159-c728c40b97de tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: ad0cece6-9b26-4c87-9e48-2c0437cb9190] Found default for hw_cdrom_bus of ide {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:01:48 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-fb747c59-6845-4c51-8159-c728c40b97de tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: ad0cece6-9b26-4c87-9e48-2c0437cb9190] Found default for hw_disk_bus of virtio {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:01:48 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-fb747c59-6845-4c51-8159-c728c40b97de tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: ad0cece6-9b26-4c87-9e48-2c0437cb9190] Found default for hw_input_bus of None {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:01:48 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-fb747c59-6845-4c51-8159-c728c40b97de tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: ad0cece6-9b26-4c87-9e48-2c0437cb9190] Found default for hw_pointer_model of None {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:01:48 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-fb747c59-6845-4c51-8159-c728c40b97de tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: ad0cece6-9b26-4c87-9e48-2c0437cb9190] Found default for hw_video_model of virtio {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:01:48 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-fb747c59-6845-4c51-8159-c728c40b97de tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: ad0cece6-9b26-4c87-9e48-2c0437cb9190] Found default for hw_vif_model of virtio {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:01:48 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-bbed4048-4927-42b3-adfd-56163d11e8c8 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Lock "55aff314-eb5e-4752-af9f-a4021e970cac" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.081s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:01:48 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: ad0cece6-9b26-4c87-9e48-2c0437cb9190] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 16:01:48 user nova-compute[71874]: DEBUG nova.virt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Emitting event <LifecycleEvent: 1681315308.6464615, ad0cece6-9b26-4c87-9e48-2c0437cb9190 => Started> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:01:48 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: ad0cece6-9b26-4c87-9e48-2c0437cb9190] VM Started (Lifecycle Event)
Apr 12 16:01:48 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: ad0cece6-9b26-4c87-9e48-2c0437cb9190] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:01:48 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: ad0cece6-9b26-4c87-9e48-2c0437cb9190] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 16:01:48 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: ad0cece6-9b26-4c87-9e48-2c0437cb9190] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 16:01:48 user nova-compute[71874]: INFO nova.compute.manager [None req-fb747c59-6845-4c51-8159-c728c40b97de tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: ad0cece6-9b26-4c87-9e48-2c0437cb9190] Took 5.56 seconds to spawn the instance on the hypervisor.
Apr 12 16:01:48 user nova-compute[71874]: DEBUG nova.compute.manager [None req-fb747c59-6845-4c51-8159-c728c40b97de tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: ad0cece6-9b26-4c87-9e48-2c0437cb9190] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:01:48 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-bbed4048-4927-42b3-adfd-56163d11e8c8 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Acquiring lock "55aff314-eb5e-4752-af9f-a4021e970cac" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:01:48 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-bbed4048-4927-42b3-adfd-56163d11e8c8 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Lock "55aff314-eb5e-4752-af9f-a4021e970cac" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:01:48 user nova-compute[71874]: INFO nova.compute.manager [None req-bbed4048-4927-42b3-adfd-56163d11e8c8 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] [instance: 55aff314-eb5e-4752-af9f-a4021e970cac] Attaching volume b2f0d62b-ba81-4361-8238-57417c052465 to /dev/vdb
Apr 12 16:01:48 user nova-compute[71874]: INFO nova.compute.manager [None req-fb747c59-6845-4c51-8159-c728c40b97de tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: ad0cece6-9b26-4c87-9e48-2c0437cb9190] Took 6.37 seconds to build instance.
Apr 12 16:01:48 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-fb747c59-6845-4c51-8159-c728c40b97de tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "ad0cece6-9b26-4c87-9e48-2c0437cb9190" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.474s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:01:48 user nova-compute[71874]: DEBUG nova.compute.manager [req-5d420f2a-32cd-4a7f-94bc-766a4d631b67 req-e51cffb5-ec83-4b74-b080-5e6985762932 service nova] [instance: ad0cece6-9b26-4c87-9e48-2c0437cb9190] Received event network-vif-plugged-b734d9d7-5bb7-4ca9-a637-9c335398dfc0 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:01:48 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-5d420f2a-32cd-4a7f-94bc-766a4d631b67 req-e51cffb5-ec83-4b74-b080-5e6985762932 service nova] Acquiring lock "ad0cece6-9b26-4c87-9e48-2c0437cb9190-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:01:48 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-5d420f2a-32cd-4a7f-94bc-766a4d631b67 req-e51cffb5-ec83-4b74-b080-5e6985762932 service nova] Lock "ad0cece6-9b26-4c87-9e48-2c0437cb9190-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:01:48 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-5d420f2a-32cd-4a7f-94bc-766a4d631b67 req-e51cffb5-ec83-4b74-b080-5e6985762932 service nova] Lock "ad0cece6-9b26-4c87-9e48-2c0437cb9190-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:01:48 user nova-compute[71874]: DEBUG nova.compute.manager [req-5d420f2a-32cd-4a7f-94bc-766a4d631b67 req-e51cffb5-ec83-4b74-b080-5e6985762932 service nova] [instance: ad0cece6-9b26-4c87-9e48-2c0437cb9190] No waiting events found dispatching network-vif-plugged-b734d9d7-5bb7-4ca9-a637-9c335398dfc0 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:01:48 user nova-compute[71874]: WARNING nova.compute.manager [req-5d420f2a-32cd-4a7f-94bc-766a4d631b67 req-e51cffb5-ec83-4b74-b080-5e6985762932 service nova] [instance: ad0cece6-9b26-4c87-9e48-2c0437cb9190] Received unexpected event network-vif-plugged-b734d9d7-5bb7-4ca9-a637-9c335398dfc0 for instance with vm_state active and task_state None.
Apr 12 16:01:48 user nova-compute[71874]: DEBUG nova.compute.manager [req-5d420f2a-32cd-4a7f-94bc-766a4d631b67 req-e51cffb5-ec83-4b74-b080-5e6985762932 service nova] [instance: 55aff314-eb5e-4752-af9f-a4021e970cac] Received event network-changed-9e66bcb0-73bf-4d5e-b20a-b26443302fca {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:01:48 user nova-compute[71874]: DEBUG nova.compute.manager [req-5d420f2a-32cd-4a7f-94bc-766a4d631b67 req-e51cffb5-ec83-4b74-b080-5e6985762932 service nova] [instance: 55aff314-eb5e-4752-af9f-a4021e970cac] Refreshing instance network info cache due to event network-changed-9e66bcb0-73bf-4d5e-b20a-b26443302fca. {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 16:01:48 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-5d420f2a-32cd-4a7f-94bc-766a4d631b67 req-e51cffb5-ec83-4b74-b080-5e6985762932 service nova] Acquiring lock "refresh_cache-55aff314-eb5e-4752-af9f-a4021e970cac" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:01:48 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-5d420f2a-32cd-4a7f-94bc-766a4d631b67 req-e51cffb5-ec83-4b74-b080-5e6985762932 service nova] Acquired lock "refresh_cache-55aff314-eb5e-4752-af9f-a4021e970cac" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:01:48 user nova-compute[71874]: DEBUG nova.network.neutron [req-5d420f2a-32cd-4a7f-94bc-766a4d631b67 req-e51cffb5-ec83-4b74-b080-5e6985762932 service nova] [instance: 55aff314-eb5e-4752-af9f-a4021e970cac] Refreshing network info cache for port 9e66bcb0-73bf-4d5e-b20a-b26443302fca {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 16:01:48 user nova-compute[71874]: DEBUG os_brick.utils [None req-bbed4048-4927-42b3-adfd-56163d11e8c8 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:01:48 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:01:48 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:01:48 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[49248470-8032-4f75-82f9-29fd098bb725]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:61a48d4489d2\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:01:48 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:01:49 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:01:49 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d21a88c-ab19-4205-89d4-704469428443]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:01:49 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:01:49 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:01:49 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[f197c9c0-d330-428a-bc98-68f13c0233b9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:01:49 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d2d0800-5b4d-409a-afe2-4e9336a811e8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:01:49 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-bbed4048-4927-42b3-adfd-56163d11e8c8 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Running cmd (subprocess): nvme version {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:01:49 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-bbed4048-4927-42b3-adfd-56163d11e8c8 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] 'nvme version' failed. Not Retrying. {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 16:01:49 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bbed4048-4927-42b3-adfd-56163d11e8c8 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] nvme not present on system {{(pid=71874) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 16:01:49 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:01:49 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 16:01:49 user nova-compute[71874]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 16:01:49 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2623689-6f38-4d6c-871e-bdec09015aa0]: (4, '') {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:01:49 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.lightos [None req-bbed4048-4927-42b3-adfd-56163d11e8c8 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71874) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 16:01:49 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.lightos [None req-bbed4048-4927-42b3-adfd-56163d11e8c8 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71874) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 16:01:49 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.lightos [None req-bbed4048-4927-42b3-adfd-56163d11e8c8 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] LIGHTOS: no hostnqn found. {{(pid=71874) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 16:01:49 user nova-compute[71874]: DEBUG os_brick.utils [None req-bbed4048-4927-42b3-adfd-56163d11e8c8 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:61a48d4489d2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:01:49 user nova-compute[71874]: DEBUG nova.virt.block_device [None req-bbed4048-4927-42b3-adfd-56163d11e8c8 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] [instance: 55aff314-eb5e-4752-af9f-a4021e970cac] Updating existing volume attachment record: 856f9817-696a-438b-a83b-3b98643f03e5 {{(pid=71874) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 16:01:49 user nova-compute[71874]: DEBUG nova.network.neutron [req-5d420f2a-32cd-4a7f-94bc-766a4d631b67 req-e51cffb5-ec83-4b74-b080-5e6985762932 service nova] [instance: 55aff314-eb5e-4752-af9f-a4021e970cac] Updated VIF entry in instance network info cache for port 9e66bcb0-73bf-4d5e-b20a-b26443302fca. {{(pid=71874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 16:01:49 user nova-compute[71874]: DEBUG nova.network.neutron [req-5d420f2a-32cd-4a7f-94bc-766a4d631b67 req-e51cffb5-ec83-4b74-b080-5e6985762932 service nova] [instance: 55aff314-eb5e-4752-af9f-a4021e970cac] Updating instance_info_cache with network_info: [{"id": "4a51084d-9fff-4a53-9387-4542bfd6a4a7", "address": "fa:16:3e:5a:aa:4d", "network": {"id": "95c64a1b-8b44-403f-8c4c-32730720d7a7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-87023330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8197a98d7ebc4230899aca82b073ab15", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a51084d-9f", "ovs_interfaceid": "4a51084d-9fff-4a53-9387-4542bfd6a4a7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9e66bcb0-73bf-4d5e-b20a-b26443302fca", "address": "fa:16:3e:59:6e:ba", "network": {"id": "4080a87a-33fc-4ac1-a7a0-a514db7dcb08", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-699748812", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "8197a98d7ebc4230899aca82b073ab15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e66bcb0-73", "ovs_interfaceid": "9e66bcb0-73bf-4d5e-b20a-b26443302fca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:01:49 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-5d420f2a-32cd-4a7f-94bc-766a4d631b67 req-e51cffb5-ec83-4b74-b080-5e6985762932 service nova] Releasing lock "refresh_cache-55aff314-eb5e-4752-af9f-a4021e970cac" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:01:49 user nova-compute[71874]: DEBUG nova.compute.manager [req-5d420f2a-32cd-4a7f-94bc-766a4d631b67 req-e51cffb5-ec83-4b74-b080-5e6985762932 service nova] [instance: 55aff314-eb5e-4752-af9f-a4021e970cac] Received event network-vif-plugged-9e66bcb0-73bf-4d5e-b20a-b26443302fca {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:01:49 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-5d420f2a-32cd-4a7f-94bc-766a4d631b67 req-e51cffb5-ec83-4b74-b080-5e6985762932 service nova] Acquiring lock "55aff314-eb5e-4752-af9f-a4021e970cac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:01:49 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-5d420f2a-32cd-4a7f-94bc-766a4d631b67 req-e51cffb5-ec83-4b74-b080-5e6985762932 service nova] Lock "55aff314-eb5e-4752-af9f-a4021e970cac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:01:49 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-5d420f2a-32cd-4a7f-94bc-766a4d631b67 req-e51cffb5-ec83-4b74-b080-5e6985762932 service nova] Lock "55aff314-eb5e-4752-af9f-a4021e970cac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:01:49 user nova-compute[71874]: DEBUG nova.compute.manager [req-5d420f2a-32cd-4a7f-94bc-766a4d631b67 req-e51cffb5-ec83-4b74-b080-5e6985762932 service nova] [instance: 55aff314-eb5e-4752-af9f-a4021e970cac] No waiting events found dispatching network-vif-plugged-9e66bcb0-73bf-4d5e-b20a-b26443302fca {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:01:49 user nova-compute[71874]: WARNING nova.compute.manager [req-5d420f2a-32cd-4a7f-94bc-766a4d631b67 req-e51cffb5-ec83-4b74-b080-5e6985762932 service nova] [instance: 55aff314-eb5e-4752-af9f-a4021e970cac] Received unexpected event network-vif-plugged-9e66bcb0-73bf-4d5e-b20a-b26443302fca for instance with vm_state active and task_state None.
Apr 12 16:01:49 user nova-compute[71874]: DEBUG nova.compute.manager [req-5d420f2a-32cd-4a7f-94bc-766a4d631b67 req-e51cffb5-ec83-4b74-b080-5e6985762932 service nova] [instance: 55aff314-eb5e-4752-af9f-a4021e970cac] Received event network-vif-plugged-9e66bcb0-73bf-4d5e-b20a-b26443302fca {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:01:49 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-5d420f2a-32cd-4a7f-94bc-766a4d631b67 req-e51cffb5-ec83-4b74-b080-5e6985762932 service nova] Acquiring lock "55aff314-eb5e-4752-af9f-a4021e970cac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:01:49 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-5d420f2a-32cd-4a7f-94bc-766a4d631b67 req-e51cffb5-ec83-4b74-b080-5e6985762932 service nova] Lock "55aff314-eb5e-4752-af9f-a4021e970cac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:01:49 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-5d420f2a-32cd-4a7f-94bc-766a4d631b67 req-e51cffb5-ec83-4b74-b080-5e6985762932 service nova] Lock "55aff314-eb5e-4752-af9f-a4021e970cac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:01:49 user nova-compute[71874]: DEBUG nova.compute.manager [req-5d420f2a-32cd-4a7f-94bc-766a4d631b67 req-e51cffb5-ec83-4b74-b080-5e6985762932 service nova] [instance: 55aff314-eb5e-4752-af9f-a4021e970cac] No waiting events found dispatching network-vif-plugged-9e66bcb0-73bf-4d5e-b20a-b26443302fca {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:01:49 user nova-compute[71874]: WARNING nova.compute.manager [req-5d420f2a-32cd-4a7f-94bc-766a4d631b67 req-e51cffb5-ec83-4b74-b080-5e6985762932 service nova] [instance: 55aff314-eb5e-4752-af9f-a4021e970cac] Received unexpected event network-vif-plugged-9e66bcb0-73bf-4d5e-b20a-b26443302fca for instance with vm_state active and task_state None.
Apr 12 16:01:51 user nova-compute[71874]: DEBUG nova.compute.manager [req-f651cd77-e25e-49c9-a6c7-337c7150c8f9 req-1c0a9e6e-59b2-4667-b750-fbc5bbca1359 service nova] [instance: e85aa869-0d2a-40ff-9697-f979a6b110cb] Received event network-changed-0db939d7-60c3-48af-8d8d-0f5528f41bb6 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:01:51 user nova-compute[71874]: DEBUG nova.compute.manager [req-f651cd77-e25e-49c9-a6c7-337c7150c8f9 req-1c0a9e6e-59b2-4667-b750-fbc5bbca1359 service nova] [instance: e85aa869-0d2a-40ff-9697-f979a6b110cb] Refreshing instance network info cache due to event network-changed-0db939d7-60c3-48af-8d8d-0f5528f41bb6. {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 16:01:51 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-f651cd77-e25e-49c9-a6c7-337c7150c8f9 req-1c0a9e6e-59b2-4667-b750-fbc5bbca1359 service nova] Acquiring lock "refresh_cache-e85aa869-0d2a-40ff-9697-f979a6b110cb" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:01:51 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-f651cd77-e25e-49c9-a6c7-337c7150c8f9 req-1c0a9e6e-59b2-4667-b750-fbc5bbca1359 service nova] Acquired lock "refresh_cache-e85aa869-0d2a-40ff-9697-f979a6b110cb" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:01:51 user nova-compute[71874]: DEBUG nova.network.neutron [req-f651cd77-e25e-49c9-a6c7-337c7150c8f9 req-1c0a9e6e-59b2-4667-b750-fbc5bbca1359 service nova] [instance: e85aa869-0d2a-40ff-9697-f979a6b110cb] Refreshing network info cache for port 0db939d7-60c3-48af-8d8d-0f5528f41bb6 {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 16:01:51 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-58f5cfc4-290d-41ea-9884-3f24c9816f7b tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Acquiring lock "e85aa869-0d2a-40ff-9697-f979a6b110cb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:01:51 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-58f5cfc4-290d-41ea-9884-3f24c9816f7b tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Lock "e85aa869-0d2a-40ff-9697-f979a6b110cb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:01:51 user nova-compute[71874]: DEBUG nova.objects.instance [None req-58f5cfc4-290d-41ea-9884-3f24c9816f7b tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Lazy-loading 'flavor' on Instance uuid e85aa869-0d2a-40ff-9697-f979a6b110cb {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:01:51 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-58f5cfc4-290d-41ea-9884-3f24c9816f7b tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Lock "e85aa869-0d2a-40ff-9697-f979a6b110cb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.077s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:01:51 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-58f5cfc4-290d-41ea-9884-3f24c9816f7b tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Acquiring lock "e85aa869-0d2a-40ff-9697-f979a6b110cb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:01:51 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-58f5cfc4-290d-41ea-9884-3f24c9816f7b tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Lock "e85aa869-0d2a-40ff-9697-f979a6b110cb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:01:51 user nova-compute[71874]: INFO nova.compute.manager [None req-58f5cfc4-290d-41ea-9884-3f24c9816f7b tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] [instance: e85aa869-0d2a-40ff-9697-f979a6b110cb] Attaching volume 5403a600-a3bb-44d7-b9b8-bf933454ca76 to /dev/vdb
Apr 12 16:01:51 user nova-compute[71874]: DEBUG os_brick.utils [None req-58f5cfc4-290d-41ea-9884-3f24c9816f7b tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:01:51 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:01:51 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:01:51 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[785244b5-48e9-40ee-851d-ed8190ee1cdb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:61a48d4489d2\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:01:51 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:01:51 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.027s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:01:51 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[0faff8c7-dca9-4926-a206-178d354b0e2c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:01:51 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:01:51 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.044s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:01:51 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[af51fc00-8946-4e66-9357-3923ba40fae8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:01:51 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[22c01b50-2dcd-4108-891b-3a46c2a9f0e6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:01:51 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-58f5cfc4-290d-41ea-9884-3f24c9816f7b tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Running cmd (subprocess): nvme version {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:01:51 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-58f5cfc4-290d-41ea-9884-3f24c9816f7b tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] 'nvme version' failed. Not Retrying. {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 16:01:51 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.nvmeof [None req-58f5cfc4-290d-41ea-9884-3f24c9816f7b tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] nvme not present on system {{(pid=71874) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 16:01:51 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:01:51 user nova-compute[71874]: DEBUG nova.network.neutron [req-f651cd77-e25e-49c9-a6c7-337c7150c8f9 req-1c0a9e6e-59b2-4667-b750-fbc5bbca1359 service nova] [instance: e85aa869-0d2a-40ff-9697-f979a6b110cb] Updated VIF entry in instance network info cache for port 0db939d7-60c3-48af-8d8d-0f5528f41bb6. {{(pid=71874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 16:01:51 user nova-compute[71874]: DEBUG nova.network.neutron [req-f651cd77-e25e-49c9-a6c7-337c7150c8f9 req-1c0a9e6e-59b2-4667-b750-fbc5bbca1359 service nova] [instance: e85aa869-0d2a-40ff-9697-f979a6b110cb] Updating instance_info_cache with network_info: [{"id": "0db939d7-60c3-48af-8d8d-0f5528f41bb6", "address": "fa:16:3e:c9:39:5d", "network": {"id": "1316768e-1461-4bd9-b6df-2a43928b62b2", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1176895361-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a8e21d4dae04fd08951f8306cff0624", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0db939d7-60", "ovs_interfaceid": "0db939d7-60c3-48af-8d8d-0f5528f41bb6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:01:51 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 16:01:51 user nova-compute[71874]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 16:01:51 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdb1900f-38b1-4978-b1fa-175e2aadb209]: (4, '') {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:01:51 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.lightos [None req-58f5cfc4-290d-41ea-9884-3f24c9816f7b tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71874) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 16:01:51 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.lightos [None req-58f5cfc4-290d-41ea-9884-3f24c9816f7b tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71874) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 16:01:51 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.lightos [None req-58f5cfc4-290d-41ea-9884-3f24c9816f7b tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] LIGHTOS: no hostnqn found. {{(pid=71874) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 16:01:51 user nova-compute[71874]: DEBUG os_brick.utils [None req-58f5cfc4-290d-41ea-9884-3f24c9816f7b tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] <== get_connector_properties: return (154ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:61a48d4489d2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:01:51 user nova-compute[71874]: DEBUG nova.virt.block_device [None req-58f5cfc4-290d-41ea-9884-3f24c9816f7b tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] [instance: e85aa869-0d2a-40ff-9697-f979a6b110cb] Updating existing volume attachment record: 0e592171-1ad5-4151-adcc-f42a09ffc53f {{(pid=71874) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 16:01:51 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-f651cd77-e25e-49c9-a6c7-337c7150c8f9 req-1c0a9e6e-59b2-4667-b750-fbc5bbca1359 service nova] Releasing lock "refresh_cache-e85aa869-0d2a-40ff-9697-f979a6b110cb" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:01:52 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:01:52 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:01:53 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bbed4048-4927-42b3-adfd-56163d11e8c8 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] [instance: 55aff314-eb5e-4752-af9f-a4021e970cac] Calling os-brick to attach iSCSI Volume {{(pid=71874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 16:01:53 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbed4048-4927-42b3-adfd-56163d11e8c8 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3c0216320>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b2f0d62b-ba81-4361-8238-57417c052465', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pJOeSdyv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:01:53 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-bbed4048-4927-42b3-adfd-56163d11e8c8 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:01:53 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-bbed4048-4927-42b3-adfd-56163d11e8c8 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:01:53 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-bbed4048-4927-42b3-adfd-56163d11e8c8 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:01:53 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-bbed4048-4927-42b3-adfd-56163d11e8c8 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:01:53 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-bbed4048-4927-42b3-adfd-56163d11e8c8 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b2f0d62b-ba81-4361-8238-57417c052465" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:01:53 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-bbed4048-4927-42b3-adfd-56163d11e8c8 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b2f0d62b-ba81-4361-8238-57417c052465" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:01:53 user nova-compute[71874]: INFO os_brick.initiator.connectors.iscsi [None req-bbed4048-4927-42b3-adfd-56163d11e8c8 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 16:01:53 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2f0d62b-ba81-4361-8238-57417c052465 -p 172.16.0.220:3260 {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:01:53 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2f0d62b-ba81-4361-8238-57417c052465 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:01:53 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[492f4d56-e6f5-44bc-8db5-4f07a089089c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:01:53 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbed4048-4927-42b3-adfd-56163d11e8c8 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 16:01:53 user nova-compute[71874]:  {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:01:53 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2f0d62b-ba81-4361-8238-57417c052465 -p 172.16.0.220:3260 --interface default --op new {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:01:53 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2f0d62b-ba81-4361-8238-57417c052465 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:01:53 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b6771b7-9667-406e-bbbc-1c3c3b8702e7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b2f0d62b-ba81-4361-8238-57417c052465] added\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:01:53 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbed4048-4927-42b3-adfd-56163d11e8c8 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b2f0d62b-ba81-4361-8238-57417c052465] added
Apr 12 16:01:53 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:01:53 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2f0d62b-ba81-4361-8238-57417c052465 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:01:53 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2f0d62b-ba81-4361-8238-57417c052465 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:01:53 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4f59935-62b1-41ac-ad4e-e07d7c17ef42]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:01:53 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbed4048-4927-42b3-adfd-56163d11e8c8 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:01:53 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2f0d62b-ba81-4361-8238-57417c052465 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:01:53 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2f0d62b-ba81-4361-8238-57417c052465 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:01:53 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[30ae3e83-99ed-4669-9a94-ad2532f35626]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:01:53 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbed4048-4927-42b3-adfd-56163d11e8c8 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:01:53 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2f0d62b-ba81-4361-8238-57417c052465 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pJOeSdyv {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:01:53 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2f0d62b-ba81-4361-8238-57417c052465 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pJOeSdyv" returned: 0 in 0.020s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:01:53 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[cca49439-0b2a-4cda-a960-98645a27d091]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:01:53 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbed4048-4927-42b3-adfd-56163d11e8c8 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pJOeSdyv'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:01:53 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2f0d62b-ba81-4361-8238-57417c052465 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:01:53 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2f0d62b-ba81-4361-8238-57417c052465 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:01:53 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cefeaa4-bb35-497e-9a7d-8ca4fd1c5cd9]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:01:53 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbed4048-4927-42b3-adfd-56163d11e8c8 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:01:53 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:01:53 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:01:53 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd49734f-85c8-4ea5-9e2e-ae7378e6f329]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fde1cb-bd86-48a5-8aca-463fdf3444b0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0100e6d-5149-423c-aadc-0c4f2635196b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6 (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:01:53 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbed4048-4927-42b3-adfd-56163d11e8c8 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 (non-flash)
Apr 12 16:01:53 user nova-compute[71874]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fde1cb-bd86-48a5-8aca-463fdf3444b0 (non-flash)
Apr 12 16:01:53 user nova-compute[71874]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4 (non-flash)
Apr 12 16:01:53 user nova-compute[71874]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0100e6d-5149-423c-aadc-0c4f2635196b (non-flash)
Apr 12 16:01:53 user nova-compute[71874]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4 (non-flash)
Apr 12 16:01:53 user nova-compute[71874]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b (non-flash)
Apr 12 16:01:53 user nova-compute[71874]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd (non-flash)
Apr 12 16:01:53 user nova-compute[71874]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6 (non-flash)
Apr 12 16:01:53 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:01:53 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbed4048-4927-42b3-adfd-56163d11e8c8 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 (non-flash)
Apr 12 16:01:53 user nova-compute[71874]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fde1cb-bd86-48a5-8aca-463fdf3444b0 (non-flash)
Apr 12 16:01:53 user nova-compute[71874]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4 (non-flash)
Apr 12 16:01:53 user nova-compute[71874]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0100e6d-5149-423c-aadc-0c4f2635196b (non-flash)
Apr 12 16:01:53 user nova-compute[71874]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4 (non-flash)
Apr 12 16:01:53 user nova-compute[71874]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b (non-flash)
Apr 12 16:01:53 user nova-compute[71874]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd (non-flash)
Apr 12 16:01:53 user nova-compute[71874]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6 (non-flash)
Apr 12 16:01:53 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:01:53 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2f0d62b-ba81-4361-8238-57417c052465 -p 172.16.0.220:3260 --login {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:01:53 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2f0d62b-ba81-4361-8238-57417c052465 -p 172.16.0.220:3260 --login" returned: 0 in 0.104s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:01:53 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b849c7a-39d7-452f-9f81-0c1ab12eaa36]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b2f0d62b-ba81-4361-8238-57417c052465, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b2f0d62b-ba81-4361-8238-57417c052465, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:01:53 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbed4048-4927-42b3-adfd-56163d11e8c8 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b2f0d62b-ba81-4361-8238-57417c052465, portal: 172.16.0.220,3260]
Apr 12 16:01:53 user nova-compute[71874]: Login to [iface: default, target: iqn.2010-10.org.openstack:b2f0d62b-ba81-4361-8238-57417c052465, portal: 172.16.0.220,3260] successful.
Apr 12 16:01:53 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:01:53 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2f0d62b-ba81-4361-8238-57417c052465 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:01:53 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2f0d62b-ba81-4361-8238-57417c052465 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:01:53 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[b491b015-1abc-4b52-87bc-b686f17edeb9]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:01:53 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbed4048-4927-42b3-adfd-56163d11e8c8 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:01:53 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:01:53 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:01:53 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[61851f6b-b884-4a8a-ae9c-d14b2cc15ea9]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2f0d62b-ba81-4361-8238-57417c052465 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fde1cb-bd86-48a5-8aca-463fdf3444b0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0100e6d-5149-423c-aadc-0c4f2635196b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6 (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:01:53 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbed4048-4927-42b3-adfd-56163d11e8c8 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2f0d62b-ba81-4361-8238-57417c052465 (non-flash)
Apr 12 16:01:53 user nova-compute[71874]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 (non-flash)
Apr 12 16:01:53 user nova-compute[71874]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fde1cb-bd86-48a5-8aca-463fdf3444b0 (non-flash)
Apr 12 16:01:53 user nova-compute[71874]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4 (non-flash)
Apr 12 16:01:53 user nova-compute[71874]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0100e6d-5149-423c-aadc-0c4f2635196b (non-flash)
Apr 12 16:01:53 user nova-compute[71874]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4 (non-flash)
Apr 12 16:01:53 user nova-compute[71874]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b (non-flash)
Apr 12 16:01:53 user nova-compute[71874]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd (non-flash)
Apr 12 16:01:53 user nova-compute[71874]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6 (non-flash)
Apr 12 16:01:53 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:01:53 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbed4048-4927-42b3-adfd-56163d11e8c8 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2f0d62b-ba81-4361-8238-57417c052465 (non-flash)
Apr 12 16:01:53 user nova-compute[71874]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 (non-flash)
Apr 12 16:01:53 user nova-compute[71874]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fde1cb-bd86-48a5-8aca-463fdf3444b0 (non-flash)
Apr 12 16:01:53 user nova-compute[71874]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4 (non-flash)
Apr 12 16:01:53 user nova-compute[71874]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0100e6d-5149-423c-aadc-0c4f2635196b (non-flash)
Apr 12 16:01:53 user nova-compute[71874]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4 (non-flash)
Apr 12 16:01:53 user nova-compute[71874]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b (non-flash)
Apr 12 16:01:53 user nova-compute[71874]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd (non-flash)
Apr 12 16:01:53 user nova-compute[71874]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6 (non-flash)
Apr 12 16:01:53 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:01:53 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-bbed4048-4927-42b3-adfd-56163d11e8c8 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b2f0d62b-ba81-4361-8238-57417c052465" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.350s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:01:53 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbed4048-4927-42b3-adfd-56163d11e8c8 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Connected to 172.16.0.220:3260 {{(pid=71874) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 16:01:53 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-bbed4048-4927-42b3-adfd-56163d11e8c8 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] HCTL ('41', '-', '-', 0) found on session 10 with lun 0 {{(pid=71874) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 16:01:53 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-bbed4048-4927-42b3-adfd-56163d11e8c8 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=71874) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 16:01:54 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:01:54 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.022s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:01:54 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[79163917-94b5-40e1-963c-8320a6c4f6e2]: (4, ('- - 0', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:01:54 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-bbed4048-4927-42b3-adfd-56163d11e8c8 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Searching for a device in session 10 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=71874) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 16:01:54 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbed4048-4927-42b3-adfd-56163d11e8c8 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Connected to sdj using {'target_iqn': 'iqn.2010-10.org.openstack:b2f0d62b-ba81-4361-8238-57417c052465', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pJOeSdyv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71874) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 16:01:55 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-bbed4048-4927-42b3-adfd-56163d11e8c8 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.404s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:01:55 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbed4048-4927-42b3-adfd-56163d11e8c8 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] <== connect_volume: return (1405ms) {'type': 'block', 'scsi_wwn': '23534303532343966', 'path': '/dev/sdj'} {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:01:55 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bbed4048-4927-42b3-adfd-56163d11e8c8 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] [instance: 55aff314-eb5e-4752-af9f-a4021e970cac] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23534303532343966', 'path': '/dev/sdj'} {{(pid=71874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 16:01:55 user nova-compute[71874]: DEBUG nova.objects.instance [None req-bbed4048-4927-42b3-adfd-56163d11e8c8 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Lazy-loading 'flavor' on Instance uuid 55aff314-eb5e-4752-af9f-a4021e970cac {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:01:55 user nova-compute[71874]: DEBUG nova.virt.libvirt.guest [None req-bbed4048-4927-42b3-adfd-56163d11e8c8 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 16:01:55 user nova-compute[71874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 16:01:55 user nova-compute[71874]:   <source dev="/dev/sdj"/>
Apr 12 16:01:55 user nova-compute[71874]:   <target dev="vdb" bus="virtio"/>
Apr 12 16:01:55 user nova-compute[71874]:   <serial>b2f0d62b-ba81-4361-8238-57417c052465</serial>
Apr 12 16:01:55 user nova-compute[71874]: </disk>
Apr 12 16:01:55 user nova-compute[71874]:  {{(pid=71874) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 16:01:55 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-bbed4048-4927-42b3-adfd-56163d11e8c8 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] No BDM found with device name vda, not building metadata. {{(pid=71874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 16:01:55 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-bbed4048-4927-42b3-adfd-56163d11e8c8 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] No BDM found with device name hda, not building metadata. {{(pid=71874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 16:01:55 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-bbed4048-4927-42b3-adfd-56163d11e8c8 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] No VIF found with MAC fa:16:3e:5a:aa:4d, not building metadata {{(pid=71874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 16:01:55 user nova-compute[71874]: DEBUG nova.compute.manager [req-c1f1fdba-614d-4b25-8ed0-23db99b89a67 req-8b4fbc89-f069-4b3e-bfe3-893eb6fbefbd service nova] [instance: 6614f2c0-399b-43d2-86c9-5790c57575e9] Received event network-changed-f1aab2a2-67f1-4ec5-9aeb-dffdec2170e3 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:01:55 user nova-compute[71874]: DEBUG nova.compute.manager [req-c1f1fdba-614d-4b25-8ed0-23db99b89a67 req-8b4fbc89-f069-4b3e-bfe3-893eb6fbefbd service nova] [instance: 6614f2c0-399b-43d2-86c9-5790c57575e9] Refreshing instance network info cache due to event network-changed-f1aab2a2-67f1-4ec5-9aeb-dffdec2170e3. {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 16:01:55 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-c1f1fdba-614d-4b25-8ed0-23db99b89a67 req-8b4fbc89-f069-4b3e-bfe3-893eb6fbefbd service nova] Acquiring lock "refresh_cache-6614f2c0-399b-43d2-86c9-5790c57575e9" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:01:55 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-c1f1fdba-614d-4b25-8ed0-23db99b89a67 req-8b4fbc89-f069-4b3e-bfe3-893eb6fbefbd service nova] Acquired lock "refresh_cache-6614f2c0-399b-43d2-86c9-5790c57575e9" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:01:55 user nova-compute[71874]: DEBUG nova.network.neutron [req-c1f1fdba-614d-4b25-8ed0-23db99b89a67 req-8b4fbc89-f069-4b3e-bfe3-893eb6fbefbd service nova] [instance: 6614f2c0-399b-43d2-86c9-5790c57575e9] Refreshing network info cache for port f1aab2a2-67f1-4ec5-9aeb-dffdec2170e3 {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 16:01:55 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-bbed4048-4927-42b3-adfd-56163d11e8c8 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Lock "55aff314-eb5e-4752-af9f-a4021e970cac" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.789s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:01:56 user nova-compute[71874]: DEBUG nova.network.neutron [req-c1f1fdba-614d-4b25-8ed0-23db99b89a67 req-8b4fbc89-f069-4b3e-bfe3-893eb6fbefbd service nova] [instance: 6614f2c0-399b-43d2-86c9-5790c57575e9] Updated VIF entry in instance network info cache for port f1aab2a2-67f1-4ec5-9aeb-dffdec2170e3. {{(pid=71874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 16:01:56 user nova-compute[71874]: DEBUG nova.network.neutron [req-c1f1fdba-614d-4b25-8ed0-23db99b89a67 req-8b4fbc89-f069-4b3e-bfe3-893eb6fbefbd service nova] [instance: 6614f2c0-399b-43d2-86c9-5790c57575e9] Updating instance_info_cache with network_info: [{"id": "f1aab2a2-67f1-4ec5-9aeb-dffdec2170e3", "address": "fa:16:3e:75:cb:77", "network": {"id": "f4226065-ecee-4c2b-bbaa-df0406d0d0f6", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1167048120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "672dcb2ce6454ab4aeae3de7550ca8e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1aab2a2-67", "ovs_interfaceid": "f1aab2a2-67f1-4ec5-9aeb-dffdec2170e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:01:56 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-c1f1fdba-614d-4b25-8ed0-23db99b89a67 req-8b4fbc89-f069-4b3e-bfe3-893eb6fbefbd service nova] Releasing lock "refresh_cache-6614f2c0-399b-43d2-86c9-5790c57575e9" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:01:56 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58f5cfc4-290d-41ea-9884-3f24c9816f7b tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] [instance: e85aa869-0d2a-40ff-9697-f979a6b110cb] Calling os-brick to attach iSCSI Volume {{(pid=71874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 16:01:56 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-58f5cfc4-290d-41ea-9884-3f24c9816f7b tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3c0216320>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qvyPEgoJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:01:56 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-58f5cfc4-290d-41ea-9884-3f24c9816f7b tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:01:56 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-58f5cfc4-290d-41ea-9884-3f24c9816f7b tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:01:56 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-58f5cfc4-290d-41ea-9884-3f24c9816f7b tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:01:56 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-58f5cfc4-290d-41ea-9884-3f24c9816f7b tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:01:56 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-58f5cfc4-290d-41ea-9884-3f24c9816f7b tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:01:56 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-58f5cfc4-290d-41ea-9884-3f24c9816f7b tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:01:56 user nova-compute[71874]: INFO os_brick.initiator.connectors.iscsi [None req-58f5cfc4-290d-41ea-9884-3f24c9816f7b tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 16:01:56 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76 -p 172.16.0.220:3260 {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:01:56 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:01:56 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[cffd5697-1093-46e4-9ad8-8ddfe2babc68]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:01:56 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-58f5cfc4-290d-41ea-9884-3f24c9816f7b tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 16:01:56 user nova-compute[71874]:  {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:01:56 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76 -p 172.16.0.220:3260 --interface default --op new {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:01:56 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:01:56 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[22ab233e-6d7f-4369-91eb-8e798d7a8e71]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76] added\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:01:56 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-58f5cfc4-290d-41ea-9884-3f24c9816f7b tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76] added
Apr 12 16:01:56 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:01:56 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:01:56 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:01:56 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cb9e8dd-090a-4eb4-92a5-0a5752ed9c8d]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:01:56 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-58f5cfc4-290d-41ea-9884-3f24c9816f7b tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:01:56 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:01:56 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:01:56 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2e7a1e6-efb7-4513-8b35-8a32f38091c3]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:01:56 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-58f5cfc4-290d-41ea-9884-3f24c9816f7b tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:01:56 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qvyPEgoJ {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:01:56 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qvyPEgoJ" returned: 0 in 0.034s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:01:56 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd1d999f-5aba-4441-b3e6-6dbbb57f02a0]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:01:56 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-58f5cfc4-290d-41ea-9884-3f24c9816f7b tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qvyPEgoJ'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:01:56 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:01:57 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:01:57 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c76b77f-94ff-4557-91dc-16e5ddc8c380]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:01:57 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-58f5cfc4-290d-41ea-9884-3f24c9816f7b tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:01:57 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:01:57 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:01:57 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[97c82f0a-ad51-459b-b983-456e94848087]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2f0d62b-ba81-4361-8238-57417c052465 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fde1cb-bd86-48a5-8aca-463fdf3444b0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0100e6d-5149-423c-aadc-0c4f2635196b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6 (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:01:57 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-58f5cfc4-290d-41ea-9884-3f24c9816f7b tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2f0d62b-ba81-4361-8238-57417c052465 (non-flash)
Apr 12 16:01:57 user nova-compute[71874]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 (non-flash)
Apr 12 16:01:57 user nova-compute[71874]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fde1cb-bd86-48a5-8aca-463fdf3444b0 (non-flash)
Apr 12 16:01:57 user nova-compute[71874]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4 (non-flash)
Apr 12 16:01:57 user nova-compute[71874]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0100e6d-5149-423c-aadc-0c4f2635196b (non-flash)
Apr 12 16:01:57 user nova-compute[71874]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4 (non-flash)
Apr 12 16:01:57 user nova-compute[71874]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b (non-flash)
Apr 12 16:01:57 user nova-compute[71874]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd (non-flash)
Apr 12 16:01:57 user nova-compute[71874]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6 (non-flash)
Apr 12 16:01:57 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:01:57 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-58f5cfc4-290d-41ea-9884-3f24c9816f7b tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2f0d62b-ba81-4361-8238-57417c052465 (non-flash)
Apr 12 16:01:57 user nova-compute[71874]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 (non-flash)
Apr 12 16:01:57 user nova-compute[71874]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fde1cb-bd86-48a5-8aca-463fdf3444b0 (non-flash)
Apr 12 16:01:57 user nova-compute[71874]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4 (non-flash)
Apr 12 16:01:57 user nova-compute[71874]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0100e6d-5149-423c-aadc-0c4f2635196b (non-flash)
Apr 12 16:01:57 user nova-compute[71874]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4 (non-flash)
Apr 12 16:01:57 user nova-compute[71874]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b (non-flash)
Apr 12 16:01:57 user nova-compute[71874]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd (non-flash)
Apr 12 16:01:57 user nova-compute[71874]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6 (non-flash)
Apr 12 16:01:57 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:01:57 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76 -p 172.16.0.220:3260 --login {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:01:57 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-bf105eca-bc3d-4303-b97c-adbf0c8787e3 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Acquiring lock "55aff314-eb5e-4752-af9f-a4021e970cac" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:01:57 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-bf105eca-bc3d-4303-b97c-adbf0c8787e3 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Lock "55aff314-eb5e-4752-af9f-a4021e970cac" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:01:57 user nova-compute[71874]: INFO nova.compute.manager [None req-bf105eca-bc3d-4303-b97c-adbf0c8787e3 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] [instance: 55aff314-eb5e-4752-af9f-a4021e970cac] Detaching volume b2f0d62b-ba81-4361-8238-57417c052465
Apr 12 16:01:57 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76 -p 172.16.0.220:3260 --login" returned: 0 in 0.098s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:01:57 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7d1cf0f-90d7-4488-aa01-1de14b155dba]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:01:57 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-58f5cfc4-290d-41ea-9884-3f24c9816f7b tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76, portal: 172.16.0.220,3260]
Apr 12 16:01:57 user nova-compute[71874]: Login to [iface: default, target: iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76, portal: 172.16.0.220,3260] successful.
Apr 12 16:01:57 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:01:57 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:01:57 user nova-compute[71874]: INFO nova.virt.block_device [None req-bf105eca-bc3d-4303-b97c-adbf0c8787e3 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] [instance: 55aff314-eb5e-4752-af9f-a4021e970cac] Attempting to driver detach volume b2f0d62b-ba81-4361-8238-57417c052465 from mountpoint /dev/vdb
Apr 12 16:01:57 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:01:57 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[5148d13a-b4ea-4d9d-8848-03533aa7415a]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:01:57 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-58f5cfc4-290d-41ea-9884-3f24c9816f7b tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:01:57 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-bf105eca-bc3d-4303-b97c-adbf0c8787e3 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Attempting to detach device vdb from instance 55aff314-eb5e-4752-af9f-a4021e970cac from the persistent domain config. {{(pid=71874) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 16:01:57 user nova-compute[71874]: DEBUG nova.virt.libvirt.guest [None req-bf105eca-bc3d-4303-b97c-adbf0c8787e3 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 16:01:57 user nova-compute[71874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 16:01:57 user nova-compute[71874]:   <source dev="/dev/sdj"/>
Apr 12 16:01:57 user nova-compute[71874]:   <target dev="vdb" bus="virtio"/>
Apr 12 16:01:57 user nova-compute[71874]:   <serial>b2f0d62b-ba81-4361-8238-57417c052465</serial>
Apr 12 16:01:57 user nova-compute[71874]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Apr 12 16:01:57 user nova-compute[71874]: </disk>
Apr 12 16:01:57 user nova-compute[71874]:  {{(pid=71874) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 16:01:57 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:01:57 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-bf105eca-bc3d-4303-b97c-adbf0c8787e3 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Successfully detached device vdb from instance 55aff314-eb5e-4752-af9f-a4021e970cac from the persistent domain config.
Apr 12 16:01:57 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-bf105eca-bc3d-4303-b97c-adbf0c8787e3 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 55aff314-eb5e-4752-af9f-a4021e970cac from the live domain config. {{(pid=71874) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 16:01:57 user nova-compute[71874]: DEBUG nova.virt.libvirt.guest [None req-bf105eca-bc3d-4303-b97c-adbf0c8787e3 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 16:01:57 user nova-compute[71874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 16:01:57 user nova-compute[71874]:   <source dev="/dev/sdj"/>
Apr 12 16:01:57 user nova-compute[71874]:   <target dev="vdb" bus="virtio"/>
Apr 12 16:01:57 user nova-compute[71874]:   <serial>b2f0d62b-ba81-4361-8238-57417c052465</serial>
Apr 12 16:01:57 user nova-compute[71874]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Apr 12 16:01:57 user nova-compute[71874]: </disk>
Apr 12 16:01:57 user nova-compute[71874]:  {{(pid=71874) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 16:01:57 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:01:57 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d6c8f2b-7ee1-4675-90b0-5bccd8ce90c6]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2f0d62b-ba81-4361-8238-57417c052465 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fde1cb-bd86-48a5-8aca-463fdf3444b0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0100e6d-5149-423c-aadc-0c4f2635196b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6 (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:01:57 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-58f5cfc4-290d-41ea-9884-3f24c9816f7b tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2f0d62b-ba81-4361-8238-57417c052465 (non-flash)
Apr 12 16:01:57 user nova-compute[71874]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76 (non-flash)
Apr 12 16:01:57 user nova-compute[71874]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 (non-flash)
Apr 12 16:01:57 user nova-compute[71874]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fde1cb-bd86-48a5-8aca-463fdf3444b0 (non-flash)
Apr 12 16:01:57 user nova-compute[71874]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4 (non-flash)
Apr 12 16:01:57 user nova-compute[71874]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0100e6d-5149-423c-aadc-0c4f2635196b (non-flash)
Apr 12 16:01:57 user nova-compute[71874]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4 (non-flash)
Apr 12 16:01:57 user nova-compute[71874]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b (non-flash)
Apr 12 16:01:57 user nova-compute[71874]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd (non-flash)
Apr 12 16:01:57 user nova-compute[71874]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6 (non-flash)
Apr 12 16:01:57 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:01:57 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-58f5cfc4-290d-41ea-9884-3f24c9816f7b tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2f0d62b-ba81-4361-8238-57417c052465 (non-flash)
Apr 12 16:01:57 user nova-compute[71874]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76 (non-flash)
Apr 12 16:01:57 user nova-compute[71874]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 (non-flash)
Apr 12 16:01:57 user nova-compute[71874]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fde1cb-bd86-48a5-8aca-463fdf3444b0 (non-flash)
Apr 12 16:01:57 user nova-compute[71874]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4 (non-flash)
Apr 12 16:01:57 user nova-compute[71874]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0100e6d-5149-423c-aadc-0c4f2635196b (non-flash)
Apr 12 16:01:57 user nova-compute[71874]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4 (non-flash)
Apr 12 16:01:57 user nova-compute[71874]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b (non-flash)
Apr 12 16:01:57 user nova-compute[71874]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd (non-flash)
Apr 12 16:01:57 user nova-compute[71874]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6 (non-flash)
Apr 12 16:01:57 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:01:57 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-58f5cfc4-290d-41ea-9884-3f24c9816f7b tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.385s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:01:57 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-58f5cfc4-290d-41ea-9884-3f24c9816f7b tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Connected to 172.16.0.220:3260 {{(pid=71874) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 16:01:57 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-58f5cfc4-290d-41ea-9884-3f24c9816f7b tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] HCTL ('42', '-', '-', 0) found on session 11 with lun 0 {{(pid=71874) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 16:01:57 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-58f5cfc4-290d-41ea-9884-3f24c9816f7b tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Scanning host 42 c: -, t: -, l: 0) {{(pid=71874) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 16:01:57 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host42/scan {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:01:57 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host42/scan" returned: 0 in 0.016s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:01:57 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[78b55dfe-71c0-4411-a436-d19cff1aef8f]: (4, ('- - 0', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:01:57 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-58f5cfc4-290d-41ea-9884-3f24c9816f7b tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Searching for a device in session 11 and hctl ['42', '*', '*', 0] yield: sdk {{(pid=71874) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 16:01:57 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-58f5cfc4-290d-41ea-9884-3f24c9816f7b tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Connected to sdk using {'target_iqn': 'iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qvyPEgoJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71874) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 16:01:57 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:01:57 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Received event <DeviceRemovedEvent: 1681315317.6321554, 55aff314-eb5e-4752-af9f-a4021e970cac => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71874) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 16:01:57 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-bf105eca-bc3d-4303-b97c-adbf0c8787e3 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 55aff314-eb5e-4752-af9f-a4021e970cac {{(pid=71874) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 16:01:57 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-bf105eca-bc3d-4303-b97c-adbf0c8787e3 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Successfully detached device vdb from instance 55aff314-eb5e-4752-af9f-a4021e970cac from the live domain config.
Apr 12 16:01:57 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf105eca-bc3d-4303-b97c-adbf0c8787e3 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] [instance: 55aff314-eb5e-4752-af9f-a4021e970cac] calling os-brick to detach iSCSI Volume {{(pid=71874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 16:01:57 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf105eca-bc3d-4303-b97c-adbf0c8787e3 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3c0216320>, {'target_iqn': 'iqn.2010-10.org.openstack:b2f0d62b-ba81-4361-8238-57417c052465', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pJOeSdyv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj': {}}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:01:57 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-bf105eca-bc3d-4303-b97c-adbf0c8787e3 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:01:57 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-bf105eca-bc3d-4303-b97c-adbf0c8787e3 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:01:57 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:01:58 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-f75ebf76-12ce-4b6a-8582-c842f15bf6b2 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Acquiring lock "6614f2c0-399b-43d2-86c9-5790c57575e9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:01:58 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-f75ebf76-12ce-4b6a-8582-c842f15bf6b2 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Lock "6614f2c0-399b-43d2-86c9-5790c57575e9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:01:58 user nova-compute[71874]: DEBUG nova.objects.instance [None req-f75ebf76-12ce-4b6a-8582-c842f15bf6b2 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Lazy-loading 'flavor' on Instance uuid 6614f2c0-399b-43d2-86c9-5790c57575e9 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:01:58 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-f75ebf76-12ce-4b6a-8582-c842f15bf6b2 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Lock "6614f2c0-399b-43d2-86c9-5790c57575e9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:01:58 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-58f5cfc4-290d-41ea-9884-3f24c9816f7b tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.422s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:01:58 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-58f5cfc4-290d-41ea-9884-3f24c9816f7b tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] <== connect_volume: return (1423ms) {'type': 'block', 'scsi_wwn': '23461313538333964', 'path': '/dev/sdk'} {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:01:58 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58f5cfc4-290d-41ea-9884-3f24c9816f7b tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] [instance: e85aa869-0d2a-40ff-9697-f979a6b110cb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23461313538333964', 'path': '/dev/sdk'} {{(pid=71874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 16:01:58 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-bf105eca-bc3d-4303-b97c-adbf0c8787e3 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.629s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:01:58 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:01:58 user nova-compute[71874]: DEBUG nova.objects.instance [None req-58f5cfc4-290d-41ea-9884-3f24c9816f7b tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Lazy-loading 'flavor' on Instance uuid e85aa869-0d2a-40ff-9697-f979a6b110cb {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:01:58 user nova-compute[71874]: DEBUG nova.virt.libvirt.guest [None req-58f5cfc4-290d-41ea-9884-3f24c9816f7b tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 16:01:58 user nova-compute[71874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 16:01:58 user nova-compute[71874]:   <source dev="/dev/sdk"/>
Apr 12 16:01:58 user nova-compute[71874]:   <target dev="vdb" bus="virtio"/>
Apr 12 16:01:58 user nova-compute[71874]:   <serial>5403a600-a3bb-44d7-b9b8-bf933454ca76</serial>
Apr 12 16:01:58 user nova-compute[71874]: </disk>
Apr 12 16:01:58 user nova-compute[71874]:  {{(pid=71874) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 16:01:58 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.035s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:01:58 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eaf22b2-273f-4912-a650-8a5cc50f0e58]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a0100e6d-5149-423c-aadc-0c4f2635196b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b2fde1cb-bd86-48a5-8aca-463fdf3444b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b2f0d62b-ba81-4361-8238-57417c052465\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:01:58 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf105eca-bc3d-4303-b97c-adbf0c8787e3 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 16:01:58 user nova-compute[71874]: No targets found.
Apr 12 16:01:58 user nova-compute[71874]: iSNS:
Apr 12 16:01:58 user nova-compute[71874]: No targets found.
Apr 12 16:01:58 user nova-compute[71874]: STATIC:
Apr 12 16:01:58 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:a0100e6d-5149-423c-aadc-0c4f2635196b
Apr 12 16:01:58 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:01:58 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:01:58 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2
Apr 12 16:01:58 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:01:58 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:01:58 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76
Apr 12 16:01:58 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:01:58 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:01:58 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4
Apr 12 16:01:58 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:01:58 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:01:58 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd
Apr 12 16:01:58 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:01:58 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:01:58 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:b2fde1cb-bd86-48a5-8aca-463fdf3444b0
Apr 12 16:01:58 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:01:58 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:01:58 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:b2f0d62b-ba81-4361-8238-57417c052465
Apr 12 16:01:58 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:01:58 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:01:58 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6
Apr 12 16:01:58 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:01:58 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:01:58 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4
Apr 12 16:01:58 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:01:58 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:01:58 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b
Apr 12 16:01:58 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:01:58 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:01:58 user nova-compute[71874]: FIRMWARE:
Apr 12 16:01:58 user nova-compute[71874]: No targets found.
Apr 12 16:01:58 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:01:58 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf105eca-bc3d-4303-b97c-adbf0c8787e3 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 16:01:58 user nova-compute[71874]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 16:01:58 user nova-compute[71874]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71874) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 16:01:58 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf105eca-bc3d-4303-b97c-adbf0c8787e3 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b2f0d62b-ba81-4361-8238-57417c052465', 0)] {{(pid=71874) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 16:01:58 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:01:58 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:01:58 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[bed58ec0-067e-4290-9564-6354d129a080]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a0100e6d-5149-423c-aadc-0c4f2635196b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2f0d62b-ba81-4361-8238-57417c052465\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2fde1cb-bd86-48a5-8aca-463fdf3444b0\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:01:58 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:01:58 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-f75ebf76-12ce-4b6a-8582-c842f15bf6b2 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Acquiring lock "6614f2c0-399b-43d2-86c9-5790c57575e9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:01:58 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-f75ebf76-12ce-4b6a-8582-c842f15bf6b2 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Lock "6614f2c0-399b-43d2-86c9-5790c57575e9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:01:58 user nova-compute[71874]: INFO nova.compute.manager [None req-f75ebf76-12ce-4b6a-8582-c842f15bf6b2 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] [instance: 6614f2c0-399b-43d2-86c9-5790c57575e9] Attaching volume 2a81326c-a5ae-4b84-a746-2f4efd7335eb to /dev/sdc
Apr 12 16:01:58 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:01:58 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9574094-10f1-4622-8df7-605dbbc629eb]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2f0d62b-ba81-4361-8238-57417c052465 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fde1cb-bd86-48a5-8aca-463fdf3444b0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0100e6d-5149-423c-aadc-0c4f2635196b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6 (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:01:58 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf105eca-bc3d-4303-b97c-adbf0c8787e3 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2f0d62b-ba81-4361-8238-57417c052465 (non-flash)
Apr 12 16:01:58 user nova-compute[71874]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76 (non-flash)
Apr 12 16:01:58 user nova-compute[71874]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 (non-flash)
Apr 12 16:01:58 user nova-compute[71874]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fde1cb-bd86-48a5-8aca-463fdf3444b0 (non-flash)
Apr 12 16:01:58 user nova-compute[71874]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4 (non-flash)
Apr 12 16:01:58 user nova-compute[71874]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0100e6d-5149-423c-aadc-0c4f2635196b (non-flash)
Apr 12 16:01:58 user nova-compute[71874]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4 (non-flash)
Apr 12 16:01:58 user nova-compute[71874]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b (non-flash)
Apr 12 16:01:58 user nova-compute[71874]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd (non-flash)
Apr 12 16:01:58 user nova-compute[71874]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6 (non-flash)
Apr 12 16:01:58 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:01:58 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf105eca-bc3d-4303-b97c-adbf0c8787e3 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2f0d62b-ba81-4361-8238-57417c052465 (non-flash)
Apr 12 16:01:58 user nova-compute[71874]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76 (non-flash)
Apr 12 16:01:58 user nova-compute[71874]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 (non-flash)
Apr 12 16:01:58 user nova-compute[71874]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fde1cb-bd86-48a5-8aca-463fdf3444b0 (non-flash)
Apr 12 16:01:58 user nova-compute[71874]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4 (non-flash)
Apr 12 16:01:58 user nova-compute[71874]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0100e6d-5149-423c-aadc-0c4f2635196b (non-flash)
Apr 12 16:01:58 user nova-compute[71874]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4 (non-flash)
Apr 12 16:01:58 user nova-compute[71874]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b (non-flash)
Apr 12 16:01:58 user nova-compute[71874]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd (non-flash)
Apr 12 16:01:58 user nova-compute[71874]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6 (non-flash)
Apr 12 16:01:58 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:01:58 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf105eca-bc3d-4303-b97c-adbf0c8787e3 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc3d4476440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b2f0d62b-ba81-4361-8238-57417c052465'): ({'sdj'}, set())}) {{(pid=71874) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 16:01:58 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-bf105eca-bc3d-4303-b97c-adbf0c8787e3 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Removing single pathed devices sdj {{(pid=71874) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 16:01:58 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:01:58 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:01:58 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[c14e0a13-24f4-4984-96e4-a25479de5608]: (4, ('path checker states:\nup                  10\n\npaths: 0\nbusy: False\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:01:58 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:01:58 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.020s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:01:58 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[693b54fb-713f-42ed-a506-cbda0fe02ea4]: (4, ('ok\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:01:58 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-bf105eca-bc3d-4303-b97c-adbf0c8787e3 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Flushing IO for device /dev/sdj {{(pid=71874) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 16:01:58 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:01:58 user nova-compute[71874]: DEBUG os_brick.utils [None req-f75ebf76-12ce-4b6a-8582-c842f15bf6b2 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:01:58 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:01:58 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.016s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:01:58 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a159ff4-d55d-4a2f-b865-99b582d22b87]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:01:58 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-bf105eca-bc3d-4303-b97c-adbf0c8787e3 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=71874) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 16:01:58 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:01:58 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:01:58 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bb43b33-6316-43d0-88ec-d404ed4ae63d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:61a48d4489d2\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:01:58 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:01:58 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:01:58 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[f601b48c-fa37-4e46-8acd-dbad516e18cd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:01:58 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:01:58 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.048s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:01:58 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[20078fb2-e76f-4e2c-ac7f-12b4a49dba50]: (4, ('1', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:01:58 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-bf105eca-bc3d-4303-b97c-adbf0c8787e3 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=71874) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 16:01:58 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-bf105eca-bc3d-4303-b97c-adbf0c8787e3 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] SCSI volumes sdj have been removed. {{(pid=71874) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 16:01:58 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf105eca-bc3d-4303-b97c-adbf0c8787e3 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b2f0d62b-ba81-4361-8238-57417c052465')] {{(pid=71874) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 16:01:58 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:01:58 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[b19092a9-02d9-4139-9202-e3a261410e99]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:01:58 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2f0d62b-ba81-4361-8238-57417c052465 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:01:58 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d9b5863-f666-414f-b7d8-17fbd6c9bf2d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:01:58 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-f75ebf76-12ce-4b6a-8582-c842f15bf6b2 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Running cmd (subprocess): nvme version {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:01:58 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-f75ebf76-12ce-4b6a-8582-c842f15bf6b2 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] 'nvme version' failed. Not Retrying. {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 16:01:58 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2f0d62b-ba81-4361-8238-57417c052465 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:01:58 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[60bbaed6-1cc3-412b-8129-7be3978f9e4e]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:01:58 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f75ebf76-12ce-4b6a-8582-c842f15bf6b2 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] nvme not present on system {{(pid=71874) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 16:01:58 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf105eca-bc3d-4303-b97c-adbf0c8787e3 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:01:58 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:01:58 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2f0d62b-ba81-4361-8238-57417c052465 -p 172.16.0.220:3260 --logout {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:01:58 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 16:01:58 user nova-compute[71874]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 16:01:58 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[502aed05-a59d-4e99-a0ed-37d688f6f9c9]: (4, '') {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:01:58 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.lightos [None req-f75ebf76-12ce-4b6a-8582-c842f15bf6b2 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71874) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 16:01:58 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.lightos [None req-f75ebf76-12ce-4b6a-8582-c842f15bf6b2 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71874) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 16:01:58 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.lightos [None req-f75ebf76-12ce-4b6a-8582-c842f15bf6b2 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] LIGHTOS: no hostnqn found. {{(pid=71874) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 16:01:58 user nova-compute[71874]: DEBUG os_brick.utils [None req-f75ebf76-12ce-4b6a-8582-c842f15bf6b2 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] <== get_connector_properties: return (147ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:61a48d4489d2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:01:58 user nova-compute[71874]: DEBUG nova.virt.block_device [None req-f75ebf76-12ce-4b6a-8582-c842f15bf6b2 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] [instance: 6614f2c0-399b-43d2-86c9-5790c57575e9] Updating existing volume attachment record: 9f5e7e2f-8793-4e7a-bb21-2a4110522e5f {{(pid=71874) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 16:01:58 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2f0d62b-ba81-4361-8238-57417c052465 -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:01:58 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecf56874-52da-441f-aa41-fba107d93480]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:b2f0d62b-ba81-4361-8238-57417c052465, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:b2f0d62b-ba81-4361-8238-57417c052465, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:01:58 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf105eca-bc3d-4303-b97c-adbf0c8787e3 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:b2f0d62b-ba81-4361-8238-57417c052465, portal: 172.16.0.220,3260]
Apr 12 16:01:58 user nova-compute[71874]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:b2f0d62b-ba81-4361-8238-57417c052465, portal: 172.16.0.220,3260] successful.
Apr 12 16:01:58 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:01:58 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2f0d62b-ba81-4361-8238-57417c052465 -p 172.16.0.220:3260 --op delete {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:01:58 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2f0d62b-ba81-4361-8238-57417c052465 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.049s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:01:58 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[a53eee07-daa3-4180-8743-ca479a27056f]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:01:58 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf105eca-bc3d-4303-b97c-adbf0c8787e3 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:01:58 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-bf105eca-bc3d-4303-b97c-adbf0c8787e3 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.432s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:01:58 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf105eca-bc3d-4303-b97c-adbf0c8787e3 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] <== disconnect_volume: return (1061ms) None {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:01:58 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf105eca-bc3d-4303-b97c-adbf0c8787e3 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] [instance: 55aff314-eb5e-4752-af9f-a4021e970cac] Disconnected iSCSI Volume {{(pid=71874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 16:01:58 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-58f5cfc4-290d-41ea-9884-3f24c9816f7b tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] No BDM found with device name vda, not building metadata. {{(pid=71874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 16:01:58 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-58f5cfc4-290d-41ea-9884-3f24c9816f7b tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 16:01:58 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-58f5cfc4-290d-41ea-9884-3f24c9816f7b tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] No VIF found with MAC fa:16:3e:c9:39:5d, not building metadata {{(pid=71874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 16:01:58 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-58f5cfc4-290d-41ea-9884-3f24c9816f7b tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Lock "e85aa869-0d2a-40ff-9697-f979a6b110cb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.131s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:01:59 user nova-compute[71874]: DEBUG nova.objects.instance [None req-bf105eca-bc3d-4303-b97c-adbf0c8787e3 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Lazy-loading 'flavor' on Instance uuid 55aff314-eb5e-4752-af9f-a4021e970cac {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:01:59 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-bf105eca-bc3d-4303-b97c-adbf0c8787e3 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Lock "55aff314-eb5e-4752-af9f-a4021e970cac" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.613s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:01:59 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-f83ad43f-2a40-4495-8c27-2de4281dba36 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] Acquiring lock "e85aa869-0d2a-40ff-9697-f979a6b110cb" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:01:59 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-f83ad43f-2a40-4495-8c27-2de4281dba36 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] Lock "e85aa869-0d2a-40ff-9697-f979a6b110cb" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:01:59 user nova-compute[71874]: DEBUG os_brick.utils [None req-f83ad43f-2a40-4495-8c27-2de4281dba36 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:01:59 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:01:59 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:01:59 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[bab98b10-b920-486e-912b-f030d5bcd37c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:61a48d4489d2\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:01:59 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:00 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:00 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eabec68-786c-4772-836d-d4d9467508f5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:00 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:00 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:00 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[f999000e-a7e7-4332-8792-3ae9242bbf6c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:00 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bb14f0a-6e92-46c2-8e5c-76d8849dbfc1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:00 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-f83ad43f-2a40-4495-8c27-2de4281dba36 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] Running cmd (subprocess): nvme version {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:00 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-f83ad43f-2a40-4495-8c27-2de4281dba36 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] 'nvme version' failed. Not Retrying. {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 16:02:00 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f83ad43f-2a40-4495-8c27-2de4281dba36 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] nvme not present on system {{(pid=71874) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 16:02:00 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:00 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 16:02:00 user nova-compute[71874]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 16:02:00 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f155ab4-43d6-4dd3-8800-5d456258fc45]: (4, '') {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:00 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.lightos [None req-f83ad43f-2a40-4495-8c27-2de4281dba36 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71874) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 16:02:00 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.lightos [None req-f83ad43f-2a40-4495-8c27-2de4281dba36 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71874) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 16:02:00 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.lightos [None req-f83ad43f-2a40-4495-8c27-2de4281dba36 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] LIGHTOS: no hostnqn found. {{(pid=71874) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 16:02:00 user nova-compute[71874]: DEBUG os_brick.utils [None req-f83ad43f-2a40-4495-8c27-2de4281dba36 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:61a48d4489d2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:02:00 user nova-compute[71874]: INFO nova.compute.manager [None req-f83ad43f-2a40-4495-8c27-2de4281dba36 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] [instance: e85aa869-0d2a-40ff-9697-f979a6b110cb] Swapping volume 5403a600-a3bb-44d7-b9b8-bf933454ca76 for 5894d073-fc1e-467b-99c4-290106eeea63
Apr 12 16:02:00 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-80084f5b-26ab-40bf-956d-0f0c04199362 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Acquiring lock "interface-55aff314-eb5e-4752-af9f-a4021e970cac-9e66bcb0-73bf-4d5e-b20a-b26443302fca" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:02:00 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-80084f5b-26ab-40bf-956d-0f0c04199362 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Lock "interface-55aff314-eb5e-4752-af9f-a4021e970cac-9e66bcb0-73bf-4d5e-b20a-b26443302fca" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:02:00 user nova-compute[71874]: DEBUG nova.objects.instance [None req-80084f5b-26ab-40bf-956d-0f0c04199362 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Lazy-loading 'flavor' on Instance uuid 55aff314-eb5e-4752-af9f-a4021e970cac {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:02:00 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-80084f5b-26ab-40bf-956d-0f0c04199362 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T15:59:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1331285489',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1331285489',id=7,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEJbHdIj6Qnsbz5sPRJ4ye2dl2IsI8e0vfQ09uKxN501bN+DgkHVMylQpwrl7ZvLZ8swmrO3BjtPpMg/5nOMgbnum5uHS/qZKbdglyI6E6LnkEx0Cctk5Q87Mk68+Dgi4A==',key_name='tempest-keypair-2057580771',keypairs=<?>,launch_index=0,launched_at=2023-04-12T16:00:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8197a98d7ebc4230899aca82b073ab15',ramdisk_id='',reservation_id='r-ncvxejnb',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-475014275',owner_user_name='tempest-TaggedAttachmentsTest-475014275-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T16:00:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='324eb9033e62405ca2b322bcb6da9a04',uuid=55aff314-eb5e-4752-af9f-a4021e970cac,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9e66bcb0-73bf-4d5e-b20a-b26443302fca", "address": "fa:16:3e:59:6e:ba", "network": {"id": "4080a87a-33fc-4ac1-a7a0-a514db7dcb08", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-699748812", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "8197a98d7ebc4230899aca82b073ab15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e66bcb0-73", "ovs_interfaceid": "9e66bcb0-73bf-4d5e-b20a-b26443302fca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 16:02:00 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-80084f5b-26ab-40bf-956d-0f0c04199362 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Converting VIF {"id": "9e66bcb0-73bf-4d5e-b20a-b26443302fca", "address": "fa:16:3e:59:6e:ba", "network": {"id": "4080a87a-33fc-4ac1-a7a0-a514db7dcb08", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-699748812", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "8197a98d7ebc4230899aca82b073ab15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e66bcb0-73", "ovs_interfaceid": "9e66bcb0-73bf-4d5e-b20a-b26443302fca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:02:00 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-80084f5b-26ab-40bf-956d-0f0c04199362 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:59:6e:ba,bridge_name='br-int',has_traffic_filtering=True,id=9e66bcb0-73bf-4d5e-b20a-b26443302fca,network=Network(4080a87a-33fc-4ac1-a7a0-a514db7dcb08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e66bcb0-73') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:02:00 user nova-compute[71874]: DEBUG nova.virt.libvirt.guest [None req-80084f5b-26ab-40bf-956d-0f0c04199362 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:59:6e:ba"/><model type="virtio"/><mtu size="1442"/><target dev="tap9e66bcb0-73"/></interface> {{(pid=71874) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 12 16:02:00 user nova-compute[71874]: DEBUG nova.virt.libvirt.guest [None req-80084f5b-26ab-40bf-956d-0f0c04199362 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:59:6e:ba"/><model type="virtio"/><mtu size="1442"/><target dev="tap9e66bcb0-73"/></interface> {{(pid=71874) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 12 16:02:00 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-80084f5b-26ab-40bf-956d-0f0c04199362 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Attempting to detach device tap9e66bcb0-73 from instance 55aff314-eb5e-4752-af9f-a4021e970cac from the persistent domain config. {{(pid=71874) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 16:02:00 user nova-compute[71874]: DEBUG nova.virt.libvirt.guest [None req-80084f5b-26ab-40bf-956d-0f0c04199362 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] detach device xml: <interface type="ethernet">
Apr 12 16:02:00 user nova-compute[71874]:   <mac address="fa:16:3e:59:6e:ba"/>
Apr 12 16:02:00 user nova-compute[71874]:   <model type="virtio"/>
Apr 12 16:02:00 user nova-compute[71874]:   <mtu size="1442"/>
Apr 12 16:02:00 user nova-compute[71874]:   <target dev="tap9e66bcb0-73"/>
Apr 12 16:02:00 user nova-compute[71874]: </interface>
Apr 12 16:02:00 user nova-compute[71874]:  {{(pid=71874) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 16:02:00 user nova-compute[71874]: DEBUG nova.virt.libvirt.guest [None req-80084f5b-26ab-40bf-956d-0f0c04199362 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:59:6e:ba"/><model type="virtio"/><mtu size="1442"/><target dev="tap9e66bcb0-73"/></interface> {{(pid=71874) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 12 16:02:00 user nova-compute[71874]: DEBUG nova.virt.libvirt.guest [None req-80084f5b-26ab-40bf-956d-0f0c04199362 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:59:6e:ba"/><model type="virtio"/><mtu size="1442"/><target dev="tap9e66bcb0-73"/></interface>not found in domain: <domain type='kvm' id='7'>
Apr 12 16:02:00 user nova-compute[71874]:   <name>instance-00000007</name>
Apr 12 16:02:00 user nova-compute[71874]:   <uuid>55aff314-eb5e-4752-af9f-a4021e970cac</uuid>
Apr 12 16:02:00 user nova-compute[71874]:   <metadata>
Apr 12 16:02:00 user nova-compute[71874]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 16:02:00 user nova-compute[71874]:   <nova:package version="0.0.0"/>
Apr 12 16:02:00 user nova-compute[71874]:   <nova:name>tempest-device-tagging-server-1331285489</nova:name>
Apr 12 16:02:00 user nova-compute[71874]:   <nova:creationTime>2023-04-12 16:01:48</nova:creationTime>
Apr 12 16:02:00 user nova-compute[71874]:   <nova:flavor name="m1.nano">
Apr 12 16:02:00 user nova-compute[71874]:     <nova:memory>128</nova:memory>
Apr 12 16:02:00 user nova-compute[71874]:     <nova:disk>1</nova:disk>
Apr 12 16:02:00 user nova-compute[71874]:     <nova:swap>0</nova:swap>
Apr 12 16:02:00 user nova-compute[71874]:     <nova:ephemeral>0</nova:ephemeral>
Apr 12 16:02:00 user nova-compute[71874]:     <nova:vcpus>1</nova:vcpus>
Apr 12 16:02:00 user nova-compute[71874]:   </nova:flavor>
Apr 12 16:02:00 user nova-compute[71874]:   <nova:owner>
Apr 12 16:02:00 user nova-compute[71874]:     <nova:user uuid="324eb9033e62405ca2b322bcb6da9a04">tempest-TaggedAttachmentsTest-475014275-project-member</nova:user>
Apr 12 16:02:00 user nova-compute[71874]:     <nova:project uuid="8197a98d7ebc4230899aca82b073ab15">tempest-TaggedAttachmentsTest-475014275</nova:project>
Apr 12 16:02:00 user nova-compute[71874]:   </nova:owner>
Apr 12 16:02:00 user nova-compute[71874]:   <nova:root type="image" uuid="9dc63f14-8b70-4e72-89f2-13464f2f5c7c"/>
Apr 12 16:02:00 user nova-compute[71874]:   <nova:ports>
Apr 12 16:02:00 user nova-compute[71874]:     <nova:port uuid="4a51084d-9fff-4a53-9387-4542bfd6a4a7">
Apr 12 16:02:00 user nova-compute[71874]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 12 16:02:00 user nova-compute[71874]:     </nova:port>
Apr 12 16:02:00 user nova-compute[71874]:     <nova:port uuid="9e66bcb0-73bf-4d5e-b20a-b26443302fca">
Apr 12 16:02:00 user nova-compute[71874]:       <nova:ip type="fixed" address="10.10.10.120" ipVersion="4"/>
Apr 12 16:02:00 user nova-compute[71874]:     </nova:port>
Apr 12 16:02:00 user nova-compute[71874]:   </nova:ports>
Apr 12 16:02:00 user nova-compute[71874]: </nova:instance>
Apr 12 16:02:00 user nova-compute[71874]:   </metadata>
Apr 12 16:02:00 user nova-compute[71874]:   <memory unit='KiB'>131072</memory>
Apr 12 16:02:00 user nova-compute[71874]:   <currentMemory unit='KiB'>131072</currentMemory>
Apr 12 16:02:00 user nova-compute[71874]:   <vcpu placement='static'>1</vcpu>
Apr 12 16:02:00 user nova-compute[71874]:   <resource>
Apr 12 16:02:00 user nova-compute[71874]:     <partition>/machine</partition>
Apr 12 16:02:00 user nova-compute[71874]:   </resource>
Apr 12 16:02:00 user nova-compute[71874]:   <sysinfo type='smbios'>
Apr 12 16:02:00 user nova-compute[71874]:     <system>
Apr 12 16:02:00 user nova-compute[71874]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Apr 12 16:02:00 user nova-compute[71874]:       <entry name='product'>OpenStack Nova</entry>
Apr 12 16:02:00 user nova-compute[71874]:       <entry name='version'>0.0.0</entry>
Apr 12 16:02:00 user nova-compute[71874]:       <entry name='serial'>55aff314-eb5e-4752-af9f-a4021e970cac</entry>
Apr 12 16:02:00 user nova-compute[71874]:       <entry name='uuid'>55aff314-eb5e-4752-af9f-a4021e970cac</entry>
Apr 12 16:02:00 user nova-compute[71874]:       <entry name='family'>Virtual Machine</entry>
Apr 12 16:02:00 user nova-compute[71874]:     </system>
Apr 12 16:02:00 user nova-compute[71874]:   </sysinfo>
Apr 12 16:02:00 user nova-compute[71874]:   <os>
Apr 12 16:02:00 user nova-compute[71874]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Apr 12 16:02:00 user nova-compute[71874]:     <boot dev='hd'/>
Apr 12 16:02:00 user nova-compute[71874]:     <smbios mode='sysinfo'/>
Apr 12 16:02:00 user nova-compute[71874]:   </os>
Apr 12 16:02:00 user nova-compute[71874]:   <features>
Apr 12 16:02:00 user nova-compute[71874]:     <acpi/>
Apr 12 16:02:00 user nova-compute[71874]:     <apic/>
Apr 12 16:02:00 user nova-compute[71874]:     <vmcoreinfo state='on'/>
Apr 12 16:02:00 user nova-compute[71874]:   </features>
Apr 12 16:02:00 user nova-compute[71874]:   <cpu mode='custom' match='exact' check='full'>
Apr 12 16:02:00 user nova-compute[71874]:     <model fallback='forbid'>Nehalem</model>
Apr 12 16:02:00 user nova-compute[71874]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Apr 12 16:02:00 user nova-compute[71874]:     <feature policy='require' name='vme'/>
Apr 12 16:02:00 user nova-compute[71874]:     <feature policy='require' name='x2apic'/>
Apr 12 16:02:00 user nova-compute[71874]:     <feature policy='require' name='hypervisor'/>
Apr 12 16:02:00 user nova-compute[71874]:   </cpu>
Apr 12 16:02:00 user nova-compute[71874]:   <clock offset='utc'>
Apr 12 16:02:00 user nova-compute[71874]:     <timer name='pit' tickpolicy='delay'/>
Apr 12 16:02:00 user nova-compute[71874]:     <timer name='rtc' tickpolicy='catchup'/>
Apr 12 16:02:00 user nova-compute[71874]:     <timer name='hpet' present='no'/>
Apr 12 16:02:00 user nova-compute[71874]:   </clock>
Apr 12 16:02:00 user nova-compute[71874]:   <on_poweroff>destroy</on_poweroff>
Apr 12 16:02:00 user nova-compute[71874]:   <on_reboot>restart</on_reboot>
Apr 12 16:02:00 user nova-compute[71874]:   <on_crash>destroy</on_crash>
Apr 12 16:02:00 user nova-compute[71874]:   <devices>
Apr 12 16:02:00 user nova-compute[71874]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Apr 12 16:02:00 user nova-compute[71874]:     <disk type='file' device='disk'>
Apr 12 16:02:00 user nova-compute[71874]:       <driver name='qemu' type='qcow2' cache='none'/>
Apr 12 16:02:00 user nova-compute[71874]:       <source file='/opt/stack/data/nova/instances/55aff314-eb5e-4752-af9f-a4021e970cac/disk' index='2'/>
Apr 12 16:02:00 user nova-compute[71874]:       <backingStore type='file' index='3'>
Apr 12 16:02:00 user nova-compute[71874]:         <format type='raw'/>
Apr 12 16:02:00 user nova-compute[71874]:         <source file='/opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411'/>
Apr 12 16:02:00 user nova-compute[71874]:         <backingStore/>
Apr 12 16:02:00 user nova-compute[71874]:       </backingStore>
Apr 12 16:02:00 user nova-compute[71874]:       <target dev='vda' bus='virtio'/>
Apr 12 16:02:00 user nova-compute[71874]:       <alias name='virtio-disk0'/>
Apr 12 16:02:00 user nova-compute[71874]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Apr 12 16:02:00 user nova-compute[71874]:     </disk>
Apr 12 16:02:00 user nova-compute[71874]:     <disk type='file' device='cdrom'>
Apr 12 16:02:00 user nova-compute[71874]:       <driver name='qemu' type='raw' cache='none'/>
Apr 12 16:02:00 user nova-compute[71874]:       <source file='/opt/stack/data/nova/instances/55aff314-eb5e-4752-af9f-a4021e970cac/disk.config' index='1'/>
Apr 12 16:02:00 user nova-compute[71874]:       <backingStore/>
Apr 12 16:02:00 user nova-compute[71874]:       <target dev='hda' bus='ide'/>
Apr 12 16:02:00 user nova-compute[71874]:       <readonly/>
Apr 12 16:02:00 user nova-compute[71874]:       <alias name='ide0-0-0'/>
Apr 12 16:02:00 user nova-compute[71874]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Apr 12 16:02:00 user nova-compute[71874]:     </disk>
Apr 12 16:02:00 user nova-compute[71874]:     <controller type='usb' index='0' model='none'>
Apr 12 16:02:00 user nova-compute[71874]:       <alias name='usb'/>
Apr 12 16:02:00 user nova-compute[71874]:     </controller>
Apr 12 16:02:00 user nova-compute[71874]:     <controller type='pci' index='0' model='pci-root'>
Apr 12 16:02:00 user nova-compute[71874]:       <alias name='pci.0'/>
Apr 12 16:02:00 user nova-compute[71874]:     </controller>
Apr 12 16:02:00 user nova-compute[71874]:     <controller type='ide' index='0'>
Apr 12 16:02:00 user nova-compute[71874]:       <alias name='ide'/>
Apr 12 16:02:00 user nova-compute[71874]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Apr 12 16:02:00 user nova-compute[71874]:     </controller>
Apr 12 16:02:00 user nova-compute[71874]:     <interface type='ethernet'>
Apr 12 16:02:00 user nova-compute[71874]:       <mac address='fa:16:3e:5a:aa:4d'/>
Apr 12 16:02:00 user nova-compute[71874]:       <target dev='tap4a51084d-9f'/>
Apr 12 16:02:00 user nova-compute[71874]:       <model type='virtio'/>
Apr 12 16:02:00 user nova-compute[71874]:       <mtu size='1442'/>
Apr 12 16:02:00 user nova-compute[71874]:       <alias name='net0'/>
Apr 12 16:02:00 user nova-compute[71874]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Apr 12 16:02:00 user nova-compute[71874]:     </interface>
Apr 12 16:02:00 user nova-compute[71874]:     <interface type='ethernet'>
Apr 12 16:02:00 user nova-compute[71874]:       <mac address='fa:16:3e:59:6e:ba'/>
Apr 12 16:02:00 user nova-compute[71874]:       <target dev='tap9e66bcb0-73'/>
Apr 12 16:02:00 user nova-compute[71874]:       <model type='virtio'/>
Apr 12 16:02:00 user nova-compute[71874]:       <mtu size='1442'/>
Apr 12 16:02:00 user nova-compute[71874]:       <alias name='net1'/>
Apr 12 16:02:00 user nova-compute[71874]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Apr 12 16:02:00 user nova-compute[71874]:     </interface>
Apr 12 16:02:00 user nova-compute[71874]:     <serial type='pty'>
Apr 12 16:02:00 user nova-compute[71874]:       <source path='/dev/pts/6'/>
Apr 12 16:02:00 user nova-compute[71874]:       <log file='/opt/stack/data/nova/instances/55aff314-eb5e-4752-af9f-a4021e970cac/console.log' append='off'/>
Apr 12 16:02:00 user nova-compute[71874]:       <target type='isa-serial' port='0'>
Apr 12 16:02:00 user nova-compute[71874]:         <model name='isa-serial'/>
Apr 12 16:02:00 user nova-compute[71874]:       </target>
Apr 12 16:02:00 user nova-compute[71874]:       <alias name='serial0'/>
Apr 12 16:02:00 user nova-compute[71874]:     </serial>
Apr 12 16:02:00 user nova-compute[71874]:     <console type='pty' tty='/dev/pts/6'>
Apr 12 16:02:00 user nova-compute[71874]:       <source path='/dev/pts/6'/>
Apr 12 16:02:00 user nova-compute[71874]:       <log file='/opt/stack/data/nova/instances/55aff314-eb5e-4752-af9f-a4021e970cac/console.log' append='off'/>
Apr 12 16:02:00 user nova-compute[71874]:       <target type='serial' port='0'/>
Apr 12 16:02:00 user nova-compute[71874]:       <alias name='serial0'/>
Apr 12 16:02:00 user nova-compute[71874]:     </console>
Apr 12 16:02:00 user nova-compute[71874]:     <input type='mouse' bus='ps2'>
Apr 12 16:02:00 user nova-compute[71874]:       <alias name='input0'/>
Apr 12 16:02:00 user nova-compute[71874]:     </input>
Apr 12 16:02:00 user nova-compute[71874]:     <input type='keyboard' bus='ps2'>
Apr 12 16:02:00 user nova-compute[71874]:       <alias name='input1'/>
Apr 12 16:02:00 user nova-compute[71874]:     </input>
Apr 12 16:02:00 user nova-compute[71874]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Apr 12 16:02:00 user nova-compute[71874]:       <listen type='address' address='0.0.0.0'/>
Apr 12 16:02:00 user nova-compute[71874]:     </graphics>
Apr 12 16:02:00 user nova-compute[71874]:     <audio id='1' type='none'/>
Apr 12 16:02:00 user nova-compute[71874]:     <video>
Apr 12 16:02:00 user nova-compute[71874]:       <model type='virtio' heads='1' primary='yes'/>
Apr 12 16:02:00 user nova-compute[71874]:       <alias name='video0'/>
Apr 12 16:02:00 user nova-compute[71874]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Apr 12 16:02:00 user nova-compute[71874]:     </video>
Apr 12 16:02:00 user nova-compute[71874]:     <memballoon model='virtio'>
Apr 12 16:02:00 user nova-compute[71874]:       <stats period='10'/>
Apr 12 16:02:00 user nova-compute[71874]:       <alias name='balloon0'/>
Apr 12 16:02:00 user nova-compute[71874]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Apr 12 16:02:00 user nova-compute[71874]:     </memballoon>
Apr 12 16:02:00 user nova-compute[71874]:     <rng model='virtio'>
Apr 12 16:02:00 user nova-compute[71874]:       <backend model='random'>/dev/urandom</backend>
Apr 12 16:02:00 user nova-compute[71874]:       <alias name='rng0'/>
Apr 12 16:02:00 user nova-compute[71874]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Apr 12 16:02:00 user nova-compute[71874]:     </rng>
Apr 12 16:02:00 user nova-compute[71874]:   </devices>
Apr 12 16:02:00 user nova-compute[71874]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Apr 12 16:02:00 user nova-compute[71874]:     <label>libvirt-55aff314-eb5e-4752-af9f-a4021e970cac</label>
Apr 12 16:02:00 user nova-compute[71874]:     <imagelabel>libvirt-55aff314-eb5e-4752-af9f-a4021e970cac</imagelabel>
Apr 12 16:02:00 user nova-compute[71874]:   </seclabel>
Apr 12 16:02:00 user nova-compute[71874]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Apr 12 16:02:00 user nova-compute[71874]:     <label>+64055:+108</label>
Apr 12 16:02:00 user nova-compute[71874]:     <imagelabel>+64055:+108</imagelabel>
Apr 12 16:02:00 user nova-compute[71874]:   </seclabel>
Apr 12 16:02:00 user nova-compute[71874]: </domain>
Apr 12 16:02:00 user nova-compute[71874]:  {{(pid=71874) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Apr 12 16:02:00 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-80084f5b-26ab-40bf-956d-0f0c04199362 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Successfully detached device tap9e66bcb0-73 from instance 55aff314-eb5e-4752-af9f-a4021e970cac from the persistent domain config.
Apr 12 16:02:00 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-80084f5b-26ab-40bf-956d-0f0c04199362 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] (1/8): Attempting to detach device tap9e66bcb0-73 with device alias net1 from instance 55aff314-eb5e-4752-af9f-a4021e970cac from the live domain config. {{(pid=71874) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 16:02:00 user nova-compute[71874]: DEBUG nova.virt.libvirt.guest [None req-80084f5b-26ab-40bf-956d-0f0c04199362 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] detach device xml: <interface type="ethernet">
Apr 12 16:02:00 user nova-compute[71874]:   <mac address="fa:16:3e:59:6e:ba"/>
Apr 12 16:02:00 user nova-compute[71874]:   <model type="virtio"/>
Apr 12 16:02:00 user nova-compute[71874]:   <mtu size="1442"/>
Apr 12 16:02:00 user nova-compute[71874]:   <target dev="tap9e66bcb0-73"/>
Apr 12 16:02:00 user nova-compute[71874]: </interface>
Apr 12 16:02:00 user nova-compute[71874]:  {{(pid=71874) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 16:02:00 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:02:00 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:02:00 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Received event <DeviceRemovedEvent: 1681315320.7975318, 55aff314-eb5e-4752-af9f-a4021e970cac => net1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71874) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 16:02:00 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-80084f5b-26ab-40bf-956d-0f0c04199362 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Start waiting for the detach event from libvirt for device tap9e66bcb0-73 with device alias net1 for instance 55aff314-eb5e-4752-af9f-a4021e970cac {{(pid=71874) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 16:02:00 user nova-compute[71874]: DEBUG nova.virt.libvirt.guest [None req-80084f5b-26ab-40bf-956d-0f0c04199362 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:59:6e:ba"/><model type="virtio"/><mtu size="1442"/><target dev="tap9e66bcb0-73"/></interface> {{(pid=71874) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 12 16:02:00 user nova-compute[71874]: DEBUG nova.virt.libvirt.guest [None req-80084f5b-26ab-40bf-956d-0f0c04199362 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:59:6e:ba"/><model type="virtio"/><mtu size="1442"/><target dev="tap9e66bcb0-73"/></interface>not found in domain: <domain type='kvm' id='7'>
Apr 12 16:02:00 user nova-compute[71874]:   <name>instance-00000007</name>
Apr 12 16:02:00 user nova-compute[71874]:   <uuid>55aff314-eb5e-4752-af9f-a4021e970cac</uuid>
Apr 12 16:02:00 user nova-compute[71874]:   <metadata>
Apr 12 16:02:00 user nova-compute[71874]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 16:02:00 user nova-compute[71874]:   <nova:package version="0.0.0"/>
Apr 12 16:02:00 user nova-compute[71874]:   <nova:name>tempest-device-tagging-server-1331285489</nova:name>
Apr 12 16:02:00 user nova-compute[71874]:   <nova:creationTime>2023-04-12 16:01:48</nova:creationTime>
Apr 12 16:02:00 user nova-compute[71874]:   <nova:flavor name="m1.nano">
Apr 12 16:02:00 user nova-compute[71874]:     <nova:memory>128</nova:memory>
Apr 12 16:02:00 user nova-compute[71874]:     <nova:disk>1</nova:disk>
Apr 12 16:02:00 user nova-compute[71874]:     <nova:swap>0</nova:swap>
Apr 12 16:02:00 user nova-compute[71874]:     <nova:ephemeral>0</nova:ephemeral>
Apr 12 16:02:00 user nova-compute[71874]:     <nova:vcpus>1</nova:vcpus>
Apr 12 16:02:00 user nova-compute[71874]:   </nova:flavor>
Apr 12 16:02:00 user nova-compute[71874]:   <nova:owner>
Apr 12 16:02:00 user nova-compute[71874]:     <nova:user uuid="324eb9033e62405ca2b322bcb6da9a04">tempest-TaggedAttachmentsTest-475014275-project-member</nova:user>
Apr 12 16:02:00 user nova-compute[71874]:     <nova:project uuid="8197a98d7ebc4230899aca82b073ab15">tempest-TaggedAttachmentsTest-475014275</nova:project>
Apr 12 16:02:00 user nova-compute[71874]:   </nova:owner>
Apr 12 16:02:00 user nova-compute[71874]:   <nova:root type="image" uuid="9dc63f14-8b70-4e72-89f2-13464f2f5c7c"/>
Apr 12 16:02:00 user nova-compute[71874]:   <nova:ports>
Apr 12 16:02:00 user nova-compute[71874]:     <nova:port uuid="4a51084d-9fff-4a53-9387-4542bfd6a4a7">
Apr 12 16:02:00 user nova-compute[71874]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 12 16:02:00 user nova-compute[71874]:     </nova:port>
Apr 12 16:02:00 user nova-compute[71874]:     <nova:port uuid="9e66bcb0-73bf-4d5e-b20a-b26443302fca">
Apr 12 16:02:00 user nova-compute[71874]:       <nova:ip type="fixed" address="10.10.10.120" ipVersion="4"/>
Apr 12 16:02:00 user nova-compute[71874]:     </nova:port>
Apr 12 16:02:00 user nova-compute[71874]:   </nova:ports>
Apr 12 16:02:00 user nova-compute[71874]: </nova:instance>
Apr 12 16:02:00 user nova-compute[71874]:   </metadata>
Apr 12 16:02:00 user nova-compute[71874]:   <memory unit='KiB'>131072</memory>
Apr 12 16:02:00 user nova-compute[71874]:   <currentMemory unit='KiB'>131072</currentMemory>
Apr 12 16:02:00 user nova-compute[71874]:   <vcpu placement='static'>1</vcpu>
Apr 12 16:02:00 user nova-compute[71874]:   <resource>
Apr 12 16:02:00 user nova-compute[71874]:     <partition>/machine</partition>
Apr 12 16:02:00 user nova-compute[71874]:   </resource>
Apr 12 16:02:00 user nova-compute[71874]:   <sysinfo type='smbios'>
Apr 12 16:02:00 user nova-compute[71874]:     <system>
Apr 12 16:02:00 user nova-compute[71874]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Apr 12 16:02:00 user nova-compute[71874]:       <entry name='product'>OpenStack Nova</entry>
Apr 12 16:02:00 user nova-compute[71874]:       <entry name='version'>0.0.0</entry>
Apr 12 16:02:00 user nova-compute[71874]:       <entry name='serial'>55aff314-eb5e-4752-af9f-a4021e970cac</entry>
Apr 12 16:02:00 user nova-compute[71874]:       <entry name='uuid'>55aff314-eb5e-4752-af9f-a4021e970cac</entry>
Apr 12 16:02:00 user nova-compute[71874]:       <entry name='family'>Virtual Machine</entry>
Apr 12 16:02:00 user nova-compute[71874]:     </system>
Apr 12 16:02:00 user nova-compute[71874]:   </sysinfo>
Apr 12 16:02:00 user nova-compute[71874]:   <os>
Apr 12 16:02:00 user nova-compute[71874]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Apr 12 16:02:00 user nova-compute[71874]:     <boot dev='hd'/>
Apr 12 16:02:00 user nova-compute[71874]:     <smbios mode='sysinfo'/>
Apr 12 16:02:00 user nova-compute[71874]:   </os>
Apr 12 16:02:00 user nova-compute[71874]:   <features>
Apr 12 16:02:00 user nova-compute[71874]:     <acpi/>
Apr 12 16:02:00 user nova-compute[71874]:     <apic/>
Apr 12 16:02:00 user nova-compute[71874]:     <vmcoreinfo state='on'/>
Apr 12 16:02:00 user nova-compute[71874]:   </features>
Apr 12 16:02:00 user nova-compute[71874]:   <cpu mode='custom' match='exact' check='full'>
Apr 12 16:02:00 user nova-compute[71874]:     <model fallback='forbid'>Nehalem</model>
Apr 12 16:02:00 user nova-compute[71874]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Apr 12 16:02:00 user nova-compute[71874]:     <feature policy='require' name='vme'/>
Apr 12 16:02:00 user nova-compute[71874]:     <feature policy='require' name='x2apic'/>
Apr 12 16:02:00 user nova-compute[71874]:     <feature policy='require' name='hypervisor'/>
Apr 12 16:02:00 user nova-compute[71874]:   </cpu>
Apr 12 16:02:00 user nova-compute[71874]:   <clock offset='utc'>
Apr 12 16:02:00 user nova-compute[71874]:     <timer name='pit' tickpolicy='delay'/>
Apr 12 16:02:00 user nova-compute[71874]:     <timer name='rtc' tickpolicy='catchup'/>
Apr 12 16:02:00 user nova-compute[71874]:     <timer name='hpet' present='no'/>
Apr 12 16:02:00 user nova-compute[71874]:   </clock>
Apr 12 16:02:00 user nova-compute[71874]:   <on_poweroff>destroy</on_poweroff>
Apr 12 16:02:00 user nova-compute[71874]:   <on_reboot>restart</on_reboot>
Apr 12 16:02:00 user nova-compute[71874]:   <on_crash>destroy</on_crash>
Apr 12 16:02:00 user nova-compute[71874]:   <devices>
Apr 12 16:02:00 user nova-compute[71874]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Apr 12 16:02:00 user nova-compute[71874]:     <disk type='file' device='disk'>
Apr 12 16:02:00 user nova-compute[71874]:       <driver name='qemu' type='qcow2' cache='none'/>
Apr 12 16:02:00 user nova-compute[71874]:       <source file='/opt/stack/data/nova/instances/55aff314-eb5e-4752-af9f-a4021e970cac/disk' index='2'/>
Apr 12 16:02:00 user nova-compute[71874]:       <backingStore type='file' index='3'>
Apr 12 16:02:00 user nova-compute[71874]:         <format type='raw'/>
Apr 12 16:02:00 user nova-compute[71874]:         <source file='/opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411'/>
Apr 12 16:02:00 user nova-compute[71874]:         <backingStore/>
Apr 12 16:02:00 user nova-compute[71874]:       </backingStore>
Apr 12 16:02:00 user nova-compute[71874]:       <target dev='vda' bus='virtio'/>
Apr 12 16:02:00 user nova-compute[71874]:       <alias name='virtio-disk0'/>
Apr 12 16:02:00 user nova-compute[71874]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Apr 12 16:02:00 user nova-compute[71874]:     </disk>
Apr 12 16:02:00 user nova-compute[71874]:     <disk type='file' device='cdrom'>
Apr 12 16:02:00 user nova-compute[71874]:       <driver name='qemu' type='raw' cache='none'/>
Apr 12 16:02:00 user nova-compute[71874]:       <source file='/opt/stack/data/nova/instances/55aff314-eb5e-4752-af9f-a4021e970cac/disk.config' index='1'/>
Apr 12 16:02:00 user nova-compute[71874]:       <backingStore/>
Apr 12 16:02:00 user nova-compute[71874]:       <target dev='hda' bus='ide'/>
Apr 12 16:02:00 user nova-compute[71874]:       <readonly/>
Apr 12 16:02:00 user nova-compute[71874]:       <alias name='ide0-0-0'/>
Apr 12 16:02:00 user nova-compute[71874]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Apr 12 16:02:00 user nova-compute[71874]:     </disk>
Apr 12 16:02:00 user nova-compute[71874]:     <controller type='usb' index='0' model='none'>
Apr 12 16:02:00 user nova-compute[71874]:       <alias name='usb'/>
Apr 12 16:02:00 user nova-compute[71874]:     </controller>
Apr 12 16:02:00 user nova-compute[71874]:     <controller type='pci' index='0' model='pci-root'>
Apr 12 16:02:00 user nova-compute[71874]:       <alias name='pci.0'/>
Apr 12 16:02:00 user nova-compute[71874]:     </controller>
Apr 12 16:02:00 user nova-compute[71874]:     <controller type='ide' index='0'>
Apr 12 16:02:00 user nova-compute[71874]:       <alias name='ide'/>
Apr 12 16:02:00 user nova-compute[71874]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Apr 12 16:02:00 user nova-compute[71874]:     </controller>
Apr 12 16:02:00 user nova-compute[71874]:     <interface type='ethernet'>
Apr 12 16:02:00 user nova-compute[71874]:       <mac address='fa:16:3e:5a:aa:4d'/>
Apr 12 16:02:00 user nova-compute[71874]:       <target dev='tap4a51084d-9f'/>
Apr 12 16:02:00 user nova-compute[71874]:       <model type='virtio'/>
Apr 12 16:02:00 user nova-compute[71874]:       <mtu size='1442'/>
Apr 12 16:02:00 user nova-compute[71874]:       <alias name='net0'/>
Apr 12 16:02:00 user nova-compute[71874]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Apr 12 16:02:00 user nova-compute[71874]:     </interface>
Apr 12 16:02:00 user nova-compute[71874]:     <serial type='pty'>
Apr 12 16:02:00 user nova-compute[71874]:       <source path='/dev/pts/6'/>
Apr 12 16:02:00 user nova-compute[71874]:       <log file='/opt/stack/data/nova/instances/55aff314-eb5e-4752-af9f-a4021e970cac/console.log' append='off'/>
Apr 12 16:02:00 user nova-compute[71874]:       <target type='isa-serial' port='0'>
Apr 12 16:02:00 user nova-compute[71874]:         <model name='isa-serial'/>
Apr 12 16:02:00 user nova-compute[71874]:       </target>
Apr 12 16:02:00 user nova-compute[71874]:       <alias name='serial0'/>
Apr 12 16:02:00 user nova-compute[71874]:     </serial>
Apr 12 16:02:00 user nova-compute[71874]:     <console type='pty' tty='/dev/pts/6'>
Apr 12 16:02:00 user nova-compute[71874]:       <source path='/dev/pts/6'/>
Apr 12 16:02:00 user nova-compute[71874]:       <log file='/opt/stack/data/nova/instances/55aff314-eb5e-4752-af9f-a4021e970cac/console.log' append='off'/>
Apr 12 16:02:00 user nova-compute[71874]:       <target type='serial' port='0'/>
Apr 12 16:02:00 user nova-compute[71874]:       <alias name='serial0'/>
Apr 12 16:02:00 user nova-compute[71874]:     </console>
Apr 12 16:02:00 user nova-compute[71874]:     <input type='mouse' bus='ps2'>
Apr 12 16:02:00 user nova-compute[71874]:       <alias name='input0'/>
Apr 12 16:02:00 user nova-compute[71874]:     </input>
Apr 12 16:02:00 user nova-compute[71874]:     <input type='keyboard' bus='ps2'>
Apr 12 16:02:00 user nova-compute[71874]:       <alias name='input1'/>
Apr 12 16:02:00 user nova-compute[71874]:     </input>
Apr 12 16:02:00 user nova-compute[71874]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Apr 12 16:02:00 user nova-compute[71874]:       <listen type='address' address='0.0.0.0'/>
Apr 12 16:02:00 user nova-compute[71874]:     </graphics>
Apr 12 16:02:00 user nova-compute[71874]:     <audio id='1' type='none'/>
Apr 12 16:02:00 user nova-compute[71874]:     <video>
Apr 12 16:02:00 user nova-compute[71874]:       <model type='virtio' heads='1' primary='yes'/>
Apr 12 16:02:00 user nova-compute[71874]:       <alias name='video0'/>
Apr 12 16:02:00 user nova-compute[71874]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Apr 12 16:02:00 user nova-compute[71874]:     </video>
Apr 12 16:02:00 user nova-compute[71874]:     <memballoon model='virtio'>
Apr 12 16:02:00 user nova-compute[71874]:       <stats period='10'/>
Apr 12 16:02:00 user nova-compute[71874]:       <alias name='balloon0'/>
Apr 12 16:02:00 user nova-compute[71874]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Apr 12 16:02:00 user nova-compute[71874]:     </memballoon>
Apr 12 16:02:00 user nova-compute[71874]:     <rng model='virtio'>
Apr 12 16:02:00 user nova-compute[71874]:       <backend model='random'>/dev/urandom</backend>
Apr 12 16:02:00 user nova-compute[71874]:       <alias name='rng0'/>
Apr 12 16:02:00 user nova-compute[71874]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Apr 12 16:02:00 user nova-compute[71874]:     </rng>
Apr 12 16:02:00 user nova-compute[71874]:   </devices>
Apr 12 16:02:00 user nova-compute[71874]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Apr 12 16:02:00 user nova-compute[71874]:     <label>libvirt-55aff314-eb5e-4752-af9f-a4021e970cac</label>
Apr 12 16:02:00 user nova-compute[71874]:     <imagelabel>libvirt-55aff314-eb5e-4752-af9f-a4021e970cac</imagelabel>
Apr 12 16:02:00 user nova-compute[71874]:   </seclabel>
Apr 12 16:02:00 user nova-compute[71874]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Apr 12 16:02:00 user nova-compute[71874]:     <label>+64055:+108</label>
Apr 12 16:02:00 user nova-compute[71874]:     <imagelabel>+64055:+108</imagelabel>
Apr 12 16:02:00 user nova-compute[71874]:   </seclabel>
Apr 12 16:02:00 user nova-compute[71874]: </domain>
Apr 12 16:02:00 user nova-compute[71874]:  {{(pid=71874) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Apr 12 16:02:00 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-80084f5b-26ab-40bf-956d-0f0c04199362 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Successfully detached device tap9e66bcb0-73 from instance 55aff314-eb5e-4752-af9f-a4021e970cac from the live domain config.
Apr 12 16:02:00 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-80084f5b-26ab-40bf-956d-0f0c04199362 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T15:59:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1331285489',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1331285489',id=7,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEJbHdIj6Qnsbz5sPRJ4ye2dl2IsI8e0vfQ09uKxN501bN+DgkHVMylQpwrl7ZvLZ8swmrO3BjtPpMg/5nOMgbnum5uHS/qZKbdglyI6E6LnkEx0Cctk5Q87Mk68+Dgi4A==',key_name='tempest-keypair-2057580771',keypairs=<?>,launch_index=0,launched_at=2023-04-12T16:00:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8197a98d7ebc4230899aca82b073ab15',ramdisk_id='',reservation_id='r-ncvxejnb',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-475014275',owner_user_name='tempest-TaggedAttachmentsTest-475014275-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T16:00:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='324eb9033e62405ca2b322bcb6da9a04',uuid=55aff314-eb5e-4752-af9f-a4021e970cac,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9e66bcb0-73bf-4d5e-b20a-b26443302fca", "address": "fa:16:3e:59:6e:ba", "network": {"id": "4080a87a-33fc-4ac1-a7a0-a514db7dcb08", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-699748812", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "8197a98d7ebc4230899aca82b073ab15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e66bcb0-73", "ovs_interfaceid": "9e66bcb0-73bf-4d5e-b20a-b26443302fca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 16:02:00 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-80084f5b-26ab-40bf-956d-0f0c04199362 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Converting VIF {"id": "9e66bcb0-73bf-4d5e-b20a-b26443302fca", "address": "fa:16:3e:59:6e:ba", "network": {"id": "4080a87a-33fc-4ac1-a7a0-a514db7dcb08", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-699748812", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "8197a98d7ebc4230899aca82b073ab15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e66bcb0-73", "ovs_interfaceid": "9e66bcb0-73bf-4d5e-b20a-b26443302fca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:02:00 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-80084f5b-26ab-40bf-956d-0f0c04199362 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:59:6e:ba,bridge_name='br-int',has_traffic_filtering=True,id=9e66bcb0-73bf-4d5e-b20a-b26443302fca,network=Network(4080a87a-33fc-4ac1-a7a0-a514db7dcb08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e66bcb0-73') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:02:00 user nova-compute[71874]: DEBUG os_vif [None req-80084f5b-26ab-40bf-956d-0f0c04199362 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:59:6e:ba,bridge_name='br-int',has_traffic_filtering=True,id=9e66bcb0-73bf-4d5e-b20a-b26443302fca,network=Network(4080a87a-33fc-4ac1-a7a0-a514db7dcb08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e66bcb0-73') {{(pid=71874) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 16:02:00 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:02:00 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9e66bcb0-73, bridge=br-int, if_exists=True) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:02:00 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:02:00 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:02:00 user nova-compute[71874]: INFO os_vif [None req-80084f5b-26ab-40bf-956d-0f0c04199362 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:59:6e:ba,bridge_name='br-int',has_traffic_filtering=True,id=9e66bcb0-73bf-4d5e-b20a-b26443302fca,network=Network(4080a87a-33fc-4ac1-a7a0-a514db7dcb08),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e66bcb0-73')
Apr 12 16:02:00 user nova-compute[71874]: DEBUG nova.virt.libvirt.guest [None req-80084f5b-26ab-40bf-956d-0f0c04199362 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 16:02:00 user nova-compute[71874]:   <nova:package version="0.0.0"/>
Apr 12 16:02:00 user nova-compute[71874]:   <nova:name>tempest-device-tagging-server-1331285489</nova:name>
Apr 12 16:02:00 user nova-compute[71874]:   <nova:creationTime>2023-04-12 16:02:00</nova:creationTime>
Apr 12 16:02:00 user nova-compute[71874]:   <nova:flavor name="m1.nano">
Apr 12 16:02:00 user nova-compute[71874]:     <nova:memory>128</nova:memory>
Apr 12 16:02:00 user nova-compute[71874]:     <nova:disk>1</nova:disk>
Apr 12 16:02:00 user nova-compute[71874]:     <nova:swap>0</nova:swap>
Apr 12 16:02:00 user nova-compute[71874]:     <nova:ephemeral>0</nova:ephemeral>
Apr 12 16:02:00 user nova-compute[71874]:     <nova:vcpus>1</nova:vcpus>
Apr 12 16:02:00 user nova-compute[71874]:   </nova:flavor>
Apr 12 16:02:00 user nova-compute[71874]:   <nova:owner>
Apr 12 16:02:00 user nova-compute[71874]:     <nova:user uuid="324eb9033e62405ca2b322bcb6da9a04">tempest-TaggedAttachmentsTest-475014275-project-member</nova:user>
Apr 12 16:02:00 user nova-compute[71874]:     <nova:project uuid="8197a98d7ebc4230899aca82b073ab15">tempest-TaggedAttachmentsTest-475014275</nova:project>
Apr 12 16:02:00 user nova-compute[71874]:   </nova:owner>
Apr 12 16:02:00 user nova-compute[71874]:   <nova:root type="image" uuid="9dc63f14-8b70-4e72-89f2-13464f2f5c7c"/>
Apr 12 16:02:00 user nova-compute[71874]:   <nova:ports>
Apr 12 16:02:00 user nova-compute[71874]:     <nova:port uuid="4a51084d-9fff-4a53-9387-4542bfd6a4a7">
Apr 12 16:02:00 user nova-compute[71874]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 12 16:02:00 user nova-compute[71874]:     </nova:port>
Apr 12 16:02:00 user nova-compute[71874]:   </nova:ports>
Apr 12 16:02:00 user nova-compute[71874]: </nova:instance>
Apr 12 16:02:00 user nova-compute[71874]:  {{(pid=71874) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Apr 12 16:02:01 user nova-compute[71874]: DEBUG nova.compute.manager [req-b695feaa-948b-4365-8871-83bebd497379 req-eb64799c-9413-44cc-9492-13773ced002a service nova] [instance: 55aff314-eb5e-4752-af9f-a4021e970cac] Received event network-vif-unplugged-9e66bcb0-73bf-4d5e-b20a-b26443302fca {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:02:01 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-b695feaa-948b-4365-8871-83bebd497379 req-eb64799c-9413-44cc-9492-13773ced002a service nova] Acquiring lock "55aff314-eb5e-4752-af9f-a4021e970cac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:02:01 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-b695feaa-948b-4365-8871-83bebd497379 req-eb64799c-9413-44cc-9492-13773ced002a service nova] Lock "55aff314-eb5e-4752-af9f-a4021e970cac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:02:01 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-b695feaa-948b-4365-8871-83bebd497379 req-eb64799c-9413-44cc-9492-13773ced002a service nova] Lock "55aff314-eb5e-4752-af9f-a4021e970cac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:02:01 user nova-compute[71874]: DEBUG nova.compute.manager [req-b695feaa-948b-4365-8871-83bebd497379 req-eb64799c-9413-44cc-9492-13773ced002a service nova] [instance: 55aff314-eb5e-4752-af9f-a4021e970cac] No waiting events found dispatching network-vif-unplugged-9e66bcb0-73bf-4d5e-b20a-b26443302fca {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:02:01 user nova-compute[71874]: WARNING nova.compute.manager [req-b695feaa-948b-4365-8871-83bebd497379 req-eb64799c-9413-44cc-9492-13773ced002a service nova] [instance: 55aff314-eb5e-4752-af9f-a4021e970cac] Received unexpected event network-vif-unplugged-9e66bcb0-73bf-4d5e-b20a-b26443302fca for instance with vm_state active and task_state None.
Apr 12 16:02:01 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-1253aa1c-dae5-49b6-8414-ca615cf74b0e tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Acquiring lock "abbb6742-17d0-46b3-87ba-c14abc06738f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:02:01 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-1253aa1c-dae5-49b6-8414-ca615cf74b0e tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Lock "abbb6742-17d0-46b3-87ba-c14abc06738f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:02:01 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-1253aa1c-dae5-49b6-8414-ca615cf74b0e tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Acquiring lock "abbb6742-17d0-46b3-87ba-c14abc06738f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:02:01 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-1253aa1c-dae5-49b6-8414-ca615cf74b0e tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Lock "abbb6742-17d0-46b3-87ba-c14abc06738f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:02:01 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-1253aa1c-dae5-49b6-8414-ca615cf74b0e tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Lock "abbb6742-17d0-46b3-87ba-c14abc06738f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:02:01 user nova-compute[71874]: INFO nova.compute.manager [None req-1253aa1c-dae5-49b6-8414-ca615cf74b0e tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] [instance: abbb6742-17d0-46b3-87ba-c14abc06738f] Terminating instance
Apr 12 16:02:01 user nova-compute[71874]: DEBUG nova.compute.manager [None req-1253aa1c-dae5-49b6-8414-ca615cf74b0e tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] [instance: abbb6742-17d0-46b3-87ba-c14abc06738f] Start destroying the instance on the hypervisor. {{(pid=71874) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 16:02:01 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:02:01 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:02:01 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-80084f5b-26ab-40bf-956d-0f0c04199362 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Acquiring lock "refresh_cache-55aff314-eb5e-4752-af9f-a4021e970cac" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:02:01 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-80084f5b-26ab-40bf-956d-0f0c04199362 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Acquired lock "refresh_cache-55aff314-eb5e-4752-af9f-a4021e970cac" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:02:01 user nova-compute[71874]: DEBUG nova.network.neutron [None req-80084f5b-26ab-40bf-956d-0f0c04199362 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] [instance: 55aff314-eb5e-4752-af9f-a4021e970cac] Building network info cache for instance {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 16:02:02 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:02:02 user nova-compute[71874]: INFO nova.virt.libvirt.driver [-] [instance: abbb6742-17d0-46b3-87ba-c14abc06738f] Instance destroyed successfully.
Apr 12 16:02:02 user nova-compute[71874]: DEBUG nova.objects.instance [None req-1253aa1c-dae5-49b6-8414-ca615cf74b0e tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Lazy-loading 'resources' on Instance uuid abbb6742-17d0-46b3-87ba-c14abc06738f {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:02:02 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-1253aa1c-dae5-49b6-8414-ca615cf74b0e tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T16:00:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2046590386',display_name='tempest-VolumesActionsTest-instance-2046590386',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2046590386',id=10,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T16:00:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1bde51ff8bde4dcdb14fcda0fc92d564',ramdisk_id='',reservation_id='r-uz6ixsjl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-104284977',owner_user_name='tempest-VolumesActionsTest-104284977-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T16:00:18Z,user_data=None,user_id='c5d01dd905404e4aa08a31f25fa53338',uuid=abbb6742-17d0-46b3-87ba-c14abc06738f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fb7d3715-f433-4db0-b9ac-8d5a2b0070e9", "address": "fa:16:3e:7c:33:e2", "network": {"id": "33052061-3a43-449e-b742-4ffa29dfc039", "bridge": "br-int", "label": "tempest-VolumesActionsTest-564180421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "1bde51ff8bde4dcdb14fcda0fc92d564", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb7d3715-f4", "ovs_interfaceid": "fb7d3715-f433-4db0-b9ac-8d5a2b0070e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 16:02:02 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-1253aa1c-dae5-49b6-8414-ca615cf74b0e tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Converting VIF {"id": "fb7d3715-f433-4db0-b9ac-8d5a2b0070e9", "address": "fa:16:3e:7c:33:e2", "network": {"id": "33052061-3a43-449e-b742-4ffa29dfc039", "bridge": "br-int", "label": "tempest-VolumesActionsTest-564180421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "1bde51ff8bde4dcdb14fcda0fc92d564", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb7d3715-f4", "ovs_interfaceid": "fb7d3715-f433-4db0-b9ac-8d5a2b0070e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:02:02 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-1253aa1c-dae5-49b6-8414-ca615cf74b0e tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:33:e2,bridge_name='br-int',has_traffic_filtering=True,id=fb7d3715-f433-4db0-b9ac-8d5a2b0070e9,network=Network(33052061-3a43-449e-b742-4ffa29dfc039),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb7d3715-f4') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:02:02 user nova-compute[71874]: DEBUG os_vif [None req-1253aa1c-dae5-49b6-8414-ca615cf74b0e tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:33:e2,bridge_name='br-int',has_traffic_filtering=True,id=fb7d3715-f433-4db0-b9ac-8d5a2b0070e9,network=Network(33052061-3a43-449e-b742-4ffa29dfc039),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb7d3715-f4') {{(pid=71874) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 16:02:02 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:02:02 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfb7d3715-f4, bridge=br-int, if_exists=True) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:02:02 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:02:02 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:02:02 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:02:02 user nova-compute[71874]: INFO os_vif [None req-1253aa1c-dae5-49b6-8414-ca615cf74b0e tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:33:e2,bridge_name='br-int',has_traffic_filtering=True,id=fb7d3715-f433-4db0-b9ac-8d5a2b0070e9,network=Network(33052061-3a43-449e-b742-4ffa29dfc039),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb7d3715-f4')
Apr 12 16:02:02 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-1253aa1c-dae5-49b6-8414-ca615cf74b0e tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] [instance: abbb6742-17d0-46b3-87ba-c14abc06738f] Deleting instance files /opt/stack/data/nova/instances/abbb6742-17d0-46b3-87ba-c14abc06738f_del
Apr 12 16:02:02 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-1253aa1c-dae5-49b6-8414-ca615cf74b0e tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] [instance: abbb6742-17d0-46b3-87ba-c14abc06738f] Deletion of /opt/stack/data/nova/instances/abbb6742-17d0-46b3-87ba-c14abc06738f_del complete
Apr 12 16:02:02 user nova-compute[71874]: INFO nova.network.neutron [None req-80084f5b-26ab-40bf-956d-0f0c04199362 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] [instance: 55aff314-eb5e-4752-af9f-a4021e970cac] Port 9e66bcb0-73bf-4d5e-b20a-b26443302fca from network info_cache is no longer associated with instance in Neutron. Removing from network info_cache.
Apr 12 16:02:02 user nova-compute[71874]: DEBUG nova.network.neutron [None req-80084f5b-26ab-40bf-956d-0f0c04199362 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] [instance: 55aff314-eb5e-4752-af9f-a4021e970cac] Updating instance_info_cache with network_info: [{"id": "4a51084d-9fff-4a53-9387-4542bfd6a4a7", "address": "fa:16:3e:5a:aa:4d", "network": {"id": "95c64a1b-8b44-403f-8c4c-32730720d7a7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-87023330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8197a98d7ebc4230899aca82b073ab15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a51084d-9f", "ovs_interfaceid": "4a51084d-9fff-4a53-9387-4542bfd6a4a7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:02:02 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-80084f5b-26ab-40bf-956d-0f0c04199362 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Releasing lock "refresh_cache-55aff314-eb5e-4752-af9f-a4021e970cac" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:02:02 user nova-compute[71874]: INFO nova.compute.manager [None req-1253aa1c-dae5-49b6-8414-ca615cf74b0e tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] [instance: abbb6742-17d0-46b3-87ba-c14abc06738f] Took 0.94 seconds to destroy the instance on the hypervisor.
Apr 12 16:02:02 user nova-compute[71874]: DEBUG oslo.service.loopingcall [None req-1253aa1c-dae5-49b6-8414-ca615cf74b0e tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71874) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 16:02:02 user nova-compute[71874]: DEBUG nova.compute.manager [-] [instance: abbb6742-17d0-46b3-87ba-c14abc06738f] Deallocating network for instance {{(pid=71874) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 16:02:02 user nova-compute[71874]: DEBUG nova.network.neutron [-] [instance: abbb6742-17d0-46b3-87ba-c14abc06738f] deallocate_for_instance() {{(pid=71874) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 16:02:02 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-80084f5b-26ab-40bf-956d-0f0c04199362 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Lock "interface-55aff314-eb5e-4752-af9f-a4021e970cac-9e66bcb0-73bf-4d5e-b20a-b26443302fca" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 2.235s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:02:03 user nova-compute[71874]: DEBUG nova.network.neutron [-] [instance: abbb6742-17d0-46b3-87ba-c14abc06738f] Updating instance_info_cache with network_info: [] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:02:03 user nova-compute[71874]: INFO nova.compute.manager [-] [instance: abbb6742-17d0-46b3-87ba-c14abc06738f] Took 0.50 seconds to deallocate network for instance.
Apr 12 16:02:03 user nova-compute[71874]: DEBUG nova.compute.manager [req-40b9bc66-28ec-497b-af86-e711570804b9 req-7bf8308c-f3fa-42af-82d9-99704ab1fcbc service nova] [instance: 55aff314-eb5e-4752-af9f-a4021e970cac] Received event network-vif-plugged-9e66bcb0-73bf-4d5e-b20a-b26443302fca {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:02:03 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-40b9bc66-28ec-497b-af86-e711570804b9 req-7bf8308c-f3fa-42af-82d9-99704ab1fcbc service nova] Acquiring lock "55aff314-eb5e-4752-af9f-a4021e970cac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:02:03 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-40b9bc66-28ec-497b-af86-e711570804b9 req-7bf8308c-f3fa-42af-82d9-99704ab1fcbc service nova] Lock "55aff314-eb5e-4752-af9f-a4021e970cac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:02:03 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-40b9bc66-28ec-497b-af86-e711570804b9 req-7bf8308c-f3fa-42af-82d9-99704ab1fcbc service nova] Lock "55aff314-eb5e-4752-af9f-a4021e970cac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:02:03 user nova-compute[71874]: DEBUG nova.compute.manager [req-40b9bc66-28ec-497b-af86-e711570804b9 req-7bf8308c-f3fa-42af-82d9-99704ab1fcbc service nova] [instance: 55aff314-eb5e-4752-af9f-a4021e970cac] No waiting events found dispatching network-vif-plugged-9e66bcb0-73bf-4d5e-b20a-b26443302fca {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:02:03 user nova-compute[71874]: WARNING nova.compute.manager [req-40b9bc66-28ec-497b-af86-e711570804b9 req-7bf8308c-f3fa-42af-82d9-99704ab1fcbc service nova] [instance: 55aff314-eb5e-4752-af9f-a4021e970cac] Received unexpected event network-vif-plugged-9e66bcb0-73bf-4d5e-b20a-b26443302fca for instance with vm_state active and task_state None.
Apr 12 16:02:03 user nova-compute[71874]: DEBUG nova.compute.manager [req-40b9bc66-28ec-497b-af86-e711570804b9 req-7bf8308c-f3fa-42af-82d9-99704ab1fcbc service nova] [instance: 55aff314-eb5e-4752-af9f-a4021e970cac] Received event network-vif-deleted-9e66bcb0-73bf-4d5e-b20a-b26443302fca {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:02:03 user nova-compute[71874]: DEBUG nova.compute.manager [req-40b9bc66-28ec-497b-af86-e711570804b9 req-7bf8308c-f3fa-42af-82d9-99704ab1fcbc service nova] [instance: abbb6742-17d0-46b3-87ba-c14abc06738f] Received event network-vif-unplugged-fb7d3715-f433-4db0-b9ac-8d5a2b0070e9 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:02:03 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-40b9bc66-28ec-497b-af86-e711570804b9 req-7bf8308c-f3fa-42af-82d9-99704ab1fcbc service nova] Acquiring lock "abbb6742-17d0-46b3-87ba-c14abc06738f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:02:03 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-40b9bc66-28ec-497b-af86-e711570804b9 req-7bf8308c-f3fa-42af-82d9-99704ab1fcbc service nova] Lock "abbb6742-17d0-46b3-87ba-c14abc06738f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:02:03 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-40b9bc66-28ec-497b-af86-e711570804b9 req-7bf8308c-f3fa-42af-82d9-99704ab1fcbc service nova] Lock "abbb6742-17d0-46b3-87ba-c14abc06738f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:02:03 user nova-compute[71874]: DEBUG nova.compute.manager [req-40b9bc66-28ec-497b-af86-e711570804b9 req-7bf8308c-f3fa-42af-82d9-99704ab1fcbc service nova] [instance: abbb6742-17d0-46b3-87ba-c14abc06738f] No waiting events found dispatching network-vif-unplugged-fb7d3715-f433-4db0-b9ac-8d5a2b0070e9 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:02:03 user nova-compute[71874]: DEBUG nova.compute.manager [req-40b9bc66-28ec-497b-af86-e711570804b9 req-7bf8308c-f3fa-42af-82d9-99704ab1fcbc service nova] [instance: abbb6742-17d0-46b3-87ba-c14abc06738f] Received event network-vif-unplugged-fb7d3715-f433-4db0-b9ac-8d5a2b0070e9 for instance with task_state deleting. {{(pid=71874) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 16:02:03 user nova-compute[71874]: DEBUG nova.compute.manager [req-40b9bc66-28ec-497b-af86-e711570804b9 req-7bf8308c-f3fa-42af-82d9-99704ab1fcbc service nova] [instance: abbb6742-17d0-46b3-87ba-c14abc06738f] Received event network-vif-plugged-fb7d3715-f433-4db0-b9ac-8d5a2b0070e9 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:02:03 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-40b9bc66-28ec-497b-af86-e711570804b9 req-7bf8308c-f3fa-42af-82d9-99704ab1fcbc service nova] Acquiring lock "abbb6742-17d0-46b3-87ba-c14abc06738f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:02:03 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-40b9bc66-28ec-497b-af86-e711570804b9 req-7bf8308c-f3fa-42af-82d9-99704ab1fcbc service nova] Lock "abbb6742-17d0-46b3-87ba-c14abc06738f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:02:03 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-40b9bc66-28ec-497b-af86-e711570804b9 req-7bf8308c-f3fa-42af-82d9-99704ab1fcbc service nova] Lock "abbb6742-17d0-46b3-87ba-c14abc06738f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:02:03 user nova-compute[71874]: DEBUG nova.compute.manager [req-40b9bc66-28ec-497b-af86-e711570804b9 req-7bf8308c-f3fa-42af-82d9-99704ab1fcbc service nova] [instance: abbb6742-17d0-46b3-87ba-c14abc06738f] No waiting events found dispatching network-vif-plugged-fb7d3715-f433-4db0-b9ac-8d5a2b0070e9 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:02:03 user nova-compute[71874]: WARNING nova.compute.manager [req-40b9bc66-28ec-497b-af86-e711570804b9 req-7bf8308c-f3fa-42af-82d9-99704ab1fcbc service nova] [instance: abbb6742-17d0-46b3-87ba-c14abc06738f] Received unexpected event network-vif-plugged-fb7d3715-f433-4db0-b9ac-8d5a2b0070e9 for instance with vm_state active and task_state deleting.
Apr 12 16:02:03 user nova-compute[71874]: DEBUG nova.compute.manager [req-40b9bc66-28ec-497b-af86-e711570804b9 req-7bf8308c-f3fa-42af-82d9-99704ab1fcbc service nova] [instance: abbb6742-17d0-46b3-87ba-c14abc06738f] Received event network-vif-deleted-fb7d3715-f433-4db0-b9ac-8d5a2b0070e9 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:02:03 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-1253aa1c-dae5-49b6-8414-ca615cf74b0e tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:02:03 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-1253aa1c-dae5-49b6-8414-ca615cf74b0e tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:02:03 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f75ebf76-12ce-4b6a-8582-c842f15bf6b2 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] [instance: 6614f2c0-399b-43d2-86c9-5790c57575e9] Calling os-brick to attach iSCSI Volume {{(pid=71874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 16:02:03 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-f75ebf76-12ce-4b6a-8582-c842f15bf6b2 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3c0216320>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2a81326c-a5ae-4b84-a746-2f4efd7335eb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gwLvftXV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:02:03 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-f75ebf76-12ce-4b6a-8582-c842f15bf6b2 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:02:03 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-f75ebf76-12ce-4b6a-8582-c842f15bf6b2 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:02:03 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-f75ebf76-12ce-4b6a-8582-c842f15bf6b2 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:02:03 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-f75ebf76-12ce-4b6a-8582-c842f15bf6b2 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:02:03 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-f75ebf76-12ce-4b6a-8582-c842f15bf6b2 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2a81326c-a5ae-4b84-a746-2f4efd7335eb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:02:03 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-f75ebf76-12ce-4b6a-8582-c842f15bf6b2 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2a81326c-a5ae-4b84-a746-2f4efd7335eb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:02:03 user nova-compute[71874]: INFO os_brick.initiator.connectors.iscsi [None req-f75ebf76-12ce-4b6a-8582-c842f15bf6b2 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 16:02:03 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a81326c-a5ae-4b84-a746-2f4efd7335eb -p 172.16.0.220:3260 {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:03 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a81326c-a5ae-4b84-a746-2f4efd7335eb -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:03 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0453a0c-dd2b-43c0-b71e-5fd625aa20b7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:03 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-f75ebf76-12ce-4b6a-8582-c842f15bf6b2 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 16:02:03 user nova-compute[71874]:  {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:02:03 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a81326c-a5ae-4b84-a746-2f4efd7335eb -p 172.16.0.220:3260 --interface default --op new {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:03 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a81326c-a5ae-4b84-a746-2f4efd7335eb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:03 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dacfa0b-00ae-42c5-88e8-8fd7afdf81d7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2a81326c-a5ae-4b84-a746-2f4efd7335eb] added\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:03 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-f75ebf76-12ce-4b6a-8582-c842f15bf6b2 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2a81326c-a5ae-4b84-a746-2f4efd7335eb] added
Apr 12 16:02:03 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:02:03 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a81326c-a5ae-4b84-a746-2f4efd7335eb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:03 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a81326c-a5ae-4b84-a746-2f4efd7335eb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:03 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[d33b93c7-07a8-4d00-96b2-e33be27c45d2]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:03 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-f75ebf76-12ce-4b6a-8582-c842f15bf6b2 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:02:03 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a81326c-a5ae-4b84-a746-2f4efd7335eb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:03 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a81326c-a5ae-4b84-a746-2f4efd7335eb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:03 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[0235b9ae-c852-4e46-a884-a737a7eb8c29]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:03 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-f75ebf76-12ce-4b6a-8582-c842f15bf6b2 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:02:03 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a81326c-a5ae-4b84-a746-2f4efd7335eb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gwLvftXV {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:03 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a81326c-a5ae-4b84-a746-2f4efd7335eb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gwLvftXV" returned: 0 in 0.020s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:03 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2e2fefe-0832-43be-b572-0f21f456ab91]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:03 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-f75ebf76-12ce-4b6a-8582-c842f15bf6b2 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gwLvftXV'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:02:03 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a81326c-a5ae-4b84-a746-2f4efd7335eb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:03 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a81326c-a5ae-4b84-a746-2f4efd7335eb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:03 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fe3af9f-2f8a-4929-a1d2-b32161fec538]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:03 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-f75ebf76-12ce-4b6a-8582-c842f15bf6b2 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:02:03 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:03 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:03 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[018ec938-80e4-4942-9650-0034964fd45c]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fde1cb-bd86-48a5-8aca-463fdf3444b0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0100e6d-5149-423c-aadc-0c4f2635196b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6 (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:03 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-f75ebf76-12ce-4b6a-8582-c842f15bf6b2 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76 (non-flash)
Apr 12 16:02:03 user nova-compute[71874]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 (non-flash)
Apr 12 16:02:03 user nova-compute[71874]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fde1cb-bd86-48a5-8aca-463fdf3444b0 (non-flash)
Apr 12 16:02:03 user nova-compute[71874]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4 (non-flash)
Apr 12 16:02:03 user nova-compute[71874]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0100e6d-5149-423c-aadc-0c4f2635196b (non-flash)
Apr 12 16:02:03 user nova-compute[71874]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4 (non-flash)
Apr 12 16:02:03 user nova-compute[71874]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b (non-flash)
Apr 12 16:02:03 user nova-compute[71874]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd (non-flash)
Apr 12 16:02:03 user nova-compute[71874]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6 (non-flash)
Apr 12 16:02:03 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:02:03 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-f75ebf76-12ce-4b6a-8582-c842f15bf6b2 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76 (non-flash)
Apr 12 16:02:03 user nova-compute[71874]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 (non-flash)
Apr 12 16:02:03 user nova-compute[71874]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fde1cb-bd86-48a5-8aca-463fdf3444b0 (non-flash)
Apr 12 16:02:03 user nova-compute[71874]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4 (non-flash)
Apr 12 16:02:03 user nova-compute[71874]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0100e6d-5149-423c-aadc-0c4f2635196b (non-flash)
Apr 12 16:02:03 user nova-compute[71874]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4 (non-flash)
Apr 12 16:02:03 user nova-compute[71874]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b (non-flash)
Apr 12 16:02:03 user nova-compute[71874]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd (non-flash)
Apr 12 16:02:03 user nova-compute[71874]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6 (non-flash)
Apr 12 16:02:03 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:02:03 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a81326c-a5ae-4b84-a746-2f4efd7335eb -p 172.16.0.220:3260 --login {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:03 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-1253aa1c-dae5-49b6-8414-ca615cf74b0e tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Inventory has not changed in ProviderTree for provider: 0e94b4c8-cd49-45e4-9133-d36eb4b2456b {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 16:02:03 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-1253aa1c-dae5-49b6-8414-ca615cf74b0e tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Inventory has not changed for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 16:02:03 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a81326c-a5ae-4b84-a746-2f4efd7335eb -p 172.16.0.220:3260 --login" returned: 0 in 0.105s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:03 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[adb1e229-66ee-42d8-8917-aaf9987aa373]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2a81326c-a5ae-4b84-a746-2f4efd7335eb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2a81326c-a5ae-4b84-a746-2f4efd7335eb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:03 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-f75ebf76-12ce-4b6a-8582-c842f15bf6b2 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2a81326c-a5ae-4b84-a746-2f4efd7335eb, portal: 172.16.0.220,3260]
Apr 12 16:02:03 user nova-compute[71874]: Login to [iface: default, target: iqn.2010-10.org.openstack:2a81326c-a5ae-4b84-a746-2f4efd7335eb, portal: 172.16.0.220,3260] successful.
Apr 12 16:02:03 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:02:03 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a81326c-a5ae-4b84-a746-2f4efd7335eb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:03 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-1253aa1c-dae5-49b6-8414-ca615cf74b0e tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.397s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:02:03 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a81326c-a5ae-4b84-a746-2f4efd7335eb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:03 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9ae1a88-156f-4e41-a744-e4100805b42d]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:03 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-f75ebf76-12ce-4b6a-8582-c842f15bf6b2 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:02:03 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:03 user nova-compute[71874]: INFO nova.scheduler.client.report [None req-1253aa1c-dae5-49b6-8414-ca615cf74b0e tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Deleted allocations for instance abbb6742-17d0-46b3-87ba-c14abc06738f
Apr 12 16:02:03 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:03 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e6c1537-8c27-4941-8bc3-6dd8dc8fb101]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a81326c-a5ae-4b84-a746-2f4efd7335eb (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fde1cb-bd86-48a5-8aca-463fdf3444b0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0100e6d-5149-423c-aadc-0c4f2635196b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6 (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:03 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-f75ebf76-12ce-4b6a-8582-c842f15bf6b2 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76 (non-flash)
Apr 12 16:02:03 user nova-compute[71874]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a81326c-a5ae-4b84-a746-2f4efd7335eb (non-flash)
Apr 12 16:02:03 user nova-compute[71874]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 (non-flash)
Apr 12 16:02:03 user nova-compute[71874]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fde1cb-bd86-48a5-8aca-463fdf3444b0 (non-flash)
Apr 12 16:02:03 user nova-compute[71874]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4 (non-flash)
Apr 12 16:02:03 user nova-compute[71874]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0100e6d-5149-423c-aadc-0c4f2635196b (non-flash)
Apr 12 16:02:03 user nova-compute[71874]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4 (non-flash)
Apr 12 16:02:03 user nova-compute[71874]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b (non-flash)
Apr 12 16:02:03 user nova-compute[71874]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd (non-flash)
Apr 12 16:02:03 user nova-compute[71874]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6 (non-flash)
Apr 12 16:02:03 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:02:03 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-f75ebf76-12ce-4b6a-8582-c842f15bf6b2 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76 (non-flash)
Apr 12 16:02:03 user nova-compute[71874]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a81326c-a5ae-4b84-a746-2f4efd7335eb (non-flash)
Apr 12 16:02:03 user nova-compute[71874]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 (non-flash)
Apr 12 16:02:03 user nova-compute[71874]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fde1cb-bd86-48a5-8aca-463fdf3444b0 (non-flash)
Apr 12 16:02:03 user nova-compute[71874]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4 (non-flash)
Apr 12 16:02:03 user nova-compute[71874]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0100e6d-5149-423c-aadc-0c4f2635196b (non-flash)
Apr 12 16:02:03 user nova-compute[71874]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4 (non-flash)
Apr 12 16:02:03 user nova-compute[71874]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b (non-flash)
Apr 12 16:02:03 user nova-compute[71874]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd (non-flash)
Apr 12 16:02:03 user nova-compute[71874]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6 (non-flash)
Apr 12 16:02:03 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:02:03 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-f75ebf76-12ce-4b6a-8582-c842f15bf6b2 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2a81326c-a5ae-4b84-a746-2f4efd7335eb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.359s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:02:03 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-f75ebf76-12ce-4b6a-8582-c842f15bf6b2 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Connected to 172.16.0.220:3260 {{(pid=71874) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 16:02:03 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-f75ebf76-12ce-4b6a-8582-c842f15bf6b2 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] HCTL ('41', '-', '-', 0) found on session 12 with lun 0 {{(pid=71874) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 16:02:03 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-f75ebf76-12ce-4b6a-8582-c842f15bf6b2 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=71874) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 16:02:03 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:03 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.022s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:03 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[04db3e78-cc63-4c60-b39d-4f41ace92467]: (4, ('- - 0', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:03 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-f75ebf76-12ce-4b6a-8582-c842f15bf6b2 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Searching for a device in session 12 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=71874) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 16:02:03 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-f75ebf76-12ce-4b6a-8582-c842f15bf6b2 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Connected to sdj using {'target_iqn': 'iqn.2010-10.org.openstack:2a81326c-a5ae-4b84-a746-2f4efd7335eb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gwLvftXV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71874) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 16:02:03 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-1253aa1c-dae5-49b6-8414-ca615cf74b0e tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Lock "abbb6742-17d0-46b3-87ba-c14abc06738f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.054s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:02:04 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-f75ebf76-12ce-4b6a-8582-c842f15bf6b2 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.409s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:02:04 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-f75ebf76-12ce-4b6a-8582-c842f15bf6b2 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] <== connect_volume: return (1411ms) {'type': 'block', 'scsi_wwn': '23837366532383532', 'path': '/dev/sdj'} {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:02:04 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f75ebf76-12ce-4b6a-8582-c842f15bf6b2 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] [instance: 6614f2c0-399b-43d2-86c9-5790c57575e9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23837366532383532', 'path': '/dev/sdj'} {{(pid=71874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 16:02:04 user nova-compute[71874]: DEBUG nova.objects.instance [None req-f75ebf76-12ce-4b6a-8582-c842f15bf6b2 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Lazy-loading 'flavor' on Instance uuid 6614f2c0-399b-43d2-86c9-5790c57575e9 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:02:04 user nova-compute[71874]: DEBUG nova.virt.libvirt.guest [None req-f75ebf76-12ce-4b6a-8582-c842f15bf6b2 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 16:02:04 user nova-compute[71874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 16:02:04 user nova-compute[71874]:   <source dev="/dev/sdj"/>
Apr 12 16:02:04 user nova-compute[71874]:   <target dev="sdc" bus="scsi"/>
Apr 12 16:02:04 user nova-compute[71874]:   <serial>2a81326c-a5ae-4b84-a746-2f4efd7335eb</serial>
Apr 12 16:02:04 user nova-compute[71874]:   <address type="drive" controller="0" unit="2"/>
Apr 12 16:02:04 user nova-compute[71874]: </disk>
Apr 12 16:02:04 user nova-compute[71874]:  {{(pid=71874) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 16:02:04 user nova-compute[71874]: DEBUG nova.compute.manager [None req-f83ad43f-2a40-4495-8c27-2de4281dba36 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] [instance: e85aa869-0d2a-40ff-9697-f979a6b110cb] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5894d073-fc1e-467b-99c4-290106eeea63', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BDfmsqQV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e85aa869-0d2a-40ff-9697-f979a6b110cb', 'attached_at': '', 'detached_at': '', 'volume_id': '5894d073-fc1e-467b-99c4-290106eeea63', 'serial': '5894d073-fc1e-467b-99c4-290106eeea63'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qvyPEgoJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk'}, 'status': 'reserved', 'instance': 'e85aa869-0d2a-40ff-9697-f979a6b110cb', 'attached_at': '', 'detached_at': '', 'volume_id': '5403a600-a3bb-44d7-b9b8-bf933454ca76', 'serial'} {{(pid=71874) _swap_volume /opt/stack/nova/nova/compute/manager.py:7656}}
Apr 12 16:02:04 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f83ad43f-2a40-4495-8c27-2de4281dba36 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] [instance: e85aa869-0d2a-40ff-9697-f979a6b110cb] Calling os-brick to attach iSCSI Volume {{(pid=71874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 16:02:04 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-f83ad43f-2a40-4495-8c27-2de4281dba36 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3c0216320>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5894d073-fc1e-467b-99c4-290106eeea63', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BDfmsqQV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:02:04 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-f83ad43f-2a40-4495-8c27-2de4281dba36 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:02:04 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-f83ad43f-2a40-4495-8c27-2de4281dba36 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:02:04 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-f83ad43f-2a40-4495-8c27-2de4281dba36 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:02:04 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-f83ad43f-2a40-4495-8c27-2de4281dba36 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:02:04 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-f83ad43f-2a40-4495-8c27-2de4281dba36 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5894d073-fc1e-467b-99c4-290106eeea63" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:02:04 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-f83ad43f-2a40-4495-8c27-2de4281dba36 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5894d073-fc1e-467b-99c4-290106eeea63" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:02:04 user nova-compute[71874]: INFO os_brick.initiator.connectors.iscsi [None req-f83ad43f-2a40-4495-8c27-2de4281dba36 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 16:02:04 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5894d073-fc1e-467b-99c4-290106eeea63 -p 172.16.0.220:3260 {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:04 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5894d073-fc1e-467b-99c4-290106eeea63 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:04 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[c12987ff-5299-459e-ae6f-dec3866e3fef]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:04 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-f83ad43f-2a40-4495-8c27-2de4281dba36 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 16:02:04 user nova-compute[71874]:  {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:02:04 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5894d073-fc1e-467b-99c4-290106eeea63 -p 172.16.0.220:3260 --interface default --op new {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:04 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5894d073-fc1e-467b-99c4-290106eeea63 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:04 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d4db0c7-453d-4901-8382-08ad83e5044d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5894d073-fc1e-467b-99c4-290106eeea63] added\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:04 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-f83ad43f-2a40-4495-8c27-2de4281dba36 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5894d073-fc1e-467b-99c4-290106eeea63] added
Apr 12 16:02:04 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:02:04 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5894d073-fc1e-467b-99c4-290106eeea63 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:05 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5894d073-fc1e-467b-99c4-290106eeea63 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:05 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e0558f5-ec00-438e-baa6-f8bfc9bda1fc]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:05 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-f83ad43f-2a40-4495-8c27-2de4281dba36 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:02:05 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5894d073-fc1e-467b-99c4-290106eeea63 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:05 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5894d073-fc1e-467b-99c4-290106eeea63 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:05 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8d8f4fd-d2ed-442f-a5c4-c0fd5ea7492e]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:05 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-f83ad43f-2a40-4495-8c27-2de4281dba36 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:02:05 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5894d073-fc1e-467b-99c4-290106eeea63 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BDfmsqQV {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:05 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5894d073-fc1e-467b-99c4-290106eeea63 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BDfmsqQV" returned: 0 in 0.020s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:05 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[757ee1b6-6c67-4106-b46d-655d0c67422c]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:05 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-f83ad43f-2a40-4495-8c27-2de4281dba36 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BDfmsqQV'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:02:05 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5894d073-fc1e-467b-99c4-290106eeea63 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:05 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5894d073-fc1e-467b-99c4-290106eeea63 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:05 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd49d6d8-a349-4512-ab97-82a9893d0bc9]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:05 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-f83ad43f-2a40-4495-8c27-2de4281dba36 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:02:05 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:05 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:05 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[28de8558-292e-4dd9-9d5d-5ea9a05e30ed]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a81326c-a5ae-4b84-a746-2f4efd7335eb (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fde1cb-bd86-48a5-8aca-463fdf3444b0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0100e6d-5149-423c-aadc-0c4f2635196b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6 (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:05 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-f83ad43f-2a40-4495-8c27-2de4281dba36 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76 (non-flash)
Apr 12 16:02:05 user nova-compute[71874]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a81326c-a5ae-4b84-a746-2f4efd7335eb (non-flash)
Apr 12 16:02:05 user nova-compute[71874]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 (non-flash)
Apr 12 16:02:05 user nova-compute[71874]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fde1cb-bd86-48a5-8aca-463fdf3444b0 (non-flash)
Apr 12 16:02:05 user nova-compute[71874]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4 (non-flash)
Apr 12 16:02:05 user nova-compute[71874]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0100e6d-5149-423c-aadc-0c4f2635196b (non-flash)
Apr 12 16:02:05 user nova-compute[71874]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4 (non-flash)
Apr 12 16:02:05 user nova-compute[71874]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b (non-flash)
Apr 12 16:02:05 user nova-compute[71874]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd (non-flash)
Apr 12 16:02:05 user nova-compute[71874]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6 (non-flash)
Apr 12 16:02:05 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:02:05 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-f83ad43f-2a40-4495-8c27-2de4281dba36 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76 (non-flash)
Apr 12 16:02:05 user nova-compute[71874]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a81326c-a5ae-4b84-a746-2f4efd7335eb (non-flash)
Apr 12 16:02:05 user nova-compute[71874]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 (non-flash)
Apr 12 16:02:05 user nova-compute[71874]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fde1cb-bd86-48a5-8aca-463fdf3444b0 (non-flash)
Apr 12 16:02:05 user nova-compute[71874]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4 (non-flash)
Apr 12 16:02:05 user nova-compute[71874]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0100e6d-5149-423c-aadc-0c4f2635196b (non-flash)
Apr 12 16:02:05 user nova-compute[71874]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4 (non-flash)
Apr 12 16:02:05 user nova-compute[71874]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b (non-flash)
Apr 12 16:02:05 user nova-compute[71874]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd (non-flash)
Apr 12 16:02:05 user nova-compute[71874]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6 (non-flash)
Apr 12 16:02:05 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:02:05 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5894d073-fc1e-467b-99c4-290106eeea63 -p 172.16.0.220:3260 --login {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:05 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-f75ebf76-12ce-4b6a-8582-c842f15bf6b2 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] No BDM found with device name sda, not building metadata. {{(pid=71874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 16:02:05 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-f75ebf76-12ce-4b6a-8582-c842f15bf6b2 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] No BDM found with device name sdb, not building metadata. {{(pid=71874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 16:02:05 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-f75ebf76-12ce-4b6a-8582-c842f15bf6b2 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] No BDM found with device name sdc, not building metadata. {{(pid=71874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 16:02:05 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-f75ebf76-12ce-4b6a-8582-c842f15bf6b2 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] No VIF found with MAC fa:16:3e:75:cb:77, not building metadata {{(pid=71874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 16:02:05 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5894d073-fc1e-467b-99c4-290106eeea63 -p 172.16.0.220:3260 --login" returned: 0 in 0.104s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:05 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1b3e912-d6b5-4389-ab82-b705f7ae4e9e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5894d073-fc1e-467b-99c4-290106eeea63, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5894d073-fc1e-467b-99c4-290106eeea63, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:05 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-f83ad43f-2a40-4495-8c27-2de4281dba36 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5894d073-fc1e-467b-99c4-290106eeea63, portal: 172.16.0.220,3260]
Apr 12 16:02:05 user nova-compute[71874]: Login to [iface: default, target: iqn.2010-10.org.openstack:5894d073-fc1e-467b-99c4-290106eeea63, portal: 172.16.0.220,3260] successful.
Apr 12 16:02:05 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:02:05 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5894d073-fc1e-467b-99c4-290106eeea63 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:05 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5894d073-fc1e-467b-99c4-290106eeea63 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:05 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[30f6c951-0d53-4a13-8bd9-a85f40ed07cb]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:05 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-f83ad43f-2a40-4495-8c27-2de4281dba36 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:02:05 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:05 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:05 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b716bbe-8b5b-4d91-a829-047e724e7a8b]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a81326c-a5ae-4b84-a746-2f4efd7335eb (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5894d073-fc1e-467b-99c4-290106eeea63 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fde1cb-bd86-48a5-8aca-463fdf3444b0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0100e6d-5149-423c-aadc-0c4f2635196b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6 (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:05 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-f83ad43f-2a40-4495-8c27-2de4281dba36 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76 (non-flash)
Apr 12 16:02:05 user nova-compute[71874]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a81326c-a5ae-4b84-a746-2f4efd7335eb (non-flash)
Apr 12 16:02:05 user nova-compute[71874]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5894d073-fc1e-467b-99c4-290106eeea63 (non-flash)
Apr 12 16:02:05 user nova-compute[71874]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 (non-flash)
Apr 12 16:02:05 user nova-compute[71874]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fde1cb-bd86-48a5-8aca-463fdf3444b0 (non-flash)
Apr 12 16:02:05 user nova-compute[71874]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4 (non-flash)
Apr 12 16:02:05 user nova-compute[71874]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0100e6d-5149-423c-aadc-0c4f2635196b (non-flash)
Apr 12 16:02:05 user nova-compute[71874]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4 (non-flash)
Apr 12 16:02:05 user nova-compute[71874]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b (non-flash)
Apr 12 16:02:05 user nova-compute[71874]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd (non-flash)
Apr 12 16:02:05 user nova-compute[71874]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6 (non-flash)
Apr 12 16:02:05 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:02:05 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-f83ad43f-2a40-4495-8c27-2de4281dba36 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76 (non-flash)
Apr 12 16:02:05 user nova-compute[71874]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a81326c-a5ae-4b84-a746-2f4efd7335eb (non-flash)
Apr 12 16:02:05 user nova-compute[71874]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5894d073-fc1e-467b-99c4-290106eeea63 (non-flash)
Apr 12 16:02:05 user nova-compute[71874]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 (non-flash)
Apr 12 16:02:05 user nova-compute[71874]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fde1cb-bd86-48a5-8aca-463fdf3444b0 (non-flash)
Apr 12 16:02:05 user nova-compute[71874]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4 (non-flash)
Apr 12 16:02:05 user nova-compute[71874]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0100e6d-5149-423c-aadc-0c4f2635196b (non-flash)
Apr 12 16:02:05 user nova-compute[71874]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4 (non-flash)
Apr 12 16:02:05 user nova-compute[71874]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b (non-flash)
Apr 12 16:02:05 user nova-compute[71874]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd (non-flash)
Apr 12 16:02:05 user nova-compute[71874]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6 (non-flash)
Apr 12 16:02:05 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:02:05 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-f83ad43f-2a40-4495-8c27-2de4281dba36 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5894d073-fc1e-467b-99c4-290106eeea63" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.368s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:02:05 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-f83ad43f-2a40-4495-8c27-2de4281dba36 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] Connected to 172.16.0.220:3260 {{(pid=71874) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 16:02:05 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-f83ad43f-2a40-4495-8c27-2de4281dba36 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] HCTL ('43', '-', '-', 0) found on session 13 with lun 0 {{(pid=71874) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 16:02:05 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-f83ad43f-2a40-4495-8c27-2de4281dba36 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] Scanning host 43 c: -, t: -, l: 0) {{(pid=71874) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 16:02:05 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host43/scan {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:05 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host43/scan" returned: 0 in 0.017s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:05 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[23b25231-093a-4585-afd6-7cd6a90a91a7]: (4, ('- - 0', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:05 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-f83ad43f-2a40-4495-8c27-2de4281dba36 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] Searching for a device in session 13 and hctl ['43', '*', '*', 0] yield: sdl {{(pid=71874) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 16:02:05 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-f83ad43f-2a40-4495-8c27-2de4281dba36 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] Connected to sdl using {'target_iqn': 'iqn.2010-10.org.openstack:5894d073-fc1e-467b-99c4-290106eeea63', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BDfmsqQV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71874) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 16:02:05 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-f75ebf76-12ce-4b6a-8582-c842f15bf6b2 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Lock "6614f2c0-399b-43d2-86c9-5790c57575e9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.971s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:02:06 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-f83ad43f-2a40-4495-8c27-2de4281dba36 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.407s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:02:06 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-f83ad43f-2a40-4495-8c27-2de4281dba36 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] <== connect_volume: return (1409ms) {'type': 'block', 'scsi_wwn': '23535323531353232', 'path': '/dev/sdl'} {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:02:06 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f83ad43f-2a40-4495-8c27-2de4281dba36 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] [instance: e85aa869-0d2a-40ff-9697-f979a6b110cb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23535323531353232', 'path': '/dev/sdl'} {{(pid=71874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 16:02:06 user nova-compute[71874]: DEBUG nova.objects.instance [None req-f83ad43f-2a40-4495-8c27-2de4281dba36 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] Lazy-loading 'flavor' on Instance uuid e85aa869-0d2a-40ff-9697-f979a6b110cb {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:02:06 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-c3e6151d-f5af-4587-81d0-57b66680af7c tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Acquiring lock "6614f2c0-399b-43d2-86c9-5790c57575e9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:02:06 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-c3e6151d-f5af-4587-81d0-57b66680af7c tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Lock "6614f2c0-399b-43d2-86c9-5790c57575e9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:02:06 user nova-compute[71874]: INFO nova.compute.manager [None req-c3e6151d-f5af-4587-81d0-57b66680af7c tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] [instance: 6614f2c0-399b-43d2-86c9-5790c57575e9] Detaching volume 2a81326c-a5ae-4b84-a746-2f4efd7335eb
Apr 12 16:02:06 user nova-compute[71874]: INFO nova.virt.block_device [None req-c3e6151d-f5af-4587-81d0-57b66680af7c tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] [instance: 6614f2c0-399b-43d2-86c9-5790c57575e9] Attempting to driver detach volume 2a81326c-a5ae-4b84-a746-2f4efd7335eb from mountpoint /dev/sdc
Apr 12 16:02:06 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-c3e6151d-f5af-4587-81d0-57b66680af7c tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Attempting to detach device sdc from instance 6614f2c0-399b-43d2-86c9-5790c57575e9 from the persistent domain config. {{(pid=71874) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 16:02:06 user nova-compute[71874]: DEBUG nova.virt.libvirt.guest [None req-c3e6151d-f5af-4587-81d0-57b66680af7c tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 16:02:06 user nova-compute[71874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 16:02:06 user nova-compute[71874]:   <source dev="/dev/sdj"/>
Apr 12 16:02:06 user nova-compute[71874]:   <target dev="sdc" bus="scsi"/>
Apr 12 16:02:06 user nova-compute[71874]:   <serial>2a81326c-a5ae-4b84-a746-2f4efd7335eb</serial>
Apr 12 16:02:06 user nova-compute[71874]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Apr 12 16:02:06 user nova-compute[71874]: </disk>
Apr 12 16:02:06 user nova-compute[71874]:  {{(pid=71874) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 16:02:06 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-c3e6151d-f5af-4587-81d0-57b66680af7c tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Successfully detached device sdc from instance 6614f2c0-399b-43d2-86c9-5790c57575e9 from the persistent domain config.
Apr 12 16:02:06 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-c3e6151d-f5af-4587-81d0-57b66680af7c tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 6614f2c0-399b-43d2-86c9-5790c57575e9 from the live domain config. {{(pid=71874) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 16:02:06 user nova-compute[71874]: DEBUG nova.virt.libvirt.guest [None req-c3e6151d-f5af-4587-81d0-57b66680af7c tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 16:02:06 user nova-compute[71874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 16:02:06 user nova-compute[71874]:   <source dev="/dev/sdj"/>
Apr 12 16:02:06 user nova-compute[71874]:   <target dev="sdc" bus="scsi"/>
Apr 12 16:02:06 user nova-compute[71874]:   <serial>2a81326c-a5ae-4b84-a746-2f4efd7335eb</serial>
Apr 12 16:02:06 user nova-compute[71874]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Apr 12 16:02:06 user nova-compute[71874]: </disk>
Apr 12 16:02:06 user nova-compute[71874]:  {{(pid=71874) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 16:02:06 user nova-compute[71874]: DEBUG nova.virt.libvirt.guest [None req-f83ad43f-2a40-4495-8c27-2de4281dba36 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] COPY block job progress, current cursor: 5242880 final cursor: 1073741824 {{(pid=71874) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 16:02:07 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Received event <DeviceRemovedEvent: 1681315327.019132, 6614f2c0-399b-43d2-86c9-5790c57575e9 => scsi0-0-0-2> from libvirt while the driver is waiting for it; dispatched. {{(pid=71874) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 16:02:07 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-c3e6151d-f5af-4587-81d0-57b66680af7c tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 6614f2c0-399b-43d2-86c9-5790c57575e9 {{(pid=71874) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 16:02:07 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-c3e6151d-f5af-4587-81d0-57b66680af7c tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Successfully detached device sdc from instance 6614f2c0-399b-43d2-86c9-5790c57575e9 from the live domain config.
Apr 12 16:02:07 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3e6151d-f5af-4587-81d0-57b66680af7c tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] [instance: 6614f2c0-399b-43d2-86c9-5790c57575e9] calling os-brick to detach iSCSI Volume {{(pid=71874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 16:02:07 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e6151d-f5af-4587-81d0-57b66680af7c tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3c0216320>, {'target_iqn': 'iqn.2010-10.org.openstack:2a81326c-a5ae-4b84-a746-2f4efd7335eb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gwLvftXV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj': {}}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:02:07 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-c3e6151d-f5af-4587-81d0-57b66680af7c tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:02:07 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-c3e6151d-f5af-4587-81d0-57b66680af7c tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:02:07 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-c3e6151d-f5af-4587-81d0-57b66680af7c tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:02:07 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:07 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:07 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddaeb103-f947-48c6-829a-7f41af7b0657]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a0100e6d-5149-423c-aadc-0c4f2635196b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2a81326c-a5ae-4b84-a746-2f4efd7335eb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b2fde1cb-bd86-48a5-8aca-463fdf3444b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5894d073-fc1e-467b-99c4-290106eeea63\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:07 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e6151d-f5af-4587-81d0-57b66680af7c tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 16:02:07 user nova-compute[71874]: No targets found.
Apr 12 16:02:07 user nova-compute[71874]: iSNS:
Apr 12 16:02:07 user nova-compute[71874]: No targets found.
Apr 12 16:02:07 user nova-compute[71874]: STATIC:
Apr 12 16:02:07 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:a0100e6d-5149-423c-aadc-0c4f2635196b
Apr 12 16:02:07 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:02:07 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:02:07 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:2a81326c-a5ae-4b84-a746-2f4efd7335eb
Apr 12 16:02:07 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:02:07 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:02:07 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2
Apr 12 16:02:07 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:02:07 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:02:07 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76
Apr 12 16:02:07 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:02:07 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:02:07 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4
Apr 12 16:02:07 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:02:07 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:02:07 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd
Apr 12 16:02:07 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:02:07 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:02:07 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:b2fde1cb-bd86-48a5-8aca-463fdf3444b0
Apr 12 16:02:07 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:02:07 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:02:07 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6
Apr 12 16:02:07 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:02:07 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:02:07 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4
Apr 12 16:02:07 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:02:07 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:02:07 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:5894d073-fc1e-467b-99c4-290106eeea63
Apr 12 16:02:07 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:02:07 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:02:07 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b
Apr 12 16:02:07 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:02:07 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:02:07 user nova-compute[71874]: FIRMWARE:
Apr 12 16:02:07 user nova-compute[71874]: No targets found.
Apr 12 16:02:07 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:02:07 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e6151d-f5af-4587-81d0-57b66680af7c tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 16:02:07 user nova-compute[71874]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 16:02:07 user nova-compute[71874]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71874) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 16:02:07 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e6151d-f5af-4587-81d0-57b66680af7c tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2a81326c-a5ae-4b84-a746-2f4efd7335eb', 0)] {{(pid=71874) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 16:02:07 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:07 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:07 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[684c7000-a978-4098-8979-8d1fd2d1a9a1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2a81326c-a5ae-4b84-a746-2f4efd7335eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5894d073-fc1e-467b-99c4-290106eeea63\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a0100e6d-5149-423c-aadc-0c4f2635196b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2fde1cb-bd86-48a5-8aca-463fdf3444b0\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:07 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:07 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.047s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:07 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bbe8da2-d6fc-4966-bea7-6bcff210c450]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a81326c-a5ae-4b84-a746-2f4efd7335eb (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5894d073-fc1e-467b-99c4-290106eeea63 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fde1cb-bd86-48a5-8aca-463fdf3444b0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0100e6d-5149-423c-aadc-0c4f2635196b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6 (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:07 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e6151d-f5af-4587-81d0-57b66680af7c tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76 (non-flash)
Apr 12 16:02:07 user nova-compute[71874]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a81326c-a5ae-4b84-a746-2f4efd7335eb (non-flash)
Apr 12 16:02:07 user nova-compute[71874]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5894d073-fc1e-467b-99c4-290106eeea63 (non-flash)
Apr 12 16:02:07 user nova-compute[71874]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 (non-flash)
Apr 12 16:02:07 user nova-compute[71874]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fde1cb-bd86-48a5-8aca-463fdf3444b0 (non-flash)
Apr 12 16:02:07 user nova-compute[71874]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4 (non-flash)
Apr 12 16:02:07 user nova-compute[71874]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0100e6d-5149-423c-aadc-0c4f2635196b (non-flash)
Apr 12 16:02:07 user nova-compute[71874]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4 (non-flash)
Apr 12 16:02:07 user nova-compute[71874]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b (non-flash)
Apr 12 16:02:07 user nova-compute[71874]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd (non-flash)
Apr 12 16:02:07 user nova-compute[71874]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6 (non-flash)
Apr 12 16:02:07 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:02:07 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e6151d-f5af-4587-81d0-57b66680af7c tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76 (non-flash)
Apr 12 16:02:07 user nova-compute[71874]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a81326c-a5ae-4b84-a746-2f4efd7335eb (non-flash)
Apr 12 16:02:07 user nova-compute[71874]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5894d073-fc1e-467b-99c4-290106eeea63 (non-flash)
Apr 12 16:02:07 user nova-compute[71874]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 (non-flash)
Apr 12 16:02:07 user nova-compute[71874]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fde1cb-bd86-48a5-8aca-463fdf3444b0 (non-flash)
Apr 12 16:02:07 user nova-compute[71874]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4 (non-flash)
Apr 12 16:02:07 user nova-compute[71874]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0100e6d-5149-423c-aadc-0c4f2635196b (non-flash)
Apr 12 16:02:07 user nova-compute[71874]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4 (non-flash)
Apr 12 16:02:07 user nova-compute[71874]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b (non-flash)
Apr 12 16:02:07 user nova-compute[71874]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd (non-flash)
Apr 12 16:02:07 user nova-compute[71874]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6 (non-flash)
Apr 12 16:02:07 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:02:07 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e6151d-f5af-4587-81d0-57b66680af7c tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc3d04bb520>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2a81326c-a5ae-4b84-a746-2f4efd7335eb'): ({'sdj'}, set())}) {{(pid=71874) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 16:02:07 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-c3e6151d-f5af-4587-81d0-57b66680af7c tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Removing single pathed devices sdj {{(pid=71874) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 16:02:07 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:07 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:07 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[f20d4ba4-3667-496c-b8f3-8b544515ab63]: (4, ('path checker states:\nup                  11\n\npaths: 0\nbusy: False\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:07 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:07 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.023s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:07 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad429380-3faa-42a9-a41c-9400b9f08db2]: (4, ('ok\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:07 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-c3e6151d-f5af-4587-81d0-57b66680af7c tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Flushing IO for device /dev/sdj {{(pid=71874) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 16:02:07 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:07 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.017s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:07 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a833762-2b5d-453f-9560-26b89a022aa8]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:07 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-c3e6151d-f5af-4587-81d0-57b66680af7c tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=71874) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 16:02:07 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:07 user nova-compute[71874]: DEBUG nova.virt.libvirt.guest [None req-f83ad43f-2a40-4495-8c27-2de4281dba36 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] COPY block job progress, current cursor: 154140672 final cursor: 1073741824 {{(pid=71874) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 16:02:07 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.047s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:07 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[4647c0f1-8b80-4f56-b995-01bf4fad7572]: (4, ('1', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:07 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-c3e6151d-f5af-4587-81d0-57b66680af7c tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=71874) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 16:02:07 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-c3e6151d-f5af-4587-81d0-57b66680af7c tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] SCSI volumes sdj have been removed. {{(pid=71874) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 16:02:07 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e6151d-f5af-4587-81d0-57b66680af7c tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2a81326c-a5ae-4b84-a746-2f4efd7335eb')] {{(pid=71874) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 16:02:07 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a81326c-a5ae-4b84-a746-2f4efd7335eb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:07 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a81326c-a5ae-4b84-a746-2f4efd7335eb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:07 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[40556f7b-bc9b-4f17-b8d2-ea4f7ed7f373]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:07 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e6151d-f5af-4587-81d0-57b66680af7c tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:02:07 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a81326c-a5ae-4b84-a746-2f4efd7335eb -p 172.16.0.220:3260 --logout {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:07 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a81326c-a5ae-4b84-a746-2f4efd7335eb -p 172.16.0.220:3260 --logout" returned: 0 in 0.089s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:07 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[c15eb31c-b057-4ef5-80ee-84203fb9e403]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:2a81326c-a5ae-4b84-a746-2f4efd7335eb, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:2a81326c-a5ae-4b84-a746-2f4efd7335eb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:07 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e6151d-f5af-4587-81d0-57b66680af7c tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:2a81326c-a5ae-4b84-a746-2f4efd7335eb, portal: 172.16.0.220,3260]
Apr 12 16:02:07 user nova-compute[71874]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:2a81326c-a5ae-4b84-a746-2f4efd7335eb, portal: 172.16.0.220,3260] successful.
Apr 12 16:02:07 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:02:07 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a81326c-a5ae-4b84-a746-2f4efd7335eb -p 172.16.0.220:3260 --op delete {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:07 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a81326c-a5ae-4b84-a746-2f4efd7335eb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.056s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:07 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c05b9ae-29e3-471f-8e67-361369bb5f65]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:07 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e6151d-f5af-4587-81d0-57b66680af7c tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:02:07 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-c3e6151d-f5af-4587-81d0-57b66680af7c tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.439s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:02:07 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e6151d-f5af-4587-81d0-57b66680af7c tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] <== disconnect_volume: return (440ms) None {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:02:07 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3e6151d-f5af-4587-81d0-57b66680af7c tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] [instance: 6614f2c0-399b-43d2-86c9-5790c57575e9] Disconnected iSCSI Volume {{(pid=71874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 16:02:07 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:02:07 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:02:07 user nova-compute[71874]: DEBUG nova.virt.libvirt.guest [None req-f83ad43f-2a40-4495-8c27-2de4281dba36 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] COPY block job progress, current cursor: 301989888 final cursor: 1073741824 {{(pid=71874) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 16:02:08 user nova-compute[71874]: DEBUG nova.virt.libvirt.guest [None req-f83ad43f-2a40-4495-8c27-2de4281dba36 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] COPY block job progress, current cursor: 399507456 final cursor: 1073741824 {{(pid=71874) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 16:02:08 user nova-compute[71874]: DEBUG nova.objects.instance [None req-c3e6151d-f5af-4587-81d0-57b66680af7c tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Lazy-loading 'flavor' on Instance uuid 6614f2c0-399b-43d2-86c9-5790c57575e9 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:02:08 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-c3e6151d-f5af-4587-81d0-57b66680af7c tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Lock "6614f2c0-399b-43d2-86c9-5790c57575e9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.381s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:02:08 user nova-compute[71874]: DEBUG nova.virt.libvirt.guest [None req-f83ad43f-2a40-4495-8c27-2de4281dba36 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] COPY block job progress, current cursor: 501219328 final cursor: 1073741824 {{(pid=71874) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 16:02:09 user nova-compute[71874]: DEBUG nova.virt.libvirt.guest [None req-f83ad43f-2a40-4495-8c27-2de4281dba36 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] COPY block job progress, current cursor: 660602880 final cursor: 1073741824 {{(pid=71874) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 16:02:09 user nova-compute[71874]: DEBUG nova.virt.libvirt.guest [None req-f83ad43f-2a40-4495-8c27-2de4281dba36 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] COPY block job progress, current cursor: 832569344 final cursor: 1073741824 {{(pid=71874) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 16:02:10 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-2dcf5bde-1df7-4177-9431-f08101773965 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Acquiring lock "6614f2c0-399b-43d2-86c9-5790c57575e9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:02:10 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-2dcf5bde-1df7-4177-9431-f08101773965 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Lock "6614f2c0-399b-43d2-86c9-5790c57575e9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:02:10 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-2dcf5bde-1df7-4177-9431-f08101773965 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Acquiring lock "6614f2c0-399b-43d2-86c9-5790c57575e9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:02:10 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-2dcf5bde-1df7-4177-9431-f08101773965 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Lock "6614f2c0-399b-43d2-86c9-5790c57575e9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:02:10 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-2dcf5bde-1df7-4177-9431-f08101773965 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Lock "6614f2c0-399b-43d2-86c9-5790c57575e9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:02:10 user nova-compute[71874]: INFO nova.compute.manager [None req-2dcf5bde-1df7-4177-9431-f08101773965 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] [instance: 6614f2c0-399b-43d2-86c9-5790c57575e9] Terminating instance
Apr 12 16:02:10 user nova-compute[71874]: DEBUG nova.compute.manager [None req-2dcf5bde-1df7-4177-9431-f08101773965 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] [instance: 6614f2c0-399b-43d2-86c9-5790c57575e9] Start destroying the instance on the hypervisor. {{(pid=71874) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 16:02:10 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:02:10 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:02:10 user nova-compute[71874]: DEBUG nova.virt.libvirt.guest [None req-f83ad43f-2a40-4495-8c27-2de4281dba36 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] COPY block job progress, current cursor: 987758592 final cursor: 1073741824 {{(pid=71874) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 16:02:10 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:02:10 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:02:10 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:02:10 user nova-compute[71874]: DEBUG nova.compute.manager [req-daf77724-679d-4e70-a5b1-4354ee8108dc req-dbee69f1-576e-4dc0-8d1b-050802dd5a0e service nova] [instance: 6614f2c0-399b-43d2-86c9-5790c57575e9] Received event network-vif-unplugged-f1aab2a2-67f1-4ec5-9aeb-dffdec2170e3 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:02:10 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-daf77724-679d-4e70-a5b1-4354ee8108dc req-dbee69f1-576e-4dc0-8d1b-050802dd5a0e service nova] Acquiring lock "6614f2c0-399b-43d2-86c9-5790c57575e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:02:10 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-daf77724-679d-4e70-a5b1-4354ee8108dc req-dbee69f1-576e-4dc0-8d1b-050802dd5a0e service nova] Lock "6614f2c0-399b-43d2-86c9-5790c57575e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:02:10 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-daf77724-679d-4e70-a5b1-4354ee8108dc req-dbee69f1-576e-4dc0-8d1b-050802dd5a0e service nova] Lock "6614f2c0-399b-43d2-86c9-5790c57575e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:02:10 user nova-compute[71874]: DEBUG nova.compute.manager [req-daf77724-679d-4e70-a5b1-4354ee8108dc req-dbee69f1-576e-4dc0-8d1b-050802dd5a0e service nova] [instance: 6614f2c0-399b-43d2-86c9-5790c57575e9] No waiting events found dispatching network-vif-unplugged-f1aab2a2-67f1-4ec5-9aeb-dffdec2170e3 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:02:10 user nova-compute[71874]: DEBUG nova.compute.manager [req-daf77724-679d-4e70-a5b1-4354ee8108dc req-dbee69f1-576e-4dc0-8d1b-050802dd5a0e service nova] [instance: 6614f2c0-399b-43d2-86c9-5790c57575e9] Received event network-vif-unplugged-f1aab2a2-67f1-4ec5-9aeb-dffdec2170e3 for instance with task_state deleting. {{(pid=71874) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 16:02:10 user nova-compute[71874]: DEBUG nova.compute.manager [req-70f4f74e-5d46-4419-9c86-d4e3299c1d1f req-4682f4bd-c773-4496-ba9b-a729b06b3bc7 service nova] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] Received event network-changed-567c632f-4b91-46d8-ade5-c694ee9023c1 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:02:10 user nova-compute[71874]: DEBUG nova.compute.manager [req-70f4f74e-5d46-4419-9c86-d4e3299c1d1f req-4682f4bd-c773-4496-ba9b-a729b06b3bc7 service nova] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] Refreshing instance network info cache due to event network-changed-567c632f-4b91-46d8-ade5-c694ee9023c1. {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 16:02:10 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-70f4f74e-5d46-4419-9c86-d4e3299c1d1f req-4682f4bd-c773-4496-ba9b-a729b06b3bc7 service nova] Acquiring lock "refresh_cache-85b91251-9735-4812-9f11-003a7951a6f3" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:02:10 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-70f4f74e-5d46-4419-9c86-d4e3299c1d1f req-4682f4bd-c773-4496-ba9b-a729b06b3bc7 service nova] Acquired lock "refresh_cache-85b91251-9735-4812-9f11-003a7951a6f3" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:02:10 user nova-compute[71874]: DEBUG nova.network.neutron [req-70f4f74e-5d46-4419-9c86-d4e3299c1d1f req-4682f4bd-c773-4496-ba9b-a729b06b3bc7 service nova] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] Refreshing network info cache for port 567c632f-4b91-46d8-ade5-c694ee9023c1 {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 16:02:10 user nova-compute[71874]: DEBUG nova.virt.libvirt.guest [None req-f83ad43f-2a40-4495-8c27-2de4281dba36 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=71874) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 16:02:10 user nova-compute[71874]: INFO nova.virt.libvirt.driver [-] [instance: 6614f2c0-399b-43d2-86c9-5790c57575e9] Instance destroyed successfully.
Apr 12 16:02:10 user nova-compute[71874]: DEBUG nova.objects.instance [None req-2dcf5bde-1df7-4177-9431-f08101773965 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Lazy-loading 'resources' on Instance uuid 6614f2c0-399b-43d2-86c9-5790c57575e9 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:02:10 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f83ad43f-2a40-4495-8c27-2de4281dba36 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] [instance: e85aa869-0d2a-40ff-9697-f979a6b110cb] calling os-brick to detach iSCSI Volume {{(pid=71874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 16:02:10 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-f83ad43f-2a40-4495-8c27-2de4281dba36 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3c0216320>, {'target_iqn': 'iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qvyPEgoJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk': {}}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:02:10 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-f83ad43f-2a40-4495-8c27-2de4281dba36 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:02:10 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-f83ad43f-2a40-4495-8c27-2de4281dba36 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:02:10 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-f83ad43f-2a40-4495-8c27-2de4281dba36 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:02:10 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:10 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-2dcf5bde-1df7-4177-9431-f08101773965 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T16:00:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-179674331',display_name='tempest-AttachSCSIVolumeTestJSON-server-179674331',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-179674331',id=9,image_ref='bfacce9c-c119-4e9b-9797-bddc83436fec',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO19lsCNGEgoB2HHAQYuTR3Xz/r7iAXIlSkC7qzeVq0k3Wmxoc0KYdp4AolUci+hjmn40whJ+Pl38vCo+I61Aw/7to0Te/LrgRb9gUOAeMD8WGVk+4AtHE5vS4Vk7211aA==',key_name='tempest-keypair-393786',keypairs=<?>,launch_index=0,launched_at=2023-04-12T16:00:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='672dcb2ce6454ab4aeae3de7550ca8e0',ramdisk_id='',reservation_id='r-dumsxd1w',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bfacce9c-c119-4e9b-9797-bddc83436fec',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-526027473',owner_user_name='tempest-AttachSCSIVolumeTestJSON-526027473-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T16:00:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='16ff4a8d98bc4dfa85f0f7d9c0fcebea',uuid=6614f2c0-399b-43d2-86c9-5790c57575e9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f1aab2a2-67f1-4ec5-9aeb-dffdec2170e3", "address": "fa:16:3e:75:cb:77", "network": {"id": "f4226065-ecee-4c2b-bbaa-df0406d0d0f6", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1167048120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "672dcb2ce6454ab4aeae3de7550ca8e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1aab2a2-67", "ovs_interfaceid": "f1aab2a2-67f1-4ec5-9aeb-dffdec2170e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 16:02:10 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-2dcf5bde-1df7-4177-9431-f08101773965 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Converting VIF {"id": "f1aab2a2-67f1-4ec5-9aeb-dffdec2170e3", "address": "fa:16:3e:75:cb:77", "network": {"id": "f4226065-ecee-4c2b-bbaa-df0406d0d0f6", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1167048120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "672dcb2ce6454ab4aeae3de7550ca8e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1aab2a2-67", "ovs_interfaceid": "f1aab2a2-67f1-4ec5-9aeb-dffdec2170e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:02:10 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-2dcf5bde-1df7-4177-9431-f08101773965 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:75:cb:77,bridge_name='br-int',has_traffic_filtering=True,id=f1aab2a2-67f1-4ec5-9aeb-dffdec2170e3,network=Network(f4226065-ecee-4c2b-bbaa-df0406d0d0f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1aab2a2-67') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:02:10 user nova-compute[71874]: DEBUG os_vif [None req-2dcf5bde-1df7-4177-9431-f08101773965 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:75:cb:77,bridge_name='br-int',has_traffic_filtering=True,id=f1aab2a2-67f1-4ec5-9aeb-dffdec2170e3,network=Network(f4226065-ecee-4c2b-bbaa-df0406d0d0f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1aab2a2-67') {{(pid=71874) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 16:02:10 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:02:10 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf1aab2a2-67, bridge=br-int, if_exists=True) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:02:10 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:02:10 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:02:10 user nova-compute[71874]: INFO os_vif [None req-2dcf5bde-1df7-4177-9431-f08101773965 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:75:cb:77,bridge_name='br-int',has_traffic_filtering=True,id=f1aab2a2-67f1-4ec5-9aeb-dffdec2170e3,network=Network(f4226065-ecee-4c2b-bbaa-df0406d0d0f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1aab2a2-67')
Apr 12 16:02:10 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-2dcf5bde-1df7-4177-9431-f08101773965 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] [instance: 6614f2c0-399b-43d2-86c9-5790c57575e9] Deleting instance files /opt/stack/data/nova/instances/6614f2c0-399b-43d2-86c9-5790c57575e9_del
Apr 12 16:02:10 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-2dcf5bde-1df7-4177-9431-f08101773965 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] [instance: 6614f2c0-399b-43d2-86c9-5790c57575e9] Deletion of /opt/stack/data/nova/instances/6614f2c0-399b-43d2-86c9-5790c57575e9_del complete
Apr 12 16:02:11 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:11 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6f5ff6d-d2fc-4ef4-8e99-a1036306cc7f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a0100e6d-5149-423c-aadc-0c4f2635196b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b2fde1cb-bd86-48a5-8aca-463fdf3444b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5894d073-fc1e-467b-99c4-290106eeea63\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:11 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-f83ad43f-2a40-4495-8c27-2de4281dba36 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 16:02:11 user nova-compute[71874]: No targets found.
Apr 12 16:02:11 user nova-compute[71874]: iSNS:
Apr 12 16:02:11 user nova-compute[71874]: No targets found.
Apr 12 16:02:11 user nova-compute[71874]: STATIC:
Apr 12 16:02:11 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:a0100e6d-5149-423c-aadc-0c4f2635196b
Apr 12 16:02:11 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:02:11 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:02:11 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2
Apr 12 16:02:11 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:02:11 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:02:11 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76
Apr 12 16:02:11 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:02:11 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:02:11 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4
Apr 12 16:02:11 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:02:11 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:02:11 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd
Apr 12 16:02:11 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:02:11 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:02:11 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:b2fde1cb-bd86-48a5-8aca-463fdf3444b0
Apr 12 16:02:11 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:02:11 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:02:11 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6
Apr 12 16:02:11 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:02:11 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:02:11 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4
Apr 12 16:02:11 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:02:11 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:02:11 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:5894d073-fc1e-467b-99c4-290106eeea63
Apr 12 16:02:11 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:02:11 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:02:11 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b
Apr 12 16:02:11 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:02:11 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:02:11 user nova-compute[71874]: FIRMWARE:
Apr 12 16:02:11 user nova-compute[71874]: No targets found.
Apr 12 16:02:11 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:02:11 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-f83ad43f-2a40-4495-8c27-2de4281dba36 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 16:02:11 user nova-compute[71874]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 16:02:11 user nova-compute[71874]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71874) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 16:02:11 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-f83ad43f-2a40-4495-8c27-2de4281dba36 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76', 0)] {{(pid=71874) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 16:02:11 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:11 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:11 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[16115b8d-6212-4d07-b217-4a7fcb5e81d6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5894d073-fc1e-467b-99c4-290106eeea63\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a0100e6d-5149-423c-aadc-0c4f2635196b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2fde1cb-bd86-48a5-8aca-463fdf3444b0\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:11 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:11 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-7688f8a1-1783-444a-82c4-fcc22539a47a tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Acquiring lock "85b91251-9735-4812-9f11-003a7951a6f3" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:02:11 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-7688f8a1-1783-444a-82c4-fcc22539a47a tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Lock "85b91251-9735-4812-9f11-003a7951a6f3" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:02:11 user nova-compute[71874]: INFO nova.compute.manager [None req-7688f8a1-1783-444a-82c4-fcc22539a47a tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] Shelve offloading
Apr 12 16:02:11 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:11 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[4df9d913-8b13-4b28-9482-8fd6ac8c2541]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5894d073-fc1e-467b-99c4-290106eeea63 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fde1cb-bd86-48a5-8aca-463fdf3444b0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0100e6d-5149-423c-aadc-0c4f2635196b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6 (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:11 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-f83ad43f-2a40-4495-8c27-2de4281dba36 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76 (non-flash)
Apr 12 16:02:11 user nova-compute[71874]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5894d073-fc1e-467b-99c4-290106eeea63 (non-flash)
Apr 12 16:02:11 user nova-compute[71874]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 (non-flash)
Apr 12 16:02:11 user nova-compute[71874]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fde1cb-bd86-48a5-8aca-463fdf3444b0 (non-flash)
Apr 12 16:02:11 user nova-compute[71874]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4 (non-flash)
Apr 12 16:02:11 user nova-compute[71874]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0100e6d-5149-423c-aadc-0c4f2635196b (non-flash)
Apr 12 16:02:11 user nova-compute[71874]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4 (non-flash)
Apr 12 16:02:11 user nova-compute[71874]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b (non-flash)
Apr 12 16:02:11 user nova-compute[71874]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd (non-flash)
Apr 12 16:02:11 user nova-compute[71874]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6 (non-flash)
Apr 12 16:02:11 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:02:11 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-f83ad43f-2a40-4495-8c27-2de4281dba36 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76 (non-flash)
Apr 12 16:02:11 user nova-compute[71874]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5894d073-fc1e-467b-99c4-290106eeea63 (non-flash)
Apr 12 16:02:11 user nova-compute[71874]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 (non-flash)
Apr 12 16:02:11 user nova-compute[71874]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fde1cb-bd86-48a5-8aca-463fdf3444b0 (non-flash)
Apr 12 16:02:11 user nova-compute[71874]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4 (non-flash)
Apr 12 16:02:11 user nova-compute[71874]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0100e6d-5149-423c-aadc-0c4f2635196b (non-flash)
Apr 12 16:02:11 user nova-compute[71874]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4 (non-flash)
Apr 12 16:02:11 user nova-compute[71874]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b (non-flash)
Apr 12 16:02:11 user nova-compute[71874]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd (non-flash)
Apr 12 16:02:11 user nova-compute[71874]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6 (non-flash)
Apr 12 16:02:11 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:02:11 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-f83ad43f-2a40-4495-8c27-2de4281dba36 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc3c0222dd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76'): ({'sdk'}, set())}) {{(pid=71874) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 16:02:11 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-f83ad43f-2a40-4495-8c27-2de4281dba36 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] Removing single pathed devices sdk {{(pid=71874) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 16:02:11 user nova-compute[71874]: INFO nova.compute.manager [None req-2dcf5bde-1df7-4177-9431-f08101773965 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] [instance: 6614f2c0-399b-43d2-86c9-5790c57575e9] Took 0.91 seconds to destroy the instance on the hypervisor.
Apr 12 16:02:11 user nova-compute[71874]: DEBUG oslo.service.loopingcall [None req-2dcf5bde-1df7-4177-9431-f08101773965 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71874) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 16:02:11 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:11 user nova-compute[71874]: DEBUG nova.compute.manager [-] [instance: 6614f2c0-399b-43d2-86c9-5790c57575e9] Deallocating network for instance {{(pid=71874) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 16:02:11 user nova-compute[71874]: DEBUG nova.network.neutron [-] [instance: 6614f2c0-399b-43d2-86c9-5790c57575e9] deallocate_for_instance() {{(pid=71874) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 16:02:11 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:11 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[298d88af-df0e-405e-adb4-b0b68a00dba3]: (4, ('path checker states:\nup                  10\n\npaths: 0\nbusy: False\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:11 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdk {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:11 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdk" returned: 0 in 0.023s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:11 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[133b8ac4-f85a-4ccf-96e1-ea212dc6f117]: (4, ('ok\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:11 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-f83ad43f-2a40-4495-8c27-2de4281dba36 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] Flushing IO for device /dev/sdk {{(pid=71874) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 16:02:11 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdk {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:11 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdk" returned: 0 in 0.017s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:11 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4423d7e-0925-4642-9475-aba1746812f9]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:11 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-f83ad43f-2a40-4495-8c27-2de4281dba36 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=71874) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 16:02:11 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdk/device/delete {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:11 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:02:11 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdk/device/delete" returned: 0 in 0.052s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:11 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[bea358c5-273e-4119-a683-daa73f527a41]: (4, ('1', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:11 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-f83ad43f-2a40-4495-8c27-2de4281dba36 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] Checking to see if SCSI volumes sdk have been removed. {{(pid=71874) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 16:02:11 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-f83ad43f-2a40-4495-8c27-2de4281dba36 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] SCSI volumes sdk have been removed. {{(pid=71874) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 16:02:11 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-f83ad43f-2a40-4495-8c27-2de4281dba36 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76')] {{(pid=71874) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 16:02:11 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:11 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:02:11 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:02:11 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:11 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0425f64-2bdf-4141-822a-751e355b396f]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:11 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-f83ad43f-2a40-4495-8c27-2de4281dba36 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:02:11 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76 -p 172.16.0.220:3260 --logout {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:11 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:02:11 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76 -p 172.16.0.220:3260 --logout" returned: 0 in 0.109s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:11 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1645e94-ae8a-40d1-b33a-c8466d65a981]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:11 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-f83ad43f-2a40-4495-8c27-2de4281dba36 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76, portal: 172.16.0.220,3260]
Apr 12 16:02:11 user nova-compute[71874]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76, portal: 172.16.0.220,3260] successful.
Apr 12 16:02:11 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:02:11 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76 -p 172.16.0.220:3260 --op delete {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:11 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.042s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:11 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[39daeec0-f91f-460f-8337-8cd6cc9ec600]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:11 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-f83ad43f-2a40-4495-8c27-2de4281dba36 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:02:11 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-f83ad43f-2a40-4495-8c27-2de4281dba36 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.430s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:02:11 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-f83ad43f-2a40-4495-8c27-2de4281dba36 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] <== disconnect_volume: return (431ms) None {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:02:11 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f83ad43f-2a40-4495-8c27-2de4281dba36 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] [instance: e85aa869-0d2a-40ff-9697-f979a6b110cb] Disconnected iSCSI Volume {{(pid=71874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 16:02:11 user nova-compute[71874]: DEBUG nova.compute.manager [None req-f83ad43f-2a40-4495-8c27-2de4281dba36 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5894d073-fc1e-467b-99c4-290106eeea63', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BDfmsqQV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdl'}, 'status': 'reserved', 'instance': 'e85aa869-0d2a-40ff-9697-f979a6b110cb', 'attached_at': '', 'detached_at': '', 'volume_id': '5894d073-fc1e-467b-99c4-290106eeea63', 'serial'} {{(pid=71874) _swap_volume /opt/stack/nova/nova/compute/manager.py:7665}}
Apr 12 16:02:11 user nova-compute[71874]: DEBUG nova.compute.manager [None req-f83ad43f-2a40-4495-8c27-2de4281dba36 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] [instance: e85aa869-0d2a-40ff-9697-f979a6b110cb] swap_volume: removing Cinder connection for volume 5403a600-a3bb-44d7-b9b8-bf933454ca76 {{(pid=71874) _swap_volume /opt/stack/nova/nova/compute/manager.py:7710}}
Apr 12 16:02:11 user nova-compute[71874]: DEBUG nova.network.neutron [req-70f4f74e-5d46-4419-9c86-d4e3299c1d1f req-4682f4bd-c773-4496-ba9b-a729b06b3bc7 service nova] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] Updated VIF entry in instance network info cache for port 567c632f-4b91-46d8-ade5-c694ee9023c1. {{(pid=71874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 16:02:11 user nova-compute[71874]: DEBUG nova.network.neutron [req-70f4f74e-5d46-4419-9c86-d4e3299c1d1f req-4682f4bd-c773-4496-ba9b-a729b06b3bc7 service nova] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] Updating instance_info_cache with network_info: [{"id": "567c632f-4b91-46d8-ade5-c694ee9023c1", "address": "fa:16:3e:d5:b1:e0", "network": {"id": "0b7c67f6-057a-4bb5-aa44-db5290d55865", "bridge": "br-int", "label": "tempest-TestShelveInstance-825161862-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a46b4e80a65541d6bab94b5edfc26e5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap567c632f-4b", "ovs_interfaceid": "567c632f-4b91-46d8-ade5-c694ee9023c1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:02:11 user nova-compute[71874]: DEBUG nova.compute.manager [req-4610fd7d-29b8-4f6b-b512-fb0863117b43 req-d989edbf-40ad-4df6-b7fb-1ec9008fbe91 service nova] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] Received event network-vif-unplugged-567c632f-4b91-46d8-ade5-c694ee9023c1 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:02:11 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-4610fd7d-29b8-4f6b-b512-fb0863117b43 req-d989edbf-40ad-4df6-b7fb-1ec9008fbe91 service nova] Acquiring lock "85b91251-9735-4812-9f11-003a7951a6f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:02:11 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-4610fd7d-29b8-4f6b-b512-fb0863117b43 req-d989edbf-40ad-4df6-b7fb-1ec9008fbe91 service nova] Lock "85b91251-9735-4812-9f11-003a7951a6f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:02:11 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-4610fd7d-29b8-4f6b-b512-fb0863117b43 req-d989edbf-40ad-4df6-b7fb-1ec9008fbe91 service nova] Lock "85b91251-9735-4812-9f11-003a7951a6f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:02:11 user nova-compute[71874]: DEBUG nova.compute.manager [req-4610fd7d-29b8-4f6b-b512-fb0863117b43 req-d989edbf-40ad-4df6-b7fb-1ec9008fbe91 service nova] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] No waiting events found dispatching network-vif-unplugged-567c632f-4b91-46d8-ade5-c694ee9023c1 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:02:11 user nova-compute[71874]: WARNING nova.compute.manager [req-4610fd7d-29b8-4f6b-b512-fb0863117b43 req-d989edbf-40ad-4df6-b7fb-1ec9008fbe91 service nova] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] Received unexpected event network-vif-unplugged-567c632f-4b91-46d8-ade5-c694ee9023c1 for instance with vm_state active and task_state shelving.
Apr 12 16:02:11 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-70f4f74e-5d46-4419-9c86-d4e3299c1d1f req-4682f4bd-c773-4496-ba9b-a729b06b3bc7 service nova] Releasing lock "refresh_cache-85b91251-9735-4812-9f11-003a7951a6f3" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:02:11 user nova-compute[71874]: INFO nova.virt.libvirt.driver [-] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] Instance destroyed successfully.
Apr 12 16:02:11 user nova-compute[71874]: DEBUG nova.compute.manager [None req-7688f8a1-1783-444a-82c4-fcc22539a47a tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:02:11 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-7688f8a1-1783-444a-82c4-fcc22539a47a tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Acquiring lock "refresh_cache-85b91251-9735-4812-9f11-003a7951a6f3" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:02:11 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-7688f8a1-1783-444a-82c4-fcc22539a47a tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Acquired lock "refresh_cache-85b91251-9735-4812-9f11-003a7951a6f3" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:02:11 user nova-compute[71874]: DEBUG nova.network.neutron [None req-7688f8a1-1783-444a-82c4-fcc22539a47a tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] Building network info cache for instance {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 16:02:12 user nova-compute[71874]: DEBUG nova.compute.manager [None req-f83ad43f-2a40-4495-8c27-2de4281dba36 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] [instance: e85aa869-0d2a-40ff-9697-f979a6b110cb] swap_volume: Updating volume 5403a600-a3bb-44d7-b9b8-bf933454ca76 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:5894d073-fc1e-467b-99c4-290106eeea63", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "BDfmsqQV", "auth_password": "A64nRBjJ95ugFs", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdl", "volume_id": "5894d073-fc1e-467b-99c4-290106eeea63"}, "status": "reserved", "instance": "e85aa869-0d2a-40ff-9697-f979a6b110cb", "attached_at": "", "detached_at": "", "volume_id": "5894d073-fc1e-467b-99c4-290106eeea63", "serial": "5894d073-fc1e-467b-99c4-290106eeea63"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '5894d073-fc1e-467b-99c4-290106eeea63', 'no_device': None, 'attachment_id': '885c39de-c5a7-4d47-bf92-dcd0ecd9be51'} {{(pid=71874) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7858}}
Apr 12 16:02:12 user nova-compute[71874]: DEBUG nova.network.neutron [None req-7688f8a1-1783-444a-82c4-fcc22539a47a tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] Updating instance_info_cache with network_info: [{"id": "567c632f-4b91-46d8-ade5-c694ee9023c1", "address": "fa:16:3e:d5:b1:e0", "network": {"id": "0b7c67f6-057a-4bb5-aa44-db5290d55865", "bridge": "br-int", "label": "tempest-TestShelveInstance-825161862-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a46b4e80a65541d6bab94b5edfc26e5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap567c632f-4b", "ovs_interfaceid": "567c632f-4b91-46d8-ade5-c694ee9023c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:02:12 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-f83ad43f-2a40-4495-8c27-2de4281dba36 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] Lock "e85aa869-0d2a-40ff-9697-f979a6b110cb" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 12.431s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:02:12 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-7688f8a1-1783-444a-82c4-fcc22539a47a tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Releasing lock "refresh_cache-85b91251-9735-4812-9f11-003a7951a6f3" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:02:12 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:02:12 user nova-compute[71874]: DEBUG nova.compute.manager [req-6c7a0256-f3c6-4914-aa7f-e3c3bd06cc20 req-d2e08b86-778d-45d0-9f2a-c605b68c35be service nova] [instance: 6614f2c0-399b-43d2-86c9-5790c57575e9] Received event network-vif-plugged-f1aab2a2-67f1-4ec5-9aeb-dffdec2170e3 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:02:12 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-6c7a0256-f3c6-4914-aa7f-e3c3bd06cc20 req-d2e08b86-778d-45d0-9f2a-c605b68c35be service nova] Acquiring lock "6614f2c0-399b-43d2-86c9-5790c57575e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:02:12 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-6c7a0256-f3c6-4914-aa7f-e3c3bd06cc20 req-d2e08b86-778d-45d0-9f2a-c605b68c35be service nova] Lock "6614f2c0-399b-43d2-86c9-5790c57575e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:02:12 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-6c7a0256-f3c6-4914-aa7f-e3c3bd06cc20 req-d2e08b86-778d-45d0-9f2a-c605b68c35be service nova] Lock "6614f2c0-399b-43d2-86c9-5790c57575e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:02:12 user nova-compute[71874]: DEBUG nova.compute.manager [req-6c7a0256-f3c6-4914-aa7f-e3c3bd06cc20 req-d2e08b86-778d-45d0-9f2a-c605b68c35be service nova] [instance: 6614f2c0-399b-43d2-86c9-5790c57575e9] No waiting events found dispatching network-vif-plugged-f1aab2a2-67f1-4ec5-9aeb-dffdec2170e3 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:02:12 user nova-compute[71874]: WARNING nova.compute.manager [req-6c7a0256-f3c6-4914-aa7f-e3c3bd06cc20 req-d2e08b86-778d-45d0-9f2a-c605b68c35be service nova] [instance: 6614f2c0-399b-43d2-86c9-5790c57575e9] Received unexpected event network-vif-plugged-f1aab2a2-67f1-4ec5-9aeb-dffdec2170e3 for instance with vm_state active and task_state deleting.
Apr 12 16:02:12 user nova-compute[71874]: DEBUG nova.network.neutron [-] [instance: 6614f2c0-399b-43d2-86c9-5790c57575e9] Updating instance_info_cache with network_info: [] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:02:12 user nova-compute[71874]: INFO nova.compute.manager [-] [instance: 6614f2c0-399b-43d2-86c9-5790c57575e9] Took 1.76 seconds to deallocate network for instance.
Apr 12 16:02:12 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-2dcf5bde-1df7-4177-9431-f08101773965 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:02:12 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-2dcf5bde-1df7-4177-9431-f08101773965 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:02:12 user nova-compute[71874]: INFO nova.virt.libvirt.driver [-] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] Instance destroyed successfully.
Apr 12 16:02:12 user nova-compute[71874]: DEBUG nova.objects.instance [None req-7688f8a1-1783-444a-82c4-fcc22539a47a tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Lazy-loading 'resources' on Instance uuid 85b91251-9735-4812-9f11-003a7951a6f3 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:02:12 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-7688f8a1-1783-444a-82c4-fcc22539a47a tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T16:00:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1745076225',display_name='tempest-TestShelveInstance-server-1745076225',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1745076225',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGrjGxRBnu9rsB4dVnF551Ir+USJO3Xww91Gyq7pzJHhLIC+yf3sqYFIB7zX6y2mMrg16l4hILlV14T+O7phmEsFD6kmLB6HpztKchow4NACtmWzqkjfiJtDlHrmoWu0KQ==',key_name='tempest-TestShelveInstance-509475392',keypairs=<?>,launch_index=0,launched_at=2023-04-12T16:00:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a46b4e80a65541d6bab94b5edfc26e5b',ramdisk_id='',reservation_id='r-ffojuop7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-346701715',owner_user_name='tempest-TestShelveInstance-346701715-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T16:00:34Z,user_data=None,user_id='6acbd977c4b4494db95f879777184489',uuid=85b91251-9735-4812-9f11-003a7951a6f3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "567c632f-4b91-46d8-ade5-c694ee9023c1", "address": "fa:16:3e:d5:b1:e0", "network": {"id": "0b7c67f6-057a-4bb5-aa44-db5290d55865", "bridge": "br-int", "label": "tempest-TestShelveInstance-825161862-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a46b4e80a65541d6bab94b5edfc26e5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap567c632f-4b", "ovs_interfaceid": "567c632f-4b91-46d8-ade5-c694ee9023c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 16:02:12 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-7688f8a1-1783-444a-82c4-fcc22539a47a tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Converting VIF {"id": "567c632f-4b91-46d8-ade5-c694ee9023c1", "address": "fa:16:3e:d5:b1:e0", "network": {"id": "0b7c67f6-057a-4bb5-aa44-db5290d55865", "bridge": "br-int", "label": "tempest-TestShelveInstance-825161862-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a46b4e80a65541d6bab94b5edfc26e5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap567c632f-4b", "ovs_interfaceid": "567c632f-4b91-46d8-ade5-c694ee9023c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:02:12 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-7688f8a1-1783-444a-82c4-fcc22539a47a tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:b1:e0,bridge_name='br-int',has_traffic_filtering=True,id=567c632f-4b91-46d8-ade5-c694ee9023c1,network=Network(0b7c67f6-057a-4bb5-aa44-db5290d55865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap567c632f-4b') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:02:12 user nova-compute[71874]: DEBUG os_vif [None req-7688f8a1-1783-444a-82c4-fcc22539a47a tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:b1:e0,bridge_name='br-int',has_traffic_filtering=True,id=567c632f-4b91-46d8-ade5-c694ee9023c1,network=Network(0b7c67f6-057a-4bb5-aa44-db5290d55865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap567c632f-4b') {{(pid=71874) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 16:02:12 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:02:12 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap567c632f-4b, bridge=br-int, if_exists=True) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:02:12 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:02:12 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:02:12 user nova-compute[71874]: INFO os_vif [None req-7688f8a1-1783-444a-82c4-fcc22539a47a tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:b1:e0,bridge_name='br-int',has_traffic_filtering=True,id=567c632f-4b91-46d8-ade5-c694ee9023c1,network=Network(0b7c67f6-057a-4bb5-aa44-db5290d55865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap567c632f-4b')
Apr 12 16:02:12 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7688f8a1-1783-444a-82c4-fcc22539a47a tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] calling os-brick to detach iSCSI Volume {{(pid=71874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 16:02:12 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-7688f8a1-1783-444a-82c4-fcc22539a47a tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3c0216320>, {'target_iqn': 'iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xHtihcnd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:02:12 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-7688f8a1-1783-444a-82c4-fcc22539a47a tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:02:12 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-7688f8a1-1783-444a-82c4-fcc22539a47a tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:02:12 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-7688f8a1-1783-444a-82c4-fcc22539a47a tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:02:12 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:13 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:13 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c3e41f0-0a62-4cfe-8aea-13e49c7dc058]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a0100e6d-5149-423c-aadc-0c4f2635196b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b2fde1cb-bd86-48a5-8aca-463fdf3444b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5894d073-fc1e-467b-99c4-290106eeea63\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:13 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-7688f8a1-1783-444a-82c4-fcc22539a47a tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 16:02:13 user nova-compute[71874]: No targets found.
Apr 12 16:02:13 user nova-compute[71874]: iSNS:
Apr 12 16:02:13 user nova-compute[71874]: No targets found.
Apr 12 16:02:13 user nova-compute[71874]: STATIC:
Apr 12 16:02:13 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:a0100e6d-5149-423c-aadc-0c4f2635196b
Apr 12 16:02:13 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:02:13 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:02:13 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2
Apr 12 16:02:13 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:02:13 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:02:13 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4
Apr 12 16:02:13 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:02:13 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:02:13 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd
Apr 12 16:02:13 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:02:13 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:02:13 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:b2fde1cb-bd86-48a5-8aca-463fdf3444b0
Apr 12 16:02:13 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:02:13 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:02:13 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6
Apr 12 16:02:13 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:02:13 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:02:13 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4
Apr 12 16:02:13 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:02:13 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:02:13 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:5894d073-fc1e-467b-99c4-290106eeea63
Apr 12 16:02:13 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:02:13 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:02:13 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b
Apr 12 16:02:13 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:02:13 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:02:13 user nova-compute[71874]: FIRMWARE:
Apr 12 16:02:13 user nova-compute[71874]: No targets found.
Apr 12 16:02:13 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:02:13 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-7688f8a1-1783-444a-82c4-fcc22539a47a tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 16:02:13 user nova-compute[71874]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 16:02:13 user nova-compute[71874]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71874) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 16:02:13 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-7688f8a1-1783-444a-82c4-fcc22539a47a tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2', 0)] {{(pid=71874) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 16:02:13 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:13 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:13 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[039af78d-09b7-4d75-a81d-0cb5eed1d514]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5894d073-fc1e-467b-99c4-290106eeea63\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a0100e6d-5149-423c-aadc-0c4f2635196b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2fde1cb-bd86-48a5-8aca-463fdf3444b0\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:13 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:13 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:13 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[b89bdd31-ab26-4b03-a162-d93676afca80]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5894d073-fc1e-467b-99c4-290106eeea63 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fde1cb-bd86-48a5-8aca-463fdf3444b0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0100e6d-5149-423c-aadc-0c4f2635196b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6 (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:13 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-7688f8a1-1783-444a-82c4-fcc22539a47a tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5894d073-fc1e-467b-99c4-290106eeea63 (non-flash)
Apr 12 16:02:13 user nova-compute[71874]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 (non-flash)
Apr 12 16:02:13 user nova-compute[71874]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fde1cb-bd86-48a5-8aca-463fdf3444b0 (non-flash)
Apr 12 16:02:13 user nova-compute[71874]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4 (non-flash)
Apr 12 16:02:13 user nova-compute[71874]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0100e6d-5149-423c-aadc-0c4f2635196b (non-flash)
Apr 12 16:02:13 user nova-compute[71874]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4 (non-flash)
Apr 12 16:02:13 user nova-compute[71874]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b (non-flash)
Apr 12 16:02:13 user nova-compute[71874]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd (non-flash)
Apr 12 16:02:13 user nova-compute[71874]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6 (non-flash)
Apr 12 16:02:13 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:02:13 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-7688f8a1-1783-444a-82c4-fcc22539a47a tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5894d073-fc1e-467b-99c4-290106eeea63 (non-flash)
Apr 12 16:02:13 user nova-compute[71874]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 (non-flash)
Apr 12 16:02:13 user nova-compute[71874]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fde1cb-bd86-48a5-8aca-463fdf3444b0 (non-flash)
Apr 12 16:02:13 user nova-compute[71874]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4 (non-flash)
Apr 12 16:02:13 user nova-compute[71874]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0100e6d-5149-423c-aadc-0c4f2635196b (non-flash)
Apr 12 16:02:13 user nova-compute[71874]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4 (non-flash)
Apr 12 16:02:13 user nova-compute[71874]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b (non-flash)
Apr 12 16:02:13 user nova-compute[71874]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd (non-flash)
Apr 12 16:02:13 user nova-compute[71874]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6 (non-flash)
Apr 12 16:02:13 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:02:13 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-7688f8a1-1783-444a-82c4-fcc22539a47a tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc3d457bf40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2'): ({'sdb'}, set())}) {{(pid=71874) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 16:02:13 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-7688f8a1-1783-444a-82c4-fcc22539a47a tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Removing single pathed devices sdb {{(pid=71874) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 16:02:13 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:13 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:13 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd1d88c9-4c3b-48ce-a9bc-5ac5a48b5146]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:13 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:13 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:13 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f13029e-1642-42f4-ac07-875f03e88fa7]: (4, ('ok\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:13 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-7688f8a1-1783-444a-82c4-fcc22539a47a tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Flushing IO for device /dev/sdb {{(pid=71874) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 16:02:13 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:13 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:13 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ec2d2f9-67c3-44e6-8bb0-39fe868cd201]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:13 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-7688f8a1-1783-444a-82c4-fcc22539a47a tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71874) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 16:02:13 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:13 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.032s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:13 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0c04dfa-73f2-48a6-8e7d-248f0bdfc587]: (4, ('1', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:13 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-7688f8a1-1783-444a-82c4-fcc22539a47a tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71874) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 16:02:13 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-7688f8a1-1783-444a-82c4-fcc22539a47a tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] SCSI volumes sdb have been removed. {{(pid=71874) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 16:02:13 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-7688f8a1-1783-444a-82c4-fcc22539a47a tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2')] {{(pid=71874) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 16:02:13 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:13 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:13 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6fe5e85-ee69-493d-975b-6c62b466d968]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:13 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-7688f8a1-1783-444a-82c4-fcc22539a47a tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:02:13 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 -p 172.16.0.220:3260 --logout {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:13 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-2dcf5bde-1df7-4177-9431-f08101773965 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Inventory has not changed in ProviderTree for provider: 0e94b4c8-cd49-45e4-9133-d36eb4b2456b {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 16:02:13 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:13 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fde8b9f-8cd7-4a3b-a862-c83832499347]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:13 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-7688f8a1-1783-444a-82c4-fcc22539a47a tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2, portal: 172.16.0.220,3260]
Apr 12 16:02:13 user nova-compute[71874]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2, portal: 172.16.0.220,3260] successful.
Apr 12 16:02:13 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:02:13 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-2dcf5bde-1df7-4177-9431-f08101773965 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Inventory has not changed for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 16:02:13 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 -p 172.16.0.220:3260 --op delete {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:13 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-2dcf5bde-1df7-4177-9431-f08101773965 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.422s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:02:13 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.050s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:13 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ddb92db-a1ca-427f-8fb9-ad7737efbf0f]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:13 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-7688f8a1-1783-444a-82c4-fcc22539a47a tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:02:13 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-7688f8a1-1783-444a-82c4-fcc22539a47a tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.359s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:02:13 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-7688f8a1-1783-444a-82c4-fcc22539a47a tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] <== disconnect_volume: return (361ms) None {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:02:13 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7688f8a1-1783-444a-82c4-fcc22539a47a tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] Disconnected iSCSI Volume {{(pid=71874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 16:02:13 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-7688f8a1-1783-444a-82c4-fcc22539a47a tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] Deleting instance files /opt/stack/data/nova/instances/85b91251-9735-4812-9f11-003a7951a6f3_del
Apr 12 16:02:13 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-7688f8a1-1783-444a-82c4-fcc22539a47a tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] Deletion of /opt/stack/data/nova/instances/85b91251-9735-4812-9f11-003a7951a6f3_del complete
Apr 12 16:02:13 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-46c5e654-7b9b-4feb-bdfb-f5109e023e28 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] Acquiring lock "e85aa869-0d2a-40ff-9697-f979a6b110cb" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:02:13 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-46c5e654-7b9b-4feb-bdfb-f5109e023e28 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] Lock "e85aa869-0d2a-40ff-9697-f979a6b110cb" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:02:13 user nova-compute[71874]: DEBUG os_brick.utils [None req-46c5e654-7b9b-4feb-bdfb-f5109e023e28 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:02:13 user nova-compute[71874]: INFO nova.scheduler.client.report [None req-2dcf5bde-1df7-4177-9431-f08101773965 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Deleted allocations for instance 6614f2c0-399b-43d2-86c9-5790c57575e9
Apr 12 16:02:13 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:13 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:13 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfeaca1a-a238-4c88-a482-dc1c642760bb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:61a48d4489d2\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:13 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:13 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:13 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e2f5bc5-097a-4a6f-ab14-225bf3050139]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:13 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:13 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:13 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ec66482-9ba3-4c4d-a09f-11c321d117ac]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:13 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d0e283c-7b1f-47ec-834f-4212f354f645]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:13 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-46c5e654-7b9b-4feb-bdfb-f5109e023e28 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] Running cmd (subprocess): nvme version {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:13 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-46c5e654-7b9b-4feb-bdfb-f5109e023e28 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] 'nvme version' failed. Not Retrying. {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 16:02:13 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.nvmeof [None req-46c5e654-7b9b-4feb-bdfb-f5109e023e28 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] nvme not present on system {{(pid=71874) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 16:02:13 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-2dcf5bde-1df7-4177-9431-f08101773965 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Lock "6614f2c0-399b-43d2-86c9-5790c57575e9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.342s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:02:13 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:13 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 16:02:13 user nova-compute[71874]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 16:02:13 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[f800f9f4-89cd-4d26-8c60-b6eb5b981113]: (4, '') {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:13 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.lightos [None req-46c5e654-7b9b-4feb-bdfb-f5109e023e28 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71874) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 16:02:13 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.lightos [None req-46c5e654-7b9b-4feb-bdfb-f5109e023e28 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71874) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 16:02:13 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.lightos [None req-46c5e654-7b9b-4feb-bdfb-f5109e023e28 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] LIGHTOS: no hostnqn found. {{(pid=71874) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 16:02:13 user nova-compute[71874]: DEBUG os_brick.utils [None req-46c5e654-7b9b-4feb-bdfb-f5109e023e28 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:61a48d4489d2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:02:13 user nova-compute[71874]: INFO nova.compute.manager [None req-46c5e654-7b9b-4feb-bdfb-f5109e023e28 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] [instance: e85aa869-0d2a-40ff-9697-f979a6b110cb] Swapping volume 5894d073-fc1e-467b-99c4-290106eeea63 for 5403a600-a3bb-44d7-b9b8-bf933454ca76
Apr 12 16:02:13 user nova-compute[71874]: DEBUG nova.compute.manager [req-494f037e-b2f5-4163-90eb-2429f1207562 req-bc12ebe1-be03-4e88-9dbc-4ca15ebd97b3 service nova] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] Received event network-vif-plugged-567c632f-4b91-46d8-ade5-c694ee9023c1 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:02:13 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-494f037e-b2f5-4163-90eb-2429f1207562 req-bc12ebe1-be03-4e88-9dbc-4ca15ebd97b3 service nova] Acquiring lock "85b91251-9735-4812-9f11-003a7951a6f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:02:13 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-494f037e-b2f5-4163-90eb-2429f1207562 req-bc12ebe1-be03-4e88-9dbc-4ca15ebd97b3 service nova] Lock "85b91251-9735-4812-9f11-003a7951a6f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:02:13 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-494f037e-b2f5-4163-90eb-2429f1207562 req-bc12ebe1-be03-4e88-9dbc-4ca15ebd97b3 service nova] Lock "85b91251-9735-4812-9f11-003a7951a6f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:02:13 user nova-compute[71874]: DEBUG nova.compute.manager [req-494f037e-b2f5-4163-90eb-2429f1207562 req-bc12ebe1-be03-4e88-9dbc-4ca15ebd97b3 service nova] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] No waiting events found dispatching network-vif-plugged-567c632f-4b91-46d8-ade5-c694ee9023c1 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:02:13 user nova-compute[71874]: WARNING nova.compute.manager [req-494f037e-b2f5-4163-90eb-2429f1207562 req-bc12ebe1-be03-4e88-9dbc-4ca15ebd97b3 service nova] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] Received unexpected event network-vif-plugged-567c632f-4b91-46d8-ade5-c694ee9023c1 for instance with vm_state active and task_state shelving.
Apr 12 16:02:13 user nova-compute[71874]: DEBUG nova.compute.manager [req-494f037e-b2f5-4163-90eb-2429f1207562 req-bc12ebe1-be03-4e88-9dbc-4ca15ebd97b3 service nova] [instance: 6614f2c0-399b-43d2-86c9-5790c57575e9] Received event network-vif-deleted-f1aab2a2-67f1-4ec5-9aeb-dffdec2170e3 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:02:14 user nova-compute[71874]: INFO nova.scheduler.client.report [None req-7688f8a1-1783-444a-82c4-fcc22539a47a tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Deleted allocations for instance 85b91251-9735-4812-9f11-003a7951a6f3
Apr 12 16:02:14 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-7688f8a1-1783-444a-82c4-fcc22539a47a tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:02:14 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-7688f8a1-1783-444a-82c4-fcc22539a47a tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:02:14 user nova-compute[71874]: DEBUG nova.objects.instance [None req-7688f8a1-1783-444a-82c4-fcc22539a47a tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Lazy-loading 'numa_topology' on Instance uuid 85b91251-9735-4812-9f11-003a7951a6f3 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:02:14 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-7688f8a1-1783-444a-82c4-fcc22539a47a tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Inventory has not changed in ProviderTree for provider: 0e94b4c8-cd49-45e4-9133-d36eb4b2456b {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 16:02:14 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-7688f8a1-1783-444a-82c4-fcc22539a47a tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Inventory has not changed for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 16:02:14 user nova-compute[71874]: DEBUG nova.compute.manager [req-6d574e0c-271a-4d6f-8180-f8bf14d2123d req-75660b79-ea22-43a9-8434-4536d8a52027 service nova] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] Received event network-changed-567c632f-4b91-46d8-ade5-c694ee9023c1 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:02:14 user nova-compute[71874]: DEBUG nova.compute.manager [req-6d574e0c-271a-4d6f-8180-f8bf14d2123d req-75660b79-ea22-43a9-8434-4536d8a52027 service nova] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] Refreshing instance network info cache due to event network-changed-567c632f-4b91-46d8-ade5-c694ee9023c1. {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 16:02:14 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-6d574e0c-271a-4d6f-8180-f8bf14d2123d req-75660b79-ea22-43a9-8434-4536d8a52027 service nova] Acquiring lock "refresh_cache-85b91251-9735-4812-9f11-003a7951a6f3" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:02:14 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-6d574e0c-271a-4d6f-8180-f8bf14d2123d req-75660b79-ea22-43a9-8434-4536d8a52027 service nova] Acquired lock "refresh_cache-85b91251-9735-4812-9f11-003a7951a6f3" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:02:14 user nova-compute[71874]: DEBUG nova.network.neutron [req-6d574e0c-271a-4d6f-8180-f8bf14d2123d req-75660b79-ea22-43a9-8434-4536d8a52027 service nova] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] Refreshing network info cache for port 567c632f-4b91-46d8-ade5-c694ee9023c1 {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 16:02:14 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-7688f8a1-1783-444a-82c4-fcc22539a47a tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.330s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:02:14 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-7688f8a1-1783-444a-82c4-fcc22539a47a tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Lock "85b91251-9735-4812-9f11-003a7951a6f3" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 3.703s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:02:15 user nova-compute[71874]: DEBUG nova.network.neutron [req-6d574e0c-271a-4d6f-8180-f8bf14d2123d req-75660b79-ea22-43a9-8434-4536d8a52027 service nova] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] Updated VIF entry in instance network info cache for port 567c632f-4b91-46d8-ade5-c694ee9023c1. {{(pid=71874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 16:02:15 user nova-compute[71874]: DEBUG nova.network.neutron [req-6d574e0c-271a-4d6f-8180-f8bf14d2123d req-75660b79-ea22-43a9-8434-4536d8a52027 service nova] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] Updating instance_info_cache with network_info: [{"id": "567c632f-4b91-46d8-ade5-c694ee9023c1", "address": "fa:16:3e:d5:b1:e0", "network": {"id": "0b7c67f6-057a-4bb5-aa44-db5290d55865", "bridge": null, "label": "tempest-TestShelveInstance-825161862-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a46b4e80a65541d6bab94b5edfc26e5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap567c632f-4b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:02:15 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-6d574e0c-271a-4d6f-8180-f8bf14d2123d req-75660b79-ea22-43a9-8434-4536d8a52027 service nova] Releasing lock "refresh_cache-85b91251-9735-4812-9f11-003a7951a6f3" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:02:17 user nova-compute[71874]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681315322.5415852, abbb6742-17d0-46b3-87ba-c14abc06738f => Stopped> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:02:17 user nova-compute[71874]: INFO nova.compute.manager [-] [instance: abbb6742-17d0-46b3-87ba-c14abc06738f] VM Stopped (Lifecycle Event)
Apr 12 16:02:17 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:02:17 user nova-compute[71874]: DEBUG nova.compute.manager [None req-af847e33-2c28-4aa6-a6ae-067b6998f0a1 None None] [instance: abbb6742-17d0-46b3-87ba-c14abc06738f] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:02:17 user nova-compute[71874]: DEBUG nova.compute.manager [None req-46c5e654-7b9b-4feb-bdfb-f5109e023e28 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] [instance: e85aa869-0d2a-40ff-9697-f979a6b110cb] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qvyPEgoJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e85aa869-0d2a-40ff-9697-f979a6b110cb', 'attached_at': '', 'detached_at': '', 'volume_id': '5403a600-a3bb-44d7-b9b8-bf933454ca76', 'serial': '5403a600-a3bb-44d7-b9b8-bf933454ca76'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5894d073-fc1e-467b-99c4-290106eeea63', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BDfmsqQV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdl', 'volume_id': '5894d073-fc1e-467b-99c4-290106eeea63'}, 'status': 'reserved', 'instance': 'e85aa869-0d2a-40ff-9697-f979a6b110cb', 'attached_at': '', 'detached_at': '', 'volume_id': '5894d073-fc1e-467b-99c4-290106eeea63', 'serial'} {{(pid=71874) _swap_volume /opt/stack/nova/nova/compute/manager.py:7656}}
Apr 12 16:02:17 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46c5e654-7b9b-4feb-bdfb-f5109e023e28 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] [instance: e85aa869-0d2a-40ff-9697-f979a6b110cb] Calling os-brick to attach iSCSI Volume {{(pid=71874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 16:02:17 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-46c5e654-7b9b-4feb-bdfb-f5109e023e28 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3c0216320>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qvyPEgoJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:02:17 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-46c5e654-7b9b-4feb-bdfb-f5109e023e28 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:02:17 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-46c5e654-7b9b-4feb-bdfb-f5109e023e28 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:02:17 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-46c5e654-7b9b-4feb-bdfb-f5109e023e28 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:02:17 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-46c5e654-7b9b-4feb-bdfb-f5109e023e28 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:02:17 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-46c5e654-7b9b-4feb-bdfb-f5109e023e28 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:02:17 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-46c5e654-7b9b-4feb-bdfb-f5109e023e28 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:02:17 user nova-compute[71874]: INFO os_brick.initiator.connectors.iscsi [None req-46c5e654-7b9b-4feb-bdfb-f5109e023e28 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 16:02:17 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76 -p 172.16.0.220:3260 {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:17 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:17 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[d966bcc8-4a65-4907-b64d-ffc856dc0575]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:17 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-46c5e654-7b9b-4feb-bdfb-f5109e023e28 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 16:02:17 user nova-compute[71874]:  {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:02:17 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76 -p 172.16.0.220:3260 --interface default --op new {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:17 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:17 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cd0ef8e-1c45-4eeb-9f0f-90c3fedb00fa]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76] added\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:17 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-46c5e654-7b9b-4feb-bdfb-f5109e023e28 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76] added
Apr 12 16:02:17 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:02:17 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:17 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:17 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee7361f2-e8fa-436a-939f-e5fae3d05bb1]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:17 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-46c5e654-7b9b-4feb-bdfb-f5109e023e28 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:02:17 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:17 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:02:17 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:17 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[dedd01b5-2c2b-4b39-81fa-e323f1509e76]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:17 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-46c5e654-7b9b-4feb-bdfb-f5109e023e28 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:02:17 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qvyPEgoJ {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:18 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qvyPEgoJ" returned: 0 in 0.023s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:18 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bbeec1b-5e4d-48c6-b6a7-a064b369bc0e]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:18 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-46c5e654-7b9b-4feb-bdfb-f5109e023e28 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qvyPEgoJ'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:02:18 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:18 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:18 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[537a97b0-e5f5-4619-8d4b-d4fc7ad2f167]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:18 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-46c5e654-7b9b-4feb-bdfb-f5109e023e28 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:02:18 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:18 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:18 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[e44fc893-9678-447b-a6a8-36b162ae98a2]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5894d073-fc1e-467b-99c4-290106eeea63 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fde1cb-bd86-48a5-8aca-463fdf3444b0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0100e6d-5149-423c-aadc-0c4f2635196b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6 (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:18 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-46c5e654-7b9b-4feb-bdfb-f5109e023e28 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5894d073-fc1e-467b-99c4-290106eeea63 (non-flash)
Apr 12 16:02:18 user nova-compute[71874]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fde1cb-bd86-48a5-8aca-463fdf3444b0 (non-flash)
Apr 12 16:02:18 user nova-compute[71874]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4 (non-flash)
Apr 12 16:02:18 user nova-compute[71874]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0100e6d-5149-423c-aadc-0c4f2635196b (non-flash)
Apr 12 16:02:18 user nova-compute[71874]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4 (non-flash)
Apr 12 16:02:18 user nova-compute[71874]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b (non-flash)
Apr 12 16:02:18 user nova-compute[71874]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd (non-flash)
Apr 12 16:02:18 user nova-compute[71874]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6 (non-flash)
Apr 12 16:02:18 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:02:18 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-46c5e654-7b9b-4feb-bdfb-f5109e023e28 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5894d073-fc1e-467b-99c4-290106eeea63 (non-flash)
Apr 12 16:02:18 user nova-compute[71874]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fde1cb-bd86-48a5-8aca-463fdf3444b0 (non-flash)
Apr 12 16:02:18 user nova-compute[71874]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4 (non-flash)
Apr 12 16:02:18 user nova-compute[71874]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0100e6d-5149-423c-aadc-0c4f2635196b (non-flash)
Apr 12 16:02:18 user nova-compute[71874]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4 (non-flash)
Apr 12 16:02:18 user nova-compute[71874]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b (non-flash)
Apr 12 16:02:18 user nova-compute[71874]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd (non-flash)
Apr 12 16:02:18 user nova-compute[71874]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6 (non-flash)
Apr 12 16:02:18 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:02:18 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76 -p 172.16.0.220:3260 --login {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:18 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76 -p 172.16.0.220:3260 --login" returned: 0 in 0.086s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:18 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[767ff358-4fd4-4152-9eb3-aacf405486cd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:18 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-46c5e654-7b9b-4feb-bdfb-f5109e023e28 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76, portal: 172.16.0.220,3260]
Apr 12 16:02:18 user nova-compute[71874]: Login to [iface: default, target: iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76, portal: 172.16.0.220,3260] successful.
Apr 12 16:02:18 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:02:18 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:18 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:18 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[682d564a-799c-4f33-ae3b-3f818c3aea14]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:18 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-46c5e654-7b9b-4feb-bdfb-f5109e023e28 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:02:18 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:18 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:18 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[edb617e3-ad9c-4797-82fc-693a127f4a43]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5894d073-fc1e-467b-99c4-290106eeea63 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fde1cb-bd86-48a5-8aca-463fdf3444b0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0100e6d-5149-423c-aadc-0c4f2635196b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6 (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:18 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-46c5e654-7b9b-4feb-bdfb-f5109e023e28 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5894d073-fc1e-467b-99c4-290106eeea63 (non-flash)
Apr 12 16:02:18 user nova-compute[71874]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76 (non-flash)
Apr 12 16:02:18 user nova-compute[71874]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fde1cb-bd86-48a5-8aca-463fdf3444b0 (non-flash)
Apr 12 16:02:18 user nova-compute[71874]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4 (non-flash)
Apr 12 16:02:18 user nova-compute[71874]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0100e6d-5149-423c-aadc-0c4f2635196b (non-flash)
Apr 12 16:02:18 user nova-compute[71874]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4 (non-flash)
Apr 12 16:02:18 user nova-compute[71874]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b (non-flash)
Apr 12 16:02:18 user nova-compute[71874]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd (non-flash)
Apr 12 16:02:18 user nova-compute[71874]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6 (non-flash)
Apr 12 16:02:18 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:02:18 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-46c5e654-7b9b-4feb-bdfb-f5109e023e28 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5894d073-fc1e-467b-99c4-290106eeea63 (non-flash)
Apr 12 16:02:18 user nova-compute[71874]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76 (non-flash)
Apr 12 16:02:18 user nova-compute[71874]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fde1cb-bd86-48a5-8aca-463fdf3444b0 (non-flash)
Apr 12 16:02:18 user nova-compute[71874]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4 (non-flash)
Apr 12 16:02:18 user nova-compute[71874]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0100e6d-5149-423c-aadc-0c4f2635196b (non-flash)
Apr 12 16:02:18 user nova-compute[71874]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4 (non-flash)
Apr 12 16:02:18 user nova-compute[71874]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b (non-flash)
Apr 12 16:02:18 user nova-compute[71874]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd (non-flash)
Apr 12 16:02:18 user nova-compute[71874]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6 (non-flash)
Apr 12 16:02:18 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:02:18 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-46c5e654-7b9b-4feb-bdfb-f5109e023e28 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.341s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:02:18 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-46c5e654-7b9b-4feb-bdfb-f5109e023e28 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] Connected to 172.16.0.220:3260 {{(pid=71874) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 16:02:18 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-46c5e654-7b9b-4feb-bdfb-f5109e023e28 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] HCTL ('33', '-', '-', 0) found on session 14 with lun 0 {{(pid=71874) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 16:02:18 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-46c5e654-7b9b-4feb-bdfb-f5109e023e28 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] Scanning host 33 c: -, t: -, l: 0) {{(pid=71874) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 16:02:18 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:18 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:18 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cd9f853-c06a-49a7-ba37-5a73e1e16dc6]: (4, ('- - 0', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:18 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-46c5e654-7b9b-4feb-bdfb-f5109e023e28 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] Searching for a device in session 14 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71874) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 16:02:18 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-46c5e654-7b9b-4feb-bdfb-f5109e023e28 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qvyPEgoJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71874) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 16:02:19 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-46c5e654-7b9b-4feb-bdfb-f5109e023e28 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.379s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:02:19 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-46c5e654-7b9b-4feb-bdfb-f5109e023e28 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] <== connect_volume: return (1380ms) {'type': 'block', 'scsi_wwn': '23461313538333964', 'path': '/dev/sdb'} {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:02:19 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46c5e654-7b9b-4feb-bdfb-f5109e023e28 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] [instance: e85aa869-0d2a-40ff-9697-f979a6b110cb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23461313538333964', 'path': '/dev/sdb'} {{(pid=71874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 16:02:19 user nova-compute[71874]: DEBUG nova.objects.instance [None req-46c5e654-7b9b-4feb-bdfb-f5109e023e28 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] Lazy-loading 'flavor' on Instance uuid e85aa869-0d2a-40ff-9697-f979a6b110cb {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:02:19 user nova-compute[71874]: DEBUG nova.virt.libvirt.guest [None req-46c5e654-7b9b-4feb-bdfb-f5109e023e28 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=71874) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 16:02:20 user nova-compute[71874]: DEBUG nova.virt.libvirt.guest [None req-46c5e654-7b9b-4feb-bdfb-f5109e023e28 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] COPY block job progress, current cursor: 63963136 final cursor: 1073741824 {{(pid=71874) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 16:02:20 user nova-compute[71874]: DEBUG nova.virt.libvirt.guest [None req-46c5e654-7b9b-4feb-bdfb-f5109e023e28 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] COPY block job progress, current cursor: 234881024 final cursor: 1073741824 {{(pid=71874) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 16:02:21 user nova-compute[71874]: DEBUG nova.virt.libvirt.guest [None req-46c5e654-7b9b-4feb-bdfb-f5109e023e28 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] COPY block job progress, current cursor: 421527552 final cursor: 1073741824 {{(pid=71874) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 16:02:21 user nova-compute[71874]: DEBUG nova.virt.libvirt.guest [None req-46c5e654-7b9b-4feb-bdfb-f5109e023e28 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] COPY block job progress, current cursor: 574619648 final cursor: 1073741824 {{(pid=71874) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 16:02:22 user nova-compute[71874]: DEBUG nova.compute.manager [req-13d678f6-3429-4389-b7ed-952e98b53f30 req-1a63d5aa-50df-4e10-8b90-edcc5bb5c12a service nova] [instance: 026ab036-1481-4689-af70-661493e9451c] Received event network-changed-0d6194a7-a3c4-47f9-8c37-960cb622ce28 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:02:22 user nova-compute[71874]: DEBUG nova.compute.manager [req-13d678f6-3429-4389-b7ed-952e98b53f30 req-1a63d5aa-50df-4e10-8b90-edcc5bb5c12a service nova] [instance: 026ab036-1481-4689-af70-661493e9451c] Refreshing instance network info cache due to event network-changed-0d6194a7-a3c4-47f9-8c37-960cb622ce28. {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 16:02:22 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-13d678f6-3429-4389-b7ed-952e98b53f30 req-1a63d5aa-50df-4e10-8b90-edcc5bb5c12a service nova] Acquiring lock "refresh_cache-026ab036-1481-4689-af70-661493e9451c" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:02:22 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-13d678f6-3429-4389-b7ed-952e98b53f30 req-1a63d5aa-50df-4e10-8b90-edcc5bb5c12a service nova] Acquired lock "refresh_cache-026ab036-1481-4689-af70-661493e9451c" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:02:22 user nova-compute[71874]: DEBUG nova.network.neutron [req-13d678f6-3429-4389-b7ed-952e98b53f30 req-1a63d5aa-50df-4e10-8b90-edcc5bb5c12a service nova] [instance: 026ab036-1481-4689-af70-661493e9451c] Refreshing network info cache for port 0d6194a7-a3c4-47f9-8c37-960cb622ce28 {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 16:02:22 user nova-compute[71874]: DEBUG nova.virt.libvirt.guest [None req-46c5e654-7b9b-4feb-bdfb-f5109e023e28 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] COPY block job progress, current cursor: 717225984 final cursor: 1073741824 {{(pid=71874) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 16:02:22 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-2f9f654f-f62b-48ca-8866-c4756fbc06b3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Acquiring lock "f52ee906-c8fd-4cd5-842e-de98a5099c4f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:02:22 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-2f9f654f-f62b-48ca-8866-c4756fbc06b3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "f52ee906-c8fd-4cd5-842e-de98a5099c4f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:02:22 user nova-compute[71874]: DEBUG nova.compute.manager [None req-2f9f654f-f62b-48ca-8866-c4756fbc06b3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] Starting instance... {{(pid=71874) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 16:02:22 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-2f9f654f-f62b-48ca-8866-c4756fbc06b3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:02:22 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-2f9f654f-f62b-48ca-8866-c4756fbc06b3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:02:22 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-2f9f654f-f62b-48ca-8866-c4756fbc06b3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71874) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 16:02:22 user nova-compute[71874]: INFO nova.compute.claims [None req-2f9f654f-f62b-48ca-8866-c4756fbc06b3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] Claim successful on node user
Apr 12 16:02:22 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:02:22 user nova-compute[71874]: DEBUG nova.virt.libvirt.guest [None req-46c5e654-7b9b-4feb-bdfb-f5109e023e28 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] COPY block job progress, current cursor: 856686592 final cursor: 1073741824 {{(pid=71874) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 16:02:22 user nova-compute[71874]: DEBUG nova.network.neutron [req-13d678f6-3429-4389-b7ed-952e98b53f30 req-1a63d5aa-50df-4e10-8b90-edcc5bb5c12a service nova] [instance: 026ab036-1481-4689-af70-661493e9451c] Updated VIF entry in instance network info cache for port 0d6194a7-a3c4-47f9-8c37-960cb622ce28. {{(pid=71874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 16:02:22 user nova-compute[71874]: DEBUG nova.network.neutron [req-13d678f6-3429-4389-b7ed-952e98b53f30 req-1a63d5aa-50df-4e10-8b90-edcc5bb5c12a service nova] [instance: 026ab036-1481-4689-af70-661493e9451c] Updating instance_info_cache with network_info: [{"id": "0d6194a7-a3c4-47f9-8c37-960cb622ce28", "address": "fa:16:3e:9c:84:d7", "network": {"id": "77f1158d-0720-49c1-9530-29d3cdca64df", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1458658917-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14aea401da6344858416fd2543bc10ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d6194a7-a3", "ovs_interfaceid": "0d6194a7-a3c4-47f9-8c37-960cb622ce28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8ebc1d23-a473-4640-aa39-31cbed300c07", "address": "fa:16:3e:d5:95:9e", "network": {"id": "9b0c9550-d764-4db6-b28b-09ab59801170", "bridge": "br-int", "label": "tempest-device-tagging-net1-638686183", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.180", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14aea401da6344858416fd2543bc10ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ebc1d23-a4", "ovs_interfaceid": "8ebc1d23-a473-4640-aa39-31cbed300c07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7f36bae3-c729-4d85-8c31-075b2b100abe", "address": "fa:16:3e:99:5c:8b", "network": {"id": "9b0c9550-d764-4db6-b28b-09ab59801170", "bridge": "br-int", "label": "tempest-device-tagging-net1-638686183", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14aea401da6344858416fd2543bc10ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f36bae3-c7", "ovs_interfaceid": "7f36bae3-c729-4d85-8c31-075b2b100abe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "264de72a-d4f4-4a6a-b3ab-1e8ea8b9a30b", "address": "fa:16:3e:da:a9:6d", "network": {"id": "9b0c9550-d764-4db6-b28b-09ab59801170", "bridge": "br-int", "label": "tempest-device-tagging-net1-638686183", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14aea401da6344858416fd2543bc10ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap264de72a-d4", "ovs_interfaceid": "264de72a-d4f4-4a6a-b3ab-1e8ea8b9a30b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e3f484fe-17dd-4cef-babd-ad78cf557b03", "address": "fa:16:3e:e6:0d:58", "network": {"id": "9b0c9550-d764-4db6-b28b-09ab59801170", "bridge": "br-int", "label": "tempest-device-tagging-net1-638686183", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14aea401da6344858416fd2543bc10ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3f484fe-17", "ovs_interfaceid": "e3f484fe-17dd-4cef-babd-ad78cf557b03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0b2175eb-de94-4274-b200-14894dbcbda0", "address": "fa:16:3e:0f:80:1c", "network": {"id": "92fe4d7e-c0cd-45f1-9e92-a120ab22f6f1", "bridge": "br-int", "label": "tempest-device-tagging-net2-367644823", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "14aea401da6344858416fd2543bc10ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b2175eb-de", "ovs_interfaceid": "0b2175eb-de94-4274-b200-14894dbcbda0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5796cf52-4e81-4c40-954e-86819f5557c8", "address": "fa:16:3e:b7:67:83", "network": {"id": "92fe4d7e-c0cd-45f1-9e92-a120ab22f6f1", "bridge": "br-int", "label": "tempest-device-tagging-net2-367644823", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "14aea401da6344858416fd2543bc10ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5796cf52-4e", "ovs_interfaceid": "5796cf52-4e81-4c40-954e-86819f5557c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:02:22 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-13d678f6-3429-4389-b7ed-952e98b53f30 req-1a63d5aa-50df-4e10-8b90-edcc5bb5c12a service nova] Releasing lock "refresh_cache-026ab036-1481-4689-af70-661493e9451c" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:02:22 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-2f9f654f-f62b-48ca-8866-c4756fbc06b3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Inventory has not changed in ProviderTree for provider: 0e94b4c8-cd49-45e4-9133-d36eb4b2456b {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 16:02:22 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:02:22 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-2f9f654f-f62b-48ca-8866-c4756fbc06b3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Inventory has not changed for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 16:02:23 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-2f9f654f-f62b-48ca-8866-c4756fbc06b3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.573s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:02:23 user nova-compute[71874]: DEBUG nova.compute.manager [None req-2f9f654f-f62b-48ca-8866-c4756fbc06b3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] Start building networks asynchronously for instance. {{(pid=71874) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 16:02:23 user nova-compute[71874]: DEBUG nova.compute.manager [None req-2f9f654f-f62b-48ca-8866-c4756fbc06b3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] Allocating IP information in the background. {{(pid=71874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 16:02:23 user nova-compute[71874]: DEBUG nova.network.neutron [None req-2f9f654f-f62b-48ca-8866-c4756fbc06b3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] allocate_for_instance() {{(pid=71874) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 16:02:23 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-2f9f654f-f62b-48ca-8866-c4756fbc06b3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 16:02:23 user nova-compute[71874]: DEBUG nova.compute.manager [None req-2f9f654f-f62b-48ca-8866-c4756fbc06b3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] Start building block device mappings for instance. {{(pid=71874) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 16:02:23 user nova-compute[71874]: INFO nova.virt.block_device [None req-2f9f654f-f62b-48ca-8866-c4756fbc06b3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] Booting with blank volume at /dev/vda
Apr 12 16:02:23 user nova-compute[71874]: DEBUG nova.virt.libvirt.guest [None req-46c5e654-7b9b-4feb-bdfb-f5109e023e28 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] COPY block job progress, current cursor: 1015021568 final cursor: 1073741824 {{(pid=71874) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 16:02:23 user nova-compute[71874]: DEBUG nova.policy [None req-2f9f654f-f62b-48ca-8866-c4756fbc06b3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '73f9fa5bc22a4824b3cdcb8cf7bb380c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9210f81232304e179d3e09914a492442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71874) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 16:02:23 user nova-compute[71874]: DEBUG nova.virt.libvirt.guest [None req-46c5e654-7b9b-4feb-bdfb-f5109e023e28 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=71874) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 16:02:23 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-cbf270ef-0c51-4bbf-9943-bfa7afa5681f tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Acquiring lock "026ab036-1481-4689-af70-661493e9451c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:02:23 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-cbf270ef-0c51-4bbf-9943-bfa7afa5681f tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Lock "026ab036-1481-4689-af70-661493e9451c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:02:23 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-cbf270ef-0c51-4bbf-9943-bfa7afa5681f tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Acquiring lock "026ab036-1481-4689-af70-661493e9451c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:02:23 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-cbf270ef-0c51-4bbf-9943-bfa7afa5681f tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Lock "026ab036-1481-4689-af70-661493e9451c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:02:23 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-cbf270ef-0c51-4bbf-9943-bfa7afa5681f tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Lock "026ab036-1481-4689-af70-661493e9451c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:02:23 user nova-compute[71874]: INFO nova.compute.manager [None req-cbf270ef-0c51-4bbf-9943-bfa7afa5681f tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] [instance: 026ab036-1481-4689-af70-661493e9451c] Terminating instance
Apr 12 16:02:23 user nova-compute[71874]: DEBUG nova.compute.manager [None req-cbf270ef-0c51-4bbf-9943-bfa7afa5681f tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] [instance: 026ab036-1481-4689-af70-661493e9451c] Start destroying the instance on the hypervisor. {{(pid=71874) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 16:02:23 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46c5e654-7b9b-4feb-bdfb-f5109e023e28 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] [instance: e85aa869-0d2a-40ff-9697-f979a6b110cb] calling os-brick to detach iSCSI Volume {{(pid=71874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 16:02:23 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-46c5e654-7b9b-4feb-bdfb-f5109e023e28 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3c0216320>, {'target_iqn': 'iqn.2010-10.org.openstack:5894d073-fc1e-467b-99c4-290106eeea63', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BDfmsqQV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdl', 'volume_id': '5894d073-fc1e-467b-99c4-290106eeea63': {}}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:02:23 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-46c5e654-7b9b-4feb-bdfb-f5109e023e28 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:02:23 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-46c5e654-7b9b-4feb-bdfb-f5109e023e28 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:02:23 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-46c5e654-7b9b-4feb-bdfb-f5109e023e28 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:02:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:23 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa2ecb3c-4e32-47e0-ab3e-1a107d155d64]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a0100e6d-5149-423c-aadc-0c4f2635196b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b2fde1cb-bd86-48a5-8aca-463fdf3444b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5894d073-fc1e-467b-99c4-290106eeea63\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:23 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-46c5e654-7b9b-4feb-bdfb-f5109e023e28 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 16:02:23 user nova-compute[71874]: No targets found.
Apr 12 16:02:23 user nova-compute[71874]: iSNS:
Apr 12 16:02:23 user nova-compute[71874]: No targets found.
Apr 12 16:02:23 user nova-compute[71874]: STATIC:
Apr 12 16:02:23 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:a0100e6d-5149-423c-aadc-0c4f2635196b
Apr 12 16:02:23 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:02:23 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:02:23 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76
Apr 12 16:02:23 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:02:23 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:02:23 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4
Apr 12 16:02:23 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:02:23 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:02:23 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd
Apr 12 16:02:23 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:02:23 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:02:23 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:b2fde1cb-bd86-48a5-8aca-463fdf3444b0
Apr 12 16:02:23 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:02:23 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:02:23 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6
Apr 12 16:02:23 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:02:23 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:02:23 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4
Apr 12 16:02:23 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:02:23 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:02:23 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:5894d073-fc1e-467b-99c4-290106eeea63
Apr 12 16:02:23 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:02:23 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:02:23 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b
Apr 12 16:02:23 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:02:23 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:02:23 user nova-compute[71874]: FIRMWARE:
Apr 12 16:02:23 user nova-compute[71874]: No targets found.
Apr 12 16:02:23 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:02:23 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-46c5e654-7b9b-4feb-bdfb-f5109e023e28 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 16:02:23 user nova-compute[71874]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 16:02:23 user nova-compute[71874]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71874) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 16:02:23 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-46c5e654-7b9b-4feb-bdfb-f5109e023e28 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5894d073-fc1e-467b-99c4-290106eeea63', 0)] {{(pid=71874) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 16:02:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:23 user nova-compute[71874]: DEBUG nova.network.neutron [None req-2f9f654f-f62b-48ca-8866-c4756fbc06b3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] Successfully created port: 955511f0-eca8-447d-a105-fdd5f182de62 {{(pid=71874) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 16:02:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.111s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:24 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[34d85665-a23d-4350-ab87-749fff140654]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5894d073-fc1e-467b-99c4-290106eeea63\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a0100e6d-5149-423c-aadc-0c4f2635196b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2fde1cb-bd86-48a5-8aca-463fdf3444b0\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:24 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:02:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:24 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[bab7cab0-e6da-4360-aef7-33487bc90f98]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5894d073-fc1e-467b-99c4-290106eeea63 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fde1cb-bd86-48a5-8aca-463fdf3444b0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0100e6d-5149-423c-aadc-0c4f2635196b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6 (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:24 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-46c5e654-7b9b-4feb-bdfb-f5109e023e28 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5894d073-fc1e-467b-99c4-290106eeea63 (non-flash)
Apr 12 16:02:24 user nova-compute[71874]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76 (non-flash)
Apr 12 16:02:24 user nova-compute[71874]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fde1cb-bd86-48a5-8aca-463fdf3444b0 (non-flash)
Apr 12 16:02:24 user nova-compute[71874]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4 (non-flash)
Apr 12 16:02:24 user nova-compute[71874]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0100e6d-5149-423c-aadc-0c4f2635196b (non-flash)
Apr 12 16:02:24 user nova-compute[71874]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4 (non-flash)
Apr 12 16:02:24 user nova-compute[71874]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b (non-flash)
Apr 12 16:02:24 user nova-compute[71874]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd (non-flash)
Apr 12 16:02:24 user nova-compute[71874]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6 (non-flash)
Apr 12 16:02:24 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:02:24 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-46c5e654-7b9b-4feb-bdfb-f5109e023e28 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5894d073-fc1e-467b-99c4-290106eeea63 (non-flash)
Apr 12 16:02:24 user nova-compute[71874]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76 (non-flash)
Apr 12 16:02:24 user nova-compute[71874]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fde1cb-bd86-48a5-8aca-463fdf3444b0 (non-flash)
Apr 12 16:02:24 user nova-compute[71874]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4 (non-flash)
Apr 12 16:02:24 user nova-compute[71874]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0100e6d-5149-423c-aadc-0c4f2635196b (non-flash)
Apr 12 16:02:24 user nova-compute[71874]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4 (non-flash)
Apr 12 16:02:24 user nova-compute[71874]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b (non-flash)
Apr 12 16:02:24 user nova-compute[71874]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd (non-flash)
Apr 12 16:02:24 user nova-compute[71874]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6 (non-flash)
Apr 12 16:02:24 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:02:24 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-46c5e654-7b9b-4feb-bdfb-f5109e023e28 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc3c04b5990>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5894d073-fc1e-467b-99c4-290106eeea63'): ({'sdl'}, set())}) {{(pid=71874) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 16:02:24 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-46c5e654-7b9b-4feb-bdfb-f5109e023e28 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] Removing single pathed devices sdl {{(pid=71874) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 16:02:24 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:02:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:24 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9e0c9f1-07d5-4bc7-85a1-60572fd5ed91]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdl {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:24 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:02:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdl" returned: 0 in 0.025s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:24 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e98139f-85b7-40e2-b65f-00493c9e5bfa]: (4, ('ok\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:24 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-46c5e654-7b9b-4feb-bdfb-f5109e023e28 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] Flushing IO for device /dev/sdl {{(pid=71874) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 16:02:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdl {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:24 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:02:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdl" returned: 0 in 0.027s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:24 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e6dcbc2-611c-41ed-b0e9-aad985c88e9f]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:24 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-46c5e654-7b9b-4feb-bdfb-f5109e023e28 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=71874) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 16:02:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdl/device/delete {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:24 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:02:24 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:02:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdl/device/delete" returned: 0 in 0.043s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:24 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[aab422c4-b3fa-410a-916d-9b3976e275ce]: (4, ('1', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:24 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-46c5e654-7b9b-4feb-bdfb-f5109e023e28 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] Checking to see if SCSI volumes sdl have been removed. {{(pid=71874) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 16:02:24 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-46c5e654-7b9b-4feb-bdfb-f5109e023e28 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] SCSI volumes sdl have been removed. {{(pid=71874) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 16:02:24 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-46c5e654-7b9b-4feb-bdfb-f5109e023e28 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5894d073-fc1e-467b-99c4-290106eeea63')] {{(pid=71874) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 16:02:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5894d073-fc1e-467b-99c4-290106eeea63 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5894d073-fc1e-467b-99c4-290106eeea63 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:24 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[479babe9-d231-48c2-b3bf-bc74eeff105a]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:24 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-46c5e654-7b9b-4feb-bdfb-f5109e023e28 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:02:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5894d073-fc1e-467b-99c4-290106eeea63 -p 172.16.0.220:3260 --logout {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:24 user nova-compute[71874]: DEBUG nova.compute.manager [req-164c7a79-6279-4f0a-a300-cb4453db3fb2 req-8476164b-9664-453a-95c6-baf204b82291 service nova] [instance: 026ab036-1481-4689-af70-661493e9451c] Received event network-vif-unplugged-0d6194a7-a3c4-47f9-8c37-960cb622ce28 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:02:24 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-164c7a79-6279-4f0a-a300-cb4453db3fb2 req-8476164b-9664-453a-95c6-baf204b82291 service nova] Acquiring lock "026ab036-1481-4689-af70-661493e9451c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:02:24 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-164c7a79-6279-4f0a-a300-cb4453db3fb2 req-8476164b-9664-453a-95c6-baf204b82291 service nova] Lock "026ab036-1481-4689-af70-661493e9451c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:02:24 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-164c7a79-6279-4f0a-a300-cb4453db3fb2 req-8476164b-9664-453a-95c6-baf204b82291 service nova] Lock "026ab036-1481-4689-af70-661493e9451c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:02:24 user nova-compute[71874]: DEBUG nova.compute.manager [req-164c7a79-6279-4f0a-a300-cb4453db3fb2 req-8476164b-9664-453a-95c6-baf204b82291 service nova] [instance: 026ab036-1481-4689-af70-661493e9451c] No waiting events found dispatching network-vif-unplugged-0d6194a7-a3c4-47f9-8c37-960cb622ce28 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:02:24 user nova-compute[71874]: DEBUG nova.compute.manager [req-164c7a79-6279-4f0a-a300-cb4453db3fb2 req-8476164b-9664-453a-95c6-baf204b82291 service nova] [instance: 026ab036-1481-4689-af70-661493e9451c] Received event network-vif-unplugged-0d6194a7-a3c4-47f9-8c37-960cb622ce28 for instance with task_state deleting. {{(pid=71874) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 16:02:24 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:02:24 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:02:24 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:02:24 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:02:24 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Starting heal instance info cache {{(pid=71874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 16:02:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5894d073-fc1e-467b-99c4-290106eeea63 -p 172.16.0.220:3260 --logout" returned: 0 in 0.104s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:24 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e01b830-3937-4006-ac3e-372468349268]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:5894d073-fc1e-467b-99c4-290106eeea63, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:5894d073-fc1e-467b-99c4-290106eeea63, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:24 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-46c5e654-7b9b-4feb-bdfb-f5109e023e28 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:5894d073-fc1e-467b-99c4-290106eeea63, portal: 172.16.0.220,3260]
Apr 12 16:02:24 user nova-compute[71874]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:5894d073-fc1e-467b-99c4-290106eeea63, portal: 172.16.0.220,3260] successful.
Apr 12 16:02:24 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:02:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5894d073-fc1e-467b-99c4-290106eeea63 -p 172.16.0.220:3260 --op delete {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5894d073-fc1e-467b-99c4-290106eeea63 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.046s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:24 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba15e89d-79cd-45fd-9458-f655ff617acc]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:24 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-46c5e654-7b9b-4feb-bdfb-f5109e023e28 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:02:24 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-46c5e654-7b9b-4feb-bdfb-f5109e023e28 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.593s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:02:24 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-46c5e654-7b9b-4feb-bdfb-f5109e023e28 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] <== disconnect_volume: return (595ms) None {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:02:24 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46c5e654-7b9b-4feb-bdfb-f5109e023e28 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] [instance: e85aa869-0d2a-40ff-9697-f979a6b110cb] Disconnected iSCSI Volume {{(pid=71874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 16:02:24 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:02:24 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:02:24 user nova-compute[71874]: DEBUG nova.compute.manager [None req-46c5e654-7b9b-4feb-bdfb-f5109e023e28 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qvyPEgoJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'e85aa869-0d2a-40ff-9697-f979a6b110cb', 'attached_at': '', 'detached_at': '', 'volume_id': '5403a600-a3bb-44d7-b9b8-bf933454ca76', 'serial'} {{(pid=71874) _swap_volume /opt/stack/nova/nova/compute/manager.py:7665}}
Apr 12 16:02:24 user nova-compute[71874]: DEBUG nova.compute.manager [None req-46c5e654-7b9b-4feb-bdfb-f5109e023e28 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] [instance: e85aa869-0d2a-40ff-9697-f979a6b110cb] swap_volume: removing Cinder connection for volume 5894d073-fc1e-467b-99c4-290106eeea63 {{(pid=71874) _swap_volume /opt/stack/nova/nova/compute/manager.py:7710}}
Apr 12 16:02:24 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquiring lock "refresh_cache-608fbea2-b42b-4bb9-94a7-2b76dcdc2001" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:02:24 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquired lock "refresh_cache-608fbea2-b42b-4bb9-94a7-2b76dcdc2001" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:02:24 user nova-compute[71874]: DEBUG nova.network.neutron [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] [instance: 608fbea2-b42b-4bb9-94a7-2b76dcdc2001] Forcefully refreshing network info cache for instance {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 16:02:24 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:02:24 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:02:24 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:02:24 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:02:24 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:02:24 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:02:24 user nova-compute[71874]: DEBUG nova.network.neutron [None req-2f9f654f-f62b-48ca-8866-c4756fbc06b3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] Successfully updated port: 955511f0-eca8-447d-a105-fdd5f182de62 {{(pid=71874) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 16:02:24 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:02:24 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:02:24 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-2f9f654f-f62b-48ca-8866-c4756fbc06b3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Acquiring lock "refresh_cache-f52ee906-c8fd-4cd5-842e-de98a5099c4f" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:02:24 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-2f9f654f-f62b-48ca-8866-c4756fbc06b3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Acquired lock "refresh_cache-f52ee906-c8fd-4cd5-842e-de98a5099c4f" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:02:24 user nova-compute[71874]: DEBUG nova.network.neutron [None req-2f9f654f-f62b-48ca-8866-c4756fbc06b3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] Building network info cache for instance {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 16:02:24 user nova-compute[71874]: DEBUG nova.compute.manager [req-50f5a3ad-2c95-457a-b13d-28bcf58c2a6d req-59fa1a14-661d-49b6-a6b8-24bc15961546 service nova] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] Received event network-changed-955511f0-eca8-447d-a105-fdd5f182de62 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:02:24 user nova-compute[71874]: DEBUG nova.compute.manager [req-50f5a3ad-2c95-457a-b13d-28bcf58c2a6d req-59fa1a14-661d-49b6-a6b8-24bc15961546 service nova] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] Refreshing instance network info cache due to event network-changed-955511f0-eca8-447d-a105-fdd5f182de62. {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 16:02:24 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-50f5a3ad-2c95-457a-b13d-28bcf58c2a6d req-59fa1a14-661d-49b6-a6b8-24bc15961546 service nova] Acquiring lock "refresh_cache-f52ee906-c8fd-4cd5-842e-de98a5099c4f" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:02:25 user nova-compute[71874]: DEBUG nova.network.neutron [None req-2f9f654f-f62b-48ca-8866-c4756fbc06b3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] Instance cache missing network info. {{(pid=71874) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 16:02:25 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:02:25 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:02:25 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:02:25 user nova-compute[71874]: DEBUG nova.network.neutron [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] [instance: 608fbea2-b42b-4bb9-94a7-2b76dcdc2001] Updating instance_info_cache with network_info: [{"id": "246d47a5-6953-4e38-8546-63953a8721cf", "address": "fa:16:3e:64:93:eb", "network": {"id": "b36306e0-04c5-4b1b-8022-05ff121c4e43", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1503204786-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9210f81232304e179d3e09914a492442", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap246d47a5-69", "ovs_interfaceid": "246d47a5-6953-4e38-8546-63953a8721cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:02:25 user nova-compute[71874]: DEBUG nova.compute.manager [None req-46c5e654-7b9b-4feb-bdfb-f5109e023e28 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] [instance: e85aa869-0d2a-40ff-9697-f979a6b110cb] swap_volume: Updating volume 5894d073-fc1e-467b-99c4-290106eeea63 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "qvyPEgoJ", "auth_password": "6sEGZXdboqDlM2", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdb", "volume_id": "5403a600-a3bb-44d7-b9b8-bf933454ca76"}, "status": "reserved", "instance": "e85aa869-0d2a-40ff-9697-f979a6b110cb", "attached_at": "", "detached_at": "", "volume_id": "5403a600-a3bb-44d7-b9b8-bf933454ca76", "serial": "5403a600-a3bb-44d7-b9b8-bf933454ca76"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '5403a600-a3bb-44d7-b9b8-bf933454ca76', 'no_device': None, 'attachment_id': '25152326-dc03-409e-a72e-760414971999'} {{(pid=71874) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7858}}
Apr 12 16:02:25 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Releasing lock "refresh_cache-608fbea2-b42b-4bb9-94a7-2b76dcdc2001" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:02:25 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] [instance: 608fbea2-b42b-4bb9-94a7-2b76dcdc2001] Updated the network info_cache for instance {{(pid=71874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 16:02:25 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:02:25 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:02:25 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:02:25 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:02:25 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:02:25 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:02:25 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71874) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 16:02:25 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:02:25 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-46c5e654-7b9b-4feb-bdfb-f5109e023e28 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] Lock "e85aa869-0d2a-40ff-9697-f979a6b110cb" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 12.252s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:02:25 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:02:25 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:02:25 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:02:25 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Auditing locally available compute resources for user (node: user) {{(pid=71874) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 16:02:25 user nova-compute[71874]: INFO nova.virt.libvirt.driver [-] [instance: 026ab036-1481-4689-af70-661493e9451c] Instance destroyed successfully.
Apr 12 16:02:25 user nova-compute[71874]: DEBUG nova.objects.instance [None req-cbf270ef-0c51-4bbf-9943-bfa7afa5681f tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Lazy-loading 'resources' on Instance uuid 026ab036-1481-4689-af70-661493e9451c {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:02:25 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-cbf270ef-0c51-4bbf-9943-bfa7afa5681f tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T16:00:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-42887822',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-42887822',id=12,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLrB1DENR2pfOAjIRN9LEpsOVcpe9+tGHSdMunlhJFwYQlpEscFgY1JRfeVyTGaP039pStXo0RFjA+WSluJoqeyqAo5WqwaznRFWsI938ay0ZUrGDMwsQVNkx94RdMc5mA==',key_name='tempest-keypair-1782217974',keypairs=<?>,launch_index=0,launched_at=2023-04-12T16:00:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='14aea401da6344858416fd2543bc10ca',ramdisk_id='',reservation_id='r-dfnji3do',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1488698683',owner_user_name='tempest-TaggedBootDevicesTest_v242-1488698683-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T16:00:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='896a788283bf4e88b30528ef2721e90c',uuid=026ab036-1481-4689-af70-661493e9451c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0d6194a7-a3c4-47f9-8c37-960cb622ce28", "address": "fa:16:3e:9c:84:d7", "network": {"id": "77f1158d-0720-49c1-9530-29d3cdca64df", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1458658917-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14aea401da6344858416fd2543bc10ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d6194a7-a3", "ovs_interfaceid": "0d6194a7-a3c4-47f9-8c37-960cb622ce28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 16:02:25 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-cbf270ef-0c51-4bbf-9943-bfa7afa5681f tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Converting VIF {"id": "0d6194a7-a3c4-47f9-8c37-960cb622ce28", "address": "fa:16:3e:9c:84:d7", "network": {"id": "77f1158d-0720-49c1-9530-29d3cdca64df", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1458658917-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14aea401da6344858416fd2543bc10ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d6194a7-a3", "ovs_interfaceid": "0d6194a7-a3c4-47f9-8c37-960cb622ce28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:02:25 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-cbf270ef-0c51-4bbf-9943-bfa7afa5681f tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9c:84:d7,bridge_name='br-int',has_traffic_filtering=True,id=0d6194a7-a3c4-47f9-8c37-960cb622ce28,network=Network(77f1158d-0720-49c1-9530-29d3cdca64df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d6194a7-a3') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:02:25 user nova-compute[71874]: DEBUG os_vif [None req-cbf270ef-0c51-4bbf-9943-bfa7afa5681f tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9c:84:d7,bridge_name='br-int',has_traffic_filtering=True,id=0d6194a7-a3c4-47f9-8c37-960cb622ce28,network=Network(77f1158d-0720-49c1-9530-29d3cdca64df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d6194a7-a3') {{(pid=71874) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 16:02:25 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:02:25 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0d6194a7-a3, bridge=br-int, if_exists=True) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:02:25 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:02:25 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:02:25 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:02:25 user nova-compute[71874]: INFO os_vif [None req-cbf270ef-0c51-4bbf-9943-bfa7afa5681f tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9c:84:d7,bridge_name='br-int',has_traffic_filtering=True,id=0d6194a7-a3c4-47f9-8c37-960cb622ce28,network=Network(77f1158d-0720-49c1-9530-29d3cdca64df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d6194a7-a3')
Apr 12 16:02:25 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-cbf270ef-0c51-4bbf-9943-bfa7afa5681f tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T16:00:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-42887822',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-42887822',id=12,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLrB1DENR2pfOAjIRN9LEpsOVcpe9+tGHSdMunlhJFwYQlpEscFgY1JRfeVyTGaP039pStXo0RFjA+WSluJoqeyqAo5WqwaznRFWsI938ay0ZUrGDMwsQVNkx94RdMc5mA==',key_name='tempest-keypair-1782217974',keypairs=<?>,launch_index=0,launched_at=2023-04-12T16:00:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='14aea401da6344858416fd2543bc10ca',ramdisk_id='',reservation_id='r-dfnji3do',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1488698683',owner_user_name='tempest-TaggedBootDevicesTest_v242-1488698683-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T16:00:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='896a788283bf4e88b30528ef2721e90c',uuid=026ab036-1481-4689-af70-661493e9451c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8ebc1d23-a473-4640-aa39-31cbed300c07", "address": "fa:16:3e:d5:95:9e", "network": {"id": "9b0c9550-d764-4db6-b28b-09ab59801170", "bridge": "br-int", "label": "tempest-device-tagging-net1-638686183", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.180", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14aea401da6344858416fd2543bc10ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ebc1d23-a4", "ovs_interfaceid": "8ebc1d23-a473-4640-aa39-31cbed300c07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71874) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 16:02:25 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-cbf270ef-0c51-4bbf-9943-bfa7afa5681f tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Converting VIF {"id": "8ebc1d23-a473-4640-aa39-31cbed300c07", "address": "fa:16:3e:d5:95:9e", "network": {"id": "9b0c9550-d764-4db6-b28b-09ab59801170", "bridge": "br-int", "label": "tempest-device-tagging-net1-638686183", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.180", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14aea401da6344858416fd2543bc10ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ebc1d23-a4", "ovs_interfaceid": "8ebc1d23-a473-4640-aa39-31cbed300c07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:02:25 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-cbf270ef-0c51-4bbf-9943-bfa7afa5681f tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:95:9e,bridge_name='br-int',has_traffic_filtering=True,id=8ebc1d23-a473-4640-aa39-31cbed300c07,network=Network(9b0c9550-d764-4db6-b28b-09ab59801170),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8ebc1d23-a4') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:02:25 user nova-compute[71874]: DEBUG os_vif [None req-cbf270ef-0c51-4bbf-9943-bfa7afa5681f tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:95:9e,bridge_name='br-int',has_traffic_filtering=True,id=8ebc1d23-a473-4640-aa39-31cbed300c07,network=Network(9b0c9550-d764-4db6-b28b-09ab59801170),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8ebc1d23-a4') {{(pid=71874) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 16:02:25 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:02:25 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8ebc1d23-a4, bridge=br-int, if_exists=True) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:02:25 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:02:25 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:02:25 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:02:25 user nova-compute[71874]: INFO os_vif [None req-cbf270ef-0c51-4bbf-9943-bfa7afa5681f tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:95:9e,bridge_name='br-int',has_traffic_filtering=True,id=8ebc1d23-a473-4640-aa39-31cbed300c07,network=Network(9b0c9550-d764-4db6-b28b-09ab59801170),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8ebc1d23-a4')
Apr 12 16:02:25 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-cbf270ef-0c51-4bbf-9943-bfa7afa5681f tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T16:00:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-42887822',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-42887822',id=12,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLrB1DENR2pfOAjIRN9LEpsOVcpe9+tGHSdMunlhJFwYQlpEscFgY1JRfeVyTGaP039pStXo0RFjA+WSluJoqeyqAo5WqwaznRFWsI938ay0ZUrGDMwsQVNkx94RdMc5mA==',key_name='tempest-keypair-1782217974',keypairs=<?>,launch_index=0,launched_at=2023-04-12T16:00:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='14aea401da6344858416fd2543bc10ca',ramdisk_id='',reservation_id='r-dfnji3do',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1488698683',owner_user_name='tempest-TaggedBootDevicesTest_v242-1488698683-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T16:00:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='896a788283bf4e88b30528ef2721e90c',uuid=026ab036-1481-4689-af70-661493e9451c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7f36bae3-c729-4d85-8c31-075b2b100abe", "address": "fa:16:3e:99:5c:8b", "network": {"id": "9b0c9550-d764-4db6-b28b-09ab59801170", "bridge": "br-int", "label": "tempest-device-tagging-net1-638686183", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14aea401da6344858416fd2543bc10ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f36bae3-c7", "ovs_interfaceid": "7f36bae3-c729-4d85-8c31-075b2b100abe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71874) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 16:02:25 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-cbf270ef-0c51-4bbf-9943-bfa7afa5681f tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Converting VIF {"id": "7f36bae3-c729-4d85-8c31-075b2b100abe", "address": "fa:16:3e:99:5c:8b", "network": {"id": "9b0c9550-d764-4db6-b28b-09ab59801170", "bridge": "br-int", "label": "tempest-device-tagging-net1-638686183", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14aea401da6344858416fd2543bc10ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f36bae3-c7", "ovs_interfaceid": "7f36bae3-c729-4d85-8c31-075b2b100abe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:02:25 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-cbf270ef-0c51-4bbf-9943-bfa7afa5681f tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:5c:8b,bridge_name='br-int',has_traffic_filtering=True,id=7f36bae3-c729-4d85-8c31-075b2b100abe,network=Network(9b0c9550-d764-4db6-b28b-09ab59801170),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7f36bae3-c7') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:02:25 user nova-compute[71874]: DEBUG os_vif [None req-cbf270ef-0c51-4bbf-9943-bfa7afa5681f tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:5c:8b,bridge_name='br-int',has_traffic_filtering=True,id=7f36bae3-c729-4d85-8c31-075b2b100abe,network=Network(9b0c9550-d764-4db6-b28b-09ab59801170),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7f36bae3-c7') {{(pid=71874) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 16:02:25 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:02:25 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7f36bae3-c7, bridge=br-int, if_exists=True) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:02:25 user nova-compute[71874]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681315330.9581861, 6614f2c0-399b-43d2-86c9-5790c57575e9 => Stopped> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:02:25 user nova-compute[71874]: INFO nova.compute.manager [-] [instance: 6614f2c0-399b-43d2-86c9-5790c57575e9] VM Stopped (Lifecycle Event)
Apr 12 16:02:25 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:02:25 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:02:25 user nova-compute[71874]: DEBUG nova.compute.manager [None req-b080b5fe-cdfe-4ef8-9579-eea0bee15454 None None] [instance: 6614f2c0-399b-43d2-86c9-5790c57575e9] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:02:26 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:02:26 user nova-compute[71874]: INFO os_vif [None req-cbf270ef-0c51-4bbf-9943-bfa7afa5681f tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:5c:8b,bridge_name='br-int',has_traffic_filtering=True,id=7f36bae3-c729-4d85-8c31-075b2b100abe,network=Network(9b0c9550-d764-4db6-b28b-09ab59801170),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7f36bae3-c7')
Apr 12 16:02:26 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-cbf270ef-0c51-4bbf-9943-bfa7afa5681f tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T16:00:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-42887822',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-42887822',id=12,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLrB1DENR2pfOAjIRN9LEpsOVcpe9+tGHSdMunlhJFwYQlpEscFgY1JRfeVyTGaP039pStXo0RFjA+WSluJoqeyqAo5WqwaznRFWsI938ay0ZUrGDMwsQVNkx94RdMc5mA==',key_name='tempest-keypair-1782217974',keypairs=<?>,launch_index=0,launched_at=2023-04-12T16:00:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='14aea401da6344858416fd2543bc10ca',ramdisk_id='',reservation_id='r-dfnji3do',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1488698683',owner_user_name='tempest-TaggedBootDevicesTest_v242-1488698683-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T16:00:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='896a788283bf4e88b30528ef2721e90c',uuid=026ab036-1481-4689-af70-661493e9451c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "264de72a-d4f4-4a6a-b3ab-1e8ea8b9a30b", "address": "fa:16:3e:da:a9:6d", "network": {"id": "9b0c9550-d764-4db6-b28b-09ab59801170", "bridge": "br-int", "label": "tempest-device-tagging-net1-638686183", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14aea401da6344858416fd2543bc10ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap264de72a-d4", "ovs_interfaceid": "264de72a-d4f4-4a6a-b3ab-1e8ea8b9a30b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 16:02:26 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-cbf270ef-0c51-4bbf-9943-bfa7afa5681f tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Converting VIF {"id": "264de72a-d4f4-4a6a-b3ab-1e8ea8b9a30b", "address": "fa:16:3e:da:a9:6d", "network": {"id": "9b0c9550-d764-4db6-b28b-09ab59801170", "bridge": "br-int", "label": "tempest-device-tagging-net1-638686183", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14aea401da6344858416fd2543bc10ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap264de72a-d4", "ovs_interfaceid": "264de72a-d4f4-4a6a-b3ab-1e8ea8b9a30b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:02:26 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-cbf270ef-0c51-4bbf-9943-bfa7afa5681f tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:a9:6d,bridge_name='br-int',has_traffic_filtering=True,id=264de72a-d4f4-4a6a-b3ab-1e8ea8b9a30b,network=Network(9b0c9550-d764-4db6-b28b-09ab59801170),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap264de72a-d4') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:02:26 user nova-compute[71874]: DEBUG os_vif [None req-cbf270ef-0c51-4bbf-9943-bfa7afa5681f tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:a9:6d,bridge_name='br-int',has_traffic_filtering=True,id=264de72a-d4f4-4a6a-b3ab-1e8ea8b9a30b,network=Network(9b0c9550-d764-4db6-b28b-09ab59801170),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap264de72a-d4') {{(pid=71874) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 16:02:26 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:02:26 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap264de72a-d4, bridge=br-int, if_exists=True) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:02:26 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:02:26 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 16:02:26 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 16:02:26 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=71874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 16:02:26 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afebffae-dbf6-4876-8c9f-0364f0fde49c/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:26 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:02:26 user nova-compute[71874]: INFO os_vif [None req-cbf270ef-0c51-4bbf-9943-bfa7afa5681f tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:a9:6d,bridge_name='br-int',has_traffic_filtering=True,id=264de72a-d4f4-4a6a-b3ab-1e8ea8b9a30b,network=Network(9b0c9550-d764-4db6-b28b-09ab59801170),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap264de72a-d4')
Apr 12 16:02:26 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-cbf270ef-0c51-4bbf-9943-bfa7afa5681f tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T16:00:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-42887822',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-42887822',id=12,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLrB1DENR2pfOAjIRN9LEpsOVcpe9+tGHSdMunlhJFwYQlpEscFgY1JRfeVyTGaP039pStXo0RFjA+WSluJoqeyqAo5WqwaznRFWsI938ay0ZUrGDMwsQVNkx94RdMc5mA==',key_name='tempest-keypair-1782217974',keypairs=<?>,launch_index=0,launched_at=2023-04-12T16:00:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='14aea401da6344858416fd2543bc10ca',ramdisk_id='',reservation_id='r-dfnji3do',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1488698683',owner_user_name='tempest-TaggedBootDevicesTest_v242-1488698683-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T16:00:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='896a788283bf4e88b30528ef2721e90c',uuid=026ab036-1481-4689-af70-661493e9451c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e3f484fe-17dd-4cef-babd-ad78cf557b03", "address": "fa:16:3e:e6:0d:58", "network": {"id": "9b0c9550-d764-4db6-b28b-09ab59801170", "bridge": "br-int", "label": "tempest-device-tagging-net1-638686183", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14aea401da6344858416fd2543bc10ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3f484fe-17", "ovs_interfaceid": "e3f484fe-17dd-4cef-babd-ad78cf557b03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 16:02:26 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-cbf270ef-0c51-4bbf-9943-bfa7afa5681f tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Converting VIF {"id": "e3f484fe-17dd-4cef-babd-ad78cf557b03", "address": "fa:16:3e:e6:0d:58", "network": {"id": "9b0c9550-d764-4db6-b28b-09ab59801170", "bridge": "br-int", "label": "tempest-device-tagging-net1-638686183", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14aea401da6344858416fd2543bc10ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3f484fe-17", "ovs_interfaceid": "e3f484fe-17dd-4cef-babd-ad78cf557b03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:02:26 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-cbf270ef-0c51-4bbf-9943-bfa7afa5681f tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:0d:58,bridge_name='br-int',has_traffic_filtering=True,id=e3f484fe-17dd-4cef-babd-ad78cf557b03,network=Network(9b0c9550-d764-4db6-b28b-09ab59801170),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3f484fe-17') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:02:26 user nova-compute[71874]: DEBUG os_vif [None req-cbf270ef-0c51-4bbf-9943-bfa7afa5681f tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:0d:58,bridge_name='br-int',has_traffic_filtering=True,id=e3f484fe-17dd-4cef-babd-ad78cf557b03,network=Network(9b0c9550-d764-4db6-b28b-09ab59801170),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3f484fe-17') {{(pid=71874) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 16:02:26 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:02:26 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape3f484fe-17, bridge=br-int, if_exists=True) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:02:26 user nova-compute[71874]: DEBUG nova.network.neutron [None req-2f9f654f-f62b-48ca-8866-c4756fbc06b3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] Updating instance_info_cache with network_info: [{"id": "955511f0-eca8-447d-a105-fdd5f182de62", "address": "fa:16:3e:ec:61:14", "network": {"id": "b36306e0-04c5-4b1b-8022-05ff121c4e43", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1503204786-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9210f81232304e179d3e09914a492442", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap955511f0-ec", "ovs_interfaceid": "955511f0-eca8-447d-a105-fdd5f182de62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:02:26 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:02:26 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-2f9f654f-f62b-48ca-8866-c4756fbc06b3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Releasing lock "refresh_cache-f52ee906-c8fd-4cd5-842e-de98a5099c4f" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:02:26 user nova-compute[71874]: DEBUG nova.compute.manager [None req-2f9f654f-f62b-48ca-8866-c4756fbc06b3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] Instance network_info: |[{"id": "955511f0-eca8-447d-a105-fdd5f182de62", "address": "fa:16:3e:ec:61:14", "network": {"id": "b36306e0-04c5-4b1b-8022-05ff121c4e43", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1503204786-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9210f81232304e179d3e09914a492442", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap955511f0-ec", "ovs_interfaceid": "955511f0-eca8-447d-a105-fdd5f182de62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 16:02:26 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:02:26 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-50f5a3ad-2c95-457a-b13d-28bcf58c2a6d req-59fa1a14-661d-49b6-a6b8-24bc15961546 service nova] Acquired lock "refresh_cache-f52ee906-c8fd-4cd5-842e-de98a5099c4f" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:02:26 user nova-compute[71874]: DEBUG nova.network.neutron [req-50f5a3ad-2c95-457a-b13d-28bcf58c2a6d req-59fa1a14-661d-49b6-a6b8-24bc15961546 service nova] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] Refreshing network info cache for port 955511f0-eca8-447d-a105-fdd5f182de62 {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 16:02:26 user nova-compute[71874]: INFO os_vif [None req-cbf270ef-0c51-4bbf-9943-bfa7afa5681f tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:0d:58,bridge_name='br-int',has_traffic_filtering=True,id=e3f484fe-17dd-4cef-babd-ad78cf557b03,network=Network(9b0c9550-d764-4db6-b28b-09ab59801170),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3f484fe-17')
Apr 12 16:02:26 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-cbf270ef-0c51-4bbf-9943-bfa7afa5681f tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T16:00:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-42887822',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-42887822',id=12,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLrB1DENR2pfOAjIRN9LEpsOVcpe9+tGHSdMunlhJFwYQlpEscFgY1JRfeVyTGaP039pStXo0RFjA+WSluJoqeyqAo5WqwaznRFWsI938ay0ZUrGDMwsQVNkx94RdMc5mA==',key_name='tempest-keypair-1782217974',keypairs=<?>,launch_index=0,launched_at=2023-04-12T16:00:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='14aea401da6344858416fd2543bc10ca',ramdisk_id='',reservation_id='r-dfnji3do',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1488698683',owner_user_name='tempest-TaggedBootDevicesTest_v242-1488698683-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T16:00:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='896a788283bf4e88b30528ef2721e90c',uuid=026ab036-1481-4689-af70-661493e9451c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0b2175eb-de94-4274-b200-14894dbcbda0", "address": "fa:16:3e:0f:80:1c", "network": {"id": "92fe4d7e-c0cd-45f1-9e92-a120ab22f6f1", "bridge": "br-int", "label": "tempest-device-tagging-net2-367644823", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "14aea401da6344858416fd2543bc10ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b2175eb-de", "ovs_interfaceid": "0b2175eb-de94-4274-b200-14894dbcbda0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 16:02:26 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-cbf270ef-0c51-4bbf-9943-bfa7afa5681f tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Converting VIF {"id": "0b2175eb-de94-4274-b200-14894dbcbda0", "address": "fa:16:3e:0f:80:1c", "network": {"id": "92fe4d7e-c0cd-45f1-9e92-a120ab22f6f1", "bridge": "br-int", "label": "tempest-device-tagging-net2-367644823", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "14aea401da6344858416fd2543bc10ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b2175eb-de", "ovs_interfaceid": "0b2175eb-de94-4274-b200-14894dbcbda0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:02:26 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-cbf270ef-0c51-4bbf-9943-bfa7afa5681f tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:80:1c,bridge_name='br-int',has_traffic_filtering=True,id=0b2175eb-de94-4274-b200-14894dbcbda0,network=Network(92fe4d7e-c0cd-45f1-9e92-a120ab22f6f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b2175eb-de') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:02:26 user nova-compute[71874]: DEBUG os_vif [None req-cbf270ef-0c51-4bbf-9943-bfa7afa5681f tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:80:1c,bridge_name='br-int',has_traffic_filtering=True,id=0b2175eb-de94-4274-b200-14894dbcbda0,network=Network(92fe4d7e-c0cd-45f1-9e92-a120ab22f6f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b2175eb-de') {{(pid=71874) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 16:02:26 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:02:26 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0b2175eb-de, bridge=br-int, if_exists=True) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:02:26 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:02:26 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:02:26 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:02:26 user nova-compute[71874]: INFO os_vif [None req-cbf270ef-0c51-4bbf-9943-bfa7afa5681f tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:80:1c,bridge_name='br-int',has_traffic_filtering=True,id=0b2175eb-de94-4274-b200-14894dbcbda0,network=Network(92fe4d7e-c0cd-45f1-9e92-a120ab22f6f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b2175eb-de')
Apr 12 16:02:26 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-cbf270ef-0c51-4bbf-9943-bfa7afa5681f tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T16:00:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-42887822',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-42887822',id=12,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLrB1DENR2pfOAjIRN9LEpsOVcpe9+tGHSdMunlhJFwYQlpEscFgY1JRfeVyTGaP039pStXo0RFjA+WSluJoqeyqAo5WqwaznRFWsI938ay0ZUrGDMwsQVNkx94RdMc5mA==',key_name='tempest-keypair-1782217974',keypairs=<?>,launch_index=0,launched_at=2023-04-12T16:00:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='14aea401da6344858416fd2543bc10ca',ramdisk_id='',reservation_id='r-dfnji3do',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1488698683',owner_user_name='tempest-TaggedBootDevicesTest_v242-1488698683-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T16:00:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='896a788283bf4e88b30528ef2721e90c',uuid=026ab036-1481-4689-af70-661493e9451c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5796cf52-4e81-4c40-954e-86819f5557c8", "address": "fa:16:3e:b7:67:83", "network": {"id": "92fe4d7e-c0cd-45f1-9e92-a120ab22f6f1", "bridge": "br-int", "label": "tempest-device-tagging-net2-367644823", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "14aea401da6344858416fd2543bc10ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5796cf52-4e", "ovs_interfaceid": "5796cf52-4e81-4c40-954e-86819f5557c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 16:02:26 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-cbf270ef-0c51-4bbf-9943-bfa7afa5681f tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Converting VIF {"id": "5796cf52-4e81-4c40-954e-86819f5557c8", "address": "fa:16:3e:b7:67:83", "network": {"id": "92fe4d7e-c0cd-45f1-9e92-a120ab22f6f1", "bridge": "br-int", "label": "tempest-device-tagging-net2-367644823", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "14aea401da6344858416fd2543bc10ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5796cf52-4e", "ovs_interfaceid": "5796cf52-4e81-4c40-954e-86819f5557c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:02:26 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-cbf270ef-0c51-4bbf-9943-bfa7afa5681f tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:67:83,bridge_name='br-int',has_traffic_filtering=True,id=5796cf52-4e81-4c40-954e-86819f5557c8,network=Network(92fe4d7e-c0cd-45f1-9e92-a120ab22f6f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5796cf52-4e') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:02:26 user nova-compute[71874]: DEBUG os_vif [None req-cbf270ef-0c51-4bbf-9943-bfa7afa5681f tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:67:83,bridge_name='br-int',has_traffic_filtering=True,id=5796cf52-4e81-4c40-954e-86819f5557c8,network=Network(92fe4d7e-c0cd-45f1-9e92-a120ab22f6f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5796cf52-4e') {{(pid=71874) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 16:02:26 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:02:26 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5796cf52-4e, bridge=br-int, if_exists=True) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:02:26 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afebffae-dbf6-4876-8c9f-0364f0fde49c/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:26 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afebffae-dbf6-4876-8c9f-0364f0fde49c/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:26 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:02:26 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:02:26 user nova-compute[71874]: INFO os_vif [None req-cbf270ef-0c51-4bbf-9943-bfa7afa5681f tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:67:83,bridge_name='br-int',has_traffic_filtering=True,id=5796cf52-4e81-4c40-954e-86819f5557c8,network=Network(92fe4d7e-c0cd-45f1-9e92-a120ab22f6f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5796cf52-4e')
Apr 12 16:02:26 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cbf270ef-0c51-4bbf-9943-bfa7afa5681f tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] [instance: 026ab036-1481-4689-af70-661493e9451c] calling os-brick to detach iSCSI Volume {{(pid=71874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 16:02:26 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbf270ef-0c51-4bbf-9943-bfa7afa5681f tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3c0216320>, {'target_iqn': 'iqn.2010-10.org.openstack:b2fde1cb-bd86-48a5-8aca-463fdf3444b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TNLIkhgb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:02:26 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-cbf270ef-0c51-4bbf-9943-bfa7afa5681f tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:02:26 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-cbf270ef-0c51-4bbf-9943-bfa7afa5681f tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:02:26 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-cbf270ef-0c51-4bbf-9943-bfa7afa5681f tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:02:26 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:26 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.032s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:26 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[750f29c8-0745-4e24-988c-3a4fca0b43a0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a0100e6d-5149-423c-aadc-0c4f2635196b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b2fde1cb-bd86-48a5-8aca-463fdf3444b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:26 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbf270ef-0c51-4bbf-9943-bfa7afa5681f tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 16:02:26 user nova-compute[71874]: No targets found.
Apr 12 16:02:26 user nova-compute[71874]: iSNS:
Apr 12 16:02:26 user nova-compute[71874]: No targets found.
Apr 12 16:02:26 user nova-compute[71874]: STATIC:
Apr 12 16:02:26 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:a0100e6d-5149-423c-aadc-0c4f2635196b
Apr 12 16:02:26 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:02:26 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:02:26 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76
Apr 12 16:02:26 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:02:26 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:02:26 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4
Apr 12 16:02:26 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:02:26 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:02:26 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd
Apr 12 16:02:26 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:02:26 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:02:26 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:b2fde1cb-bd86-48a5-8aca-463fdf3444b0
Apr 12 16:02:26 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:02:26 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:02:26 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6
Apr 12 16:02:26 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:02:26 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:02:26 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4
Apr 12 16:02:26 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:02:26 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:02:26 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b
Apr 12 16:02:26 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:02:26 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:02:26 user nova-compute[71874]: FIRMWARE:
Apr 12 16:02:26 user nova-compute[71874]: No targets found.
Apr 12 16:02:26 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:02:26 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbf270ef-0c51-4bbf-9943-bfa7afa5681f tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 16:02:26 user nova-compute[71874]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 16:02:26 user nova-compute[71874]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71874) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 16:02:26 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbf270ef-0c51-4bbf-9943-bfa7afa5681f tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b2fde1cb-bd86-48a5-8aca-463fdf3444b0', 0)] {{(pid=71874) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 16:02:26 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:26 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:26 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc94935c-6b3c-42e3-a124-3b7ee98ccee4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a0100e6d-5149-423c-aadc-0c4f2635196b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2fde1cb-bd86-48a5-8aca-463fdf3444b0\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:26 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:26 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afebffae-dbf6-4876-8c9f-0364f0fde49c/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:26 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.045s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:26 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[0076efe2-8687-4d47-9ab0-d0a6a59cb086]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fde1cb-bd86-48a5-8aca-463fdf3444b0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0100e6d-5149-423c-aadc-0c4f2635196b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6 (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:26 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbf270ef-0c51-4bbf-9943-bfa7afa5681f tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76 (non-flash)
Apr 12 16:02:26 user nova-compute[71874]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fde1cb-bd86-48a5-8aca-463fdf3444b0 (non-flash)
Apr 12 16:02:26 user nova-compute[71874]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4 (non-flash)
Apr 12 16:02:26 user nova-compute[71874]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0100e6d-5149-423c-aadc-0c4f2635196b (non-flash)
Apr 12 16:02:26 user nova-compute[71874]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4 (non-flash)
Apr 12 16:02:26 user nova-compute[71874]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b (non-flash)
Apr 12 16:02:26 user nova-compute[71874]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd (non-flash)
Apr 12 16:02:26 user nova-compute[71874]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6 (non-flash)
Apr 12 16:02:26 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:02:26 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbf270ef-0c51-4bbf-9943-bfa7afa5681f tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76 (non-flash)
Apr 12 16:02:26 user nova-compute[71874]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fde1cb-bd86-48a5-8aca-463fdf3444b0 (non-flash)
Apr 12 16:02:26 user nova-compute[71874]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4 (non-flash)
Apr 12 16:02:26 user nova-compute[71874]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0100e6d-5149-423c-aadc-0c4f2635196b (non-flash)
Apr 12 16:02:26 user nova-compute[71874]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4 (non-flash)
Apr 12 16:02:26 user nova-compute[71874]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b (non-flash)
Apr 12 16:02:26 user nova-compute[71874]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd (non-flash)
Apr 12 16:02:26 user nova-compute[71874]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6 (non-flash)
Apr 12 16:02:26 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:02:26 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbf270ef-0c51-4bbf-9943-bfa7afa5681f tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc3c07c8820>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b2fde1cb-bd86-48a5-8aca-463fdf3444b0'): ({'sdc'}, set())}) {{(pid=71874) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 16:02:26 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-cbf270ef-0c51-4bbf-9943-bfa7afa5681f tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Removing single pathed devices sdc {{(pid=71874) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 16:02:26 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:26 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=71874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 16:02:26 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=71874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 16:02:26 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] skipping disk /dev/sdh (vdc) as it is a volume {{(pid=71874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 16:02:26 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/608fbea2-b42b-4bb9-94a7-2b76dcdc2001/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:26 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:26 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa5050d4-b2a7-4080-9b02-e9be041829cd]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:26 user nova-compute[71874]: DEBUG nova.compute.manager [req-d0861fb3-a200-4feb-b546-e94a1078b29e req-4af5d3ed-b139-4a10-9d5d-ca93fa54fc94 service nova] [instance: 026ab036-1481-4689-af70-661493e9451c] Received event network-vif-plugged-0d6194a7-a3c4-47f9-8c37-960cb622ce28 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:02:26 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-d0861fb3-a200-4feb-b546-e94a1078b29e req-4af5d3ed-b139-4a10-9d5d-ca93fa54fc94 service nova] Acquiring lock "026ab036-1481-4689-af70-661493e9451c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:02:26 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-d0861fb3-a200-4feb-b546-e94a1078b29e req-4af5d3ed-b139-4a10-9d5d-ca93fa54fc94 service nova] Lock "026ab036-1481-4689-af70-661493e9451c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:02:26 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-d0861fb3-a200-4feb-b546-e94a1078b29e req-4af5d3ed-b139-4a10-9d5d-ca93fa54fc94 service nova] Lock "026ab036-1481-4689-af70-661493e9451c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:02:26 user nova-compute[71874]: DEBUG nova.compute.manager [req-d0861fb3-a200-4feb-b546-e94a1078b29e req-4af5d3ed-b139-4a10-9d5d-ca93fa54fc94 service nova] [instance: 026ab036-1481-4689-af70-661493e9451c] No waiting events found dispatching network-vif-plugged-0d6194a7-a3c4-47f9-8c37-960cb622ce28 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:02:26 user nova-compute[71874]: WARNING nova.compute.manager [req-d0861fb3-a200-4feb-b546-e94a1078b29e req-4af5d3ed-b139-4a10-9d5d-ca93fa54fc94 service nova] [instance: 026ab036-1481-4689-af70-661493e9451c] Received unexpected event network-vif-plugged-0d6194a7-a3c4-47f9-8c37-960cb622ce28 for instance with vm_state active and task_state deleting.
Apr 12 16:02:26 user nova-compute[71874]: DEBUG nova.compute.manager [req-d0861fb3-a200-4feb-b546-e94a1078b29e req-4af5d3ed-b139-4a10-9d5d-ca93fa54fc94 service nova] [instance: 026ab036-1481-4689-af70-661493e9451c] Received event network-vif-unplugged-8ebc1d23-a473-4640-aa39-31cbed300c07 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:02:26 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-d0861fb3-a200-4feb-b546-e94a1078b29e req-4af5d3ed-b139-4a10-9d5d-ca93fa54fc94 service nova] Acquiring lock "026ab036-1481-4689-af70-661493e9451c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:02:26 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-d0861fb3-a200-4feb-b546-e94a1078b29e req-4af5d3ed-b139-4a10-9d5d-ca93fa54fc94 service nova] Lock "026ab036-1481-4689-af70-661493e9451c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:02:26 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-d0861fb3-a200-4feb-b546-e94a1078b29e req-4af5d3ed-b139-4a10-9d5d-ca93fa54fc94 service nova] Lock "026ab036-1481-4689-af70-661493e9451c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:02:26 user nova-compute[71874]: DEBUG nova.compute.manager [req-d0861fb3-a200-4feb-b546-e94a1078b29e req-4af5d3ed-b139-4a10-9d5d-ca93fa54fc94 service nova] [instance: 026ab036-1481-4689-af70-661493e9451c] No waiting events found dispatching network-vif-unplugged-8ebc1d23-a473-4640-aa39-31cbed300c07 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:02:26 user nova-compute[71874]: DEBUG nova.compute.manager [req-d0861fb3-a200-4feb-b546-e94a1078b29e req-4af5d3ed-b139-4a10-9d5d-ca93fa54fc94 service nova] [instance: 026ab036-1481-4689-af70-661493e9451c] Received event network-vif-unplugged-8ebc1d23-a473-4640-aa39-31cbed300c07 for instance with task_state deleting. {{(pid=71874) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 16:02:26 user nova-compute[71874]: DEBUG nova.compute.manager [req-d0861fb3-a200-4feb-b546-e94a1078b29e req-4af5d3ed-b139-4a10-9d5d-ca93fa54fc94 service nova] [instance: 026ab036-1481-4689-af70-661493e9451c] Received event network-vif-plugged-8ebc1d23-a473-4640-aa39-31cbed300c07 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:02:26 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-d0861fb3-a200-4feb-b546-e94a1078b29e req-4af5d3ed-b139-4a10-9d5d-ca93fa54fc94 service nova] Acquiring lock "026ab036-1481-4689-af70-661493e9451c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:02:26 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-d0861fb3-a200-4feb-b546-e94a1078b29e req-4af5d3ed-b139-4a10-9d5d-ca93fa54fc94 service nova] Lock "026ab036-1481-4689-af70-661493e9451c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:02:26 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-d0861fb3-a200-4feb-b546-e94a1078b29e req-4af5d3ed-b139-4a10-9d5d-ca93fa54fc94 service nova] Lock "026ab036-1481-4689-af70-661493e9451c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:02:26 user nova-compute[71874]: DEBUG nova.compute.manager [req-d0861fb3-a200-4feb-b546-e94a1078b29e req-4af5d3ed-b139-4a10-9d5d-ca93fa54fc94 service nova] [instance: 026ab036-1481-4689-af70-661493e9451c] No waiting events found dispatching network-vif-plugged-8ebc1d23-a473-4640-aa39-31cbed300c07 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:02:26 user nova-compute[71874]: WARNING nova.compute.manager [req-d0861fb3-a200-4feb-b546-e94a1078b29e req-4af5d3ed-b139-4a10-9d5d-ca93fa54fc94 service nova] [instance: 026ab036-1481-4689-af70-661493e9451c] Received unexpected event network-vif-plugged-8ebc1d23-a473-4640-aa39-31cbed300c07 for instance with vm_state active and task_state deleting.
Apr 12 16:02:26 user nova-compute[71874]: DEBUG nova.compute.manager [req-d0861fb3-a200-4feb-b546-e94a1078b29e req-4af5d3ed-b139-4a10-9d5d-ca93fa54fc94 service nova] [instance: 026ab036-1481-4689-af70-661493e9451c] Received event network-vif-unplugged-7f36bae3-c729-4d85-8c31-075b2b100abe {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:02:26 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-d0861fb3-a200-4feb-b546-e94a1078b29e req-4af5d3ed-b139-4a10-9d5d-ca93fa54fc94 service nova] Acquiring lock "026ab036-1481-4689-af70-661493e9451c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:02:26 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-d0861fb3-a200-4feb-b546-e94a1078b29e req-4af5d3ed-b139-4a10-9d5d-ca93fa54fc94 service nova] Lock "026ab036-1481-4689-af70-661493e9451c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:02:26 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-d0861fb3-a200-4feb-b546-e94a1078b29e req-4af5d3ed-b139-4a10-9d5d-ca93fa54fc94 service nova] Lock "026ab036-1481-4689-af70-661493e9451c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:02:26 user nova-compute[71874]: DEBUG nova.compute.manager [req-d0861fb3-a200-4feb-b546-e94a1078b29e req-4af5d3ed-b139-4a10-9d5d-ca93fa54fc94 service nova] [instance: 026ab036-1481-4689-af70-661493e9451c] No waiting events found dispatching network-vif-unplugged-7f36bae3-c729-4d85-8c31-075b2b100abe {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:02:26 user nova-compute[71874]: DEBUG nova.compute.manager [req-d0861fb3-a200-4feb-b546-e94a1078b29e req-4af5d3ed-b139-4a10-9d5d-ca93fa54fc94 service nova] [instance: 026ab036-1481-4689-af70-661493e9451c] Received event network-vif-unplugged-7f36bae3-c729-4d85-8c31-075b2b100abe for instance with task_state deleting. {{(pid=71874) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 16:02:26 user nova-compute[71874]: DEBUG nova.compute.manager [req-d0861fb3-a200-4feb-b546-e94a1078b29e req-4af5d3ed-b139-4a10-9d5d-ca93fa54fc94 service nova] [instance: 026ab036-1481-4689-af70-661493e9451c] Received event network-vif-plugged-7f36bae3-c729-4d85-8c31-075b2b100abe {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:02:26 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-d0861fb3-a200-4feb-b546-e94a1078b29e req-4af5d3ed-b139-4a10-9d5d-ca93fa54fc94 service nova] Acquiring lock "026ab036-1481-4689-af70-661493e9451c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:02:26 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-d0861fb3-a200-4feb-b546-e94a1078b29e req-4af5d3ed-b139-4a10-9d5d-ca93fa54fc94 service nova] Lock "026ab036-1481-4689-af70-661493e9451c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:02:26 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-d0861fb3-a200-4feb-b546-e94a1078b29e req-4af5d3ed-b139-4a10-9d5d-ca93fa54fc94 service nova] Lock "026ab036-1481-4689-af70-661493e9451c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:02:26 user nova-compute[71874]: DEBUG nova.compute.manager [req-d0861fb3-a200-4feb-b546-e94a1078b29e req-4af5d3ed-b139-4a10-9d5d-ca93fa54fc94 service nova] [instance: 026ab036-1481-4689-af70-661493e9451c] No waiting events found dispatching network-vif-plugged-7f36bae3-c729-4d85-8c31-075b2b100abe {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:02:26 user nova-compute[71874]: WARNING nova.compute.manager [req-d0861fb3-a200-4feb-b546-e94a1078b29e req-4af5d3ed-b139-4a10-9d5d-ca93fa54fc94 service nova] [instance: 026ab036-1481-4689-af70-661493e9451c] Received unexpected event network-vif-plugged-7f36bae3-c729-4d85-8c31-075b2b100abe for instance with vm_state active and task_state deleting.
Apr 12 16:02:26 user nova-compute[71874]: DEBUG nova.compute.manager [req-d0861fb3-a200-4feb-b546-e94a1078b29e req-4af5d3ed-b139-4a10-9d5d-ca93fa54fc94 service nova] [instance: 026ab036-1481-4689-af70-661493e9451c] Received event network-vif-unplugged-264de72a-d4f4-4a6a-b3ab-1e8ea8b9a30b {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:02:26 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-d0861fb3-a200-4feb-b546-e94a1078b29e req-4af5d3ed-b139-4a10-9d5d-ca93fa54fc94 service nova] Acquiring lock "026ab036-1481-4689-af70-661493e9451c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:02:26 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-d0861fb3-a200-4feb-b546-e94a1078b29e req-4af5d3ed-b139-4a10-9d5d-ca93fa54fc94 service nova] Lock "026ab036-1481-4689-af70-661493e9451c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:02:26 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-d0861fb3-a200-4feb-b546-e94a1078b29e req-4af5d3ed-b139-4a10-9d5d-ca93fa54fc94 service nova] Lock "026ab036-1481-4689-af70-661493e9451c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:02:26 user nova-compute[71874]: DEBUG nova.compute.manager [req-d0861fb3-a200-4feb-b546-e94a1078b29e req-4af5d3ed-b139-4a10-9d5d-ca93fa54fc94 service nova] [instance: 026ab036-1481-4689-af70-661493e9451c] No waiting events found dispatching network-vif-unplugged-264de72a-d4f4-4a6a-b3ab-1e8ea8b9a30b {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:02:26 user nova-compute[71874]: DEBUG nova.compute.manager [req-d0861fb3-a200-4feb-b546-e94a1078b29e req-4af5d3ed-b139-4a10-9d5d-ca93fa54fc94 service nova] [instance: 026ab036-1481-4689-af70-661493e9451c] Received event network-vif-unplugged-264de72a-d4f4-4a6a-b3ab-1e8ea8b9a30b for instance with task_state deleting. {{(pid=71874) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 16:02:26 user nova-compute[71874]: DEBUG nova.compute.manager [req-d0861fb3-a200-4feb-b546-e94a1078b29e req-4af5d3ed-b139-4a10-9d5d-ca93fa54fc94 service nova] [instance: 026ab036-1481-4689-af70-661493e9451c] Received event network-vif-plugged-264de72a-d4f4-4a6a-b3ab-1e8ea8b9a30b {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:02:26 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-d0861fb3-a200-4feb-b546-e94a1078b29e req-4af5d3ed-b139-4a10-9d5d-ca93fa54fc94 service nova] Acquiring lock "026ab036-1481-4689-af70-661493e9451c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:02:26 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-d0861fb3-a200-4feb-b546-e94a1078b29e req-4af5d3ed-b139-4a10-9d5d-ca93fa54fc94 service nova] Lock "026ab036-1481-4689-af70-661493e9451c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:02:26 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-d0861fb3-a200-4feb-b546-e94a1078b29e req-4af5d3ed-b139-4a10-9d5d-ca93fa54fc94 service nova] Lock "026ab036-1481-4689-af70-661493e9451c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:02:26 user nova-compute[71874]: DEBUG nova.compute.manager [req-d0861fb3-a200-4feb-b546-e94a1078b29e req-4af5d3ed-b139-4a10-9d5d-ca93fa54fc94 service nova] [instance: 026ab036-1481-4689-af70-661493e9451c] No waiting events found dispatching network-vif-plugged-264de72a-d4f4-4a6a-b3ab-1e8ea8b9a30b {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:02:26 user nova-compute[71874]: WARNING nova.compute.manager [req-d0861fb3-a200-4feb-b546-e94a1078b29e req-4af5d3ed-b139-4a10-9d5d-ca93fa54fc94 service nova] [instance: 026ab036-1481-4689-af70-661493e9451c] Received unexpected event network-vif-plugged-264de72a-d4f4-4a6a-b3ab-1e8ea8b9a30b for instance with vm_state active and task_state deleting.
Apr 12 16:02:26 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:26 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.025s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:26 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[13502c59-d1db-4a5e-8eb2-59bd540417e2]: (4, ('ok\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:26 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-cbf270ef-0c51-4bbf-9943-bfa7afa5681f tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Flushing IO for device /dev/sdc {{(pid=71874) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 16:02:26 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:26 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:26 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[709139cb-4e77-4e49-9bea-37f0a7709357]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:26 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-cbf270ef-0c51-4bbf-9943-bfa7afa5681f tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71874) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 16:02:26 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:26 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.049s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:26 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ac564ee-ddf9-41d2-b8e5-d33a9f300685]: (4, ('1', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:26 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-cbf270ef-0c51-4bbf-9943-bfa7afa5681f tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71874) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 16:02:26 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-cbf270ef-0c51-4bbf-9943-bfa7afa5681f tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] SCSI volumes sdc have been removed. {{(pid=71874) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 16:02:26 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbf270ef-0c51-4bbf-9943-bfa7afa5681f tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b2fde1cb-bd86-48a5-8aca-463fdf3444b0')] {{(pid=71874) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 16:02:26 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2fde1cb-bd86-48a5-8aca-463fdf3444b0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:26 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/608fbea2-b42b-4bb9-94a7-2b76dcdc2001/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:26 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/608fbea2-b42b-4bb9-94a7-2b76dcdc2001/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:26 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2fde1cb-bd86-48a5-8aca-463fdf3444b0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:26 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[492f9e67-92f8-4440-96d9-eec7fd2cb51f]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:26 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbf270ef-0c51-4bbf-9943-bfa7afa5681f tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:02:26 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2fde1cb-bd86-48a5-8aca-463fdf3444b0 -p 172.16.0.220:3260 --logout {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:26 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2fde1cb-bd86-48a5-8aca-463fdf3444b0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.086s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:26 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[196fbb3e-96a0-4d6b-acdb-960e3c40dc24]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:b2fde1cb-bd86-48a5-8aca-463fdf3444b0, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:b2fde1cb-bd86-48a5-8aca-463fdf3444b0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:26 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbf270ef-0c51-4bbf-9943-bfa7afa5681f tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:b2fde1cb-bd86-48a5-8aca-463fdf3444b0, portal: 172.16.0.220,3260]
Apr 12 16:02:26 user nova-compute[71874]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:b2fde1cb-bd86-48a5-8aca-463fdf3444b0, portal: 172.16.0.220,3260] successful.
Apr 12 16:02:26 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:02:26 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2fde1cb-bd86-48a5-8aca-463fdf3444b0 -p 172.16.0.220:3260 --op delete {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:26 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/608fbea2-b42b-4bb9-94a7-2b76dcdc2001/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:26 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55aff314-eb5e-4752-af9f-a4021e970cac/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:26 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2fde1cb-bd86-48a5-8aca-463fdf3444b0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.042s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:26 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b38a501-545e-4263-b1ef-ca1b96bbfa92]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:26 user nova-compute[71874]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681315331.8510616, 85b91251-9735-4812-9f11-003a7951a6f3 => Stopped> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:02:26 user nova-compute[71874]: INFO nova.compute.manager [-] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] VM Stopped (Lifecycle Event)
Apr 12 16:02:26 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbf270ef-0c51-4bbf-9943-bfa7afa5681f tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:02:26 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-cbf270ef-0c51-4bbf-9943-bfa7afa5681f tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.645s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:02:26 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbf270ef-0c51-4bbf-9943-bfa7afa5681f tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] <== disconnect_volume: return (647ms) None {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:02:26 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cbf270ef-0c51-4bbf-9943-bfa7afa5681f tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] [instance: 026ab036-1481-4689-af70-661493e9451c] Disconnected iSCSI Volume {{(pid=71874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 16:02:26 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cbf270ef-0c51-4bbf-9943-bfa7afa5681f tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] [instance: 026ab036-1481-4689-af70-661493e9451c] calling os-brick to detach iSCSI Volume {{(pid=71874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 16:02:26 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbf270ef-0c51-4bbf-9943-bfa7afa5681f tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3c0216320>, {'target_iqn': 'iqn.2010-10.org.openstack:33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FsfOvogi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:02:26 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-cbf270ef-0c51-4bbf-9943-bfa7afa5681f tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:02:26 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-cbf270ef-0c51-4bbf-9943-bfa7afa5681f tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:02:26 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-cbf270ef-0c51-4bbf-9943-bfa7afa5681f tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:02:26 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:26 user nova-compute[71874]: DEBUG nova.compute.manager [None req-c529dac7-cbe5-42da-9938-9091ec9e368a None None] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:02:26 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.030s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:26 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba53d768-ac0b-4be1-87f4-0bbef85f2762]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a0100e6d-5149-423c-aadc-0c4f2635196b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:26 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbf270ef-0c51-4bbf-9943-bfa7afa5681f tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 16:02:26 user nova-compute[71874]: No targets found.
Apr 12 16:02:26 user nova-compute[71874]: iSNS:
Apr 12 16:02:26 user nova-compute[71874]: No targets found.
Apr 12 16:02:26 user nova-compute[71874]: STATIC:
Apr 12 16:02:26 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:a0100e6d-5149-423c-aadc-0c4f2635196b
Apr 12 16:02:26 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:02:26 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:02:26 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76
Apr 12 16:02:26 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:02:26 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:02:26 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4
Apr 12 16:02:26 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:02:26 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:02:26 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd
Apr 12 16:02:26 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:02:26 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:02:26 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6
Apr 12 16:02:26 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:02:26 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:02:26 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4
Apr 12 16:02:26 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:02:26 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:02:26 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b
Apr 12 16:02:26 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:02:26 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:02:26 user nova-compute[71874]: FIRMWARE:
Apr 12 16:02:26 user nova-compute[71874]: No targets found.
Apr 12 16:02:26 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:02:26 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbf270ef-0c51-4bbf-9943-bfa7afa5681f tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 16:02:26 user nova-compute[71874]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 16:02:26 user nova-compute[71874]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71874) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 16:02:26 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbf270ef-0c51-4bbf-9943-bfa7afa5681f tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4', 0)] {{(pid=71874) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 16:02:26 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:26 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:26 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[6da8514b-424f-4ef1-b544-7b12f1c522c2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a0100e6d-5149-423c-aadc-0c4f2635196b\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:27 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:27 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:27 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[60dcda59-b756-4542-9547-2960fb20da30]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0100e6d-5149-423c-aadc-0c4f2635196b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6 (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:27 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbf270ef-0c51-4bbf-9943-bfa7afa5681f tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76 (non-flash)
Apr 12 16:02:27 user nova-compute[71874]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4 (non-flash)
Apr 12 16:02:27 user nova-compute[71874]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0100e6d-5149-423c-aadc-0c4f2635196b (non-flash)
Apr 12 16:02:27 user nova-compute[71874]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4 (non-flash)
Apr 12 16:02:27 user nova-compute[71874]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b (non-flash)
Apr 12 16:02:27 user nova-compute[71874]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd (non-flash)
Apr 12 16:02:27 user nova-compute[71874]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6 (non-flash)
Apr 12 16:02:27 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:02:27 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbf270ef-0c51-4bbf-9943-bfa7afa5681f tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76 (non-flash)
Apr 12 16:02:27 user nova-compute[71874]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4 (non-flash)
Apr 12 16:02:27 user nova-compute[71874]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0100e6d-5149-423c-aadc-0c4f2635196b (non-flash)
Apr 12 16:02:27 user nova-compute[71874]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4 (non-flash)
Apr 12 16:02:27 user nova-compute[71874]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b (non-flash)
Apr 12 16:02:27 user nova-compute[71874]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd (non-flash)
Apr 12 16:02:27 user nova-compute[71874]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6 (non-flash)
Apr 12 16:02:27 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:02:27 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbf270ef-0c51-4bbf-9943-bfa7afa5681f tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc3d44f9360>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4'): ({'sdd'}, set())}) {{(pid=71874) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 16:02:27 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-cbf270ef-0c51-4bbf-9943-bfa7afa5681f tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Removing single pathed devices sdd {{(pid=71874) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 16:02:27 user nova-compute[71874]: DEBUG nova.network.neutron [req-50f5a3ad-2c95-457a-b13d-28bcf58c2a6d req-59fa1a14-661d-49b6-a6b8-24bc15961546 service nova] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] Updated VIF entry in instance network info cache for port 955511f0-eca8-447d-a105-fdd5f182de62. {{(pid=71874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 16:02:27 user nova-compute[71874]: DEBUG nova.network.neutron [req-50f5a3ad-2c95-457a-b13d-28bcf58c2a6d req-59fa1a14-661d-49b6-a6b8-24bc15961546 service nova] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] Updating instance_info_cache with network_info: [{"id": "955511f0-eca8-447d-a105-fdd5f182de62", "address": "fa:16:3e:ec:61:14", "network": {"id": "b36306e0-04c5-4b1b-8022-05ff121c4e43", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1503204786-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9210f81232304e179d3e09914a492442", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap955511f0-ec", "ovs_interfaceid": "955511f0-eca8-447d-a105-fdd5f182de62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:02:27 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:27 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55aff314-eb5e-4752-af9f-a4021e970cac/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:27 user nova-compute[71874]: DEBUG nova.compute.manager [req-9ccdfa61-f35b-4279-b531-4d8451844c05 req-33930647-fcc9-4cc7-a414-7c4b1f9151e8 service nova] [instance: 026ab036-1481-4689-af70-661493e9451c] Received event network-vif-unplugged-e3f484fe-17dd-4cef-babd-ad78cf557b03 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:02:27 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-9ccdfa61-f35b-4279-b531-4d8451844c05 req-33930647-fcc9-4cc7-a414-7c4b1f9151e8 service nova] Acquiring lock "026ab036-1481-4689-af70-661493e9451c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:02:27 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-9ccdfa61-f35b-4279-b531-4d8451844c05 req-33930647-fcc9-4cc7-a414-7c4b1f9151e8 service nova] Lock "026ab036-1481-4689-af70-661493e9451c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:02:27 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-9ccdfa61-f35b-4279-b531-4d8451844c05 req-33930647-fcc9-4cc7-a414-7c4b1f9151e8 service nova] Lock "026ab036-1481-4689-af70-661493e9451c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:02:27 user nova-compute[71874]: DEBUG nova.compute.manager [req-9ccdfa61-f35b-4279-b531-4d8451844c05 req-33930647-fcc9-4cc7-a414-7c4b1f9151e8 service nova] [instance: 026ab036-1481-4689-af70-661493e9451c] No waiting events found dispatching network-vif-unplugged-e3f484fe-17dd-4cef-babd-ad78cf557b03 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:02:27 user nova-compute[71874]: DEBUG nova.compute.manager [req-9ccdfa61-f35b-4279-b531-4d8451844c05 req-33930647-fcc9-4cc7-a414-7c4b1f9151e8 service nova] [instance: 026ab036-1481-4689-af70-661493e9451c] Received event network-vif-unplugged-e3f484fe-17dd-4cef-babd-ad78cf557b03 for instance with task_state deleting. {{(pid=71874) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 16:02:27 user nova-compute[71874]: DEBUG nova.compute.manager [req-9ccdfa61-f35b-4279-b531-4d8451844c05 req-33930647-fcc9-4cc7-a414-7c4b1f9151e8 service nova] [instance: 026ab036-1481-4689-af70-661493e9451c] Received event network-vif-plugged-e3f484fe-17dd-4cef-babd-ad78cf557b03 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:02:27 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-9ccdfa61-f35b-4279-b531-4d8451844c05 req-33930647-fcc9-4cc7-a414-7c4b1f9151e8 service nova] Acquiring lock "026ab036-1481-4689-af70-661493e9451c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:02:27 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-9ccdfa61-f35b-4279-b531-4d8451844c05 req-33930647-fcc9-4cc7-a414-7c4b1f9151e8 service nova] Lock "026ab036-1481-4689-af70-661493e9451c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:02:27 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-9ccdfa61-f35b-4279-b531-4d8451844c05 req-33930647-fcc9-4cc7-a414-7c4b1f9151e8 service nova] Lock "026ab036-1481-4689-af70-661493e9451c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:02:27 user nova-compute[71874]: DEBUG nova.compute.manager [req-9ccdfa61-f35b-4279-b531-4d8451844c05 req-33930647-fcc9-4cc7-a414-7c4b1f9151e8 service nova] [instance: 026ab036-1481-4689-af70-661493e9451c] No waiting events found dispatching network-vif-plugged-e3f484fe-17dd-4cef-babd-ad78cf557b03 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:02:27 user nova-compute[71874]: WARNING nova.compute.manager [req-9ccdfa61-f35b-4279-b531-4d8451844c05 req-33930647-fcc9-4cc7-a414-7c4b1f9151e8 service nova] [instance: 026ab036-1481-4689-af70-661493e9451c] Received unexpected event network-vif-plugged-e3f484fe-17dd-4cef-babd-ad78cf557b03 for instance with vm_state active and task_state deleting.
Apr 12 16:02:27 user nova-compute[71874]: DEBUG nova.compute.manager [req-9ccdfa61-f35b-4279-b531-4d8451844c05 req-33930647-fcc9-4cc7-a414-7c4b1f9151e8 service nova] [instance: 026ab036-1481-4689-af70-661493e9451c] Received event network-vif-unplugged-0b2175eb-de94-4274-b200-14894dbcbda0 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:02:27 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-9ccdfa61-f35b-4279-b531-4d8451844c05 req-33930647-fcc9-4cc7-a414-7c4b1f9151e8 service nova] Acquiring lock "026ab036-1481-4689-af70-661493e9451c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:02:27 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-9ccdfa61-f35b-4279-b531-4d8451844c05 req-33930647-fcc9-4cc7-a414-7c4b1f9151e8 service nova] Lock "026ab036-1481-4689-af70-661493e9451c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:02:27 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-9ccdfa61-f35b-4279-b531-4d8451844c05 req-33930647-fcc9-4cc7-a414-7c4b1f9151e8 service nova] Lock "026ab036-1481-4689-af70-661493e9451c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:02:27 user nova-compute[71874]: DEBUG nova.compute.manager [req-9ccdfa61-f35b-4279-b531-4d8451844c05 req-33930647-fcc9-4cc7-a414-7c4b1f9151e8 service nova] [instance: 026ab036-1481-4689-af70-661493e9451c] No waiting events found dispatching network-vif-unplugged-0b2175eb-de94-4274-b200-14894dbcbda0 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:02:27 user nova-compute[71874]: DEBUG nova.compute.manager [req-9ccdfa61-f35b-4279-b531-4d8451844c05 req-33930647-fcc9-4cc7-a414-7c4b1f9151e8 service nova] [instance: 026ab036-1481-4689-af70-661493e9451c] Received event network-vif-unplugged-0b2175eb-de94-4274-b200-14894dbcbda0 for instance with task_state deleting. {{(pid=71874) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 16:02:27 user nova-compute[71874]: DEBUG nova.compute.manager [req-9ccdfa61-f35b-4279-b531-4d8451844c05 req-33930647-fcc9-4cc7-a414-7c4b1f9151e8 service nova] [instance: 026ab036-1481-4689-af70-661493e9451c] Received event network-vif-plugged-0b2175eb-de94-4274-b200-14894dbcbda0 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:02:27 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-9ccdfa61-f35b-4279-b531-4d8451844c05 req-33930647-fcc9-4cc7-a414-7c4b1f9151e8 service nova] Acquiring lock "026ab036-1481-4689-af70-661493e9451c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:02:27 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-9ccdfa61-f35b-4279-b531-4d8451844c05 req-33930647-fcc9-4cc7-a414-7c4b1f9151e8 service nova] Lock "026ab036-1481-4689-af70-661493e9451c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:02:27 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-9ccdfa61-f35b-4279-b531-4d8451844c05 req-33930647-fcc9-4cc7-a414-7c4b1f9151e8 service nova] Lock "026ab036-1481-4689-af70-661493e9451c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:02:27 user nova-compute[71874]: DEBUG nova.compute.manager [req-9ccdfa61-f35b-4279-b531-4d8451844c05 req-33930647-fcc9-4cc7-a414-7c4b1f9151e8 service nova] [instance: 026ab036-1481-4689-af70-661493e9451c] No waiting events found dispatching network-vif-plugged-0b2175eb-de94-4274-b200-14894dbcbda0 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:02:27 user nova-compute[71874]: WARNING nova.compute.manager [req-9ccdfa61-f35b-4279-b531-4d8451844c05 req-33930647-fcc9-4cc7-a414-7c4b1f9151e8 service nova] [instance: 026ab036-1481-4689-af70-661493e9451c] Received unexpected event network-vif-plugged-0b2175eb-de94-4274-b200-14894dbcbda0 for instance with vm_state active and task_state deleting.
Apr 12 16:02:27 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55aff314-eb5e-4752-af9f-a4021e970cac/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:27 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:27 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[d27e740d-5646-4698-aea8-d68bd8640266]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:27 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-50f5a3ad-2c95-457a-b13d-28bcf58c2a6d req-59fa1a14-661d-49b6-a6b8-24bc15961546 service nova] Releasing lock "refresh_cache-f52ee906-c8fd-4cd5-842e-de98a5099c4f" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:02:27 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:27 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:27 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[18d09952-cad8-4614-aeb9-4ad65fae3f05]: (4, ('ok\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:27 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-cbf270ef-0c51-4bbf-9943-bfa7afa5681f tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Flushing IO for device /dev/sdd {{(pid=71874) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 16:02:27 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:27 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:27 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[201e52aa-d6f1-4a39-b3c8-890802a20a1d]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:27 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-cbf270ef-0c51-4bbf-9943-bfa7afa5681f tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71874) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 16:02:27 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:27 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.044s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:27 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[c75653b3-940e-410e-9a8d-a681b8be5a20]: (4, ('1', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:27 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-cbf270ef-0c51-4bbf-9943-bfa7afa5681f tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71874) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 16:02:27 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-cbf270ef-0c51-4bbf-9943-bfa7afa5681f tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] SCSI volumes sdd have been removed. {{(pid=71874) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 16:02:27 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbf270ef-0c51-4bbf-9943-bfa7afa5681f tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4')] {{(pid=71874) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 16:02:27 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:27 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55aff314-eb5e-4752-af9f-a4021e970cac/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:27 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/920c6512-180d-46e1-b0cf-240d34c3fc97/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:27 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.031s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:27 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[73143adf-91a2-41a6-b656-99a2a88808a3]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:27 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbf270ef-0c51-4bbf-9943-bfa7afa5681f tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:02:27 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4 -p 172.16.0.220:3260 --logout {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:27 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.090s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:27 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbe72989-ef89-4ce3-8283-81d2866d2d04]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:27 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbf270ef-0c51-4bbf-9943-bfa7afa5681f tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4, portal: 172.16.0.220,3260]
Apr 12 16:02:27 user nova-compute[71874]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4, portal: 172.16.0.220,3260] successful.
Apr 12 16:02:27 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:02:27 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4 -p 172.16.0.220:3260 --op delete {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:27 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.041s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:27 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d8828b4-b181-450d-b8ea-62ca09a2edae]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:27 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbf270ef-0c51-4bbf-9943-bfa7afa5681f tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:02:27 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-cbf270ef-0c51-4bbf-9943-bfa7afa5681f tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.557s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:02:27 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbf270ef-0c51-4bbf-9943-bfa7afa5681f tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] <== disconnect_volume: return (559ms) None {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:02:27 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cbf270ef-0c51-4bbf-9943-bfa7afa5681f tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] [instance: 026ab036-1481-4689-af70-661493e9451c] Disconnected iSCSI Volume {{(pid=71874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 16:02:27 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/920c6512-180d-46e1-b0cf-240d34c3fc97/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:27 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/920c6512-180d-46e1-b0cf-240d34c3fc97/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:27 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-342a2ae6-74f9-4bb7-9699-ba22856fccf6 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Acquiring lock "e85aa869-0d2a-40ff-9697-f979a6b110cb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:02:27 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-342a2ae6-74f9-4bb7-9699-ba22856fccf6 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Lock "e85aa869-0d2a-40ff-9697-f979a6b110cb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.003s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:02:27 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cbf270ef-0c51-4bbf-9943-bfa7afa5681f tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] [instance: 026ab036-1481-4689-af70-661493e9451c] calling os-brick to detach iSCSI Volume {{(pid=71874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 16:02:27 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbf270ef-0c51-4bbf-9943-bfa7afa5681f tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3c0216320>, {'target_iqn': 'iqn.2010-10.org.openstack:a0100e6d-5149-423c-aadc-0c4f2635196b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'msHTjcxK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:02:27 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-cbf270ef-0c51-4bbf-9943-bfa7afa5681f tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:02:27 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-cbf270ef-0c51-4bbf-9943-bfa7afa5681f tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:02:27 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-cbf270ef-0c51-4bbf-9943-bfa7afa5681f tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:02:27 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:27 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:02:27 user nova-compute[71874]: INFO nova.compute.manager [None req-342a2ae6-74f9-4bb7-9699-ba22856fccf6 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] [instance: e85aa869-0d2a-40ff-9697-f979a6b110cb] Detaching volume 5403a600-a3bb-44d7-b9b8-bf933454ca76
Apr 12 16:02:27 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:27 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[7115ef8b-6acf-4d81-bf97-0de99ebd4892]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a0100e6d-5149-423c-aadc-0c4f2635196b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:27 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbf270ef-0c51-4bbf-9943-bfa7afa5681f tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 16:02:27 user nova-compute[71874]: No targets found.
Apr 12 16:02:27 user nova-compute[71874]: iSNS:
Apr 12 16:02:27 user nova-compute[71874]: No targets found.
Apr 12 16:02:27 user nova-compute[71874]: STATIC:
Apr 12 16:02:27 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:a0100e6d-5149-423c-aadc-0c4f2635196b
Apr 12 16:02:27 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:02:27 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:02:27 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76
Apr 12 16:02:27 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:02:27 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:02:27 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd
Apr 12 16:02:27 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:02:27 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:02:27 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6
Apr 12 16:02:27 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:02:27 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:02:27 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4
Apr 12 16:02:27 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:02:27 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:02:27 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b
Apr 12 16:02:27 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:02:27 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:02:27 user nova-compute[71874]: FIRMWARE:
Apr 12 16:02:27 user nova-compute[71874]: No targets found.
Apr 12 16:02:27 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:02:27 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbf270ef-0c51-4bbf-9943-bfa7afa5681f tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 16:02:27 user nova-compute[71874]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 16:02:27 user nova-compute[71874]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71874) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 16:02:27 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbf270ef-0c51-4bbf-9943-bfa7afa5681f tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a0100e6d-5149-423c-aadc-0c4f2635196b', 0)] {{(pid=71874) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 16:02:27 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:27 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:27 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcb8769d-f628-45d3-b009-6105dfce24ca]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a0100e6d-5149-423c-aadc-0c4f2635196b\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:27 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:27 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:27 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[51289b52-797c-4f34-aae1-953ed1f5512c]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0100e6d-5149-423c-aadc-0c4f2635196b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6 (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:27 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbf270ef-0c51-4bbf-9943-bfa7afa5681f tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76 (non-flash)
Apr 12 16:02:27 user nova-compute[71874]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0100e6d-5149-423c-aadc-0c4f2635196b (non-flash)
Apr 12 16:02:27 user nova-compute[71874]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4 (non-flash)
Apr 12 16:02:27 user nova-compute[71874]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b (non-flash)
Apr 12 16:02:27 user nova-compute[71874]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd (non-flash)
Apr 12 16:02:27 user nova-compute[71874]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6 (non-flash)
Apr 12 16:02:27 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:02:27 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbf270ef-0c51-4bbf-9943-bfa7afa5681f tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76 (non-flash)
Apr 12 16:02:27 user nova-compute[71874]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0100e6d-5149-423c-aadc-0c4f2635196b (non-flash)
Apr 12 16:02:27 user nova-compute[71874]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4 (non-flash)
Apr 12 16:02:27 user nova-compute[71874]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b (non-flash)
Apr 12 16:02:27 user nova-compute[71874]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd (non-flash)
Apr 12 16:02:27 user nova-compute[71874]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6 (non-flash)
Apr 12 16:02:27 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:02:27 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbf270ef-0c51-4bbf-9943-bfa7afa5681f tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc3c0611c60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a0100e6d-5149-423c-aadc-0c4f2635196b'): ({'sde'}, set())}) {{(pid=71874) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 16:02:27 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-cbf270ef-0c51-4bbf-9943-bfa7afa5681f tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Removing single pathed devices sde {{(pid=71874) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 16:02:27 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:27 user nova-compute[71874]: INFO nova.virt.block_device [None req-342a2ae6-74f9-4bb7-9699-ba22856fccf6 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] [instance: e85aa869-0d2a-40ff-9697-f979a6b110cb] Attempting to driver detach volume 5403a600-a3bb-44d7-b9b8-bf933454ca76 from mountpoint /dev/vdb
Apr 12 16:02:27 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/920c6512-180d-46e1-b0cf-240d34c3fc97/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:27 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=71874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 16:02:27 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:27 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae4ab443-6a8e-4403-bc11-a054e82aabe8]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:27 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad0cece6-9b26-4c87-9e48-2c0437cb9190/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:27 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:27 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.033s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:27 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5dd6a14-062e-420e-b650-7f5f8e7d8034]: (4, ('ok\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:27 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-cbf270ef-0c51-4bbf-9943-bfa7afa5681f tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Flushing IO for device /dev/sde {{(pid=71874) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 16:02:27 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:27 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-342a2ae6-74f9-4bb7-9699-ba22856fccf6 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Attempting to detach device vdb from instance e85aa869-0d2a-40ff-9697-f979a6b110cb from the persistent domain config. {{(pid=71874) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 16:02:27 user nova-compute[71874]: DEBUG nova.virt.libvirt.guest [None req-342a2ae6-74f9-4bb7-9699-ba22856fccf6 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 16:02:27 user nova-compute[71874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 16:02:27 user nova-compute[71874]:   <source dev="/dev/sdb"/>
Apr 12 16:02:27 user nova-compute[71874]:   <target dev="vdb" bus="virtio"/>
Apr 12 16:02:27 user nova-compute[71874]:   <serial>5403a600-a3bb-44d7-b9b8-bf933454ca76</serial>
Apr 12 16:02:27 user nova-compute[71874]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 16:02:27 user nova-compute[71874]: </disk>
Apr 12 16:02:27 user nova-compute[71874]:  {{(pid=71874) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 16:02:27 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.025s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:27 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[74949515-3f13-440f-bc69-edf3f3b795da]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:27 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-cbf270ef-0c51-4bbf-9943-bfa7afa5681f tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71874) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 16:02:27 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-342a2ae6-74f9-4bb7-9699-ba22856fccf6 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Successfully detached device vdb from instance e85aa869-0d2a-40ff-9697-f979a6b110cb from the persistent domain config.
Apr 12 16:02:27 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-342a2ae6-74f9-4bb7-9699-ba22856fccf6 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e85aa869-0d2a-40ff-9697-f979a6b110cb from the live domain config. {{(pid=71874) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 16:02:27 user nova-compute[71874]: DEBUG nova.virt.libvirt.guest [None req-342a2ae6-74f9-4bb7-9699-ba22856fccf6 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 16:02:27 user nova-compute[71874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 16:02:27 user nova-compute[71874]:   <source dev="/dev/sdb"/>
Apr 12 16:02:27 user nova-compute[71874]:   <target dev="vdb" bus="virtio"/>
Apr 12 16:02:27 user nova-compute[71874]:   <serial>5403a600-a3bb-44d7-b9b8-bf933454ca76</serial>
Apr 12 16:02:27 user nova-compute[71874]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 16:02:27 user nova-compute[71874]: </disk>
Apr 12 16:02:27 user nova-compute[71874]:  {{(pid=71874) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 16:02:27 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:27 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.047s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:27 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a42e341-758e-449d-afad-d462c888486e]: (4, ('1', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:27 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-cbf270ef-0c51-4bbf-9943-bfa7afa5681f tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71874) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 16:02:27 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-cbf270ef-0c51-4bbf-9943-bfa7afa5681f tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] SCSI volumes sde have been removed. {{(pid=71874) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 16:02:27 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbf270ef-0c51-4bbf-9943-bfa7afa5681f tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a0100e6d-5149-423c-aadc-0c4f2635196b')] {{(pid=71874) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 16:02:27 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0100e6d-5149-423c-aadc-0c4f2635196b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:27 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0100e6d-5149-423c-aadc-0c4f2635196b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:27 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[22727583-0a65-4b2b-900a-ed7c7021c3d0]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:27 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbf270ef-0c51-4bbf-9943-bfa7afa5681f tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:02:27 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0100e6d-5149-423c-aadc-0c4f2635196b -p 172.16.0.220:3260 --logout {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:27 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad0cece6-9b26-4c87-9e48-2c0437cb9190/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:27 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad0cece6-9b26-4c87-9e48-2c0437cb9190/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:27 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0100e6d-5149-423c-aadc-0c4f2635196b -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:27 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[23c6789f-3786-4732-b3b3-a1189f8aee62]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:a0100e6d-5149-423c-aadc-0c4f2635196b, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:a0100e6d-5149-423c-aadc-0c4f2635196b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:27 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbf270ef-0c51-4bbf-9943-bfa7afa5681f tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:a0100e6d-5149-423c-aadc-0c4f2635196b, portal: 172.16.0.220,3260]
Apr 12 16:02:27 user nova-compute[71874]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:a0100e6d-5149-423c-aadc-0c4f2635196b, portal: 172.16.0.220,3260] successful.
Apr 12 16:02:27 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:02:27 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0100e6d-5149-423c-aadc-0c4f2635196b -p 172.16.0.220:3260 --op delete {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:27 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0100e6d-5149-423c-aadc-0c4f2635196b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:27 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3852e36-c826-4b1f-b5d9-46b9cb9d55e1]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:27 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbf270ef-0c51-4bbf-9943-bfa7afa5681f tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:02:27 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-cbf270ef-0c51-4bbf-9943-bfa7afa5681f tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.428s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:02:27 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbf270ef-0c51-4bbf-9943-bfa7afa5681f tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] <== disconnect_volume: return (430ms) None {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:02:27 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cbf270ef-0c51-4bbf-9943-bfa7afa5681f tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] [instance: 026ab036-1481-4689-af70-661493e9451c] Disconnected iSCSI Volume {{(pid=71874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 16:02:27 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-cbf270ef-0c51-4bbf-9943-bfa7afa5681f tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] [instance: 026ab036-1481-4689-af70-661493e9451c] Deleting instance files /opt/stack/data/nova/instances/026ab036-1481-4689-af70-661493e9451c_del
Apr 12 16:02:27 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-cbf270ef-0c51-4bbf-9943-bfa7afa5681f tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] [instance: 026ab036-1481-4689-af70-661493e9451c] Deletion of /opt/stack/data/nova/instances/026ab036-1481-4689-af70-661493e9451c_del complete
Apr 12 16:02:28 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad0cece6-9b26-4c87-9e48-2c0437cb9190/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:28 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473a30c4-5aa4-481c-8859-fda815d14872/disk.rescue --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:28 user nova-compute[71874]: INFO nova.compute.manager [None req-cbf270ef-0c51-4bbf-9943-bfa7afa5681f tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] [instance: 026ab036-1481-4689-af70-661493e9451c] Took 4.24 seconds to destroy the instance on the hypervisor.
Apr 12 16:02:28 user nova-compute[71874]: DEBUG oslo.service.loopingcall [None req-cbf270ef-0c51-4bbf-9943-bfa7afa5681f tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71874) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 16:02:28 user nova-compute[71874]: DEBUG nova.compute.manager [-] [instance: 026ab036-1481-4689-af70-661493e9451c] Deallocating network for instance {{(pid=71874) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 16:02:28 user nova-compute[71874]: DEBUG nova.network.neutron [-] [instance: 026ab036-1481-4689-af70-661493e9451c] deallocate_for_instance() {{(pid=71874) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 16:02:28 user nova-compute[71874]: DEBUG nova.compute.manager [req-1d09ab23-6b37-47ef-ba11-3ddf071f897b req-14924870-33fc-436e-9212-e7dbb0410a67 service nova] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Received event network-changed-7ae43e60-f63a-448e-9a89-0d6bff272104 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:02:28 user nova-compute[71874]: DEBUG nova.compute.manager [req-1d09ab23-6b37-47ef-ba11-3ddf071f897b req-14924870-33fc-436e-9212-e7dbb0410a67 service nova] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Refreshing instance network info cache due to event network-changed-7ae43e60-f63a-448e-9a89-0d6bff272104. {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 16:02:28 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-1d09ab23-6b37-47ef-ba11-3ddf071f897b req-14924870-33fc-436e-9212-e7dbb0410a67 service nova] Acquiring lock "refresh_cache-9ea56377-20bc-48cc-a248-5fad6db060cb" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:02:28 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-1d09ab23-6b37-47ef-ba11-3ddf071f897b req-14924870-33fc-436e-9212-e7dbb0410a67 service nova] Acquired lock "refresh_cache-9ea56377-20bc-48cc-a248-5fad6db060cb" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:02:28 user nova-compute[71874]: DEBUG nova.network.neutron [req-1d09ab23-6b37-47ef-ba11-3ddf071f897b req-14924870-33fc-436e-9212-e7dbb0410a67 service nova] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Refreshing network info cache for port 7ae43e60-f63a-448e-9a89-0d6bff272104 {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 16:02:28 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473a30c4-5aa4-481c-8859-fda815d14872/disk.rescue --force-share --output=json" returned: 0 in 0.169s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:28 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473a30c4-5aa4-481c-8859-fda815d14872/disk.rescue --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:28 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Received event <DeviceRemovedEvent: 1681315348.304398, e85aa869-0d2a-40ff-9697-f979a6b110cb => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71874) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 16:02:28 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-342a2ae6-74f9-4bb7-9699-ba22856fccf6 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e85aa869-0d2a-40ff-9697-f979a6b110cb {{(pid=71874) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 16:02:28 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-342a2ae6-74f9-4bb7-9699-ba22856fccf6 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Successfully detached device vdb from instance e85aa869-0d2a-40ff-9697-f979a6b110cb from the live domain config.
Apr 12 16:02:28 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-342a2ae6-74f9-4bb7-9699-ba22856fccf6 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] [instance: e85aa869-0d2a-40ff-9697-f979a6b110cb] calling os-brick to detach iSCSI Volume {{(pid=71874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 16:02:28 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-342a2ae6-74f9-4bb7-9699-ba22856fccf6 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3c0216320>, {'target_iqn': 'iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qvyPEgoJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'volume_id': '5403a600-a3bb-44d7-b9b8-bf933454ca76': {}}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:02:28 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-342a2ae6-74f9-4bb7-9699-ba22856fccf6 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:02:28 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-342a2ae6-74f9-4bb7-9699-ba22856fccf6 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:02:28 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-342a2ae6-74f9-4bb7-9699-ba22856fccf6 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:02:28 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:28 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:28 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[614e4395-80bd-491b-8236-e4f25d8fba1d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:28 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-342a2ae6-74f9-4bb7-9699-ba22856fccf6 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 16:02:28 user nova-compute[71874]: No targets found.
Apr 12 16:02:28 user nova-compute[71874]: iSNS:
Apr 12 16:02:28 user nova-compute[71874]: No targets found.
Apr 12 16:02:28 user nova-compute[71874]: STATIC:
Apr 12 16:02:28 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76
Apr 12 16:02:28 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:02:28 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:02:28 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd
Apr 12 16:02:28 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:02:28 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:02:28 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6
Apr 12 16:02:28 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:02:28 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:02:28 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4
Apr 12 16:02:28 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:02:28 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:02:28 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b
Apr 12 16:02:28 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:02:28 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:02:28 user nova-compute[71874]: FIRMWARE:
Apr 12 16:02:28 user nova-compute[71874]: No targets found.
Apr 12 16:02:28 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:02:28 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-342a2ae6-74f9-4bb7-9699-ba22856fccf6 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 16:02:28 user nova-compute[71874]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 16:02:28 user nova-compute[71874]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71874) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 16:02:28 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-342a2ae6-74f9-4bb7-9699-ba22856fccf6 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76', 0)] {{(pid=71874) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 16:02:28 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:28 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:28 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d7f48c7-a14b-49fb-96ba-d527719472f6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:28 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:28 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:28 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2333ba8-5a11-4cbf-a47c-1dc313cbf064]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6 (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:28 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-342a2ae6-74f9-4bb7-9699-ba22856fccf6 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76 (non-flash)
Apr 12 16:02:28 user nova-compute[71874]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4 (non-flash)
Apr 12 16:02:28 user nova-compute[71874]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b (non-flash)
Apr 12 16:02:28 user nova-compute[71874]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd (non-flash)
Apr 12 16:02:28 user nova-compute[71874]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6 (non-flash)
Apr 12 16:02:28 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:02:28 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-342a2ae6-74f9-4bb7-9699-ba22856fccf6 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76 (non-flash)
Apr 12 16:02:28 user nova-compute[71874]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4 (non-flash)
Apr 12 16:02:28 user nova-compute[71874]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b (non-flash)
Apr 12 16:02:28 user nova-compute[71874]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd (non-flash)
Apr 12 16:02:28 user nova-compute[71874]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6 (non-flash)
Apr 12 16:02:28 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:02:28 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-342a2ae6-74f9-4bb7-9699-ba22856fccf6 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc3c02a2710>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76'): ({'sdb'}, set())}) {{(pid=71874) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 16:02:28 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-342a2ae6-74f9-4bb7-9699-ba22856fccf6 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Removing single pathed devices sdb {{(pid=71874) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 16:02:28 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473a30c4-5aa4-481c-8859-fda815d14872/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:28 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473a30c4-5aa4-481c-8859-fda815d14872/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:28 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:28 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:28 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[35778317-4778-4e2b-8a14-0c900f4bc6f7]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:28 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:28 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:28 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a1c9a61-a84c-40e0-95be-1d2f0db114e8]: (4, ('ok\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:28 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-342a2ae6-74f9-4bb7-9699-ba22856fccf6 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Flushing IO for device /dev/sdb {{(pid=71874) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 16:02:28 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:28 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:28 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9f8efb1-76d2-4d95-8c02-ed184adcbf23]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:28 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-342a2ae6-74f9-4bb7-9699-ba22856fccf6 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71874) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 16:02:28 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:28 user nova-compute[71874]: DEBUG nova.compute.manager [req-62b6621c-9e5c-45a0-9f60-b16d6cc5b82f req-35d8dcac-6bb5-45d8-ac28-e8db19d59eb5 service nova] [instance: 026ab036-1481-4689-af70-661493e9451c] Received event network-vif-unplugged-5796cf52-4e81-4c40-954e-86819f5557c8 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:02:28 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-62b6621c-9e5c-45a0-9f60-b16d6cc5b82f req-35d8dcac-6bb5-45d8-ac28-e8db19d59eb5 service nova] Acquiring lock "026ab036-1481-4689-af70-661493e9451c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:02:28 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-62b6621c-9e5c-45a0-9f60-b16d6cc5b82f req-35d8dcac-6bb5-45d8-ac28-e8db19d59eb5 service nova] Lock "026ab036-1481-4689-af70-661493e9451c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:02:28 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-62b6621c-9e5c-45a0-9f60-b16d6cc5b82f req-35d8dcac-6bb5-45d8-ac28-e8db19d59eb5 service nova] Lock "026ab036-1481-4689-af70-661493e9451c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:02:28 user nova-compute[71874]: DEBUG nova.compute.manager [req-62b6621c-9e5c-45a0-9f60-b16d6cc5b82f req-35d8dcac-6bb5-45d8-ac28-e8db19d59eb5 service nova] [instance: 026ab036-1481-4689-af70-661493e9451c] No waiting events found dispatching network-vif-unplugged-5796cf52-4e81-4c40-954e-86819f5557c8 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:02:28 user nova-compute[71874]: DEBUG nova.compute.manager [req-62b6621c-9e5c-45a0-9f60-b16d6cc5b82f req-35d8dcac-6bb5-45d8-ac28-e8db19d59eb5 service nova] [instance: 026ab036-1481-4689-af70-661493e9451c] Received event network-vif-unplugged-5796cf52-4e81-4c40-954e-86819f5557c8 for instance with task_state deleting. {{(pid=71874) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 16:02:28 user nova-compute[71874]: DEBUG nova.compute.manager [req-62b6621c-9e5c-45a0-9f60-b16d6cc5b82f req-35d8dcac-6bb5-45d8-ac28-e8db19d59eb5 service nova] [instance: 026ab036-1481-4689-af70-661493e9451c] Received event network-vif-plugged-5796cf52-4e81-4c40-954e-86819f5557c8 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:02:28 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-62b6621c-9e5c-45a0-9f60-b16d6cc5b82f req-35d8dcac-6bb5-45d8-ac28-e8db19d59eb5 service nova] Acquiring lock "026ab036-1481-4689-af70-661493e9451c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:02:28 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-62b6621c-9e5c-45a0-9f60-b16d6cc5b82f req-35d8dcac-6bb5-45d8-ac28-e8db19d59eb5 service nova] Lock "026ab036-1481-4689-af70-661493e9451c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:02:28 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-62b6621c-9e5c-45a0-9f60-b16d6cc5b82f req-35d8dcac-6bb5-45d8-ac28-e8db19d59eb5 service nova] Lock "026ab036-1481-4689-af70-661493e9451c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:02:28 user nova-compute[71874]: DEBUG nova.compute.manager [req-62b6621c-9e5c-45a0-9f60-b16d6cc5b82f req-35d8dcac-6bb5-45d8-ac28-e8db19d59eb5 service nova] [instance: 026ab036-1481-4689-af70-661493e9451c] No waiting events found dispatching network-vif-plugged-5796cf52-4e81-4c40-954e-86819f5557c8 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:02:28 user nova-compute[71874]: WARNING nova.compute.manager [req-62b6621c-9e5c-45a0-9f60-b16d6cc5b82f req-35d8dcac-6bb5-45d8-ac28-e8db19d59eb5 service nova] [instance: 026ab036-1481-4689-af70-661493e9451c] Received unexpected event network-vif-plugged-5796cf52-4e81-4c40-954e-86819f5557c8 for instance with vm_state active and task_state deleting.
Apr 12 16:02:28 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:28 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[f13c74ea-9a2a-4972-90a3-5436704e2c4c]: (4, ('1', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:28 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-342a2ae6-74f9-4bb7-9699-ba22856fccf6 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71874) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 16:02:28 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-342a2ae6-74f9-4bb7-9699-ba22856fccf6 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] SCSI volumes sdb have been removed. {{(pid=71874) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 16:02:28 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-342a2ae6-74f9-4bb7-9699-ba22856fccf6 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76')] {{(pid=71874) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 16:02:28 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:28 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473a30c4-5aa4-481c-8859-fda815d14872/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:28 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473a30c4-5aa4-481c-8859-fda815d14872/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:28 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:28 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[43807f61-ac07-44d7-84c5-cc194fa84e75]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:28 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-342a2ae6-74f9-4bb7-9699-ba22856fccf6 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:02:28 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76 -p 172.16.0.220:3260 --logout {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:28 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:28 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[00938f7f-2b15-4ff4-95cc-49208bb81bfb]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:28 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-342a2ae6-74f9-4bb7-9699-ba22856fccf6 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76, portal: 172.16.0.220,3260]
Apr 12 16:02:28 user nova-compute[71874]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76, portal: 172.16.0.220,3260] successful.
Apr 12 16:02:28 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:02:28 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76 -p 172.16.0.220:3260 --op delete {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:28 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5403a600-a3bb-44d7-b9b8-bf933454ca76 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:28 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d033e0e-9378-4cfc-b447-122cdc05b6e2]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:28 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-342a2ae6-74f9-4bb7-9699-ba22856fccf6 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:02:28 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-342a2ae6-74f9-4bb7-9699-ba22856fccf6 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.415s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:02:28 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-342a2ae6-74f9-4bb7-9699-ba22856fccf6 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] <== disconnect_volume: return (416ms) None {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:02:28 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-342a2ae6-74f9-4bb7-9699-ba22856fccf6 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] [instance: e85aa869-0d2a-40ff-9697-f979a6b110cb] Disconnected iSCSI Volume {{(pid=71874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 16:02:28 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473a30c4-5aa4-481c-8859-fda815d14872/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:28 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e85aa869-0d2a-40ff-9697-f979a6b110cb/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:28 user nova-compute[71874]: DEBUG os_brick.utils [None req-2f9f654f-f62b-48ca-8866-c4756fbc06b3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:02:28 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:28 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e85aa869-0d2a-40ff-9697-f979a6b110cb/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:28 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e85aa869-0d2a-40ff-9697-f979a6b110cb/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:28 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:28 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1542d3c-b729-4dbf-b7fb-8af5a702be1c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:61a48d4489d2\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:28 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:28 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:28 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ea5d78e-18cb-4942-80dd-0e454968d3cc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:28 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:28 user nova-compute[71874]: DEBUG nova.network.neutron [req-1d09ab23-6b37-47ef-ba11-3ddf071f897b req-14924870-33fc-436e-9212-e7dbb0410a67 service nova] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Updated VIF entry in instance network info cache for port 7ae43e60-f63a-448e-9a89-0d6bff272104. {{(pid=71874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 16:02:29 user nova-compute[71874]: DEBUG nova.network.neutron [req-1d09ab23-6b37-47ef-ba11-3ddf071f897b req-14924870-33fc-436e-9212-e7dbb0410a67 service nova] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Updating instance_info_cache with network_info: [{"id": "7ae43e60-f63a-448e-9a89-0d6bff272104", "address": "fa:16:3e:b7:f0:f6", "network": {"id": "db8367a7-06c5-4e83-987a-c92d02009fef", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-612559343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "020f60d454f846d5a18dfbe1d88b65da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ae43e60-f6", "ovs_interfaceid": "7ae43e60-f63a-448e-9a89-0d6bff272104", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6c9be856-3e7e-4166-8d71-a1f5330aa82f", "address": "fa:16:3e:44:ca:b6", "network": {"id": "a491fcd5-d137-491a-9854-a743afbd448d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1608054323", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "020f60d454f846d5a18dfbe1d88b65da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9be856-3e", "ovs_interfaceid": "6c9be856-3e7e-4166-8d71-a1f5330aa82f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cd2391ad-cb7a-47be-b062-b0dbbc1f8475", "address": "fa:16:3e:89:21:2f", "network": {"id": "a491fcd5-d137-491a-9854-a743afbd448d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1608054323", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.38", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "020f60d454f846d5a18dfbe1d88b65da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd2391ad-cb", "ovs_interfaceid": "cd2391ad-cb7a-47be-b062-b0dbbc1f8475", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f76aae02-12c4-41d6-951a-201330ea7693", "address": "fa:16:3e:13:a6:2d", "network": {"id": "a491fcd5-d137-491a-9854-a743afbd448d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1608054323", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.239", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "020f60d454f846d5a18dfbe1d88b65da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf76aae02-12", "ovs_interfaceid": "f76aae02-12c4-41d6-951a-201330ea7693", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b85b7f43-1f5d-441a-bf3e-380900194e10", "address": "fa:16:3e:2f:65:2e", "network": {"id": "a491fcd5-d137-491a-9854-a743afbd448d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1608054323", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "020f60d454f846d5a18dfbe1d88b65da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb85b7f43-1f", "ovs_interfaceid": "b85b7f43-1f5d-441a-bf3e-380900194e10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c5c4abf8-1b9b-4385-adf7-b34b27a8bc6b", "address": "fa:16:3e:10:b7:d0", "network": {"id": "c543f5eb-b28c-4113-a560-8d6790713d19", "bridge": "br-int", "label": "tempest-device-tagging-net2-1828870959", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "020f60d454f846d5a18dfbe1d88b65da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5c4abf8-1b", "ovs_interfaceid": "c5c4abf8-1b9b-4385-adf7-b34b27a8bc6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1d70ad7b-92c6-47fa-a411-cef9d6159e90", "address": "fa:16:3e:46:54:b4", "network": {"id": "c543f5eb-b28c-4113-a560-8d6790713d19", "bridge": "br-int", "label": "tempest-device-tagging-net2-1828870959", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "020f60d454f846d5a18dfbe1d88b65da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d70ad7b-92", "ovs_interfaceid": "1d70ad7b-92c6-47fa-a411-cef9d6159e90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:02:29 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:29 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6895899-5a08-4cae-8624-614c3debff82]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:29 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[850f7841-9d4e-460d-99e5-f11034ff0026]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:29 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-2f9f654f-f62b-48ca-8866-c4756fbc06b3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Running cmd (subprocess): nvme version {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:29 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-2f9f654f-f62b-48ca-8866-c4756fbc06b3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] 'nvme version' failed. Not Retrying. {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 16:02:29 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2f9f654f-f62b-48ca-8866-c4756fbc06b3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] nvme not present on system {{(pid=71874) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 16:02:29 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-1d09ab23-6b37-47ef-ba11-3ddf071f897b req-14924870-33fc-436e-9212-e7dbb0410a67 service nova] Releasing lock "refresh_cache-9ea56377-20bc-48cc-a248-5fad6db060cb" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:02:29 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:29 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e85aa869-0d2a-40ff-9697-f979a6b110cb/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:29 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 16:02:29 user nova-compute[71874]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 16:02:29 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[16a8192e-c66b-4366-94cb-f87a680fe902]: (4, '') {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:29 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.lightos [None req-2f9f654f-f62b-48ca-8866-c4756fbc06b3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71874) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 16:02:29 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.lightos [None req-2f9f654f-f62b-48ca-8866-c4756fbc06b3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71874) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 16:02:29 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.lightos [None req-2f9f654f-f62b-48ca-8866-c4756fbc06b3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] LIGHTOS: no hostnqn found. {{(pid=71874) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 16:02:29 user nova-compute[71874]: DEBUG os_brick.utils [None req-2f9f654f-f62b-48ca-8866-c4756fbc06b3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] <== get_connector_properties: return (158ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:61a48d4489d2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:02:29 user nova-compute[71874]: DEBUG nova.virt.block_device [None req-2f9f654f-f62b-48ca-8866-c4756fbc06b3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] Updating existing volume attachment record: c3a8b54b-e31d-4609-afe9-1ed34e3bef9e {{(pid=71874) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 16:02:29 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:29 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:29 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:29 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:29 user nova-compute[71874]: DEBUG nova.objects.instance [None req-342a2ae6-74f9-4bb7-9699-ba22856fccf6 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Lazy-loading 'flavor' on Instance uuid e85aa869-0d2a-40ff-9697-f979a6b110cb {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:02:29 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:02:29 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:02:29 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Hypervisor/Node resource view: name=user free_ram=7590MB free_disk=26.221378326416016GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71874) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 16:02:29 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:02:29 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:02:29 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-342a2ae6-74f9-4bb7-9699-ba22856fccf6 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Lock "e85aa869-0d2a-40ff-9697-f979a6b110cb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.398s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:02:30 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-eb3d82e7-7232-45a5-9d24-542563b8dec1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Acquiring lock "9ea56377-20bc-48cc-a248-5fad6db060cb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:02:30 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-eb3d82e7-7232-45a5-9d24-542563b8dec1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Lock "9ea56377-20bc-48cc-a248-5fad6db060cb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:02:30 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-eb3d82e7-7232-45a5-9d24-542563b8dec1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Acquiring lock "9ea56377-20bc-48cc-a248-5fad6db060cb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:02:30 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-eb3d82e7-7232-45a5-9d24-542563b8dec1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Lock "9ea56377-20bc-48cc-a248-5fad6db060cb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:02:30 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-eb3d82e7-7232-45a5-9d24-542563b8dec1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Lock "9ea56377-20bc-48cc-a248-5fad6db060cb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:02:30 user nova-compute[71874]: INFO nova.compute.manager [None req-eb3d82e7-7232-45a5-9d24-542563b8dec1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Terminating instance
Apr 12 16:02:30 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb3d82e7-7232-45a5-9d24-542563b8dec1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Start destroying the instance on the hypervisor. {{(pid=71874) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 16:02:30 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance afebffae-dbf6-4876-8c9f-0364f0fde49c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:02:30 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 473a30c4-5aa4-481c-8859-fda815d14872 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:02:30 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 608fbea2-b42b-4bb9-94a7-2b76dcdc2001 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:02:30 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:02:30 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 920c6512-180d-46e1-b0cf-240d34c3fc97 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:02:30 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 55aff314-eb5e-4752-af9f-a4021e970cac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:02:30 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance e85aa869-0d2a-40ff-9697-f979a6b110cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:02:30 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 026ab036-1481-4689-af70-661493e9451c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:02:30 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 9ea56377-20bc-48cc-a248-5fad6db060cb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:02:30 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance ad0cece6-9b26-4c87-9e48-2c0437cb9190 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:02:30 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance f52ee906-c8fd-4cd5-842e-de98a5099c4f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:02:30 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=71874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 16:02:30 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Final resource view: name=user phys_ram=16023MB used_ram=1920MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=71874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 16:02:30 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:02:30 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:02:30 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:02:30 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:02:30 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:02:30 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:02:30 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:02:30 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:02:30 user nova-compute[71874]: DEBUG nova.compute.manager [req-55ab6f1e-3f54-4c86-911f-13a8b18c0d52 req-5c93ffd3-f66a-492e-95ad-be1c35fa3f12 service nova] [instance: 026ab036-1481-4689-af70-661493e9451c] Received event network-vif-deleted-0d6194a7-a3c4-47f9-8c37-960cb622ce28 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:02:30 user nova-compute[71874]: INFO nova.compute.manager [req-55ab6f1e-3f54-4c86-911f-13a8b18c0d52 req-5c93ffd3-f66a-492e-95ad-be1c35fa3f12 service nova] [instance: 026ab036-1481-4689-af70-661493e9451c] Neutron deleted interface 0d6194a7-a3c4-47f9-8c37-960cb622ce28; detaching it from the instance and deleting it from the info cache
Apr 12 16:02:30 user nova-compute[71874]: DEBUG nova.network.neutron [req-55ab6f1e-3f54-4c86-911f-13a8b18c0d52 req-5c93ffd3-f66a-492e-95ad-be1c35fa3f12 service nova] [instance: 026ab036-1481-4689-af70-661493e9451c] Updating instance_info_cache with network_info: [{"id": "8ebc1d23-a473-4640-aa39-31cbed300c07", "address": "fa:16:3e:d5:95:9e", "network": {"id": "9b0c9550-d764-4db6-b28b-09ab59801170", "bridge": "br-int", "label": "tempest-device-tagging-net1-638686183", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.180", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14aea401da6344858416fd2543bc10ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ebc1d23-a4", "ovs_interfaceid": "8ebc1d23-a473-4640-aa39-31cbed300c07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7f36bae3-c729-4d85-8c31-075b2b100abe", "address": "fa:16:3e:99:5c:8b", "network": {"id": "9b0c9550-d764-4db6-b28b-09ab59801170", "bridge": "br-int", "label": "tempest-device-tagging-net1-638686183", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14aea401da6344858416fd2543bc10ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f36bae3-c7", "ovs_interfaceid": "7f36bae3-c729-4d85-8c31-075b2b100abe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "264de72a-d4f4-4a6a-b3ab-1e8ea8b9a30b", "address": "fa:16:3e:da:a9:6d", "network": {"id": "9b0c9550-d764-4db6-b28b-09ab59801170", "bridge": "br-int", "label": "tempest-device-tagging-net1-638686183", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14aea401da6344858416fd2543bc10ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap264de72a-d4", "ovs_interfaceid": "264de72a-d4f4-4a6a-b3ab-1e8ea8b9a30b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e3f484fe-17dd-4cef-babd-ad78cf557b03", "address": "fa:16:3e:e6:0d:58", "network": {"id": "9b0c9550-d764-4db6-b28b-09ab59801170", "bridge": "br-int", "label": "tempest-device-tagging-net1-638686183", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14aea401da6344858416fd2543bc10ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3f484fe-17", "ovs_interfaceid": "e3f484fe-17dd-4cef-babd-ad78cf557b03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0b2175eb-de94-4274-b200-14894dbcbda0", "address": "fa:16:3e:0f:80:1c", "network": {"id": "92fe4d7e-c0cd-45f1-9e92-a120ab22f6f1", "bridge": "br-int", "label": "tempest-device-tagging-net2-367644823", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "14aea401da6344858416fd2543bc10ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b2175eb-de", "ovs_interfaceid": "0b2175eb-de94-4274-b200-14894dbcbda0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5796cf52-4e81-4c40-954e-86819f5557c8", "address": "fa:16:3e:b7:67:83", "network": {"id": "92fe4d7e-c0cd-45f1-9e92-a120ab22f6f1", "bridge": "br-int", "label": "tempest-device-tagging-net2-367644823", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "14aea401da6344858416fd2543bc10ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5796cf52-4e", "ovs_interfaceid": "5796cf52-4e81-4c40-954e-86819f5557c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:02:30 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Inventory has not changed in ProviderTree for provider: 0e94b4c8-cd49-45e4-9133-d36eb4b2456b {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 16:02:30 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Inventory has not changed for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 16:02:30 user nova-compute[71874]: DEBUG nova.compute.manager [req-55ab6f1e-3f54-4c86-911f-13a8b18c0d52 req-5c93ffd3-f66a-492e-95ad-be1c35fa3f12 service nova] [instance: 026ab036-1481-4689-af70-661493e9451c] Detach interface failed, port_id=0d6194a7-a3c4-47f9-8c37-960cb622ce28, reason: Instance 026ab036-1481-4689-af70-661493e9451c could not be found. {{(pid=71874) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 12 16:02:30 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:02:30 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:02:30 user nova-compute[71874]: DEBUG nova.compute.manager [req-f080cfcc-d5f7-45df-a27d-e1f80b8e1a10 req-a7ce5acf-6100-401c-b79a-76ebdde95628 service nova] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Received event network-vif-unplugged-7ae43e60-f63a-448e-9a89-0d6bff272104 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:02:30 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-f080cfcc-d5f7-45df-a27d-e1f80b8e1a10 req-a7ce5acf-6100-401c-b79a-76ebdde95628 service nova] Acquiring lock "9ea56377-20bc-48cc-a248-5fad6db060cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:02:30 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-f080cfcc-d5f7-45df-a27d-e1f80b8e1a10 req-a7ce5acf-6100-401c-b79a-76ebdde95628 service nova] Lock "9ea56377-20bc-48cc-a248-5fad6db060cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:02:30 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-f080cfcc-d5f7-45df-a27d-e1f80b8e1a10 req-a7ce5acf-6100-401c-b79a-76ebdde95628 service nova] Lock "9ea56377-20bc-48cc-a248-5fad6db060cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:02:30 user nova-compute[71874]: DEBUG nova.compute.manager [req-f080cfcc-d5f7-45df-a27d-e1f80b8e1a10 req-a7ce5acf-6100-401c-b79a-76ebdde95628 service nova] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] No waiting events found dispatching network-vif-unplugged-7ae43e60-f63a-448e-9a89-0d6bff272104 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:02:30 user nova-compute[71874]: DEBUG nova.compute.manager [req-f080cfcc-d5f7-45df-a27d-e1f80b8e1a10 req-a7ce5acf-6100-401c-b79a-76ebdde95628 service nova] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Received event network-vif-unplugged-7ae43e60-f63a-448e-9a89-0d6bff272104 for instance with task_state deleting. {{(pid=71874) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 16:02:30 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Compute_service record updated for user:user {{(pid=71874) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 16:02:30 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.683s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:02:30 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:02:30 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:02:30 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:02:30 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:02:30 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:02:30 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:02:30 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:02:30 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:02:30 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:02:31 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:02:31 user nova-compute[71874]: DEBUG nova.compute.manager [req-8e3290df-8ee7-4ce5-b33f-c735dc3546a6 req-c2e130bb-b76c-4d14-a08d-d3a34b774b8c service nova] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Received event network-vif-unplugged-b85b7f43-1f5d-441a-bf3e-380900194e10 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:02:31 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-8e3290df-8ee7-4ce5-b33f-c735dc3546a6 req-c2e130bb-b76c-4d14-a08d-d3a34b774b8c service nova] Acquiring lock "9ea56377-20bc-48cc-a248-5fad6db060cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:02:31 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-8e3290df-8ee7-4ce5-b33f-c735dc3546a6 req-c2e130bb-b76c-4d14-a08d-d3a34b774b8c service nova] Lock "9ea56377-20bc-48cc-a248-5fad6db060cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:02:31 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-8e3290df-8ee7-4ce5-b33f-c735dc3546a6 req-c2e130bb-b76c-4d14-a08d-d3a34b774b8c service nova] Lock "9ea56377-20bc-48cc-a248-5fad6db060cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:02:31 user nova-compute[71874]: DEBUG nova.compute.manager [req-8e3290df-8ee7-4ce5-b33f-c735dc3546a6 req-c2e130bb-b76c-4d14-a08d-d3a34b774b8c service nova] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] No waiting events found dispatching network-vif-unplugged-b85b7f43-1f5d-441a-bf3e-380900194e10 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:02:31 user nova-compute[71874]: DEBUG nova.compute.manager [req-8e3290df-8ee7-4ce5-b33f-c735dc3546a6 req-c2e130bb-b76c-4d14-a08d-d3a34b774b8c service nova] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Received event network-vif-unplugged-b85b7f43-1f5d-441a-bf3e-380900194e10 for instance with task_state deleting. {{(pid=71874) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 16:02:31 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:02:31 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:02:31 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:02:31 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:02:31 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:02:31 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:02:31 user nova-compute[71874]: INFO nova.virt.libvirt.driver [-] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Instance destroyed successfully.
Apr 12 16:02:31 user nova-compute[71874]: DEBUG nova.objects.instance [None req-eb3d82e7-7232-45a5-9d24-542563b8dec1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Lazy-loading 'resources' on Instance uuid 9ea56377-20bc-48cc-a248-5fad6db060cb {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:02:31 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-eb3d82e7-7232-45a5-9d24-542563b8dec1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T16:00:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1486400569',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1486400569',id=13,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLLQXDyGxnW8Y8uGnRNVHYUbX23R7I4pLI6ZbfyCvQF/VJCuiE4FcFV1q49XDBUk5vZYnAPb/+RlfqgPWZ19CwkWt6aeUKiPxRYOkBEiwZu+X1jwZm0eXBg0fxd57kvoRA==',key_name='tempest-keypair-302611627',keypairs=<?>,launch_index=0,launched_at=2023-04-12T16:01:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='020f60d454f846d5a18dfbe1d88b65da',ramdisk_id='',reservation_id='r-pwhuoluu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-42052269',owner_user_name='tempest-TaggedBootDevicesTest-42052269-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T16:01:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='51e8a84c876249dd9b588305926ffdff',uuid=9ea56377-20bc-48cc-a248-5fad6db060cb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7ae43e60-f63a-448e-9a89-0d6bff272104", "address": "fa:16:3e:b7:f0:f6", "network": {"id": "db8367a7-06c5-4e83-987a-c92d02009fef", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-612559343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "020f60d454f846d5a18dfbe1d88b65da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ae43e60-f6", "ovs_interfaceid": "7ae43e60-f63a-448e-9a89-0d6bff272104", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 16:02:31 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-eb3d82e7-7232-45a5-9d24-542563b8dec1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Converting VIF {"id": "7ae43e60-f63a-448e-9a89-0d6bff272104", "address": "fa:16:3e:b7:f0:f6", "network": {"id": "db8367a7-06c5-4e83-987a-c92d02009fef", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-612559343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "020f60d454f846d5a18dfbe1d88b65da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ae43e60-f6", "ovs_interfaceid": "7ae43e60-f63a-448e-9a89-0d6bff272104", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:02:31 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-eb3d82e7-7232-45a5-9d24-542563b8dec1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b7:f0:f6,bridge_name='br-int',has_traffic_filtering=True,id=7ae43e60-f63a-448e-9a89-0d6bff272104,network=Network(db8367a7-06c5-4e83-987a-c92d02009fef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ae43e60-f6') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:02:31 user nova-compute[71874]: DEBUG os_vif [None req-eb3d82e7-7232-45a5-9d24-542563b8dec1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b7:f0:f6,bridge_name='br-int',has_traffic_filtering=True,id=7ae43e60-f63a-448e-9a89-0d6bff272104,network=Network(db8367a7-06c5-4e83-987a-c92d02009fef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ae43e60-f6') {{(pid=71874) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 16:02:31 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:02:31 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7ae43e60-f6, bridge=br-int, if_exists=True) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:02:31 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:02:31 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:02:32 user nova-compute[71874]: INFO os_vif [None req-eb3d82e7-7232-45a5-9d24-542563b8dec1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b7:f0:f6,bridge_name='br-int',has_traffic_filtering=True,id=7ae43e60-f63a-448e-9a89-0d6bff272104,network=Network(db8367a7-06c5-4e83-987a-c92d02009fef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ae43e60-f6')
Apr 12 16:02:32 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-eb3d82e7-7232-45a5-9d24-542563b8dec1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T16:00:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1486400569',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1486400569',id=13,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLLQXDyGxnW8Y8uGnRNVHYUbX23R7I4pLI6ZbfyCvQF/VJCuiE4FcFV1q49XDBUk5vZYnAPb/+RlfqgPWZ19CwkWt6aeUKiPxRYOkBEiwZu+X1jwZm0eXBg0fxd57kvoRA==',key_name='tempest-keypair-302611627',keypairs=<?>,launch_index=0,launched_at=2023-04-12T16:01:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='020f60d454f846d5a18dfbe1d88b65da',ramdisk_id='',reservation_id='r-pwhuoluu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-42052269',owner_user_name='tempest-TaggedBootDevicesTest-42052269-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T16:01:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='51e8a84c876249dd9b588305926ffdff',uuid=9ea56377-20bc-48cc-a248-5fad6db060cb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6c9be856-3e7e-4166-8d71-a1f5330aa82f", "address": "fa:16:3e:44:ca:b6", "network": {"id": "a491fcd5-d137-491a-9854-a743afbd448d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1608054323", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "020f60d454f846d5a18dfbe1d88b65da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9be856-3e", "ovs_interfaceid": "6c9be856-3e7e-4166-8d71-a1f5330aa82f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71874) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-eb3d82e7-7232-45a5-9d24-542563b8dec1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Converting VIF {"id": "6c9be856-3e7e-4166-8d71-a1f5330aa82f", "address": "fa:16:3e:44:ca:b6", "network": {"id": "a491fcd5-d137-491a-9854-a743afbd448d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1608054323", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "020f60d454f846d5a18dfbe1d88b65da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9be856-3e", "ovs_interfaceid": "6c9be856-3e7e-4166-8d71-a1f5330aa82f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-eb3d82e7-7232-45a5-9d24-542563b8dec1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:ca:b6,bridge_name='br-int',has_traffic_filtering=True,id=6c9be856-3e7e-4166-8d71-a1f5330aa82f,network=Network(a491fcd5-d137-491a-9854-a743afbd448d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6c9be856-3e') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG os_vif [None req-eb3d82e7-7232-45a5-9d24-542563b8dec1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:ca:b6,bridge_name='br-int',has_traffic_filtering=True,id=6c9be856-3e7e-4166-8d71-a1f5330aa82f,network=Network(a491fcd5-d137-491a-9854-a743afbd448d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6c9be856-3e') {{(pid=71874) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6c9be856-3e, bridge=br-int, if_exists=True) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:02:32 user nova-compute[71874]: INFO os_vif [None req-eb3d82e7-7232-45a5-9d24-542563b8dec1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:ca:b6,bridge_name='br-int',has_traffic_filtering=True,id=6c9be856-3e7e-4166-8d71-a1f5330aa82f,network=Network(a491fcd5-d137-491a-9854-a743afbd448d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6c9be856-3e')
Apr 12 16:02:32 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-eb3d82e7-7232-45a5-9d24-542563b8dec1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T16:00:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1486400569',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1486400569',id=13,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLLQXDyGxnW8Y8uGnRNVHYUbX23R7I4pLI6ZbfyCvQF/VJCuiE4FcFV1q49XDBUk5vZYnAPb/+RlfqgPWZ19CwkWt6aeUKiPxRYOkBEiwZu+X1jwZm0eXBg0fxd57kvoRA==',key_name='tempest-keypair-302611627',keypairs=<?>,launch_index=0,launched_at=2023-04-12T16:01:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='020f60d454f846d5a18dfbe1d88b65da',ramdisk_id='',reservation_id='r-pwhuoluu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-42052269',owner_user_name='tempest-TaggedBootDevicesTest-42052269-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T16:01:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='51e8a84c876249dd9b588305926ffdff',uuid=9ea56377-20bc-48cc-a248-5fad6db060cb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cd2391ad-cb7a-47be-b062-b0dbbc1f8475", "address": "fa:16:3e:89:21:2f", "network": {"id": "a491fcd5-d137-491a-9854-a743afbd448d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1608054323", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.38", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "020f60d454f846d5a18dfbe1d88b65da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd2391ad-cb", "ovs_interfaceid": "cd2391ad-cb7a-47be-b062-b0dbbc1f8475", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71874) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-eb3d82e7-7232-45a5-9d24-542563b8dec1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Converting VIF {"id": "cd2391ad-cb7a-47be-b062-b0dbbc1f8475", "address": "fa:16:3e:89:21:2f", "network": {"id": "a491fcd5-d137-491a-9854-a743afbd448d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1608054323", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.38", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "020f60d454f846d5a18dfbe1d88b65da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd2391ad-cb", "ovs_interfaceid": "cd2391ad-cb7a-47be-b062-b0dbbc1f8475", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-eb3d82e7-7232-45a5-9d24-542563b8dec1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:21:2f,bridge_name='br-int',has_traffic_filtering=True,id=cd2391ad-cb7a-47be-b062-b0dbbc1f8475,network=Network(a491fcd5-d137-491a-9854-a743afbd448d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapcd2391ad-cb') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG os_vif [None req-eb3d82e7-7232-45a5-9d24-542563b8dec1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:21:2f,bridge_name='br-int',has_traffic_filtering=True,id=cd2391ad-cb7a-47be-b062-b0dbbc1f8475,network=Network(a491fcd5-d137-491a-9854-a743afbd448d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapcd2391ad-cb') {{(pid=71874) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcd2391ad-cb, bridge=br-int, if_exists=True) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:02:32 user nova-compute[71874]: INFO os_vif [None req-eb3d82e7-7232-45a5-9d24-542563b8dec1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:21:2f,bridge_name='br-int',has_traffic_filtering=True,id=cd2391ad-cb7a-47be-b062-b0dbbc1f8475,network=Network(a491fcd5-d137-491a-9854-a743afbd448d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapcd2391ad-cb')
Apr 12 16:02:32 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-eb3d82e7-7232-45a5-9d24-542563b8dec1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T16:00:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1486400569',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1486400569',id=13,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLLQXDyGxnW8Y8uGnRNVHYUbX23R7I4pLI6ZbfyCvQF/VJCuiE4FcFV1q49XDBUk5vZYnAPb/+RlfqgPWZ19CwkWt6aeUKiPxRYOkBEiwZu+X1jwZm0eXBg0fxd57kvoRA==',key_name='tempest-keypair-302611627',keypairs=<?>,launch_index=0,launched_at=2023-04-12T16:01:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='020f60d454f846d5a18dfbe1d88b65da',ramdisk_id='',reservation_id='r-pwhuoluu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-42052269',owner_user_name='tempest-TaggedBootDevicesTest-42052269-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T16:01:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='51e8a84c876249dd9b588305926ffdff',uuid=9ea56377-20bc-48cc-a248-5fad6db060cb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f76aae02-12c4-41d6-951a-201330ea7693", "address": "fa:16:3e:13:a6:2d", "network": {"id": "a491fcd5-d137-491a-9854-a743afbd448d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1608054323", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.239", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "020f60d454f846d5a18dfbe1d88b65da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf76aae02-12", "ovs_interfaceid": "f76aae02-12c4-41d6-951a-201330ea7693", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-eb3d82e7-7232-45a5-9d24-542563b8dec1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Converting VIF {"id": "f76aae02-12c4-41d6-951a-201330ea7693", "address": "fa:16:3e:13:a6:2d", "network": {"id": "a491fcd5-d137-491a-9854-a743afbd448d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1608054323", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.239", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "020f60d454f846d5a18dfbe1d88b65da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf76aae02-12", "ovs_interfaceid": "f76aae02-12c4-41d6-951a-201330ea7693", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-eb3d82e7-7232-45a5-9d24-542563b8dec1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:a6:2d,bridge_name='br-int',has_traffic_filtering=True,id=f76aae02-12c4-41d6-951a-201330ea7693,network=Network(a491fcd5-d137-491a-9854-a743afbd448d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf76aae02-12') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG os_vif [None req-eb3d82e7-7232-45a5-9d24-542563b8dec1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:a6:2d,bridge_name='br-int',has_traffic_filtering=True,id=f76aae02-12c4-41d6-951a-201330ea7693,network=Network(a491fcd5-d137-491a-9854-a743afbd448d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf76aae02-12') {{(pid=71874) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf76aae02-12, bridge=br-int, if_exists=True) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:02:32 user nova-compute[71874]: INFO os_vif [None req-eb3d82e7-7232-45a5-9d24-542563b8dec1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:a6:2d,bridge_name='br-int',has_traffic_filtering=True,id=f76aae02-12c4-41d6-951a-201330ea7693,network=Network(a491fcd5-d137-491a-9854-a743afbd448d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf76aae02-12')
Apr 12 16:02:32 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-eb3d82e7-7232-45a5-9d24-542563b8dec1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T16:00:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1486400569',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1486400569',id=13,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLLQXDyGxnW8Y8uGnRNVHYUbX23R7I4pLI6ZbfyCvQF/VJCuiE4FcFV1q49XDBUk5vZYnAPb/+RlfqgPWZ19CwkWt6aeUKiPxRYOkBEiwZu+X1jwZm0eXBg0fxd57kvoRA==',key_name='tempest-keypair-302611627',keypairs=<?>,launch_index=0,launched_at=2023-04-12T16:01:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='020f60d454f846d5a18dfbe1d88b65da',ramdisk_id='',reservation_id='r-pwhuoluu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-42052269',owner_user_name='tempest-TaggedBootDevicesTest-42052269-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T16:01:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='51e8a84c876249dd9b588305926ffdff',uuid=9ea56377-20bc-48cc-a248-5fad6db060cb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b85b7f43-1f5d-441a-bf3e-380900194e10", "address": "fa:16:3e:2f:65:2e", "network": {"id": "a491fcd5-d137-491a-9854-a743afbd448d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1608054323", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "020f60d454f846d5a18dfbe1d88b65da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb85b7f43-1f", "ovs_interfaceid": "b85b7f43-1f5d-441a-bf3e-380900194e10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-eb3d82e7-7232-45a5-9d24-542563b8dec1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Converting VIF {"id": "b85b7f43-1f5d-441a-bf3e-380900194e10", "address": "fa:16:3e:2f:65:2e", "network": {"id": "a491fcd5-d137-491a-9854-a743afbd448d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1608054323", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "020f60d454f846d5a18dfbe1d88b65da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb85b7f43-1f", "ovs_interfaceid": "b85b7f43-1f5d-441a-bf3e-380900194e10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-eb3d82e7-7232-45a5-9d24-542563b8dec1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:65:2e,bridge_name='br-int',has_traffic_filtering=True,id=b85b7f43-1f5d-441a-bf3e-380900194e10,network=Network(a491fcd5-d137-491a-9854-a743afbd448d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb85b7f43-1f') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG os_vif [None req-eb3d82e7-7232-45a5-9d24-542563b8dec1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:65:2e,bridge_name='br-int',has_traffic_filtering=True,id=b85b7f43-1f5d-441a-bf3e-380900194e10,network=Network(a491fcd5-d137-491a-9854-a743afbd448d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb85b7f43-1f') {{(pid=71874) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb85b7f43-1f, bridge=br-int, if_exists=True) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:02:32 user nova-compute[71874]: INFO os_vif [None req-eb3d82e7-7232-45a5-9d24-542563b8dec1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:65:2e,bridge_name='br-int',has_traffic_filtering=True,id=b85b7f43-1f5d-441a-bf3e-380900194e10,network=Network(a491fcd5-d137-491a-9854-a743afbd448d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb85b7f43-1f')
Apr 12 16:02:32 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-eb3d82e7-7232-45a5-9d24-542563b8dec1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T16:00:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1486400569',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1486400569',id=13,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLLQXDyGxnW8Y8uGnRNVHYUbX23R7I4pLI6ZbfyCvQF/VJCuiE4FcFV1q49XDBUk5vZYnAPb/+RlfqgPWZ19CwkWt6aeUKiPxRYOkBEiwZu+X1jwZm0eXBg0fxd57kvoRA==',key_name='tempest-keypair-302611627',keypairs=<?>,launch_index=0,launched_at=2023-04-12T16:01:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='020f60d454f846d5a18dfbe1d88b65da',ramdisk_id='',reservation_id='r-pwhuoluu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-42052269',owner_user_name='tempest-TaggedBootDevicesTest-42052269-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T16:01:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='51e8a84c876249dd9b588305926ffdff',uuid=9ea56377-20bc-48cc-a248-5fad6db060cb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c5c4abf8-1b9b-4385-adf7-b34b27a8bc6b", "address": "fa:16:3e:10:b7:d0", "network": {"id": "c543f5eb-b28c-4113-a560-8d6790713d19", "bridge": "br-int", "label": "tempest-device-tagging-net2-1828870959", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "020f60d454f846d5a18dfbe1d88b65da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5c4abf8-1b", "ovs_interfaceid": "c5c4abf8-1b9b-4385-adf7-b34b27a8bc6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-eb3d82e7-7232-45a5-9d24-542563b8dec1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Converting VIF {"id": "c5c4abf8-1b9b-4385-adf7-b34b27a8bc6b", "address": "fa:16:3e:10:b7:d0", "network": {"id": "c543f5eb-b28c-4113-a560-8d6790713d19", "bridge": "br-int", "label": "tempest-device-tagging-net2-1828870959", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "020f60d454f846d5a18dfbe1d88b65da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5c4abf8-1b", "ovs_interfaceid": "c5c4abf8-1b9b-4385-adf7-b34b27a8bc6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-eb3d82e7-7232-45a5-9d24-542563b8dec1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:b7:d0,bridge_name='br-int',has_traffic_filtering=True,id=c5c4abf8-1b9b-4385-adf7-b34b27a8bc6b,network=Network(c543f5eb-b28c-4113-a560-8d6790713d19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5c4abf8-1b') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG os_vif [None req-eb3d82e7-7232-45a5-9d24-542563b8dec1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:b7:d0,bridge_name='br-int',has_traffic_filtering=True,id=c5c4abf8-1b9b-4385-adf7-b34b27a8bc6b,network=Network(c543f5eb-b28c-4113-a560-8d6790713d19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5c4abf8-1b') {{(pid=71874) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc5c4abf8-1b, bridge=br-int, if_exists=True) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:02:32 user nova-compute[71874]: INFO os_vif [None req-eb3d82e7-7232-45a5-9d24-542563b8dec1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:b7:d0,bridge_name='br-int',has_traffic_filtering=True,id=c5c4abf8-1b9b-4385-adf7-b34b27a8bc6b,network=Network(c543f5eb-b28c-4113-a560-8d6790713d19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5c4abf8-1b')
Apr 12 16:02:32 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-eb3d82e7-7232-45a5-9d24-542563b8dec1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T16:00:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1486400569',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1486400569',id=13,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLLQXDyGxnW8Y8uGnRNVHYUbX23R7I4pLI6ZbfyCvQF/VJCuiE4FcFV1q49XDBUk5vZYnAPb/+RlfqgPWZ19CwkWt6aeUKiPxRYOkBEiwZu+X1jwZm0eXBg0fxd57kvoRA==',key_name='tempest-keypair-302611627',keypairs=<?>,launch_index=0,launched_at=2023-04-12T16:01:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='020f60d454f846d5a18dfbe1d88b65da',ramdisk_id='',reservation_id='r-pwhuoluu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-42052269',owner_user_name='tempest-TaggedBootDevicesTest-42052269-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T16:01:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='51e8a84c876249dd9b588305926ffdff',uuid=9ea56377-20bc-48cc-a248-5fad6db060cb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1d70ad7b-92c6-47fa-a411-cef9d6159e90", "address": "fa:16:3e:46:54:b4", "network": {"id": "c543f5eb-b28c-4113-a560-8d6790713d19", "bridge": "br-int", "label": "tempest-device-tagging-net2-1828870959", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "020f60d454f846d5a18dfbe1d88b65da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d70ad7b-92", "ovs_interfaceid": "1d70ad7b-92c6-47fa-a411-cef9d6159e90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-eb3d82e7-7232-45a5-9d24-542563b8dec1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Converting VIF {"id": "1d70ad7b-92c6-47fa-a411-cef9d6159e90", "address": "fa:16:3e:46:54:b4", "network": {"id": "c543f5eb-b28c-4113-a560-8d6790713d19", "bridge": "br-int", "label": "tempest-device-tagging-net2-1828870959", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "020f60d454f846d5a18dfbe1d88b65da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d70ad7b-92", "ovs_interfaceid": "1d70ad7b-92c6-47fa-a411-cef9d6159e90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-eb3d82e7-7232-45a5-9d24-542563b8dec1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:54:b4,bridge_name='br-int',has_traffic_filtering=True,id=1d70ad7b-92c6-47fa-a411-cef9d6159e90,network=Network(c543f5eb-b28c-4113-a560-8d6790713d19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d70ad7b-92') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG os_vif [None req-eb3d82e7-7232-45a5-9d24-542563b8dec1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:54:b4,bridge_name='br-int',has_traffic_filtering=True,id=1d70ad7b-92c6-47fa-a411-cef9d6159e90,network=Network(c543f5eb-b28c-4113-a560-8d6790713d19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d70ad7b-92') {{(pid=71874) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1d70ad7b-92, bridge=br-int, if_exists=True) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:02:32 user nova-compute[71874]: INFO os_vif [None req-eb3d82e7-7232-45a5-9d24-542563b8dec1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:54:b4,bridge_name='br-int',has_traffic_filtering=True,id=1d70ad7b-92c6-47fa-a411-cef9d6159e90,network=Network(c543f5eb-b28c-4113-a560-8d6790713d19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d70ad7b-92')
Apr 12 16:02:32 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb3d82e7-7232-45a5-9d24-542563b8dec1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] calling os-brick to detach iSCSI Volume {{(pid=71874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb3d82e7-7232-45a5-9d24-542563b8dec1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3c0216320>, {'target_iqn': 'iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jXkJFWPU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:02:32 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-eb3d82e7-7232-45a5-9d24-542563b8dec1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:02:32 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-eb3d82e7-7232-45a5-9d24-542563b8dec1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-eb3d82e7-7232-45a5-9d24-542563b8dec1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1c19ef5-094e-4e48-9959-f6f861c57ad8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb3d82e7-7232-45a5-9d24-542563b8dec1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 16:02:32 user nova-compute[71874]: No targets found.
Apr 12 16:02:32 user nova-compute[71874]: iSNS:
Apr 12 16:02:32 user nova-compute[71874]: No targets found.
Apr 12 16:02:32 user nova-compute[71874]: STATIC:
Apr 12 16:02:32 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd
Apr 12 16:02:32 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:02:32 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:02:32 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6
Apr 12 16:02:32 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:02:32 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:02:32 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4
Apr 12 16:02:32 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:02:32 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:02:32 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b
Apr 12 16:02:32 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:02:32 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:02:32 user nova-compute[71874]: FIRMWARE:
Apr 12 16:02:32 user nova-compute[71874]: No targets found.
Apr 12 16:02:32 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb3d82e7-7232-45a5-9d24-542563b8dec1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 16:02:32 user nova-compute[71874]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 16:02:32 user nova-compute[71874]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71874) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb3d82e7-7232-45a5-9d24-542563b8dec1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4', 0)] {{(pid=71874) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1242cd7-93cd-40c9-9cd8-286f68358acc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f9e6f4d-1879-4bba-a501-d197a7fc393f]: (4, ('tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6 (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb3d82e7-7232-45a5-9d24-542563b8dec1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4 (non-flash)
Apr 12 16:02:32 user nova-compute[71874]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b (non-flash)
Apr 12 16:02:32 user nova-compute[71874]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd (non-flash)
Apr 12 16:02:32 user nova-compute[71874]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6 (non-flash)
Apr 12 16:02:32 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb3d82e7-7232-45a5-9d24-542563b8dec1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] iscsi session list stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4 (non-flash)
Apr 12 16:02:32 user nova-compute[71874]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b (non-flash)
Apr 12 16:02:32 user nova-compute[71874]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd (non-flash)
Apr 12 16:02:32 user nova-compute[71874]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6 (non-flash)
Apr 12 16:02:32 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb3d82e7-7232-45a5-9d24-542563b8dec1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc3c02a0550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4'): ({'sdf'}, set())}) {{(pid=71874) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-eb3d82e7-7232-45a5-9d24-542563b8dec1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Removing single pathed devices sdf {{(pid=71874) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[46842e1b-03ce-434a-8167-0ee0271d34dc]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a444423-9126-4c0c-9c9a-fbffc3f66d7e]: (4, ('ok\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-eb3d82e7-7232-45a5-9d24-542563b8dec1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Flushing IO for device /dev/sdf {{(pid=71874) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef687698-08ce-409a-9515-6be0004f2860]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-eb3d82e7-7232-45a5-9d24-542563b8dec1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=71874) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.033s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[274702be-1261-4ab6-87f9-88c5381d8c8d]: (4, ('1', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-eb3d82e7-7232-45a5-9d24-542563b8dec1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=71874) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-eb3d82e7-7232-45a5-9d24-542563b8dec1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] SCSI volumes sdf have been removed. {{(pid=71874) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb3d82e7-7232-45a5-9d24-542563b8dec1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4')] {{(pid=71874) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c8a22c6-16ad-4d9c-b735-0f77b1ce7b70]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb3d82e7-7232-45a5-9d24-542563b8dec1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4 -p 172.16.0.220:3260 --logout {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[679174a8-1c31-4e36-beb4-fcd035fcc932]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb3d82e7-7232-45a5-9d24-542563b8dec1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4, portal: 172.16.0.220,3260]
Apr 12 16:02:32 user nova-compute[71874]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4, portal: 172.16.0.220,3260] successful.
Apr 12 16:02:32 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4 -p 172.16.0.220:3260 --op delete {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a3e6bdc-d274-4e4a-ac05-59caa88e13d4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[975d4fde-2bf4-4c33-ac16-47e7a91856a8]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb3d82e7-7232-45a5-9d24-542563b8dec1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-eb3d82e7-7232-45a5-9d24-542563b8dec1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb3d82e7-7232-45a5-9d24-542563b8dec1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] <== disconnect_volume: return (305ms) None {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb3d82e7-7232-45a5-9d24-542563b8dec1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Disconnected iSCSI Volume {{(pid=71874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb3d82e7-7232-45a5-9d24-542563b8dec1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] calling os-brick to detach iSCSI Volume {{(pid=71874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb3d82e7-7232-45a5-9d24-542563b8dec1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3c0216320>, {'target_iqn': 'iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ksBtruqJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg': {}}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:02:32 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-eb3d82e7-7232-45a5-9d24-542563b8dec1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:02:32 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-eb3d82e7-7232-45a5-9d24-542563b8dec1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-eb3d82e7-7232-45a5-9d24-542563b8dec1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2242d2f-9be6-480e-ac8c-334da8d956d4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb3d82e7-7232-45a5-9d24-542563b8dec1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 16:02:32 user nova-compute[71874]: No targets found.
Apr 12 16:02:32 user nova-compute[71874]: iSNS:
Apr 12 16:02:32 user nova-compute[71874]: No targets found.
Apr 12 16:02:32 user nova-compute[71874]: STATIC:
Apr 12 16:02:32 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd
Apr 12 16:02:32 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:02:32 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:02:32 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6
Apr 12 16:02:32 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:02:32 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:02:32 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b
Apr 12 16:02:32 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:02:32 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:02:32 user nova-compute[71874]: FIRMWARE:
Apr 12 16:02:32 user nova-compute[71874]: No targets found.
Apr 12 16:02:32 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb3d82e7-7232-45a5-9d24-542563b8dec1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 16:02:32 user nova-compute[71874]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 16:02:32 user nova-compute[71874]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71874) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb3d82e7-7232-45a5-9d24-542563b8dec1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b', 0)] {{(pid=71874) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG nova.compute.manager [req-ce1d15aa-ff0f-48ed-a01e-7f740e53f05b req-6584da67-a422-4840-ad76-0a8da1aef47e service nova] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Received event network-vif-unplugged-6c9be856-3e7e-4166-8d71-a1f5330aa82f {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-ce1d15aa-ff0f-48ed-a01e-7f740e53f05b req-6584da67-a422-4840-ad76-0a8da1aef47e service nova] Acquiring lock "9ea56377-20bc-48cc-a248-5fad6db060cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-ce1d15aa-ff0f-48ed-a01e-7f740e53f05b req-6584da67-a422-4840-ad76-0a8da1aef47e service nova] Lock "9ea56377-20bc-48cc-a248-5fad6db060cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-ce1d15aa-ff0f-48ed-a01e-7f740e53f05b req-6584da67-a422-4840-ad76-0a8da1aef47e service nova] Lock "9ea56377-20bc-48cc-a248-5fad6db060cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG nova.compute.manager [req-ce1d15aa-ff0f-48ed-a01e-7f740e53f05b req-6584da67-a422-4840-ad76-0a8da1aef47e service nova] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] No waiting events found dispatching network-vif-unplugged-6c9be856-3e7e-4166-8d71-a1f5330aa82f {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG nova.compute.manager [req-ce1d15aa-ff0f-48ed-a01e-7f740e53f05b req-6584da67-a422-4840-ad76-0a8da1aef47e service nova] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Received event network-vif-unplugged-6c9be856-3e7e-4166-8d71-a1f5330aa82f for instance with task_state deleting. {{(pid=71874) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG nova.compute.manager [req-ce1d15aa-ff0f-48ed-a01e-7f740e53f05b req-6584da67-a422-4840-ad76-0a8da1aef47e service nova] [instance: 026ab036-1481-4689-af70-661493e9451c] Received event network-vif-deleted-0b2175eb-de94-4274-b200-14894dbcbda0 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:02:32 user nova-compute[71874]: INFO nova.compute.manager [req-ce1d15aa-ff0f-48ed-a01e-7f740e53f05b req-6584da67-a422-4840-ad76-0a8da1aef47e service nova] [instance: 026ab036-1481-4689-af70-661493e9451c] Neutron deleted interface 0b2175eb-de94-4274-b200-14894dbcbda0; detaching it from the instance and deleting it from the info cache
Apr 12 16:02:32 user nova-compute[71874]: DEBUG nova.network.neutron [req-ce1d15aa-ff0f-48ed-a01e-7f740e53f05b req-6584da67-a422-4840-ad76-0a8da1aef47e service nova] [instance: 026ab036-1481-4689-af70-661493e9451c] Updating instance_info_cache with network_info: [{"id": "8ebc1d23-a473-4640-aa39-31cbed300c07", "address": "fa:16:3e:d5:95:9e", "network": {"id": "9b0c9550-d764-4db6-b28b-09ab59801170", "bridge": "br-int", "label": "tempest-device-tagging-net1-638686183", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.180", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14aea401da6344858416fd2543bc10ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ebc1d23-a4", "ovs_interfaceid": "8ebc1d23-a473-4640-aa39-31cbed300c07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7f36bae3-c729-4d85-8c31-075b2b100abe", "address": "fa:16:3e:99:5c:8b", "network": {"id": "9b0c9550-d764-4db6-b28b-09ab59801170", "bridge": "br-int", "label": "tempest-device-tagging-net1-638686183", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14aea401da6344858416fd2543bc10ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f36bae3-c7", "ovs_interfaceid": "7f36bae3-c729-4d85-8c31-075b2b100abe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "264de72a-d4f4-4a6a-b3ab-1e8ea8b9a30b", "address": "fa:16:3e:da:a9:6d", "network": {"id": "9b0c9550-d764-4db6-b28b-09ab59801170", "bridge": "br-int", "label": "tempest-device-tagging-net1-638686183", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14aea401da6344858416fd2543bc10ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap264de72a-d4", "ovs_interfaceid": "264de72a-d4f4-4a6a-b3ab-1e8ea8b9a30b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e3f484fe-17dd-4cef-babd-ad78cf557b03", "address": "fa:16:3e:e6:0d:58", "network": {"id": "9b0c9550-d764-4db6-b28b-09ab59801170", "bridge": "br-int", "label": "tempest-device-tagging-net1-638686183", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14aea401da6344858416fd2543bc10ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3f484fe-17", "ovs_interfaceid": "e3f484fe-17dd-4cef-babd-ad78cf557b03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5796cf52-4e81-4c40-954e-86819f5557c8", "address": "fa:16:3e:b7:67:83", "network": {"id": "92fe4d7e-c0cd-45f1-9e92-a120ab22f6f1", "bridge": "br-int", "label": "tempest-device-tagging-net2-367644823", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "14aea401da6344858416fd2543bc10ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5796cf52-4e", "ovs_interfaceid": "5796cf52-4e81-4c40-954e-86819f5557c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cb242b6-c0cf-4de9-b359-007ab9a67b35]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG nova.compute.manager [req-ce1d15aa-ff0f-48ed-a01e-7f740e53f05b req-6584da67-a422-4840-ad76-0a8da1aef47e service nova] [instance: 026ab036-1481-4689-af70-661493e9451c] Detach interface failed, port_id=0b2175eb-de94-4274-b200-14894dbcbda0, reason: Instance 026ab036-1481-4689-af70-661493e9451c could not be found. {{(pid=71874) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG nova.compute.manager [req-ce1d15aa-ff0f-48ed-a01e-7f740e53f05b req-6584da67-a422-4840-ad76-0a8da1aef47e service nova] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Received event network-vif-plugged-6c9be856-3e7e-4166-8d71-a1f5330aa82f {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-ce1d15aa-ff0f-48ed-a01e-7f740e53f05b req-6584da67-a422-4840-ad76-0a8da1aef47e service nova] Acquiring lock "9ea56377-20bc-48cc-a248-5fad6db060cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-ce1d15aa-ff0f-48ed-a01e-7f740e53f05b req-6584da67-a422-4840-ad76-0a8da1aef47e service nova] Lock "9ea56377-20bc-48cc-a248-5fad6db060cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-ce1d15aa-ff0f-48ed-a01e-7f740e53f05b req-6584da67-a422-4840-ad76-0a8da1aef47e service nova] Lock "9ea56377-20bc-48cc-a248-5fad6db060cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG nova.compute.manager [req-ce1d15aa-ff0f-48ed-a01e-7f740e53f05b req-6584da67-a422-4840-ad76-0a8da1aef47e service nova] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] No waiting events found dispatching network-vif-plugged-6c9be856-3e7e-4166-8d71-a1f5330aa82f {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:02:32 user nova-compute[71874]: WARNING nova.compute.manager [req-ce1d15aa-ff0f-48ed-a01e-7f740e53f05b req-6584da67-a422-4840-ad76-0a8da1aef47e service nova] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Received unexpected event network-vif-plugged-6c9be856-3e7e-4166-8d71-a1f5330aa82f for instance with vm_state active and task_state deleting.
Apr 12 16:02:32 user nova-compute[71874]: DEBUG nova.compute.manager [req-ce1d15aa-ff0f-48ed-a01e-7f740e53f05b req-6584da67-a422-4840-ad76-0a8da1aef47e service nova] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Received event network-vif-unplugged-f76aae02-12c4-41d6-951a-201330ea7693 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-ce1d15aa-ff0f-48ed-a01e-7f740e53f05b req-6584da67-a422-4840-ad76-0a8da1aef47e service nova] Acquiring lock "9ea56377-20bc-48cc-a248-5fad6db060cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-ce1d15aa-ff0f-48ed-a01e-7f740e53f05b req-6584da67-a422-4840-ad76-0a8da1aef47e service nova] Lock "9ea56377-20bc-48cc-a248-5fad6db060cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-ce1d15aa-ff0f-48ed-a01e-7f740e53f05b req-6584da67-a422-4840-ad76-0a8da1aef47e service nova] Lock "9ea56377-20bc-48cc-a248-5fad6db060cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG nova.compute.manager [req-ce1d15aa-ff0f-48ed-a01e-7f740e53f05b req-6584da67-a422-4840-ad76-0a8da1aef47e service nova] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] No waiting events found dispatching network-vif-unplugged-f76aae02-12c4-41d6-951a-201330ea7693 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG nova.compute.manager [req-ce1d15aa-ff0f-48ed-a01e-7f740e53f05b req-6584da67-a422-4840-ad76-0a8da1aef47e service nova] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Received event network-vif-unplugged-f76aae02-12c4-41d6-951a-201330ea7693 for instance with task_state deleting. {{(pid=71874) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG nova.compute.manager [req-ce1d15aa-ff0f-48ed-a01e-7f740e53f05b req-6584da67-a422-4840-ad76-0a8da1aef47e service nova] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Received event network-vif-plugged-f76aae02-12c4-41d6-951a-201330ea7693 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-ce1d15aa-ff0f-48ed-a01e-7f740e53f05b req-6584da67-a422-4840-ad76-0a8da1aef47e service nova] Acquiring lock "9ea56377-20bc-48cc-a248-5fad6db060cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-ce1d15aa-ff0f-48ed-a01e-7f740e53f05b req-6584da67-a422-4840-ad76-0a8da1aef47e service nova] Lock "9ea56377-20bc-48cc-a248-5fad6db060cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-ce1d15aa-ff0f-48ed-a01e-7f740e53f05b req-6584da67-a422-4840-ad76-0a8da1aef47e service nova] Lock "9ea56377-20bc-48cc-a248-5fad6db060cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG nova.compute.manager [req-ce1d15aa-ff0f-48ed-a01e-7f740e53f05b req-6584da67-a422-4840-ad76-0a8da1aef47e service nova] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] No waiting events found dispatching network-vif-plugged-f76aae02-12c4-41d6-951a-201330ea7693 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:02:32 user nova-compute[71874]: WARNING nova.compute.manager [req-ce1d15aa-ff0f-48ed-a01e-7f740e53f05b req-6584da67-a422-4840-ad76-0a8da1aef47e service nova] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Received unexpected event network-vif-plugged-f76aae02-12c4-41d6-951a-201330ea7693 for instance with vm_state active and task_state deleting.
Apr 12 16:02:32 user nova-compute[71874]: DEBUG nova.compute.manager [req-ce1d15aa-ff0f-48ed-a01e-7f740e53f05b req-6584da67-a422-4840-ad76-0a8da1aef47e service nova] [instance: 026ab036-1481-4689-af70-661493e9451c] Received event network-vif-deleted-e3f484fe-17dd-4cef-babd-ad78cf557b03 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:02:32 user nova-compute[71874]: INFO nova.compute.manager [req-ce1d15aa-ff0f-48ed-a01e-7f740e53f05b req-6584da67-a422-4840-ad76-0a8da1aef47e service nova] [instance: 026ab036-1481-4689-af70-661493e9451c] Neutron deleted interface e3f484fe-17dd-4cef-babd-ad78cf557b03; detaching it from the instance and deleting it from the info cache
Apr 12 16:02:32 user nova-compute[71874]: DEBUG nova.network.neutron [req-ce1d15aa-ff0f-48ed-a01e-7f740e53f05b req-6584da67-a422-4840-ad76-0a8da1aef47e service nova] [instance: 026ab036-1481-4689-af70-661493e9451c] Updating instance_info_cache with network_info: [{"id": "8ebc1d23-a473-4640-aa39-31cbed300c07", "address": "fa:16:3e:d5:95:9e", "network": {"id": "9b0c9550-d764-4db6-b28b-09ab59801170", "bridge": "br-int", "label": "tempest-device-tagging-net1-638686183", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.180", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14aea401da6344858416fd2543bc10ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ebc1d23-a4", "ovs_interfaceid": "8ebc1d23-a473-4640-aa39-31cbed300c07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7f36bae3-c729-4d85-8c31-075b2b100abe", "address": "fa:16:3e:99:5c:8b", "network": {"id": "9b0c9550-d764-4db6-b28b-09ab59801170", "bridge": "br-int", "label": "tempest-device-tagging-net1-638686183", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14aea401da6344858416fd2543bc10ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f36bae3-c7", "ovs_interfaceid": "7f36bae3-c729-4d85-8c31-075b2b100abe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "264de72a-d4f4-4a6a-b3ab-1e8ea8b9a30b", "address": "fa:16:3e:da:a9:6d", "network": {"id": "9b0c9550-d764-4db6-b28b-09ab59801170", "bridge": "br-int", "label": "tempest-device-tagging-net1-638686183", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14aea401da6344858416fd2543bc10ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap264de72a-d4", "ovs_interfaceid": "264de72a-d4f4-4a6a-b3ab-1e8ea8b9a30b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5796cf52-4e81-4c40-954e-86819f5557c8", "address": "fa:16:3e:b7:67:83", "network": {"id": "92fe4d7e-c0cd-45f1-9e92-a120ab22f6f1", "bridge": "br-int", "label": "tempest-device-tagging-net2-367644823", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "14aea401da6344858416fd2543bc10ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5796cf52-4e", "ovs_interfaceid": "5796cf52-4e81-4c40-954e-86819f5557c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ecbf8d0-de88-42f2-ba75-aaaa7667d871]: (4, ('tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6 (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb3d82e7-7232-45a5-9d24-542563b8dec1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b (non-flash)
Apr 12 16:02:32 user nova-compute[71874]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd (non-flash)
Apr 12 16:02:32 user nova-compute[71874]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6 (non-flash)
Apr 12 16:02:32 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb3d82e7-7232-45a5-9d24-542563b8dec1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] iscsi session list stdout=tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b (non-flash)
Apr 12 16:02:32 user nova-compute[71874]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd (non-flash)
Apr 12 16:02:32 user nova-compute[71874]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6 (non-flash)
Apr 12 16:02:32 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb3d82e7-7232-45a5-9d24-542563b8dec1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc3c02a2b90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b'): ({'sdg'}, set())}) {{(pid=71874) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-eb3d82e7-7232-45a5-9d24-542563b8dec1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Removing single pathed devices sdg {{(pid=71874) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG nova.compute.manager [req-ce99b627-e8b1-45b0-9502-51fb6c7e756b req-24d66f32-cd4b-4ad7-9755-370352740dc7 service nova] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Received event network-vif-plugged-7ae43e60-f63a-448e-9a89-0d6bff272104 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-ce99b627-e8b1-45b0-9502-51fb6c7e756b req-24d66f32-cd4b-4ad7-9755-370352740dc7 service nova] Acquiring lock "9ea56377-20bc-48cc-a248-5fad6db060cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-ce99b627-e8b1-45b0-9502-51fb6c7e756b req-24d66f32-cd4b-4ad7-9755-370352740dc7 service nova] Lock "9ea56377-20bc-48cc-a248-5fad6db060cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-ce99b627-e8b1-45b0-9502-51fb6c7e756b req-24d66f32-cd4b-4ad7-9755-370352740dc7 service nova] Lock "9ea56377-20bc-48cc-a248-5fad6db060cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG nova.compute.manager [req-ce99b627-e8b1-45b0-9502-51fb6c7e756b req-24d66f32-cd4b-4ad7-9755-370352740dc7 service nova] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] No waiting events found dispatching network-vif-plugged-7ae43e60-f63a-448e-9a89-0d6bff272104 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:02:32 user nova-compute[71874]: WARNING nova.compute.manager [req-ce99b627-e8b1-45b0-9502-51fb6c7e756b req-24d66f32-cd4b-4ad7-9755-370352740dc7 service nova] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Received unexpected event network-vif-plugged-7ae43e60-f63a-448e-9a89-0d6bff272104 for instance with vm_state active and task_state deleting.
Apr 12 16:02:32 user nova-compute[71874]: DEBUG nova.compute.manager [req-ce99b627-e8b1-45b0-9502-51fb6c7e756b req-24d66f32-cd4b-4ad7-9755-370352740dc7 service nova] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Received event network-vif-unplugged-cd2391ad-cb7a-47be-b062-b0dbbc1f8475 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-ce99b627-e8b1-45b0-9502-51fb6c7e756b req-24d66f32-cd4b-4ad7-9755-370352740dc7 service nova] Acquiring lock "9ea56377-20bc-48cc-a248-5fad6db060cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-ce99b627-e8b1-45b0-9502-51fb6c7e756b req-24d66f32-cd4b-4ad7-9755-370352740dc7 service nova] Lock "9ea56377-20bc-48cc-a248-5fad6db060cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-ce99b627-e8b1-45b0-9502-51fb6c7e756b req-24d66f32-cd4b-4ad7-9755-370352740dc7 service nova] Lock "9ea56377-20bc-48cc-a248-5fad6db060cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG nova.compute.manager [req-ce99b627-e8b1-45b0-9502-51fb6c7e756b req-24d66f32-cd4b-4ad7-9755-370352740dc7 service nova] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] No waiting events found dispatching network-vif-unplugged-cd2391ad-cb7a-47be-b062-b0dbbc1f8475 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG nova.compute.manager [req-ce99b627-e8b1-45b0-9502-51fb6c7e756b req-24d66f32-cd4b-4ad7-9755-370352740dc7 service nova] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Received event network-vif-unplugged-cd2391ad-cb7a-47be-b062-b0dbbc1f8475 for instance with task_state deleting. {{(pid=71874) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG nova.compute.manager [req-ce99b627-e8b1-45b0-9502-51fb6c7e756b req-24d66f32-cd4b-4ad7-9755-370352740dc7 service nova] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Received event network-vif-plugged-cd2391ad-cb7a-47be-b062-b0dbbc1f8475 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-ce99b627-e8b1-45b0-9502-51fb6c7e756b req-24d66f32-cd4b-4ad7-9755-370352740dc7 service nova] Acquiring lock "9ea56377-20bc-48cc-a248-5fad6db060cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-ce99b627-e8b1-45b0-9502-51fb6c7e756b req-24d66f32-cd4b-4ad7-9755-370352740dc7 service nova] Lock "9ea56377-20bc-48cc-a248-5fad6db060cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-ce99b627-e8b1-45b0-9502-51fb6c7e756b req-24d66f32-cd4b-4ad7-9755-370352740dc7 service nova] Lock "9ea56377-20bc-48cc-a248-5fad6db060cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG nova.compute.manager [req-ce99b627-e8b1-45b0-9502-51fb6c7e756b req-24d66f32-cd4b-4ad7-9755-370352740dc7 service nova] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] No waiting events found dispatching network-vif-plugged-cd2391ad-cb7a-47be-b062-b0dbbc1f8475 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:02:32 user nova-compute[71874]: WARNING nova.compute.manager [req-ce99b627-e8b1-45b0-9502-51fb6c7e756b req-24d66f32-cd4b-4ad7-9755-370352740dc7 service nova] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Received unexpected event network-vif-plugged-cd2391ad-cb7a-47be-b062-b0dbbc1f8475 for instance with vm_state active and task_state deleting.
Apr 12 16:02:32 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8d4cab5-0aca-42ad-ad36-1c4af398db4d]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG nova.compute.manager [req-ce1d15aa-ff0f-48ed-a01e-7f740e53f05b req-6584da67-a422-4840-ad76-0a8da1aef47e service nova] [instance: 026ab036-1481-4689-af70-661493e9451c] Detach interface failed, port_id=e3f484fe-17dd-4cef-babd-ad78cf557b03, reason: Instance 026ab036-1481-4689-af70-661493e9451c could not be found. {{(pid=71874) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.026s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[64ed1a90-b805-4641-82ec-334a991ea29c]: (4, ('ok\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-eb3d82e7-7232-45a5-9d24-542563b8dec1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Flushing IO for device /dev/sdg {{(pid=71874) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.014s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2750aee-6bb6-4110-bf4c-7256f565410c]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-eb3d82e7-7232-45a5-9d24-542563b8dec1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=71874) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.033s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[fac0c21d-1c27-4f19-800d-09f89674da85]: (4, ('1', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-eb3d82e7-7232-45a5-9d24-542563b8dec1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=71874) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-eb3d82e7-7232-45a5-9d24-542563b8dec1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] SCSI volumes sdg have been removed. {{(pid=71874) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb3d82e7-7232-45a5-9d24-542563b8dec1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b')] {{(pid=71874) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3dc299c-dcb3-4b8e-b99e-09b8f588ed0d]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb3d82e7-7232-45a5-9d24-542563b8dec1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b -p 172.16.0.220:3260 --logout {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[10308ad3-452a-48cd-8c0d-a519815dcb33]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb3d82e7-7232-45a5-9d24-542563b8dec1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b, portal: 172.16.0.220,3260]
Apr 12 16:02:32 user nova-compute[71874]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b, portal: 172.16.0.220,3260] successful.
Apr 12 16:02:32 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b -p 172.16.0.220:3260 --op delete {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c11ebd7-2275-4a31-9558-6af01638a09b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcc1670b-115b-4331-83f2-f47fcd88fc44]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb3d82e7-7232-45a5-9d24-542563b8dec1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-eb3d82e7-7232-45a5-9d24-542563b8dec1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.332s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb3d82e7-7232-45a5-9d24-542563b8dec1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] <== disconnect_volume: return (333ms) None {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb3d82e7-7232-45a5-9d24-542563b8dec1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Disconnected iSCSI Volume {{(pid=71874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb3d82e7-7232-45a5-9d24-542563b8dec1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] calling os-brick to detach iSCSI Volume {{(pid=71874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb3d82e7-7232-45a5-9d24-542563b8dec1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3c0216320>, {'target_iqn': 'iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ksialVvo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh': {}}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:02:32 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-eb3d82e7-7232-45a5-9d24-542563b8dec1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:02:32 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-eb3d82e7-7232-45a5-9d24-542563b8dec1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-eb3d82e7-7232-45a5-9d24-542563b8dec1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ba52cc2-9940-44ac-8669-36c4dabc87e4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb3d82e7-7232-45a5-9d24-542563b8dec1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 16:02:32 user nova-compute[71874]: No targets found.
Apr 12 16:02:32 user nova-compute[71874]: iSNS:
Apr 12 16:02:32 user nova-compute[71874]: No targets found.
Apr 12 16:02:32 user nova-compute[71874]: STATIC:
Apr 12 16:02:32 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd
Apr 12 16:02:32 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:02:32 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:02:32 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6
Apr 12 16:02:32 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:02:32 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:02:32 user nova-compute[71874]: FIRMWARE:
Apr 12 16:02:32 user nova-compute[71874]: No targets found.
Apr 12 16:02:32 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb3d82e7-7232-45a5-9d24-542563b8dec1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 16:02:32 user nova-compute[71874]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 16:02:32 user nova-compute[71874]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71874) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb3d82e7-7232-45a5-9d24-542563b8dec1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd', 0)] {{(pid=71874) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[24c41787-41dd-476c-9677-ae7f5742f173]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dea1dba-ea56-41c8-a2c7-c61957e984fb]: (4, ('tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6 (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb3d82e7-7232-45a5-9d24-542563b8dec1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd (non-flash)
Apr 12 16:02:32 user nova-compute[71874]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6 (non-flash)
Apr 12 16:02:32 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb3d82e7-7232-45a5-9d24-542563b8dec1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] iscsi session list stdout=tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd (non-flash)
Apr 12 16:02:32 user nova-compute[71874]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6 (non-flash)
Apr 12 16:02:32 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb3d82e7-7232-45a5-9d24-542563b8dec1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc3c0613d00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd'): ({'sdh'}, set())}) {{(pid=71874) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-eb3d82e7-7232-45a5-9d24-542563b8dec1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Removing single pathed devices sdh {{(pid=71874) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[37c8a7cf-006f-4be7-8444-becacaf1630b]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:32 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:33 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.017s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:33 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[1956bbeb-4ec7-4b83-be08-121a8b6a1059]: (4, ('ok\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:33 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-eb3d82e7-7232-45a5-9d24-542563b8dec1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Flushing IO for device /dev/sdh {{(pid=71874) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 16:02:33 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:33 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.014s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:33 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[f21ec92d-c501-49e5-b9e1-e27e7b875f2c]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:33 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-eb3d82e7-7232-45a5-9d24-542563b8dec1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=71874) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 16:02:33 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:33 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.043s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:33 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[4273c7e1-f21f-4e90-b457-e7666af85eb9]: (4, ('1', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:33 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-eb3d82e7-7232-45a5-9d24-542563b8dec1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=71874) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 16:02:33 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-eb3d82e7-7232-45a5-9d24-542563b8dec1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] SCSI volumes sdh have been removed. {{(pid=71874) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 16:02:33 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb3d82e7-7232-45a5-9d24-542563b8dec1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd')] {{(pid=71874) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 16:02:33 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:33 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:33 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[8caf793c-a78b-48c5-935f-1c013a99ad7d]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:33 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb3d82e7-7232-45a5-9d24-542563b8dec1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:02:33 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd -p 172.16.0.220:3260 --logout {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:33 user nova-compute[71874]: DEBUG nova.compute.manager [req-565ba1b4-e229-407e-9a88-eab4ecc34e5a req-8789015c-86b6-49bb-916c-16f2e11f9ad1 service nova] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Received event network-vif-plugged-b85b7f43-1f5d-441a-bf3e-380900194e10 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:02:33 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-565ba1b4-e229-407e-9a88-eab4ecc34e5a req-8789015c-86b6-49bb-916c-16f2e11f9ad1 service nova] Acquiring lock "9ea56377-20bc-48cc-a248-5fad6db060cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:02:33 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-565ba1b4-e229-407e-9a88-eab4ecc34e5a req-8789015c-86b6-49bb-916c-16f2e11f9ad1 service nova] Lock "9ea56377-20bc-48cc-a248-5fad6db060cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:02:33 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-565ba1b4-e229-407e-9a88-eab4ecc34e5a req-8789015c-86b6-49bb-916c-16f2e11f9ad1 service nova] Lock "9ea56377-20bc-48cc-a248-5fad6db060cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:02:33 user nova-compute[71874]: DEBUG nova.compute.manager [req-565ba1b4-e229-407e-9a88-eab4ecc34e5a req-8789015c-86b6-49bb-916c-16f2e11f9ad1 service nova] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] No waiting events found dispatching network-vif-plugged-b85b7f43-1f5d-441a-bf3e-380900194e10 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:02:33 user nova-compute[71874]: WARNING nova.compute.manager [req-565ba1b4-e229-407e-9a88-eab4ecc34e5a req-8789015c-86b6-49bb-916c-16f2e11f9ad1 service nova] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Received unexpected event network-vif-plugged-b85b7f43-1f5d-441a-bf3e-380900194e10 for instance with vm_state active and task_state deleting.
Apr 12 16:02:33 user nova-compute[71874]: DEBUG nova.compute.manager [req-565ba1b4-e229-407e-9a88-eab4ecc34e5a req-8789015c-86b6-49bb-916c-16f2e11f9ad1 service nova] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Received event network-vif-unplugged-c5c4abf8-1b9b-4385-adf7-b34b27a8bc6b {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:02:33 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-565ba1b4-e229-407e-9a88-eab4ecc34e5a req-8789015c-86b6-49bb-916c-16f2e11f9ad1 service nova] Acquiring lock "9ea56377-20bc-48cc-a248-5fad6db060cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:02:33 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-565ba1b4-e229-407e-9a88-eab4ecc34e5a req-8789015c-86b6-49bb-916c-16f2e11f9ad1 service nova] Lock "9ea56377-20bc-48cc-a248-5fad6db060cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:02:33 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-565ba1b4-e229-407e-9a88-eab4ecc34e5a req-8789015c-86b6-49bb-916c-16f2e11f9ad1 service nova] Lock "9ea56377-20bc-48cc-a248-5fad6db060cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:02:33 user nova-compute[71874]: DEBUG nova.compute.manager [req-565ba1b4-e229-407e-9a88-eab4ecc34e5a req-8789015c-86b6-49bb-916c-16f2e11f9ad1 service nova] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] No waiting events found dispatching network-vif-unplugged-c5c4abf8-1b9b-4385-adf7-b34b27a8bc6b {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:02:33 user nova-compute[71874]: DEBUG nova.compute.manager [req-565ba1b4-e229-407e-9a88-eab4ecc34e5a req-8789015c-86b6-49bb-916c-16f2e11f9ad1 service nova] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Received event network-vif-unplugged-c5c4abf8-1b9b-4385-adf7-b34b27a8bc6b for instance with task_state deleting. {{(pid=71874) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 16:02:33 user nova-compute[71874]: DEBUG nova.compute.manager [req-565ba1b4-e229-407e-9a88-eab4ecc34e5a req-8789015c-86b6-49bb-916c-16f2e11f9ad1 service nova] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Received event network-vif-plugged-c5c4abf8-1b9b-4385-adf7-b34b27a8bc6b {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:02:33 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-565ba1b4-e229-407e-9a88-eab4ecc34e5a req-8789015c-86b6-49bb-916c-16f2e11f9ad1 service nova] Acquiring lock "9ea56377-20bc-48cc-a248-5fad6db060cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:02:33 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-565ba1b4-e229-407e-9a88-eab4ecc34e5a req-8789015c-86b6-49bb-916c-16f2e11f9ad1 service nova] Lock "9ea56377-20bc-48cc-a248-5fad6db060cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:02:33 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-565ba1b4-e229-407e-9a88-eab4ecc34e5a req-8789015c-86b6-49bb-916c-16f2e11f9ad1 service nova] Lock "9ea56377-20bc-48cc-a248-5fad6db060cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:02:33 user nova-compute[71874]: DEBUG nova.compute.manager [req-565ba1b4-e229-407e-9a88-eab4ecc34e5a req-8789015c-86b6-49bb-916c-16f2e11f9ad1 service nova] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] No waiting events found dispatching network-vif-plugged-c5c4abf8-1b9b-4385-adf7-b34b27a8bc6b {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:02:33 user nova-compute[71874]: WARNING nova.compute.manager [req-565ba1b4-e229-407e-9a88-eab4ecc34e5a req-8789015c-86b6-49bb-916c-16f2e11f9ad1 service nova] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Received unexpected event network-vif-plugged-c5c4abf8-1b9b-4385-adf7-b34b27a8bc6b for instance with vm_state active and task_state deleting.
Apr 12 16:02:33 user nova-compute[71874]: DEBUG nova.compute.manager [req-565ba1b4-e229-407e-9a88-eab4ecc34e5a req-8789015c-86b6-49bb-916c-16f2e11f9ad1 service nova] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Received event network-vif-unplugged-1d70ad7b-92c6-47fa-a411-cef9d6159e90 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:02:33 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-565ba1b4-e229-407e-9a88-eab4ecc34e5a req-8789015c-86b6-49bb-916c-16f2e11f9ad1 service nova] Acquiring lock "9ea56377-20bc-48cc-a248-5fad6db060cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:02:33 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-565ba1b4-e229-407e-9a88-eab4ecc34e5a req-8789015c-86b6-49bb-916c-16f2e11f9ad1 service nova] Lock "9ea56377-20bc-48cc-a248-5fad6db060cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:02:33 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-565ba1b4-e229-407e-9a88-eab4ecc34e5a req-8789015c-86b6-49bb-916c-16f2e11f9ad1 service nova] Lock "9ea56377-20bc-48cc-a248-5fad6db060cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:02:33 user nova-compute[71874]: DEBUG nova.compute.manager [req-565ba1b4-e229-407e-9a88-eab4ecc34e5a req-8789015c-86b6-49bb-916c-16f2e11f9ad1 service nova] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] No waiting events found dispatching network-vif-unplugged-1d70ad7b-92c6-47fa-a411-cef9d6159e90 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:02:33 user nova-compute[71874]: DEBUG nova.compute.manager [req-565ba1b4-e229-407e-9a88-eab4ecc34e5a req-8789015c-86b6-49bb-916c-16f2e11f9ad1 service nova] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Received event network-vif-unplugged-1d70ad7b-92c6-47fa-a411-cef9d6159e90 for instance with task_state deleting. {{(pid=71874) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 16:02:33 user nova-compute[71874]: DEBUG nova.compute.manager [req-565ba1b4-e229-407e-9a88-eab4ecc34e5a req-8789015c-86b6-49bb-916c-16f2e11f9ad1 service nova] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Received event network-vif-plugged-1d70ad7b-92c6-47fa-a411-cef9d6159e90 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:02:33 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-565ba1b4-e229-407e-9a88-eab4ecc34e5a req-8789015c-86b6-49bb-916c-16f2e11f9ad1 service nova] Acquiring lock "9ea56377-20bc-48cc-a248-5fad6db060cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:02:33 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-565ba1b4-e229-407e-9a88-eab4ecc34e5a req-8789015c-86b6-49bb-916c-16f2e11f9ad1 service nova] Lock "9ea56377-20bc-48cc-a248-5fad6db060cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:02:33 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-565ba1b4-e229-407e-9a88-eab4ecc34e5a req-8789015c-86b6-49bb-916c-16f2e11f9ad1 service nova] Lock "9ea56377-20bc-48cc-a248-5fad6db060cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:02:33 user nova-compute[71874]: DEBUG nova.compute.manager [req-565ba1b4-e229-407e-9a88-eab4ecc34e5a req-8789015c-86b6-49bb-916c-16f2e11f9ad1 service nova] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] No waiting events found dispatching network-vif-plugged-1d70ad7b-92c6-47fa-a411-cef9d6159e90 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:02:33 user nova-compute[71874]: WARNING nova.compute.manager [req-565ba1b4-e229-407e-9a88-eab4ecc34e5a req-8789015c-86b6-49bb-916c-16f2e11f9ad1 service nova] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Received unexpected event network-vif-plugged-1d70ad7b-92c6-47fa-a411-cef9d6159e90 for instance with vm_state active and task_state deleting.
Apr 12 16:02:33 user nova-compute[71874]: DEBUG nova.network.neutron [-] [instance: 026ab036-1481-4689-af70-661493e9451c] Updating instance_info_cache with network_info: [] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:02:33 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:33 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4fac510-12d6-4eb6-8520-ea12815087fe]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:33 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb3d82e7-7232-45a5-9d24-542563b8dec1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd, portal: 172.16.0.220,3260]
Apr 12 16:02:33 user nova-compute[71874]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd, portal: 172.16.0.220,3260] successful.
Apr 12 16:02:33 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:02:33 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd -p 172.16.0.220:3260 --op delete {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:33 user nova-compute[71874]: INFO nova.compute.manager [-] [instance: 026ab036-1481-4689-af70-661493e9451c] Took 5.06 seconds to deallocate network for instance.
Apr 12 16:02:33 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b990634-7cec-49db-9df4-81d3a3f3b0fd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:33 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[e398d7bc-4237-4c6f-8a78-5ff38056a583]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:33 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb3d82e7-7232-45a5-9d24-542563b8dec1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:02:33 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-eb3d82e7-7232-45a5-9d24-542563b8dec1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.293s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:02:33 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb3d82e7-7232-45a5-9d24-542563b8dec1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] <== disconnect_volume: return (294ms) None {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:02:33 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb3d82e7-7232-45a5-9d24-542563b8dec1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Disconnected iSCSI Volume {{(pid=71874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 16:02:33 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-eb3d82e7-7232-45a5-9d24-542563b8dec1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Deleting instance files /opt/stack/data/nova/instances/9ea56377-20bc-48cc-a248-5fad6db060cb_del
Apr 12 16:02:33 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-eb3d82e7-7232-45a5-9d24-542563b8dec1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Deletion of /opt/stack/data/nova/instances/9ea56377-20bc-48cc-a248-5fad6db060cb_del complete
Apr 12 16:02:33 user nova-compute[71874]: INFO nova.compute.manager [None req-eb3d82e7-7232-45a5-9d24-542563b8dec1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Took 3.24 seconds to destroy the instance on the hypervisor.
Apr 12 16:02:33 user nova-compute[71874]: DEBUG oslo.service.loopingcall [None req-eb3d82e7-7232-45a5-9d24-542563b8dec1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71874) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 16:02:33 user nova-compute[71874]: DEBUG nova.compute.manager [-] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Deallocating network for instance {{(pid=71874) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 16:02:33 user nova-compute[71874]: DEBUG nova.network.neutron [-] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] deallocate_for_instance() {{(pid=71874) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 16:02:34 user nova-compute[71874]: DEBUG nova.compute.manager [None req-2f9f654f-f62b-48ca-8866-c4756fbc06b3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] Start spawning the instance on the hypervisor. {{(pid=71874) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 16:02:34 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-2f9f654f-f62b-48ca-8866-c4756fbc06b3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] Creating instance directory {{(pid=71874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 16:02:34 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-2f9f654f-f62b-48ca-8866-c4756fbc06b3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] Creating image(s)
Apr 12 16:02:34 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-2f9f654f-f62b-48ca-8866-c4756fbc06b3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] Did not create local disks {{(pid=71874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 12 16:02:34 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-2f9f654f-f62b-48ca-8866-c4756fbc06b3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] Ensure instance console log exists: /opt/stack/data/nova/instances/f52ee906-c8fd-4cd5-842e-de98a5099c4f/console.log {{(pid=71874) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 16:02:34 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-2f9f654f-f62b-48ca-8866-c4756fbc06b3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:02:34 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-2f9f654f-f62b-48ca-8866-c4756fbc06b3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:02:34 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-2f9f654f-f62b-48ca-8866-c4756fbc06b3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:02:34 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-2f9f654f-f62b-48ca-8866-c4756fbc06b3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] Start _get_guest_xml network_info=[{"id": "955511f0-eca8-447d-a105-fdd5f182de62", "address": "fa:16:3e:ec:61:14", "network": {"id": "b36306e0-04c5-4b1b-8022-05ff121c4e43", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1503204786-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9210f81232304e179d3e09914a492442", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap955511f0-ec", "ovs_interfaceid": "955511f0-eca8-447d-a105-fdd5f182de62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T15:55:37Z,direct_url=<?>,disk_format='qcow2',id=9dc63f14-8b70-4e72-89f2-13464f2f5c7c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='61a4936d9b7744c0b488d81c9b7746b6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T15:55:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'delete_on_termination': False, 'attachment_id': 'c3a8b54b-e31d-4609-afe9-1ed34e3bef9e', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aufDXJAj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f52ee906-c8fd-4cd5-842e-de98a5099c4f', 'attached_at': '', 'detached_at': '', 'volume_id': 'a3ef648d-928f-4687-906e-f415a564fea2', 'serial': 'a3ef648d-928f-4687-906e-f415a564fea2'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'volume_type': None} {{(pid=71874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 16:02:34 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-2f9f654f-f62b-48ca-8866-c4756fbc06b3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:02:34 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-2f9f654f-f62b-48ca-8866-c4756fbc06b3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:02:34 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-2f9f654f-f62b-48ca-8866-c4756fbc06b3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71874) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 16:02:34 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-2f9f654f-f62b-48ca-8866-c4756fbc06b3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T15:56:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T15:55:37Z,direct_url=<?>,disk_format='qcow2',id=9dc63f14-8b70-4e72-89f2-13464f2f5c7c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='61a4936d9b7744c0b488d81c9b7746b6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T15:55:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 16:02:34 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-2f9f654f-f62b-48ca-8866-c4756fbc06b3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Flavor limits 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 16:02:34 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-2f9f654f-f62b-48ca-8866-c4756fbc06b3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Image limits 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 16:02:34 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-2f9f654f-f62b-48ca-8866-c4756fbc06b3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Flavor pref 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 16:02:34 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-2f9f654f-f62b-48ca-8866-c4756fbc06b3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Image pref 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 16:02:34 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-2f9f654f-f62b-48ca-8866-c4756fbc06b3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 16:02:34 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-2f9f654f-f62b-48ca-8866-c4756fbc06b3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 16:02:34 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-2f9f654f-f62b-48ca-8866-c4756fbc06b3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 16:02:34 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-2f9f654f-f62b-48ca-8866-c4756fbc06b3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Got 1 possible topologies {{(pid=71874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 16:02:34 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-2f9f654f-f62b-48ca-8866-c4756fbc06b3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 16:02:34 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-2f9f654f-f62b-48ca-8866-c4756fbc06b3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 16:02:34 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f9f654f-f62b-48ca-8866-c4756fbc06b3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] Calling os-brick to attach iSCSI Volume {{(pid=71874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 16:02:34 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f9f654f-f62b-48ca-8866-c4756fbc06b3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3c0216320>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aufDXJAj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:02:34 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-2f9f654f-f62b-48ca-8866-c4756fbc06b3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:02:34 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-2f9f654f-f62b-48ca-8866-c4756fbc06b3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:02:34 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-2f9f654f-f62b-48ca-8866-c4756fbc06b3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:02:34 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-2f9f654f-f62b-48ca-8866-c4756fbc06b3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:02:34 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-2f9f654f-f62b-48ca-8866-c4756fbc06b3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:02:34 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-2f9f654f-f62b-48ca-8866-c4756fbc06b3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:02:34 user nova-compute[71874]: INFO os_brick.initiator.connectors.iscsi [None req-2f9f654f-f62b-48ca-8866-c4756fbc06b3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 16:02:34 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 -p 172.16.0.220:3260 {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:34 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:34 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad948006-ab29-4821-98f8-d7ae5cd5d707]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:34 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f9f654f-f62b-48ca-8866-c4756fbc06b3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 16:02:34 user nova-compute[71874]:  {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:02:34 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 -p 172.16.0.220:3260 --interface default --op new {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:34 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:34 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5fd4905-aa62-446d-8c5f-51a215bf01e7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2] added\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:34 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f9f654f-f62b-48ca-8866-c4756fbc06b3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2] added
Apr 12 16:02:34 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:02:34 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:34 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:34 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[a591126d-539e-44bb-b589-86f6f1f0854c]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:34 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f9f654f-f62b-48ca-8866-c4756fbc06b3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:02:34 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:34 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:34 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c022be5-2fed-4d94-a2bf-ca4431afe971]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:34 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f9f654f-f62b-48ca-8866-c4756fbc06b3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:02:34 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aufDXJAj {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:34 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aufDXJAj" returned: 0 in 0.017s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:34 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[e93e9a18-7595-44b3-9da9-c7173e661aa0]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:34 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f9f654f-f62b-48ca-8866-c4756fbc06b3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aufDXJAj'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:02:34 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:34 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:34 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f8f9702-96b6-4230-90bd-ab190b76ed6a]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:34 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f9f654f-f62b-48ca-8866-c4756fbc06b3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:02:34 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:34 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:34 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[831533bd-5732-44bf-b0aa-f526c29dd992]: (4, ('tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6 (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:34 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f9f654f-f62b-48ca-8866-c4756fbc06b3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6 (non-flash)
Apr 12 16:02:34 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:02:34 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f9f654f-f62b-48ca-8866-c4756fbc06b3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] iscsi session list stdout=tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6 (non-flash)
Apr 12 16:02:34 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:02:34 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 -p 172.16.0.220:3260 --login {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:34 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:34 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[040f100c-ccd9-4aab-8aea-2d75409f6487]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:34 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f9f654f-f62b-48ca-8866-c4756fbc06b3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2, portal: 172.16.0.220,3260]
Apr 12 16:02:34 user nova-compute[71874]: Login to [iface: default, target: iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2, portal: 172.16.0.220,3260] successful.
Apr 12 16:02:34 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:02:34 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:34 user nova-compute[71874]: DEBUG nova.compute.manager [req-035d6d27-91c2-48ef-97b1-79c2eb7d5c3f req-968d2c39-8648-4cbd-a965-872d0c04c9d6 service nova] [instance: 026ab036-1481-4689-af70-661493e9451c] Received event network-vif-deleted-264de72a-d4f4-4a6a-b3ab-1e8ea8b9a30b {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:02:34 user nova-compute[71874]: DEBUG nova.compute.manager [req-035d6d27-91c2-48ef-97b1-79c2eb7d5c3f req-968d2c39-8648-4cbd-a965-872d0c04c9d6 service nova] [instance: 026ab036-1481-4689-af70-661493e9451c] Received event network-vif-deleted-5796cf52-4e81-4c40-954e-86819f5557c8 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:02:34 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:34 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[b59d0ec8-53ff-4260-a788-2bdff1d019bb]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:34 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f9f654f-f62b-48ca-8866-c4756fbc06b3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:02:34 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:34 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:34 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[16c72f37-4b0d-4465-a444-efe4dd791e04]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6 (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:34 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f9f654f-f62b-48ca-8866-c4756fbc06b3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:02:34 user nova-compute[71874]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6 (non-flash)
Apr 12 16:02:34 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:02:34 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f9f654f-f62b-48ca-8866-c4756fbc06b3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:02:34 user nova-compute[71874]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6 (non-flash)
Apr 12 16:02:34 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:02:34 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-2f9f654f-f62b-48ca-8866-c4756fbc06b3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.264s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:02:34 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f9f654f-f62b-48ca-8866-c4756fbc06b3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Connected to 172.16.0.220:3260 {{(pid=71874) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 16:02:34 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-2f9f654f-f62b-48ca-8866-c4756fbc06b3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] HCTL ('33', '-', '-', 0) found on session 15 with lun 0 {{(pid=71874) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 16:02:34 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-2f9f654f-f62b-48ca-8866-c4756fbc06b3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71874) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 16:02:34 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:34 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:34 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[019caa3a-d1be-4547-aac8-e5c8ff303cec]: (4, ('- - 0', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:02:34 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-2f9f654f-f62b-48ca-8866-c4756fbc06b3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Searching for a device in session 15 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71874) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 16:02:34 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f9f654f-f62b-48ca-8866-c4756fbc06b3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aufDXJAj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71874) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 16:02:35 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-2f9f654f-f62b-48ca-8866-c4756fbc06b3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.299s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:02:35 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f9f654f-f62b-48ca-8866-c4756fbc06b3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] <== connect_volume: return (1300ms) {'type': 'block', 'scsi_wwn': '26636366630616233', 'path': '/dev/sdb'} {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:02:35 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f9f654f-f62b-48ca-8866-c4756fbc06b3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26636366630616233', 'path': '/dev/sdb'} {{(pid=71874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 16:02:35 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-2f9f654f-f62b-48ca-8866-c4756fbc06b3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T16:02:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2141634890',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2141634890',id=15,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9210f81232304e179d3e09914a492442',ramdisk_id='',reservation_id='r-ny60dh1j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1443944578',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T16:02:23Z,user_data=None,user_id='73f9fa5bc22a4824b3cdcb8cf7bb380c',uuid=f52ee906-c8fd-4cd5-842e-de98a5099c4f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "955511f0-eca8-447d-a105-fdd5f182de62", "address": "fa:16:3e:ec:61:14", "network": {"id": "b36306e0-04c5-4b1b-8022-05ff121c4e43", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1503204786-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9210f81232304e179d3e09914a492442", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap955511f0-ec", "ovs_interfaceid": "955511f0-eca8-447d-a105-fdd5f182de62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 16:02:35 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-2f9f654f-f62b-48ca-8866-c4756fbc06b3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Converting VIF {"id": "955511f0-eca8-447d-a105-fdd5f182de62", "address": "fa:16:3e:ec:61:14", "network": {"id": "b36306e0-04c5-4b1b-8022-05ff121c4e43", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1503204786-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9210f81232304e179d3e09914a492442", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap955511f0-ec", "ovs_interfaceid": "955511f0-eca8-447d-a105-fdd5f182de62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:02:35 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-2f9f654f-f62b-48ca-8866-c4756fbc06b3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:61:14,bridge_name='br-int',has_traffic_filtering=True,id=955511f0-eca8-447d-a105-fdd5f182de62,network=Network(b36306e0-04c5-4b1b-8022-05ff121c4e43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap955511f0-ec') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:02:35 user nova-compute[71874]: DEBUG nova.objects.instance [None req-2f9f654f-f62b-48ca-8866-c4756fbc06b3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lazy-loading 'pci_devices' on Instance uuid f52ee906-c8fd-4cd5-842e-de98a5099c4f {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:02:35 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-2f9f654f-f62b-48ca-8866-c4756fbc06b3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] End _get_guest_xml xml=<domain type="kvm">
Apr 12 16:02:35 user nova-compute[71874]:   <uuid>f52ee906-c8fd-4cd5-842e-de98a5099c4f</uuid>
Apr 12 16:02:35 user nova-compute[71874]:   <name>instance-0000000f</name>
Apr 12 16:02:35 user nova-compute[71874]:   <memory>131072</memory>
Apr 12 16:02:35 user nova-compute[71874]:   <vcpu>1</vcpu>
Apr 12 16:02:35 user nova-compute[71874]:   <metadata>
Apr 12 16:02:35 user nova-compute[71874]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 16:02:35 user nova-compute[71874]:       <nova:package version="0.0.0"/>
Apr 12 16:02:35 user nova-compute[71874]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-2141634890</nova:name>
Apr 12 16:02:35 user nova-compute[71874]:       <nova:creationTime>2023-04-12 16:02:34</nova:creationTime>
Apr 12 16:02:35 user nova-compute[71874]:       <nova:flavor name="m1.nano">
Apr 12 16:02:35 user nova-compute[71874]:         <nova:memory>128</nova:memory>
Apr 12 16:02:35 user nova-compute[71874]:         <nova:disk>1</nova:disk>
Apr 12 16:02:35 user nova-compute[71874]:         <nova:swap>0</nova:swap>
Apr 12 16:02:35 user nova-compute[71874]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 16:02:35 user nova-compute[71874]:         <nova:vcpus>1</nova:vcpus>
Apr 12 16:02:35 user nova-compute[71874]:       </nova:flavor>
Apr 12 16:02:35 user nova-compute[71874]:       <nova:owner>
Apr 12 16:02:35 user nova-compute[71874]:         <nova:user uuid="73f9fa5bc22a4824b3cdcb8cf7bb380c">tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member</nova:user>
Apr 12 16:02:35 user nova-compute[71874]:         <nova:project uuid="9210f81232304e179d3e09914a492442">tempest-ServerBootFromVolumeStableRescueTest-1443944578</nova:project>
Apr 12 16:02:35 user nova-compute[71874]:       </nova:owner>
Apr 12 16:02:35 user nova-compute[71874]:       <nova:root type="image" uuid="9dc63f14-8b70-4e72-89f2-13464f2f5c7c"/>
Apr 12 16:02:35 user nova-compute[71874]:       <nova:ports>
Apr 12 16:02:35 user nova-compute[71874]:         <nova:port uuid="955511f0-eca8-447d-a105-fdd5f182de62">
Apr 12 16:02:35 user nova-compute[71874]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 12 16:02:35 user nova-compute[71874]:         </nova:port>
Apr 12 16:02:35 user nova-compute[71874]:       </nova:ports>
Apr 12 16:02:35 user nova-compute[71874]:     </nova:instance>
Apr 12 16:02:35 user nova-compute[71874]:   </metadata>
Apr 12 16:02:35 user nova-compute[71874]:   <sysinfo type="smbios">
Apr 12 16:02:35 user nova-compute[71874]:     <system>
Apr 12 16:02:35 user nova-compute[71874]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 16:02:35 user nova-compute[71874]:       <entry name="product">OpenStack Nova</entry>
Apr 12 16:02:35 user nova-compute[71874]:       <entry name="version">0.0.0</entry>
Apr 12 16:02:35 user nova-compute[71874]:       <entry name="serial">f52ee906-c8fd-4cd5-842e-de98a5099c4f</entry>
Apr 12 16:02:35 user nova-compute[71874]:       <entry name="uuid">f52ee906-c8fd-4cd5-842e-de98a5099c4f</entry>
Apr 12 16:02:35 user nova-compute[71874]:       <entry name="family">Virtual Machine</entry>
Apr 12 16:02:35 user nova-compute[71874]:     </system>
Apr 12 16:02:35 user nova-compute[71874]:   </sysinfo>
Apr 12 16:02:35 user nova-compute[71874]:   <os>
Apr 12 16:02:35 user nova-compute[71874]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 16:02:35 user nova-compute[71874]:     <boot dev="hd"/>
Apr 12 16:02:35 user nova-compute[71874]:     <smbios mode="sysinfo"/>
Apr 12 16:02:35 user nova-compute[71874]:   </os>
Apr 12 16:02:35 user nova-compute[71874]:   <features>
Apr 12 16:02:35 user nova-compute[71874]:     <acpi/>
Apr 12 16:02:35 user nova-compute[71874]:     <apic/>
Apr 12 16:02:35 user nova-compute[71874]:     <vmcoreinfo/>
Apr 12 16:02:35 user nova-compute[71874]:   </features>
Apr 12 16:02:35 user nova-compute[71874]:   <clock offset="utc">
Apr 12 16:02:35 user nova-compute[71874]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 16:02:35 user nova-compute[71874]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 16:02:35 user nova-compute[71874]:     <timer name="hpet" present="no"/>
Apr 12 16:02:35 user nova-compute[71874]:   </clock>
Apr 12 16:02:35 user nova-compute[71874]:   <cpu mode="custom" match="exact">
Apr 12 16:02:35 user nova-compute[71874]:     <model>Nehalem</model>
Apr 12 16:02:35 user nova-compute[71874]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 16:02:35 user nova-compute[71874]:   </cpu>
Apr 12 16:02:35 user nova-compute[71874]:   <devices>
Apr 12 16:02:35 user nova-compute[71874]:     <disk type="block" device="disk">
Apr 12 16:02:35 user nova-compute[71874]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 16:02:35 user nova-compute[71874]:       <source dev="/dev/sdb"/>
Apr 12 16:02:35 user nova-compute[71874]:       <target dev="vda" bus="virtio"/>
Apr 12 16:02:35 user nova-compute[71874]:       <serial>a3ef648d-928f-4687-906e-f415a564fea2</serial>
Apr 12 16:02:35 user nova-compute[71874]:     </disk>
Apr 12 16:02:35 user nova-compute[71874]:     <interface type="ethernet">
Apr 12 16:02:35 user nova-compute[71874]:       <mac address="fa:16:3e:ec:61:14"/>
Apr 12 16:02:35 user nova-compute[71874]:       <model type="virtio"/>
Apr 12 16:02:35 user nova-compute[71874]:       <mtu size="1442"/>
Apr 12 16:02:35 user nova-compute[71874]:       <target dev="tap955511f0-ec"/>
Apr 12 16:02:35 user nova-compute[71874]:     </interface>
Apr 12 16:02:35 user nova-compute[71874]:     <serial type="pty">
Apr 12 16:02:35 user nova-compute[71874]:       <log file="/opt/stack/data/nova/instances/f52ee906-c8fd-4cd5-842e-de98a5099c4f/console.log" append="off"/>
Apr 12 16:02:35 user nova-compute[71874]:     </serial>
Apr 12 16:02:35 user nova-compute[71874]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 16:02:35 user nova-compute[71874]:     <video>
Apr 12 16:02:35 user nova-compute[71874]:       <model type="virtio"/>
Apr 12 16:02:35 user nova-compute[71874]:     </video>
Apr 12 16:02:35 user nova-compute[71874]:     <rng model="virtio">
Apr 12 16:02:35 user nova-compute[71874]:       <backend model="random">/dev/urandom</backend>
Apr 12 16:02:35 user nova-compute[71874]:     </rng>
Apr 12 16:02:35 user nova-compute[71874]:     <controller type="usb" index="0" model="none"/>
Apr 12 16:02:35 user nova-compute[71874]:     <memballoon model="virtio">
Apr 12 16:02:35 user nova-compute[71874]:       <stats period="10"/>
Apr 12 16:02:35 user nova-compute[71874]:     </memballoon>
Apr 12 16:02:35 user nova-compute[71874]:   </devices>
Apr 12 16:02:35 user nova-compute[71874]: </domain>
Apr 12 16:02:35 user nova-compute[71874]:  {{(pid=71874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 16:02:35 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-2f9f654f-f62b-48ca-8866-c4756fbc06b3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T16:02:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2141634890',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2141634890',id=15,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9210f81232304e179d3e09914a492442',ramdisk_id='',reservation_id='r-ny60dh1j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1443944578',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T16:02:23Z,user_data=None,user_id='73f9fa5bc22a4824b3cdcb8cf7bb380c',uuid=f52ee906-c8fd-4cd5-842e-de98a5099c4f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "955511f0-eca8-447d-a105-fdd5f182de62", "address": "fa:16:3e:ec:61:14", "network": {"id": "b36306e0-04c5-4b1b-8022-05ff121c4e43", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1503204786-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9210f81232304e179d3e09914a492442", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap955511f0-ec", "ovs_interfaceid": "955511f0-eca8-447d-a105-fdd5f182de62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 16:02:35 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-2f9f654f-f62b-48ca-8866-c4756fbc06b3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Converting VIF {"id": "955511f0-eca8-447d-a105-fdd5f182de62", "address": "fa:16:3e:ec:61:14", "network": {"id": "b36306e0-04c5-4b1b-8022-05ff121c4e43", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1503204786-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9210f81232304e179d3e09914a492442", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap955511f0-ec", "ovs_interfaceid": "955511f0-eca8-447d-a105-fdd5f182de62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:02:35 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-2f9f654f-f62b-48ca-8866-c4756fbc06b3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:61:14,bridge_name='br-int',has_traffic_filtering=True,id=955511f0-eca8-447d-a105-fdd5f182de62,network=Network(b36306e0-04c5-4b1b-8022-05ff121c4e43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap955511f0-ec') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:02:35 user nova-compute[71874]: DEBUG os_vif [None req-2f9f654f-f62b-48ca-8866-c4756fbc06b3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:61:14,bridge_name='br-int',has_traffic_filtering=True,id=955511f0-eca8-447d-a105-fdd5f182de62,network=Network(b36306e0-04c5-4b1b-8022-05ff121c4e43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap955511f0-ec') {{(pid=71874) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 16:02:35 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:02:35 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:02:35 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 16:02:35 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:02:35 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap955511f0-ec, may_exist=True) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:02:35 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap955511f0-ec, col_values=(('external_ids', {'iface-id': '955511f0-eca8-447d-a105-fdd5f182de62', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ec:61:14', 'vm-uuid': 'f52ee906-c8fd-4cd5-842e-de98a5099c4f'}),)) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:02:35 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:02:35 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:02:35 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:02:35 user nova-compute[71874]: INFO os_vif [None req-2f9f654f-f62b-48ca-8866-c4756fbc06b3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:61:14,bridge_name='br-int',has_traffic_filtering=True,id=955511f0-eca8-447d-a105-fdd5f182de62,network=Network(b36306e0-04c5-4b1b-8022-05ff121c4e43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap955511f0-ec')
Apr 12 16:02:35 user nova-compute[71874]: INFO nova.compute.manager [None req-cbf270ef-0c51-4bbf-9943-bfa7afa5681f tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] [instance: 026ab036-1481-4689-af70-661493e9451c] Took 2.65 seconds to detach 3 volumes for instance.
Apr 12 16:02:35 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-2f9f654f-f62b-48ca-8866-c4756fbc06b3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] No BDM found with device name vda, not building metadata. {{(pid=71874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 16:02:35 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-2f9f654f-f62b-48ca-8866-c4756fbc06b3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] No VIF found with MAC fa:16:3e:ec:61:14, not building metadata {{(pid=71874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 16:02:35 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-cbf270ef-0c51-4bbf-9943-bfa7afa5681f tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:02:35 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-cbf270ef-0c51-4bbf-9943-bfa7afa5681f tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:02:36 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-cbf270ef-0c51-4bbf-9943-bfa7afa5681f tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Inventory has not changed in ProviderTree for provider: 0e94b4c8-cd49-45e4-9133-d36eb4b2456b {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 16:02:36 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-cbf270ef-0c51-4bbf-9943-bfa7afa5681f tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Inventory has not changed for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 16:02:36 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-cbf270ef-0c51-4bbf-9943-bfa7afa5681f tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.377s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:02:36 user nova-compute[71874]: INFO nova.scheduler.client.report [None req-cbf270ef-0c51-4bbf-9943-bfa7afa5681f tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Deleted allocations for instance 026ab036-1481-4689-af70-661493e9451c
Apr 12 16:02:36 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-cbf270ef-0c51-4bbf-9943-bfa7afa5681f tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Lock "026ab036-1481-4689-af70-661493e9451c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 12.546s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:02:36 user nova-compute[71874]: DEBUG nova.network.neutron [-] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Updating instance_info_cache with network_info: [] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:02:36 user nova-compute[71874]: INFO nova.compute.manager [-] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Took 3.30 seconds to deallocate network for instance.
Apr 12 16:02:36 user nova-compute[71874]: DEBUG nova.compute.manager [req-02a4ee7f-6da3-4a50-af23-211c650c02ed req-0306932e-fd08-4b1e-9444-974c4f31977a service nova] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Received event network-vif-deleted-1d70ad7b-92c6-47fa-a411-cef9d6159e90 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:02:36 user nova-compute[71874]: DEBUG nova.compute.manager [req-02a4ee7f-6da3-4a50-af23-211c650c02ed req-0306932e-fd08-4b1e-9444-974c4f31977a service nova] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Received event network-vif-deleted-b85b7f43-1f5d-441a-bf3e-380900194e10 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:02:36 user nova-compute[71874]: DEBUG nova.compute.manager [req-02a4ee7f-6da3-4a50-af23-211c650c02ed req-0306932e-fd08-4b1e-9444-974c4f31977a service nova] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Received event network-vif-deleted-7ae43e60-f63a-448e-9a89-0d6bff272104 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:02:36 user nova-compute[71874]: DEBUG nova.compute.manager [req-02a4ee7f-6da3-4a50-af23-211c650c02ed req-0306932e-fd08-4b1e-9444-974c4f31977a service nova] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Received event network-vif-deleted-f76aae02-12c4-41d6-951a-201330ea7693 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:02:36 user nova-compute[71874]: DEBUG nova.compute.manager [req-02a4ee7f-6da3-4a50-af23-211c650c02ed req-0306932e-fd08-4b1e-9444-974c4f31977a service nova] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Received event network-vif-deleted-c5c4abf8-1b9b-4385-adf7-b34b27a8bc6b {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:02:37 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:02:37 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:02:37 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:02:37 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:02:37 user nova-compute[71874]: DEBUG nova.compute.manager [req-2c80efc7-73cd-4797-aca3-6e541939387c req-64fabd45-4a34-4d62-a873-fb8b42a80e14 service nova] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] Received event network-vif-plugged-955511f0-eca8-447d-a105-fdd5f182de62 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:02:37 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-2c80efc7-73cd-4797-aca3-6e541939387c req-64fabd45-4a34-4d62-a873-fb8b42a80e14 service nova] Acquiring lock "f52ee906-c8fd-4cd5-842e-de98a5099c4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:02:37 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-2c80efc7-73cd-4797-aca3-6e541939387c req-64fabd45-4a34-4d62-a873-fb8b42a80e14 service nova] Lock "f52ee906-c8fd-4cd5-842e-de98a5099c4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:02:37 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-2c80efc7-73cd-4797-aca3-6e541939387c req-64fabd45-4a34-4d62-a873-fb8b42a80e14 service nova] Lock "f52ee906-c8fd-4cd5-842e-de98a5099c4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:02:37 user nova-compute[71874]: DEBUG nova.compute.manager [req-2c80efc7-73cd-4797-aca3-6e541939387c req-64fabd45-4a34-4d62-a873-fb8b42a80e14 service nova] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] No waiting events found dispatching network-vif-plugged-955511f0-eca8-447d-a105-fdd5f182de62 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:02:37 user nova-compute[71874]: WARNING nova.compute.manager [req-2c80efc7-73cd-4797-aca3-6e541939387c req-64fabd45-4a34-4d62-a873-fb8b42a80e14 service nova] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] Received unexpected event network-vif-plugged-955511f0-eca8-447d-a105-fdd5f182de62 for instance with vm_state building and task_state spawning.
Apr 12 16:02:37 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:02:37 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:02:38 user nova-compute[71874]: INFO nova.compute.manager [None req-eb3d82e7-7232-45a5-9d24-542563b8dec1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Took 2.36 seconds to detach 3 volumes for instance.
Apr 12 16:02:39 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-eb3d82e7-7232-45a5-9d24-542563b8dec1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:02:39 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-eb3d82e7-7232-45a5-9d24-542563b8dec1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:02:39 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-eb3d82e7-7232-45a5-9d24-542563b8dec1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Inventory has not changed in ProviderTree for provider: 0e94b4c8-cd49-45e4-9133-d36eb4b2456b {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 16:02:39 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-eb3d82e7-7232-45a5-9d24-542563b8dec1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Inventory has not changed for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 16:02:39 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-eb3d82e7-7232-45a5-9d24-542563b8dec1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.422s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:02:39 user nova-compute[71874]: DEBUG nova.virt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Emitting event <LifecycleEvent: 1681315359.443386, f52ee906-c8fd-4cd5-842e-de98a5099c4f => Resumed> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:02:39 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] VM Resumed (Lifecycle Event)
Apr 12 16:02:39 user nova-compute[71874]: DEBUG nova.compute.manager [None req-2f9f654f-f62b-48ca-8866-c4756fbc06b3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] Instance event wait completed in 0 seconds for  {{(pid=71874) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 16:02:39 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-2f9f654f-f62b-48ca-8866-c4756fbc06b3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] Guest created on hypervisor {{(pid=71874) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 16:02:39 user nova-compute[71874]: INFO nova.virt.libvirt.driver [-] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] Instance spawned successfully.
Apr 12 16:02:39 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-2f9f654f-f62b-48ca-8866-c4756fbc06b3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 16:02:39 user nova-compute[71874]: DEBUG nova.compute.manager [req-583f5c5f-ca2f-43a2-a53c-489c436168b6 req-94ebbc23-b8ef-4983-95e7-8c3d2acc09c0 service nova] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] Received event network-vif-plugged-955511f0-eca8-447d-a105-fdd5f182de62 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:02:39 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-583f5c5f-ca2f-43a2-a53c-489c436168b6 req-94ebbc23-b8ef-4983-95e7-8c3d2acc09c0 service nova] Acquiring lock "f52ee906-c8fd-4cd5-842e-de98a5099c4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:02:39 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-583f5c5f-ca2f-43a2-a53c-489c436168b6 req-94ebbc23-b8ef-4983-95e7-8c3d2acc09c0 service nova] Lock "f52ee906-c8fd-4cd5-842e-de98a5099c4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:02:39 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-583f5c5f-ca2f-43a2-a53c-489c436168b6 req-94ebbc23-b8ef-4983-95e7-8c3d2acc09c0 service nova] Lock "f52ee906-c8fd-4cd5-842e-de98a5099c4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:02:39 user nova-compute[71874]: DEBUG nova.compute.manager [req-583f5c5f-ca2f-43a2-a53c-489c436168b6 req-94ebbc23-b8ef-4983-95e7-8c3d2acc09c0 service nova] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] No waiting events found dispatching network-vif-plugged-955511f0-eca8-447d-a105-fdd5f182de62 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:02:39 user nova-compute[71874]: WARNING nova.compute.manager [req-583f5c5f-ca2f-43a2-a53c-489c436168b6 req-94ebbc23-b8ef-4983-95e7-8c3d2acc09c0 service nova] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] Received unexpected event network-vif-plugged-955511f0-eca8-447d-a105-fdd5f182de62 for instance with vm_state building and task_state spawning.
Apr 12 16:02:39 user nova-compute[71874]: INFO nova.scheduler.client.report [None req-eb3d82e7-7232-45a5-9d24-542563b8dec1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Deleted allocations for instance 9ea56377-20bc-48cc-a248-5fad6db060cb
Apr 12 16:02:39 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:02:39 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-2f9f654f-f62b-48ca-8866-c4756fbc06b3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] Found default for hw_cdrom_bus of ide {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:02:39 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-2f9f654f-f62b-48ca-8866-c4756fbc06b3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] Found default for hw_disk_bus of virtio {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:02:39 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-2f9f654f-f62b-48ca-8866-c4756fbc06b3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] Found default for hw_input_bus of None {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:02:39 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-2f9f654f-f62b-48ca-8866-c4756fbc06b3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] Found default for hw_pointer_model of None {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:02:39 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-2f9f654f-f62b-48ca-8866-c4756fbc06b3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] Found default for hw_video_model of virtio {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:02:39 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-2f9f654f-f62b-48ca-8866-c4756fbc06b3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] Found default for hw_vif_model of virtio {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:02:39 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 16:02:39 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 16:02:39 user nova-compute[71874]: DEBUG nova.virt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Emitting event <LifecycleEvent: 1681315359.444363, f52ee906-c8fd-4cd5-842e-de98a5099c4f => Started> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:02:39 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] VM Started (Lifecycle Event)
Apr 12 16:02:39 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:02:39 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 16:02:39 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 16:02:39 user nova-compute[71874]: INFO nova.compute.manager [None req-2f9f654f-f62b-48ca-8866-c4756fbc06b3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] Took 5.60 seconds to spawn the instance on the hypervisor.
Apr 12 16:02:39 user nova-compute[71874]: DEBUG nova.compute.manager [None req-2f9f654f-f62b-48ca-8866-c4756fbc06b3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:02:40 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-eb3d82e7-7232-45a5-9d24-542563b8dec1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Lock "9ea56377-20bc-48cc-a248-5fad6db060cb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 9.913s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:02:40 user nova-compute[71874]: INFO nova.compute.manager [None req-2f9f654f-f62b-48ca-8866-c4756fbc06b3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] Took 17.73 seconds to build instance.
Apr 12 16:02:40 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-2f9f654f-f62b-48ca-8866-c4756fbc06b3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "f52ee906-c8fd-4cd5-842e-de98a5099c4f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.877s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:02:40 user nova-compute[71874]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681315345.7593207, 026ab036-1481-4689-af70-661493e9451c => Stopped> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:02:40 user nova-compute[71874]: INFO nova.compute.manager [-] [instance: 026ab036-1481-4689-af70-661493e9451c] VM Stopped (Lifecycle Event)
Apr 12 16:02:40 user nova-compute[71874]: DEBUG nova.compute.manager [None req-f8b6ec57-cdca-42fe-810c-001f4217e11f None None] [instance: 026ab036-1481-4689-af70-661493e9451c] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:02:40 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:02:42 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:02:45 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:02:46 user nova-compute[71874]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681315351.91967, 9ea56377-20bc-48cc-a248-5fad6db060cb => Stopped> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:02:46 user nova-compute[71874]: INFO nova.compute.manager [-] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] VM Stopped (Lifecycle Event)
Apr 12 16:02:46 user nova-compute[71874]: DEBUG nova.compute.manager [None req-32c4fa39-8f7e-4d7d-b09d-b1fd2785698e None None] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:02:50 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:02:51 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-5f435b00-6a1b-4899-9150-34d07cc2c5c6 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Acquiring lock "55aff314-eb5e-4752-af9f-a4021e970cac" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:02:51 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-5f435b00-6a1b-4899-9150-34d07cc2c5c6 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Lock "55aff314-eb5e-4752-af9f-a4021e970cac" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:02:51 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-5f435b00-6a1b-4899-9150-34d07cc2c5c6 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Acquiring lock "55aff314-eb5e-4752-af9f-a4021e970cac-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:02:51 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-5f435b00-6a1b-4899-9150-34d07cc2c5c6 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Lock "55aff314-eb5e-4752-af9f-a4021e970cac-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:02:51 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-5f435b00-6a1b-4899-9150-34d07cc2c5c6 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Lock "55aff314-eb5e-4752-af9f-a4021e970cac-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:02:51 user nova-compute[71874]: INFO nova.compute.manager [None req-5f435b00-6a1b-4899-9150-34d07cc2c5c6 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] [instance: 55aff314-eb5e-4752-af9f-a4021e970cac] Terminating instance
Apr 12 16:02:51 user nova-compute[71874]: DEBUG nova.compute.manager [None req-5f435b00-6a1b-4899-9150-34d07cc2c5c6 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] [instance: 55aff314-eb5e-4752-af9f-a4021e970cac] Start destroying the instance on the hypervisor. {{(pid=71874) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 16:02:51 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:02:51 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:02:51 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:02:51 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:02:51 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:02:51 user nova-compute[71874]: DEBUG nova.compute.manager [req-4287e954-c941-41ac-b584-663eb195eccf req-513f7b19-31a5-40ad-b966-c2cc21f33195 service nova] [instance: 55aff314-eb5e-4752-af9f-a4021e970cac] Received event network-vif-unplugged-4a51084d-9fff-4a53-9387-4542bfd6a4a7 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:02:51 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-4287e954-c941-41ac-b584-663eb195eccf req-513f7b19-31a5-40ad-b966-c2cc21f33195 service nova] Acquiring lock "55aff314-eb5e-4752-af9f-a4021e970cac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:02:51 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-4287e954-c941-41ac-b584-663eb195eccf req-513f7b19-31a5-40ad-b966-c2cc21f33195 service nova] Lock "55aff314-eb5e-4752-af9f-a4021e970cac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:02:51 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-4287e954-c941-41ac-b584-663eb195eccf req-513f7b19-31a5-40ad-b966-c2cc21f33195 service nova] Lock "55aff314-eb5e-4752-af9f-a4021e970cac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:02:51 user nova-compute[71874]: DEBUG nova.compute.manager [req-4287e954-c941-41ac-b584-663eb195eccf req-513f7b19-31a5-40ad-b966-c2cc21f33195 service nova] [instance: 55aff314-eb5e-4752-af9f-a4021e970cac] No waiting events found dispatching network-vif-unplugged-4a51084d-9fff-4a53-9387-4542bfd6a4a7 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:02:51 user nova-compute[71874]: DEBUG nova.compute.manager [req-4287e954-c941-41ac-b584-663eb195eccf req-513f7b19-31a5-40ad-b966-c2cc21f33195 service nova] [instance: 55aff314-eb5e-4752-af9f-a4021e970cac] Received event network-vif-unplugged-4a51084d-9fff-4a53-9387-4542bfd6a4a7 for instance with task_state deleting. {{(pid=71874) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 16:02:51 user nova-compute[71874]: INFO nova.virt.libvirt.driver [-] [instance: 55aff314-eb5e-4752-af9f-a4021e970cac] Instance destroyed successfully.
Apr 12 16:02:51 user nova-compute[71874]: DEBUG nova.objects.instance [None req-5f435b00-6a1b-4899-9150-34d07cc2c5c6 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Lazy-loading 'resources' on Instance uuid 55aff314-eb5e-4752-af9f-a4021e970cac {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:02:51 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-5f435b00-6a1b-4899-9150-34d07cc2c5c6 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T15:59:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1331285489',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1331285489',id=7,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEJbHdIj6Qnsbz5sPRJ4ye2dl2IsI8e0vfQ09uKxN501bN+DgkHVMylQpwrl7ZvLZ8swmrO3BjtPpMg/5nOMgbnum5uHS/qZKbdglyI6E6LnkEx0Cctk5Q87Mk68+Dgi4A==',key_name='tempest-keypair-2057580771',keypairs=<?>,launch_index=0,launched_at=2023-04-12T16:00:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8197a98d7ebc4230899aca82b073ab15',ramdisk_id='',reservation_id='r-ncvxejnb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-475014275',owner_user_name='tempest-TaggedAttachmentsTest-475014275-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T16:00:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='324eb9033e62405ca2b322bcb6da9a04',uuid=55aff314-eb5e-4752-af9f-a4021e970cac,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4a51084d-9fff-4a53-9387-4542bfd6a4a7", "address": "fa:16:3e:5a:aa:4d", "network": {"id": "95c64a1b-8b44-403f-8c4c-32730720d7a7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-87023330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8197a98d7ebc4230899aca82b073ab15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a51084d-9f", "ovs_interfaceid": "4a51084d-9fff-4a53-9387-4542bfd6a4a7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 16:02:51 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-5f435b00-6a1b-4899-9150-34d07cc2c5c6 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Converting VIF {"id": "4a51084d-9fff-4a53-9387-4542bfd6a4a7", "address": "fa:16:3e:5a:aa:4d", "network": {"id": "95c64a1b-8b44-403f-8c4c-32730720d7a7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-87023330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8197a98d7ebc4230899aca82b073ab15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a51084d-9f", "ovs_interfaceid": "4a51084d-9fff-4a53-9387-4542bfd6a4a7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:02:51 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-5f435b00-6a1b-4899-9150-34d07cc2c5c6 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5a:aa:4d,bridge_name='br-int',has_traffic_filtering=True,id=4a51084d-9fff-4a53-9387-4542bfd6a4a7,network=Network(95c64a1b-8b44-403f-8c4c-32730720d7a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a51084d-9f') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:02:51 user nova-compute[71874]: DEBUG os_vif [None req-5f435b00-6a1b-4899-9150-34d07cc2c5c6 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5a:aa:4d,bridge_name='br-int',has_traffic_filtering=True,id=4a51084d-9fff-4a53-9387-4542bfd6a4a7,network=Network(95c64a1b-8b44-403f-8c4c-32730720d7a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a51084d-9f') {{(pid=71874) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 16:02:51 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:02:51 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4a51084d-9f, bridge=br-int, if_exists=True) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:02:51 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:02:52 user nova-compute[71874]: INFO os_vif [None req-5f435b00-6a1b-4899-9150-34d07cc2c5c6 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5a:aa:4d,bridge_name='br-int',has_traffic_filtering=True,id=4a51084d-9fff-4a53-9387-4542bfd6a4a7,network=Network(95c64a1b-8b44-403f-8c4c-32730720d7a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a51084d-9f')
Apr 12 16:02:52 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-5f435b00-6a1b-4899-9150-34d07cc2c5c6 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] [instance: 55aff314-eb5e-4752-af9f-a4021e970cac] Deleting instance files /opt/stack/data/nova/instances/55aff314-eb5e-4752-af9f-a4021e970cac_del
Apr 12 16:02:52 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-5f435b00-6a1b-4899-9150-34d07cc2c5c6 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] [instance: 55aff314-eb5e-4752-af9f-a4021e970cac] Deletion of /opt/stack/data/nova/instances/55aff314-eb5e-4752-af9f-a4021e970cac_del complete
Apr 12 16:02:52 user nova-compute[71874]: INFO nova.compute.manager [None req-5f435b00-6a1b-4899-9150-34d07cc2c5c6 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] [instance: 55aff314-eb5e-4752-af9f-a4021e970cac] Took 0.85 seconds to destroy the instance on the hypervisor.
Apr 12 16:02:52 user nova-compute[71874]: DEBUG oslo.service.loopingcall [None req-5f435b00-6a1b-4899-9150-34d07cc2c5c6 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71874) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 16:02:52 user nova-compute[71874]: DEBUG nova.compute.manager [-] [instance: 55aff314-eb5e-4752-af9f-a4021e970cac] Deallocating network for instance {{(pid=71874) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 16:02:52 user nova-compute[71874]: DEBUG nova.network.neutron [-] [instance: 55aff314-eb5e-4752-af9f-a4021e970cac] deallocate_for_instance() {{(pid=71874) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 16:02:52 user nova-compute[71874]: DEBUG nova.network.neutron [-] [instance: 55aff314-eb5e-4752-af9f-a4021e970cac] Updating instance_info_cache with network_info: [] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:02:52 user nova-compute[71874]: INFO nova.compute.manager [-] [instance: 55aff314-eb5e-4752-af9f-a4021e970cac] Took 0.79 seconds to deallocate network for instance.
Apr 12 16:02:52 user nova-compute[71874]: DEBUG nova.compute.manager [req-98404061-31b7-4104-bb72-5226e3e41083 req-008fffcc-0f96-474e-8754-8a52fcdf0b9f service nova] [instance: 55aff314-eb5e-4752-af9f-a4021e970cac] Received event network-vif-deleted-4a51084d-9fff-4a53-9387-4542bfd6a4a7 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:02:52 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-5f435b00-6a1b-4899-9150-34d07cc2c5c6 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:02:52 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-5f435b00-6a1b-4899-9150-34d07cc2c5c6 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:02:53 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-f958eef3-48e5-4601-83fb-2ecb7c81d669 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Acquiring lock "2285eef6-6613-4802-a988-3fae065fa92d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:02:53 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-f958eef3-48e5-4601-83fb-2ecb7c81d669 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Lock "2285eef6-6613-4802-a988-3fae065fa92d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:02:53 user nova-compute[71874]: DEBUG nova.compute.manager [None req-f958eef3-48e5-4601-83fb-2ecb7c81d669 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] [instance: 2285eef6-6613-4802-a988-3fae065fa92d] Starting instance... {{(pid=71874) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 16:02:53 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-f958eef3-48e5-4601-83fb-2ecb7c81d669 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:02:53 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-5f435b00-6a1b-4899-9150-34d07cc2c5c6 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Inventory has not changed in ProviderTree for provider: 0e94b4c8-cd49-45e4-9133-d36eb4b2456b {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 16:02:53 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-5f435b00-6a1b-4899-9150-34d07cc2c5c6 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Inventory has not changed for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 16:02:53 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-5f435b00-6a1b-4899-9150-34d07cc2c5c6 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.427s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:02:53 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-f958eef3-48e5-4601-83fb-2ecb7c81d669 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.094s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:02:53 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-f958eef3-48e5-4601-83fb-2ecb7c81d669 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71874) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 16:02:53 user nova-compute[71874]: INFO nova.compute.claims [None req-f958eef3-48e5-4601-83fb-2ecb7c81d669 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] [instance: 2285eef6-6613-4802-a988-3fae065fa92d] Claim successful on node user
Apr 12 16:02:53 user nova-compute[71874]: INFO nova.scheduler.client.report [None req-5f435b00-6a1b-4899-9150-34d07cc2c5c6 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Deleted allocations for instance 55aff314-eb5e-4752-af9f-a4021e970cac
Apr 12 16:02:53 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-5f435b00-6a1b-4899-9150-34d07cc2c5c6 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Lock "55aff314-eb5e-4752-af9f-a4021e970cac" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.240s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:02:53 user nova-compute[71874]: DEBUG nova.compute.manager [req-bf0daa3f-7e45-4513-a30f-f59371fa814f req-74ee7d8c-30b6-4a8b-8c13-3b79442c36d0 service nova] [instance: 55aff314-eb5e-4752-af9f-a4021e970cac] Received event network-vif-plugged-4a51084d-9fff-4a53-9387-4542bfd6a4a7 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:02:53 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-bf0daa3f-7e45-4513-a30f-f59371fa814f req-74ee7d8c-30b6-4a8b-8c13-3b79442c36d0 service nova] Acquiring lock "55aff314-eb5e-4752-af9f-a4021e970cac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:02:53 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-bf0daa3f-7e45-4513-a30f-f59371fa814f req-74ee7d8c-30b6-4a8b-8c13-3b79442c36d0 service nova] Lock "55aff314-eb5e-4752-af9f-a4021e970cac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:02:53 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-bf0daa3f-7e45-4513-a30f-f59371fa814f req-74ee7d8c-30b6-4a8b-8c13-3b79442c36d0 service nova] Lock "55aff314-eb5e-4752-af9f-a4021e970cac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:02:53 user nova-compute[71874]: DEBUG nova.compute.manager [req-bf0daa3f-7e45-4513-a30f-f59371fa814f req-74ee7d8c-30b6-4a8b-8c13-3b79442c36d0 service nova] [instance: 55aff314-eb5e-4752-af9f-a4021e970cac] No waiting events found dispatching network-vif-plugged-4a51084d-9fff-4a53-9387-4542bfd6a4a7 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:02:53 user nova-compute[71874]: WARNING nova.compute.manager [req-bf0daa3f-7e45-4513-a30f-f59371fa814f req-74ee7d8c-30b6-4a8b-8c13-3b79442c36d0 service nova] [instance: 55aff314-eb5e-4752-af9f-a4021e970cac] Received unexpected event network-vif-plugged-4a51084d-9fff-4a53-9387-4542bfd6a4a7 for instance with vm_state deleted and task_state None.
Apr 12 16:02:53 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-f958eef3-48e5-4601-83fb-2ecb7c81d669 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Inventory has not changed in ProviderTree for provider: 0e94b4c8-cd49-45e4-9133-d36eb4b2456b {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 16:02:53 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-f958eef3-48e5-4601-83fb-2ecb7c81d669 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Inventory has not changed for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 16:02:53 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-f958eef3-48e5-4601-83fb-2ecb7c81d669 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.346s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:02:53 user nova-compute[71874]: DEBUG nova.compute.manager [None req-f958eef3-48e5-4601-83fb-2ecb7c81d669 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] [instance: 2285eef6-6613-4802-a988-3fae065fa92d] Start building networks asynchronously for instance. {{(pid=71874) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 16:02:53 user nova-compute[71874]: DEBUG nova.compute.manager [None req-f958eef3-48e5-4601-83fb-2ecb7c81d669 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] [instance: 2285eef6-6613-4802-a988-3fae065fa92d] Allocating IP information in the background. {{(pid=71874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 16:02:53 user nova-compute[71874]: DEBUG nova.network.neutron [None req-f958eef3-48e5-4601-83fb-2ecb7c81d669 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] [instance: 2285eef6-6613-4802-a988-3fae065fa92d] allocate_for_instance() {{(pid=71874) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 16:02:53 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-f958eef3-48e5-4601-83fb-2ecb7c81d669 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] [instance: 2285eef6-6613-4802-a988-3fae065fa92d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 16:02:53 user nova-compute[71874]: DEBUG nova.compute.manager [None req-f958eef3-48e5-4601-83fb-2ecb7c81d669 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] [instance: 2285eef6-6613-4802-a988-3fae065fa92d] Start building block device mappings for instance. {{(pid=71874) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 16:02:53 user nova-compute[71874]: DEBUG nova.policy [None req-f958eef3-48e5-4601-83fb-2ecb7c81d669 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c5d01dd905404e4aa08a31f25fa53338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bde51ff8bde4dcdb14fcda0fc92d564', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71874) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 16:02:53 user nova-compute[71874]: DEBUG nova.compute.manager [None req-f958eef3-48e5-4601-83fb-2ecb7c81d669 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] [instance: 2285eef6-6613-4802-a988-3fae065fa92d] Start spawning the instance on the hypervisor. {{(pid=71874) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 16:02:53 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-f958eef3-48e5-4601-83fb-2ecb7c81d669 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] [instance: 2285eef6-6613-4802-a988-3fae065fa92d] Creating instance directory {{(pid=71874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 16:02:53 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-f958eef3-48e5-4601-83fb-2ecb7c81d669 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] [instance: 2285eef6-6613-4802-a988-3fae065fa92d] Creating image(s)
Apr 12 16:02:53 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-f958eef3-48e5-4601-83fb-2ecb7c81d669 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Acquiring lock "/opt/stack/data/nova/instances/2285eef6-6613-4802-a988-3fae065fa92d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:02:53 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-f958eef3-48e5-4601-83fb-2ecb7c81d669 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Lock "/opt/stack/data/nova/instances/2285eef6-6613-4802-a988-3fae065fa92d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:02:53 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-f958eef3-48e5-4601-83fb-2ecb7c81d669 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Lock "/opt/stack/data/nova/instances/2285eef6-6613-4802-a988-3fae065fa92d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.013s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:02:53 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-f958eef3-48e5-4601-83fb-2ecb7c81d669 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:54 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-f958eef3-48e5-4601-83fb-2ecb7c81d669 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json" returned: 0 in 0.131s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:54 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-f958eef3-48e5-4601-83fb-2ecb7c81d669 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Acquiring lock "b88df1b37cb431f52bc53b5616015c89b5bec411" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:02:54 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-f958eef3-48e5-4601-83fb-2ecb7c81d669 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Lock "b88df1b37cb431f52bc53b5616015c89b5bec411" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:02:54 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-f958eef3-48e5-4601-83fb-2ecb7c81d669 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:54 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-f958eef3-48e5-4601-83fb-2ecb7c81d669 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json" returned: 0 in 0.168s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:54 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-f958eef3-48e5-4601-83fb-2ecb7c81d669 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411,backing_fmt=raw /opt/stack/data/nova/instances/2285eef6-6613-4802-a988-3fae065fa92d/disk 1073741824 {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:54 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-f958eef3-48e5-4601-83fb-2ecb7c81d669 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411,backing_fmt=raw /opt/stack/data/nova/instances/2285eef6-6613-4802-a988-3fae065fa92d/disk 1073741824" returned: 0 in 0.067s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:54 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-f958eef3-48e5-4601-83fb-2ecb7c81d669 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Lock "b88df1b37cb431f52bc53b5616015c89b5bec411" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:02:54 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-f958eef3-48e5-4601-83fb-2ecb7c81d669 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:54 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-f958eef3-48e5-4601-83fb-2ecb7c81d669 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json" returned: 0 in 0.129s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:54 user nova-compute[71874]: DEBUG nova.virt.disk.api [None req-f958eef3-48e5-4601-83fb-2ecb7c81d669 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2285eef6-6613-4802-a988-3fae065fa92d/disk. size=1073741824 {{(pid=71874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 16:02:54 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-f958eef3-48e5-4601-83fb-2ecb7c81d669 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2285eef6-6613-4802-a988-3fae065fa92d/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:02:54 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-f958eef3-48e5-4601-83fb-2ecb7c81d669 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2285eef6-6613-4802-a988-3fae065fa92d/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:02:54 user nova-compute[71874]: DEBUG nova.virt.disk.api [None req-f958eef3-48e5-4601-83fb-2ecb7c81d669 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Cannot resize image /opt/stack/data/nova/instances/2285eef6-6613-4802-a988-3fae065fa92d/disk to a smaller size. {{(pid=71874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 16:02:54 user nova-compute[71874]: DEBUG nova.objects.instance [None req-f958eef3-48e5-4601-83fb-2ecb7c81d669 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Lazy-loading 'migration_context' on Instance uuid 2285eef6-6613-4802-a988-3fae065fa92d {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:02:54 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-f958eef3-48e5-4601-83fb-2ecb7c81d669 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] [instance: 2285eef6-6613-4802-a988-3fae065fa92d] Created local disks {{(pid=71874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 16:02:54 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-f958eef3-48e5-4601-83fb-2ecb7c81d669 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] [instance: 2285eef6-6613-4802-a988-3fae065fa92d] Ensure instance console log exists: /opt/stack/data/nova/instances/2285eef6-6613-4802-a988-3fae065fa92d/console.log {{(pid=71874) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 16:02:54 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-f958eef3-48e5-4601-83fb-2ecb7c81d669 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:02:54 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-f958eef3-48e5-4601-83fb-2ecb7c81d669 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:02:54 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-f958eef3-48e5-4601-83fb-2ecb7c81d669 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:02:54 user nova-compute[71874]: DEBUG nova.network.neutron [None req-f958eef3-48e5-4601-83fb-2ecb7c81d669 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] [instance: 2285eef6-6613-4802-a988-3fae065fa92d] Successfully created port: 56615a48-49c1-42dd-8326-5806056ea7cf {{(pid=71874) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 16:02:55 user nova-compute[71874]: DEBUG nova.network.neutron [None req-f958eef3-48e5-4601-83fb-2ecb7c81d669 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] [instance: 2285eef6-6613-4802-a988-3fae065fa92d] Successfully updated port: 56615a48-49c1-42dd-8326-5806056ea7cf {{(pid=71874) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 16:02:55 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-f958eef3-48e5-4601-83fb-2ecb7c81d669 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Acquiring lock "refresh_cache-2285eef6-6613-4802-a988-3fae065fa92d" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:02:55 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-f958eef3-48e5-4601-83fb-2ecb7c81d669 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Acquired lock "refresh_cache-2285eef6-6613-4802-a988-3fae065fa92d" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:02:55 user nova-compute[71874]: DEBUG nova.network.neutron [None req-f958eef3-48e5-4601-83fb-2ecb7c81d669 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] [instance: 2285eef6-6613-4802-a988-3fae065fa92d] Building network info cache for instance {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 16:02:55 user nova-compute[71874]: DEBUG nova.compute.manager [req-cd8348d7-4706-436f-b1b7-bb97c1c60e51 req-373e6f90-6ec1-4766-94e0-b5cf72a52fbf service nova] [instance: 2285eef6-6613-4802-a988-3fae065fa92d] Received event network-changed-56615a48-49c1-42dd-8326-5806056ea7cf {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:02:55 user nova-compute[71874]: DEBUG nova.compute.manager [req-cd8348d7-4706-436f-b1b7-bb97c1c60e51 req-373e6f90-6ec1-4766-94e0-b5cf72a52fbf service nova] [instance: 2285eef6-6613-4802-a988-3fae065fa92d] Refreshing instance network info cache due to event network-changed-56615a48-49c1-42dd-8326-5806056ea7cf. {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 16:02:55 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-cd8348d7-4706-436f-b1b7-bb97c1c60e51 req-373e6f90-6ec1-4766-94e0-b5cf72a52fbf service nova] Acquiring lock "refresh_cache-2285eef6-6613-4802-a988-3fae065fa92d" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:02:55 user nova-compute[71874]: DEBUG nova.network.neutron [None req-f958eef3-48e5-4601-83fb-2ecb7c81d669 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] [instance: 2285eef6-6613-4802-a988-3fae065fa92d] Instance cache missing network info. {{(pid=71874) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 16:02:55 user nova-compute[71874]: DEBUG nova.network.neutron [None req-f958eef3-48e5-4601-83fb-2ecb7c81d669 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] [instance: 2285eef6-6613-4802-a988-3fae065fa92d] Updating instance_info_cache with network_info: [{"id": "56615a48-49c1-42dd-8326-5806056ea7cf", "address": "fa:16:3e:92:c0:85", "network": {"id": "33052061-3a43-449e-b742-4ffa29dfc039", "bridge": "br-int", "label": "tempest-VolumesActionsTest-564180421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "1bde51ff8bde4dcdb14fcda0fc92d564", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56615a48-49", "ovs_interfaceid": "56615a48-49c1-42dd-8326-5806056ea7cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:02:55 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-f958eef3-48e5-4601-83fb-2ecb7c81d669 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Releasing lock "refresh_cache-2285eef6-6613-4802-a988-3fae065fa92d" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:02:55 user nova-compute[71874]: DEBUG nova.compute.manager [None req-f958eef3-48e5-4601-83fb-2ecb7c81d669 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] [instance: 2285eef6-6613-4802-a988-3fae065fa92d] Instance network_info: |[{"id": "56615a48-49c1-42dd-8326-5806056ea7cf", "address": "fa:16:3e:92:c0:85", "network": {"id": "33052061-3a43-449e-b742-4ffa29dfc039", "bridge": "br-int", "label": "tempest-VolumesActionsTest-564180421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "1bde51ff8bde4dcdb14fcda0fc92d564", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56615a48-49", "ovs_interfaceid": "56615a48-49c1-42dd-8326-5806056ea7cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 16:02:55 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-cd8348d7-4706-436f-b1b7-bb97c1c60e51 req-373e6f90-6ec1-4766-94e0-b5cf72a52fbf service nova] Acquired lock "refresh_cache-2285eef6-6613-4802-a988-3fae065fa92d" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:02:55 user nova-compute[71874]: DEBUG nova.network.neutron [req-cd8348d7-4706-436f-b1b7-bb97c1c60e51 req-373e6f90-6ec1-4766-94e0-b5cf72a52fbf service nova] [instance: 2285eef6-6613-4802-a988-3fae065fa92d] Refreshing network info cache for port 56615a48-49c1-42dd-8326-5806056ea7cf {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 16:02:55 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-f958eef3-48e5-4601-83fb-2ecb7c81d669 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] [instance: 2285eef6-6613-4802-a988-3fae065fa92d] Start _get_guest_xml network_info=[{"id": "56615a48-49c1-42dd-8326-5806056ea7cf", "address": "fa:16:3e:92:c0:85", "network": {"id": "33052061-3a43-449e-b742-4ffa29dfc039", "bridge": "br-int", "label": "tempest-VolumesActionsTest-564180421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "1bde51ff8bde4dcdb14fcda0fc92d564", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56615a48-49", "ovs_interfaceid": "56615a48-49c1-42dd-8326-5806056ea7cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T15:55:37Z,direct_url=<?>,disk_format='qcow2',id=9dc63f14-8b70-4e72-89f2-13464f2f5c7c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='61a4936d9b7744c0b488d81c9b7746b6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T15:55:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_options': None, 'image_id': '9dc63f14-8b70-4e72-89f2-13464f2f5c7c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 16:02:55 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-f958eef3-48e5-4601-83fb-2ecb7c81d669 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:02:55 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-f958eef3-48e5-4601-83fb-2ecb7c81d669 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:02:55 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-f958eef3-48e5-4601-83fb-2ecb7c81d669 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71874) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 16:02:55 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-f958eef3-48e5-4601-83fb-2ecb7c81d669 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T15:56:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T15:55:37Z,direct_url=<?>,disk_format='qcow2',id=9dc63f14-8b70-4e72-89f2-13464f2f5c7c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='61a4936d9b7744c0b488d81c9b7746b6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T15:55:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 16:02:55 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-f958eef3-48e5-4601-83fb-2ecb7c81d669 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Flavor limits 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 16:02:55 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-f958eef3-48e5-4601-83fb-2ecb7c81d669 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Image limits 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 16:02:55 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-f958eef3-48e5-4601-83fb-2ecb7c81d669 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Flavor pref 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 16:02:55 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-f958eef3-48e5-4601-83fb-2ecb7c81d669 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Image pref 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 16:02:55 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-f958eef3-48e5-4601-83fb-2ecb7c81d669 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 16:02:55 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-f958eef3-48e5-4601-83fb-2ecb7c81d669 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 16:02:55 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-f958eef3-48e5-4601-83fb-2ecb7c81d669 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 16:02:55 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-f958eef3-48e5-4601-83fb-2ecb7c81d669 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Got 1 possible topologies {{(pid=71874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 16:02:55 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-f958eef3-48e5-4601-83fb-2ecb7c81d669 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 16:02:55 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-f958eef3-48e5-4601-83fb-2ecb7c81d669 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 16:02:55 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-f958eef3-48e5-4601-83fb-2ecb7c81d669 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T16:02:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1401858867',display_name='tempest-VolumesActionsTest-instance-1401858867',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1401858867',id=16,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1bde51ff8bde4dcdb14fcda0fc92d564',ramdisk_id='',reservation_id='r-9env1k09',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-104284977',owner_user_name='tempest-VolumesActionsTest-104284977-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T16:02:54Z,user_data=None,user_id='c5d01dd905404e4aa08a31f25fa53338',uuid=2285eef6-6613-4802-a988-3fae065fa92d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "56615a48-49c1-42dd-8326-5806056ea7cf", "address": "fa:16:3e:92:c0:85", "network": {"id": "33052061-3a43-449e-b742-4ffa29dfc039", "bridge": "br-int", "label": "tempest-VolumesActionsTest-564180421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "1bde51ff8bde4dcdb14fcda0fc92d564", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56615a48-49", "ovs_interfaceid": "56615a48-49c1-42dd-8326-5806056ea7cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 16:02:55 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-f958eef3-48e5-4601-83fb-2ecb7c81d669 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Converting VIF {"id": "56615a48-49c1-42dd-8326-5806056ea7cf", "address": "fa:16:3e:92:c0:85", "network": {"id": "33052061-3a43-449e-b742-4ffa29dfc039", "bridge": "br-int", "label": "tempest-VolumesActionsTest-564180421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "1bde51ff8bde4dcdb14fcda0fc92d564", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56615a48-49", "ovs_interfaceid": "56615a48-49c1-42dd-8326-5806056ea7cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:02:55 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-f958eef3-48e5-4601-83fb-2ecb7c81d669 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:c0:85,bridge_name='br-int',has_traffic_filtering=True,id=56615a48-49c1-42dd-8326-5806056ea7cf,network=Network(33052061-3a43-449e-b742-4ffa29dfc039),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56615a48-49') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:02:55 user nova-compute[71874]: DEBUG nova.objects.instance [None req-f958eef3-48e5-4601-83fb-2ecb7c81d669 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Lazy-loading 'pci_devices' on Instance uuid 2285eef6-6613-4802-a988-3fae065fa92d {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:02:55 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-f958eef3-48e5-4601-83fb-2ecb7c81d669 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] [instance: 2285eef6-6613-4802-a988-3fae065fa92d] End _get_guest_xml xml=<domain type="kvm">
Apr 12 16:02:55 user nova-compute[71874]:   <uuid>2285eef6-6613-4802-a988-3fae065fa92d</uuid>
Apr 12 16:02:55 user nova-compute[71874]:   <name>instance-00000010</name>
Apr 12 16:02:55 user nova-compute[71874]:   <memory>131072</memory>
Apr 12 16:02:55 user nova-compute[71874]:   <vcpu>1</vcpu>
Apr 12 16:02:55 user nova-compute[71874]:   <metadata>
Apr 12 16:02:55 user nova-compute[71874]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 16:02:55 user nova-compute[71874]:       <nova:package version="0.0.0"/>
Apr 12 16:02:55 user nova-compute[71874]:       <nova:name>tempest-VolumesActionsTest-instance-1401858867</nova:name>
Apr 12 16:02:55 user nova-compute[71874]:       <nova:creationTime>2023-04-12 16:02:55</nova:creationTime>
Apr 12 16:02:55 user nova-compute[71874]:       <nova:flavor name="m1.nano">
Apr 12 16:02:55 user nova-compute[71874]:         <nova:memory>128</nova:memory>
Apr 12 16:02:55 user nova-compute[71874]:         <nova:disk>1</nova:disk>
Apr 12 16:02:55 user nova-compute[71874]:         <nova:swap>0</nova:swap>
Apr 12 16:02:55 user nova-compute[71874]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 16:02:55 user nova-compute[71874]:         <nova:vcpus>1</nova:vcpus>
Apr 12 16:02:55 user nova-compute[71874]:       </nova:flavor>
Apr 12 16:02:55 user nova-compute[71874]:       <nova:owner>
Apr 12 16:02:55 user nova-compute[71874]:         <nova:user uuid="c5d01dd905404e4aa08a31f25fa53338">tempest-VolumesActionsTest-104284977-project-member</nova:user>
Apr 12 16:02:55 user nova-compute[71874]:         <nova:project uuid="1bde51ff8bde4dcdb14fcda0fc92d564">tempest-VolumesActionsTest-104284977</nova:project>
Apr 12 16:02:55 user nova-compute[71874]:       </nova:owner>
Apr 12 16:02:55 user nova-compute[71874]:       <nova:root type="image" uuid="9dc63f14-8b70-4e72-89f2-13464f2f5c7c"/>
Apr 12 16:02:55 user nova-compute[71874]:       <nova:ports>
Apr 12 16:02:55 user nova-compute[71874]:         <nova:port uuid="56615a48-49c1-42dd-8326-5806056ea7cf">
Apr 12 16:02:55 user nova-compute[71874]:           <nova:ip type="fixed" address="10.0.0.2" ipVersion="4"/>
Apr 12 16:02:55 user nova-compute[71874]:         </nova:port>
Apr 12 16:02:55 user nova-compute[71874]:       </nova:ports>
Apr 12 16:02:55 user nova-compute[71874]:     </nova:instance>
Apr 12 16:02:55 user nova-compute[71874]:   </metadata>
Apr 12 16:02:55 user nova-compute[71874]:   <sysinfo type="smbios">
Apr 12 16:02:55 user nova-compute[71874]:     <system>
Apr 12 16:02:55 user nova-compute[71874]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 16:02:55 user nova-compute[71874]:       <entry name="product">OpenStack Nova</entry>
Apr 12 16:02:55 user nova-compute[71874]:       <entry name="version">0.0.0</entry>
Apr 12 16:02:55 user nova-compute[71874]:       <entry name="serial">2285eef6-6613-4802-a988-3fae065fa92d</entry>
Apr 12 16:02:55 user nova-compute[71874]:       <entry name="uuid">2285eef6-6613-4802-a988-3fae065fa92d</entry>
Apr 12 16:02:55 user nova-compute[71874]:       <entry name="family">Virtual Machine</entry>
Apr 12 16:02:55 user nova-compute[71874]:     </system>
Apr 12 16:02:55 user nova-compute[71874]:   </sysinfo>
Apr 12 16:02:55 user nova-compute[71874]:   <os>
Apr 12 16:02:55 user nova-compute[71874]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 16:02:55 user nova-compute[71874]:     <boot dev="hd"/>
Apr 12 16:02:55 user nova-compute[71874]:     <smbios mode="sysinfo"/>
Apr 12 16:02:55 user nova-compute[71874]:   </os>
Apr 12 16:02:55 user nova-compute[71874]:   <features>
Apr 12 16:02:55 user nova-compute[71874]:     <acpi/>
Apr 12 16:02:55 user nova-compute[71874]:     <apic/>
Apr 12 16:02:55 user nova-compute[71874]:     <vmcoreinfo/>
Apr 12 16:02:55 user nova-compute[71874]:   </features>
Apr 12 16:02:55 user nova-compute[71874]:   <clock offset="utc">
Apr 12 16:02:55 user nova-compute[71874]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 16:02:55 user nova-compute[71874]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 16:02:55 user nova-compute[71874]:     <timer name="hpet" present="no"/>
Apr 12 16:02:55 user nova-compute[71874]:   </clock>
Apr 12 16:02:55 user nova-compute[71874]:   <cpu mode="custom" match="exact">
Apr 12 16:02:55 user nova-compute[71874]:     <model>Nehalem</model>
Apr 12 16:02:55 user nova-compute[71874]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 16:02:55 user nova-compute[71874]:   </cpu>
Apr 12 16:02:55 user nova-compute[71874]:   <devices>
Apr 12 16:02:55 user nova-compute[71874]:     <disk type="file" device="disk">
Apr 12 16:02:55 user nova-compute[71874]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 16:02:55 user nova-compute[71874]:       <source file="/opt/stack/data/nova/instances/2285eef6-6613-4802-a988-3fae065fa92d/disk"/>
Apr 12 16:02:55 user nova-compute[71874]:       <target dev="vda" bus="virtio"/>
Apr 12 16:02:55 user nova-compute[71874]:     </disk>
Apr 12 16:02:55 user nova-compute[71874]:     <interface type="ethernet">
Apr 12 16:02:55 user nova-compute[71874]:       <mac address="fa:16:3e:92:c0:85"/>
Apr 12 16:02:55 user nova-compute[71874]:       <model type="virtio"/>
Apr 12 16:02:55 user nova-compute[71874]:       <mtu size="1442"/>
Apr 12 16:02:55 user nova-compute[71874]:       <target dev="tap56615a48-49"/>
Apr 12 16:02:55 user nova-compute[71874]:     </interface>
Apr 12 16:02:55 user nova-compute[71874]:     <serial type="pty">
Apr 12 16:02:55 user nova-compute[71874]:       <log file="/opt/stack/data/nova/instances/2285eef6-6613-4802-a988-3fae065fa92d/console.log" append="off"/>
Apr 12 16:02:55 user nova-compute[71874]:     </serial>
Apr 12 16:02:55 user nova-compute[71874]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 16:02:55 user nova-compute[71874]:     <video>
Apr 12 16:02:55 user nova-compute[71874]:       <model type="virtio"/>
Apr 12 16:02:55 user nova-compute[71874]:     </video>
Apr 12 16:02:55 user nova-compute[71874]:     <rng model="virtio">
Apr 12 16:02:55 user nova-compute[71874]:       <backend model="random">/dev/urandom</backend>
Apr 12 16:02:55 user nova-compute[71874]:     </rng>
Apr 12 16:02:55 user nova-compute[71874]:     <controller type="usb" index="0" model="none"/>
Apr 12 16:02:55 user nova-compute[71874]:     <memballoon model="virtio">
Apr 12 16:02:55 user nova-compute[71874]:       <stats period="10"/>
Apr 12 16:02:55 user nova-compute[71874]:     </memballoon>
Apr 12 16:02:55 user nova-compute[71874]:   </devices>
Apr 12 16:02:55 user nova-compute[71874]: </domain>
Apr 12 16:02:55 user nova-compute[71874]:  {{(pid=71874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 16:02:55 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-f958eef3-48e5-4601-83fb-2ecb7c81d669 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T16:02:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1401858867',display_name='tempest-VolumesActionsTest-instance-1401858867',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1401858867',id=16,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1bde51ff8bde4dcdb14fcda0fc92d564',ramdisk_id='',reservation_id='r-9env1k09',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-104284977',owner_user_name='tempest-VolumesActionsTest-104284977-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T16:02:54Z,user_data=None,user_id='c5d01dd905404e4aa08a31f25fa53338',uuid=2285eef6-6613-4802-a988-3fae065fa92d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "56615a48-49c1-42dd-8326-5806056ea7cf", "address": "fa:16:3e:92:c0:85", "network": {"id": "33052061-3a43-449e-b742-4ffa29dfc039", "bridge": "br-int", "label": "tempest-VolumesActionsTest-564180421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "1bde51ff8bde4dcdb14fcda0fc92d564", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56615a48-49", "ovs_interfaceid": "56615a48-49c1-42dd-8326-5806056ea7cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 16:02:55 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-f958eef3-48e5-4601-83fb-2ecb7c81d669 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Converting VIF {"id": "56615a48-49c1-42dd-8326-5806056ea7cf", "address": "fa:16:3e:92:c0:85", "network": {"id": "33052061-3a43-449e-b742-4ffa29dfc039", "bridge": "br-int", "label": "tempest-VolumesActionsTest-564180421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "1bde51ff8bde4dcdb14fcda0fc92d564", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56615a48-49", "ovs_interfaceid": "56615a48-49c1-42dd-8326-5806056ea7cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:02:55 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-f958eef3-48e5-4601-83fb-2ecb7c81d669 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:c0:85,bridge_name='br-int',has_traffic_filtering=True,id=56615a48-49c1-42dd-8326-5806056ea7cf,network=Network(33052061-3a43-449e-b742-4ffa29dfc039),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56615a48-49') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:02:55 user nova-compute[71874]: DEBUG os_vif [None req-f958eef3-48e5-4601-83fb-2ecb7c81d669 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:c0:85,bridge_name='br-int',has_traffic_filtering=True,id=56615a48-49c1-42dd-8326-5806056ea7cf,network=Network(33052061-3a43-449e-b742-4ffa29dfc039),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56615a48-49') {{(pid=71874) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 16:02:55 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:02:55 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:02:55 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 16:02:55 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:02:55 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap56615a48-49, may_exist=True) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:02:55 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap56615a48-49, col_values=(('external_ids', {'iface-id': '56615a48-49c1-42dd-8326-5806056ea7cf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:92:c0:85', 'vm-uuid': '2285eef6-6613-4802-a988-3fae065fa92d'}),)) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:02:55 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:02:55 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:02:55 user nova-compute[71874]: INFO os_vif [None req-f958eef3-48e5-4601-83fb-2ecb7c81d669 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:c0:85,bridge_name='br-int',has_traffic_filtering=True,id=56615a48-49c1-42dd-8326-5806056ea7cf,network=Network(33052061-3a43-449e-b742-4ffa29dfc039),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56615a48-49')
Apr 12 16:02:55 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-f958eef3-48e5-4601-83fb-2ecb7c81d669 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] No BDM found with device name vda, not building metadata. {{(pid=71874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 16:02:55 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-f958eef3-48e5-4601-83fb-2ecb7c81d669 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] No VIF found with MAC fa:16:3e:92:c0:85, not building metadata {{(pid=71874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 16:02:56 user nova-compute[71874]: DEBUG nova.network.neutron [req-cd8348d7-4706-436f-b1b7-bb97c1c60e51 req-373e6f90-6ec1-4766-94e0-b5cf72a52fbf service nova] [instance: 2285eef6-6613-4802-a988-3fae065fa92d] Updated VIF entry in instance network info cache for port 56615a48-49c1-42dd-8326-5806056ea7cf. {{(pid=71874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 16:02:56 user nova-compute[71874]: DEBUG nova.network.neutron [req-cd8348d7-4706-436f-b1b7-bb97c1c60e51 req-373e6f90-6ec1-4766-94e0-b5cf72a52fbf service nova] [instance: 2285eef6-6613-4802-a988-3fae065fa92d] Updating instance_info_cache with network_info: [{"id": "56615a48-49c1-42dd-8326-5806056ea7cf", "address": "fa:16:3e:92:c0:85", "network": {"id": "33052061-3a43-449e-b742-4ffa29dfc039", "bridge": "br-int", "label": "tempest-VolumesActionsTest-564180421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "1bde51ff8bde4dcdb14fcda0fc92d564", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56615a48-49", "ovs_interfaceid": "56615a48-49c1-42dd-8326-5806056ea7cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:02:56 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-cd8348d7-4706-436f-b1b7-bb97c1c60e51 req-373e6f90-6ec1-4766-94e0-b5cf72a52fbf service nova] Releasing lock "refresh_cache-2285eef6-6613-4802-a988-3fae065fa92d" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:02:57 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:02:57 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:02:57 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:02:57 user nova-compute[71874]: DEBUG nova.compute.manager [req-f3a55ea4-db3c-464c-8bf5-4c9390bec283 req-40f4f9f3-f715-4f39-8c39-90aad5382c2e service nova] [instance: 2285eef6-6613-4802-a988-3fae065fa92d] Received event network-vif-plugged-56615a48-49c1-42dd-8326-5806056ea7cf {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:02:57 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-f3a55ea4-db3c-464c-8bf5-4c9390bec283 req-40f4f9f3-f715-4f39-8c39-90aad5382c2e service nova] Acquiring lock "2285eef6-6613-4802-a988-3fae065fa92d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:02:57 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-f3a55ea4-db3c-464c-8bf5-4c9390bec283 req-40f4f9f3-f715-4f39-8c39-90aad5382c2e service nova] Lock "2285eef6-6613-4802-a988-3fae065fa92d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:02:57 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-f3a55ea4-db3c-464c-8bf5-4c9390bec283 req-40f4f9f3-f715-4f39-8c39-90aad5382c2e service nova] Lock "2285eef6-6613-4802-a988-3fae065fa92d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:02:57 user nova-compute[71874]: DEBUG nova.compute.manager [req-f3a55ea4-db3c-464c-8bf5-4c9390bec283 req-40f4f9f3-f715-4f39-8c39-90aad5382c2e service nova] [instance: 2285eef6-6613-4802-a988-3fae065fa92d] No waiting events found dispatching network-vif-plugged-56615a48-49c1-42dd-8326-5806056ea7cf {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:02:57 user nova-compute[71874]: WARNING nova.compute.manager [req-f3a55ea4-db3c-464c-8bf5-4c9390bec283 req-40f4f9f3-f715-4f39-8c39-90aad5382c2e service nova] [instance: 2285eef6-6613-4802-a988-3fae065fa92d] Received unexpected event network-vif-plugged-56615a48-49c1-42dd-8326-5806056ea7cf for instance with vm_state building and task_state spawning.
Apr 12 16:02:59 user nova-compute[71874]: DEBUG nova.virt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Emitting event <LifecycleEvent: 1681315379.1740575, 2285eef6-6613-4802-a988-3fae065fa92d => Resumed> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:02:59 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 2285eef6-6613-4802-a988-3fae065fa92d] VM Resumed (Lifecycle Event)
Apr 12 16:02:59 user nova-compute[71874]: DEBUG nova.compute.manager [None req-f958eef3-48e5-4601-83fb-2ecb7c81d669 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] [instance: 2285eef6-6613-4802-a988-3fae065fa92d] Instance event wait completed in 0 seconds for  {{(pid=71874) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 16:02:59 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-f958eef3-48e5-4601-83fb-2ecb7c81d669 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] [instance: 2285eef6-6613-4802-a988-3fae065fa92d] Guest created on hypervisor {{(pid=71874) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 16:02:59 user nova-compute[71874]: INFO nova.virt.libvirt.driver [-] [instance: 2285eef6-6613-4802-a988-3fae065fa92d] Instance spawned successfully.
Apr 12 16:02:59 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-f958eef3-48e5-4601-83fb-2ecb7c81d669 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] [instance: 2285eef6-6613-4802-a988-3fae065fa92d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 16:02:59 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 2285eef6-6613-4802-a988-3fae065fa92d] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:02:59 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 2285eef6-6613-4802-a988-3fae065fa92d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 16:02:59 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-f958eef3-48e5-4601-83fb-2ecb7c81d669 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] [instance: 2285eef6-6613-4802-a988-3fae065fa92d] Found default for hw_cdrom_bus of ide {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:02:59 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-f958eef3-48e5-4601-83fb-2ecb7c81d669 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] [instance: 2285eef6-6613-4802-a988-3fae065fa92d] Found default for hw_disk_bus of virtio {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:02:59 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-f958eef3-48e5-4601-83fb-2ecb7c81d669 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] [instance: 2285eef6-6613-4802-a988-3fae065fa92d] Found default for hw_input_bus of None {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:02:59 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-f958eef3-48e5-4601-83fb-2ecb7c81d669 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] [instance: 2285eef6-6613-4802-a988-3fae065fa92d] Found default for hw_pointer_model of None {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:02:59 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-f958eef3-48e5-4601-83fb-2ecb7c81d669 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] [instance: 2285eef6-6613-4802-a988-3fae065fa92d] Found default for hw_video_model of virtio {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:02:59 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-f958eef3-48e5-4601-83fb-2ecb7c81d669 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] [instance: 2285eef6-6613-4802-a988-3fae065fa92d] Found default for hw_vif_model of virtio {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:02:59 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 2285eef6-6613-4802-a988-3fae065fa92d] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 16:02:59 user nova-compute[71874]: DEBUG nova.virt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Emitting event <LifecycleEvent: 1681315379.175213, 2285eef6-6613-4802-a988-3fae065fa92d => Started> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:02:59 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 2285eef6-6613-4802-a988-3fae065fa92d] VM Started (Lifecycle Event)
Apr 12 16:02:59 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 2285eef6-6613-4802-a988-3fae065fa92d] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:02:59 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 2285eef6-6613-4802-a988-3fae065fa92d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 16:02:59 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 2285eef6-6613-4802-a988-3fae065fa92d] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 16:02:59 user nova-compute[71874]: INFO nova.compute.manager [None req-f958eef3-48e5-4601-83fb-2ecb7c81d669 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] [instance: 2285eef6-6613-4802-a988-3fae065fa92d] Took 5.41 seconds to spawn the instance on the hypervisor.
Apr 12 16:02:59 user nova-compute[71874]: DEBUG nova.compute.manager [None req-f958eef3-48e5-4601-83fb-2ecb7c81d669 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] [instance: 2285eef6-6613-4802-a988-3fae065fa92d] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:02:59 user nova-compute[71874]: INFO nova.compute.manager [None req-f958eef3-48e5-4601-83fb-2ecb7c81d669 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] [instance: 2285eef6-6613-4802-a988-3fae065fa92d] Took 6.15 seconds to build instance.
Apr 12 16:02:59 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-f958eef3-48e5-4601-83fb-2ecb7c81d669 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Lock "2285eef6-6613-4802-a988-3fae065fa92d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.240s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:02:59 user nova-compute[71874]: DEBUG nova.compute.manager [req-56333c9b-5b6d-4264-9fe4-826648366ce4 req-d6a61920-7ee9-4afa-b93c-4ed966ec9c26 service nova] [instance: 2285eef6-6613-4802-a988-3fae065fa92d] Received event network-vif-plugged-56615a48-49c1-42dd-8326-5806056ea7cf {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:02:59 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-56333c9b-5b6d-4264-9fe4-826648366ce4 req-d6a61920-7ee9-4afa-b93c-4ed966ec9c26 service nova] Acquiring lock "2285eef6-6613-4802-a988-3fae065fa92d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:02:59 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-56333c9b-5b6d-4264-9fe4-826648366ce4 req-d6a61920-7ee9-4afa-b93c-4ed966ec9c26 service nova] Lock "2285eef6-6613-4802-a988-3fae065fa92d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:02:59 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-56333c9b-5b6d-4264-9fe4-826648366ce4 req-d6a61920-7ee9-4afa-b93c-4ed966ec9c26 service nova] Lock "2285eef6-6613-4802-a988-3fae065fa92d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:02:59 user nova-compute[71874]: DEBUG nova.compute.manager [req-56333c9b-5b6d-4264-9fe4-826648366ce4 req-d6a61920-7ee9-4afa-b93c-4ed966ec9c26 service nova] [instance: 2285eef6-6613-4802-a988-3fae065fa92d] No waiting events found dispatching network-vif-plugged-56615a48-49c1-42dd-8326-5806056ea7cf {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:02:59 user nova-compute[71874]: WARNING nova.compute.manager [req-56333c9b-5b6d-4264-9fe4-826648366ce4 req-d6a61920-7ee9-4afa-b93c-4ed966ec9c26 service nova] [instance: 2285eef6-6613-4802-a988-3fae065fa92d] Received unexpected event network-vif-plugged-56615a48-49c1-42dd-8326-5806056ea7cf for instance with vm_state active and task_state None.
Apr 12 16:03:00 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:03:02 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:03:05 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:03:06 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:03:06 user nova-compute[71874]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681315371.967206, 55aff314-eb5e-4752-af9f-a4021e970cac => Stopped> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:03:06 user nova-compute[71874]: INFO nova.compute.manager [-] [instance: 55aff314-eb5e-4752-af9f-a4021e970cac] VM Stopped (Lifecycle Event)
Apr 12 16:03:06 user nova-compute[71874]: DEBUG nova.compute.manager [None req-501a6071-2f9a-4e29-ae98-51a5077594a7 None None] [instance: 55aff314-eb5e-4752-af9f-a4021e970cac] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:03:09 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:03:10 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:03:12 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:03:14 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-46f59941-1599-44d5-b082-e835e0d14bce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:03:14 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-46f59941-1599-44d5-b082-e835e0d14bce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:03:14 user nova-compute[71874]: DEBUG nova.objects.instance [None req-46f59941-1599-44d5-b082-e835e0d14bce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lazy-loading 'flavor' on Instance uuid dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:03:14 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-46f59941-1599-44d5-b082-e835e0d14bce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:03:15 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-46f59941-1599-44d5-b082-e835e0d14bce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:03:15 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-46f59941-1599-44d5-b082-e835e0d14bce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:03:15 user nova-compute[71874]: INFO nova.compute.manager [None req-46f59941-1599-44d5-b082-e835e0d14bce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Attaching volume b09d128a-0198-4cfc-942f-323bd2f41d53 to /dev/vdb
Apr 12 16:03:15 user nova-compute[71874]: DEBUG os_brick.utils [None req-46f59941-1599-44d5-b082-e835e0d14bce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:03:15 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:03:15 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:03:15 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[7810208d-f619-495f-a95e-70a24718d7aa]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:61a48d4489d2\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:03:15 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:03:15 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.023s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:03:15 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[80e186b0-5302-4dcc-a9ec-1660a4ee1710]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:03:15 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:03:15 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:03:15 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c1d1332-3392-475f-9c28-85dfd4016d37]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:03:15 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[727b89ca-638c-4c1f-88a8-5217f63f881f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:03:15 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-46f59941-1599-44d5-b082-e835e0d14bce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Running cmd (subprocess): nvme version {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:03:15 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-46f59941-1599-44d5-b082-e835e0d14bce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] 'nvme version' failed. Not Retrying. {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 16:03:15 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.nvmeof [None req-46f59941-1599-44d5-b082-e835e0d14bce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] nvme not present on system {{(pid=71874) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 16:03:15 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:03:15 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 16:03:15 user nova-compute[71874]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 16:03:15 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[83fadfc6-ba17-4483-b780-62e03466863b]: (4, '') {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:03:15 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.lightos [None req-46f59941-1599-44d5-b082-e835e0d14bce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71874) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 16:03:15 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.lightos [None req-46f59941-1599-44d5-b082-e835e0d14bce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71874) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 16:03:15 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.lightos [None req-46f59941-1599-44d5-b082-e835e0d14bce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] LIGHTOS: no hostnqn found. {{(pid=71874) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 16:03:15 user nova-compute[71874]: DEBUG os_brick.utils [None req-46f59941-1599-44d5-b082-e835e0d14bce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:61a48d4489d2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:03:15 user nova-compute[71874]: DEBUG nova.virt.block_device [None req-46f59941-1599-44d5-b082-e835e0d14bce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Updating existing volume attachment record: 9827c8b7-6cd7-46a5-b88a-f52b9a6ed35d {{(pid=71874) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 16:03:15 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:03:16 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:03:17 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:03:17 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-106906fa-3ae8-4042-bc3b-d928c6c416aa tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Acquiring lock "e85aa869-0d2a-40ff-9697-f979a6b110cb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:03:17 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-106906fa-3ae8-4042-bc3b-d928c6c416aa tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Lock "e85aa869-0d2a-40ff-9697-f979a6b110cb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:03:17 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-106906fa-3ae8-4042-bc3b-d928c6c416aa tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Acquiring lock "e85aa869-0d2a-40ff-9697-f979a6b110cb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:03:17 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-106906fa-3ae8-4042-bc3b-d928c6c416aa tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Lock "e85aa869-0d2a-40ff-9697-f979a6b110cb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:03:17 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-106906fa-3ae8-4042-bc3b-d928c6c416aa tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Lock "e85aa869-0d2a-40ff-9697-f979a6b110cb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:03:17 user nova-compute[71874]: INFO nova.compute.manager [None req-106906fa-3ae8-4042-bc3b-d928c6c416aa tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] [instance: e85aa869-0d2a-40ff-9697-f979a6b110cb] Terminating instance
Apr 12 16:03:17 user nova-compute[71874]: DEBUG nova.compute.manager [None req-106906fa-3ae8-4042-bc3b-d928c6c416aa tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] [instance: e85aa869-0d2a-40ff-9697-f979a6b110cb] Start destroying the instance on the hypervisor. {{(pid=71874) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 16:03:18 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:03:18 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:03:18 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:03:18 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:03:18 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:03:18 user nova-compute[71874]: DEBUG nova.compute.manager [req-85e013e3-4e2f-4002-b44c-8a790740b626 req-650d50b1-76bc-47da-94b0-c607ef988222 service nova] [instance: e85aa869-0d2a-40ff-9697-f979a6b110cb] Received event network-vif-unplugged-0db939d7-60c3-48af-8d8d-0f5528f41bb6 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:03:18 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-85e013e3-4e2f-4002-b44c-8a790740b626 req-650d50b1-76bc-47da-94b0-c607ef988222 service nova] Acquiring lock "e85aa869-0d2a-40ff-9697-f979a6b110cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:03:18 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-85e013e3-4e2f-4002-b44c-8a790740b626 req-650d50b1-76bc-47da-94b0-c607ef988222 service nova] Lock "e85aa869-0d2a-40ff-9697-f979a6b110cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:03:18 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-85e013e3-4e2f-4002-b44c-8a790740b626 req-650d50b1-76bc-47da-94b0-c607ef988222 service nova] Lock "e85aa869-0d2a-40ff-9697-f979a6b110cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:03:18 user nova-compute[71874]: DEBUG nova.compute.manager [req-85e013e3-4e2f-4002-b44c-8a790740b626 req-650d50b1-76bc-47da-94b0-c607ef988222 service nova] [instance: e85aa869-0d2a-40ff-9697-f979a6b110cb] No waiting events found dispatching network-vif-unplugged-0db939d7-60c3-48af-8d8d-0f5528f41bb6 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:03:18 user nova-compute[71874]: DEBUG nova.compute.manager [req-85e013e3-4e2f-4002-b44c-8a790740b626 req-650d50b1-76bc-47da-94b0-c607ef988222 service nova] [instance: e85aa869-0d2a-40ff-9697-f979a6b110cb] Received event network-vif-unplugged-0db939d7-60c3-48af-8d8d-0f5528f41bb6 for instance with task_state deleting. {{(pid=71874) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 16:03:18 user nova-compute[71874]: INFO nova.virt.libvirt.driver [-] [instance: e85aa869-0d2a-40ff-9697-f979a6b110cb] Instance destroyed successfully.
Apr 12 16:03:18 user nova-compute[71874]: DEBUG nova.objects.instance [None req-106906fa-3ae8-4042-bc3b-d928c6c416aa tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Lazy-loading 'resources' on Instance uuid e85aa869-0d2a-40ff-9697-f979a6b110cb {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:03:18 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-106906fa-3ae8-4042-bc3b-d928c6c416aa tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T15:59:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1426192575',display_name='tempest-TestVolumeSwap-server-1426192575',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1426192575',id=8,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF1Wd2ociOIFyjLM0vn+nY1bwPOFKVzmKcdhIhfpYlk3fUbGjg3MnW5Ty147Fnic93nKiDzHzxGNd6ERR69ZW9ZlfleRTXR5NIDgI9vygcdWTL7ncaqq0O00R7QkB5KROw==',key_name='tempest-keypair-1069057277',keypairs=<?>,launch_index=0,launched_at=2023-04-12T16:00:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5a8e21d4dae04fd08951f8306cff0624',ramdisk_id='',reservation_id='r-4jpqp070',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-432048888',owner_user_name='tempest-TestVolumeSwap-432048888-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T16:00:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d2e5f900d0b144f9942de733017fb396',uuid=e85aa869-0d2a-40ff-9697-f979a6b110cb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0db939d7-60c3-48af-8d8d-0f5528f41bb6", "address": "fa:16:3e:c9:39:5d", "network": {"id": "1316768e-1461-4bd9-b6df-2a43928b62b2", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1176895361-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a8e21d4dae04fd08951f8306cff0624", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0db939d7-60", "ovs_interfaceid": "0db939d7-60c3-48af-8d8d-0f5528f41bb6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 16:03:18 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-106906fa-3ae8-4042-bc3b-d928c6c416aa tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Converting VIF {"id": "0db939d7-60c3-48af-8d8d-0f5528f41bb6", "address": "fa:16:3e:c9:39:5d", "network": {"id": "1316768e-1461-4bd9-b6df-2a43928b62b2", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1176895361-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a8e21d4dae04fd08951f8306cff0624", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0db939d7-60", "ovs_interfaceid": "0db939d7-60c3-48af-8d8d-0f5528f41bb6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:03:18 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-106906fa-3ae8-4042-bc3b-d928c6c416aa tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c9:39:5d,bridge_name='br-int',has_traffic_filtering=True,id=0db939d7-60c3-48af-8d8d-0f5528f41bb6,network=Network(1316768e-1461-4bd9-b6df-2a43928b62b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0db939d7-60') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:03:18 user nova-compute[71874]: DEBUG os_vif [None req-106906fa-3ae8-4042-bc3b-d928c6c416aa tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c9:39:5d,bridge_name='br-int',has_traffic_filtering=True,id=0db939d7-60c3-48af-8d8d-0f5528f41bb6,network=Network(1316768e-1461-4bd9-b6df-2a43928b62b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0db939d7-60') {{(pid=71874) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 16:03:18 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:03:18 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0db939d7-60, bridge=br-int, if_exists=True) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:03:18 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:03:18 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:03:18 user nova-compute[71874]: INFO os_vif [None req-106906fa-3ae8-4042-bc3b-d928c6c416aa tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c9:39:5d,bridge_name='br-int',has_traffic_filtering=True,id=0db939d7-60c3-48af-8d8d-0f5528f41bb6,network=Network(1316768e-1461-4bd9-b6df-2a43928b62b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0db939d7-60')
Apr 12 16:03:18 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-106906fa-3ae8-4042-bc3b-d928c6c416aa tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] [instance: e85aa869-0d2a-40ff-9697-f979a6b110cb] Deleting instance files /opt/stack/data/nova/instances/e85aa869-0d2a-40ff-9697-f979a6b110cb_del
Apr 12 16:03:18 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-106906fa-3ae8-4042-bc3b-d928c6c416aa tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] [instance: e85aa869-0d2a-40ff-9697-f979a6b110cb] Deletion of /opt/stack/data/nova/instances/e85aa869-0d2a-40ff-9697-f979a6b110cb_del complete
Apr 12 16:03:18 user nova-compute[71874]: INFO nova.compute.manager [None req-106906fa-3ae8-4042-bc3b-d928c6c416aa tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] [instance: e85aa869-0d2a-40ff-9697-f979a6b110cb] Took 0.98 seconds to destroy the instance on the hypervisor.
Apr 12 16:03:18 user nova-compute[71874]: DEBUG oslo.service.loopingcall [None req-106906fa-3ae8-4042-bc3b-d928c6c416aa tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71874) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 16:03:18 user nova-compute[71874]: DEBUG nova.compute.manager [-] [instance: e85aa869-0d2a-40ff-9697-f979a6b110cb] Deallocating network for instance {{(pid=71874) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 16:03:18 user nova-compute[71874]: DEBUG nova.network.neutron [-] [instance: e85aa869-0d2a-40ff-9697-f979a6b110cb] deallocate_for_instance() {{(pid=71874) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 16:03:18 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-a93c5be7-6c20-4ded-9f78-3eae721683f5 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Acquiring lock "fc19fd8d-3285-4ceb-8714-a0ba139f3045" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:03:18 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-a93c5be7-6c20-4ded-9f78-3eae721683f5 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "fc19fd8d-3285-4ceb-8714-a0ba139f3045" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:03:18 user nova-compute[71874]: INFO nova.compute.manager [None req-a93c5be7-6c20-4ded-9f78-3eae721683f5 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] Unshelving
Apr 12 16:03:19 user nova-compute[71874]: INFO nova.virt.block_device [None req-a93c5be7-6c20-4ded-9f78-3eae721683f5 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] Booting with volume cfd27585-75c7-4a04-a93a-79e4236a36f7 at /dev/vdc
Apr 12 16:03:19 user nova-compute[71874]: DEBUG os_brick.utils [None req-a93c5be7-6c20-4ded-9f78-3eae721683f5 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:03:19 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:03:19 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:03:19 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[196c81a0-5467-4425-acae-4e70ca890ee7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:61a48d4489d2\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:03:19 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:03:19 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:03:19 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd9ccf53-8f28-430d-b71e-8e48bfc90746]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:03:19 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:03:19 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:03:19 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b94504e-b645-43a7-86b9-839aaba0d078]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:03:19 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[8429b69e-39b2-4ed8-8e58-ec9659994271]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:03:19 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-a93c5be7-6c20-4ded-9f78-3eae721683f5 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Running cmd (subprocess): nvme version {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:03:19 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-a93c5be7-6c20-4ded-9f78-3eae721683f5 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] 'nvme version' failed. Not Retrying. {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 16:03:19 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a93c5be7-6c20-4ded-9f78-3eae721683f5 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] nvme not present on system {{(pid=71874) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 16:03:19 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:03:19 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 16:03:19 user nova-compute[71874]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 16:03:19 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f84396f-6414-4737-9fa6-edf8f4289142]: (4, '') {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:03:19 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.lightos [None req-a93c5be7-6c20-4ded-9f78-3eae721683f5 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71874) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 16:03:19 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.lightos [None req-a93c5be7-6c20-4ded-9f78-3eae721683f5 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71874) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 16:03:19 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.lightos [None req-a93c5be7-6c20-4ded-9f78-3eae721683f5 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] LIGHTOS: no hostnqn found. {{(pid=71874) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 16:03:19 user nova-compute[71874]: DEBUG os_brick.utils [None req-a93c5be7-6c20-4ded-9f78-3eae721683f5 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:61a48d4489d2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:03:19 user nova-compute[71874]: DEBUG nova.virt.block_device [None req-a93c5be7-6c20-4ded-9f78-3eae721683f5 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] Updating existing volume attachment record: 938f1a58-a4c3-42e6-97f4-e77ff53f55a9 {{(pid=71874) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 16:03:20 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46f59941-1599-44d5-b082-e835e0d14bce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Calling os-brick to attach iSCSI Volume {{(pid=71874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 16:03:20 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-46f59941-1599-44d5-b082-e835e0d14bce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3c0216320>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b09d128a-0198-4cfc-942f-323bd2f41d53', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dwXLiHIo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:03:20 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-46f59941-1599-44d5-b082-e835e0d14bce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:03:20 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-46f59941-1599-44d5-b082-e835e0d14bce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:03:20 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-46f59941-1599-44d5-b082-e835e0d14bce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:03:20 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-46f59941-1599-44d5-b082-e835e0d14bce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:03:20 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-46f59941-1599-44d5-b082-e835e0d14bce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b09d128a-0198-4cfc-942f-323bd2f41d53" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:03:20 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-46f59941-1599-44d5-b082-e835e0d14bce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b09d128a-0198-4cfc-942f-323bd2f41d53" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:03:20 user nova-compute[71874]: INFO os_brick.initiator.connectors.iscsi [None req-46f59941-1599-44d5-b082-e835e0d14bce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 16:03:20 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b09d128a-0198-4cfc-942f-323bd2f41d53 -p 172.16.0.220:3260 {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:03:20 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b09d128a-0198-4cfc-942f-323bd2f41d53 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:03:20 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[77f4b82d-903f-4120-95e5-63a44754fa4d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:03:20 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-46f59941-1599-44d5-b082-e835e0d14bce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 16:03:20 user nova-compute[71874]:  {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:03:20 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b09d128a-0198-4cfc-942f-323bd2f41d53 -p 172.16.0.220:3260 --interface default --op new {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:03:20 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b09d128a-0198-4cfc-942f-323bd2f41d53 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:03:20 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[78a6da12-5859-4f84-8c9a-3dc56d0e93d3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b09d128a-0198-4cfc-942f-323bd2f41d53] added\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:03:20 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-46f59941-1599-44d5-b082-e835e0d14bce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b09d128a-0198-4cfc-942f-323bd2f41d53] added
Apr 12 16:03:20 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:03:20 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b09d128a-0198-4cfc-942f-323bd2f41d53 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:03:20 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b09d128a-0198-4cfc-942f-323bd2f41d53 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:03:20 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7675f15-b2ad-4085-a20a-f2f1e15b7447]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:03:20 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-46f59941-1599-44d5-b082-e835e0d14bce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:03:20 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b09d128a-0198-4cfc-942f-323bd2f41d53 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:03:20 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b09d128a-0198-4cfc-942f-323bd2f41d53 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:03:20 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[32572ab9-a781-4207-93a5-0a7a2457e66d]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:03:20 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-46f59941-1599-44d5-b082-e835e0d14bce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:03:20 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b09d128a-0198-4cfc-942f-323bd2f41d53 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dwXLiHIo {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:03:20 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b09d128a-0198-4cfc-942f-323bd2f41d53 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dwXLiHIo" returned: 0 in 0.027s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:03:20 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[c685b41d-df9c-44f2-8d5e-0e4232155b7d]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:03:20 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-46f59941-1599-44d5-b082-e835e0d14bce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dwXLiHIo'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:03:20 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b09d128a-0198-4cfc-942f-323bd2f41d53 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:03:20 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:03:20 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b09d128a-0198-4cfc-942f-323bd2f41d53 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:03:20 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[95acda6e-a38d-411d-84d3-9a9d7c26fe3e]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:03:20 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-46f59941-1599-44d5-b082-e835e0d14bce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:03:20 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:03:20 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:03:20 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[9097bd1f-d62a-4a85-b2b1-03c812750ff2]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6 (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:03:20 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-46f59941-1599-44d5-b082-e835e0d14bce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:03:20 user nova-compute[71874]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6 (non-flash)
Apr 12 16:03:20 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:03:20 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-46f59941-1599-44d5-b082-e835e0d14bce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:03:20 user nova-compute[71874]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6 (non-flash)
Apr 12 16:03:20 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:03:20 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b09d128a-0198-4cfc-942f-323bd2f41d53 -p 172.16.0.220:3260 --login {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:03:20 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b09d128a-0198-4cfc-942f-323bd2f41d53 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:03:20 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[38e34e84-61a3-4f21-b583-0a3e4f5ebc2c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b09d128a-0198-4cfc-942f-323bd2f41d53, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b09d128a-0198-4cfc-942f-323bd2f41d53, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:03:20 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-46f59941-1599-44d5-b082-e835e0d14bce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b09d128a-0198-4cfc-942f-323bd2f41d53, portal: 172.16.0.220,3260]
Apr 12 16:03:20 user nova-compute[71874]: Login to [iface: default, target: iqn.2010-10.org.openstack:b09d128a-0198-4cfc-942f-323bd2f41d53, portal: 172.16.0.220,3260] successful.
Apr 12 16:03:20 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:03:20 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b09d128a-0198-4cfc-942f-323bd2f41d53 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:03:20 user nova-compute[71874]: DEBUG nova.network.neutron [-] [instance: e85aa869-0d2a-40ff-9697-f979a6b110cb] Updating instance_info_cache with network_info: [] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:03:20 user nova-compute[71874]: INFO nova.compute.manager [-] [instance: e85aa869-0d2a-40ff-9697-f979a6b110cb] Took 1.37 seconds to deallocate network for instance.
Apr 12 16:03:20 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b09d128a-0198-4cfc-942f-323bd2f41d53 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:03:20 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d7ddbe9-378d-4002-988d-a1861228b7bd]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:03:20 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-46f59941-1599-44d5-b082-e835e0d14bce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:03:20 user nova-compute[71874]: DEBUG nova.compute.manager [req-67ad8188-a5e5-4271-8768-5b8f4b2d30fe req-a7c99b07-493e-441f-9ddf-a37cddbe38a3 service nova] [instance: e85aa869-0d2a-40ff-9697-f979a6b110cb] Received event network-vif-deleted-0db939d7-60c3-48af-8d8d-0f5528f41bb6 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:03:20 user nova-compute[71874]: INFO nova.compute.manager [req-67ad8188-a5e5-4271-8768-5b8f4b2d30fe req-a7c99b07-493e-441f-9ddf-a37cddbe38a3 service nova] [instance: e85aa869-0d2a-40ff-9697-f979a6b110cb] Neutron deleted interface 0db939d7-60c3-48af-8d8d-0f5528f41bb6; detaching it from the instance and deleting it from the info cache
Apr 12 16:03:20 user nova-compute[71874]: DEBUG nova.network.neutron [req-67ad8188-a5e5-4271-8768-5b8f4b2d30fe req-a7c99b07-493e-441f-9ddf-a37cddbe38a3 service nova] [instance: e85aa869-0d2a-40ff-9697-f979a6b110cb] Updating instance_info_cache with network_info: [] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:03:20 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:03:20 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:03:20 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[58249c67-5867-4f93-ad98-e74027eb5b03]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b09d128a-0198-4cfc-942f-323bd2f41d53 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6 (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:03:20 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-46f59941-1599-44d5-b082-e835e0d14bce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:03:20 user nova-compute[71874]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b09d128a-0198-4cfc-942f-323bd2f41d53 (non-flash)
Apr 12 16:03:20 user nova-compute[71874]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6 (non-flash)
Apr 12 16:03:20 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:03:20 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-46f59941-1599-44d5-b082-e835e0d14bce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:03:20 user nova-compute[71874]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b09d128a-0198-4cfc-942f-323bd2f41d53 (non-flash)
Apr 12 16:03:20 user nova-compute[71874]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6 (non-flash)
Apr 12 16:03:20 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:03:20 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-46f59941-1599-44d5-b082-e835e0d14bce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b09d128a-0198-4cfc-942f-323bd2f41d53" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.308s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:03:20 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-46f59941-1599-44d5-b082-e835e0d14bce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Connected to 172.16.0.220:3260 {{(pid=71874) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 16:03:20 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-46f59941-1599-44d5-b082-e835e0d14bce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] HCTL ('34', '-', '-', 0) found on session 16 with lun 0 {{(pid=71874) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 16:03:20 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-46f59941-1599-44d5-b082-e835e0d14bce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71874) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 16:03:20 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:03:20 user nova-compute[71874]: DEBUG nova.compute.manager [req-67ad8188-a5e5-4271-8768-5b8f4b2d30fe req-a7c99b07-493e-441f-9ddf-a37cddbe38a3 service nova] [instance: e85aa869-0d2a-40ff-9697-f979a6b110cb] Detach interface failed, port_id=0db939d7-60c3-48af-8d8d-0f5528f41bb6, reason: Instance e85aa869-0d2a-40ff-9697-f979a6b110cb could not be found. {{(pid=71874) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 12 16:03:20 user nova-compute[71874]: DEBUG nova.compute.manager [req-363f83b3-0a86-41de-bdbc-381553c9a307 req-00be2ea7-600c-4097-943d-299e66258b43 service nova] [instance: e85aa869-0d2a-40ff-9697-f979a6b110cb] Received event network-vif-plugged-0db939d7-60c3-48af-8d8d-0f5528f41bb6 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:03:20 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-363f83b3-0a86-41de-bdbc-381553c9a307 req-00be2ea7-600c-4097-943d-299e66258b43 service nova] Acquiring lock "e85aa869-0d2a-40ff-9697-f979a6b110cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:03:20 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-363f83b3-0a86-41de-bdbc-381553c9a307 req-00be2ea7-600c-4097-943d-299e66258b43 service nova] Lock "e85aa869-0d2a-40ff-9697-f979a6b110cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:03:20 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-363f83b3-0a86-41de-bdbc-381553c9a307 req-00be2ea7-600c-4097-943d-299e66258b43 service nova] Lock "e85aa869-0d2a-40ff-9697-f979a6b110cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:03:20 user nova-compute[71874]: DEBUG nova.compute.manager [req-363f83b3-0a86-41de-bdbc-381553c9a307 req-00be2ea7-600c-4097-943d-299e66258b43 service nova] [instance: e85aa869-0d2a-40ff-9697-f979a6b110cb] No waiting events found dispatching network-vif-plugged-0db939d7-60c3-48af-8d8d-0f5528f41bb6 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:03:20 user nova-compute[71874]: WARNING nova.compute.manager [req-363f83b3-0a86-41de-bdbc-381553c9a307 req-00be2ea7-600c-4097-943d-299e66258b43 service nova] [instance: e85aa869-0d2a-40ff-9697-f979a6b110cb] Received unexpected event network-vif-plugged-0db939d7-60c3-48af-8d8d-0f5528f41bb6 for instance with vm_state active and task_state deleting.
Apr 12 16:03:20 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.036s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:03:20 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7db9586-4d32-437d-aa49-3e0bfbbfb000]: (4, ('- - 0', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:03:20 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-46f59941-1599-44d5-b082-e835e0d14bce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Searching for a device in session 16 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71874) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 16:03:20 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-46f59941-1599-44d5-b082-e835e0d14bce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:b09d128a-0198-4cfc-942f-323bd2f41d53', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dwXLiHIo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71874) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 16:03:20 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-106906fa-3ae8-4042-bc3b-d928c6c416aa tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:03:20 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-106906fa-3ae8-4042-bc3b-d928c6c416aa tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:03:20 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-106906fa-3ae8-4042-bc3b-d928c6c416aa tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Inventory has not changed in ProviderTree for provider: 0e94b4c8-cd49-45e4-9133-d36eb4b2456b {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 16:03:20 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-106906fa-3ae8-4042-bc3b-d928c6c416aa tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Inventory has not changed for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 16:03:20 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-106906fa-3ae8-4042-bc3b-d928c6c416aa tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.403s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:03:20 user nova-compute[71874]: INFO nova.scheduler.client.report [None req-106906fa-3ae8-4042-bc3b-d928c6c416aa tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Deleted allocations for instance e85aa869-0d2a-40ff-9697-f979a6b110cb
Apr 12 16:03:20 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-106906fa-3ae8-4042-bc3b-d928c6c416aa tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Lock "e85aa869-0d2a-40ff-9697-f979a6b110cb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.014s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:03:21 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:03:21 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:03:21 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:03:21 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Starting heal instance info cache {{(pid=71874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 16:03:21 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquiring lock "refresh_cache-dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:03:21 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquired lock "refresh_cache-dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:03:21 user nova-compute[71874]: DEBUG nova.network.neutron [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Forcefully refreshing network info cache for instance {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 16:03:21 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-46f59941-1599-44d5-b082-e835e0d14bce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.361s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:03:21 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-46f59941-1599-44d5-b082-e835e0d14bce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] <== connect_volume: return (1364ms) {'type': 'block', 'scsi_wwn': '26536373864373666', 'path': '/dev/sdc'} {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:03:21 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46f59941-1599-44d5-b082-e835e0d14bce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26536373864373666', 'path': '/dev/sdc'} {{(pid=71874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 16:03:21 user nova-compute[71874]: DEBUG nova.objects.instance [None req-46f59941-1599-44d5-b082-e835e0d14bce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lazy-loading 'flavor' on Instance uuid dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:03:21 user nova-compute[71874]: DEBUG nova.virt.libvirt.guest [None req-46f59941-1599-44d5-b082-e835e0d14bce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 16:03:21 user nova-compute[71874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 16:03:21 user nova-compute[71874]:   <source dev="/dev/sdc"/>
Apr 12 16:03:21 user nova-compute[71874]:   <target dev="vdb" bus="virtio"/>
Apr 12 16:03:21 user nova-compute[71874]:   <serial>b09d128a-0198-4cfc-942f-323bd2f41d53</serial>
Apr 12 16:03:21 user nova-compute[71874]: </disk>
Apr 12 16:03:21 user nova-compute[71874]:  {{(pid=71874) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 16:03:21 user nova-compute[71874]: DEBUG nova.network.neutron [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Updating instance_info_cache with network_info: [{"id": "18196ae0-d9c1-4814-8803-c4ba8ad4ab45", "address": "fa:16:3e:98:72:fa", "network": {"id": "e6694358-e361-4952-b859-93755c11721e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-667152893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97ea81bd1962466bbe552424973f71a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18196ae0-d9", "ovs_interfaceid": "18196ae0-d9c1-4814-8803-c4ba8ad4ab45", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:03:21 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Releasing lock "refresh_cache-dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:03:21 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Updated the network info_cache for instance {{(pid=71874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 16:03:21 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:03:21 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:03:21 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:03:21 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:03:21 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:03:21 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:03:21 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71874) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 16:03:21 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:03:21 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:03:21 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:03:21 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:03:21 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Auditing locally available compute resources for user (node: user) {{(pid=71874) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 16:03:21 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-46f59941-1599-44d5-b082-e835e0d14bce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] No BDM found with device name vda, not building metadata. {{(pid=71874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 16:03:21 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-46f59941-1599-44d5-b082-e835e0d14bce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 16:03:21 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-46f59941-1599-44d5-b082-e835e0d14bce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] No VIF found with MAC fa:16:3e:98:72:fa, not building metadata {{(pid=71874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 16:03:22 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afebffae-dbf6-4876-8c9f-0364f0fde49c/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:03:22 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afebffae-dbf6-4876-8c9f-0364f0fde49c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:03:22 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afebffae-dbf6-4876-8c9f-0364f0fde49c/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:03:22 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-46f59941-1599-44d5-b082-e835e0d14bce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.211s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:03:22 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afebffae-dbf6-4876-8c9f-0364f0fde49c/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:03:22 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 16:03:22 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/608fbea2-b42b-4bb9-94a7-2b76dcdc2001/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:03:22 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/608fbea2-b42b-4bb9-94a7-2b76dcdc2001/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:03:22 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/608fbea2-b42b-4bb9-94a7-2b76dcdc2001/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:03:22 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:03:22 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/608fbea2-b42b-4bb9-94a7-2b76dcdc2001/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:03:22 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2285eef6-6613-4802-a988-3fae065fa92d/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:03:22 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2285eef6-6613-4802-a988-3fae065fa92d/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:03:22 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2285eef6-6613-4802-a988-3fae065fa92d/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:03:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2285eef6-6613-4802-a988-3fae065fa92d/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:03:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/920c6512-180d-46e1-b0cf-240d34c3fc97/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:03:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/920c6512-180d-46e1-b0cf-240d34c3fc97/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:03:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/920c6512-180d-46e1-b0cf-240d34c3fc97/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:03:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/920c6512-180d-46e1-b0cf-240d34c3fc97/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:03:23 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=71874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 16:03:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad0cece6-9b26-4c87-9e48-2c0437cb9190/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:03:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad0cece6-9b26-4c87-9e48-2c0437cb9190/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:03:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad0cece6-9b26-4c87-9e48-2c0437cb9190/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:03:23 user nova-compute[71874]: INFO nova.compute.manager [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Rebuilding instance
Apr 12 16:03:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad0cece6-9b26-4c87-9e48-2c0437cb9190/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:03:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473a30c4-5aa4-481c-8859-fda815d14872/disk.rescue --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:03:23 user nova-compute[71874]: DEBUG nova.objects.instance [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lazy-loading 'trusted_certs' on Instance uuid dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:03:23 user nova-compute[71874]: DEBUG nova.compute.manager [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:03:23 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:03:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473a30c4-5aa4-481c-8859-fda815d14872/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:03:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473a30c4-5aa4-481c-8859-fda815d14872/disk.rescue --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:03:23 user nova-compute[71874]: DEBUG nova.objects.instance [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lazy-loading 'pci_requests' on Instance uuid dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:03:23 user nova-compute[71874]: DEBUG nova.objects.instance [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lazy-loading 'pci_devices' on Instance uuid dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:03:23 user nova-compute[71874]: DEBUG nova.objects.instance [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lazy-loading 'resources' on Instance uuid dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:03:23 user nova-compute[71874]: DEBUG nova.objects.instance [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lazy-loading 'migration_context' on Instance uuid dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:03:23 user nova-compute[71874]: DEBUG nova.objects.instance [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Trying to apply a migration context that does not seem to be set for this instance {{(pid=71874) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1032}}
Apr 12 16:03:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473a30c4-5aa4-481c-8859-fda815d14872/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:03:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473a30c4-5aa4-481c-8859-fda815d14872/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:03:24 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:03:24 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:03:24 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:03:24 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:03:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473a30c4-5aa4-481c-8859-fda815d14872/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:03:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473a30c4-5aa4-481c-8859-fda815d14872/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:03:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473a30c4-5aa4-481c-8859-fda815d14872/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:03:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:03:24 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-a93c5be7-6c20-4ded-9f78-3eae721683f5 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:03:24 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-a93c5be7-6c20-4ded-9f78-3eae721683f5 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:03:24 user nova-compute[71874]: DEBUG nova.compute.manager [req-c21df7d4-1a48-4fa1-9f3b-ccd712fd305d req-e109cf3d-2ade-4631-91fe-8e7397437ad8 service nova] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Received event network-vif-unplugged-18196ae0-d9c1-4814-8803-c4ba8ad4ab45 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:03:24 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-c21df7d4-1a48-4fa1-9f3b-ccd712fd305d req-e109cf3d-2ade-4631-91fe-8e7397437ad8 service nova] Acquiring lock "dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:03:24 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-c21df7d4-1a48-4fa1-9f3b-ccd712fd305d req-e109cf3d-2ade-4631-91fe-8e7397437ad8 service nova] Lock "dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:03:24 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-c21df7d4-1a48-4fa1-9f3b-ccd712fd305d req-e109cf3d-2ade-4631-91fe-8e7397437ad8 service nova] Lock "dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:03:24 user nova-compute[71874]: DEBUG nova.compute.manager [req-c21df7d4-1a48-4fa1-9f3b-ccd712fd305d req-e109cf3d-2ade-4631-91fe-8e7397437ad8 service nova] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] No waiting events found dispatching network-vif-unplugged-18196ae0-d9c1-4814-8803-c4ba8ad4ab45 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:03:24 user nova-compute[71874]: WARNING nova.compute.manager [req-c21df7d4-1a48-4fa1-9f3b-ccd712fd305d req-e109cf3d-2ade-4631-91fe-8e7397437ad8 service nova] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Received unexpected event network-vif-unplugged-18196ae0-d9c1-4814-8803-c4ba8ad4ab45 for instance with vm_state active and task_state rebuilding.
Apr 12 16:03:24 user nova-compute[71874]: DEBUG nova.objects.instance [None req-a93c5be7-6c20-4ded-9f78-3eae721683f5 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lazy-loading 'pci_requests' on Instance uuid fc19fd8d-3285-4ceb-8714-a0ba139f3045 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:03:24 user nova-compute[71874]: DEBUG nova.objects.instance [None req-a93c5be7-6c20-4ded-9f78-3eae721683f5 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lazy-loading 'numa_topology' on Instance uuid fc19fd8d-3285-4ceb-8714-a0ba139f3045 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:03:24 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-a93c5be7-6c20-4ded-9f78-3eae721683f5 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71874) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 16:03:24 user nova-compute[71874]: INFO nova.compute.claims [None req-a93c5be7-6c20-4ded-9f78-3eae721683f5 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] Claim successful on node user
Apr 12 16:03:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:03:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:03:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:03:24 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 16:03:25 user nova-compute[71874]: INFO nova.virt.libvirt.driver [-] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Instance destroyed successfully.
Apr 12 16:03:25 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:03:25 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:03:25 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Hypervisor/Node resource view: name=user free_ram=7846MB free_disk=26.259815216064453GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71874) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 16:03:25 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:03:25 user nova-compute[71874]: INFO nova.compute.manager [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Detaching volume b09d128a-0198-4cfc-942f-323bd2f41d53
Apr 12 16:03:25 user nova-compute[71874]: INFO nova.virt.block_device [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Attempting to driver detach volume b09d128a-0198-4cfc-942f-323bd2f41d53 from mountpoint /dev/vdb
Apr 12 16:03:25 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Attempting to detach device vdb from instance dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 from the persistent domain config. {{(pid=71874) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 16:03:25 user nova-compute[71874]: DEBUG nova.virt.libvirt.guest [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 16:03:25 user nova-compute[71874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 16:03:25 user nova-compute[71874]:   <source dev="/dev/sdc"/>
Apr 12 16:03:25 user nova-compute[71874]:   <target dev="vdb" bus="virtio"/>
Apr 12 16:03:25 user nova-compute[71874]:   <serial>b09d128a-0198-4cfc-942f-323bd2f41d53</serial>
Apr 12 16:03:25 user nova-compute[71874]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 16:03:25 user nova-compute[71874]: </disk>
Apr 12 16:03:25 user nova-compute[71874]:  {{(pid=71874) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 16:03:25 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Successfully detached device vdb from instance dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 from the persistent domain config.
Apr 12 16:03:25 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] calling os-brick to detach iSCSI Volume {{(pid=71874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 16:03:25 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3c0216320>, {'target_iqn': 'iqn.2010-10.org.openstack:b09d128a-0198-4cfc-942f-323bd2f41d53', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dwXLiHIo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:03:25 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Apr 12 16:03:25 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:03:25 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:03:25 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:03:25 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:03:25 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-a93c5be7-6c20-4ded-9f78-3eae721683f5 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Inventory has not changed in ProviderTree for provider: 0e94b4c8-cd49-45e4-9133-d36eb4b2456b {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 16:03:25 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:03:25 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[554c31dd-8da5-4d78-ae77-eb811ada2907]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b09d128a-0198-4cfc-942f-323bd2f41d53\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:03:25 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 16:03:25 user nova-compute[71874]: No targets found.
Apr 12 16:03:25 user nova-compute[71874]: iSNS:
Apr 12 16:03:25 user nova-compute[71874]: No targets found.
Apr 12 16:03:25 user nova-compute[71874]: STATIC:
Apr 12 16:03:25 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6
Apr 12 16:03:25 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:03:25 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:03:25 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:b09d128a-0198-4cfc-942f-323bd2f41d53
Apr 12 16:03:25 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:03:25 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:03:25 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2
Apr 12 16:03:25 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:03:25 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:03:25 user nova-compute[71874]: FIRMWARE:
Apr 12 16:03:25 user nova-compute[71874]: No targets found.
Apr 12 16:03:25 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:03:25 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 16:03:25 user nova-compute[71874]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 16:03:25 user nova-compute[71874]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71874) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 16:03:25 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b09d128a-0198-4cfc-942f-323bd2f41d53', 0)] {{(pid=71874) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 16:03:25 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:03:25 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-a93c5be7-6c20-4ded-9f78-3eae721683f5 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Inventory has not changed for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 16:03:25 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:03:25 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[1526d062-eb3d-498f-995e-bf6697c9ae79]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b09d128a-0198-4cfc-942f-323bd2f41d53\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:03:25 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:03:25 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:03:25 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[f95cbb88-902e-4ecf-a593-a1a818054630]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b09d128a-0198-4cfc-942f-323bd2f41d53 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6 (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:03:25 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:03:25 user nova-compute[71874]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b09d128a-0198-4cfc-942f-323bd2f41d53 (non-flash)
Apr 12 16:03:25 user nova-compute[71874]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6 (non-flash)
Apr 12 16:03:25 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:03:25 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:03:25 user nova-compute[71874]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b09d128a-0198-4cfc-942f-323bd2f41d53 (non-flash)
Apr 12 16:03:25 user nova-compute[71874]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6 (non-flash)
Apr 12 16:03:25 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:03:25 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc3d44cdbd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b09d128a-0198-4cfc-942f-323bd2f41d53'): ({'sdc'}, set())}) {{(pid=71874) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 16:03:25 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Removing single pathed devices sdc {{(pid=71874) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 16:03:25 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-a93c5be7-6c20-4ded-9f78-3eae721683f5 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.282s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:03:25 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:03:25 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.321s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:03:25 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:03:25 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[abda386e-e454-4624-a91f-915b45f386a5]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:03:25 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:03:25 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:03:25 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[7306e188-4661-4e89-bc78-00e8a28d568f]: (4, ('ok\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:03:25 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Flushing IO for device /dev/sdc {{(pid=71874) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 16:03:25 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:03:25 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:03:25 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c444988-7d3d-4976-81ae-3acc8aad2bc3]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:03:25 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71874) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 16:03:25 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:03:25 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:03:25 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[13751bf7-d93a-4437-a211-27cab47c7793]: (4, ('1', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:03:25 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71874) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 16:03:25 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] SCSI volumes sdc have been removed. {{(pid=71874) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 16:03:25 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b09d128a-0198-4cfc-942f-323bd2f41d53')] {{(pid=71874) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 16:03:25 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b09d128a-0198-4cfc-942f-323bd2f41d53 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:03:25 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance afebffae-dbf6-4876-8c9f-0364f0fde49c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:03:25 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 473a30c4-5aa4-481c-8859-fda815d14872 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:03:25 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 608fbea2-b42b-4bb9-94a7-2b76dcdc2001 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:03:25 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:03:25 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 920c6512-180d-46e1-b0cf-240d34c3fc97 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:03:25 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance ad0cece6-9b26-4c87-9e48-2c0437cb9190 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:03:25 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance f52ee906-c8fd-4cd5-842e-de98a5099c4f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:03:25 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 2285eef6-6613-4802-a988-3fae065fa92d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:03:25 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] Instance with task_state "spawning" is not being actively managed by this compute host but has allocations referencing this compute node (0e94b4c8-cd49-45e4-9133-d36eb4b2456b): {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. Skipping heal of allocations during the task state transition. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1705}}
Apr 12 16:03:25 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=71874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 16:03:25 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Final resource view: name=user phys_ram=16023MB used_ram=1536MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=71874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 16:03:25 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b09d128a-0198-4cfc-942f-323bd2f41d53 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:03:25 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f3499cd-765e-4ba8-87b2-27d1ce82c24e]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:03:25 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:03:25 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b09d128a-0198-4cfc-942f-323bd2f41d53 -p 172.16.0.220:3260 --logout {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:03:25 user nova-compute[71874]: INFO nova.network.neutron [None req-a93c5be7-6c20-4ded-9f78-3eae721683f5 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] Updating port 12acc77d-6a56-426a-acda-16438c358c44 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Apr 12 16:03:25 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b09d128a-0198-4cfc-942f-323bd2f41d53 -p 172.16.0.220:3260 --logout" returned: 0 in 0.088s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:03:25 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[97192566-6525-4a0e-90f6-0130a7654672]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:b09d128a-0198-4cfc-942f-323bd2f41d53, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:b09d128a-0198-4cfc-942f-323bd2f41d53, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:03:25 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:b09d128a-0198-4cfc-942f-323bd2f41d53, portal: 172.16.0.220,3260]
Apr 12 16:03:25 user nova-compute[71874]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:b09d128a-0198-4cfc-942f-323bd2f41d53, portal: 172.16.0.220,3260] successful.
Apr 12 16:03:25 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:03:25 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b09d128a-0198-4cfc-942f-323bd2f41d53 -p 172.16.0.220:3260 --op delete {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:03:26 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b09d128a-0198-4cfc-942f-323bd2f41d53 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:03:26 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[d37be6c6-ae7b-4135-9971-a779f9dd2d0b]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:03:26 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:03:26 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.357s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:03:26 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] <== disconnect_volume: return (360ms) None {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:03:26 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Disconnected iSCSI Volume {{(pid=71874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 16:03:26 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Inventory has not changed in ProviderTree for provider: 0e94b4c8-cd49-45e4-9133-d36eb4b2456b {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 16:03:26 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Inventory has not changed for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 16:03:26 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Compute_service record updated for user:user {{(pid=71874) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 16:03:26 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.706s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:03:26 user nova-compute[71874]: DEBUG nova.compute.manager [req-2038068d-e803-4d3a-b5d8-3b5c72f894c6 req-8669e4ac-8ac8-4d31-b56d-78e268e48c54 service nova] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Received event network-vif-plugged-18196ae0-d9c1-4814-8803-c4ba8ad4ab45 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:03:26 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-2038068d-e803-4d3a-b5d8-3b5c72f894c6 req-8669e4ac-8ac8-4d31-b56d-78e268e48c54 service nova] Acquiring lock "dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:03:26 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-2038068d-e803-4d3a-b5d8-3b5c72f894c6 req-8669e4ac-8ac8-4d31-b56d-78e268e48c54 service nova] Lock "dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:03:26 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-2038068d-e803-4d3a-b5d8-3b5c72f894c6 req-8669e4ac-8ac8-4d31-b56d-78e268e48c54 service nova] Lock "dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:03:26 user nova-compute[71874]: DEBUG nova.compute.manager [req-2038068d-e803-4d3a-b5d8-3b5c72f894c6 req-8669e4ac-8ac8-4d31-b56d-78e268e48c54 service nova] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] No waiting events found dispatching network-vif-plugged-18196ae0-d9c1-4814-8803-c4ba8ad4ab45 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:03:26 user nova-compute[71874]: WARNING nova.compute.manager [req-2038068d-e803-4d3a-b5d8-3b5c72f894c6 req-8669e4ac-8ac8-4d31-b56d-78e268e48c54 service nova] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Received unexpected event network-vif-plugged-18196ae0-d9c1-4814-8803-c4ba8ad4ab45 for instance with vm_state active and task_state rebuilding.
Apr 12 16:03:27 user nova-compute[71874]: INFO nova.virt.libvirt.driver [-] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Instance destroyed successfully.
Apr 12 16:03:27 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T15:59:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1390712116',display_name='tempest-ServerActionsTestJSON-server-416657090',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1390712116',id=4,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNmXVADjvoPSh3uGCGCTNS/vcfcDtUjn/vZEaV3bCllfz1ZO8VIgFuZhP+mAsa+G/KA4ubi5U9Vj41YtHGsakdPR5VoByhorvfUv/PIWtER2tn1LWX2mlFyT+T8AEJplPw==',key_name='tempest-keypair-1923467613',keypairs=<?>,launch_index=0,launched_at=2023-04-12T15:59:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='97ea81bd1962466bbe552424973f71a8',ramdisk_id='',reservation_id='r-y3c7iw20',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-631887779',owner_user_name='tempest-ServerActionsTestJSON-631887779-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T16:03:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1a699b3ba8304eadb8a53d465ea340cf',uuid=dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "18196ae0-d9c1-4814-8803-c4ba8ad4ab45", "address": "fa:16:3e:98:72:fa", "network": {"id": "e6694358-e361-4952-b859-93755c11721e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-667152893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97ea81bd1962466bbe552424973f71a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18196ae0-d9", "ovs_interfaceid": "18196ae0-d9c1-4814-8803-c4ba8ad4ab45", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 16:03:27 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Converting VIF {"id": "18196ae0-d9c1-4814-8803-c4ba8ad4ab45", "address": "fa:16:3e:98:72:fa", "network": {"id": "e6694358-e361-4952-b859-93755c11721e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-667152893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97ea81bd1962466bbe552424973f71a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18196ae0-d9", "ovs_interfaceid": "18196ae0-d9c1-4814-8803-c4ba8ad4ab45", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:03:27 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:98:72:fa,bridge_name='br-int',has_traffic_filtering=True,id=18196ae0-d9c1-4814-8803-c4ba8ad4ab45,network=Network(e6694358-e361-4952-b859-93755c11721e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18196ae0-d9') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:03:27 user nova-compute[71874]: DEBUG os_vif [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:98:72:fa,bridge_name='br-int',has_traffic_filtering=True,id=18196ae0-d9c1-4814-8803-c4ba8ad4ab45,network=Network(e6694358-e361-4952-b859-93755c11721e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18196ae0-d9') {{(pid=71874) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 16:03:27 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:03:27 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap18196ae0-d9, bridge=br-int, if_exists=True) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:03:27 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:03:27 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:03:27 user nova-compute[71874]: INFO os_vif [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:98:72:fa,bridge_name='br-int',has_traffic_filtering=True,id=18196ae0-d9c1-4814-8803-c4ba8ad4ab45,network=Network(e6694358-e361-4952-b859-93755c11721e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18196ae0-d9')
Apr 12 16:03:27 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] calling os-brick to detach iSCSI Volume {{(pid=71874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 16:03:27 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3c0216320>, {'target_iqn': 'iqn.2010-10.org.openstack:b09d128a-0198-4cfc-942f-323bd2f41d53', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dwXLiHIo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:03:27 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Apr 12 16:03:27 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:03:27 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:03:27 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:03:27 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:03:27 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e3ae9ce-f0e3-460d-83b4-f7732c9fab06]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:03:27 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 16:03:27 user nova-compute[71874]: No targets found.
Apr 12 16:03:27 user nova-compute[71874]: iSNS:
Apr 12 16:03:27 user nova-compute[71874]: No targets found.
Apr 12 16:03:27 user nova-compute[71874]: STATIC:
Apr 12 16:03:27 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6
Apr 12 16:03:27 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:03:27 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:03:27 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2
Apr 12 16:03:27 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:03:27 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:03:27 user nova-compute[71874]: FIRMWARE:
Apr 12 16:03:27 user nova-compute[71874]: No targets found.
Apr 12 16:03:27 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:03:27 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 16:03:27 user nova-compute[71874]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 16:03:27 user nova-compute[71874]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71874) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 16:03:27 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b09d128a-0198-4cfc-942f-323bd2f41d53', 0)] {{(pid=71874) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 16:03:27 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:03:27 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.029s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:03:27 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5e6d8bc-ca3d-4304-a7b9-66b255f7c753]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:03:27 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:03:27 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:03:27 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0987fc0-465b-4768-8047-4e4fc357f0d9]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6 (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:03:27 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:03:27 user nova-compute[71874]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6 (non-flash)
Apr 12 16:03:27 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:03:27 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:03:27 user nova-compute[71874]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6 (non-flash)
Apr 12 16:03:27 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:03:27 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc3c076e680>, {}) {{(pid=71874) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 16:03:27 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Disconnecting from: [] {{(pid=71874) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 16:03:27 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.106s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:03:27 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] <== disconnect_volume: return (108ms) None {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:03:27 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Disconnected iSCSI Volume {{(pid=71874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 16:03:27 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Deleting instance files /opt/stack/data/nova/instances/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1_del
Apr 12 16:03:27 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Deletion of /opt/stack/data/nova/instances/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1_del complete
Apr 12 16:03:27 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:03:27 user nova-compute[71874]: INFO nova.virt.block_device [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Booting with volume b09d128a-0198-4cfc-942f-323bd2f41d53 at /dev/vdb
Apr 12 16:03:27 user nova-compute[71874]: DEBUG os_brick.utils [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:03:27 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:03:27 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:03:27 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[47935e38-69e1-418d-80b9-83193c98422e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:61a48d4489d2\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:03:27 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:03:27 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:03:27 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[af26915a-9925-4143-997f-ef00150f4d3a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:03:27 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:03:27 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:03:27 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea244382-4d60-496c-a8da-582696e2bc82]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:03:27 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[04ba5e8b-9d55-41e6-ad38-964f34cb0426]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:03:27 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Running cmd (subprocess): nvme version {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:03:27 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] 'nvme version' failed. Not Retrying. {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 16:03:27 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.nvmeof [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] nvme not present on system {{(pid=71874) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 16:03:27 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:03:27 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 16:03:27 user nova-compute[71874]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 16:03:27 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[80a5bea1-1b01-41af-8ae9-00192b6b7a89]: (4, '') {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:03:27 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.lightos [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71874) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 16:03:27 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.lightos [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71874) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 16:03:27 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.lightos [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] LIGHTOS: no hostnqn found. {{(pid=71874) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 16:03:27 user nova-compute[71874]: DEBUG os_brick.utils [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] <== get_connector_properties: return (149ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:61a48d4489d2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:03:27 user nova-compute[71874]: DEBUG nova.virt.block_device [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Updating existing volume attachment record: f6c93cef-1e43-4df0-b389-f0be8e25236b {{(pid=71874) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 16:03:28 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-a93c5be7-6c20-4ded-9f78-3eae721683f5 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Acquiring lock "refresh_cache-fc19fd8d-3285-4ceb-8714-a0ba139f3045" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:03:28 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-a93c5be7-6c20-4ded-9f78-3eae721683f5 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Acquired lock "refresh_cache-fc19fd8d-3285-4ceb-8714-a0ba139f3045" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:03:28 user nova-compute[71874]: DEBUG nova.network.neutron [None req-a93c5be7-6c20-4ded-9f78-3eae721683f5 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] Building network info cache for instance {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 16:03:28 user nova-compute[71874]: DEBUG nova.compute.manager [req-da1699ef-fe6a-42bb-9951-f28b433b984b req-35cf21b2-2df9-43e9-b8ad-571981ebbf31 service nova] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] Received event network-changed-12acc77d-6a56-426a-acda-16438c358c44 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:03:28 user nova-compute[71874]: DEBUG nova.compute.manager [req-da1699ef-fe6a-42bb-9951-f28b433b984b req-35cf21b2-2df9-43e9-b8ad-571981ebbf31 service nova] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] Refreshing instance network info cache due to event network-changed-12acc77d-6a56-426a-acda-16438c358c44. {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 16:03:28 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-da1699ef-fe6a-42bb-9951-f28b433b984b req-35cf21b2-2df9-43e9-b8ad-571981ebbf31 service nova] Acquiring lock "refresh_cache-fc19fd8d-3285-4ceb-8714-a0ba139f3045" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:03:29 user nova-compute[71874]: DEBUG nova.network.neutron [None req-a93c5be7-6c20-4ded-9f78-3eae721683f5 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] Updating instance_info_cache with network_info: [{"id": "12acc77d-6a56-426a-acda-16438c358c44", "address": "fa:16:3e:9f:92:7f", "network": {"id": "eb4dd4b5-96d4-4b53-b510-d41e2775b92f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-596111273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fa122cbabe94c6f93c862b4daf31e50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12acc77d-6a", "ovs_interfaceid": "12acc77d-6a56-426a-acda-16438c358c44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:03:29 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-a93c5be7-6c20-4ded-9f78-3eae721683f5 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Releasing lock "refresh_cache-fc19fd8d-3285-4ceb-8714-a0ba139f3045" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:03:29 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-a93c5be7-6c20-4ded-9f78-3eae721683f5 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] Creating instance directory {{(pid=71874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 16:03:29 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-a93c5be7-6c20-4ded-9f78-3eae721683f5 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] Creating image(s)
Apr 12 16:03:29 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-a93c5be7-6c20-4ded-9f78-3eae721683f5 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Acquiring lock "/opt/stack/data/nova/instances/fc19fd8d-3285-4ceb-8714-a0ba139f3045/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:03:29 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-a93c5be7-6c20-4ded-9f78-3eae721683f5 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "/opt/stack/data/nova/instances/fc19fd8d-3285-4ceb-8714-a0ba139f3045/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:03:29 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-a93c5be7-6c20-4ded-9f78-3eae721683f5 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "/opt/stack/data/nova/instances/fc19fd8d-3285-4ceb-8714-a0ba139f3045/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:03:29 user nova-compute[71874]: DEBUG nova.objects.instance [None req-a93c5be7-6c20-4ded-9f78-3eae721683f5 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lazy-loading 'trusted_certs' on Instance uuid fc19fd8d-3285-4ceb-8714-a0ba139f3045 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:03:29 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-da1699ef-fe6a-42bb-9951-f28b433b984b req-35cf21b2-2df9-43e9-b8ad-571981ebbf31 service nova] Acquired lock "refresh_cache-fc19fd8d-3285-4ceb-8714-a0ba139f3045" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:03:29 user nova-compute[71874]: DEBUG nova.network.neutron [req-da1699ef-fe6a-42bb-9951-f28b433b984b req-35cf21b2-2df9-43e9-b8ad-571981ebbf31 service nova] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] Refreshing network info cache for port 12acc77d-6a56-426a-acda-16438c358c44 {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 16:03:29 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-a93c5be7-6c20-4ded-9f78-3eae721683f5 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Acquiring lock "12fc99932511efaad98d0589e0d900594bad05cb" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:03:29 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-a93c5be7-6c20-4ded-9f78-3eae721683f5 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "12fc99932511efaad98d0589e0d900594bad05cb" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:03:30 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-a93c5be7-6c20-4ded-9f78-3eae721683f5 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/12fc99932511efaad98d0589e0d900594bad05cb.part --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:03:30 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-a93c5be7-6c20-4ded-9f78-3eae721683f5 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/12fc99932511efaad98d0589e0d900594bad05cb.part --force-share --output=json" returned: 0 in 0.163s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:03:30 user nova-compute[71874]: DEBUG nova.virt.images [None req-a93c5be7-6c20-4ded-9f78-3eae721683f5 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] aea0d05c-bce2-4503-aeaf-6f9933e25a12 was qcow2, converting to raw {{(pid=71874) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 12 16:03:30 user nova-compute[71874]: DEBUG nova.privsep.utils [None req-a93c5be7-6c20-4ded-9f78-3eae721683f5 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71874) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 12 16:03:30 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-a93c5be7-6c20-4ded-9f78-3eae721683f5 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/12fc99932511efaad98d0589e0d900594bad05cb.part /opt/stack/data/nova/instances/_base/12fc99932511efaad98d0589e0d900594bad05cb.converted {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:03:31 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-a93c5be7-6c20-4ded-9f78-3eae721683f5 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/12fc99932511efaad98d0589e0d900594bad05cb.part /opt/stack/data/nova/instances/_base/12fc99932511efaad98d0589e0d900594bad05cb.converted" returned: 0 in 0.280s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:03:31 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-a93c5be7-6c20-4ded-9f78-3eae721683f5 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/12fc99932511efaad98d0589e0d900594bad05cb.converted --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:03:31 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-a93c5be7-6c20-4ded-9f78-3eae721683f5 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/12fc99932511efaad98d0589e0d900594bad05cb.converted --force-share --output=json" returned: 0 in 0.197s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:03:31 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-a93c5be7-6c20-4ded-9f78-3eae721683f5 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "12fc99932511efaad98d0589e0d900594bad05cb" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.507s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:03:31 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-a93c5be7-6c20-4ded-9f78-3eae721683f5 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/12fc99932511efaad98d0589e0d900594bad05cb --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:03:31 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-a93c5be7-6c20-4ded-9f78-3eae721683f5 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/12fc99932511efaad98d0589e0d900594bad05cb --force-share --output=json" returned: 0 in 0.153s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:03:31 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-a93c5be7-6c20-4ded-9f78-3eae721683f5 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Acquiring lock "12fc99932511efaad98d0589e0d900594bad05cb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:03:31 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-a93c5be7-6c20-4ded-9f78-3eae721683f5 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "12fc99932511efaad98d0589e0d900594bad05cb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:03:31 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-a93c5be7-6c20-4ded-9f78-3eae721683f5 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/12fc99932511efaad98d0589e0d900594bad05cb --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:03:31 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:03:31 user nova-compute[71874]: DEBUG nova.network.neutron [req-da1699ef-fe6a-42bb-9951-f28b433b984b req-35cf21b2-2df9-43e9-b8ad-571981ebbf31 service nova] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] Updated VIF entry in instance network info cache for port 12acc77d-6a56-426a-acda-16438c358c44. {{(pid=71874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 16:03:31 user nova-compute[71874]: DEBUG nova.network.neutron [req-da1699ef-fe6a-42bb-9951-f28b433b984b req-35cf21b2-2df9-43e9-b8ad-571981ebbf31 service nova] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] Updating instance_info_cache with network_info: [{"id": "12acc77d-6a56-426a-acda-16438c358c44", "address": "fa:16:3e:9f:92:7f", "network": {"id": "eb4dd4b5-96d4-4b53-b510-d41e2775b92f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-596111273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fa122cbabe94c6f93c862b4daf31e50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12acc77d-6a", "ovs_interfaceid": "12acc77d-6a56-426a-acda-16438c358c44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:03:31 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:03:31 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-da1699ef-fe6a-42bb-9951-f28b433b984b req-35cf21b2-2df9-43e9-b8ad-571981ebbf31 service nova] Releasing lock "refresh_cache-fc19fd8d-3285-4ceb-8714-a0ba139f3045" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:03:31 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-a93c5be7-6c20-4ded-9f78-3eae721683f5 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/12fc99932511efaad98d0589e0d900594bad05cb --force-share --output=json" returned: 0 in 0.157s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:03:31 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-a93c5be7-6c20-4ded-9f78-3eae721683f5 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/12fc99932511efaad98d0589e0d900594bad05cb,backing_fmt=raw /opt/stack/data/nova/instances/fc19fd8d-3285-4ceb-8714-a0ba139f3045/disk 1073741824 {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:03:31 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-a93c5be7-6c20-4ded-9f78-3eae721683f5 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/12fc99932511efaad98d0589e0d900594bad05cb,backing_fmt=raw /opt/stack/data/nova/instances/fc19fd8d-3285-4ceb-8714-a0ba139f3045/disk 1073741824" returned: 0 in 0.052s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:03:31 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-a93c5be7-6c20-4ded-9f78-3eae721683f5 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "12fc99932511efaad98d0589e0d900594bad05cb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.217s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:03:31 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-a93c5be7-6c20-4ded-9f78-3eae721683f5 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/12fc99932511efaad98d0589e0d900594bad05cb --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:03:31 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-a93c5be7-6c20-4ded-9f78-3eae721683f5 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/12fc99932511efaad98d0589e0d900594bad05cb --force-share --output=json" returned: 0 in 0.134s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:03:31 user nova-compute[71874]: DEBUG nova.objects.instance [None req-a93c5be7-6c20-4ded-9f78-3eae721683f5 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lazy-loading 'migration_context' on Instance uuid fc19fd8d-3285-4ceb-8714-a0ba139f3045 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:03:31 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-a93c5be7-6c20-4ded-9f78-3eae721683f5 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] Rebasing disk image.
Apr 12 16:03:31 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-a93c5be7-6c20-4ded-9f78-3eae721683f5 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:03:31 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:03:31 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-a93c5be7-6c20-4ded-9f78-3eae721683f5 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json" returned: 0 in 0.166s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:03:31 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-a93c5be7-6c20-4ded-9f78-3eae721683f5 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 -F raw /opt/stack/data/nova/instances/fc19fd8d-3285-4ceb-8714-a0ba139f3045/disk {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:03:32 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:03:32 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:03:32 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Creating instance directory {{(pid=71874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 16:03:32 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Creating image(s)
Apr 12 16:03:32 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "/opt/stack/data/nova/instances/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:03:32 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "/opt/stack/data/nova/instances/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:03:32 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "/opt/stack/data/nova/instances/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:03:32 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:03:33 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json" returned: 0 in 0.140s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:03:33 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "b88df1b37cb431f52bc53b5616015c89b5bec411" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:03:33 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "b88df1b37cb431f52bc53b5616015c89b5bec411" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:03:33 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:03:33 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json" returned: 0 in 0.142s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:03:33 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411,backing_fmt=raw /opt/stack/data/nova/instances/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1/disk 1073741824 {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:03:33 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411,backing_fmt=raw /opt/stack/data/nova/instances/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1/disk 1073741824" returned: 0 in 0.054s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:03:33 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "b88df1b37cb431f52bc53b5616015c89b5bec411" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.204s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:03:33 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:03:33 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json" returned: 0 in 0.149s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:03:33 user nova-compute[71874]: DEBUG nova.virt.disk.api [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Checking if we can resize image /opt/stack/data/nova/instances/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1/disk. size=1073741824 {{(pid=71874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 16:03:33 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:03:33 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:03:33 user nova-compute[71874]: DEBUG nova.virt.disk.api [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Cannot resize image /opt/stack/data/nova/instances/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1/disk to a smaller size. {{(pid=71874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 16:03:33 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Created local disks {{(pid=71874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 16:03:33 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Ensure instance console log exists: /opt/stack/data/nova/instances/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1/console.log {{(pid=71874) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 16:03:33 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:03:33 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:03:33 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:03:33 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Start _get_guest_xml network_info=[{"id": "18196ae0-d9c1-4814-8803-c4ba8ad4ab45", "address": "fa:16:3e:98:72:fa", "network": {"id": "e6694358-e361-4952-b859-93755c11721e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-667152893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97ea81bd1962466bbe552424973f71a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18196ae0-d9", "ovs_interfaceid": "18196ae0-d9c1-4814-8803-c4ba8ad4ab45", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T15:55:37Z,direct_url=<?>,disk_format='qcow2',id=9dc63f14-8b70-4e72-89f2-13464f2f5c7c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='61a4936d9b7744c0b488d81c9b7746b6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T15:55:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_options': None, 'image_id': '9dc63f14-8b70-4e72-89f2-13464f2f5c7c'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'delete_on_termination': False, 'attachment_id': 'f6c93cef-1e43-4df0-b389-f0be8e25236b', 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b09d128a-0198-4cfc-942f-323bd2f41d53', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dwXLiHIo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1', 'attached_at': '', 'detached_at': '', 'volume_id': 'b09d128a-0198-4cfc-942f-323bd2f41d53', 'serial': 'b09d128a-0198-4cfc-942f-323bd2f41d53'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': None, 'volume_type': None} {{(pid=71874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 16:03:33 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Apr 12 16:03:33 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Apr 12 16:03:33 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71874) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 16:03:33 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T15:56:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T15:55:37Z,direct_url=<?>,disk_format='qcow2',id=9dc63f14-8b70-4e72-89f2-13464f2f5c7c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='61a4936d9b7744c0b488d81c9b7746b6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T15:55:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 16:03:33 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Flavor limits 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 16:03:33 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Image limits 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 16:03:33 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Flavor pref 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 16:03:33 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Image pref 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 16:03:33 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 16:03:33 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 16:03:33 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 16:03:33 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Got 1 possible topologies {{(pid=71874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 16:03:33 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 16:03:33 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 16:03:33 user nova-compute[71874]: DEBUG nova.objects.instance [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lazy-loading 'vcpu_model' on Instance uuid dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:03:33 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Calling os-brick to attach iSCSI Volume {{(pid=71874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 16:03:33 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3c0216320>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b09d128a-0198-4cfc-942f-323bd2f41d53', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dwXLiHIo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:03:33 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Apr 12 16:03:33 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:03:33 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:03:33 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Apr 12 16:03:33 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b09d128a-0198-4cfc-942f-323bd2f41d53" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:03:33 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b09d128a-0198-4cfc-942f-323bd2f41d53" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:03:33 user nova-compute[71874]: INFO os_brick.initiator.connectors.iscsi [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 16:03:33 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b09d128a-0198-4cfc-942f-323bd2f41d53 -p 172.16.0.220:3260 {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:03:33 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b09d128a-0198-4cfc-942f-323bd2f41d53 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:03:33 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[43098a12-008d-4ba4-acd7-3eb1a36138ee]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:03:33 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 16:03:33 user nova-compute[71874]:  {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:03:33 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b09d128a-0198-4cfc-942f-323bd2f41d53 -p 172.16.0.220:3260 --interface default --op new {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:03:33 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b09d128a-0198-4cfc-942f-323bd2f41d53 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:03:33 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[98fd8828-03a3-499b-86ef-a8ca9870cb83]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b09d128a-0198-4cfc-942f-323bd2f41d53] added\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:03:33 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b09d128a-0198-4cfc-942f-323bd2f41d53] added
Apr 12 16:03:33 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:03:33 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b09d128a-0198-4cfc-942f-323bd2f41d53 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:03:33 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b09d128a-0198-4cfc-942f-323bd2f41d53 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:03:33 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf59b27f-8bf2-45a5-8ed3-c40554b01e64]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:03:33 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:03:33 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b09d128a-0198-4cfc-942f-323bd2f41d53 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:03:33 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:03:33 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b09d128a-0198-4cfc-942f-323bd2f41d53 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:03:33 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[404f2ee1-7414-4b0f-8847-62310f2fe7da]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:03:33 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:03:33 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b09d128a-0198-4cfc-942f-323bd2f41d53 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dwXLiHIo {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:03:33 user nova-compute[71874]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681315398.801538, e85aa869-0d2a-40ff-9697-f979a6b110cb => Stopped> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:03:33 user nova-compute[71874]: INFO nova.compute.manager [-] [instance: e85aa869-0d2a-40ff-9697-f979a6b110cb] VM Stopped (Lifecycle Event)
Apr 12 16:03:33 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b09d128a-0198-4cfc-942f-323bd2f41d53 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dwXLiHIo" returned: 0 in 0.029s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:03:33 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ff1d13f-24fd-40ad-8514-c151a259c34d]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:03:33 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dwXLiHIo'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:03:33 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b09d128a-0198-4cfc-942f-323bd2f41d53 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:03:33 user nova-compute[71874]: DEBUG nova.compute.manager [None req-9a0511df-ec97-436a-bb3d-37ed43d1518a None None] [instance: e85aa869-0d2a-40ff-9697-f979a6b110cb] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:03:33 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b09d128a-0198-4cfc-942f-323bd2f41d53 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:03:33 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[0270b022-6443-4246-9547-ddf281192787]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:03:33 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:03:33 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:03:33 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:03:33 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[192f8e3c-f436-40aa-9f88-b36f97995620]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6 (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:03:33 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:03:33 user nova-compute[71874]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6 (non-flash)
Apr 12 16:03:33 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:03:33 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:03:33 user nova-compute[71874]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6 (non-flash)
Apr 12 16:03:33 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:03:33 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b09d128a-0198-4cfc-942f-323bd2f41d53 -p 172.16.0.220:3260 --login {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:03:33 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b09d128a-0198-4cfc-942f-323bd2f41d53 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:03:33 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4f40bb7-d74a-448d-8953-afcc99a629e0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b09d128a-0198-4cfc-942f-323bd2f41d53, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b09d128a-0198-4cfc-942f-323bd2f41d53, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:03:33 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b09d128a-0198-4cfc-942f-323bd2f41d53, portal: 172.16.0.220,3260]
Apr 12 16:03:33 user nova-compute[71874]: Login to [iface: default, target: iqn.2010-10.org.openstack:b09d128a-0198-4cfc-942f-323bd2f41d53, portal: 172.16.0.220,3260] successful.
Apr 12 16:03:33 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:03:33 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b09d128a-0198-4cfc-942f-323bd2f41d53 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:03:33 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b09d128a-0198-4cfc-942f-323bd2f41d53 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:03:33 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[5721bd3e-5953-433f-851a-89e9da01ddec]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:03:33 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:03:34 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:03:34 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:03:34 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfa66fba-c87e-4e4e-82b6-9c5f571524f1]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b09d128a-0198-4cfc-942f-323bd2f41d53 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6 (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:03:34 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:03:34 user nova-compute[71874]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b09d128a-0198-4cfc-942f-323bd2f41d53 (non-flash)
Apr 12 16:03:34 user nova-compute[71874]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6 (non-flash)
Apr 12 16:03:34 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:03:34 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:03:34 user nova-compute[71874]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b09d128a-0198-4cfc-942f-323bd2f41d53 (non-flash)
Apr 12 16:03:34 user nova-compute[71874]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6 (non-flash)
Apr 12 16:03:34 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:03:34 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b09d128a-0198-4cfc-942f-323bd2f41d53" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.357s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:03:34 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Connected to 172.16.0.220:3260 {{(pid=71874) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 16:03:34 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] HCTL ('34', '-', '-', 0) found on session 17 with lun 0 {{(pid=71874) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 16:03:34 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71874) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 16:03:34 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:03:34 user nova-compute[71874]: DEBUG nova.compute.manager [req-916e6eb9-e257-4cda-b862-48636bd77ae2 req-c7e4fa53-52df-4f09-b7f0-eca6d1c23759 service nova] [instance: ad0cece6-9b26-4c87-9e48-2c0437cb9190] Received event network-changed-b734d9d7-5bb7-4ca9-a637-9c335398dfc0 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:03:34 user nova-compute[71874]: DEBUG nova.compute.manager [req-916e6eb9-e257-4cda-b862-48636bd77ae2 req-c7e4fa53-52df-4f09-b7f0-eca6d1c23759 service nova] [instance: ad0cece6-9b26-4c87-9e48-2c0437cb9190] Refreshing instance network info cache due to event network-changed-b734d9d7-5bb7-4ca9-a637-9c335398dfc0. {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 16:03:34 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-916e6eb9-e257-4cda-b862-48636bd77ae2 req-c7e4fa53-52df-4f09-b7f0-eca6d1c23759 service nova] Acquiring lock "refresh_cache-ad0cece6-9b26-4c87-9e48-2c0437cb9190" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:03:34 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-916e6eb9-e257-4cda-b862-48636bd77ae2 req-c7e4fa53-52df-4f09-b7f0-eca6d1c23759 service nova] Acquired lock "refresh_cache-ad0cece6-9b26-4c87-9e48-2c0437cb9190" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:03:34 user nova-compute[71874]: DEBUG nova.network.neutron [req-916e6eb9-e257-4cda-b862-48636bd77ae2 req-c7e4fa53-52df-4f09-b7f0-eca6d1c23759 service nova] [instance: ad0cece6-9b26-4c87-9e48-2c0437cb9190] Refreshing network info cache for port b734d9d7-5bb7-4ca9-a637-9c335398dfc0 {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 16:03:34 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.035s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:03:34 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcad2d27-4af0-43cd-93cc-d3f23e55b5be]: (4, ('- - 0', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:03:34 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-a93c5be7-6c20-4ded-9f78-3eae721683f5 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 -F raw /opt/stack/data/nova/instances/fc19fd8d-3285-4ceb-8714-a0ba139f3045/disk" returned: 0 in 2.135s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:03:34 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Searching for a device in session 17 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71874) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 16:03:34 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:b09d128a-0198-4cfc-942f-323bd2f41d53', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dwXLiHIo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71874) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 16:03:34 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-a93c5be7-6c20-4ded-9f78-3eae721683f5 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] Created local disks {{(pid=71874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 16:03:34 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-a93c5be7-6c20-4ded-9f78-3eae721683f5 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] Ensure instance console log exists: /opt/stack/data/nova/instances/fc19fd8d-3285-4ceb-8714-a0ba139f3045/console.log {{(pid=71874) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 16:03:34 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-a93c5be7-6c20-4ded-9f78-3eae721683f5 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:03:34 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-a93c5be7-6c20-4ded-9f78-3eae721683f5 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:03:34 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-a93c5be7-6c20-4ded-9f78-3eae721683f5 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:03:34 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-a93c5be7-6c20-4ded-9f78-3eae721683f5 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] Start _get_guest_xml network_info=[{"id": "12acc77d-6a56-426a-acda-16438c358c44", "address": "fa:16:3e:9f:92:7f", "network": {"id": "eb4dd4b5-96d4-4b53-b510-d41e2775b92f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-596111273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fa122cbabe94c6f93c862b4daf31e50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12acc77d-6a", "ovs_interfaceid": "12acc77d-6a56-426a-acda-16438c358c44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='91316633079ed6c8e06b4a7d072f56f3',container_format='bare',created_at=2023-04-12T16:01:26Z,direct_url=<?>,disk_format='qcow2',id=aea0d05c-bce2-4503-aeaf-6f9933e25a12,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-791161427-shelved',owner='1fa122cbabe94c6f93c862b4daf31e50',properties=ImageMetaProps,protected=<?>,size=38600704,status='active',tags=<?>,updated_at=2023-04-12T16:01:30Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_options': None, 'image_id': '9dc63f14-8b70-4e72-89f2-13464f2f5c7c'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'delete_on_termination': False, 'attachment_id': '938f1a58-a4c3-42e6-97f4-e77ff53f55a9', 'mount_device': '/dev/vdc', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:cfd27585-75c7-4a04-a93a-79e4236a36f7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hWavuZEb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': 'fc19fd8d-3285-4ceb-8714-a0ba139f3045', 'attached_at': '', 'detached_at': '', 'volume_id': 'cfd27585-75c7-4a04-a93a-79e4236a36f7', 'serial': 'cfd27585-75c7-4a04-a93a-79e4236a36f7'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': None, 'volume_type': None} {{(pid=71874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 16:03:34 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-a93c5be7-6c20-4ded-9f78-3eae721683f5 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:03:34 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-a93c5be7-6c20-4ded-9f78-3eae721683f5 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:03:34 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-a93c5be7-6c20-4ded-9f78-3eae721683f5 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71874) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 16:03:34 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-a93c5be7-6c20-4ded-9f78-3eae721683f5 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T15:56:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='91316633079ed6c8e06b4a7d072f56f3',container_format='bare',created_at=2023-04-12T16:01:26Z,direct_url=<?>,disk_format='qcow2',id=aea0d05c-bce2-4503-aeaf-6f9933e25a12,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-791161427-shelved',owner='1fa122cbabe94c6f93c862b4daf31e50',properties=ImageMetaProps,protected=<?>,size=38600704,status='active',tags=<?>,updated_at=2023-04-12T16:01:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 16:03:34 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-a93c5be7-6c20-4ded-9f78-3eae721683f5 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Flavor limits 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 16:03:34 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-a93c5be7-6c20-4ded-9f78-3eae721683f5 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Image limits 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 16:03:34 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-a93c5be7-6c20-4ded-9f78-3eae721683f5 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Flavor pref 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 16:03:34 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-a93c5be7-6c20-4ded-9f78-3eae721683f5 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Image pref 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 16:03:34 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-a93c5be7-6c20-4ded-9f78-3eae721683f5 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 16:03:34 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-a93c5be7-6c20-4ded-9f78-3eae721683f5 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 16:03:34 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-a93c5be7-6c20-4ded-9f78-3eae721683f5 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 16:03:34 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-a93c5be7-6c20-4ded-9f78-3eae721683f5 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Got 1 possible topologies {{(pid=71874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 16:03:34 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-a93c5be7-6c20-4ded-9f78-3eae721683f5 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 16:03:34 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-a93c5be7-6c20-4ded-9f78-3eae721683f5 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 16:03:34 user nova-compute[71874]: DEBUG nova.objects.instance [None req-a93c5be7-6c20-4ded-9f78-3eae721683f5 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lazy-loading 'vcpu_model' on Instance uuid fc19fd8d-3285-4ceb-8714-a0ba139f3045 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:03:34 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a93c5be7-6c20-4ded-9f78-3eae721683f5 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] Calling os-brick to attach iSCSI Volume {{(pid=71874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 16:03:34 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-a93c5be7-6c20-4ded-9f78-3eae721683f5 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3c0216320>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cfd27585-75c7-4a04-a93a-79e4236a36f7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hWavuZEb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:03:34 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-a93c5be7-6c20-4ded-9f78-3eae721683f5 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:03:34 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-a93c5be7-6c20-4ded-9f78-3eae721683f5 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:03:34 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-6348be2b-b3c4-4a5d-8ef5-be94edc1af79 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "ad0cece6-9b26-4c87-9e48-2c0437cb9190" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:03:34 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-6348be2b-b3c4-4a5d-8ef5-be94edc1af79 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "ad0cece6-9b26-4c87-9e48-2c0437cb9190" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:03:34 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-6348be2b-b3c4-4a5d-8ef5-be94edc1af79 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "ad0cece6-9b26-4c87-9e48-2c0437cb9190-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:03:34 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-6348be2b-b3c4-4a5d-8ef5-be94edc1af79 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "ad0cece6-9b26-4c87-9e48-2c0437cb9190-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:03:34 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-6348be2b-b3c4-4a5d-8ef5-be94edc1af79 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "ad0cece6-9b26-4c87-9e48-2c0437cb9190-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:03:34 user nova-compute[71874]: INFO nova.compute.manager [None req-6348be2b-b3c4-4a5d-8ef5-be94edc1af79 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: ad0cece6-9b26-4c87-9e48-2c0437cb9190] Terminating instance
Apr 12 16:03:34 user nova-compute[71874]: DEBUG nova.compute.manager [None req-6348be2b-b3c4-4a5d-8ef5-be94edc1af79 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: ad0cece6-9b26-4c87-9e48-2c0437cb9190] Start destroying the instance on the hypervisor. {{(pid=71874) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 16:03:34 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:03:34 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:03:34 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:03:35 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.415s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:03:35 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] <== connect_volume: return (1419ms) {'type': 'block', 'scsi_wwn': '26536373864373666', 'path': '/dev/sdc'} {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:03:35 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26536373864373666', 'path': '/dev/sdc'} {{(pid=71874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 16:03:35 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-a93c5be7-6c20-4ded-9f78-3eae721683f5 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.910s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:03:35 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-a93c5be7-6c20-4ded-9f78-3eae721683f5 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:03:35 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-a93c5be7-6c20-4ded-9f78-3eae721683f5 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cfd27585-75c7-4a04-a93a-79e4236a36f7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:03:35 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-a93c5be7-6c20-4ded-9f78-3eae721683f5 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cfd27585-75c7-4a04-a93a-79e4236a36f7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.006s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:03:35 user nova-compute[71874]: INFO os_brick.initiator.connectors.iscsi [None req-a93c5be7-6c20-4ded-9f78-3eae721683f5 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 16:03:35 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfd27585-75c7-4a04-a93a-79e4236a36f7 -p 172.16.0.220:3260 {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:03:35 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfd27585-75c7-4a04-a93a-79e4236a36f7 -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:03:35 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[e87a1893-e899-4e46-bf22-681013ad4c8f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:03:35 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-a93c5be7-6c20-4ded-9f78-3eae721683f5 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 16:03:35 user nova-compute[71874]:  {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:03:35 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfd27585-75c7-4a04-a93a-79e4236a36f7 -p 172.16.0.220:3260 --interface default --op new {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:03:35 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfd27585-75c7-4a04-a93a-79e4236a36f7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:03:35 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2bea501-1d27-4f2f-bec3-45251759a34f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cfd27585-75c7-4a04-a93a-79e4236a36f7] added\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:03:35 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-a93c5be7-6c20-4ded-9f78-3eae721683f5 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cfd27585-75c7-4a04-a93a-79e4236a36f7] added
Apr 12 16:03:35 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:03:35 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfd27585-75c7-4a04-a93a-79e4236a36f7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:03:35 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-12T15:59:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1390712116',display_name='tempest-ServerActionsTestJSON-server-416657090',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1390712116',id=4,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNmXVADjvoPSh3uGCGCTNS/vcfcDtUjn/vZEaV3bCllfz1ZO8VIgFuZhP+mAsa+G/KA4ubi5U9Vj41YtHGsakdPR5VoByhorvfUv/PIWtER2tn1LWX2mlFyT+T8AEJplPw==',key_name='tempest-keypair-1923467613',keypairs=<?>,launch_index=0,launched_at=2023-04-12T15:59:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='97ea81bd1962466bbe552424973f71a8',ramdisk_id='',reservation_id='r-y3c7iw20',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-631887779',owner_user_name='tempest-ServerActionsTestJSON-631887779-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T16:03:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1a699b3ba8304eadb8a53d465ea340cf',uuid=dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "18196ae0-d9c1-4814-8803-c4ba8ad4ab45", "address": "fa:16:3e:98:72:fa", "network": {"id": "e6694358-e361-4952-b859-93755c11721e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-667152893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97ea81bd1962466bbe552424973f71a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18196ae0-d9", "ovs_interfaceid": "18196ae0-d9c1-4814-8803-c4ba8ad4ab45", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 16:03:35 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Converting VIF {"id": "18196ae0-d9c1-4814-8803-c4ba8ad4ab45", "address": "fa:16:3e:98:72:fa", "network": {"id": "e6694358-e361-4952-b859-93755c11721e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-667152893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97ea81bd1962466bbe552424973f71a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18196ae0-d9", "ovs_interfaceid": "18196ae0-d9c1-4814-8803-c4ba8ad4ab45", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:03:35 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:98:72:fa,bridge_name='br-int',has_traffic_filtering=True,id=18196ae0-d9c1-4814-8803-c4ba8ad4ab45,network=Network(e6694358-e361-4952-b859-93755c11721e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18196ae0-d9') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:03:35 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] End _get_guest_xml xml=<domain type="kvm">
Apr 12 16:03:35 user nova-compute[71874]:   <uuid>dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1</uuid>
Apr 12 16:03:35 user nova-compute[71874]:   <name>instance-00000004</name>
Apr 12 16:03:35 user nova-compute[71874]:   <memory>131072</memory>
Apr 12 16:03:35 user nova-compute[71874]:   <vcpu>1</vcpu>
Apr 12 16:03:35 user nova-compute[71874]:   <metadata>
Apr 12 16:03:35 user nova-compute[71874]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 16:03:35 user nova-compute[71874]:       <nova:package version="0.0.0"/>
Apr 12 16:03:35 user nova-compute[71874]:       <nova:name>tempest-ServerActionsTestJSON-server-416657090</nova:name>
Apr 12 16:03:35 user nova-compute[71874]:       <nova:creationTime>2023-04-12 16:03:33</nova:creationTime>
Apr 12 16:03:35 user nova-compute[71874]:       <nova:flavor name="m1.nano">
Apr 12 16:03:35 user nova-compute[71874]:         <nova:memory>128</nova:memory>
Apr 12 16:03:35 user nova-compute[71874]:         <nova:disk>1</nova:disk>
Apr 12 16:03:35 user nova-compute[71874]:         <nova:swap>0</nova:swap>
Apr 12 16:03:35 user nova-compute[71874]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 16:03:35 user nova-compute[71874]:         <nova:vcpus>1</nova:vcpus>
Apr 12 16:03:35 user nova-compute[71874]:       </nova:flavor>
Apr 12 16:03:35 user nova-compute[71874]:       <nova:owner>
Apr 12 16:03:35 user nova-compute[71874]:         <nova:user uuid="1a699b3ba8304eadb8a53d465ea340cf">tempest-ServerActionsTestJSON-631887779-project-member</nova:user>
Apr 12 16:03:35 user nova-compute[71874]:         <nova:project uuid="97ea81bd1962466bbe552424973f71a8">tempest-ServerActionsTestJSON-631887779</nova:project>
Apr 12 16:03:35 user nova-compute[71874]:       </nova:owner>
Apr 12 16:03:35 user nova-compute[71874]:       <nova:root type="image" uuid="9dc63f14-8b70-4e72-89f2-13464f2f5c7c"/>
Apr 12 16:03:35 user nova-compute[71874]:       <nova:ports>
Apr 12 16:03:35 user nova-compute[71874]:         <nova:port uuid="18196ae0-d9c1-4814-8803-c4ba8ad4ab45">
Apr 12 16:03:35 user nova-compute[71874]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 12 16:03:35 user nova-compute[71874]:         </nova:port>
Apr 12 16:03:35 user nova-compute[71874]:       </nova:ports>
Apr 12 16:03:35 user nova-compute[71874]:     </nova:instance>
Apr 12 16:03:35 user nova-compute[71874]:   </metadata>
Apr 12 16:03:35 user nova-compute[71874]:   <sysinfo type="smbios">
Apr 12 16:03:35 user nova-compute[71874]:     <system>
Apr 12 16:03:35 user nova-compute[71874]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 16:03:35 user nova-compute[71874]:       <entry name="product">OpenStack Nova</entry>
Apr 12 16:03:35 user nova-compute[71874]:       <entry name="version">0.0.0</entry>
Apr 12 16:03:35 user nova-compute[71874]:       <entry name="serial">dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1</entry>
Apr 12 16:03:35 user nova-compute[71874]:       <entry name="uuid">dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1</entry>
Apr 12 16:03:35 user nova-compute[71874]:       <entry name="family">Virtual Machine</entry>
Apr 12 16:03:35 user nova-compute[71874]:     </system>
Apr 12 16:03:35 user nova-compute[71874]:   </sysinfo>
Apr 12 16:03:35 user nova-compute[71874]:   <os>
Apr 12 16:03:35 user nova-compute[71874]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 16:03:35 user nova-compute[71874]:     <boot dev="hd"/>
Apr 12 16:03:35 user nova-compute[71874]:     <smbios mode="sysinfo"/>
Apr 12 16:03:35 user nova-compute[71874]:   </os>
Apr 12 16:03:35 user nova-compute[71874]:   <features>
Apr 12 16:03:35 user nova-compute[71874]:     <acpi/>
Apr 12 16:03:35 user nova-compute[71874]:     <apic/>
Apr 12 16:03:35 user nova-compute[71874]:     <vmcoreinfo/>
Apr 12 16:03:35 user nova-compute[71874]:   </features>
Apr 12 16:03:35 user nova-compute[71874]:   <clock offset="utc">
Apr 12 16:03:35 user nova-compute[71874]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 16:03:35 user nova-compute[71874]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 16:03:35 user nova-compute[71874]:     <timer name="hpet" present="no"/>
Apr 12 16:03:35 user nova-compute[71874]:   </clock>
Apr 12 16:03:35 user nova-compute[71874]:   <cpu mode="custom" match="exact">
Apr 12 16:03:35 user nova-compute[71874]:     <model>Nehalem</model>
Apr 12 16:03:35 user nova-compute[71874]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 16:03:35 user nova-compute[71874]:   </cpu>
Apr 12 16:03:35 user nova-compute[71874]:   <devices>
Apr 12 16:03:35 user nova-compute[71874]:     <disk type="file" device="disk">
Apr 12 16:03:35 user nova-compute[71874]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 16:03:35 user nova-compute[71874]:       <source file="/opt/stack/data/nova/instances/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1/disk"/>
Apr 12 16:03:35 user nova-compute[71874]:       <target dev="vda" bus="virtio"/>
Apr 12 16:03:35 user nova-compute[71874]:     </disk>
Apr 12 16:03:35 user nova-compute[71874]:     <disk type="block" device="disk">
Apr 12 16:03:35 user nova-compute[71874]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 16:03:35 user nova-compute[71874]:       <source dev="/dev/sdc"/>
Apr 12 16:03:35 user nova-compute[71874]:       <target dev="vdb" bus="virtio"/>
Apr 12 16:03:35 user nova-compute[71874]:       <serial>b09d128a-0198-4cfc-942f-323bd2f41d53</serial>
Apr 12 16:03:35 user nova-compute[71874]:     </disk>
Apr 12 16:03:35 user nova-compute[71874]:     <interface type="ethernet">
Apr 12 16:03:35 user nova-compute[71874]:       <mac address="fa:16:3e:98:72:fa"/>
Apr 12 16:03:35 user nova-compute[71874]:       <model type="virtio"/>
Apr 12 16:03:35 user nova-compute[71874]:       <mtu size="1442"/>
Apr 12 16:03:35 user nova-compute[71874]:       <target dev="tap18196ae0-d9"/>
Apr 12 16:03:35 user nova-compute[71874]:     </interface>
Apr 12 16:03:35 user nova-compute[71874]:     <serial type="pty">
Apr 12 16:03:35 user nova-compute[71874]:       <log file="/opt/stack/data/nova/instances/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1/console.log" append="off"/>
Apr 12 16:03:35 user nova-compute[71874]:     </serial>
Apr 12 16:03:35 user nova-compute[71874]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 16:03:35 user nova-compute[71874]:     <video>
Apr 12 16:03:35 user nova-compute[71874]:       <model type="virtio"/>
Apr 12 16:03:35 user nova-compute[71874]:     </video>
Apr 12 16:03:35 user nova-compute[71874]:     <rng model="virtio">
Apr 12 16:03:35 user nova-compute[71874]:       <backend model="random">/dev/urandom</backend>
Apr 12 16:03:35 user nova-compute[71874]:     </rng>
Apr 12 16:03:35 user nova-compute[71874]:     <controller type="usb" index="0" model="none"/>
Apr 12 16:03:35 user nova-compute[71874]:     <memballoon model="virtio">
Apr 12 16:03:35 user nova-compute[71874]:       <stats period="10"/>
Apr 12 16:03:35 user nova-compute[71874]:     </memballoon>
Apr 12 16:03:35 user nova-compute[71874]:   </devices>
Apr 12 16:03:35 user nova-compute[71874]: </domain>
Apr 12 16:03:35 user nova-compute[71874]:  {{(pid=71874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 16:03:35 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-12T15:59:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1390712116',display_name='tempest-ServerActionsTestJSON-server-416657090',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1390712116',id=4,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNmXVADjvoPSh3uGCGCTNS/vcfcDtUjn/vZEaV3bCllfz1ZO8VIgFuZhP+mAsa+G/KA4ubi5U9Vj41YtHGsakdPR5VoByhorvfUv/PIWtER2tn1LWX2mlFyT+T8AEJplPw==',key_name='tempest-keypair-1923467613',keypairs=<?>,launch_index=0,launched_at=2023-04-12T15:59:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='97ea81bd1962466bbe552424973f71a8',ramdisk_id='',reservation_id='r-y3c7iw20',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-631887779',owner_user_name='tempest-ServerActionsTestJSON-631887779-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T16:03:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1a699b3ba8304eadb8a53d465ea340cf',uuid=dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "18196ae0-d9c1-4814-8803-c4ba8ad4ab45", "address": "fa:16:3e:98:72:fa", "network": {"id": "e6694358-e361-4952-b859-93755c11721e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-667152893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97ea81bd1962466bbe552424973f71a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18196ae0-d9", "ovs_interfaceid": "18196ae0-d9c1-4814-8803-c4ba8ad4ab45", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 16:03:35 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Converting VIF {"id": "18196ae0-d9c1-4814-8803-c4ba8ad4ab45", "address": "fa:16:3e:98:72:fa", "network": {"id": "e6694358-e361-4952-b859-93755c11721e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-667152893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97ea81bd1962466bbe552424973f71a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18196ae0-d9", "ovs_interfaceid": "18196ae0-d9c1-4814-8803-c4ba8ad4ab45", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:03:35 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:98:72:fa,bridge_name='br-int',has_traffic_filtering=True,id=18196ae0-d9c1-4814-8803-c4ba8ad4ab45,network=Network(e6694358-e361-4952-b859-93755c11721e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18196ae0-d9') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:03:35 user nova-compute[71874]: DEBUG os_vif [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:98:72:fa,bridge_name='br-int',has_traffic_filtering=True,id=18196ae0-d9c1-4814-8803-c4ba8ad4ab45,network=Network(e6694358-e361-4952-b859-93755c11721e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18196ae0-d9') {{(pid=71874) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 16:03:35 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:03:35 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:03:35 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 16:03:35 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:03:35 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap18196ae0-d9, may_exist=True) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:03:35 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap18196ae0-d9, col_values=(('external_ids', {'iface-id': '18196ae0-d9c1-4814-8803-c4ba8ad4ab45', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:98:72:fa', 'vm-uuid': 'dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1'}),)) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:03:35 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:03:35 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:03:35 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfd27585-75c7-4a04-a93a-79e4236a36f7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.033s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:03:35 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[13e65d57-cdee-4649-a45d-09567a840e23]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:03:35 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-a93c5be7-6c20-4ded-9f78-3eae721683f5 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:03:35 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfd27585-75c7-4a04-a93a-79e4236a36f7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:03:35 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:03:35 user nova-compute[71874]: INFO os_vif [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:98:72:fa,bridge_name='br-int',has_traffic_filtering=True,id=18196ae0-d9c1-4814-8803-c4ba8ad4ab45,network=Network(e6694358-e361-4952-b859-93755c11721e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18196ae0-d9')
Apr 12 16:03:35 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfd27585-75c7-4a04-a93a-79e4236a36f7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:03:35 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[0040b1bf-fc71-482c-b324-b732a157406c]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:03:35 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-a93c5be7-6c20-4ded-9f78-3eae721683f5 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:03:35 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfd27585-75c7-4a04-a93a-79e4236a36f7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hWavuZEb {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:03:35 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfd27585-75c7-4a04-a93a-79e4236a36f7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hWavuZEb" returned: 0 in 0.025s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:03:35 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[52de352b-ee21-4501-b738-57620415c178]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:03:35 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-a93c5be7-6c20-4ded-9f78-3eae721683f5 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hWavuZEb'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:03:35 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfd27585-75c7-4a04-a93a-79e4236a36f7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:03:35 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfd27585-75c7-4a04-a93a-79e4236a36f7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:03:35 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[249e8071-0254-4aaa-b7f1-722736f68ee5]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:03:35 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-a93c5be7-6c20-4ded-9f78-3eae721683f5 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:03:35 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:03:35 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] No BDM found with device name vda, not building metadata. {{(pid=71874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 16:03:35 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 16:03:35 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] No VIF found with MAC fa:16:3e:98:72:fa, not building metadata {{(pid=71874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 16:03:35 user nova-compute[71874]: DEBUG nova.network.neutron [req-916e6eb9-e257-4cda-b862-48636bd77ae2 req-c7e4fa53-52df-4f09-b7f0-eca6d1c23759 service nova] [instance: ad0cece6-9b26-4c87-9e48-2c0437cb9190] Updated VIF entry in instance network info cache for port b734d9d7-5bb7-4ca9-a637-9c335398dfc0. {{(pid=71874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 16:03:35 user nova-compute[71874]: DEBUG nova.network.neutron [req-916e6eb9-e257-4cda-b862-48636bd77ae2 req-c7e4fa53-52df-4f09-b7f0-eca6d1c23759 service nova] [instance: ad0cece6-9b26-4c87-9e48-2c0437cb9190] Updating instance_info_cache with network_info: [{"id": "b734d9d7-5bb7-4ca9-a637-9c335398dfc0", "address": "fa:16:3e:b9:28:73", "network": {"id": "e71b9966-9a95-4f66-b3b1-36b05d05853c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-310205564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28d940eae5394293b87cfced45911ab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb734d9d7-5b", "ovs_interfaceid": "b734d9d7-5bb7-4ca9-a637-9c335398dfc0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:03:35 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:03:35 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[375c87ef-3de8-4f3d-bc33-3e66a1e2b8a5]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b09d128a-0198-4cfc-942f-323bd2f41d53 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6 (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:03:35 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-a93c5be7-6c20-4ded-9f78-3eae721683f5 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:03:35 user nova-compute[71874]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b09d128a-0198-4cfc-942f-323bd2f41d53 (non-flash)
Apr 12 16:03:35 user nova-compute[71874]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6 (non-flash)
Apr 12 16:03:35 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:03:35 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-a93c5be7-6c20-4ded-9f78-3eae721683f5 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:03:35 user nova-compute[71874]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b09d128a-0198-4cfc-942f-323bd2f41d53 (non-flash)
Apr 12 16:03:35 user nova-compute[71874]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6 (non-flash)
Apr 12 16:03:35 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:03:35 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfd27585-75c7-4a04-a93a-79e4236a36f7 -p 172.16.0.220:3260 --login {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:03:35 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-916e6eb9-e257-4cda-b862-48636bd77ae2 req-c7e4fa53-52df-4f09-b7f0-eca6d1c23759 service nova] Releasing lock "refresh_cache-ad0cece6-9b26-4c87-9e48-2c0437cb9190" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:03:35 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfd27585-75c7-4a04-a93a-79e4236a36f7 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:03:35 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6e52ebb-b31f-4ae2-ab88-be8a47ea79c2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cfd27585-75c7-4a04-a93a-79e4236a36f7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cfd27585-75c7-4a04-a93a-79e4236a36f7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:03:35 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-a93c5be7-6c20-4ded-9f78-3eae721683f5 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cfd27585-75c7-4a04-a93a-79e4236a36f7, portal: 172.16.0.220,3260]
Apr 12 16:03:35 user nova-compute[71874]: Login to [iface: default, target: iqn.2010-10.org.openstack:cfd27585-75c7-4a04-a93a-79e4236a36f7, portal: 172.16.0.220,3260] successful.
Apr 12 16:03:35 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:03:35 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfd27585-75c7-4a04-a93a-79e4236a36f7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:03:35 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:03:35 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfd27585-75c7-4a04-a93a-79e4236a36f7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:03:35 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc74e238-ac63-480e-8e7c-61774b2832af]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:03:35 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-a93c5be7-6c20-4ded-9f78-3eae721683f5 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:03:35 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:03:35 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:03:35 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aaa7076-da60-4a4c-bbfb-f5d180cfcc4a]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b09d128a-0198-4cfc-942f-323bd2f41d53 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfd27585-75c7-4a04-a93a-79e4236a36f7 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6 (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:03:35 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-a93c5be7-6c20-4ded-9f78-3eae721683f5 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:03:35 user nova-compute[71874]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b09d128a-0198-4cfc-942f-323bd2f41d53 (non-flash)
Apr 12 16:03:35 user nova-compute[71874]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfd27585-75c7-4a04-a93a-79e4236a36f7 (non-flash)
Apr 12 16:03:35 user nova-compute[71874]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6 (non-flash)
Apr 12 16:03:35 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:03:35 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-a93c5be7-6c20-4ded-9f78-3eae721683f5 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:03:35 user nova-compute[71874]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b09d128a-0198-4cfc-942f-323bd2f41d53 (non-flash)
Apr 12 16:03:35 user nova-compute[71874]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfd27585-75c7-4a04-a93a-79e4236a36f7 (non-flash)
Apr 12 16:03:35 user nova-compute[71874]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6 (non-flash)
Apr 12 16:03:35 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:03:35 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-a93c5be7-6c20-4ded-9f78-3eae721683f5 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cfd27585-75c7-4a04-a93a-79e4236a36f7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.376s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:03:35 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-a93c5be7-6c20-4ded-9f78-3eae721683f5 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Connected to 172.16.0.220:3260 {{(pid=71874) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 16:03:35 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-a93c5be7-6c20-4ded-9f78-3eae721683f5 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] HCTL ('35', '-', '-', 0) found on session 18 with lun 0 {{(pid=71874) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 16:03:35 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-a93c5be7-6c20-4ded-9f78-3eae721683f5 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71874) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 16:03:35 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:03:35 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.022s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:03:35 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b825ffc-4272-4f63-93d9-3e2b40dd4c60]: (4, ('- - 0', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:03:35 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-a93c5be7-6c20-4ded-9f78-3eae721683f5 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Searching for a device in session 18 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71874) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 16:03:35 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-a93c5be7-6c20-4ded-9f78-3eae721683f5 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:cfd27585-75c7-4a04-a93a-79e4236a36f7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hWavuZEb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71874) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 16:03:35 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-f9137bed-fd6d-492e-bd2b-f5611b5b6548 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Acquiring lock "ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:03:35 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-f9137bed-fd6d-492e-bd2b-f5611b5b6548 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Lock "ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:03:35 user nova-compute[71874]: DEBUG nova.compute.manager [None req-f9137bed-fd6d-492e-bd2b-f5611b5b6548 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] [instance: ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e] Starting instance... {{(pid=71874) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 16:03:35 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-f9137bed-fd6d-492e-bd2b-f5611b5b6548 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:03:35 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-f9137bed-fd6d-492e-bd2b-f5611b5b6548 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:03:35 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-f9137bed-fd6d-492e-bd2b-f5611b5b6548 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71874) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 16:03:35 user nova-compute[71874]: INFO nova.compute.claims [None req-f9137bed-fd6d-492e-bd2b-f5611b5b6548 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] [instance: ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e] Claim successful on node user
Apr 12 16:03:35 user nova-compute[71874]: INFO nova.virt.libvirt.driver [-] [instance: ad0cece6-9b26-4c87-9e48-2c0437cb9190] Instance destroyed successfully.
Apr 12 16:03:35 user nova-compute[71874]: DEBUG nova.objects.instance [None req-6348be2b-b3c4-4a5d-8ef5-be94edc1af79 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lazy-loading 'resources' on Instance uuid ad0cece6-9b26-4c87-9e48-2c0437cb9190 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:03:35 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-6348be2b-b3c4-4a5d-8ef5-be94edc1af79 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T16:01:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2145243343',display_name='tempest-AttachVolumeNegativeTest-server-2145243343',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2145243343',id=14,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAJELhHYsdQbAcbonk0277g3DJfP1LvsNujwWmlOlhfoJ8a2xLQrIa61OTMaRnrdudqA+4xM9N9X+ZeIYSCcD9wAL76iQKzBebuY1vOBSqr/XwJdRR6IbRCAYmOPGIb2tg==',key_name='tempest-keypair-42069222',keypairs=<?>,launch_index=0,launched_at=2023-04-12T16:01:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='28d940eae5394293b87cfced45911ab4',ramdisk_id='',reservation_id='r-uwxcw57z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-288610953',owner_user_name='tempest-AttachVolumeNegativeTest-288610953-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T16:01:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5a514f6d877a4ab0bec597fee13ce9db',uuid=ad0cece6-9b26-4c87-9e48-2c0437cb9190,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b734d9d7-5bb7-4ca9-a637-9c335398dfc0", "address": "fa:16:3e:b9:28:73", "network": {"id": "e71b9966-9a95-4f66-b3b1-36b05d05853c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-310205564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28d940eae5394293b87cfced45911ab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb734d9d7-5b", "ovs_interfaceid": "b734d9d7-5bb7-4ca9-a637-9c335398dfc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 16:03:35 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-6348be2b-b3c4-4a5d-8ef5-be94edc1af79 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Converting VIF {"id": "b734d9d7-5bb7-4ca9-a637-9c335398dfc0", "address": "fa:16:3e:b9:28:73", "network": {"id": "e71b9966-9a95-4f66-b3b1-36b05d05853c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-310205564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28d940eae5394293b87cfced45911ab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb734d9d7-5b", "ovs_interfaceid": "b734d9d7-5bb7-4ca9-a637-9c335398dfc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:03:35 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-6348be2b-b3c4-4a5d-8ef5-be94edc1af79 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:28:73,bridge_name='br-int',has_traffic_filtering=True,id=b734d9d7-5bb7-4ca9-a637-9c335398dfc0,network=Network(e71b9966-9a95-4f66-b3b1-36b05d05853c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb734d9d7-5b') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:03:35 user nova-compute[71874]: DEBUG os_vif [None req-6348be2b-b3c4-4a5d-8ef5-be94edc1af79 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:28:73,bridge_name='br-int',has_traffic_filtering=True,id=b734d9d7-5bb7-4ca9-a637-9c335398dfc0,network=Network(e71b9966-9a95-4f66-b3b1-36b05d05853c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb734d9d7-5b') {{(pid=71874) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 16:03:35 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:03:35 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb734d9d7-5b, bridge=br-int, if_exists=True) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:03:35 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:03:35 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:03:36 user nova-compute[71874]: INFO os_vif [None req-6348be2b-b3c4-4a5d-8ef5-be94edc1af79 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:28:73,bridge_name='br-int',has_traffic_filtering=True,id=b734d9d7-5bb7-4ca9-a637-9c335398dfc0,network=Network(e71b9966-9a95-4f66-b3b1-36b05d05853c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb734d9d7-5b')
Apr 12 16:03:36 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-6348be2b-b3c4-4a5d-8ef5-be94edc1af79 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: ad0cece6-9b26-4c87-9e48-2c0437cb9190] Deleting instance files /opt/stack/data/nova/instances/ad0cece6-9b26-4c87-9e48-2c0437cb9190_del
Apr 12 16:03:36 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-6348be2b-b3c4-4a5d-8ef5-be94edc1af79 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: ad0cece6-9b26-4c87-9e48-2c0437cb9190] Deletion of /opt/stack/data/nova/instances/ad0cece6-9b26-4c87-9e48-2c0437cb9190_del complete
Apr 12 16:03:36 user nova-compute[71874]: INFO nova.compute.manager [None req-6348be2b-b3c4-4a5d-8ef5-be94edc1af79 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: ad0cece6-9b26-4c87-9e48-2c0437cb9190] Took 1.59 seconds to destroy the instance on the hypervisor.
Apr 12 16:03:36 user nova-compute[71874]: DEBUG oslo.service.loopingcall [None req-6348be2b-b3c4-4a5d-8ef5-be94edc1af79 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71874) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 16:03:36 user nova-compute[71874]: DEBUG nova.compute.manager [-] [instance: ad0cece6-9b26-4c87-9e48-2c0437cb9190] Deallocating network for instance {{(pid=71874) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 16:03:36 user nova-compute[71874]: DEBUG nova.network.neutron [-] [instance: ad0cece6-9b26-4c87-9e48-2c0437cb9190] deallocate_for_instance() {{(pid=71874) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 16:03:36 user nova-compute[71874]: DEBUG nova.compute.manager [req-2e1a3304-0d22-4c5e-b166-a37dc6f2a1c4 req-1ffcd91f-49ab-4332-9fa9-1b159a241411 service nova] [instance: ad0cece6-9b26-4c87-9e48-2c0437cb9190] Received event network-vif-unplugged-b734d9d7-5bb7-4ca9-a637-9c335398dfc0 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:03:36 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-2e1a3304-0d22-4c5e-b166-a37dc6f2a1c4 req-1ffcd91f-49ab-4332-9fa9-1b159a241411 service nova] Acquiring lock "ad0cece6-9b26-4c87-9e48-2c0437cb9190-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:03:36 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-2e1a3304-0d22-4c5e-b166-a37dc6f2a1c4 req-1ffcd91f-49ab-4332-9fa9-1b159a241411 service nova] Lock "ad0cece6-9b26-4c87-9e48-2c0437cb9190-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:03:36 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-2e1a3304-0d22-4c5e-b166-a37dc6f2a1c4 req-1ffcd91f-49ab-4332-9fa9-1b159a241411 service nova] Lock "ad0cece6-9b26-4c87-9e48-2c0437cb9190-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:03:36 user nova-compute[71874]: DEBUG nova.compute.manager [req-2e1a3304-0d22-4c5e-b166-a37dc6f2a1c4 req-1ffcd91f-49ab-4332-9fa9-1b159a241411 service nova] [instance: ad0cece6-9b26-4c87-9e48-2c0437cb9190] No waiting events found dispatching network-vif-unplugged-b734d9d7-5bb7-4ca9-a637-9c335398dfc0 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:03:36 user nova-compute[71874]: DEBUG nova.compute.manager [req-2e1a3304-0d22-4c5e-b166-a37dc6f2a1c4 req-1ffcd91f-49ab-4332-9fa9-1b159a241411 service nova] [instance: ad0cece6-9b26-4c87-9e48-2c0437cb9190] Received event network-vif-unplugged-b734d9d7-5bb7-4ca9-a637-9c335398dfc0 for instance with task_state deleting. {{(pid=71874) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 16:03:36 user nova-compute[71874]: DEBUG nova.compute.manager [req-2e1a3304-0d22-4c5e-b166-a37dc6f2a1c4 req-1ffcd91f-49ab-4332-9fa9-1b159a241411 service nova] [instance: ad0cece6-9b26-4c87-9e48-2c0437cb9190] Received event network-vif-plugged-b734d9d7-5bb7-4ca9-a637-9c335398dfc0 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:03:36 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-2e1a3304-0d22-4c5e-b166-a37dc6f2a1c4 req-1ffcd91f-49ab-4332-9fa9-1b159a241411 service nova] Acquiring lock "ad0cece6-9b26-4c87-9e48-2c0437cb9190-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:03:36 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-2e1a3304-0d22-4c5e-b166-a37dc6f2a1c4 req-1ffcd91f-49ab-4332-9fa9-1b159a241411 service nova] Lock "ad0cece6-9b26-4c87-9e48-2c0437cb9190-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:03:36 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-2e1a3304-0d22-4c5e-b166-a37dc6f2a1c4 req-1ffcd91f-49ab-4332-9fa9-1b159a241411 service nova] Lock "ad0cece6-9b26-4c87-9e48-2c0437cb9190-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:03:36 user nova-compute[71874]: DEBUG nova.compute.manager [req-2e1a3304-0d22-4c5e-b166-a37dc6f2a1c4 req-1ffcd91f-49ab-4332-9fa9-1b159a241411 service nova] [instance: ad0cece6-9b26-4c87-9e48-2c0437cb9190] No waiting events found dispatching network-vif-plugged-b734d9d7-5bb7-4ca9-a637-9c335398dfc0 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:03:36 user nova-compute[71874]: WARNING nova.compute.manager [req-2e1a3304-0d22-4c5e-b166-a37dc6f2a1c4 req-1ffcd91f-49ab-4332-9fa9-1b159a241411 service nova] [instance: ad0cece6-9b26-4c87-9e48-2c0437cb9190] Received unexpected event network-vif-plugged-b734d9d7-5bb7-4ca9-a637-9c335398dfc0 for instance with vm_state active and task_state deleting.
Apr 12 16:03:36 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-f9137bed-fd6d-492e-bd2b-f5611b5b6548 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Inventory has not changed in ProviderTree for provider: 0e94b4c8-cd49-45e4-9133-d36eb4b2456b {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 16:03:36 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-f9137bed-fd6d-492e-bd2b-f5611b5b6548 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Inventory has not changed for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 16:03:36 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-f9137bed-fd6d-492e-bd2b-f5611b5b6548 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.508s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:03:36 user nova-compute[71874]: DEBUG nova.compute.manager [None req-f9137bed-fd6d-492e-bd2b-f5611b5b6548 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] [instance: ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e] Start building networks asynchronously for instance. {{(pid=71874) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 16:03:36 user nova-compute[71874]: DEBUG nova.compute.manager [None req-f9137bed-fd6d-492e-bd2b-f5611b5b6548 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] [instance: ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e] Allocating IP information in the background. {{(pid=71874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 16:03:36 user nova-compute[71874]: DEBUG nova.network.neutron [None req-f9137bed-fd6d-492e-bd2b-f5611b5b6548 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] [instance: ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e] allocate_for_instance() {{(pid=71874) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 16:03:36 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-f9137bed-fd6d-492e-bd2b-f5611b5b6548 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] [instance: ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 16:03:36 user nova-compute[71874]: DEBUG nova.compute.manager [None req-f9137bed-fd6d-492e-bd2b-f5611b5b6548 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] [instance: ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e] Start building block device mappings for instance. {{(pid=71874) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 16:03:36 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-a93c5be7-6c20-4ded-9f78-3eae721683f5 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.420s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:03:36 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-a93c5be7-6c20-4ded-9f78-3eae721683f5 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] <== connect_volume: return (2330ms) {'type': 'block', 'scsi_wwn': '26434363732393036', 'path': '/dev/sdd'} {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:03:36 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a93c5be7-6c20-4ded-9f78-3eae721683f5 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26434363732393036', 'path': '/dev/sdd'} {{(pid=71874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 16:03:36 user nova-compute[71874]: DEBUG nova.policy [None req-f9137bed-fd6d-492e-bd2b-f5611b5b6548 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2b65791f14d34508b8a9a0849a9bf89e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f559719f5f43c3a47a0aaf1e699193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71874) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 16:03:36 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-a93c5be7-6c20-4ded-9f78-3eae721683f5 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-12T15:59:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-791161427',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-791161427',id=5,image_ref='aea0d05c-bce2-4503-aeaf-6f9933e25a12',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-1362669684',keypairs=<?>,launch_index=0,launched_at=2023-04-12T15:59:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='1fa122cbabe94c6f93c862b4daf31e50',ramdisk_id='',reservation_id='r-z1kj5zi3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-292107264',owner_user_name='tempest-AttachVolumeShelveTestJSON-292107264-project-member',shelved_at='2023-04-12T16:01:30.562588',shelved_host='user',shelved_image_id='aea0d05c-bce2-4503-aeaf-6f9933e25a12'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T16:03:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c1abec24caf74dc8a27b64c21a9d4a59',uuid=fc19fd8d-3285-4ceb-8714-a0ba139f3045,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "12acc77d-6a56-426a-acda-16438c358c44", "address": "fa:16:3e:9f:92:7f", "network": {"id": "eb4dd4b5-96d4-4b53-b510-d41e2775b92f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-596111273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fa122cbabe94c6f93c862b4daf31e50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12acc77d-6a", "ovs_interfaceid": "12acc77d-6a56-426a-acda-16438c358c44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 16:03:36 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-a93c5be7-6c20-4ded-9f78-3eae721683f5 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Converting VIF {"id": "12acc77d-6a56-426a-acda-16438c358c44", "address": "fa:16:3e:9f:92:7f", "network": {"id": "eb4dd4b5-96d4-4b53-b510-d41e2775b92f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-596111273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fa122cbabe94c6f93c862b4daf31e50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12acc77d-6a", "ovs_interfaceid": "12acc77d-6a56-426a-acda-16438c358c44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:03:36 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-a93c5be7-6c20-4ded-9f78-3eae721683f5 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:92:7f,bridge_name='br-int',has_traffic_filtering=True,id=12acc77d-6a56-426a-acda-16438c358c44,network=Network(eb4dd4b5-96d4-4b53-b510-d41e2775b92f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12acc77d-6a') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:03:36 user nova-compute[71874]: DEBUG nova.objects.instance [None req-a93c5be7-6c20-4ded-9f78-3eae721683f5 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lazy-loading 'pci_devices' on Instance uuid fc19fd8d-3285-4ceb-8714-a0ba139f3045 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:03:36 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-a93c5be7-6c20-4ded-9f78-3eae721683f5 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] End _get_guest_xml xml=<domain type="kvm">
Apr 12 16:03:36 user nova-compute[71874]:   <uuid>fc19fd8d-3285-4ceb-8714-a0ba139f3045</uuid>
Apr 12 16:03:36 user nova-compute[71874]:   <name>instance-00000005</name>
Apr 12 16:03:36 user nova-compute[71874]:   <memory>131072</memory>
Apr 12 16:03:36 user nova-compute[71874]:   <vcpu>1</vcpu>
Apr 12 16:03:36 user nova-compute[71874]:   <metadata>
Apr 12 16:03:36 user nova-compute[71874]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 16:03:36 user nova-compute[71874]:       <nova:package version="0.0.0"/>
Apr 12 16:03:36 user nova-compute[71874]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-791161427</nova:name>
Apr 12 16:03:36 user nova-compute[71874]:       <nova:creationTime>2023-04-12 16:03:34</nova:creationTime>
Apr 12 16:03:36 user nova-compute[71874]:       <nova:flavor name="m1.nano">
Apr 12 16:03:36 user nova-compute[71874]:         <nova:memory>128</nova:memory>
Apr 12 16:03:36 user nova-compute[71874]:         <nova:disk>1</nova:disk>
Apr 12 16:03:36 user nova-compute[71874]:         <nova:swap>0</nova:swap>
Apr 12 16:03:36 user nova-compute[71874]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 16:03:36 user nova-compute[71874]:         <nova:vcpus>1</nova:vcpus>
Apr 12 16:03:36 user nova-compute[71874]:       </nova:flavor>
Apr 12 16:03:36 user nova-compute[71874]:       <nova:owner>
Apr 12 16:03:36 user nova-compute[71874]:         <nova:user uuid="c1abec24caf74dc8a27b64c21a9d4a59">tempest-AttachVolumeShelveTestJSON-292107264-project-member</nova:user>
Apr 12 16:03:36 user nova-compute[71874]:         <nova:project uuid="1fa122cbabe94c6f93c862b4daf31e50">tempest-AttachVolumeShelveTestJSON-292107264</nova:project>
Apr 12 16:03:36 user nova-compute[71874]:       </nova:owner>
Apr 12 16:03:36 user nova-compute[71874]:       <nova:root type="image" uuid="aea0d05c-bce2-4503-aeaf-6f9933e25a12"/>
Apr 12 16:03:36 user nova-compute[71874]:       <nova:ports>
Apr 12 16:03:36 user nova-compute[71874]:         <nova:port uuid="12acc77d-6a56-426a-acda-16438c358c44">
Apr 12 16:03:36 user nova-compute[71874]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 12 16:03:36 user nova-compute[71874]:         </nova:port>
Apr 12 16:03:36 user nova-compute[71874]:       </nova:ports>
Apr 12 16:03:36 user nova-compute[71874]:     </nova:instance>
Apr 12 16:03:36 user nova-compute[71874]:   </metadata>
Apr 12 16:03:36 user nova-compute[71874]:   <sysinfo type="smbios">
Apr 12 16:03:36 user nova-compute[71874]:     <system>
Apr 12 16:03:36 user nova-compute[71874]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 16:03:36 user nova-compute[71874]:       <entry name="product">OpenStack Nova</entry>
Apr 12 16:03:36 user nova-compute[71874]:       <entry name="version">0.0.0</entry>
Apr 12 16:03:36 user nova-compute[71874]:       <entry name="serial">fc19fd8d-3285-4ceb-8714-a0ba139f3045</entry>
Apr 12 16:03:36 user nova-compute[71874]:       <entry name="uuid">fc19fd8d-3285-4ceb-8714-a0ba139f3045</entry>
Apr 12 16:03:36 user nova-compute[71874]:       <entry name="family">Virtual Machine</entry>
Apr 12 16:03:36 user nova-compute[71874]:     </system>
Apr 12 16:03:36 user nova-compute[71874]:   </sysinfo>
Apr 12 16:03:36 user nova-compute[71874]:   <os>
Apr 12 16:03:36 user nova-compute[71874]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 16:03:36 user nova-compute[71874]:     <boot dev="hd"/>
Apr 12 16:03:36 user nova-compute[71874]:     <smbios mode="sysinfo"/>
Apr 12 16:03:36 user nova-compute[71874]:   </os>
Apr 12 16:03:36 user nova-compute[71874]:   <features>
Apr 12 16:03:36 user nova-compute[71874]:     <acpi/>
Apr 12 16:03:36 user nova-compute[71874]:     <apic/>
Apr 12 16:03:36 user nova-compute[71874]:     <vmcoreinfo/>
Apr 12 16:03:36 user nova-compute[71874]:   </features>
Apr 12 16:03:36 user nova-compute[71874]:   <clock offset="utc">
Apr 12 16:03:36 user nova-compute[71874]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 16:03:36 user nova-compute[71874]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 16:03:36 user nova-compute[71874]:     <timer name="hpet" present="no"/>
Apr 12 16:03:36 user nova-compute[71874]:   </clock>
Apr 12 16:03:36 user nova-compute[71874]:   <cpu mode="custom" match="exact">
Apr 12 16:03:36 user nova-compute[71874]:     <model>Nehalem</model>
Apr 12 16:03:36 user nova-compute[71874]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 16:03:36 user nova-compute[71874]:   </cpu>
Apr 12 16:03:36 user nova-compute[71874]:   <devices>
Apr 12 16:03:36 user nova-compute[71874]:     <disk type="file" device="disk">
Apr 12 16:03:36 user nova-compute[71874]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 16:03:36 user nova-compute[71874]:       <source file="/opt/stack/data/nova/instances/fc19fd8d-3285-4ceb-8714-a0ba139f3045/disk"/>
Apr 12 16:03:36 user nova-compute[71874]:       <target dev="vda" bus="virtio"/>
Apr 12 16:03:36 user nova-compute[71874]:     </disk>
Apr 12 16:03:36 user nova-compute[71874]:     <disk type="block" device="disk">
Apr 12 16:03:36 user nova-compute[71874]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 16:03:36 user nova-compute[71874]:       <source dev="/dev/sdd"/>
Apr 12 16:03:36 user nova-compute[71874]:       <target dev="vdc" bus="virtio"/>
Apr 12 16:03:36 user nova-compute[71874]:       <serial>cfd27585-75c7-4a04-a93a-79e4236a36f7</serial>
Apr 12 16:03:36 user nova-compute[71874]:     </disk>
Apr 12 16:03:36 user nova-compute[71874]:     <interface type="ethernet">
Apr 12 16:03:36 user nova-compute[71874]:       <mac address="fa:16:3e:9f:92:7f"/>
Apr 12 16:03:36 user nova-compute[71874]:       <model type="virtio"/>
Apr 12 16:03:36 user nova-compute[71874]:       <mtu size="1442"/>
Apr 12 16:03:36 user nova-compute[71874]:       <target dev="tap12acc77d-6a"/>
Apr 12 16:03:36 user nova-compute[71874]:     </interface>
Apr 12 16:03:36 user nova-compute[71874]:     <serial type="pty">
Apr 12 16:03:36 user nova-compute[71874]:       <log file="/opt/stack/data/nova/instances/fc19fd8d-3285-4ceb-8714-a0ba139f3045/console.log" append="off"/>
Apr 12 16:03:36 user nova-compute[71874]:     </serial>
Apr 12 16:03:36 user nova-compute[71874]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 16:03:36 user nova-compute[71874]:     <video>
Apr 12 16:03:36 user nova-compute[71874]:       <model type="virtio"/>
Apr 12 16:03:36 user nova-compute[71874]:     </video>
Apr 12 16:03:36 user nova-compute[71874]:     <rng model="virtio">
Apr 12 16:03:36 user nova-compute[71874]:       <backend model="random">/dev/urandom</backend>
Apr 12 16:03:36 user nova-compute[71874]:     </rng>
Apr 12 16:03:36 user nova-compute[71874]:     <controller type="usb" index="0" model="none"/>
Apr 12 16:03:36 user nova-compute[71874]:     <memballoon model="virtio">
Apr 12 16:03:36 user nova-compute[71874]:       <stats period="10"/>
Apr 12 16:03:36 user nova-compute[71874]:     </memballoon>
Apr 12 16:03:36 user nova-compute[71874]:   </devices>
Apr 12 16:03:36 user nova-compute[71874]: </domain>
Apr 12 16:03:36 user nova-compute[71874]:  {{(pid=71874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 16:03:36 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-a93c5be7-6c20-4ded-9f78-3eae721683f5 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-12T15:59:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-791161427',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-791161427',id=5,image_ref='aea0d05c-bce2-4503-aeaf-6f9933e25a12',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-1362669684',keypairs=<?>,launch_index=0,launched_at=2023-04-12T15:59:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='1fa122cbabe94c6f93c862b4daf31e50',ramdisk_id='',reservation_id='r-z1kj5zi3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-292107264',owner_user_name='tempest-AttachVolumeShelveTestJSON-292107264-project-member',shelved_at='2023-04-12T16:01:30.562588',shelved_host='user',shelved_image_id='aea0d05c-bce2-4503-aeaf-6f9933e25a12'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T16:03:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c1abec24caf74dc8a27b64c21a9d4a59',uuid=fc19fd8d-3285-4ceb-8714-a0ba139f3045,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "12acc77d-6a56-426a-acda-16438c358c44", "address": "fa:16:3e:9f:92:7f", "network": {"id": "eb4dd4b5-96d4-4b53-b510-d41e2775b92f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-596111273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fa122cbabe94c6f93c862b4daf31e50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12acc77d-6a", "ovs_interfaceid": "12acc77d-6a56-426a-acda-16438c358c44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 16:03:36 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-a93c5be7-6c20-4ded-9f78-3eae721683f5 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Converting VIF {"id": "12acc77d-6a56-426a-acda-16438c358c44", "address": "fa:16:3e:9f:92:7f", "network": {"id": "eb4dd4b5-96d4-4b53-b510-d41e2775b92f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-596111273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fa122cbabe94c6f93c862b4daf31e50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12acc77d-6a", "ovs_interfaceid": "12acc77d-6a56-426a-acda-16438c358c44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:03:36 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-a93c5be7-6c20-4ded-9f78-3eae721683f5 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:92:7f,bridge_name='br-int',has_traffic_filtering=True,id=12acc77d-6a56-426a-acda-16438c358c44,network=Network(eb4dd4b5-96d4-4b53-b510-d41e2775b92f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12acc77d-6a') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:03:36 user nova-compute[71874]: DEBUG os_vif [None req-a93c5be7-6c20-4ded-9f78-3eae721683f5 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:92:7f,bridge_name='br-int',has_traffic_filtering=True,id=12acc77d-6a56-426a-acda-16438c358c44,network=Network(eb4dd4b5-96d4-4b53-b510-d41e2775b92f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12acc77d-6a') {{(pid=71874) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 16:03:36 user nova-compute[71874]: DEBUG nova.compute.manager [None req-f9137bed-fd6d-492e-bd2b-f5611b5b6548 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] [instance: ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e] Start spawning the instance on the hypervisor. {{(pid=71874) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 16:03:36 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-f9137bed-fd6d-492e-bd2b-f5611b5b6548 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] [instance: ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e] Creating instance directory {{(pid=71874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 16:03:36 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-f9137bed-fd6d-492e-bd2b-f5611b5b6548 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] [instance: ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e] Creating image(s)
Apr 12 16:03:36 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-f9137bed-fd6d-492e-bd2b-f5611b5b6548 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Acquiring lock "/opt/stack/data/nova/instances/ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:03:36 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-f9137bed-fd6d-492e-bd2b-f5611b5b6548 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Lock "/opt/stack/data/nova/instances/ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:03:36 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-f9137bed-fd6d-492e-bd2b-f5611b5b6548 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Lock "/opt/stack/data/nova/instances/ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:03:36 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:03:36 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:03:36 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 16:03:36 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-f9137bed-fd6d-492e-bd2b-f5611b5b6548 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:03:36 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:03:36 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap12acc77d-6a, may_exist=True) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:03:36 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap12acc77d-6a, col_values=(('external_ids', {'iface-id': '12acc77d-6a56-426a-acda-16438c358c44', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9f:92:7f', 'vm-uuid': 'fc19fd8d-3285-4ceb-8714-a0ba139f3045'}),)) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:03:36 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:03:36 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:03:36 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:03:36 user nova-compute[71874]: INFO os_vif [None req-a93c5be7-6c20-4ded-9f78-3eae721683f5 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:92:7f,bridge_name='br-int',has_traffic_filtering=True,id=12acc77d-6a56-426a-acda-16438c358c44,network=Network(eb4dd4b5-96d4-4b53-b510-d41e2775b92f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12acc77d-6a')
Apr 12 16:03:36 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-a93c5be7-6c20-4ded-9f78-3eae721683f5 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] No BDM found with device name vda, not building metadata. {{(pid=71874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 16:03:36 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-a93c5be7-6c20-4ded-9f78-3eae721683f5 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 16:03:36 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-a93c5be7-6c20-4ded-9f78-3eae721683f5 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] No VIF found with MAC fa:16:3e:9f:92:7f, not building metadata {{(pid=71874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 16:03:36 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-f9137bed-fd6d-492e-bd2b-f5611b5b6548 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json" returned: 0 in 0.203s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:03:36 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-f9137bed-fd6d-492e-bd2b-f5611b5b6548 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Acquiring lock "b88df1b37cb431f52bc53b5616015c89b5bec411" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:03:36 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-f9137bed-fd6d-492e-bd2b-f5611b5b6548 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Lock "b88df1b37cb431f52bc53b5616015c89b5bec411" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:03:36 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-f9137bed-fd6d-492e-bd2b-f5611b5b6548 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:03:36 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-f9137bed-fd6d-492e-bd2b-f5611b5b6548 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json" returned: 0 in 0.149s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:03:36 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-f9137bed-fd6d-492e-bd2b-f5611b5b6548 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411,backing_fmt=raw /opt/stack/data/nova/instances/ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e/disk 1073741824 {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:03:36 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:03:37 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-f9137bed-fd6d-492e-bd2b-f5611b5b6548 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411,backing_fmt=raw /opt/stack/data/nova/instances/ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e/disk 1073741824" returned: 0 in 0.076s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:03:37 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-f9137bed-fd6d-492e-bd2b-f5611b5b6548 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Lock "b88df1b37cb431f52bc53b5616015c89b5bec411" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:03:37 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-f9137bed-fd6d-492e-bd2b-f5611b5b6548 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:03:37 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:03:37 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:03:37 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-f9137bed-fd6d-492e-bd2b-f5611b5b6548 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json" returned: 0 in 0.156s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:03:37 user nova-compute[71874]: DEBUG nova.virt.disk.api [None req-f9137bed-fd6d-492e-bd2b-f5611b5b6548 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e/disk. size=1073741824 {{(pid=71874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 16:03:37 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-f9137bed-fd6d-492e-bd2b-f5611b5b6548 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:03:37 user nova-compute[71874]: DEBUG nova.compute.manager [req-dc94ae03-2e87-42dc-935c-0c213f69f8c0 req-47a4fe8f-a6f2-4ed7-a1fc-1cd27964d60c service nova] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Received event network-vif-plugged-18196ae0-d9c1-4814-8803-c4ba8ad4ab45 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:03:37 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-dc94ae03-2e87-42dc-935c-0c213f69f8c0 req-47a4fe8f-a6f2-4ed7-a1fc-1cd27964d60c service nova] Acquiring lock "dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:03:37 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-dc94ae03-2e87-42dc-935c-0c213f69f8c0 req-47a4fe8f-a6f2-4ed7-a1fc-1cd27964d60c service nova] Lock "dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:03:37 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-dc94ae03-2e87-42dc-935c-0c213f69f8c0 req-47a4fe8f-a6f2-4ed7-a1fc-1cd27964d60c service nova] Lock "dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:03:37 user nova-compute[71874]: DEBUG nova.compute.manager [req-dc94ae03-2e87-42dc-935c-0c213f69f8c0 req-47a4fe8f-a6f2-4ed7-a1fc-1cd27964d60c service nova] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] No waiting events found dispatching network-vif-plugged-18196ae0-d9c1-4814-8803-c4ba8ad4ab45 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:03:37 user nova-compute[71874]: WARNING nova.compute.manager [req-dc94ae03-2e87-42dc-935c-0c213f69f8c0 req-47a4fe8f-a6f2-4ed7-a1fc-1cd27964d60c service nova] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Received unexpected event network-vif-plugged-18196ae0-d9c1-4814-8803-c4ba8ad4ab45 for instance with vm_state active and task_state rebuild_spawning.
Apr 12 16:03:37 user nova-compute[71874]: DEBUG nova.network.neutron [-] [instance: ad0cece6-9b26-4c87-9e48-2c0437cb9190] Updating instance_info_cache with network_info: [] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:03:37 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-f9137bed-fd6d-492e-bd2b-f5611b5b6548 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:03:37 user nova-compute[71874]: DEBUG nova.virt.disk.api [None req-f9137bed-fd6d-492e-bd2b-f5611b5b6548 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Cannot resize image /opt/stack/data/nova/instances/ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e/disk to a smaller size. {{(pid=71874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 16:03:37 user nova-compute[71874]: DEBUG nova.objects.instance [None req-f9137bed-fd6d-492e-bd2b-f5611b5b6548 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Lazy-loading 'migration_context' on Instance uuid ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:03:37 user nova-compute[71874]: INFO nova.compute.manager [-] [instance: ad0cece6-9b26-4c87-9e48-2c0437cb9190] Took 1.28 seconds to deallocate network for instance.
Apr 12 16:03:37 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-f9137bed-fd6d-492e-bd2b-f5611b5b6548 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] [instance: ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e] Created local disks {{(pid=71874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 16:03:37 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-f9137bed-fd6d-492e-bd2b-f5611b5b6548 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] [instance: ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e] Ensure instance console log exists: /opt/stack/data/nova/instances/ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e/console.log {{(pid=71874) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 16:03:37 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-f9137bed-fd6d-492e-bd2b-f5611b5b6548 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:03:37 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-f9137bed-fd6d-492e-bd2b-f5611b5b6548 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:03:37 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-f9137bed-fd6d-492e-bd2b-f5611b5b6548 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:03:37 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-6348be2b-b3c4-4a5d-8ef5-be94edc1af79 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:03:37 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-6348be2b-b3c4-4a5d-8ef5-be94edc1af79 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:03:37 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:03:37 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:03:37 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:03:37 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:03:37 user nova-compute[71874]: DEBUG nova.network.neutron [None req-f9137bed-fd6d-492e-bd2b-f5611b5b6548 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] [instance: ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e] Successfully created port: 20f49d80-ccad-450e-baed-417505f17cc2 {{(pid=71874) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 16:03:37 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-6348be2b-b3c4-4a5d-8ef5-be94edc1af79 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Inventory has not changed in ProviderTree for provider: 0e94b4c8-cd49-45e4-9133-d36eb4b2456b {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 16:03:37 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-6348be2b-b3c4-4a5d-8ef5-be94edc1af79 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Inventory has not changed for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 16:03:37 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-6348be2b-b3c4-4a5d-8ef5-be94edc1af79 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.448s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:03:37 user nova-compute[71874]: INFO nova.scheduler.client.report [None req-6348be2b-b3c4-4a5d-8ef5-be94edc1af79 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Deleted allocations for instance ad0cece6-9b26-4c87-9e48-2c0437cb9190
Apr 12 16:03:38 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-6348be2b-b3c4-4a5d-8ef5-be94edc1af79 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "ad0cece6-9b26-4c87-9e48-2c0437cb9190" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.525s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:03:38 user nova-compute[71874]: DEBUG nova.compute.manager [req-1f98786e-cd04-4977-b56a-5f34fe00d78c req-e01101f1-9fbe-4b1a-bcf0-c6b092cec807 service nova] [instance: ad0cece6-9b26-4c87-9e48-2c0437cb9190] Received event network-vif-deleted-b734d9d7-5bb7-4ca9-a637-9c335398dfc0 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:03:38 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:03:38 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:03:38 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:03:38 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:03:39 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:03:39 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:03:39 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:03:39 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:03:39 user nova-compute[71874]: DEBUG nova.compute.manager [req-dd24e521-8ebe-4d34-844d-11300d98d995 req-bab683f3-872c-49c9-b58f-50c45db5cab0 service nova] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Received event network-vif-plugged-18196ae0-d9c1-4814-8803-c4ba8ad4ab45 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:03:39 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-dd24e521-8ebe-4d34-844d-11300d98d995 req-bab683f3-872c-49c9-b58f-50c45db5cab0 service nova] Acquiring lock "dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:03:39 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-dd24e521-8ebe-4d34-844d-11300d98d995 req-bab683f3-872c-49c9-b58f-50c45db5cab0 service nova] Lock "dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:03:39 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-dd24e521-8ebe-4d34-844d-11300d98d995 req-bab683f3-872c-49c9-b58f-50c45db5cab0 service nova] Lock "dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:03:39 user nova-compute[71874]: DEBUG nova.compute.manager [req-dd24e521-8ebe-4d34-844d-11300d98d995 req-bab683f3-872c-49c9-b58f-50c45db5cab0 service nova] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] No waiting events found dispatching network-vif-plugged-18196ae0-d9c1-4814-8803-c4ba8ad4ab45 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:03:39 user nova-compute[71874]: WARNING nova.compute.manager [req-dd24e521-8ebe-4d34-844d-11300d98d995 req-bab683f3-872c-49c9-b58f-50c45db5cab0 service nova] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Received unexpected event network-vif-plugged-18196ae0-d9c1-4814-8803-c4ba8ad4ab45 for instance with vm_state active and task_state rebuild_spawning.
Apr 12 16:03:39 user nova-compute[71874]: DEBUG nova.compute.manager [req-d758d38b-a998-4291-b452-bdcebaa2f7a4 req-8b381fa9-57b0-4695-832d-c2db76c485d9 service nova] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] Received event network-vif-plugged-12acc77d-6a56-426a-acda-16438c358c44 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:03:39 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-d758d38b-a998-4291-b452-bdcebaa2f7a4 req-8b381fa9-57b0-4695-832d-c2db76c485d9 service nova] Acquiring lock "fc19fd8d-3285-4ceb-8714-a0ba139f3045-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:03:39 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-d758d38b-a998-4291-b452-bdcebaa2f7a4 req-8b381fa9-57b0-4695-832d-c2db76c485d9 service nova] Lock "fc19fd8d-3285-4ceb-8714-a0ba139f3045-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:03:39 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-d758d38b-a998-4291-b452-bdcebaa2f7a4 req-8b381fa9-57b0-4695-832d-c2db76c485d9 service nova] Lock "fc19fd8d-3285-4ceb-8714-a0ba139f3045-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:03:39 user nova-compute[71874]: DEBUG nova.compute.manager [req-d758d38b-a998-4291-b452-bdcebaa2f7a4 req-8b381fa9-57b0-4695-832d-c2db76c485d9 service nova] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] No waiting events found dispatching network-vif-plugged-12acc77d-6a56-426a-acda-16438c358c44 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:03:39 user nova-compute[71874]: WARNING nova.compute.manager [req-d758d38b-a998-4291-b452-bdcebaa2f7a4 req-8b381fa9-57b0-4695-832d-c2db76c485d9 service nova] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] Received unexpected event network-vif-plugged-12acc77d-6a56-426a-acda-16438c358c44 for instance with vm_state shelved_offloaded and task_state spawning.
Apr 12 16:03:39 user nova-compute[71874]: DEBUG nova.network.neutron [None req-f9137bed-fd6d-492e-bd2b-f5611b5b6548 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] [instance: ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e] Successfully updated port: 20f49d80-ccad-450e-baed-417505f17cc2 {{(pid=71874) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 16:03:39 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-f9137bed-fd6d-492e-bd2b-f5611b5b6548 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Acquiring lock "refresh_cache-ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:03:39 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-f9137bed-fd6d-492e-bd2b-f5611b5b6548 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Acquired lock "refresh_cache-ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:03:39 user nova-compute[71874]: DEBUG nova.network.neutron [None req-f9137bed-fd6d-492e-bd2b-f5611b5b6548 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] [instance: ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e] Building network info cache for instance {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 16:03:39 user nova-compute[71874]: DEBUG nova.network.neutron [None req-f9137bed-fd6d-492e-bd2b-f5611b5b6548 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] [instance: ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e] Instance cache missing network info. {{(pid=71874) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 16:03:39 user nova-compute[71874]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681315404.8307676, dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 => Stopped> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:03:39 user nova-compute[71874]: INFO nova.compute.manager [-] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] VM Stopped (Lifecycle Event)
Apr 12 16:03:39 user nova-compute[71874]: DEBUG nova.compute.manager [None req-96269089-d6ce-4126-98ce-fb58473e6b98 None None] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:03:40 user nova-compute[71874]: DEBUG nova.network.neutron [None req-f9137bed-fd6d-492e-bd2b-f5611b5b6548 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] [instance: ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e] Updating instance_info_cache with network_info: [{"id": "20f49d80-ccad-450e-baed-417505f17cc2", "address": "fa:16:3e:28:84:c8", "network": {"id": "0a97bb8e-9c19-41f1-bfcd-428e3ea3492f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-6019148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76f559719f5f43c3a47a0aaf1e699193", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20f49d80-cc", "ovs_interfaceid": "20f49d80-ccad-450e-baed-417505f17cc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:03:40 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-f9137bed-fd6d-492e-bd2b-f5611b5b6548 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Releasing lock "refresh_cache-ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:03:40 user nova-compute[71874]: DEBUG nova.compute.manager [None req-f9137bed-fd6d-492e-bd2b-f5611b5b6548 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] [instance: ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e] Instance network_info: |[{"id": "20f49d80-ccad-450e-baed-417505f17cc2", "address": "fa:16:3e:28:84:c8", "network": {"id": "0a97bb8e-9c19-41f1-bfcd-428e3ea3492f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-6019148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76f559719f5f43c3a47a0aaf1e699193", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20f49d80-cc", "ovs_interfaceid": "20f49d80-ccad-450e-baed-417505f17cc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 16:03:40 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-f9137bed-fd6d-492e-bd2b-f5611b5b6548 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] [instance: ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e] Start _get_guest_xml network_info=[{"id": "20f49d80-ccad-450e-baed-417505f17cc2", "address": "fa:16:3e:28:84:c8", "network": {"id": "0a97bb8e-9c19-41f1-bfcd-428e3ea3492f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-6019148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76f559719f5f43c3a47a0aaf1e699193", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20f49d80-cc", "ovs_interfaceid": "20f49d80-ccad-450e-baed-417505f17cc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T15:55:37Z,direct_url=<?>,disk_format='qcow2',id=9dc63f14-8b70-4e72-89f2-13464f2f5c7c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='61a4936d9b7744c0b488d81c9b7746b6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T15:55:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_options': None, 'image_id': '9dc63f14-8b70-4e72-89f2-13464f2f5c7c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 16:03:40 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-f9137bed-fd6d-492e-bd2b-f5611b5b6548 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:03:40 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-f9137bed-fd6d-492e-bd2b-f5611b5b6548 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:03:40 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-f9137bed-fd6d-492e-bd2b-f5611b5b6548 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71874) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 16:03:40 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-f9137bed-fd6d-492e-bd2b-f5611b5b6548 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T15:56:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T15:55:37Z,direct_url=<?>,disk_format='qcow2',id=9dc63f14-8b70-4e72-89f2-13464f2f5c7c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='61a4936d9b7744c0b488d81c9b7746b6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T15:55:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 16:03:40 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-f9137bed-fd6d-492e-bd2b-f5611b5b6548 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Flavor limits 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 16:03:40 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-f9137bed-fd6d-492e-bd2b-f5611b5b6548 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Image limits 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 16:03:40 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-f9137bed-fd6d-492e-bd2b-f5611b5b6548 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Flavor pref 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 16:03:40 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-f9137bed-fd6d-492e-bd2b-f5611b5b6548 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Image pref 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 16:03:40 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-f9137bed-fd6d-492e-bd2b-f5611b5b6548 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 16:03:40 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-f9137bed-fd6d-492e-bd2b-f5611b5b6548 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 16:03:40 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-f9137bed-fd6d-492e-bd2b-f5611b5b6548 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 16:03:40 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-f9137bed-fd6d-492e-bd2b-f5611b5b6548 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Got 1 possible topologies {{(pid=71874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 16:03:40 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-f9137bed-fd6d-492e-bd2b-f5611b5b6548 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 16:03:40 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-f9137bed-fd6d-492e-bd2b-f5611b5b6548 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 16:03:40 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-f9137bed-fd6d-492e-bd2b-f5611b5b6548 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T16:03:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-619835956',display_name='tempest-VolumesAdminNegativeTest-server-619835956',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-619835956',id=17,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI5iGnI/5QUzaemWuPuISz6DoXlthOLrvHmO1ttnNkpfWuy+j+rfVtjrZ0Ne2wROK5ZFJtWT+9pJ5d8Q3gkQxpaFURoacMo45jMZIUZeh23Z6htw6S217IIzKdvKFzW0yA==',key_name='tempest-keypair-2119173920',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='76f559719f5f43c3a47a0aaf1e699193',ramdisk_id='',reservation_id='r-8kaeaxi9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-716771515',owner_user_name='tempest-VolumesAdminNegativeTest-716771515-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T16:03:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2b65791f14d34508b8a9a0849a9bf89e',uuid=ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "20f49d80-ccad-450e-baed-417505f17cc2", "address": "fa:16:3e:28:84:c8", "network": {"id": "0a97bb8e-9c19-41f1-bfcd-428e3ea3492f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-6019148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76f559719f5f43c3a47a0aaf1e699193", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20f49d80-cc", "ovs_interfaceid": "20f49d80-ccad-450e-baed-417505f17cc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 16:03:40 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-f9137bed-fd6d-492e-bd2b-f5611b5b6548 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Converting VIF {"id": "20f49d80-ccad-450e-baed-417505f17cc2", "address": "fa:16:3e:28:84:c8", "network": {"id": "0a97bb8e-9c19-41f1-bfcd-428e3ea3492f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-6019148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76f559719f5f43c3a47a0aaf1e699193", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20f49d80-cc", "ovs_interfaceid": "20f49d80-ccad-450e-baed-417505f17cc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:03:40 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-f9137bed-fd6d-492e-bd2b-f5611b5b6548 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:84:c8,bridge_name='br-int',has_traffic_filtering=True,id=20f49d80-ccad-450e-baed-417505f17cc2,network=Network(0a97bb8e-9c19-41f1-bfcd-428e3ea3492f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20f49d80-cc') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:03:40 user nova-compute[71874]: DEBUG nova.objects.instance [None req-f9137bed-fd6d-492e-bd2b-f5611b5b6548 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Lazy-loading 'pci_devices' on Instance uuid ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:03:40 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-f9137bed-fd6d-492e-bd2b-f5611b5b6548 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] [instance: ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e] End _get_guest_xml xml=<domain type="kvm">
Apr 12 16:03:40 user nova-compute[71874]:   <uuid>ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e</uuid>
Apr 12 16:03:40 user nova-compute[71874]:   <name>instance-00000011</name>
Apr 12 16:03:40 user nova-compute[71874]:   <memory>131072</memory>
Apr 12 16:03:40 user nova-compute[71874]:   <vcpu>1</vcpu>
Apr 12 16:03:40 user nova-compute[71874]:   <metadata>
Apr 12 16:03:40 user nova-compute[71874]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 16:03:40 user nova-compute[71874]:       <nova:package version="0.0.0"/>
Apr 12 16:03:40 user nova-compute[71874]:       <nova:name>tempest-VolumesAdminNegativeTest-server-619835956</nova:name>
Apr 12 16:03:40 user nova-compute[71874]:       <nova:creationTime>2023-04-12 16:03:40</nova:creationTime>
Apr 12 16:03:40 user nova-compute[71874]:       <nova:flavor name="m1.nano">
Apr 12 16:03:40 user nova-compute[71874]:         <nova:memory>128</nova:memory>
Apr 12 16:03:40 user nova-compute[71874]:         <nova:disk>1</nova:disk>
Apr 12 16:03:40 user nova-compute[71874]:         <nova:swap>0</nova:swap>
Apr 12 16:03:40 user nova-compute[71874]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 16:03:40 user nova-compute[71874]:         <nova:vcpus>1</nova:vcpus>
Apr 12 16:03:40 user nova-compute[71874]:       </nova:flavor>
Apr 12 16:03:40 user nova-compute[71874]:       <nova:owner>
Apr 12 16:03:40 user nova-compute[71874]:         <nova:user uuid="2b65791f14d34508b8a9a0849a9bf89e">tempest-VolumesAdminNegativeTest-716771515-project-member</nova:user>
Apr 12 16:03:40 user nova-compute[71874]:         <nova:project uuid="76f559719f5f43c3a47a0aaf1e699193">tempest-VolumesAdminNegativeTest-716771515</nova:project>
Apr 12 16:03:40 user nova-compute[71874]:       </nova:owner>
Apr 12 16:03:40 user nova-compute[71874]:       <nova:root type="image" uuid="9dc63f14-8b70-4e72-89f2-13464f2f5c7c"/>
Apr 12 16:03:40 user nova-compute[71874]:       <nova:ports>
Apr 12 16:03:40 user nova-compute[71874]:         <nova:port uuid="20f49d80-ccad-450e-baed-417505f17cc2">
Apr 12 16:03:40 user nova-compute[71874]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 12 16:03:40 user nova-compute[71874]:         </nova:port>
Apr 12 16:03:40 user nova-compute[71874]:       </nova:ports>
Apr 12 16:03:40 user nova-compute[71874]:     </nova:instance>
Apr 12 16:03:40 user nova-compute[71874]:   </metadata>
Apr 12 16:03:40 user nova-compute[71874]:   <sysinfo type="smbios">
Apr 12 16:03:40 user nova-compute[71874]:     <system>
Apr 12 16:03:40 user nova-compute[71874]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 16:03:40 user nova-compute[71874]:       <entry name="product">OpenStack Nova</entry>
Apr 12 16:03:40 user nova-compute[71874]:       <entry name="version">0.0.0</entry>
Apr 12 16:03:40 user nova-compute[71874]:       <entry name="serial">ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e</entry>
Apr 12 16:03:40 user nova-compute[71874]:       <entry name="uuid">ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e</entry>
Apr 12 16:03:40 user nova-compute[71874]:       <entry name="family">Virtual Machine</entry>
Apr 12 16:03:40 user nova-compute[71874]:     </system>
Apr 12 16:03:40 user nova-compute[71874]:   </sysinfo>
Apr 12 16:03:40 user nova-compute[71874]:   <os>
Apr 12 16:03:40 user nova-compute[71874]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 16:03:40 user nova-compute[71874]:     <boot dev="hd"/>
Apr 12 16:03:40 user nova-compute[71874]:     <smbios mode="sysinfo"/>
Apr 12 16:03:40 user nova-compute[71874]:   </os>
Apr 12 16:03:40 user nova-compute[71874]:   <features>
Apr 12 16:03:40 user nova-compute[71874]:     <acpi/>
Apr 12 16:03:40 user nova-compute[71874]:     <apic/>
Apr 12 16:03:40 user nova-compute[71874]:     <vmcoreinfo/>
Apr 12 16:03:40 user nova-compute[71874]:   </features>
Apr 12 16:03:40 user nova-compute[71874]:   <clock offset="utc">
Apr 12 16:03:40 user nova-compute[71874]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 16:03:40 user nova-compute[71874]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 16:03:40 user nova-compute[71874]:     <timer name="hpet" present="no"/>
Apr 12 16:03:40 user nova-compute[71874]:   </clock>
Apr 12 16:03:40 user nova-compute[71874]:   <cpu mode="custom" match="exact">
Apr 12 16:03:40 user nova-compute[71874]:     <model>Nehalem</model>
Apr 12 16:03:40 user nova-compute[71874]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 16:03:40 user nova-compute[71874]:   </cpu>
Apr 12 16:03:40 user nova-compute[71874]:   <devices>
Apr 12 16:03:40 user nova-compute[71874]:     <disk type="file" device="disk">
Apr 12 16:03:40 user nova-compute[71874]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 16:03:40 user nova-compute[71874]:       <source file="/opt/stack/data/nova/instances/ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e/disk"/>
Apr 12 16:03:40 user nova-compute[71874]:       <target dev="vda" bus="virtio"/>
Apr 12 16:03:40 user nova-compute[71874]:     </disk>
Apr 12 16:03:40 user nova-compute[71874]:     <interface type="ethernet">
Apr 12 16:03:40 user nova-compute[71874]:       <mac address="fa:16:3e:28:84:c8"/>
Apr 12 16:03:40 user nova-compute[71874]:       <model type="virtio"/>
Apr 12 16:03:40 user nova-compute[71874]:       <mtu size="1442"/>
Apr 12 16:03:40 user nova-compute[71874]:       <target dev="tap20f49d80-cc"/>
Apr 12 16:03:40 user nova-compute[71874]:     </interface>
Apr 12 16:03:40 user nova-compute[71874]:     <serial type="pty">
Apr 12 16:03:40 user nova-compute[71874]:       <log file="/opt/stack/data/nova/instances/ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e/console.log" append="off"/>
Apr 12 16:03:40 user nova-compute[71874]:     </serial>
Apr 12 16:03:40 user nova-compute[71874]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 16:03:40 user nova-compute[71874]:     <video>
Apr 12 16:03:40 user nova-compute[71874]:       <model type="virtio"/>
Apr 12 16:03:40 user nova-compute[71874]:     </video>
Apr 12 16:03:40 user nova-compute[71874]:     <rng model="virtio">
Apr 12 16:03:40 user nova-compute[71874]:       <backend model="random">/dev/urandom</backend>
Apr 12 16:03:40 user nova-compute[71874]:     </rng>
Apr 12 16:03:40 user nova-compute[71874]:     <controller type="usb" index="0" model="none"/>
Apr 12 16:03:40 user nova-compute[71874]:     <memballoon model="virtio">
Apr 12 16:03:40 user nova-compute[71874]:       <stats period="10"/>
Apr 12 16:03:40 user nova-compute[71874]:     </memballoon>
Apr 12 16:03:40 user nova-compute[71874]:   </devices>
Apr 12 16:03:40 user nova-compute[71874]: </domain>
Apr 12 16:03:40 user nova-compute[71874]:  {{(pid=71874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 16:03:40 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-f9137bed-fd6d-492e-bd2b-f5611b5b6548 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T16:03:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-619835956',display_name='tempest-VolumesAdminNegativeTest-server-619835956',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-619835956',id=17,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI5iGnI/5QUzaemWuPuISz6DoXlthOLrvHmO1ttnNkpfWuy+j+rfVtjrZ0Ne2wROK5ZFJtWT+9pJ5d8Q3gkQxpaFURoacMo45jMZIUZeh23Z6htw6S217IIzKdvKFzW0yA==',key_name='tempest-keypair-2119173920',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='76f559719f5f43c3a47a0aaf1e699193',ramdisk_id='',reservation_id='r-8kaeaxi9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-716771515',owner_user_name='tempest-VolumesAdminNegativeTest-716771515-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T16:03:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2b65791f14d34508b8a9a0849a9bf89e',uuid=ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "20f49d80-ccad-450e-baed-417505f17cc2", "address": "fa:16:3e:28:84:c8", "network": {"id": "0a97bb8e-9c19-41f1-bfcd-428e3ea3492f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-6019148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76f559719f5f43c3a47a0aaf1e699193", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20f49d80-cc", "ovs_interfaceid": "20f49d80-ccad-450e-baed-417505f17cc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 16:03:40 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-f9137bed-fd6d-492e-bd2b-f5611b5b6548 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Converting VIF {"id": "20f49d80-ccad-450e-baed-417505f17cc2", "address": "fa:16:3e:28:84:c8", "network": {"id": "0a97bb8e-9c19-41f1-bfcd-428e3ea3492f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-6019148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76f559719f5f43c3a47a0aaf1e699193", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20f49d80-cc", "ovs_interfaceid": "20f49d80-ccad-450e-baed-417505f17cc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:03:40 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-f9137bed-fd6d-492e-bd2b-f5611b5b6548 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:84:c8,bridge_name='br-int',has_traffic_filtering=True,id=20f49d80-ccad-450e-baed-417505f17cc2,network=Network(0a97bb8e-9c19-41f1-bfcd-428e3ea3492f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20f49d80-cc') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:03:40 user nova-compute[71874]: DEBUG os_vif [None req-f9137bed-fd6d-492e-bd2b-f5611b5b6548 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:84:c8,bridge_name='br-int',has_traffic_filtering=True,id=20f49d80-ccad-450e-baed-417505f17cc2,network=Network(0a97bb8e-9c19-41f1-bfcd-428e3ea3492f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20f49d80-cc') {{(pid=71874) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 16:03:40 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:03:40 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:03:40 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 16:03:40 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:03:40 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap20f49d80-cc, may_exist=True) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:03:40 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap20f49d80-cc, col_values=(('external_ids', {'iface-id': '20f49d80-ccad-450e-baed-417505f17cc2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:28:84:c8', 'vm-uuid': 'ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e'}),)) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:03:40 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:03:40 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:03:40 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:03:40 user nova-compute[71874]: INFO os_vif [None req-f9137bed-fd6d-492e-bd2b-f5611b5b6548 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:84:c8,bridge_name='br-int',has_traffic_filtering=True,id=20f49d80-ccad-450e-baed-417505f17cc2,network=Network(0a97bb8e-9c19-41f1-bfcd-428e3ea3492f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20f49d80-cc')
Apr 12 16:03:40 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-f9137bed-fd6d-492e-bd2b-f5611b5b6548 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] No BDM found with device name vda, not building metadata. {{(pid=71874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 16:03:40 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-f9137bed-fd6d-492e-bd2b-f5611b5b6548 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] No VIF found with MAC fa:16:3e:28:84:c8, not building metadata {{(pid=71874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 16:03:40 user nova-compute[71874]: DEBUG nova.virt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Emitting event <LifecycleEvent: 1681315420.5357153, dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 => Resumed> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:03:40 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] VM Resumed (Lifecycle Event)
Apr 12 16:03:40 user nova-compute[71874]: DEBUG nova.compute.manager [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Instance event wait completed in 0 seconds for  {{(pid=71874) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 16:03:40 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Guest created on hypervisor {{(pid=71874) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 16:03:40 user nova-compute[71874]: INFO nova.virt.libvirt.driver [-] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Instance spawned successfully.
Apr 12 16:03:40 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 16:03:40 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:03:40 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=71874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 16:03:40 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Apr 12 16:03:40 user nova-compute[71874]: DEBUG nova.virt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Emitting event <LifecycleEvent: 1681315420.5368795, dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 => Started> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:03:40 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] VM Started (Lifecycle Event)
Apr 12 16:03:40 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Found default for hw_cdrom_bus of ide {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:03:40 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Found default for hw_disk_bus of virtio {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:03:40 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Found default for hw_input_bus of None {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:03:40 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Found default for hw_pointer_model of None {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:03:40 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Found default for hw_video_model of virtio {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:03:40 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Found default for hw_vif_model of virtio {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:03:40 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:03:40 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=71874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 16:03:40 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Apr 12 16:03:40 user nova-compute[71874]: DEBUG nova.compute.manager [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:03:40 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:03:40 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:03:40 user nova-compute[71874]: DEBUG nova.objects.instance [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Trying to apply a migration context that does not seem to be set for this instance {{(pid=71874) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1032}}
Apr 12 16:03:40 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.075s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:03:41 user nova-compute[71874]: DEBUG nova.virt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Emitting event <LifecycleEvent: 1681315421.0680978, fc19fd8d-3285-4ceb-8714-a0ba139f3045 => Resumed> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:03:41 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] VM Resumed (Lifecycle Event)
Apr 12 16:03:41 user nova-compute[71874]: DEBUG nova.compute.manager [None req-a93c5be7-6c20-4ded-9f78-3eae721683f5 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] Instance event wait completed in 0 seconds for  {{(pid=71874) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 16:03:41 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-a93c5be7-6c20-4ded-9f78-3eae721683f5 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] Guest created on hypervisor {{(pid=71874) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 16:03:41 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:03:41 user nova-compute[71874]: INFO nova.virt.libvirt.driver [-] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] Instance spawned successfully.
Apr 12 16:03:41 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 16:03:41 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 16:03:41 user nova-compute[71874]: DEBUG nova.virt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Emitting event <LifecycleEvent: 1681315421.0733287, fc19fd8d-3285-4ceb-8714-a0ba139f3045 => Started> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:03:41 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] VM Started (Lifecycle Event)
Apr 12 16:03:41 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:03:41 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 16:03:41 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 16:03:41 user nova-compute[71874]: DEBUG nova.compute.manager [None req-a93c5be7-6c20-4ded-9f78-3eae721683f5 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:03:41 user nova-compute[71874]: DEBUG nova.compute.manager [req-dee16c85-b5cf-4565-937c-57ef6497aa15 req-54f92d16-f973-4055-8d42-c751ef955691 service nova] [instance: ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e] Received event network-changed-20f49d80-ccad-450e-baed-417505f17cc2 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:03:41 user nova-compute[71874]: DEBUG nova.compute.manager [req-dee16c85-b5cf-4565-937c-57ef6497aa15 req-54f92d16-f973-4055-8d42-c751ef955691 service nova] [instance: ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e] Refreshing instance network info cache due to event network-changed-20f49d80-ccad-450e-baed-417505f17cc2. {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 16:03:41 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-dee16c85-b5cf-4565-937c-57ef6497aa15 req-54f92d16-f973-4055-8d42-c751ef955691 service nova] Acquiring lock "refresh_cache-ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:03:41 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-dee16c85-b5cf-4565-937c-57ef6497aa15 req-54f92d16-f973-4055-8d42-c751ef955691 service nova] Acquired lock "refresh_cache-ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:03:41 user nova-compute[71874]: DEBUG nova.network.neutron [req-dee16c85-b5cf-4565-937c-57ef6497aa15 req-54f92d16-f973-4055-8d42-c751ef955691 service nova] [instance: ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e] Refreshing network info cache for port 20f49d80-ccad-450e-baed-417505f17cc2 {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 16:03:41 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-a93c5be7-6c20-4ded-9f78-3eae721683f5 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "fc19fd8d-3285-4ceb-8714-a0ba139f3045" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 22.510s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:03:41 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:03:42 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:03:42 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:03:42 user nova-compute[71874]: DEBUG nova.network.neutron [req-dee16c85-b5cf-4565-937c-57ef6497aa15 req-54f92d16-f973-4055-8d42-c751ef955691 service nova] [instance: ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e] Updated VIF entry in instance network info cache for port 20f49d80-ccad-450e-baed-417505f17cc2. {{(pid=71874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 16:03:42 user nova-compute[71874]: DEBUG nova.network.neutron [req-dee16c85-b5cf-4565-937c-57ef6497aa15 req-54f92d16-f973-4055-8d42-c751ef955691 service nova] [instance: ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e] Updating instance_info_cache with network_info: [{"id": "20f49d80-ccad-450e-baed-417505f17cc2", "address": "fa:16:3e:28:84:c8", "network": {"id": "0a97bb8e-9c19-41f1-bfcd-428e3ea3492f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-6019148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76f559719f5f43c3a47a0aaf1e699193", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20f49d80-cc", "ovs_interfaceid": "20f49d80-ccad-450e-baed-417505f17cc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:03:42 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-dee16c85-b5cf-4565-937c-57ef6497aa15 req-54f92d16-f973-4055-8d42-c751ef955691 service nova] Releasing lock "refresh_cache-ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:03:42 user nova-compute[71874]: DEBUG nova.compute.manager [req-dee16c85-b5cf-4565-937c-57ef6497aa15 req-54f92d16-f973-4055-8d42-c751ef955691 service nova] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] Received event network-vif-plugged-12acc77d-6a56-426a-acda-16438c358c44 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:03:42 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-dee16c85-b5cf-4565-937c-57ef6497aa15 req-54f92d16-f973-4055-8d42-c751ef955691 service nova] Acquiring lock "fc19fd8d-3285-4ceb-8714-a0ba139f3045-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:03:42 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-dee16c85-b5cf-4565-937c-57ef6497aa15 req-54f92d16-f973-4055-8d42-c751ef955691 service nova] Lock "fc19fd8d-3285-4ceb-8714-a0ba139f3045-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:03:42 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-dee16c85-b5cf-4565-937c-57ef6497aa15 req-54f92d16-f973-4055-8d42-c751ef955691 service nova] Lock "fc19fd8d-3285-4ceb-8714-a0ba139f3045-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:03:42 user nova-compute[71874]: DEBUG nova.compute.manager [req-dee16c85-b5cf-4565-937c-57ef6497aa15 req-54f92d16-f973-4055-8d42-c751ef955691 service nova] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] No waiting events found dispatching network-vif-plugged-12acc77d-6a56-426a-acda-16438c358c44 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:03:42 user nova-compute[71874]: WARNING nova.compute.manager [req-dee16c85-b5cf-4565-937c-57ef6497aa15 req-54f92d16-f973-4055-8d42-c751ef955691 service nova] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] Received unexpected event network-vif-plugged-12acc77d-6a56-426a-acda-16438c358c44 for instance with vm_state active and task_state None.
Apr 12 16:03:42 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:03:42 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:03:42 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:03:42 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:03:43 user nova-compute[71874]: DEBUG nova.compute.manager [req-9160fc15-c283-4ba0-bec8-c02b0447ef98 req-14b81c31-6f0d-43aa-8640-b7ad4f2f4e66 service nova] [instance: ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e] Received event network-vif-plugged-20f49d80-ccad-450e-baed-417505f17cc2 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:03:43 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-9160fc15-c283-4ba0-bec8-c02b0447ef98 req-14b81c31-6f0d-43aa-8640-b7ad4f2f4e66 service nova] Acquiring lock "ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:03:43 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-9160fc15-c283-4ba0-bec8-c02b0447ef98 req-14b81c31-6f0d-43aa-8640-b7ad4f2f4e66 service nova] Lock "ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:03:43 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-9160fc15-c283-4ba0-bec8-c02b0447ef98 req-14b81c31-6f0d-43aa-8640-b7ad4f2f4e66 service nova] Lock "ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:03:43 user nova-compute[71874]: DEBUG nova.compute.manager [req-9160fc15-c283-4ba0-bec8-c02b0447ef98 req-14b81c31-6f0d-43aa-8640-b7ad4f2f4e66 service nova] [instance: ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e] No waiting events found dispatching network-vif-plugged-20f49d80-ccad-450e-baed-417505f17cc2 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:03:43 user nova-compute[71874]: WARNING nova.compute.manager [req-9160fc15-c283-4ba0-bec8-c02b0447ef98 req-14b81c31-6f0d-43aa-8640-b7ad4f2f4e66 service nova] [instance: ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e] Received unexpected event network-vif-plugged-20f49d80-ccad-450e-baed-417505f17cc2 for instance with vm_state building and task_state spawning.
Apr 12 16:03:44 user nova-compute[71874]: DEBUG nova.virt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Emitting event <LifecycleEvent: 1681315424.616444, ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e => Resumed> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:03:44 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e] VM Resumed (Lifecycle Event)
Apr 12 16:03:44 user nova-compute[71874]: DEBUG nova.compute.manager [None req-f9137bed-fd6d-492e-bd2b-f5611b5b6548 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] [instance: ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e] Instance event wait completed in 0 seconds for  {{(pid=71874) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 16:03:44 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-f9137bed-fd6d-492e-bd2b-f5611b5b6548 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] [instance: ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e] Guest created on hypervisor {{(pid=71874) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 16:03:44 user nova-compute[71874]: INFO nova.virt.libvirt.driver [-] [instance: ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e] Instance spawned successfully.
Apr 12 16:03:44 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-f9137bed-fd6d-492e-bd2b-f5611b5b6548 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] [instance: ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 16:03:44 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:03:44 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 16:03:44 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-f9137bed-fd6d-492e-bd2b-f5611b5b6548 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] [instance: ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e] Found default for hw_cdrom_bus of ide {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:03:44 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-f9137bed-fd6d-492e-bd2b-f5611b5b6548 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] [instance: ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e] Found default for hw_disk_bus of virtio {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:03:44 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-f9137bed-fd6d-492e-bd2b-f5611b5b6548 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] [instance: ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e] Found default for hw_input_bus of None {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:03:44 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-f9137bed-fd6d-492e-bd2b-f5611b5b6548 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] [instance: ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e] Found default for hw_pointer_model of None {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:03:44 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-f9137bed-fd6d-492e-bd2b-f5611b5b6548 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] [instance: ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e] Found default for hw_video_model of virtio {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:03:44 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-f9137bed-fd6d-492e-bd2b-f5611b5b6548 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] [instance: ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e] Found default for hw_vif_model of virtio {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:03:44 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 16:03:44 user nova-compute[71874]: DEBUG nova.virt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Emitting event <LifecycleEvent: 1681315424.620647, ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e => Started> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:03:44 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e] VM Started (Lifecycle Event)
Apr 12 16:03:44 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:03:44 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 16:03:44 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 16:03:44 user nova-compute[71874]: INFO nova.compute.manager [None req-f9137bed-fd6d-492e-bd2b-f5611b5b6548 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] [instance: ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e] Took 8.20 seconds to spawn the instance on the hypervisor.
Apr 12 16:03:44 user nova-compute[71874]: DEBUG nova.compute.manager [None req-f9137bed-fd6d-492e-bd2b-f5611b5b6548 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] [instance: ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:03:44 user nova-compute[71874]: INFO nova.compute.manager [None req-f9137bed-fd6d-492e-bd2b-f5611b5b6548 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] [instance: ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e] Took 9.03 seconds to build instance.
Apr 12 16:03:44 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-f9137bed-fd6d-492e-bd2b-f5611b5b6548 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Lock "ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.287s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:03:45 user nova-compute[71874]: DEBUG nova.compute.manager [req-df3cd54c-7301-4972-bf2f-4bb5fd217acf req-099ddb6b-a505-4eae-bdd5-294db763144d service nova] [instance: ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e] Received event network-vif-plugged-20f49d80-ccad-450e-baed-417505f17cc2 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:03:45 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-df3cd54c-7301-4972-bf2f-4bb5fd217acf req-099ddb6b-a505-4eae-bdd5-294db763144d service nova] Acquiring lock "ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:03:45 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-df3cd54c-7301-4972-bf2f-4bb5fd217acf req-099ddb6b-a505-4eae-bdd5-294db763144d service nova] Lock "ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:03:45 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-df3cd54c-7301-4972-bf2f-4bb5fd217acf req-099ddb6b-a505-4eae-bdd5-294db763144d service nova] Lock "ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:03:45 user nova-compute[71874]: DEBUG nova.compute.manager [req-df3cd54c-7301-4972-bf2f-4bb5fd217acf req-099ddb6b-a505-4eae-bdd5-294db763144d service nova] [instance: ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e] No waiting events found dispatching network-vif-plugged-20f49d80-ccad-450e-baed-417505f17cc2 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:03:45 user nova-compute[71874]: WARNING nova.compute.manager [req-df3cd54c-7301-4972-bf2f-4bb5fd217acf req-099ddb6b-a505-4eae-bdd5-294db763144d service nova] [instance: ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e] Received unexpected event network-vif-plugged-20f49d80-ccad-450e-baed-417505f17cc2 for instance with vm_state active and task_state None.
Apr 12 16:03:45 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:03:47 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:03:47 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:03:50 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:03:50 user nova-compute[71874]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681315415.9128268, ad0cece6-9b26-4c87-9e48-2c0437cb9190 => Stopped> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:03:50 user nova-compute[71874]: INFO nova.compute.manager [-] [instance: ad0cece6-9b26-4c87-9e48-2c0437cb9190] VM Stopped (Lifecycle Event)
Apr 12 16:03:50 user nova-compute[71874]: DEBUG nova.compute.manager [None req-930e0b51-d91c-4f05-8d33-c3ba901326f5 None None] [instance: ad0cece6-9b26-4c87-9e48-2c0437cb9190] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:03:51 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:03:51 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:03:52 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:03:55 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:03:55 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:03:55 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-52df2c99-f1ec-4502-b0e6-2ccbd786cb82 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Acquiring lock "6caa4977-8333-4171-8825-2c3bfb52f80b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:03:55 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-52df2c99-f1ec-4502-b0e6-2ccbd786cb82 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Lock "6caa4977-8333-4171-8825-2c3bfb52f80b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:03:55 user nova-compute[71874]: DEBUG nova.compute.manager [None req-52df2c99-f1ec-4502-b0e6-2ccbd786cb82 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Starting instance... {{(pid=71874) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 16:03:55 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-52df2c99-f1ec-4502-b0e6-2ccbd786cb82 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:03:55 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-52df2c99-f1ec-4502-b0e6-2ccbd786cb82 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:03:55 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-52df2c99-f1ec-4502-b0e6-2ccbd786cb82 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71874) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 16:03:55 user nova-compute[71874]: INFO nova.compute.claims [None req-52df2c99-f1ec-4502-b0e6-2ccbd786cb82 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Claim successful on node user
Apr 12 16:03:56 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-52df2c99-f1ec-4502-b0e6-2ccbd786cb82 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Inventory has not changed in ProviderTree for provider: 0e94b4c8-cd49-45e4-9133-d36eb4b2456b {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 16:03:56 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-52df2c99-f1ec-4502-b0e6-2ccbd786cb82 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Inventory has not changed for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 16:03:56 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-52df2c99-f1ec-4502-b0e6-2ccbd786cb82 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.633s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:03:56 user nova-compute[71874]: DEBUG nova.compute.manager [None req-52df2c99-f1ec-4502-b0e6-2ccbd786cb82 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Start building networks asynchronously for instance. {{(pid=71874) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 16:03:56 user nova-compute[71874]: DEBUG nova.compute.manager [None req-52df2c99-f1ec-4502-b0e6-2ccbd786cb82 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Allocating IP information in the background. {{(pid=71874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 16:03:56 user nova-compute[71874]: DEBUG nova.network.neutron [None req-52df2c99-f1ec-4502-b0e6-2ccbd786cb82 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] allocate_for_instance() {{(pid=71874) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 16:03:56 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-52df2c99-f1ec-4502-b0e6-2ccbd786cb82 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 16:03:56 user nova-compute[71874]: DEBUG nova.compute.manager [None req-52df2c99-f1ec-4502-b0e6-2ccbd786cb82 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Start building block device mappings for instance. {{(pid=71874) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 16:03:56 user nova-compute[71874]: DEBUG nova.policy [None req-52df2c99-f1ec-4502-b0e6-2ccbd786cb82 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f76e286bd75a4cbaad7a7b735014f3d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3deffbb4769b4985b038b4adcd82b018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71874) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 16:03:56 user nova-compute[71874]: DEBUG nova.compute.manager [None req-52df2c99-f1ec-4502-b0e6-2ccbd786cb82 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Start spawning the instance on the hypervisor. {{(pid=71874) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 16:03:56 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-52df2c99-f1ec-4502-b0e6-2ccbd786cb82 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Creating instance directory {{(pid=71874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 16:03:56 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-52df2c99-f1ec-4502-b0e6-2ccbd786cb82 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Creating image(s)
Apr 12 16:03:56 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-52df2c99-f1ec-4502-b0e6-2ccbd786cb82 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Acquiring lock "/opt/stack/data/nova/instances/6caa4977-8333-4171-8825-2c3bfb52f80b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:03:56 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-52df2c99-f1ec-4502-b0e6-2ccbd786cb82 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Lock "/opt/stack/data/nova/instances/6caa4977-8333-4171-8825-2c3bfb52f80b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:03:56 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-52df2c99-f1ec-4502-b0e6-2ccbd786cb82 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Lock "/opt/stack/data/nova/instances/6caa4977-8333-4171-8825-2c3bfb52f80b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.019s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:03:56 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-52df2c99-f1ec-4502-b0e6-2ccbd786cb82 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:03:57 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-52df2c99-f1ec-4502-b0e6-2ccbd786cb82 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json" returned: 0 in 0.259s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:03:57 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-52df2c99-f1ec-4502-b0e6-2ccbd786cb82 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Acquiring lock "b88df1b37cb431f52bc53b5616015c89b5bec411" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:03:57 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-52df2c99-f1ec-4502-b0e6-2ccbd786cb82 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Lock "b88df1b37cb431f52bc53b5616015c89b5bec411" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:03:57 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-52df2c99-f1ec-4502-b0e6-2ccbd786cb82 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:03:57 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-52df2c99-f1ec-4502-b0e6-2ccbd786cb82 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json" returned: 0 in 0.151s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:03:57 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-52df2c99-f1ec-4502-b0e6-2ccbd786cb82 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411,backing_fmt=raw /opt/stack/data/nova/instances/6caa4977-8333-4171-8825-2c3bfb52f80b/disk 1073741824 {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:03:57 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-52df2c99-f1ec-4502-b0e6-2ccbd786cb82 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411,backing_fmt=raw /opt/stack/data/nova/instances/6caa4977-8333-4171-8825-2c3bfb52f80b/disk 1073741824" returned: 0 in 0.056s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:03:57 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-52df2c99-f1ec-4502-b0e6-2ccbd786cb82 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Lock "b88df1b37cb431f52bc53b5616015c89b5bec411" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.214s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:03:57 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-52df2c99-f1ec-4502-b0e6-2ccbd786cb82 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:03:57 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-52df2c99-f1ec-4502-b0e6-2ccbd786cb82 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json" returned: 0 in 0.181s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:03:57 user nova-compute[71874]: DEBUG nova.virt.disk.api [None req-52df2c99-f1ec-4502-b0e6-2ccbd786cb82 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6caa4977-8333-4171-8825-2c3bfb52f80b/disk. size=1073741824 {{(pid=71874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 16:03:57 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-52df2c99-f1ec-4502-b0e6-2ccbd786cb82 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6caa4977-8333-4171-8825-2c3bfb52f80b/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:03:57 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-52df2c99-f1ec-4502-b0e6-2ccbd786cb82 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6caa4977-8333-4171-8825-2c3bfb52f80b/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:03:57 user nova-compute[71874]: DEBUG nova.virt.disk.api [None req-52df2c99-f1ec-4502-b0e6-2ccbd786cb82 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Cannot resize image /opt/stack/data/nova/instances/6caa4977-8333-4171-8825-2c3bfb52f80b/disk to a smaller size. {{(pid=71874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 16:03:57 user nova-compute[71874]: DEBUG nova.objects.instance [None req-52df2c99-f1ec-4502-b0e6-2ccbd786cb82 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Lazy-loading 'migration_context' on Instance uuid 6caa4977-8333-4171-8825-2c3bfb52f80b {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:03:57 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:03:57 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-52df2c99-f1ec-4502-b0e6-2ccbd786cb82 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Created local disks {{(pid=71874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 16:03:57 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-52df2c99-f1ec-4502-b0e6-2ccbd786cb82 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Ensure instance console log exists: /opt/stack/data/nova/instances/6caa4977-8333-4171-8825-2c3bfb52f80b/console.log {{(pid=71874) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 16:03:57 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-52df2c99-f1ec-4502-b0e6-2ccbd786cb82 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:03:57 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-52df2c99-f1ec-4502-b0e6-2ccbd786cb82 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:03:57 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-52df2c99-f1ec-4502-b0e6-2ccbd786cb82 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:03:57 user nova-compute[71874]: DEBUG nova.network.neutron [None req-52df2c99-f1ec-4502-b0e6-2ccbd786cb82 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Successfully created port: c42ace22-d91b-4e4b-909e-19aaa428515a {{(pid=71874) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 16:03:58 user nova-compute[71874]: DEBUG nova.network.neutron [None req-52df2c99-f1ec-4502-b0e6-2ccbd786cb82 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Successfully updated port: c42ace22-d91b-4e4b-909e-19aaa428515a {{(pid=71874) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 16:03:58 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-52df2c99-f1ec-4502-b0e6-2ccbd786cb82 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Acquiring lock "refresh_cache-6caa4977-8333-4171-8825-2c3bfb52f80b" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:03:58 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-52df2c99-f1ec-4502-b0e6-2ccbd786cb82 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Acquired lock "refresh_cache-6caa4977-8333-4171-8825-2c3bfb52f80b" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:03:58 user nova-compute[71874]: DEBUG nova.network.neutron [None req-52df2c99-f1ec-4502-b0e6-2ccbd786cb82 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Building network info cache for instance {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 16:03:58 user nova-compute[71874]: DEBUG nova.compute.manager [req-3a12f1d4-b9ba-4b42-a7c4-1abcc98c4972 req-d9ab6855-10c9-4d13-9bec-7d1fb5600499 service nova] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Received event network-changed-c42ace22-d91b-4e4b-909e-19aaa428515a {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:03:58 user nova-compute[71874]: DEBUG nova.compute.manager [req-3a12f1d4-b9ba-4b42-a7c4-1abcc98c4972 req-d9ab6855-10c9-4d13-9bec-7d1fb5600499 service nova] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Refreshing instance network info cache due to event network-changed-c42ace22-d91b-4e4b-909e-19aaa428515a. {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 16:03:58 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-3a12f1d4-b9ba-4b42-a7c4-1abcc98c4972 req-d9ab6855-10c9-4d13-9bec-7d1fb5600499 service nova] Acquiring lock "refresh_cache-6caa4977-8333-4171-8825-2c3bfb52f80b" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:03:58 user nova-compute[71874]: DEBUG nova.network.neutron [None req-52df2c99-f1ec-4502-b0e6-2ccbd786cb82 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Instance cache missing network info. {{(pid=71874) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 16:03:59 user nova-compute[71874]: DEBUG nova.network.neutron [None req-52df2c99-f1ec-4502-b0e6-2ccbd786cb82 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Updating instance_info_cache with network_info: [{"id": "c42ace22-d91b-4e4b-909e-19aaa428515a", "address": "fa:16:3e:3e:cd:0b", "network": {"id": "0e139ef7-ae53-4cce-9063-218ac1a19c0c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2058204483-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3deffbb4769b4985b038b4adcd82b018", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc42ace22-d9", "ovs_interfaceid": "c42ace22-d91b-4e4b-909e-19aaa428515a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:03:59 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-52df2c99-f1ec-4502-b0e6-2ccbd786cb82 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Releasing lock "refresh_cache-6caa4977-8333-4171-8825-2c3bfb52f80b" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:03:59 user nova-compute[71874]: DEBUG nova.compute.manager [None req-52df2c99-f1ec-4502-b0e6-2ccbd786cb82 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Instance network_info: |[{"id": "c42ace22-d91b-4e4b-909e-19aaa428515a", "address": "fa:16:3e:3e:cd:0b", "network": {"id": "0e139ef7-ae53-4cce-9063-218ac1a19c0c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2058204483-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3deffbb4769b4985b038b4adcd82b018", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc42ace22-d9", "ovs_interfaceid": "c42ace22-d91b-4e4b-909e-19aaa428515a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 16:03:59 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-3a12f1d4-b9ba-4b42-a7c4-1abcc98c4972 req-d9ab6855-10c9-4d13-9bec-7d1fb5600499 service nova] Acquired lock "refresh_cache-6caa4977-8333-4171-8825-2c3bfb52f80b" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:03:59 user nova-compute[71874]: DEBUG nova.network.neutron [req-3a12f1d4-b9ba-4b42-a7c4-1abcc98c4972 req-d9ab6855-10c9-4d13-9bec-7d1fb5600499 service nova] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Refreshing network info cache for port c42ace22-d91b-4e4b-909e-19aaa428515a {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 16:03:59 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-52df2c99-f1ec-4502-b0e6-2ccbd786cb82 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Start _get_guest_xml network_info=[{"id": "c42ace22-d91b-4e4b-909e-19aaa428515a", "address": "fa:16:3e:3e:cd:0b", "network": {"id": "0e139ef7-ae53-4cce-9063-218ac1a19c0c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2058204483-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3deffbb4769b4985b038b4adcd82b018", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc42ace22-d9", "ovs_interfaceid": "c42ace22-d91b-4e4b-909e-19aaa428515a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T15:55:37Z,direct_url=<?>,disk_format='qcow2',id=9dc63f14-8b70-4e72-89f2-13464f2f5c7c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='61a4936d9b7744c0b488d81c9b7746b6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T15:55:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_options': None, 'image_id': '9dc63f14-8b70-4e72-89f2-13464f2f5c7c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 16:03:59 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-52df2c99-f1ec-4502-b0e6-2ccbd786cb82 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:03:59 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-52df2c99-f1ec-4502-b0e6-2ccbd786cb82 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:03:59 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-52df2c99-f1ec-4502-b0e6-2ccbd786cb82 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71874) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 16:03:59 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-52df2c99-f1ec-4502-b0e6-2ccbd786cb82 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T15:56:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T15:55:37Z,direct_url=<?>,disk_format='qcow2',id=9dc63f14-8b70-4e72-89f2-13464f2f5c7c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='61a4936d9b7744c0b488d81c9b7746b6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T15:55:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 16:03:59 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-52df2c99-f1ec-4502-b0e6-2ccbd786cb82 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Flavor limits 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 16:03:59 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-52df2c99-f1ec-4502-b0e6-2ccbd786cb82 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Image limits 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 16:03:59 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-52df2c99-f1ec-4502-b0e6-2ccbd786cb82 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Flavor pref 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 16:03:59 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-52df2c99-f1ec-4502-b0e6-2ccbd786cb82 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Image pref 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 16:03:59 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-52df2c99-f1ec-4502-b0e6-2ccbd786cb82 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 16:03:59 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-52df2c99-f1ec-4502-b0e6-2ccbd786cb82 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 16:03:59 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-52df2c99-f1ec-4502-b0e6-2ccbd786cb82 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 16:03:59 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-52df2c99-f1ec-4502-b0e6-2ccbd786cb82 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Got 1 possible topologies {{(pid=71874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 16:03:59 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-52df2c99-f1ec-4502-b0e6-2ccbd786cb82 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 16:03:59 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-52df2c99-f1ec-4502-b0e6-2ccbd786cb82 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 16:03:59 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-52df2c99-f1ec-4502-b0e6-2ccbd786cb82 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T16:03:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-689097339',display_name='tempest-ServerStableDeviceRescueTest-server-689097339',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-689097339',id=18,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAam8LYyB+LjNdQE4JBvTI3p3CIYJWs7/MCfiZUy9Xd8eIW/jYHvtZuhkG/lsvTL9zeSBHrSduF7W+pN/Bj80hUnONEMW2bSoSjFErg09RBlgz7o7NI0zfHfHDu88Z99bg==',key_name='tempest-keypair-1356498122',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3deffbb4769b4985b038b4adcd82b018',ramdisk_id='',reservation_id='r-vjrj0b0t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-692889073',owner_user_name='tempest-ServerStableDeviceRescueTest-692889073-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T16:03:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f76e286bd75a4cbaad7a7b735014f3d7',uuid=6caa4977-8333-4171-8825-2c3bfb52f80b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c42ace22-d91b-4e4b-909e-19aaa428515a", "address": "fa:16:3e:3e:cd:0b", "network": {"id": "0e139ef7-ae53-4cce-9063-218ac1a19c0c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2058204483-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3deffbb4769b4985b038b4adcd82b018", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc42ace22-d9", "ovs_interfaceid": "c42ace22-d91b-4e4b-909e-19aaa428515a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 16:03:59 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-52df2c99-f1ec-4502-b0e6-2ccbd786cb82 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Converting VIF {"id": "c42ace22-d91b-4e4b-909e-19aaa428515a", "address": "fa:16:3e:3e:cd:0b", "network": {"id": "0e139ef7-ae53-4cce-9063-218ac1a19c0c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2058204483-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3deffbb4769b4985b038b4adcd82b018", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc42ace22-d9", "ovs_interfaceid": "c42ace22-d91b-4e4b-909e-19aaa428515a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:03:59 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-52df2c99-f1ec-4502-b0e6-2ccbd786cb82 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:cd:0b,bridge_name='br-int',has_traffic_filtering=True,id=c42ace22-d91b-4e4b-909e-19aaa428515a,network=Network(0e139ef7-ae53-4cce-9063-218ac1a19c0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc42ace22-d9') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:03:59 user nova-compute[71874]: DEBUG nova.objects.instance [None req-52df2c99-f1ec-4502-b0e6-2ccbd786cb82 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Lazy-loading 'pci_devices' on Instance uuid 6caa4977-8333-4171-8825-2c3bfb52f80b {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:03:59 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-52df2c99-f1ec-4502-b0e6-2ccbd786cb82 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] End _get_guest_xml xml=<domain type="kvm">
Apr 12 16:03:59 user nova-compute[71874]:   <uuid>6caa4977-8333-4171-8825-2c3bfb52f80b</uuid>
Apr 12 16:03:59 user nova-compute[71874]:   <name>instance-00000012</name>
Apr 12 16:03:59 user nova-compute[71874]:   <memory>131072</memory>
Apr 12 16:03:59 user nova-compute[71874]:   <vcpu>1</vcpu>
Apr 12 16:03:59 user nova-compute[71874]:   <metadata>
Apr 12 16:03:59 user nova-compute[71874]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 16:03:59 user nova-compute[71874]:       <nova:package version="0.0.0"/>
Apr 12 16:03:59 user nova-compute[71874]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-689097339</nova:name>
Apr 12 16:03:59 user nova-compute[71874]:       <nova:creationTime>2023-04-12 16:03:59</nova:creationTime>
Apr 12 16:03:59 user nova-compute[71874]:       <nova:flavor name="m1.nano">
Apr 12 16:03:59 user nova-compute[71874]:         <nova:memory>128</nova:memory>
Apr 12 16:03:59 user nova-compute[71874]:         <nova:disk>1</nova:disk>
Apr 12 16:03:59 user nova-compute[71874]:         <nova:swap>0</nova:swap>
Apr 12 16:03:59 user nova-compute[71874]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 16:03:59 user nova-compute[71874]:         <nova:vcpus>1</nova:vcpus>
Apr 12 16:03:59 user nova-compute[71874]:       </nova:flavor>
Apr 12 16:03:59 user nova-compute[71874]:       <nova:owner>
Apr 12 16:03:59 user nova-compute[71874]:         <nova:user uuid="f76e286bd75a4cbaad7a7b735014f3d7">tempest-ServerStableDeviceRescueTest-692889073-project-member</nova:user>
Apr 12 16:03:59 user nova-compute[71874]:         <nova:project uuid="3deffbb4769b4985b038b4adcd82b018">tempest-ServerStableDeviceRescueTest-692889073</nova:project>
Apr 12 16:03:59 user nova-compute[71874]:       </nova:owner>
Apr 12 16:03:59 user nova-compute[71874]:       <nova:root type="image" uuid="9dc63f14-8b70-4e72-89f2-13464f2f5c7c"/>
Apr 12 16:03:59 user nova-compute[71874]:       <nova:ports>
Apr 12 16:03:59 user nova-compute[71874]:         <nova:port uuid="c42ace22-d91b-4e4b-909e-19aaa428515a">
Apr 12 16:03:59 user nova-compute[71874]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Apr 12 16:03:59 user nova-compute[71874]:         </nova:port>
Apr 12 16:03:59 user nova-compute[71874]:       </nova:ports>
Apr 12 16:03:59 user nova-compute[71874]:     </nova:instance>
Apr 12 16:03:59 user nova-compute[71874]:   </metadata>
Apr 12 16:03:59 user nova-compute[71874]:   <sysinfo type="smbios">
Apr 12 16:03:59 user nova-compute[71874]:     <system>
Apr 12 16:03:59 user nova-compute[71874]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 16:03:59 user nova-compute[71874]:       <entry name="product">OpenStack Nova</entry>
Apr 12 16:03:59 user nova-compute[71874]:       <entry name="version">0.0.0</entry>
Apr 12 16:03:59 user nova-compute[71874]:       <entry name="serial">6caa4977-8333-4171-8825-2c3bfb52f80b</entry>
Apr 12 16:03:59 user nova-compute[71874]:       <entry name="uuid">6caa4977-8333-4171-8825-2c3bfb52f80b</entry>
Apr 12 16:03:59 user nova-compute[71874]:       <entry name="family">Virtual Machine</entry>
Apr 12 16:03:59 user nova-compute[71874]:     </system>
Apr 12 16:03:59 user nova-compute[71874]:   </sysinfo>
Apr 12 16:03:59 user nova-compute[71874]:   <os>
Apr 12 16:03:59 user nova-compute[71874]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 16:03:59 user nova-compute[71874]:     <boot dev="hd"/>
Apr 12 16:03:59 user nova-compute[71874]:     <smbios mode="sysinfo"/>
Apr 12 16:03:59 user nova-compute[71874]:   </os>
Apr 12 16:03:59 user nova-compute[71874]:   <features>
Apr 12 16:03:59 user nova-compute[71874]:     <acpi/>
Apr 12 16:03:59 user nova-compute[71874]:     <apic/>
Apr 12 16:03:59 user nova-compute[71874]:     <vmcoreinfo/>
Apr 12 16:03:59 user nova-compute[71874]:   </features>
Apr 12 16:03:59 user nova-compute[71874]:   <clock offset="utc">
Apr 12 16:03:59 user nova-compute[71874]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 16:03:59 user nova-compute[71874]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 16:03:59 user nova-compute[71874]:     <timer name="hpet" present="no"/>
Apr 12 16:03:59 user nova-compute[71874]:   </clock>
Apr 12 16:03:59 user nova-compute[71874]:   <cpu mode="custom" match="exact">
Apr 12 16:03:59 user nova-compute[71874]:     <model>Nehalem</model>
Apr 12 16:03:59 user nova-compute[71874]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 16:03:59 user nova-compute[71874]:   </cpu>
Apr 12 16:03:59 user nova-compute[71874]:   <devices>
Apr 12 16:03:59 user nova-compute[71874]:     <disk type="file" device="disk">
Apr 12 16:03:59 user nova-compute[71874]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 16:03:59 user nova-compute[71874]:       <source file="/opt/stack/data/nova/instances/6caa4977-8333-4171-8825-2c3bfb52f80b/disk"/>
Apr 12 16:03:59 user nova-compute[71874]:       <target dev="vda" bus="virtio"/>
Apr 12 16:03:59 user nova-compute[71874]:     </disk>
Apr 12 16:03:59 user nova-compute[71874]:     <interface type="ethernet">
Apr 12 16:03:59 user nova-compute[71874]:       <mac address="fa:16:3e:3e:cd:0b"/>
Apr 12 16:03:59 user nova-compute[71874]:       <model type="virtio"/>
Apr 12 16:03:59 user nova-compute[71874]:       <mtu size="1442"/>
Apr 12 16:03:59 user nova-compute[71874]:       <target dev="tapc42ace22-d9"/>
Apr 12 16:03:59 user nova-compute[71874]:     </interface>
Apr 12 16:03:59 user nova-compute[71874]:     <serial type="pty">
Apr 12 16:03:59 user nova-compute[71874]:       <log file="/opt/stack/data/nova/instances/6caa4977-8333-4171-8825-2c3bfb52f80b/console.log" append="off"/>
Apr 12 16:03:59 user nova-compute[71874]:     </serial>
Apr 12 16:03:59 user nova-compute[71874]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 16:03:59 user nova-compute[71874]:     <video>
Apr 12 16:03:59 user nova-compute[71874]:       <model type="virtio"/>
Apr 12 16:03:59 user nova-compute[71874]:     </video>
Apr 12 16:03:59 user nova-compute[71874]:     <rng model="virtio">
Apr 12 16:03:59 user nova-compute[71874]:       <backend model="random">/dev/urandom</backend>
Apr 12 16:03:59 user nova-compute[71874]:     </rng>
Apr 12 16:03:59 user nova-compute[71874]:     <controller type="usb" index="0" model="none"/>
Apr 12 16:03:59 user nova-compute[71874]:     <memballoon model="virtio">
Apr 12 16:03:59 user nova-compute[71874]:       <stats period="10"/>
Apr 12 16:03:59 user nova-compute[71874]:     </memballoon>
Apr 12 16:03:59 user nova-compute[71874]:   </devices>
Apr 12 16:03:59 user nova-compute[71874]: </domain>
Apr 12 16:03:59 user nova-compute[71874]:  {{(pid=71874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 16:03:59 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-52df2c99-f1ec-4502-b0e6-2ccbd786cb82 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T16:03:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-689097339',display_name='tempest-ServerStableDeviceRescueTest-server-689097339',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-689097339',id=18,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAam8LYyB+LjNdQE4JBvTI3p3CIYJWs7/MCfiZUy9Xd8eIW/jYHvtZuhkG/lsvTL9zeSBHrSduF7W+pN/Bj80hUnONEMW2bSoSjFErg09RBlgz7o7NI0zfHfHDu88Z99bg==',key_name='tempest-keypair-1356498122',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3deffbb4769b4985b038b4adcd82b018',ramdisk_id='',reservation_id='r-vjrj0b0t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-692889073',owner_user_name='tempest-ServerStableDeviceRescueTest-692889073-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T16:03:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f76e286bd75a4cbaad7a7b735014f3d7',uuid=6caa4977-8333-4171-8825-2c3bfb52f80b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c42ace22-d91b-4e4b-909e-19aaa428515a", "address": "fa:16:3e:3e:cd:0b", "network": {"id": "0e139ef7-ae53-4cce-9063-218ac1a19c0c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2058204483-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3deffbb4769b4985b038b4adcd82b018", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc42ace22-d9", "ovs_interfaceid": "c42ace22-d91b-4e4b-909e-19aaa428515a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 16:03:59 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-52df2c99-f1ec-4502-b0e6-2ccbd786cb82 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Converting VIF {"id": "c42ace22-d91b-4e4b-909e-19aaa428515a", "address": "fa:16:3e:3e:cd:0b", "network": {"id": "0e139ef7-ae53-4cce-9063-218ac1a19c0c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2058204483-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3deffbb4769b4985b038b4adcd82b018", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc42ace22-d9", "ovs_interfaceid": "c42ace22-d91b-4e4b-909e-19aaa428515a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:03:59 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-52df2c99-f1ec-4502-b0e6-2ccbd786cb82 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:cd:0b,bridge_name='br-int',has_traffic_filtering=True,id=c42ace22-d91b-4e4b-909e-19aaa428515a,network=Network(0e139ef7-ae53-4cce-9063-218ac1a19c0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc42ace22-d9') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:03:59 user nova-compute[71874]: DEBUG os_vif [None req-52df2c99-f1ec-4502-b0e6-2ccbd786cb82 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:cd:0b,bridge_name='br-int',has_traffic_filtering=True,id=c42ace22-d91b-4e4b-909e-19aaa428515a,network=Network(0e139ef7-ae53-4cce-9063-218ac1a19c0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc42ace22-d9') {{(pid=71874) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 16:03:59 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:03:59 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:03:59 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 16:03:59 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:03:59 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc42ace22-d9, may_exist=True) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:03:59 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc42ace22-d9, col_values=(('external_ids', {'iface-id': 'c42ace22-d91b-4e4b-909e-19aaa428515a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3e:cd:0b', 'vm-uuid': '6caa4977-8333-4171-8825-2c3bfb52f80b'}),)) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:03:59 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:03:59 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:03:59 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:03:59 user nova-compute[71874]: INFO os_vif [None req-52df2c99-f1ec-4502-b0e6-2ccbd786cb82 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:cd:0b,bridge_name='br-int',has_traffic_filtering=True,id=c42ace22-d91b-4e4b-909e-19aaa428515a,network=Network(0e139ef7-ae53-4cce-9063-218ac1a19c0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc42ace22-d9')
Apr 12 16:03:59 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-52df2c99-f1ec-4502-b0e6-2ccbd786cb82 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] No BDM found with device name vda, not building metadata. {{(pid=71874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 16:03:59 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-52df2c99-f1ec-4502-b0e6-2ccbd786cb82 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] No VIF found with MAC fa:16:3e:3e:cd:0b, not building metadata {{(pid=71874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 16:04:00 user nova-compute[71874]: DEBUG nova.network.neutron [req-3a12f1d4-b9ba-4b42-a7c4-1abcc98c4972 req-d9ab6855-10c9-4d13-9bec-7d1fb5600499 service nova] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Updated VIF entry in instance network info cache for port c42ace22-d91b-4e4b-909e-19aaa428515a. {{(pid=71874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 16:04:00 user nova-compute[71874]: DEBUG nova.network.neutron [req-3a12f1d4-b9ba-4b42-a7c4-1abcc98c4972 req-d9ab6855-10c9-4d13-9bec-7d1fb5600499 service nova] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Updating instance_info_cache with network_info: [{"id": "c42ace22-d91b-4e4b-909e-19aaa428515a", "address": "fa:16:3e:3e:cd:0b", "network": {"id": "0e139ef7-ae53-4cce-9063-218ac1a19c0c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2058204483-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3deffbb4769b4985b038b4adcd82b018", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc42ace22-d9", "ovs_interfaceid": "c42ace22-d91b-4e4b-909e-19aaa428515a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:04:00 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-3a12f1d4-b9ba-4b42-a7c4-1abcc98c4972 req-d9ab6855-10c9-4d13-9bec-7d1fb5600499 service nova] Releasing lock "refresh_cache-6caa4977-8333-4171-8825-2c3bfb52f80b" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:04:00 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:04:00 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:04:00 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:04:00 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:04:01 user nova-compute[71874]: DEBUG nova.compute.manager [req-237d7832-4ce2-4030-9e55-4bc162794827 req-b91e02d4-2cb5-405a-8a58-0c9e1d7c09b3 service nova] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Received event network-vif-plugged-c42ace22-d91b-4e4b-909e-19aaa428515a {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:04:01 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-237d7832-4ce2-4030-9e55-4bc162794827 req-b91e02d4-2cb5-405a-8a58-0c9e1d7c09b3 service nova] Acquiring lock "6caa4977-8333-4171-8825-2c3bfb52f80b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:04:01 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-237d7832-4ce2-4030-9e55-4bc162794827 req-b91e02d4-2cb5-405a-8a58-0c9e1d7c09b3 service nova] Lock "6caa4977-8333-4171-8825-2c3bfb52f80b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:04:01 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-237d7832-4ce2-4030-9e55-4bc162794827 req-b91e02d4-2cb5-405a-8a58-0c9e1d7c09b3 service nova] Lock "6caa4977-8333-4171-8825-2c3bfb52f80b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:04:01 user nova-compute[71874]: DEBUG nova.compute.manager [req-237d7832-4ce2-4030-9e55-4bc162794827 req-b91e02d4-2cb5-405a-8a58-0c9e1d7c09b3 service nova] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] No waiting events found dispatching network-vif-plugged-c42ace22-d91b-4e4b-909e-19aaa428515a {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:04:01 user nova-compute[71874]: WARNING nova.compute.manager [req-237d7832-4ce2-4030-9e55-4bc162794827 req-b91e02d4-2cb5-405a-8a58-0c9e1d7c09b3 service nova] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Received unexpected event network-vif-plugged-c42ace22-d91b-4e4b-909e-19aaa428515a for instance with vm_state building and task_state spawning.
Apr 12 16:04:01 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:04:01 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:04:01 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:04:01 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:04:02 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-a6b165c5-cf5d-4c81-9fbf-a1ea238da5ef tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Acquiring lock "85b91251-9735-4812-9f11-003a7951a6f3" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:04:02 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-a6b165c5-cf5d-4c81-9fbf-a1ea238da5ef tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Lock "85b91251-9735-4812-9f11-003a7951a6f3" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:04:02 user nova-compute[71874]: INFO nova.compute.manager [None req-a6b165c5-cf5d-4c81-9fbf-a1ea238da5ef tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] Unshelving
Apr 12 16:04:02 user nova-compute[71874]: INFO nova.virt.block_device [None req-a6b165c5-cf5d-4c81-9fbf-a1ea238da5ef tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] Booting with volume 863633c1-6f4e-41f5-b72c-91ca428b73b2 at /dev/vda
Apr 12 16:04:02 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:04:02 user nova-compute[71874]: DEBUG os_brick.utils [None req-a6b165c5-cf5d-4c81-9fbf-a1ea238da5ef tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:04:02 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:04:02 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:04:02 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2a20a35-b324-4a0c-bf5a-23fd08e3de3a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:61a48d4489d2\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:04:02 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:04:02 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.031s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:04:02 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[6724cedc-cee3-4a0a-95c6-55b1f00161ff]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:04:02 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:04:02 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:04:02 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[05ed80a2-ecdc-4aa6-952b-abd1b129e32d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:04:02 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b6c3906-3f3a-4baa-89d9-26ef6ddd396a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:04:02 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-a6b165c5-cf5d-4c81-9fbf-a1ea238da5ef tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Running cmd (subprocess): nvme version {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:04:02 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-a6b165c5-cf5d-4c81-9fbf-a1ea238da5ef tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] 'nvme version' failed. Not Retrying. {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 16:04:02 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a6b165c5-cf5d-4c81-9fbf-a1ea238da5ef tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] nvme not present on system {{(pid=71874) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 16:04:02 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:04:02 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 16:04:02 user nova-compute[71874]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 16:04:02 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[caa37276-ffc0-4567-9a00-4e8cd1f5e6a4]: (4, '') {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:04:02 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.lightos [None req-a6b165c5-cf5d-4c81-9fbf-a1ea238da5ef tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71874) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 16:04:02 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.lightos [None req-a6b165c5-cf5d-4c81-9fbf-a1ea238da5ef tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71874) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 16:04:02 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.lightos [None req-a6b165c5-cf5d-4c81-9fbf-a1ea238da5ef tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] LIGHTOS: no hostnqn found. {{(pid=71874) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 16:04:02 user nova-compute[71874]: DEBUG os_brick.utils [None req-a6b165c5-cf5d-4c81-9fbf-a1ea238da5ef tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:61a48d4489d2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:04:02 user nova-compute[71874]: DEBUG nova.virt.block_device [None req-a6b165c5-cf5d-4c81-9fbf-a1ea238da5ef tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] Updating existing volume attachment record: d1cfac14-1f82-4017-882a-e279cc68da61 {{(pid=71874) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 16:04:03 user nova-compute[71874]: DEBUG nova.compute.manager [req-bae44568-4dd9-49aa-987b-f90af1d6c276 req-53c3c91f-c845-4ba8-9d46-f889faefc2bd service nova] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Received event network-vif-plugged-c42ace22-d91b-4e4b-909e-19aaa428515a {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:04:03 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-bae44568-4dd9-49aa-987b-f90af1d6c276 req-53c3c91f-c845-4ba8-9d46-f889faefc2bd service nova] Acquiring lock "6caa4977-8333-4171-8825-2c3bfb52f80b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:04:03 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-bae44568-4dd9-49aa-987b-f90af1d6c276 req-53c3c91f-c845-4ba8-9d46-f889faefc2bd service nova] Lock "6caa4977-8333-4171-8825-2c3bfb52f80b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:04:03 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-bae44568-4dd9-49aa-987b-f90af1d6c276 req-53c3c91f-c845-4ba8-9d46-f889faefc2bd service nova] Lock "6caa4977-8333-4171-8825-2c3bfb52f80b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:04:03 user nova-compute[71874]: DEBUG nova.compute.manager [req-bae44568-4dd9-49aa-987b-f90af1d6c276 req-53c3c91f-c845-4ba8-9d46-f889faefc2bd service nova] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] No waiting events found dispatching network-vif-plugged-c42ace22-d91b-4e4b-909e-19aaa428515a {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:04:03 user nova-compute[71874]: WARNING nova.compute.manager [req-bae44568-4dd9-49aa-987b-f90af1d6c276 req-53c3c91f-c845-4ba8-9d46-f889faefc2bd service nova] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Received unexpected event network-vif-plugged-c42ace22-d91b-4e4b-909e-19aaa428515a for instance with vm_state building and task_state spawning.
Apr 12 16:04:03 user nova-compute[71874]: DEBUG nova.virt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Emitting event <LifecycleEvent: 1681315443.2349381, 6caa4977-8333-4171-8825-2c3bfb52f80b => Resumed> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:04:03 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] VM Resumed (Lifecycle Event)
Apr 12 16:04:03 user nova-compute[71874]: DEBUG nova.compute.manager [None req-52df2c99-f1ec-4502-b0e6-2ccbd786cb82 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Instance event wait completed in 0 seconds for  {{(pid=71874) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 16:04:03 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-52df2c99-f1ec-4502-b0e6-2ccbd786cb82 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Guest created on hypervisor {{(pid=71874) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 16:04:03 user nova-compute[71874]: INFO nova.virt.libvirt.driver [-] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Instance spawned successfully.
Apr 12 16:04:03 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-52df2c99-f1ec-4502-b0e6-2ccbd786cb82 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 16:04:03 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:04:03 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 16:04:03 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-52df2c99-f1ec-4502-b0e6-2ccbd786cb82 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Found default for hw_cdrom_bus of ide {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:04:03 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-52df2c99-f1ec-4502-b0e6-2ccbd786cb82 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Found default for hw_disk_bus of virtio {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:04:03 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-52df2c99-f1ec-4502-b0e6-2ccbd786cb82 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Found default for hw_input_bus of None {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:04:03 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-52df2c99-f1ec-4502-b0e6-2ccbd786cb82 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Found default for hw_pointer_model of None {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:04:03 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-52df2c99-f1ec-4502-b0e6-2ccbd786cb82 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Found default for hw_video_model of virtio {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:04:03 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-52df2c99-f1ec-4502-b0e6-2ccbd786cb82 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Found default for hw_vif_model of virtio {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:04:03 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 16:04:03 user nova-compute[71874]: DEBUG nova.virt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Emitting event <LifecycleEvent: 1681315443.2355123, 6caa4977-8333-4171-8825-2c3bfb52f80b => Started> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:04:03 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] VM Started (Lifecycle Event)
Apr 12 16:04:03 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:04:03 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 16:04:03 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 16:04:03 user nova-compute[71874]: INFO nova.compute.manager [None req-52df2c99-f1ec-4502-b0e6-2ccbd786cb82 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Took 6.64 seconds to spawn the instance on the hypervisor.
Apr 12 16:04:03 user nova-compute[71874]: DEBUG nova.compute.manager [None req-52df2c99-f1ec-4502-b0e6-2ccbd786cb82 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:04:03 user nova-compute[71874]: INFO nova.compute.manager [None req-52df2c99-f1ec-4502-b0e6-2ccbd786cb82 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Took 7.73 seconds to build instance.
Apr 12 16:04:03 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-52df2c99-f1ec-4502-b0e6-2ccbd786cb82 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Lock "6caa4977-8333-4171-8825-2c3bfb52f80b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.839s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:04:04 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:04:06 user nova-compute[71874]: INFO nova.compute.manager [None req-83d91fc8-dbfb-463d-b04a-abe0cf5a9505 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] Rescuing
Apr 12 16:04:06 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-83d91fc8-dbfb-463d-b04a-abe0cf5a9505 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Acquiring lock "refresh_cache-afebffae-dbf6-4876-8c9f-0364f0fde49c" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:04:06 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-83d91fc8-dbfb-463d-b04a-abe0cf5a9505 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Acquired lock "refresh_cache-afebffae-dbf6-4876-8c9f-0364f0fde49c" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:04:06 user nova-compute[71874]: DEBUG nova.network.neutron [None req-83d91fc8-dbfb-463d-b04a-abe0cf5a9505 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] Building network info cache for instance {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 16:04:07 user nova-compute[71874]: DEBUG nova.network.neutron [None req-83d91fc8-dbfb-463d-b04a-abe0cf5a9505 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] Updating instance_info_cache with network_info: [{"id": "c4b29e0b-0ad8-4897-acf3-76004ac0338b", "address": "fa:16:3e:b8:23:a7", "network": {"id": "06fae0be-02dd-4962-a1ac-fd0413772758", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1493924857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3fe48a3b7d846a195f1e47cc7f69695", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4b29e0b-0a", "ovs_interfaceid": "c4b29e0b-0ad8-4897-acf3-76004ac0338b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:04:07 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-83d91fc8-dbfb-463d-b04a-abe0cf5a9505 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Releasing lock "refresh_cache-afebffae-dbf6-4876-8c9f-0364f0fde49c" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:04:07 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:04:07 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:04:07 user nova-compute[71874]: DEBUG nova.compute.manager [req-5e152d8e-e482-4cf1-8968-272feba7a294 req-9ab4b3a2-1a7a-4f01-8f68-55158ea8e2ce service nova] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] Received event network-vif-unplugged-c4b29e0b-0ad8-4897-acf3-76004ac0338b {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:04:07 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-5e152d8e-e482-4cf1-8968-272feba7a294 req-9ab4b3a2-1a7a-4f01-8f68-55158ea8e2ce service nova] Acquiring lock "afebffae-dbf6-4876-8c9f-0364f0fde49c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:04:07 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-5e152d8e-e482-4cf1-8968-272feba7a294 req-9ab4b3a2-1a7a-4f01-8f68-55158ea8e2ce service nova] Lock "afebffae-dbf6-4876-8c9f-0364f0fde49c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:04:07 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-5e152d8e-e482-4cf1-8968-272feba7a294 req-9ab4b3a2-1a7a-4f01-8f68-55158ea8e2ce service nova] Lock "afebffae-dbf6-4876-8c9f-0364f0fde49c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:04:07 user nova-compute[71874]: DEBUG nova.compute.manager [req-5e152d8e-e482-4cf1-8968-272feba7a294 req-9ab4b3a2-1a7a-4f01-8f68-55158ea8e2ce service nova] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] No waiting events found dispatching network-vif-unplugged-c4b29e0b-0ad8-4897-acf3-76004ac0338b {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:04:07 user nova-compute[71874]: WARNING nova.compute.manager [req-5e152d8e-e482-4cf1-8968-272feba7a294 req-9ab4b3a2-1a7a-4f01-8f68-55158ea8e2ce service nova] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] Received unexpected event network-vif-unplugged-c4b29e0b-0ad8-4897-acf3-76004ac0338b for instance with vm_state active and task_state rescuing.
Apr 12 16:04:07 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:04:07 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:04:07 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:04:07 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-a6b165c5-cf5d-4c81-9fbf-a1ea238da5ef tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:04:07 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-a6b165c5-cf5d-4c81-9fbf-a1ea238da5ef tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:04:07 user nova-compute[71874]: DEBUG nova.objects.instance [None req-a6b165c5-cf5d-4c81-9fbf-a1ea238da5ef tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Lazy-loading 'pci_requests' on Instance uuid 85b91251-9735-4812-9f11-003a7951a6f3 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:04:07 user nova-compute[71874]: DEBUG nova.objects.instance [None req-a6b165c5-cf5d-4c81-9fbf-a1ea238da5ef tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Lazy-loading 'numa_topology' on Instance uuid 85b91251-9735-4812-9f11-003a7951a6f3 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:04:07 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-a6b165c5-cf5d-4c81-9fbf-a1ea238da5ef tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71874) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 16:04:07 user nova-compute[71874]: INFO nova.compute.claims [None req-a6b165c5-cf5d-4c81-9fbf-a1ea238da5ef tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] Claim successful on node user
Apr 12 16:04:08 user nova-compute[71874]: INFO nova.virt.libvirt.driver [-] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] Instance destroyed successfully.
Apr 12 16:04:08 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-83d91fc8-dbfb-463d-b04a-abe0cf5a9505 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] Attempting rescue
Apr 12 16:04:08 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-83d91fc8-dbfb-463d-b04a-abe0cf5a9505 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=71874) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 12 16:04:08 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-83d91fc8-dbfb-463d-b04a-abe0cf5a9505 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] Instance directory exists: not creating {{(pid=71874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 12 16:04:08 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-83d91fc8-dbfb-463d-b04a-abe0cf5a9505 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] Creating image(s)
Apr 12 16:04:08 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-83d91fc8-dbfb-463d-b04a-abe0cf5a9505 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Acquiring lock "/opt/stack/data/nova/instances/afebffae-dbf6-4876-8c9f-0364f0fde49c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:04:08 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-83d91fc8-dbfb-463d-b04a-abe0cf5a9505 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "/opt/stack/data/nova/instances/afebffae-dbf6-4876-8c9f-0364f0fde49c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:04:08 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-83d91fc8-dbfb-463d-b04a-abe0cf5a9505 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "/opt/stack/data/nova/instances/afebffae-dbf6-4876-8c9f-0364f0fde49c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:04:08 user nova-compute[71874]: DEBUG nova.objects.instance [None req-83d91fc8-dbfb-463d-b04a-abe0cf5a9505 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lazy-loading 'trusted_certs' on Instance uuid afebffae-dbf6-4876-8c9f-0364f0fde49c {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:04:08 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-83d91fc8-dbfb-463d-b04a-abe0cf5a9505 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Acquiring lock "b88df1b37cb431f52bc53b5616015c89b5bec411" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:04:08 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-83d91fc8-dbfb-463d-b04a-abe0cf5a9505 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "b88df1b37cb431f52bc53b5616015c89b5bec411" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:04:08 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-83d91fc8-dbfb-463d-b04a-abe0cf5a9505 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:04:08 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-83d91fc8-dbfb-463d-b04a-abe0cf5a9505 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json" returned: 0 in 0.178s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:04:08 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-83d91fc8-dbfb-463d-b04a-abe0cf5a9505 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411,backing_fmt=raw /opt/stack/data/nova/instances/afebffae-dbf6-4876-8c9f-0364f0fde49c/disk.rescue {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:04:08 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-83d91fc8-dbfb-463d-b04a-abe0cf5a9505 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411,backing_fmt=raw /opt/stack/data/nova/instances/afebffae-dbf6-4876-8c9f-0364f0fde49c/disk.rescue" returned: 0 in 0.061s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:04:08 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-83d91fc8-dbfb-463d-b04a-abe0cf5a9505 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "b88df1b37cb431f52bc53b5616015c89b5bec411" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:04:08 user nova-compute[71874]: DEBUG nova.objects.instance [None req-83d91fc8-dbfb-463d-b04a-abe0cf5a9505 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lazy-loading 'migration_context' on Instance uuid afebffae-dbf6-4876-8c9f-0364f0fde49c {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:04:08 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-83d91fc8-dbfb-463d-b04a-abe0cf5a9505 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] Created local disks {{(pid=71874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 16:04:08 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-83d91fc8-dbfb-463d-b04a-abe0cf5a9505 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] Start _get_guest_xml network_info=[{"id": "c4b29e0b-0ad8-4897-acf3-76004ac0338b", "address": "fa:16:3e:b8:23:a7", "network": {"id": "06fae0be-02dd-4962-a1ac-fd0413772758", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1493924857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1493924857-network", "vif_mac": "fa:16:3e:b8:23:a7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3fe48a3b7d846a195f1e47cc7f69695", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4b29e0b-0a", "ovs_interfaceid": "c4b29e0b-0ad8-4897-acf3-76004ac0338b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T15:55:37Z,direct_url=<?>,disk_format='qcow2',id=9dc63f14-8b70-4e72-89f2-13464f2f5c7c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='61a4936d9b7744c0b488d81c9b7746b6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T15:55:39Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '9dc63f14-8b70-4e72-89f2-13464f2f5c7c', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=71874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 16:04:08 user nova-compute[71874]: DEBUG nova.objects.instance [None req-83d91fc8-dbfb-463d-b04a-abe0cf5a9505 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lazy-loading 'resources' on Instance uuid afebffae-dbf6-4876-8c9f-0364f0fde49c {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:04:08 user nova-compute[71874]: DEBUG nova.objects.instance [None req-83d91fc8-dbfb-463d-b04a-abe0cf5a9505 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lazy-loading 'numa_topology' on Instance uuid afebffae-dbf6-4876-8c9f-0364f0fde49c {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:04:08 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-83d91fc8-dbfb-463d-b04a-abe0cf5a9505 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:04:08 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-83d91fc8-dbfb-463d-b04a-abe0cf5a9505 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:04:08 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-83d91fc8-dbfb-463d-b04a-abe0cf5a9505 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71874) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 16:04:08 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-83d91fc8-dbfb-463d-b04a-abe0cf5a9505 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T15:56:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T15:55:37Z,direct_url=<?>,disk_format='qcow2',id=9dc63f14-8b70-4e72-89f2-13464f2f5c7c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='61a4936d9b7744c0b488d81c9b7746b6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T15:55:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 16:04:08 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-83d91fc8-dbfb-463d-b04a-abe0cf5a9505 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Flavor limits 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 16:04:08 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-83d91fc8-dbfb-463d-b04a-abe0cf5a9505 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Image limits 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 16:04:08 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-83d91fc8-dbfb-463d-b04a-abe0cf5a9505 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Flavor pref 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 16:04:08 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-83d91fc8-dbfb-463d-b04a-abe0cf5a9505 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Image pref 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 16:04:08 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-83d91fc8-dbfb-463d-b04a-abe0cf5a9505 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 16:04:08 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-83d91fc8-dbfb-463d-b04a-abe0cf5a9505 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 16:04:08 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-83d91fc8-dbfb-463d-b04a-abe0cf5a9505 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 16:04:08 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-83d91fc8-dbfb-463d-b04a-abe0cf5a9505 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Got 1 possible topologies {{(pid=71874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 16:04:08 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-83d91fc8-dbfb-463d-b04a-abe0cf5a9505 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 16:04:08 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-83d91fc8-dbfb-463d-b04a-abe0cf5a9505 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 16:04:08 user nova-compute[71874]: DEBUG nova.objects.instance [None req-83d91fc8-dbfb-463d-b04a-abe0cf5a9505 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lazy-loading 'vcpu_model' on Instance uuid afebffae-dbf6-4876-8c9f-0364f0fde49c {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:04:08 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-a6b165c5-cf5d-4c81-9fbf-a1ea238da5ef tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Inventory has not changed in ProviderTree for provider: 0e94b4c8-cd49-45e4-9133-d36eb4b2456b {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 16:04:08 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-a6b165c5-cf5d-4c81-9fbf-a1ea238da5ef tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Inventory has not changed for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 16:04:08 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-83d91fc8-dbfb-463d-b04a-abe0cf5a9505 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T15:59:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1230796191',display_name='tempest-ServerRescueNegativeTestJSON-server-1230796191',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1230796191',id=1,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T15:59:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b3fe48a3b7d846a195f1e47cc7f69695',ramdisk_id='',reservation_id='r-fjmy00j3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-984710343',owner_user_name='tempest-ServerRescueNegativeTestJSON-984710343-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T15:59:39Z,user_data=None,user_id='880266e3fa4d4dd889648c10208a1f8e',uuid=afebffae-dbf6-4876-8c9f-0364f0fde49c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c4b29e0b-0ad8-4897-acf3-76004ac0338b", "address": "fa:16:3e:b8:23:a7", "network": {"id": "06fae0be-02dd-4962-a1ac-fd0413772758", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1493924857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1493924857-network", "vif_mac": "fa:16:3e:b8:23:a7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3fe48a3b7d846a195f1e47cc7f69695", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4b29e0b-0a", "ovs_interfaceid": "c4b29e0b-0ad8-4897-acf3-76004ac0338b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 16:04:08 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-83d91fc8-dbfb-463d-b04a-abe0cf5a9505 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Converting VIF {"id": "c4b29e0b-0ad8-4897-acf3-76004ac0338b", "address": "fa:16:3e:b8:23:a7", "network": {"id": "06fae0be-02dd-4962-a1ac-fd0413772758", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1493924857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1493924857-network", "vif_mac": "fa:16:3e:b8:23:a7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3fe48a3b7d846a195f1e47cc7f69695", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4b29e0b-0a", "ovs_interfaceid": "c4b29e0b-0ad8-4897-acf3-76004ac0338b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:04:08 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-83d91fc8-dbfb-463d-b04a-abe0cf5a9505 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b8:23:a7,bridge_name='br-int',has_traffic_filtering=True,id=c4b29e0b-0ad8-4897-acf3-76004ac0338b,network=Network(06fae0be-02dd-4962-a1ac-fd0413772758),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4b29e0b-0a') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:04:08 user nova-compute[71874]: DEBUG nova.objects.instance [None req-83d91fc8-dbfb-463d-b04a-abe0cf5a9505 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lazy-loading 'pci_devices' on Instance uuid afebffae-dbf6-4876-8c9f-0364f0fde49c {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:04:08 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-a6b165c5-cf5d-4c81-9fbf-a1ea238da5ef tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.637s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:04:08 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-83d91fc8-dbfb-463d-b04a-abe0cf5a9505 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] End _get_guest_xml xml=<domain type="kvm">
Apr 12 16:04:08 user nova-compute[71874]:   <uuid>afebffae-dbf6-4876-8c9f-0364f0fde49c</uuid>
Apr 12 16:04:08 user nova-compute[71874]:   <name>instance-00000001</name>
Apr 12 16:04:08 user nova-compute[71874]:   <memory>131072</memory>
Apr 12 16:04:08 user nova-compute[71874]:   <vcpu>1</vcpu>
Apr 12 16:04:08 user nova-compute[71874]:   <metadata>
Apr 12 16:04:08 user nova-compute[71874]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 16:04:08 user nova-compute[71874]:       <nova:package version="0.0.0"/>
Apr 12 16:04:08 user nova-compute[71874]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1230796191</nova:name>
Apr 12 16:04:08 user nova-compute[71874]:       <nova:creationTime>2023-04-12 16:04:08</nova:creationTime>
Apr 12 16:04:08 user nova-compute[71874]:       <nova:flavor name="m1.nano">
Apr 12 16:04:08 user nova-compute[71874]:         <nova:memory>128</nova:memory>
Apr 12 16:04:08 user nova-compute[71874]:         <nova:disk>1</nova:disk>
Apr 12 16:04:08 user nova-compute[71874]:         <nova:swap>0</nova:swap>
Apr 12 16:04:08 user nova-compute[71874]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 16:04:08 user nova-compute[71874]:         <nova:vcpus>1</nova:vcpus>
Apr 12 16:04:08 user nova-compute[71874]:       </nova:flavor>
Apr 12 16:04:08 user nova-compute[71874]:       <nova:owner>
Apr 12 16:04:08 user nova-compute[71874]:         <nova:user uuid="880266e3fa4d4dd889648c10208a1f8e">tempest-ServerRescueNegativeTestJSON-984710343-project-member</nova:user>
Apr 12 16:04:08 user nova-compute[71874]:         <nova:project uuid="b3fe48a3b7d846a195f1e47cc7f69695">tempest-ServerRescueNegativeTestJSON-984710343</nova:project>
Apr 12 16:04:08 user nova-compute[71874]:       </nova:owner>
Apr 12 16:04:08 user nova-compute[71874]:       <nova:root type="image" uuid="9dc63f14-8b70-4e72-89f2-13464f2f5c7c"/>
Apr 12 16:04:08 user nova-compute[71874]:       <nova:ports>
Apr 12 16:04:08 user nova-compute[71874]:         <nova:port uuid="c4b29e0b-0ad8-4897-acf3-76004ac0338b">
Apr 12 16:04:08 user nova-compute[71874]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 12 16:04:08 user nova-compute[71874]:         </nova:port>
Apr 12 16:04:08 user nova-compute[71874]:       </nova:ports>
Apr 12 16:04:08 user nova-compute[71874]:     </nova:instance>
Apr 12 16:04:08 user nova-compute[71874]:   </metadata>
Apr 12 16:04:08 user nova-compute[71874]:   <sysinfo type="smbios">
Apr 12 16:04:08 user nova-compute[71874]:     <system>
Apr 12 16:04:08 user nova-compute[71874]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 16:04:08 user nova-compute[71874]:       <entry name="product">OpenStack Nova</entry>
Apr 12 16:04:08 user nova-compute[71874]:       <entry name="version">0.0.0</entry>
Apr 12 16:04:08 user nova-compute[71874]:       <entry name="serial">afebffae-dbf6-4876-8c9f-0364f0fde49c</entry>
Apr 12 16:04:08 user nova-compute[71874]:       <entry name="uuid">afebffae-dbf6-4876-8c9f-0364f0fde49c</entry>
Apr 12 16:04:08 user nova-compute[71874]:       <entry name="family">Virtual Machine</entry>
Apr 12 16:04:08 user nova-compute[71874]:     </system>
Apr 12 16:04:08 user nova-compute[71874]:   </sysinfo>
Apr 12 16:04:08 user nova-compute[71874]:   <os>
Apr 12 16:04:08 user nova-compute[71874]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 16:04:08 user nova-compute[71874]:     <smbios mode="sysinfo"/>
Apr 12 16:04:08 user nova-compute[71874]:   </os>
Apr 12 16:04:08 user nova-compute[71874]:   <features>
Apr 12 16:04:08 user nova-compute[71874]:     <acpi/>
Apr 12 16:04:08 user nova-compute[71874]:     <apic/>
Apr 12 16:04:08 user nova-compute[71874]:     <vmcoreinfo/>
Apr 12 16:04:08 user nova-compute[71874]:   </features>
Apr 12 16:04:08 user nova-compute[71874]:   <clock offset="utc">
Apr 12 16:04:08 user nova-compute[71874]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 16:04:08 user nova-compute[71874]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 16:04:08 user nova-compute[71874]:     <timer name="hpet" present="no"/>
Apr 12 16:04:08 user nova-compute[71874]:   </clock>
Apr 12 16:04:08 user nova-compute[71874]:   <cpu mode="custom" match="exact">
Apr 12 16:04:08 user nova-compute[71874]:     <model>Nehalem</model>
Apr 12 16:04:08 user nova-compute[71874]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 16:04:08 user nova-compute[71874]:   </cpu>
Apr 12 16:04:08 user nova-compute[71874]:   <devices>
Apr 12 16:04:08 user nova-compute[71874]:     <disk type="file" device="disk">
Apr 12 16:04:08 user nova-compute[71874]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 16:04:08 user nova-compute[71874]:       <source file="/opt/stack/data/nova/instances/afebffae-dbf6-4876-8c9f-0364f0fde49c/disk.rescue"/>
Apr 12 16:04:08 user nova-compute[71874]:       <target dev="vda" bus="virtio"/>
Apr 12 16:04:08 user nova-compute[71874]:     </disk>
Apr 12 16:04:08 user nova-compute[71874]:     <disk type="file" device="disk">
Apr 12 16:04:08 user nova-compute[71874]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 16:04:08 user nova-compute[71874]:       <source file="/opt/stack/data/nova/instances/afebffae-dbf6-4876-8c9f-0364f0fde49c/disk"/>
Apr 12 16:04:08 user nova-compute[71874]:       <target dev="vdb" bus="virtio"/>
Apr 12 16:04:08 user nova-compute[71874]:     </disk>
Apr 12 16:04:08 user nova-compute[71874]:     <interface type="ethernet">
Apr 12 16:04:08 user nova-compute[71874]:       <mac address="fa:16:3e:b8:23:a7"/>
Apr 12 16:04:08 user nova-compute[71874]:       <model type="virtio"/>
Apr 12 16:04:08 user nova-compute[71874]:       <mtu size="1442"/>
Apr 12 16:04:08 user nova-compute[71874]:       <target dev="tapc4b29e0b-0a"/>
Apr 12 16:04:08 user nova-compute[71874]:     </interface>
Apr 12 16:04:08 user nova-compute[71874]:     <serial type="pty">
Apr 12 16:04:08 user nova-compute[71874]:       <log file="/opt/stack/data/nova/instances/afebffae-dbf6-4876-8c9f-0364f0fde49c/console.log" append="off"/>
Apr 12 16:04:08 user nova-compute[71874]:     </serial>
Apr 12 16:04:08 user nova-compute[71874]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 16:04:08 user nova-compute[71874]:     <video>
Apr 12 16:04:08 user nova-compute[71874]:       <model type="virtio"/>
Apr 12 16:04:08 user nova-compute[71874]:     </video>
Apr 12 16:04:08 user nova-compute[71874]:     <rng model="virtio">
Apr 12 16:04:08 user nova-compute[71874]:       <backend model="random">/dev/urandom</backend>
Apr 12 16:04:08 user nova-compute[71874]:     </rng>
Apr 12 16:04:08 user nova-compute[71874]:     <controller type="usb" index="0" model="none"/>
Apr 12 16:04:08 user nova-compute[71874]:     <memballoon model="virtio">
Apr 12 16:04:08 user nova-compute[71874]:       <stats period="10"/>
Apr 12 16:04:08 user nova-compute[71874]:     </memballoon>
Apr 12 16:04:08 user nova-compute[71874]:   </devices>
Apr 12 16:04:08 user nova-compute[71874]: </domain>
Apr 12 16:04:08 user nova-compute[71874]:  {{(pid=71874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 16:04:08 user nova-compute[71874]: INFO nova.virt.libvirt.driver [-] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] Instance destroyed successfully.
Apr 12 16:04:08 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-83d91fc8-dbfb-463d-b04a-abe0cf5a9505 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] No BDM found with device name vda, not building metadata. {{(pid=71874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 16:04:08 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-83d91fc8-dbfb-463d-b04a-abe0cf5a9505 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 16:04:08 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-83d91fc8-dbfb-463d-b04a-abe0cf5a9505 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] No VIF found with MAC fa:16:3e:b8:23:a7, not building metadata {{(pid=71874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 16:04:08 user nova-compute[71874]: INFO nova.network.neutron [None req-a6b165c5-cf5d-4c81-9fbf-a1ea238da5ef tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] Updating port 567c632f-4b91-46d8-ade5-c694ee9023c1 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Apr 12 16:04:09 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:04:09 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-a6b165c5-cf5d-4c81-9fbf-a1ea238da5ef tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Acquiring lock "refresh_cache-85b91251-9735-4812-9f11-003a7951a6f3" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:04:09 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-a6b165c5-cf5d-4c81-9fbf-a1ea238da5ef tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Acquired lock "refresh_cache-85b91251-9735-4812-9f11-003a7951a6f3" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:04:09 user nova-compute[71874]: DEBUG nova.network.neutron [None req-a6b165c5-cf5d-4c81-9fbf-a1ea238da5ef tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] Building network info cache for instance {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 16:04:09 user nova-compute[71874]: DEBUG nova.compute.manager [req-02aa8b58-e862-433a-8071-64e0b78bc77f req-57bd6bf1-c55e-4645-8d3b-a30bf23ca020 service nova] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] Received event network-changed-567c632f-4b91-46d8-ade5-c694ee9023c1 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:04:09 user nova-compute[71874]: DEBUG nova.compute.manager [req-02aa8b58-e862-433a-8071-64e0b78bc77f req-57bd6bf1-c55e-4645-8d3b-a30bf23ca020 service nova] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] Refreshing instance network info cache due to event network-changed-567c632f-4b91-46d8-ade5-c694ee9023c1. {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 16:04:09 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-02aa8b58-e862-433a-8071-64e0b78bc77f req-57bd6bf1-c55e-4645-8d3b-a30bf23ca020 service nova] Acquiring lock "refresh_cache-85b91251-9735-4812-9f11-003a7951a6f3" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:04:09 user nova-compute[71874]: DEBUG nova.compute.manager [req-d1713876-efc9-4ccb-b84d-285dc12e2b28 req-12be5986-ca02-40c6-b369-8498fe62a9a1 service nova] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] Received event network-vif-plugged-c4b29e0b-0ad8-4897-acf3-76004ac0338b {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:04:09 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-d1713876-efc9-4ccb-b84d-285dc12e2b28 req-12be5986-ca02-40c6-b369-8498fe62a9a1 service nova] Acquiring lock "afebffae-dbf6-4876-8c9f-0364f0fde49c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:04:09 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-d1713876-efc9-4ccb-b84d-285dc12e2b28 req-12be5986-ca02-40c6-b369-8498fe62a9a1 service nova] Lock "afebffae-dbf6-4876-8c9f-0364f0fde49c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:04:09 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-d1713876-efc9-4ccb-b84d-285dc12e2b28 req-12be5986-ca02-40c6-b369-8498fe62a9a1 service nova] Lock "afebffae-dbf6-4876-8c9f-0364f0fde49c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:04:09 user nova-compute[71874]: DEBUG nova.compute.manager [req-d1713876-efc9-4ccb-b84d-285dc12e2b28 req-12be5986-ca02-40c6-b369-8498fe62a9a1 service nova] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] No waiting events found dispatching network-vif-plugged-c4b29e0b-0ad8-4897-acf3-76004ac0338b {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:04:09 user nova-compute[71874]: WARNING nova.compute.manager [req-d1713876-efc9-4ccb-b84d-285dc12e2b28 req-12be5986-ca02-40c6-b369-8498fe62a9a1 service nova] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] Received unexpected event network-vif-plugged-c4b29e0b-0ad8-4897-acf3-76004ac0338b for instance with vm_state active and task_state rescuing.
Apr 12 16:04:09 user nova-compute[71874]: DEBUG nova.network.neutron [None req-a6b165c5-cf5d-4c81-9fbf-a1ea238da5ef tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] Updating instance_info_cache with network_info: [{"id": "567c632f-4b91-46d8-ade5-c694ee9023c1", "address": "fa:16:3e:d5:b1:e0", "network": {"id": "0b7c67f6-057a-4bb5-aa44-db5290d55865", "bridge": "br-int", "label": "tempest-TestShelveInstance-825161862-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a46b4e80a65541d6bab94b5edfc26e5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap567c632f-4b", "ovs_interfaceid": "567c632f-4b91-46d8-ade5-c694ee9023c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:04:09 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-a6b165c5-cf5d-4c81-9fbf-a1ea238da5ef tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Releasing lock "refresh_cache-85b91251-9735-4812-9f11-003a7951a6f3" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:04:09 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-a6b165c5-cf5d-4c81-9fbf-a1ea238da5ef tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] Creating instance directory {{(pid=71874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 16:04:09 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-a6b165c5-cf5d-4c81-9fbf-a1ea238da5ef tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] Creating image(s)
Apr 12 16:04:09 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-a6b165c5-cf5d-4c81-9fbf-a1ea238da5ef tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] Did not create local disks {{(pid=71874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 12 16:04:09 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-a6b165c5-cf5d-4c81-9fbf-a1ea238da5ef tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] Ensure instance console log exists: /opt/stack/data/nova/instances/85b91251-9735-4812-9f11-003a7951a6f3/console.log {{(pid=71874) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 16:04:09 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-a6b165c5-cf5d-4c81-9fbf-a1ea238da5ef tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:04:09 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-a6b165c5-cf5d-4c81-9fbf-a1ea238da5ef tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:04:09 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-a6b165c5-cf5d-4c81-9fbf-a1ea238da5ef tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:04:09 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-a6b165c5-cf5d-4c81-9fbf-a1ea238da5ef tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] Start _get_guest_xml network_info=[{"id": "567c632f-4b91-46d8-ade5-c694ee9023c1", "address": "fa:16:3e:d5:b1:e0", "network": {"id": "0b7c67f6-057a-4bb5-aa44-db5290d55865", "bridge": "br-int", "label": "tempest-TestShelveInstance-825161862-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a46b4e80a65541d6bab94b5edfc26e5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap567c632f-4b", "ovs_interfaceid": "567c632f-4b91-46d8-ade5-c694ee9023c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'delete_on_termination': True, 'attachment_id': 'd1cfac14-1f82-4017-882a-e279cc68da61', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xHtihcnd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '85b91251-9735-4812-9f11-003a7951a6f3', 'attached_at': '', 'detached_at': '', 'volume_id': '863633c1-6f4e-41f5-b72c-91ca428b73b2', 'serial': '863633c1-6f4e-41f5-b72c-91ca428b73b2'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'volume_type': None} {{(pid=71874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 16:04:09 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-02aa8b58-e862-433a-8071-64e0b78bc77f req-57bd6bf1-c55e-4645-8d3b-a30bf23ca020 service nova] Acquired lock "refresh_cache-85b91251-9735-4812-9f11-003a7951a6f3" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:04:09 user nova-compute[71874]: DEBUG nova.network.neutron [req-02aa8b58-e862-433a-8071-64e0b78bc77f req-57bd6bf1-c55e-4645-8d3b-a30bf23ca020 service nova] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] Refreshing network info cache for port 567c632f-4b91-46d8-ade5-c694ee9023c1 {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 16:04:09 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-a6b165c5-cf5d-4c81-9fbf-a1ea238da5ef tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:04:09 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-a6b165c5-cf5d-4c81-9fbf-a1ea238da5ef tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:04:09 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-a6b165c5-cf5d-4c81-9fbf-a1ea238da5ef tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71874) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 16:04:09 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-a6b165c5-cf5d-4c81-9fbf-a1ea238da5ef tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T15:56:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 16:04:09 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-a6b165c5-cf5d-4c81-9fbf-a1ea238da5ef tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Flavor limits 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 16:04:09 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-a6b165c5-cf5d-4c81-9fbf-a1ea238da5ef tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Image limits 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 16:04:09 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-a6b165c5-cf5d-4c81-9fbf-a1ea238da5ef tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Flavor pref 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 16:04:09 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-a6b165c5-cf5d-4c81-9fbf-a1ea238da5ef tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Image pref 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 16:04:09 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-a6b165c5-cf5d-4c81-9fbf-a1ea238da5ef tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 16:04:09 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-a6b165c5-cf5d-4c81-9fbf-a1ea238da5ef tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 16:04:09 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-a6b165c5-cf5d-4c81-9fbf-a1ea238da5ef tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 16:04:09 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-a6b165c5-cf5d-4c81-9fbf-a1ea238da5ef tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Got 1 possible topologies {{(pid=71874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 16:04:09 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-a6b165c5-cf5d-4c81-9fbf-a1ea238da5ef tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 16:04:09 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-a6b165c5-cf5d-4c81-9fbf-a1ea238da5ef tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 16:04:09 user nova-compute[71874]: DEBUG nova.objects.instance [None req-a6b165c5-cf5d-4c81-9fbf-a1ea238da5ef tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Lazy-loading 'vcpu_model' on Instance uuid 85b91251-9735-4812-9f11-003a7951a6f3 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:04:10 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a6b165c5-cf5d-4c81-9fbf-a1ea238da5ef tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] Calling os-brick to attach iSCSI Volume {{(pid=71874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 16:04:10 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6b165c5-cf5d-4c81-9fbf-a1ea238da5ef tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3c0216320>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xHtihcnd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:04:10 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-a6b165c5-cf5d-4c81-9fbf-a1ea238da5ef tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:04:10 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-a6b165c5-cf5d-4c81-9fbf-a1ea238da5ef tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:04:10 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-a6b165c5-cf5d-4c81-9fbf-a1ea238da5ef tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:04:10 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-a6b165c5-cf5d-4c81-9fbf-a1ea238da5ef tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:04:10 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-a6b165c5-cf5d-4c81-9fbf-a1ea238da5ef tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:04:10 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-a6b165c5-cf5d-4c81-9fbf-a1ea238da5ef tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:04:10 user nova-compute[71874]: INFO os_brick.initiator.connectors.iscsi [None req-a6b165c5-cf5d-4c81-9fbf-a1ea238da5ef tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 16:04:10 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 -p 172.16.0.220:3260 {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:04:10 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:04:10 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ce929fb-2107-4bba-82c0-a5f7887c622a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:04:10 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6b165c5-cf5d-4c81-9fbf-a1ea238da5ef tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 16:04:10 user nova-compute[71874]:  {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:04:10 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 -p 172.16.0.220:3260 --interface default --op new {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:04:10 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:04:10 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[560442ce-77be-4eff-986c-d5bff2bf5718]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2] added\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:04:10 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6b165c5-cf5d-4c81-9fbf-a1ea238da5ef tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2] added
Apr 12 16:04:10 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:04:10 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:04:10 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:04:10 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[19bc7b79-1998-43b6-b4fe-32dce6c8f53a]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:04:10 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6b165c5-cf5d-4c81-9fbf-a1ea238da5ef tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:04:10 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:04:10 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:04:10 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[88479e5b-fa28-4811-925c-d2b75e555ad5]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:04:10 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:04:10 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6b165c5-cf5d-4c81-9fbf-a1ea238da5ef tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:04:10 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:04:10 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xHtihcnd {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:04:10 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xHtihcnd" returned: 0 in 0.027s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:04:10 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc5f7be8-0260-4fd6-8f18-56abf5ff79d0]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:04:10 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6b165c5-cf5d-4c81-9fbf-a1ea238da5ef tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xHtihcnd'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:04:10 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:04:10 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:04:10 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1c14a16-d419-4f90-9965-d1f6f438e98b]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:04:10 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6b165c5-cf5d-4c81-9fbf-a1ea238da5ef tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:04:10 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:04:10 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:04:10 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:04:10 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:04:10 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a3c23b8-2216-4a52-a2fd-c04c5c13e669]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b09d128a-0198-4cfc-942f-323bd2f41d53 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfd27585-75c7-4a04-a93a-79e4236a36f7 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6 (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:04:10 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6b165c5-cf5d-4c81-9fbf-a1ea238da5ef tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:04:10 user nova-compute[71874]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b09d128a-0198-4cfc-942f-323bd2f41d53 (non-flash)
Apr 12 16:04:10 user nova-compute[71874]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfd27585-75c7-4a04-a93a-79e4236a36f7 (non-flash)
Apr 12 16:04:10 user nova-compute[71874]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6 (non-flash)
Apr 12 16:04:10 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:04:10 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6b165c5-cf5d-4c81-9fbf-a1ea238da5ef tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:04:10 user nova-compute[71874]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b09d128a-0198-4cfc-942f-323bd2f41d53 (non-flash)
Apr 12 16:04:10 user nova-compute[71874]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfd27585-75c7-4a04-a93a-79e4236a36f7 (non-flash)
Apr 12 16:04:10 user nova-compute[71874]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6 (non-flash)
Apr 12 16:04:10 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:04:10 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 -p 172.16.0.220:3260 --login {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:04:10 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 -p 172.16.0.220:3260 --login" returned: 0 in 0.102s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:04:10 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[99d6026c-017d-456c-b46b-f28e9465ef93]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:04:10 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6b165c5-cf5d-4c81-9fbf-a1ea238da5ef tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2, portal: 172.16.0.220,3260]
Apr 12 16:04:10 user nova-compute[71874]: Login to [iface: default, target: iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2, portal: 172.16.0.220,3260] successful.
Apr 12 16:04:10 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:04:10 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:04:10 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.039s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:04:10 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[884f2635-5525-41df-a3f5-69a68d237fd5]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:04:10 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6b165c5-cf5d-4c81-9fbf-a1ea238da5ef tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:04:10 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:04:10 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:04:10 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[793d8f58-3ee2-4b4f-87e8-dfc171f67b19]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b09d128a-0198-4cfc-942f-323bd2f41d53 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfd27585-75c7-4a04-a93a-79e4236a36f7 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6 (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:04:10 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6b165c5-cf5d-4c81-9fbf-a1ea238da5ef tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:04:10 user nova-compute[71874]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b09d128a-0198-4cfc-942f-323bd2f41d53 (non-flash)
Apr 12 16:04:10 user nova-compute[71874]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfd27585-75c7-4a04-a93a-79e4236a36f7 (non-flash)
Apr 12 16:04:10 user nova-compute[71874]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 (non-flash)
Apr 12 16:04:10 user nova-compute[71874]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6 (non-flash)
Apr 12 16:04:10 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:04:10 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6b165c5-cf5d-4c81-9fbf-a1ea238da5ef tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:04:10 user nova-compute[71874]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b09d128a-0198-4cfc-942f-323bd2f41d53 (non-flash)
Apr 12 16:04:10 user nova-compute[71874]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfd27585-75c7-4a04-a93a-79e4236a36f7 (non-flash)
Apr 12 16:04:10 user nova-compute[71874]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 (non-flash)
Apr 12 16:04:10 user nova-compute[71874]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6 (non-flash)
Apr 12 16:04:10 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:04:10 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-a6b165c5-cf5d-4c81-9fbf-a1ea238da5ef tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.421s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:04:10 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6b165c5-cf5d-4c81-9fbf-a1ea238da5ef tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Connected to 172.16.0.220:3260 {{(pid=71874) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 16:04:10 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-a6b165c5-cf5d-4c81-9fbf-a1ea238da5ef tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] HCTL ('36', '-', '-', 0) found on session 19 with lun 0 {{(pid=71874) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 16:04:10 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-a6b165c5-cf5d-4c81-9fbf-a1ea238da5ef tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71874) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 16:04:10 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:04:10 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.021s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:04:10 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[0985a7c0-24b9-4463-a18d-024d4b4fb219]: (4, ('- - 0', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:04:10 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-a6b165c5-cf5d-4c81-9fbf-a1ea238da5ef tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Searching for a device in session 19 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71874) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 16:04:10 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6b165c5-cf5d-4c81-9fbf-a1ea238da5ef tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xHtihcnd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71874) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 16:04:10 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:04:10 user nova-compute[71874]: DEBUG nova.network.neutron [req-02aa8b58-e862-433a-8071-64e0b78bc77f req-57bd6bf1-c55e-4645-8d3b-a30bf23ca020 service nova] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] Updated VIF entry in instance network info cache for port 567c632f-4b91-46d8-ade5-c694ee9023c1. {{(pid=71874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 16:04:10 user nova-compute[71874]: DEBUG nova.network.neutron [req-02aa8b58-e862-433a-8071-64e0b78bc77f req-57bd6bf1-c55e-4645-8d3b-a30bf23ca020 service nova] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] Updating instance_info_cache with network_info: [{"id": "567c632f-4b91-46d8-ade5-c694ee9023c1", "address": "fa:16:3e:d5:b1:e0", "network": {"id": "0b7c67f6-057a-4bb5-aa44-db5290d55865", "bridge": "br-int", "label": "tempest-TestShelveInstance-825161862-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a46b4e80a65541d6bab94b5edfc26e5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap567c632f-4b", "ovs_interfaceid": "567c632f-4b91-46d8-ade5-c694ee9023c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:04:10 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-02aa8b58-e862-433a-8071-64e0b78bc77f req-57bd6bf1-c55e-4645-8d3b-a30bf23ca020 service nova] Releasing lock "refresh_cache-85b91251-9735-4812-9f11-003a7951a6f3" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:04:11 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-a6b165c5-cf5d-4c81-9fbf-a1ea238da5ef tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.476s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:04:11 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6b165c5-cf5d-4c81-9fbf-a1ea238da5ef tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] <== connect_volume: return (1477ms) {'type': 'block', 'scsi_wwn': '26462626239333262', 'path': '/dev/sde'} {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:04:11 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a6b165c5-cf5d-4c81-9fbf-a1ea238da5ef tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26462626239333262', 'path': '/dev/sde'} {{(pid=71874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 16:04:11 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-a6b165c5-cf5d-4c81-9fbf-a1ea238da5ef tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-12T16:00:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1745076225',display_name='tempest-TestShelveInstance-server-1745076225',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1745076225',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-509475392',keypairs=<?>,launch_index=0,launched_at=2023-04-12T16:00:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='a46b4e80a65541d6bab94b5edfc26e5b',ramdisk_id='',reservation_id='r-ffojuop7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-346701715',owner_user_name='tempest-TestShelveInstance-346701715-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T16:04:03Z,user_data=None,user_id='6acbd977c4b4494db95f879777184489',uuid=85b91251-9735-4812-9f11-003a7951a6f3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "567c632f-4b91-46d8-ade5-c694ee9023c1", "address": "fa:16:3e:d5:b1:e0", "network": {"id": "0b7c67f6-057a-4bb5-aa44-db5290d55865", "bridge": "br-int", "label": "tempest-TestShelveInstance-825161862-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a46b4e80a65541d6bab94b5edfc26e5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap567c632f-4b", "ovs_interfaceid": "567c632f-4b91-46d8-ade5-c694ee9023c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 16:04:11 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-a6b165c5-cf5d-4c81-9fbf-a1ea238da5ef tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Converting VIF {"id": "567c632f-4b91-46d8-ade5-c694ee9023c1", "address": "fa:16:3e:d5:b1:e0", "network": {"id": "0b7c67f6-057a-4bb5-aa44-db5290d55865", "bridge": "br-int", "label": "tempest-TestShelveInstance-825161862-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a46b4e80a65541d6bab94b5edfc26e5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap567c632f-4b", "ovs_interfaceid": "567c632f-4b91-46d8-ade5-c694ee9023c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:04:11 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-a6b165c5-cf5d-4c81-9fbf-a1ea238da5ef tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:b1:e0,bridge_name='br-int',has_traffic_filtering=True,id=567c632f-4b91-46d8-ade5-c694ee9023c1,network=Network(0b7c67f6-057a-4bb5-aa44-db5290d55865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap567c632f-4b') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:04:11 user nova-compute[71874]: DEBUG nova.objects.instance [None req-a6b165c5-cf5d-4c81-9fbf-a1ea238da5ef tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Lazy-loading 'pci_devices' on Instance uuid 85b91251-9735-4812-9f11-003a7951a6f3 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:04:11 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-a6b165c5-cf5d-4c81-9fbf-a1ea238da5ef tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] End _get_guest_xml xml=<domain type="kvm">
Apr 12 16:04:11 user nova-compute[71874]:   <uuid>85b91251-9735-4812-9f11-003a7951a6f3</uuid>
Apr 12 16:04:11 user nova-compute[71874]:   <name>instance-0000000b</name>
Apr 12 16:04:11 user nova-compute[71874]:   <memory>131072</memory>
Apr 12 16:04:11 user nova-compute[71874]:   <vcpu>1</vcpu>
Apr 12 16:04:11 user nova-compute[71874]:   <metadata>
Apr 12 16:04:11 user nova-compute[71874]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 16:04:11 user nova-compute[71874]:       <nova:package version="0.0.0"/>
Apr 12 16:04:11 user nova-compute[71874]:       <nova:name>tempest-TestShelveInstance-server-1745076225</nova:name>
Apr 12 16:04:11 user nova-compute[71874]:       <nova:creationTime>2023-04-12 16:04:09</nova:creationTime>
Apr 12 16:04:11 user nova-compute[71874]:       <nova:flavor name="m1.nano">
Apr 12 16:04:11 user nova-compute[71874]:         <nova:memory>128</nova:memory>
Apr 12 16:04:11 user nova-compute[71874]:         <nova:disk>1</nova:disk>
Apr 12 16:04:11 user nova-compute[71874]:         <nova:swap>0</nova:swap>
Apr 12 16:04:11 user nova-compute[71874]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 16:04:11 user nova-compute[71874]:         <nova:vcpus>1</nova:vcpus>
Apr 12 16:04:11 user nova-compute[71874]:       </nova:flavor>
Apr 12 16:04:11 user nova-compute[71874]:       <nova:owner>
Apr 12 16:04:11 user nova-compute[71874]:         <nova:user uuid="6acbd977c4b4494db95f879777184489">tempest-TestShelveInstance-346701715-project-member</nova:user>
Apr 12 16:04:11 user nova-compute[71874]:         <nova:project uuid="a46b4e80a65541d6bab94b5edfc26e5b">tempest-TestShelveInstance-346701715</nova:project>
Apr 12 16:04:11 user nova-compute[71874]:       </nova:owner>
Apr 12 16:04:11 user nova-compute[71874]:       <nova:ports>
Apr 12 16:04:11 user nova-compute[71874]:         <nova:port uuid="567c632f-4b91-46d8-ade5-c694ee9023c1">
Apr 12 16:04:11 user nova-compute[71874]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 12 16:04:11 user nova-compute[71874]:         </nova:port>
Apr 12 16:04:11 user nova-compute[71874]:       </nova:ports>
Apr 12 16:04:11 user nova-compute[71874]:     </nova:instance>
Apr 12 16:04:11 user nova-compute[71874]:   </metadata>
Apr 12 16:04:11 user nova-compute[71874]:   <sysinfo type="smbios">
Apr 12 16:04:11 user nova-compute[71874]:     <system>
Apr 12 16:04:11 user nova-compute[71874]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 16:04:11 user nova-compute[71874]:       <entry name="product">OpenStack Nova</entry>
Apr 12 16:04:11 user nova-compute[71874]:       <entry name="version">0.0.0</entry>
Apr 12 16:04:11 user nova-compute[71874]:       <entry name="serial">85b91251-9735-4812-9f11-003a7951a6f3</entry>
Apr 12 16:04:11 user nova-compute[71874]:       <entry name="uuid">85b91251-9735-4812-9f11-003a7951a6f3</entry>
Apr 12 16:04:11 user nova-compute[71874]:       <entry name="family">Virtual Machine</entry>
Apr 12 16:04:11 user nova-compute[71874]:     </system>
Apr 12 16:04:11 user nova-compute[71874]:   </sysinfo>
Apr 12 16:04:11 user nova-compute[71874]:   <os>
Apr 12 16:04:11 user nova-compute[71874]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 16:04:11 user nova-compute[71874]:     <boot dev="hd"/>
Apr 12 16:04:11 user nova-compute[71874]:     <smbios mode="sysinfo"/>
Apr 12 16:04:11 user nova-compute[71874]:   </os>
Apr 12 16:04:11 user nova-compute[71874]:   <features>
Apr 12 16:04:11 user nova-compute[71874]:     <acpi/>
Apr 12 16:04:11 user nova-compute[71874]:     <apic/>
Apr 12 16:04:11 user nova-compute[71874]:     <vmcoreinfo/>
Apr 12 16:04:11 user nova-compute[71874]:   </features>
Apr 12 16:04:11 user nova-compute[71874]:   <clock offset="utc">
Apr 12 16:04:11 user nova-compute[71874]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 16:04:11 user nova-compute[71874]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 16:04:11 user nova-compute[71874]:     <timer name="hpet" present="no"/>
Apr 12 16:04:11 user nova-compute[71874]:   </clock>
Apr 12 16:04:11 user nova-compute[71874]:   <cpu mode="custom" match="exact">
Apr 12 16:04:11 user nova-compute[71874]:     <model>Nehalem</model>
Apr 12 16:04:11 user nova-compute[71874]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 16:04:11 user nova-compute[71874]:   </cpu>
Apr 12 16:04:11 user nova-compute[71874]:   <devices>
Apr 12 16:04:11 user nova-compute[71874]:     <disk type="block" device="disk">
Apr 12 16:04:11 user nova-compute[71874]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 16:04:11 user nova-compute[71874]:       <source dev="/dev/sde"/>
Apr 12 16:04:11 user nova-compute[71874]:       <target dev="vda" bus="virtio"/>
Apr 12 16:04:11 user nova-compute[71874]:       <serial>863633c1-6f4e-41f5-b72c-91ca428b73b2</serial>
Apr 12 16:04:11 user nova-compute[71874]:     </disk>
Apr 12 16:04:11 user nova-compute[71874]:     <interface type="ethernet">
Apr 12 16:04:11 user nova-compute[71874]:       <mac address="fa:16:3e:d5:b1:e0"/>
Apr 12 16:04:11 user nova-compute[71874]:       <model type="virtio"/>
Apr 12 16:04:11 user nova-compute[71874]:       <mtu size="1442"/>
Apr 12 16:04:11 user nova-compute[71874]:       <target dev="tap567c632f-4b"/>
Apr 12 16:04:11 user nova-compute[71874]:     </interface>
Apr 12 16:04:11 user nova-compute[71874]:     <serial type="pty">
Apr 12 16:04:11 user nova-compute[71874]:       <log file="/opt/stack/data/nova/instances/85b91251-9735-4812-9f11-003a7951a6f3/console.log" append="off"/>
Apr 12 16:04:11 user nova-compute[71874]:     </serial>
Apr 12 16:04:11 user nova-compute[71874]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 16:04:11 user nova-compute[71874]:     <video>
Apr 12 16:04:11 user nova-compute[71874]:       <model type="virtio"/>
Apr 12 16:04:11 user nova-compute[71874]:     </video>
Apr 12 16:04:11 user nova-compute[71874]:     <rng model="virtio">
Apr 12 16:04:11 user nova-compute[71874]:       <backend model="random">/dev/urandom</backend>
Apr 12 16:04:11 user nova-compute[71874]:     </rng>
Apr 12 16:04:11 user nova-compute[71874]:     <controller type="usb" index="0" model="none"/>
Apr 12 16:04:11 user nova-compute[71874]:     <memballoon model="virtio">
Apr 12 16:04:11 user nova-compute[71874]:       <stats period="10"/>
Apr 12 16:04:11 user nova-compute[71874]:     </memballoon>
Apr 12 16:04:11 user nova-compute[71874]:   </devices>
Apr 12 16:04:11 user nova-compute[71874]: </domain>
Apr 12 16:04:11 user nova-compute[71874]:  {{(pid=71874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 16:04:11 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-a6b165c5-cf5d-4c81-9fbf-a1ea238da5ef tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-12T16:00:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1745076225',display_name='tempest-TestShelveInstance-server-1745076225',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1745076225',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-509475392',keypairs=<?>,launch_index=0,launched_at=2023-04-12T16:00:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='a46b4e80a65541d6bab94b5edfc26e5b',ramdisk_id='',reservation_id='r-ffojuop7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-346701715',owner_user_name='tempest-TestShelveInstance-346701715-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T16:04:03Z,user_data=None,user_id='6acbd977c4b4494db95f879777184489',uuid=85b91251-9735-4812-9f11-003a7951a6f3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "567c632f-4b91-46d8-ade5-c694ee9023c1", "address": "fa:16:3e:d5:b1:e0", "network": {"id": "0b7c67f6-057a-4bb5-aa44-db5290d55865", "bridge": "br-int", "label": "tempest-TestShelveInstance-825161862-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a46b4e80a65541d6bab94b5edfc26e5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap567c632f-4b", "ovs_interfaceid": "567c632f-4b91-46d8-ade5-c694ee9023c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 16:04:11 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-a6b165c5-cf5d-4c81-9fbf-a1ea238da5ef tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Converting VIF {"id": "567c632f-4b91-46d8-ade5-c694ee9023c1", "address": "fa:16:3e:d5:b1:e0", "network": {"id": "0b7c67f6-057a-4bb5-aa44-db5290d55865", "bridge": "br-int", "label": "tempest-TestShelveInstance-825161862-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a46b4e80a65541d6bab94b5edfc26e5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap567c632f-4b", "ovs_interfaceid": "567c632f-4b91-46d8-ade5-c694ee9023c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:04:11 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-a6b165c5-cf5d-4c81-9fbf-a1ea238da5ef tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:b1:e0,bridge_name='br-int',has_traffic_filtering=True,id=567c632f-4b91-46d8-ade5-c694ee9023c1,network=Network(0b7c67f6-057a-4bb5-aa44-db5290d55865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap567c632f-4b') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:04:11 user nova-compute[71874]: DEBUG os_vif [None req-a6b165c5-cf5d-4c81-9fbf-a1ea238da5ef tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:b1:e0,bridge_name='br-int',has_traffic_filtering=True,id=567c632f-4b91-46d8-ade5-c694ee9023c1,network=Network(0b7c67f6-057a-4bb5-aa44-db5290d55865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap567c632f-4b') {{(pid=71874) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 16:04:11 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:04:11 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:04:11 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 16:04:11 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:04:11 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap567c632f-4b, may_exist=True) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:04:11 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap567c632f-4b, col_values=(('external_ids', {'iface-id': '567c632f-4b91-46d8-ade5-c694ee9023c1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d5:b1:e0', 'vm-uuid': '85b91251-9735-4812-9f11-003a7951a6f3'}),)) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:04:11 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:04:11 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:04:11 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:04:11 user nova-compute[71874]: INFO os_vif [None req-a6b165c5-cf5d-4c81-9fbf-a1ea238da5ef tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:b1:e0,bridge_name='br-int',has_traffic_filtering=True,id=567c632f-4b91-46d8-ade5-c694ee9023c1,network=Network(0b7c67f6-057a-4bb5-aa44-db5290d55865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap567c632f-4b')
Apr 12 16:04:11 user nova-compute[71874]: DEBUG nova.compute.manager [req-d83cc506-b231-40a0-8489-e5272e7549e0 req-b421c45c-cbb9-4995-a900-57f57aded937 service nova] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] Received event network-vif-plugged-c4b29e0b-0ad8-4897-acf3-76004ac0338b {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:04:11 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-d83cc506-b231-40a0-8489-e5272e7549e0 req-b421c45c-cbb9-4995-a900-57f57aded937 service nova] Acquiring lock "afebffae-dbf6-4876-8c9f-0364f0fde49c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:04:11 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-d83cc506-b231-40a0-8489-e5272e7549e0 req-b421c45c-cbb9-4995-a900-57f57aded937 service nova] Lock "afebffae-dbf6-4876-8c9f-0364f0fde49c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:04:11 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-d83cc506-b231-40a0-8489-e5272e7549e0 req-b421c45c-cbb9-4995-a900-57f57aded937 service nova] Lock "afebffae-dbf6-4876-8c9f-0364f0fde49c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:04:11 user nova-compute[71874]: DEBUG nova.compute.manager [req-d83cc506-b231-40a0-8489-e5272e7549e0 req-b421c45c-cbb9-4995-a900-57f57aded937 service nova] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] No waiting events found dispatching network-vif-plugged-c4b29e0b-0ad8-4897-acf3-76004ac0338b {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:04:11 user nova-compute[71874]: WARNING nova.compute.manager [req-d83cc506-b231-40a0-8489-e5272e7549e0 req-b421c45c-cbb9-4995-a900-57f57aded937 service nova] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] Received unexpected event network-vif-plugged-c4b29e0b-0ad8-4897-acf3-76004ac0338b for instance with vm_state active and task_state rescuing.
Apr 12 16:04:11 user nova-compute[71874]: DEBUG nova.compute.manager [req-d83cc506-b231-40a0-8489-e5272e7549e0 req-b421c45c-cbb9-4995-a900-57f57aded937 service nova] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] Received event network-vif-plugged-c4b29e0b-0ad8-4897-acf3-76004ac0338b {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:04:11 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-d83cc506-b231-40a0-8489-e5272e7549e0 req-b421c45c-cbb9-4995-a900-57f57aded937 service nova] Acquiring lock "afebffae-dbf6-4876-8c9f-0364f0fde49c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:04:11 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-d83cc506-b231-40a0-8489-e5272e7549e0 req-b421c45c-cbb9-4995-a900-57f57aded937 service nova] Lock "afebffae-dbf6-4876-8c9f-0364f0fde49c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:04:11 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-d83cc506-b231-40a0-8489-e5272e7549e0 req-b421c45c-cbb9-4995-a900-57f57aded937 service nova] Lock "afebffae-dbf6-4876-8c9f-0364f0fde49c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:04:11 user nova-compute[71874]: DEBUG nova.compute.manager [req-d83cc506-b231-40a0-8489-e5272e7549e0 req-b421c45c-cbb9-4995-a900-57f57aded937 service nova] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] No waiting events found dispatching network-vif-plugged-c4b29e0b-0ad8-4897-acf3-76004ac0338b {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:04:11 user nova-compute[71874]: WARNING nova.compute.manager [req-d83cc506-b231-40a0-8489-e5272e7549e0 req-b421c45c-cbb9-4995-a900-57f57aded937 service nova] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] Received unexpected event network-vif-plugged-c4b29e0b-0ad8-4897-acf3-76004ac0338b for instance with vm_state active and task_state rescuing.
Apr 12 16:04:11 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-a6b165c5-cf5d-4c81-9fbf-a1ea238da5ef tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] No BDM found with device name vda, not building metadata. {{(pid=71874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 16:04:11 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-a6b165c5-cf5d-4c81-9fbf-a1ea238da5ef tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] No VIF found with MAC fa:16:3e:d5:b1:e0, not building metadata {{(pid=71874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 16:04:12 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:04:12 user nova-compute[71874]: DEBUG nova.virt.libvirt.host [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Removed pending event for afebffae-dbf6-4876-8c9f-0364f0fde49c due to event {{(pid=71874) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 12 16:04:12 user nova-compute[71874]: DEBUG nova.virt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Emitting event <LifecycleEvent: 1681315452.8649743, afebffae-dbf6-4876-8c9f-0364f0fde49c => Resumed> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:04:12 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] VM Resumed (Lifecycle Event)
Apr 12 16:04:12 user nova-compute[71874]: DEBUG nova.compute.manager [None req-83d91fc8-dbfb-463d-b04a-abe0cf5a9505 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:04:12 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:04:12 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 16:04:12 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 12 16:04:12 user nova-compute[71874]: DEBUG nova.virt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Emitting event <LifecycleEvent: 1681315452.8669252, afebffae-dbf6-4876-8c9f-0364f0fde49c => Started> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:04:12 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] VM Started (Lifecycle Event)
Apr 12 16:04:12 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:04:12 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 16:04:13 user nova-compute[71874]: INFO nova.compute.manager [None req-5cd07e0c-c7dd-41f1-80aa-dea9dfae557f tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] Rescuing
Apr 12 16:04:13 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-5cd07e0c-c7dd-41f1-80aa-dea9dfae557f tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Acquiring lock "refresh_cache-f52ee906-c8fd-4cd5-842e-de98a5099c4f" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:04:13 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-5cd07e0c-c7dd-41f1-80aa-dea9dfae557f tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Acquired lock "refresh_cache-f52ee906-c8fd-4cd5-842e-de98a5099c4f" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:04:13 user nova-compute[71874]: DEBUG nova.network.neutron [None req-5cd07e0c-c7dd-41f1-80aa-dea9dfae557f tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] Building network info cache for instance {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 16:04:13 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:04:13 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:04:13 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:04:13 user nova-compute[71874]: DEBUG nova.compute.manager [req-f3d271b1-5fdf-48f4-bf4e-b72044774264 req-1399bbed-69b1-4027-8610-fcf3324f007c service nova] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] Received event network-vif-plugged-567c632f-4b91-46d8-ade5-c694ee9023c1 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:04:13 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-f3d271b1-5fdf-48f4-bf4e-b72044774264 req-1399bbed-69b1-4027-8610-fcf3324f007c service nova] Acquiring lock "85b91251-9735-4812-9f11-003a7951a6f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:04:13 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-f3d271b1-5fdf-48f4-bf4e-b72044774264 req-1399bbed-69b1-4027-8610-fcf3324f007c service nova] Lock "85b91251-9735-4812-9f11-003a7951a6f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:04:13 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-f3d271b1-5fdf-48f4-bf4e-b72044774264 req-1399bbed-69b1-4027-8610-fcf3324f007c service nova] Lock "85b91251-9735-4812-9f11-003a7951a6f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:04:13 user nova-compute[71874]: DEBUG nova.compute.manager [req-f3d271b1-5fdf-48f4-bf4e-b72044774264 req-1399bbed-69b1-4027-8610-fcf3324f007c service nova] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] No waiting events found dispatching network-vif-plugged-567c632f-4b91-46d8-ade5-c694ee9023c1 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:04:13 user nova-compute[71874]: WARNING nova.compute.manager [req-f3d271b1-5fdf-48f4-bf4e-b72044774264 req-1399bbed-69b1-4027-8610-fcf3324f007c service nova] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] Received unexpected event network-vif-plugged-567c632f-4b91-46d8-ade5-c694ee9023c1 for instance with vm_state shelved_offloaded and task_state spawning.
Apr 12 16:04:14 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:04:14 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:04:14 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:04:14 user nova-compute[71874]: DEBUG nova.network.neutron [None req-5cd07e0c-c7dd-41f1-80aa-dea9dfae557f tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] Updating instance_info_cache with network_info: [{"id": "955511f0-eca8-447d-a105-fdd5f182de62", "address": "fa:16:3e:ec:61:14", "network": {"id": "b36306e0-04c5-4b1b-8022-05ff121c4e43", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1503204786-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9210f81232304e179d3e09914a492442", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap955511f0-ec", "ovs_interfaceid": "955511f0-eca8-447d-a105-fdd5f182de62", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:04:14 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-5cd07e0c-c7dd-41f1-80aa-dea9dfae557f tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Releasing lock "refresh_cache-f52ee906-c8fd-4cd5-842e-de98a5099c4f" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:04:14 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:04:14 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:04:15 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:04:15 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:04:15 user nova-compute[71874]: INFO nova.virt.libvirt.driver [-] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] Instance destroyed successfully.
Apr 12 16:04:15 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-5cd07e0c-c7dd-41f1-80aa-dea9dfae557f tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] Attempting a stable device rescue
Apr 12 16:04:15 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-5cd07e0c-c7dd-41f1-80aa-dea9dfae557f tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=71874) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 12 16:04:15 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-5cd07e0c-c7dd-41f1-80aa-dea9dfae557f tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] Instance directory exists: not creating {{(pid=71874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 12 16:04:15 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-5cd07e0c-c7dd-41f1-80aa-dea9dfae557f tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] Creating image(s)
Apr 12 16:04:15 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-5cd07e0c-c7dd-41f1-80aa-dea9dfae557f tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Acquiring lock "/opt/stack/data/nova/instances/f52ee906-c8fd-4cd5-842e-de98a5099c4f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:04:15 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-5cd07e0c-c7dd-41f1-80aa-dea9dfae557f tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "/opt/stack/data/nova/instances/f52ee906-c8fd-4cd5-842e-de98a5099c4f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:04:15 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-5cd07e0c-c7dd-41f1-80aa-dea9dfae557f tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "/opt/stack/data/nova/instances/f52ee906-c8fd-4cd5-842e-de98a5099c4f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:04:15 user nova-compute[71874]: DEBUG nova.objects.instance [None req-5cd07e0c-c7dd-41f1-80aa-dea9dfae557f tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lazy-loading 'trusted_certs' on Instance uuid f52ee906-c8fd-4cd5-842e-de98a5099c4f {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:04:15 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-5cd07e0c-c7dd-41f1-80aa-dea9dfae557f tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Acquiring lock "657f45b4a932f729a4b05ba98447ee86ffaa029b" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:04:15 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-5cd07e0c-c7dd-41f1-80aa-dea9dfae557f tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "657f45b4a932f729a4b05ba98447ee86ffaa029b" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:04:15 user nova-compute[71874]: DEBUG nova.compute.manager [req-33928b2d-5ab9-436e-9a48-d43f0cf5844e req-c391b7ed-b02e-478a-ae8f-9702c5bb8e01 service nova] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] Received event network-vif-plugged-567c632f-4b91-46d8-ade5-c694ee9023c1 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:04:15 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-33928b2d-5ab9-436e-9a48-d43f0cf5844e req-c391b7ed-b02e-478a-ae8f-9702c5bb8e01 service nova] Acquiring lock "85b91251-9735-4812-9f11-003a7951a6f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:04:15 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-33928b2d-5ab9-436e-9a48-d43f0cf5844e req-c391b7ed-b02e-478a-ae8f-9702c5bb8e01 service nova] Lock "85b91251-9735-4812-9f11-003a7951a6f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:04:15 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-33928b2d-5ab9-436e-9a48-d43f0cf5844e req-c391b7ed-b02e-478a-ae8f-9702c5bb8e01 service nova] Lock "85b91251-9735-4812-9f11-003a7951a6f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:04:15 user nova-compute[71874]: DEBUG nova.compute.manager [req-33928b2d-5ab9-436e-9a48-d43f0cf5844e req-c391b7ed-b02e-478a-ae8f-9702c5bb8e01 service nova] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] No waiting events found dispatching network-vif-plugged-567c632f-4b91-46d8-ade5-c694ee9023c1 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:04:15 user nova-compute[71874]: WARNING nova.compute.manager [req-33928b2d-5ab9-436e-9a48-d43f0cf5844e req-c391b7ed-b02e-478a-ae8f-9702c5bb8e01 service nova] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] Received unexpected event network-vif-plugged-567c632f-4b91-46d8-ade5-c694ee9023c1 for instance with vm_state shelved_offloaded and task_state spawning.
Apr 12 16:04:15 user nova-compute[71874]: DEBUG nova.compute.manager [req-33928b2d-5ab9-436e-9a48-d43f0cf5844e req-c391b7ed-b02e-478a-ae8f-9702c5bb8e01 service nova] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] Received event network-vif-unplugged-955511f0-eca8-447d-a105-fdd5f182de62 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:04:15 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-33928b2d-5ab9-436e-9a48-d43f0cf5844e req-c391b7ed-b02e-478a-ae8f-9702c5bb8e01 service nova] Acquiring lock "f52ee906-c8fd-4cd5-842e-de98a5099c4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:04:15 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-33928b2d-5ab9-436e-9a48-d43f0cf5844e req-c391b7ed-b02e-478a-ae8f-9702c5bb8e01 service nova] Lock "f52ee906-c8fd-4cd5-842e-de98a5099c4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:04:15 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-33928b2d-5ab9-436e-9a48-d43f0cf5844e req-c391b7ed-b02e-478a-ae8f-9702c5bb8e01 service nova] Lock "f52ee906-c8fd-4cd5-842e-de98a5099c4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:04:15 user nova-compute[71874]: DEBUG nova.compute.manager [req-33928b2d-5ab9-436e-9a48-d43f0cf5844e req-c391b7ed-b02e-478a-ae8f-9702c5bb8e01 service nova] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] No waiting events found dispatching network-vif-unplugged-955511f0-eca8-447d-a105-fdd5f182de62 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:04:15 user nova-compute[71874]: WARNING nova.compute.manager [req-33928b2d-5ab9-436e-9a48-d43f0cf5844e req-c391b7ed-b02e-478a-ae8f-9702c5bb8e01 service nova] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] Received unexpected event network-vif-unplugged-955511f0-eca8-447d-a105-fdd5f182de62 for instance with vm_state active and task_state rescuing.
Apr 12 16:04:15 user nova-compute[71874]: DEBUG nova.compute.manager [req-33928b2d-5ab9-436e-9a48-d43f0cf5844e req-c391b7ed-b02e-478a-ae8f-9702c5bb8e01 service nova] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] Received event network-vif-plugged-955511f0-eca8-447d-a105-fdd5f182de62 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:04:15 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-33928b2d-5ab9-436e-9a48-d43f0cf5844e req-c391b7ed-b02e-478a-ae8f-9702c5bb8e01 service nova] Acquiring lock "f52ee906-c8fd-4cd5-842e-de98a5099c4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:04:15 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-33928b2d-5ab9-436e-9a48-d43f0cf5844e req-c391b7ed-b02e-478a-ae8f-9702c5bb8e01 service nova] Lock "f52ee906-c8fd-4cd5-842e-de98a5099c4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:04:15 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-33928b2d-5ab9-436e-9a48-d43f0cf5844e req-c391b7ed-b02e-478a-ae8f-9702c5bb8e01 service nova] Lock "f52ee906-c8fd-4cd5-842e-de98a5099c4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:04:15 user nova-compute[71874]: DEBUG nova.compute.manager [req-33928b2d-5ab9-436e-9a48-d43f0cf5844e req-c391b7ed-b02e-478a-ae8f-9702c5bb8e01 service nova] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] No waiting events found dispatching network-vif-plugged-955511f0-eca8-447d-a105-fdd5f182de62 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:04:15 user nova-compute[71874]: WARNING nova.compute.manager [req-33928b2d-5ab9-436e-9a48-d43f0cf5844e req-c391b7ed-b02e-478a-ae8f-9702c5bb8e01 service nova] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] Received unexpected event network-vif-plugged-955511f0-eca8-447d-a105-fdd5f182de62 for instance with vm_state active and task_state rescuing.
Apr 12 16:04:15 user nova-compute[71874]: DEBUG nova.virt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Emitting event <LifecycleEvent: 1681315455.7565763, 85b91251-9735-4812-9f11-003a7951a6f3 => Resumed> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:04:15 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] VM Resumed (Lifecycle Event)
Apr 12 16:04:15 user nova-compute[71874]: DEBUG nova.compute.manager [None req-a6b165c5-cf5d-4c81-9fbf-a1ea238da5ef tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] Instance event wait completed in 0 seconds for  {{(pid=71874) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 16:04:15 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-a6b165c5-cf5d-4c81-9fbf-a1ea238da5ef tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] Guest created on hypervisor {{(pid=71874) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 16:04:15 user nova-compute[71874]: INFO nova.virt.libvirt.driver [-] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] Instance spawned successfully.
Apr 12 16:04:15 user nova-compute[71874]: DEBUG nova.compute.manager [None req-a6b165c5-cf5d-4c81-9fbf-a1ea238da5ef tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:04:15 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:04:15 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 16:04:15 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 16:04:15 user nova-compute[71874]: DEBUG nova.virt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Emitting event <LifecycleEvent: 1681315455.764614, 85b91251-9735-4812-9f11-003a7951a6f3 => Started> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:04:15 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] VM Started (Lifecycle Event)
Apr 12 16:04:15 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:04:15 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 16:04:16 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-5cd07e0c-c7dd-41f1-80aa-dea9dfae557f tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/657f45b4a932f729a4b05ba98447ee86ffaa029b.part --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:04:16 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-a6b165c5-cf5d-4c81-9fbf-a1ea238da5ef tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Lock "85b91251-9735-4812-9f11-003a7951a6f3" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 14.301s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:04:16 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:04:16 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-5cd07e0c-c7dd-41f1-80aa-dea9dfae557f tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/657f45b4a932f729a4b05ba98447ee86ffaa029b.part --force-share --output=json" returned: 0 in 0.243s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:04:16 user nova-compute[71874]: DEBUG nova.virt.images [None req-5cd07e0c-c7dd-41f1-80aa-dea9dfae557f tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] a4390902-ded6-46bd-95d0-5aa40c33bd1e was qcow2, converting to raw {{(pid=71874) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 12 16:04:16 user nova-compute[71874]: DEBUG nova.privsep.utils [None req-5cd07e0c-c7dd-41f1-80aa-dea9dfae557f tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71874) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 12 16:04:16 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-5cd07e0c-c7dd-41f1-80aa-dea9dfae557f tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/657f45b4a932f729a4b05ba98447ee86ffaa029b.part /opt/stack/data/nova/instances/_base/657f45b4a932f729a4b05ba98447ee86ffaa029b.converted {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:04:17 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-5cd07e0c-c7dd-41f1-80aa-dea9dfae557f tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/657f45b4a932f729a4b05ba98447ee86ffaa029b.part /opt/stack/data/nova/instances/_base/657f45b4a932f729a4b05ba98447ee86ffaa029b.converted" returned: 0 in 0.523s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:04:17 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-5cd07e0c-c7dd-41f1-80aa-dea9dfae557f tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/657f45b4a932f729a4b05ba98447ee86ffaa029b.converted --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:04:17 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:04:17 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-5cd07e0c-c7dd-41f1-80aa-dea9dfae557f tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/657f45b4a932f729a4b05ba98447ee86ffaa029b.converted --force-share --output=json" returned: 0 in 0.164s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:04:17 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-5cd07e0c-c7dd-41f1-80aa-dea9dfae557f tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "657f45b4a932f729a4b05ba98447ee86ffaa029b" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.044s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:04:17 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-5cd07e0c-c7dd-41f1-80aa-dea9dfae557f tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Acquiring lock "657f45b4a932f729a4b05ba98447ee86ffaa029b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:04:17 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-5cd07e0c-c7dd-41f1-80aa-dea9dfae557f tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "657f45b4a932f729a4b05ba98447ee86ffaa029b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:04:17 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-5cd07e0c-c7dd-41f1-80aa-dea9dfae557f tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/657f45b4a932f729a4b05ba98447ee86ffaa029b --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:04:17 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:04:17 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-5cd07e0c-c7dd-41f1-80aa-dea9dfae557f tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/657f45b4a932f729a4b05ba98447ee86ffaa029b --force-share --output=json" returned: 0 in 0.198s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:04:17 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-5cd07e0c-c7dd-41f1-80aa-dea9dfae557f tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/657f45b4a932f729a4b05ba98447ee86ffaa029b,backing_fmt=raw /opt/stack/data/nova/instances/f52ee906-c8fd-4cd5-842e-de98a5099c4f/disk.rescue {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:04:17 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-5cd07e0c-c7dd-41f1-80aa-dea9dfae557f tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/657f45b4a932f729a4b05ba98447ee86ffaa029b,backing_fmt=raw /opt/stack/data/nova/instances/f52ee906-c8fd-4cd5-842e-de98a5099c4f/disk.rescue" returned: 0 in 0.061s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:04:17 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-5cd07e0c-c7dd-41f1-80aa-dea9dfae557f tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "657f45b4a932f729a4b05ba98447ee86ffaa029b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.266s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:04:17 user nova-compute[71874]: DEBUG nova.objects.instance [None req-5cd07e0c-c7dd-41f1-80aa-dea9dfae557f tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lazy-loading 'migration_context' on Instance uuid f52ee906-c8fd-4cd5-842e-de98a5099c4f {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:04:17 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-5cd07e0c-c7dd-41f1-80aa-dea9dfae557f tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] Created local disks {{(pid=71874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 16:04:17 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-5cd07e0c-c7dd-41f1-80aa-dea9dfae557f tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] Start _get_guest_xml network_info=[{"id": "955511f0-eca8-447d-a105-fdd5f182de62", "address": "fa:16:3e:ec:61:14", "network": {"id": "b36306e0-04c5-4b1b-8022-05ff121c4e43", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1503204786-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1503204786-network", "vif_mac": "fa:16:3e:ec:61:14"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9210f81232304e179d3e09914a492442", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap955511f0-ec", "ovs_interfaceid": "955511f0-eca8-447d-a105-fdd5f182de62", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T15:55:37Z,direct_url=<?>,disk_format='qcow2',id=9dc63f14-8b70-4e72-89f2-13464f2f5c7c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='61a4936d9b7744c0b488d81c9b7746b6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T15:55:39Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'a4390902-ded6-46bd-95d0-5aa40c33bd1e', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'delete_on_termination': False, 'attachment_id': 'c3a8b54b-e31d-4609-afe9-1ed34e3bef9e', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aufDXJAj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'f52ee906-c8fd-4cd5-842e-de98a5099c4f', 'attached_at': '', 'detached_at': '', 'volume_id': 'a3ef648d-928f-4687-906e-f415a564fea2', 'serial': 'a3ef648d-928f-4687-906e-f415a564fea2'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'volume_type': None} {{(pid=71874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 16:04:17 user nova-compute[71874]: DEBUG nova.objects.instance [None req-5cd07e0c-c7dd-41f1-80aa-dea9dfae557f tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lazy-loading 'resources' on Instance uuid f52ee906-c8fd-4cd5-842e-de98a5099c4f {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:04:17 user nova-compute[71874]: DEBUG nova.objects.instance [None req-5cd07e0c-c7dd-41f1-80aa-dea9dfae557f tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lazy-loading 'numa_topology' on Instance uuid f52ee906-c8fd-4cd5-842e-de98a5099c4f {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:04:18 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-5cd07e0c-c7dd-41f1-80aa-dea9dfae557f tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:04:18 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-5cd07e0c-c7dd-41f1-80aa-dea9dfae557f tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:04:18 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-5cd07e0c-c7dd-41f1-80aa-dea9dfae557f tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71874) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 16:04:18 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-5cd07e0c-c7dd-41f1-80aa-dea9dfae557f tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T15:56:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T15:55:37Z,direct_url=<?>,disk_format='qcow2',id=9dc63f14-8b70-4e72-89f2-13464f2f5c7c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='61a4936d9b7744c0b488d81c9b7746b6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T15:55:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 16:04:18 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-5cd07e0c-c7dd-41f1-80aa-dea9dfae557f tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Flavor limits 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 16:04:18 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-5cd07e0c-c7dd-41f1-80aa-dea9dfae557f tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Image limits 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 16:04:18 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-5cd07e0c-c7dd-41f1-80aa-dea9dfae557f tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Flavor pref 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 16:04:18 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-5cd07e0c-c7dd-41f1-80aa-dea9dfae557f tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Image pref 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 16:04:18 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-5cd07e0c-c7dd-41f1-80aa-dea9dfae557f tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 16:04:18 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-5cd07e0c-c7dd-41f1-80aa-dea9dfae557f tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 16:04:18 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-5cd07e0c-c7dd-41f1-80aa-dea9dfae557f tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 16:04:18 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-5cd07e0c-c7dd-41f1-80aa-dea9dfae557f tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Got 1 possible topologies {{(pid=71874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 16:04:18 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-5cd07e0c-c7dd-41f1-80aa-dea9dfae557f tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 16:04:18 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-5cd07e0c-c7dd-41f1-80aa-dea9dfae557f tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 16:04:18 user nova-compute[71874]: DEBUG nova.objects.instance [None req-5cd07e0c-c7dd-41f1-80aa-dea9dfae557f tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lazy-loading 'vcpu_model' on Instance uuid f52ee906-c8fd-4cd5-842e-de98a5099c4f {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:04:18 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5cd07e0c-c7dd-41f1-80aa-dea9dfae557f tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] Calling os-brick to attach iSCSI Volume {{(pid=71874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 16:04:18 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cd07e0c-c7dd-41f1-80aa-dea9dfae557f tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3c0216320>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aufDXJAj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:04:18 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-5cd07e0c-c7dd-41f1-80aa-dea9dfae557f tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:04:18 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-5cd07e0c-c7dd-41f1-80aa-dea9dfae557f tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:04:18 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-5cd07e0c-c7dd-41f1-80aa-dea9dfae557f tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:04:18 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-5cd07e0c-c7dd-41f1-80aa-dea9dfae557f tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:04:18 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-5cd07e0c-c7dd-41f1-80aa-dea9dfae557f tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:04:18 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-5cd07e0c-c7dd-41f1-80aa-dea9dfae557f tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:04:18 user nova-compute[71874]: INFO os_brick.initiator.connectors.iscsi [None req-5cd07e0c-c7dd-41f1-80aa-dea9dfae557f tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 16:04:18 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 -p 172.16.0.220:3260 {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:04:18 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 -p 172.16.0.220:3260" returned: 0 in 0.022s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:04:18 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bfa92e4-3fca-4f29-9742-e26b401af9d4]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = aufDXJAj\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:04:18 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cd07e0c-c7dd-41f1-80aa-dea9dfae557f tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Apr 12 16:04:18 user nova-compute[71874]: node.name = iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2
Apr 12 16:04:18 user nova-compute[71874]: node.tpgt = -1
Apr 12 16:04:18 user nova-compute[71874]: node.startup = automatic
Apr 12 16:04:18 user nova-compute[71874]: node.leading_login = No
Apr 12 16:04:18 user nova-compute[71874]: iface.iscsi_ifacename = default
Apr 12 16:04:18 user nova-compute[71874]: iface.net_ifacename = <empty>
Apr 12 16:04:18 user nova-compute[71874]: iface.ipaddress = <empty>
Apr 12 16:04:18 user nova-compute[71874]: iface.prefix_len = 0
Apr 12 16:04:18 user nova-compute[71874]: iface.hwaddress = <empty>
Apr 12 16:04:18 user nova-compute[71874]: iface.transport_name = tcp
Apr 12 16:04:18 user nova-compute[71874]: iface.initiatorname = <empty>
Apr 12 16:04:18 user nova-compute[71874]: iface.state = <empty>
Apr 12 16:04:18 user nova-compute[71874]: iface.vlan_id = 0
Apr 12 16:04:18 user nova-compute[71874]: iface.vlan_priority = 0
Apr 12 16:04:18 user nova-compute[71874]: iface.vlan_state = <empty>
Apr 12 16:04:18 user nova-compute[71874]: iface.iface_num = 0
Apr 12 16:04:18 user nova-compute[71874]: iface.mtu = 0
Apr 12 16:04:18 user nova-compute[71874]: iface.port = 0
Apr 12 16:04:18 user nova-compute[71874]: iface.bootproto = <empty>
Apr 12 16:04:18 user nova-compute[71874]: iface.subnet_mask = <empty>
Apr 12 16:04:18 user nova-compute[71874]: iface.gateway = <empty>
Apr 12 16:04:18 user nova-compute[71874]: iface.dhcp_alt_client_id_state = <empty>
Apr 12 16:04:18 user nova-compute[71874]: iface.dhcp_alt_client_id = <empty>
Apr 12 16:04:18 user nova-compute[71874]: iface.dhcp_dns = <empty>
Apr 12 16:04:18 user nova-compute[71874]: iface.dhcp_learn_iqn = <empty>
Apr 12 16:04:18 user nova-compute[71874]: iface.dhcp_req_vendor_id_state = <empty>
Apr 12 16:04:18 user nova-compute[71874]: iface.dhcp_vendor_id_state = <empty>
Apr 12 16:04:18 user nova-compute[71874]: iface.dhcp_vendor_id = <empty>
Apr 12 16:04:18 user nova-compute[71874]: iface.dhcp_slp_da = <empty>
Apr 12 16:04:18 user nova-compute[71874]: iface.fragmentation = <empty>
Apr 12 16:04:18 user nova-compute[71874]: iface.gratuitous_arp = <empty>
Apr 12 16:04:18 user nova-compute[71874]: iface.incoming_forwarding = <empty>
Apr 12 16:04:18 user nova-compute[71874]: iface.tos_state = <empty>
Apr 12 16:04:18 user nova-compute[71874]: iface.tos = 0
Apr 12 16:04:18 user nova-compute[71874]: iface.ttl = 0
Apr 12 16:04:18 user nova-compute[71874]: iface.delayed_ack = <empty>
Apr 12 16:04:18 user nova-compute[71874]: iface.tcp_nagle = <empty>
Apr 12 16:04:18 user nova-compute[71874]: iface.tcp_wsf_state = <empty>
Apr 12 16:04:18 user nova-compute[71874]: iface.tcp_wsf = 0
Apr 12 16:04:18 user nova-compute[71874]: iface.tcp_timer_scale = 0
Apr 12 16:04:18 user nova-compute[71874]: iface.tcp_timestamp = <empty>
Apr 12 16:04:18 user nova-compute[71874]: iface.redirect = <empty>
Apr 12 16:04:18 user nova-compute[71874]: iface.def_task_mgmt_timeout = 0
Apr 12 16:04:18 user nova-compute[71874]: iface.header_digest = <empty>
Apr 12 16:04:18 user nova-compute[71874]: iface.data_digest = <empty>
Apr 12 16:04:18 user nova-compute[71874]: iface.immediate_data = <empty>
Apr 12 16:04:18 user nova-compute[71874]: iface.initial_r2t = <empty>
Apr 12 16:04:18 user nova-compute[71874]: iface.data_seq_inorder = <empty>
Apr 12 16:04:18 user nova-compute[71874]: iface.data_pdu_inorder = <empty>
Apr 12 16:04:18 user nova-compute[71874]: iface.erl = 0
Apr 12 16:04:18 user nova-compute[71874]: iface.max_receive_data_len = 0
Apr 12 16:04:18 user nova-compute[71874]: iface.first_burst_len = 0
Apr 12 16:04:18 user nova-compute[71874]: iface.max_outstanding_r2t = 0
Apr 12 16:04:18 user nova-compute[71874]: iface.max_burst_len = 0
Apr 12 16:04:18 user nova-compute[71874]: iface.chap_auth = <empty>
Apr 12 16:04:18 user nova-compute[71874]: iface.bidi_chap = <empty>
Apr 12 16:04:18 user nova-compute[71874]: iface.strict_login_compliance = <empty>
Apr 12 16:04:18 user nova-compute[71874]: iface.discovery_auth = <empty>
Apr 12 16:04:18 user nova-compute[71874]: iface.discovery_logout = <empty>
Apr 12 16:04:18 user nova-compute[71874]: node.discovery_address = <empty>
Apr 12 16:04:18 user nova-compute[71874]: node.discovery_port = 0
Apr 12 16:04:18 user nova-compute[71874]: node.discovery_type = static
Apr 12 16:04:18 user nova-compute[71874]: node.session.initial_cmdsn = 0
Apr 12 16:04:18 user nova-compute[71874]: node.session.initial_login_retry_max = 8
Apr 12 16:04:18 user nova-compute[71874]: node.session.xmit_thread_priority = -20
Apr 12 16:04:18 user nova-compute[71874]: node.session.cmds_max = 128
Apr 12 16:04:18 user nova-compute[71874]: node.session.queue_depth = 32
Apr 12 16:04:18 user nova-compute[71874]: node.session.nr_sessions = 1
Apr 12 16:04:18 user nova-compute[71874]: node.session.auth.authmethod = CHAP
Apr 12 16:04:18 user nova-compute[71874]: node.session.auth.username = aufDXJAj
Apr 12 16:04:18 user nova-compute[71874]: node.session.auth.password = ***
Apr 12 16:04:18 user nova-compute[71874]: node.session.auth.username_in = <empty>
Apr 12 16:04:18 user nova-compute[71874]: node.session.auth.password_in = <empty>
Apr 12 16:04:18 user nova-compute[71874]: node.session.auth.chap_algs = MD5
Apr 12 16:04:18 user nova-compute[71874]: node.session.timeo.replacement_timeout = 120
Apr 12 16:04:18 user nova-compute[71874]: node.session.err_timeo.abort_timeout = 15
Apr 12 16:04:18 user nova-compute[71874]: node.session.err_timeo.lu_reset_timeout = 30
Apr 12 16:04:18 user nova-compute[71874]: node.session.err_timeo.tgt_reset_timeout = 30
Apr 12 16:04:18 user nova-compute[71874]: node.session.err_timeo.host_reset_timeout = 60
Apr 12 16:04:18 user nova-compute[71874]: node.session.iscsi.FastAbort = Yes
Apr 12 16:04:18 user nova-compute[71874]: node.session.iscsi.InitialR2T = No
Apr 12 16:04:18 user nova-compute[71874]: node.session.iscsi.ImmediateData = Yes
Apr 12 16:04:18 user nova-compute[71874]: node.session.iscsi.FirstBurstLength = 262144
Apr 12 16:04:18 user nova-compute[71874]: node.session.iscsi.MaxBurstLength = 16776192
Apr 12 16:04:18 user nova-compute[71874]: node.session.iscsi.DefaultTime2Retain = 0
Apr 12 16:04:18 user nova-compute[71874]: node.session.iscsi.DefaultTime2Wait = 2
Apr 12 16:04:18 user nova-compute[71874]: node.session.iscsi.MaxConnections = 1
Apr 12 16:04:18 user nova-compute[71874]: node.session.iscsi.MaxOutstandingR2T = 1
Apr 12 16:04:18 user nova-compute[71874]: node.session.iscsi.ERL = 0
Apr 12 16:04:18 user nova-compute[71874]: node.session.scan = manual
Apr 12 16:04:18 user nova-compute[71874]: node.session.reopen_max = 0
Apr 12 16:04:18 user nova-compute[71874]: node.conn[0].address = 172.16.0.220
Apr 12 16:04:18 user nova-compute[71874]: node.conn[0].port = 3260
Apr 12 16:04:18 user nova-compute[71874]: node.conn[0].startup = manual
Apr 12 16:04:18 user nova-compute[71874]: node.conn[0].tcp.window_size = 524288
Apr 12 16:04:18 user nova-compute[71874]: node.conn[0].tcp.type_of_service = 0
Apr 12 16:04:18 user nova-compute[71874]: node.conn[0].timeo.logout_timeout = 15
Apr 12 16:04:18 user nova-compute[71874]: node.conn[0].timeo.login_timeout = 15
Apr 12 16:04:18 user nova-compute[71874]: node.conn[0].timeo.auth_timeout = 45
Apr 12 16:04:18 user nova-compute[71874]: node.conn[0].timeo.noop_out_interval = 5
Apr 12 16:04:18 user nova-compute[71874]: node.conn[0].timeo.noop_out_timeout = 5
Apr 12 16:04:18 user nova-compute[71874]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Apr 12 16:04:18 user nova-compute[71874]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Apr 12 16:04:18 user nova-compute[71874]: node.conn[0].iscsi.HeaderDigest = None
Apr 12 16:04:18 user nova-compute[71874]: node.conn[0].iscsi.DataDigest = None
Apr 12 16:04:18 user nova-compute[71874]: node.conn[0].iscsi.IFMarker = No
Apr 12 16:04:18 user nova-compute[71874]: node.conn[0].iscsi.OFMarker = No
Apr 12 16:04:18 user nova-compute[71874]: # END RECORD
Apr 12 16:04:18 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:04:18 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:04:18 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:04:18 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9caf723-ca11-4494-b1e5-d7fd7a438177]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:04:18 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cd07e0c-c7dd-41f1-80aa-dea9dfae557f tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:04:18 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:04:18 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:04:18 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7dc28e9-2068-4db4-93b9-8600137ecf8c]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:04:18 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cd07e0c-c7dd-41f1-80aa-dea9dfae557f tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:04:18 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aufDXJAj {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:04:18 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aufDXJAj" returned: 0 in 0.037s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:04:18 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[65bf348b-c9f8-4b84-83b4-ac017c1094c2]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:04:18 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cd07e0c-c7dd-41f1-80aa-dea9dfae557f tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aufDXJAj'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:04:18 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:04:18 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.034s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:04:18 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a95768b-a3f7-49ed-bacf-b6d57b6e02ff]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:04:18 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cd07e0c-c7dd-41f1-80aa-dea9dfae557f tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:04:18 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:04:18 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:04:18 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7ee410e-dd0d-4ded-8b1c-5de784904946]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b09d128a-0198-4cfc-942f-323bd2f41d53 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfd27585-75c7-4a04-a93a-79e4236a36f7 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6 (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:04:18 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cd07e0c-c7dd-41f1-80aa-dea9dfae557f tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:04:18 user nova-compute[71874]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b09d128a-0198-4cfc-942f-323bd2f41d53 (non-flash)
Apr 12 16:04:18 user nova-compute[71874]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfd27585-75c7-4a04-a93a-79e4236a36f7 (non-flash)
Apr 12 16:04:18 user nova-compute[71874]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 (non-flash)
Apr 12 16:04:18 user nova-compute[71874]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6 (non-flash)
Apr 12 16:04:18 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:04:18 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cd07e0c-c7dd-41f1-80aa-dea9dfae557f tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:04:18 user nova-compute[71874]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b09d128a-0198-4cfc-942f-323bd2f41d53 (non-flash)
Apr 12 16:04:18 user nova-compute[71874]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfd27585-75c7-4a04-a93a-79e4236a36f7 (non-flash)
Apr 12 16:04:18 user nova-compute[71874]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 (non-flash)
Apr 12 16:04:18 user nova-compute[71874]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6 (non-flash)
Apr 12 16:04:18 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:04:18 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-5cd07e0c-c7dd-41f1-80aa-dea9dfae557f tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.213s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:04:18 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cd07e0c-c7dd-41f1-80aa-dea9dfae557f tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Connected to 172.16.0.220:3260 {{(pid=71874) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 16:04:18 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-5cd07e0c-c7dd-41f1-80aa-dea9dfae557f tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] HCTL ('33', '0', '0', 0) found on session 15 with lun 0 {{(pid=71874) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 16:04:18 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-5cd07e0c-c7dd-41f1-80aa-dea9dfae557f tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=71874) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 16:04:18 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:04:18 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.052s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:04:18 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c37bcf2-28b8-42dd-90e2-163465282704]: (4, ('0 0 0', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:04:18 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-5cd07e0c-c7dd-41f1-80aa-dea9dfae557f tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Searching for a device in session 15 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=71874) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 16:04:18 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cd07e0c-c7dd-41f1-80aa-dea9dfae557f tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aufDXJAj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=71874) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 16:04:18 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-5cd07e0c-c7dd-41f1-80aa-dea9dfae557f tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.279s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:04:18 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cd07e0c-c7dd-41f1-80aa-dea9dfae557f tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] <== connect_volume: return (281ms) {'type': 'block', 'scsi_wwn': '26636366630616233', 'path': '/dev/sdb'} {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:04:18 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5cd07e0c-c7dd-41f1-80aa-dea9dfae557f tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26636366630616233', 'path': '/dev/sdb'} {{(pid=71874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 16:04:18 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-5cd07e0c-c7dd-41f1-80aa-dea9dfae557f tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T16:02:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2141634890',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2141634890',id=15,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T16:02:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9210f81232304e179d3e09914a492442',ramdisk_id='',reservation_id='r-ny60dh1j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1443944578',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T16:02:40Z,user_data=None,user_id='73f9fa5bc22a4824b3cdcb8cf7bb380c',uuid=f52ee906-c8fd-4cd5-842e-de98a5099c4f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "955511f0-eca8-447d-a105-fdd5f182de62", "address": "fa:16:3e:ec:61:14", "network": {"id": "b36306e0-04c5-4b1b-8022-05ff121c4e43", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1503204786-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1503204786-network", "vif_mac": "fa:16:3e:ec:61:14"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9210f81232304e179d3e09914a492442", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap955511f0-ec", "ovs_interfaceid": "955511f0-eca8-447d-a105-fdd5f182de62", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 16:04:18 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-5cd07e0c-c7dd-41f1-80aa-dea9dfae557f tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Converting VIF {"id": "955511f0-eca8-447d-a105-fdd5f182de62", "address": "fa:16:3e:ec:61:14", "network": {"id": "b36306e0-04c5-4b1b-8022-05ff121c4e43", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1503204786-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1503204786-network", "vif_mac": "fa:16:3e:ec:61:14"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9210f81232304e179d3e09914a492442", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap955511f0-ec", "ovs_interfaceid": "955511f0-eca8-447d-a105-fdd5f182de62", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:04:18 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-5cd07e0c-c7dd-41f1-80aa-dea9dfae557f tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ec:61:14,bridge_name='br-int',has_traffic_filtering=True,id=955511f0-eca8-447d-a105-fdd5f182de62,network=Network(b36306e0-04c5-4b1b-8022-05ff121c4e43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap955511f0-ec') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:04:18 user nova-compute[71874]: DEBUG nova.objects.instance [None req-5cd07e0c-c7dd-41f1-80aa-dea9dfae557f tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lazy-loading 'pci_devices' on Instance uuid f52ee906-c8fd-4cd5-842e-de98a5099c4f {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:04:18 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-5cd07e0c-c7dd-41f1-80aa-dea9dfae557f tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] End _get_guest_xml xml=<domain type="kvm">
Apr 12 16:04:18 user nova-compute[71874]:   <uuid>f52ee906-c8fd-4cd5-842e-de98a5099c4f</uuid>
Apr 12 16:04:18 user nova-compute[71874]:   <name>instance-0000000f</name>
Apr 12 16:04:18 user nova-compute[71874]:   <memory>131072</memory>
Apr 12 16:04:18 user nova-compute[71874]:   <vcpu>1</vcpu>
Apr 12 16:04:18 user nova-compute[71874]:   <metadata>
Apr 12 16:04:18 user nova-compute[71874]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 16:04:18 user nova-compute[71874]:       <nova:package version="0.0.0"/>
Apr 12 16:04:18 user nova-compute[71874]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-2141634890</nova:name>
Apr 12 16:04:18 user nova-compute[71874]:       <nova:creationTime>2023-04-12 16:04:18</nova:creationTime>
Apr 12 16:04:18 user nova-compute[71874]:       <nova:flavor name="m1.nano">
Apr 12 16:04:18 user nova-compute[71874]:         <nova:memory>128</nova:memory>
Apr 12 16:04:18 user nova-compute[71874]:         <nova:disk>1</nova:disk>
Apr 12 16:04:18 user nova-compute[71874]:         <nova:swap>0</nova:swap>
Apr 12 16:04:18 user nova-compute[71874]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 16:04:18 user nova-compute[71874]:         <nova:vcpus>1</nova:vcpus>
Apr 12 16:04:18 user nova-compute[71874]:       </nova:flavor>
Apr 12 16:04:18 user nova-compute[71874]:       <nova:owner>
Apr 12 16:04:18 user nova-compute[71874]:         <nova:user uuid="73f9fa5bc22a4824b3cdcb8cf7bb380c">tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member</nova:user>
Apr 12 16:04:18 user nova-compute[71874]:         <nova:project uuid="9210f81232304e179d3e09914a492442">tempest-ServerBootFromVolumeStableRescueTest-1443944578</nova:project>
Apr 12 16:04:18 user nova-compute[71874]:       </nova:owner>
Apr 12 16:04:18 user nova-compute[71874]:       <nova:root type="image" uuid="9dc63f14-8b70-4e72-89f2-13464f2f5c7c"/>
Apr 12 16:04:18 user nova-compute[71874]:       <nova:ports>
Apr 12 16:04:18 user nova-compute[71874]:         <nova:port uuid="955511f0-eca8-447d-a105-fdd5f182de62">
Apr 12 16:04:18 user nova-compute[71874]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 12 16:04:18 user nova-compute[71874]:         </nova:port>
Apr 12 16:04:18 user nova-compute[71874]:       </nova:ports>
Apr 12 16:04:18 user nova-compute[71874]:     </nova:instance>
Apr 12 16:04:18 user nova-compute[71874]:   </metadata>
Apr 12 16:04:18 user nova-compute[71874]:   <sysinfo type="smbios">
Apr 12 16:04:18 user nova-compute[71874]:     <system>
Apr 12 16:04:18 user nova-compute[71874]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 16:04:18 user nova-compute[71874]:       <entry name="product">OpenStack Nova</entry>
Apr 12 16:04:18 user nova-compute[71874]:       <entry name="version">0.0.0</entry>
Apr 12 16:04:18 user nova-compute[71874]:       <entry name="serial">f52ee906-c8fd-4cd5-842e-de98a5099c4f</entry>
Apr 12 16:04:18 user nova-compute[71874]:       <entry name="uuid">f52ee906-c8fd-4cd5-842e-de98a5099c4f</entry>
Apr 12 16:04:18 user nova-compute[71874]:       <entry name="family">Virtual Machine</entry>
Apr 12 16:04:18 user nova-compute[71874]:     </system>
Apr 12 16:04:18 user nova-compute[71874]:   </sysinfo>
Apr 12 16:04:18 user nova-compute[71874]:   <os>
Apr 12 16:04:18 user nova-compute[71874]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 16:04:18 user nova-compute[71874]:     <smbios mode="sysinfo"/>
Apr 12 16:04:18 user nova-compute[71874]:   </os>
Apr 12 16:04:18 user nova-compute[71874]:   <features>
Apr 12 16:04:18 user nova-compute[71874]:     <acpi/>
Apr 12 16:04:18 user nova-compute[71874]:     <apic/>
Apr 12 16:04:18 user nova-compute[71874]:     <vmcoreinfo/>
Apr 12 16:04:18 user nova-compute[71874]:   </features>
Apr 12 16:04:18 user nova-compute[71874]:   <clock offset="utc">
Apr 12 16:04:18 user nova-compute[71874]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 16:04:18 user nova-compute[71874]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 16:04:18 user nova-compute[71874]:     <timer name="hpet" present="no"/>
Apr 12 16:04:18 user nova-compute[71874]:   </clock>
Apr 12 16:04:18 user nova-compute[71874]:   <cpu mode="custom" match="exact">
Apr 12 16:04:18 user nova-compute[71874]:     <model>Nehalem</model>
Apr 12 16:04:18 user nova-compute[71874]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 16:04:18 user nova-compute[71874]:   </cpu>
Apr 12 16:04:18 user nova-compute[71874]:   <devices>
Apr 12 16:04:18 user nova-compute[71874]:     <disk type="block" device="disk">
Apr 12 16:04:18 user nova-compute[71874]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 16:04:18 user nova-compute[71874]:       <source dev="/dev/sdb"/>
Apr 12 16:04:18 user nova-compute[71874]:       <target dev="vda" bus="virtio"/>
Apr 12 16:04:18 user nova-compute[71874]:       <serial>a3ef648d-928f-4687-906e-f415a564fea2</serial>
Apr 12 16:04:18 user nova-compute[71874]:     </disk>
Apr 12 16:04:18 user nova-compute[71874]:     <disk type="file" device="disk">
Apr 12 16:04:18 user nova-compute[71874]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 16:04:18 user nova-compute[71874]:       <source file="/opt/stack/data/nova/instances/f52ee906-c8fd-4cd5-842e-de98a5099c4f/disk.rescue"/>
Apr 12 16:04:18 user nova-compute[71874]:       <target dev="vdb" bus="virtio"/>
Apr 12 16:04:18 user nova-compute[71874]:       <boot order="1"/>
Apr 12 16:04:18 user nova-compute[71874]:     </disk>
Apr 12 16:04:18 user nova-compute[71874]:     <interface type="ethernet">
Apr 12 16:04:18 user nova-compute[71874]:       <mac address="fa:16:3e:ec:61:14"/>
Apr 12 16:04:18 user nova-compute[71874]:       <model type="virtio"/>
Apr 12 16:04:18 user nova-compute[71874]:       <mtu size="1442"/>
Apr 12 16:04:18 user nova-compute[71874]:       <target dev="tap955511f0-ec"/>
Apr 12 16:04:18 user nova-compute[71874]:     </interface>
Apr 12 16:04:18 user nova-compute[71874]:     <serial type="pty">
Apr 12 16:04:18 user nova-compute[71874]:       <log file="/opt/stack/data/nova/instances/f52ee906-c8fd-4cd5-842e-de98a5099c4f/console.log" append="off"/>
Apr 12 16:04:18 user nova-compute[71874]:     </serial>
Apr 12 16:04:18 user nova-compute[71874]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 16:04:18 user nova-compute[71874]:     <video>
Apr 12 16:04:18 user nova-compute[71874]:       <model type="virtio"/>
Apr 12 16:04:18 user nova-compute[71874]:     </video>
Apr 12 16:04:18 user nova-compute[71874]:     <rng model="virtio">
Apr 12 16:04:18 user nova-compute[71874]:       <backend model="random">/dev/urandom</backend>
Apr 12 16:04:18 user nova-compute[71874]:     </rng>
Apr 12 16:04:18 user nova-compute[71874]:     <controller type="usb" index="0" model="none"/>
Apr 12 16:04:18 user nova-compute[71874]:     <memballoon model="virtio">
Apr 12 16:04:18 user nova-compute[71874]:       <stats period="10"/>
Apr 12 16:04:18 user nova-compute[71874]:     </memballoon>
Apr 12 16:04:18 user nova-compute[71874]:   </devices>
Apr 12 16:04:18 user nova-compute[71874]: </domain>
Apr 12 16:04:18 user nova-compute[71874]:  {{(pid=71874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 16:04:18 user nova-compute[71874]: INFO nova.virt.libvirt.driver [-] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] Instance destroyed successfully.
Apr 12 16:04:18 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-5cd07e0c-c7dd-41f1-80aa-dea9dfae557f tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] No BDM found with device name vda, not building metadata. {{(pid=71874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 16:04:18 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-5cd07e0c-c7dd-41f1-80aa-dea9dfae557f tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 16:04:18 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-5cd07e0c-c7dd-41f1-80aa-dea9dfae557f tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] No VIF found with MAC fa:16:3e:ec:61:14, not building metadata {{(pid=71874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 16:04:20 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:04:20 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:04:20 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:04:20 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:04:20 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:04:20 user nova-compute[71874]: DEBUG nova.compute.manager [req-8004588b-5fe9-43b6-827d-b6bd32174232 req-1c20da78-6fc1-476e-a088-be2411cf5187 service nova] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] Received event network-vif-plugged-955511f0-eca8-447d-a105-fdd5f182de62 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:04:20 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-8004588b-5fe9-43b6-827d-b6bd32174232 req-1c20da78-6fc1-476e-a088-be2411cf5187 service nova] Acquiring lock "f52ee906-c8fd-4cd5-842e-de98a5099c4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:04:20 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-8004588b-5fe9-43b6-827d-b6bd32174232 req-1c20da78-6fc1-476e-a088-be2411cf5187 service nova] Lock "f52ee906-c8fd-4cd5-842e-de98a5099c4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:04:20 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-8004588b-5fe9-43b6-827d-b6bd32174232 req-1c20da78-6fc1-476e-a088-be2411cf5187 service nova] Lock "f52ee906-c8fd-4cd5-842e-de98a5099c4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:04:20 user nova-compute[71874]: DEBUG nova.compute.manager [req-8004588b-5fe9-43b6-827d-b6bd32174232 req-1c20da78-6fc1-476e-a088-be2411cf5187 service nova] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] No waiting events found dispatching network-vif-plugged-955511f0-eca8-447d-a105-fdd5f182de62 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:04:20 user nova-compute[71874]: WARNING nova.compute.manager [req-8004588b-5fe9-43b6-827d-b6bd32174232 req-1c20da78-6fc1-476e-a088-be2411cf5187 service nova] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] Received unexpected event network-vif-plugged-955511f0-eca8-447d-a105-fdd5f182de62 for instance with vm_state active and task_state rescuing.
Apr 12 16:04:21 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:04:21 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:04:22 user nova-compute[71874]: DEBUG nova.compute.manager [req-e07a0a80-93a1-4cb6-ad01-5e66bbcbebf0 req-d6e306d2-c031-4cb7-8e50-a7aa7440949e service nova] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] Received event network-vif-plugged-955511f0-eca8-447d-a105-fdd5f182de62 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:04:22 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-e07a0a80-93a1-4cb6-ad01-5e66bbcbebf0 req-d6e306d2-c031-4cb7-8e50-a7aa7440949e service nova] Acquiring lock "f52ee906-c8fd-4cd5-842e-de98a5099c4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:04:22 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-e07a0a80-93a1-4cb6-ad01-5e66bbcbebf0 req-d6e306d2-c031-4cb7-8e50-a7aa7440949e service nova] Lock "f52ee906-c8fd-4cd5-842e-de98a5099c4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:04:22 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-e07a0a80-93a1-4cb6-ad01-5e66bbcbebf0 req-d6e306d2-c031-4cb7-8e50-a7aa7440949e service nova] Lock "f52ee906-c8fd-4cd5-842e-de98a5099c4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:04:22 user nova-compute[71874]: DEBUG nova.compute.manager [req-e07a0a80-93a1-4cb6-ad01-5e66bbcbebf0 req-d6e306d2-c031-4cb7-8e50-a7aa7440949e service nova] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] No waiting events found dispatching network-vif-plugged-955511f0-eca8-447d-a105-fdd5f182de62 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:04:22 user nova-compute[71874]: WARNING nova.compute.manager [req-e07a0a80-93a1-4cb6-ad01-5e66bbcbebf0 req-d6e306d2-c031-4cb7-8e50-a7aa7440949e service nova] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] Received unexpected event network-vif-plugged-955511f0-eca8-447d-a105-fdd5f182de62 for instance with vm_state active and task_state rescuing.
Apr 12 16:04:22 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:04:22 user nova-compute[71874]: DEBUG nova.virt.libvirt.host [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Removed pending event for f52ee906-c8fd-4cd5-842e-de98a5099c4f due to event {{(pid=71874) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 12 16:04:22 user nova-compute[71874]: DEBUG nova.virt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Emitting event <LifecycleEvent: 1681315462.9731114, f52ee906-c8fd-4cd5-842e-de98a5099c4f => Resumed> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:04:22 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] VM Resumed (Lifecycle Event)
Apr 12 16:04:22 user nova-compute[71874]: DEBUG nova.compute.manager [None req-5cd07e0c-c7dd-41f1-80aa-dea9dfae557f tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:04:23 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:04:23 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 16:04:23 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 12 16:04:23 user nova-compute[71874]: DEBUG nova.virt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Emitting event <LifecycleEvent: 1681315462.9767218, f52ee906-c8fd-4cd5-842e-de98a5099c4f => Started> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:04:23 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] VM Started (Lifecycle Event)
Apr 12 16:04:23 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:04:23 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 16:04:26 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:04:26 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:04:26 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Starting heal instance info cache {{(pid=71874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 16:04:26 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquiring lock "refresh_cache-fc19fd8d-3285-4ceb-8714-a0ba139f3045" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:04:26 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquired lock "refresh_cache-fc19fd8d-3285-4ceb-8714-a0ba139f3045" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:04:26 user nova-compute[71874]: DEBUG nova.network.neutron [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] Forcefully refreshing network info cache for instance {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 16:04:26 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:04:27 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-4ab37256-6ea9-4f20-a010-a92b90fe90d8 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "920c6512-180d-46e1-b0cf-240d34c3fc97" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:04:27 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-4ab37256-6ea9-4f20-a010-a92b90fe90d8 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "920c6512-180d-46e1-b0cf-240d34c3fc97" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:04:27 user nova-compute[71874]: INFO nova.compute.manager [None req-4ab37256-6ea9-4f20-a010-a92b90fe90d8 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: 920c6512-180d-46e1-b0cf-240d34c3fc97] Detaching volume 8d4e6a19-342a-43eb-b9dc-9570b802fbe6
Apr 12 16:04:27 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:04:27 user nova-compute[71874]: INFO nova.virt.block_device [None req-4ab37256-6ea9-4f20-a010-a92b90fe90d8 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: 920c6512-180d-46e1-b0cf-240d34c3fc97] Attempting to driver detach volume 8d4e6a19-342a-43eb-b9dc-9570b802fbe6 from mountpoint /dev/vdb
Apr 12 16:04:27 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-4ab37256-6ea9-4f20-a010-a92b90fe90d8 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Attempting to detach device vdb from instance 920c6512-180d-46e1-b0cf-240d34c3fc97 from the persistent domain config. {{(pid=71874) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 16:04:27 user nova-compute[71874]: DEBUG nova.virt.libvirt.guest [None req-4ab37256-6ea9-4f20-a010-a92b90fe90d8 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 16:04:27 user nova-compute[71874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 16:04:27 user nova-compute[71874]:   <source dev="/dev/sdi"/>
Apr 12 16:04:27 user nova-compute[71874]:   <target dev="vdb" bus="virtio"/>
Apr 12 16:04:27 user nova-compute[71874]:   <serial>8d4e6a19-342a-43eb-b9dc-9570b802fbe6</serial>
Apr 12 16:04:27 user nova-compute[71874]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 16:04:27 user nova-compute[71874]: </disk>
Apr 12 16:04:27 user nova-compute[71874]:  {{(pid=71874) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 16:04:27 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-4ab37256-6ea9-4f20-a010-a92b90fe90d8 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Successfully detached device vdb from instance 920c6512-180d-46e1-b0cf-240d34c3fc97 from the persistent domain config.
Apr 12 16:04:27 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-4ab37256-6ea9-4f20-a010-a92b90fe90d8 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 920c6512-180d-46e1-b0cf-240d34c3fc97 from the live domain config. {{(pid=71874) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 16:04:27 user nova-compute[71874]: DEBUG nova.virt.libvirt.guest [None req-4ab37256-6ea9-4f20-a010-a92b90fe90d8 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 16:04:27 user nova-compute[71874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 16:04:27 user nova-compute[71874]:   <source dev="/dev/sdi"/>
Apr 12 16:04:27 user nova-compute[71874]:   <target dev="vdb" bus="virtio"/>
Apr 12 16:04:27 user nova-compute[71874]:   <serial>8d4e6a19-342a-43eb-b9dc-9570b802fbe6</serial>
Apr 12 16:04:27 user nova-compute[71874]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 16:04:27 user nova-compute[71874]: </disk>
Apr 12 16:04:27 user nova-compute[71874]:  {{(pid=71874) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 16:04:28 user nova-compute[71874]: DEBUG nova.network.neutron [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] Updating instance_info_cache with network_info: [{"id": "12acc77d-6a56-426a-acda-16438c358c44", "address": "fa:16:3e:9f:92:7f", "network": {"id": "eb4dd4b5-96d4-4b53-b510-d41e2775b92f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-596111273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fa122cbabe94c6f93c862b4daf31e50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12acc77d-6a", "ovs_interfaceid": "12acc77d-6a56-426a-acda-16438c358c44", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:04:28 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Releasing lock "refresh_cache-fc19fd8d-3285-4ceb-8714-a0ba139f3045" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:04:28 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] Updated the network info_cache for instance {{(pid=71874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 16:04:28 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:04:28 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:04:28 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:04:28 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:04:28 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:04:28 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:04:28 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71874) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 16:04:28 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:04:28 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:04:28 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:04:28 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:04:28 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Auditing locally available compute resources for user (node: user) {{(pid=71874) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 16:04:28 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Received event <DeviceRemovedEvent: 1681315468.4456975, 920c6512-180d-46e1-b0cf-240d34c3fc97 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71874) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 16:04:28 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-4ab37256-6ea9-4f20-a010-a92b90fe90d8 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 920c6512-180d-46e1-b0cf-240d34c3fc97 {{(pid=71874) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 16:04:28 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-4ab37256-6ea9-4f20-a010-a92b90fe90d8 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Successfully detached device vdb from instance 920c6512-180d-46e1-b0cf-240d34c3fc97 from the live domain config.
Apr 12 16:04:28 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ab37256-6ea9-4f20-a010-a92b90fe90d8 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: 920c6512-180d-46e1-b0cf-240d34c3fc97] calling os-brick to detach iSCSI Volume {{(pid=71874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 16:04:28 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ab37256-6ea9-4f20-a010-a92b90fe90d8 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3c0216320>, {'target_iqn': 'iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DfEKATti', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi': {}}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:04:28 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-4ab37256-6ea9-4f20-a010-a92b90fe90d8 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:04:28 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-4ab37256-6ea9-4f20-a010-a92b90fe90d8 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:04:28 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-4ab37256-6ea9-4f20-a010-a92b90fe90d8 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:04:28 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:04:28 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:04:28 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[d80e526b-ff20-4403-9030-a38e4ba900df]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cfd27585-75c7-4a04-a93a-79e4236a36f7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b09d128a-0198-4cfc-942f-323bd2f41d53\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:04:28 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ab37256-6ea9-4f20-a010-a92b90fe90d8 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 16:04:28 user nova-compute[71874]: No targets found.
Apr 12 16:04:28 user nova-compute[71874]: iSNS:
Apr 12 16:04:28 user nova-compute[71874]: No targets found.
Apr 12 16:04:28 user nova-compute[71874]: STATIC:
Apr 12 16:04:28 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:cfd27585-75c7-4a04-a93a-79e4236a36f7
Apr 12 16:04:28 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:04:28 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:04:28 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2
Apr 12 16:04:28 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:04:28 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:04:28 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6
Apr 12 16:04:28 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:04:28 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:04:28 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:b09d128a-0198-4cfc-942f-323bd2f41d53
Apr 12 16:04:28 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:04:28 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:04:28 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2
Apr 12 16:04:28 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:04:28 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:04:28 user nova-compute[71874]: FIRMWARE:
Apr 12 16:04:28 user nova-compute[71874]: No targets found.
Apr 12 16:04:28 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:04:28 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ab37256-6ea9-4f20-a010-a92b90fe90d8 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 16:04:28 user nova-compute[71874]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 16:04:28 user nova-compute[71874]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71874) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 16:04:28 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ab37256-6ea9-4f20-a010-a92b90fe90d8 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6', 0)] {{(pid=71874) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 16:04:28 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:04:28 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:04:28 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[8152ec16-a626-4be8-9c1e-699ae19078f6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b09d128a-0198-4cfc-942f-323bd2f41d53\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cfd27585-75c7-4a04-a93a-79e4236a36f7\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:04:28 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:04:28 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:04:28 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f8a5bb4-b691-40af-a320-9c0a7f905964]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b09d128a-0198-4cfc-942f-323bd2f41d53 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfd27585-75c7-4a04-a93a-79e4236a36f7 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6 (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:04:28 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ab37256-6ea9-4f20-a010-a92b90fe90d8 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:04:28 user nova-compute[71874]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b09d128a-0198-4cfc-942f-323bd2f41d53 (non-flash)
Apr 12 16:04:28 user nova-compute[71874]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfd27585-75c7-4a04-a93a-79e4236a36f7 (non-flash)
Apr 12 16:04:28 user nova-compute[71874]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 (non-flash)
Apr 12 16:04:28 user nova-compute[71874]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6 (non-flash)
Apr 12 16:04:28 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:04:28 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ab37256-6ea9-4f20-a010-a92b90fe90d8 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:04:28 user nova-compute[71874]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b09d128a-0198-4cfc-942f-323bd2f41d53 (non-flash)
Apr 12 16:04:28 user nova-compute[71874]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfd27585-75c7-4a04-a93a-79e4236a36f7 (non-flash)
Apr 12 16:04:28 user nova-compute[71874]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 (non-flash)
Apr 12 16:04:28 user nova-compute[71874]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6 (non-flash)
Apr 12 16:04:28 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:04:28 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ab37256-6ea9-4f20-a010-a92b90fe90d8 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc3d4477be0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6'): ({'sdi'}, set())}) {{(pid=71874) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 16:04:28 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-4ab37256-6ea9-4f20-a010-a92b90fe90d8 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Removing single pathed devices sdi {{(pid=71874) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 16:04:28 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:04:28 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.029s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:04:28 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c5b8781-c0da-48e3-981f-251f2b6864fa]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:04:28 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:04:28 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.020s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:04:28 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[4554fb55-976b-4057-ae7b-77db52e9ca4f]: (4, ('ok\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:04:28 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-4ab37256-6ea9-4f20-a010-a92b90fe90d8 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Flushing IO for device /dev/sdi {{(pid=71874) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 16:04:28 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:04:28 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.014s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:04:28 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[3270ed18-cf33-4b72-962f-0e36bac113f6]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:04:28 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-4ab37256-6ea9-4f20-a010-a92b90fe90d8 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=71874) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 16:04:28 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:04:28 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.040s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:04:28 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed4ea47b-71d1-4915-81a9-f530cd5288da]: (4, ('1', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:04:28 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-4ab37256-6ea9-4f20-a010-a92b90fe90d8 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=71874) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 16:04:28 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-4ab37256-6ea9-4f20-a010-a92b90fe90d8 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] SCSI volumes sdi have been removed. {{(pid=71874) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 16:04:28 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ab37256-6ea9-4f20-a010-a92b90fe90d8 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6')] {{(pid=71874) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 16:04:28 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:04:28 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc19fd8d-3285-4ceb-8714-a0ba139f3045/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:04:28 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.034s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:04:28 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[5766c84f-53c9-4d7f-b1cc-d0e64b1d1f97]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:04:28 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ab37256-6ea9-4f20-a010-a92b90fe90d8 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:04:28 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6 -p 172.16.0.220:3260 --logout {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:04:28 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:04:28 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[94aeea7a-c417-454f-802c-339dbb7cb6c9]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:04:28 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ab37256-6ea9-4f20-a010-a92b90fe90d8 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6, portal: 172.16.0.220,3260]
Apr 12 16:04:28 user nova-compute[71874]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6, portal: 172.16.0.220,3260] successful.
Apr 12 16:04:28 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:04:28 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6 -p 172.16.0.220:3260 --op delete {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:04:28 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d4e6a19-342a-43eb-b9dc-9570b802fbe6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:04:28 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cc7fd6b-37f1-4593-98e3-594dd5c4c6b1]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:04:28 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ab37256-6ea9-4f20-a010-a92b90fe90d8 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:04:28 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-4ab37256-6ea9-4f20-a010-a92b90fe90d8 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.433s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:04:28 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ab37256-6ea9-4f20-a010-a92b90fe90d8 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] <== disconnect_volume: return (435ms) None {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:04:28 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ab37256-6ea9-4f20-a010-a92b90fe90d8 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: 920c6512-180d-46e1-b0cf-240d34c3fc97] Disconnected iSCSI Volume {{(pid=71874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 16:04:28 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc19fd8d-3285-4ceb-8714-a0ba139f3045/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:04:28 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc19fd8d-3285-4ceb-8714-a0ba139f3045/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:04:29 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc19fd8d-3285-4ceb-8714-a0ba139f3045/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:04:29 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=71874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 16:04:29 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:04:29 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:04:29 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:04:29 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:04:29 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afebffae-dbf6-4876-8c9f-0364f0fde49c/disk.rescue --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:04:29 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afebffae-dbf6-4876-8c9f-0364f0fde49c/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:04:29 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afebffae-dbf6-4876-8c9f-0364f0fde49c/disk.rescue --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:04:29 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afebffae-dbf6-4876-8c9f-0364f0fde49c/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:04:29 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afebffae-dbf6-4876-8c9f-0364f0fde49c/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:04:30 user nova-compute[71874]: DEBUG nova.objects.instance [None req-4ab37256-6ea9-4f20-a010-a92b90fe90d8 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lazy-loading 'flavor' on Instance uuid 920c6512-180d-46e1-b0cf-240d34c3fc97 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:04:30 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afebffae-dbf6-4876-8c9f-0364f0fde49c/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:04:30 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afebffae-dbf6-4876-8c9f-0364f0fde49c/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:04:30 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-4ab37256-6ea9-4f20-a010-a92b90fe90d8 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "920c6512-180d-46e1-b0cf-240d34c3fc97" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:04:30 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afebffae-dbf6-4876-8c9f-0364f0fde49c/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:04:30 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 16:04:30 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f52ee906-c8fd-4cd5-842e-de98a5099c4f/disk.rescue --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:04:30 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f52ee906-c8fd-4cd5-842e-de98a5099c4f/disk.rescue --force-share --output=json" returned: 0 in 0.166s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:04:30 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f52ee906-c8fd-4cd5-842e-de98a5099c4f/disk.rescue --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:04:30 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f52ee906-c8fd-4cd5-842e-de98a5099c4f/disk.rescue --force-share --output=json" returned: 0 in 0.206s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:04:30 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/608fbea2-b42b-4bb9-94a7-2b76dcdc2001/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:04:30 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/608fbea2-b42b-4bb9-94a7-2b76dcdc2001/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:04:30 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/608fbea2-b42b-4bb9-94a7-2b76dcdc2001/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:04:30 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/608fbea2-b42b-4bb9-94a7-2b76dcdc2001/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:04:30 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2285eef6-6613-4802-a988-3fae065fa92d/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:04:31 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2285eef6-6613-4802-a988-3fae065fa92d/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:04:31 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2285eef6-6613-4802-a988-3fae065fa92d/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:04:31 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2285eef6-6613-4802-a988-3fae065fa92d/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:04:31 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/920c6512-180d-46e1-b0cf-240d34c3fc97/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:04:31 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/920c6512-180d-46e1-b0cf-240d34c3fc97/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:04:31 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/920c6512-180d-46e1-b0cf-240d34c3fc97/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:04:31 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:04:31 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/920c6512-180d-46e1-b0cf-240d34c3fc97/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:04:31 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473a30c4-5aa4-481c-8859-fda815d14872/disk.rescue --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:04:31 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473a30c4-5aa4-481c-8859-fda815d14872/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:04:31 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473a30c4-5aa4-481c-8859-fda815d14872/disk.rescue --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:04:31 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:04:31 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473a30c4-5aa4-481c-8859-fda815d14872/disk.rescue --force-share --output=json" returned: 0 in 0.158s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:04:31 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473a30c4-5aa4-481c-8859-fda815d14872/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:04:32 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473a30c4-5aa4-481c-8859-fda815d14872/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:04:32 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473a30c4-5aa4-481c-8859-fda815d14872/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:04:32 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473a30c4-5aa4-481c-8859-fda815d14872/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:04:32 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6caa4977-8333-4171-8825-2c3bfb52f80b/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:04:32 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6caa4977-8333-4171-8825-2c3bfb52f80b/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:04:32 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6caa4977-8333-4171-8825-2c3bfb52f80b/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:04:32 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:04:32 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6caa4977-8333-4171-8825-2c3bfb52f80b/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:04:32 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:04:32 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:04:32 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:04:33 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:04:33 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 16:04:33 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=71874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 16:04:33 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:04:33 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:04:33 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Hypervisor/Node resource view: name=user free_ram=7422MB free_disk=26.12425994873047GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71874) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 16:04:33 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:04:33 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:04:33 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance afebffae-dbf6-4876-8c9f-0364f0fde49c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:04:33 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 473a30c4-5aa4-481c-8859-fda815d14872 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:04:33 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 608fbea2-b42b-4bb9-94a7-2b76dcdc2001 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:04:33 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:04:33 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 920c6512-180d-46e1-b0cf-240d34c3fc97 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:04:33 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance f52ee906-c8fd-4cd5-842e-de98a5099c4f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:04:33 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 2285eef6-6613-4802-a988-3fae065fa92d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:04:33 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance fc19fd8d-3285-4ceb-8714-a0ba139f3045 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:04:33 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:04:33 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 6caa4977-8333-4171-8825-2c3bfb52f80b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:04:33 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 85b91251-9735-4812-9f11-003a7951a6f3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:04:33 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=71874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 16:04:33 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Final resource view: name=user phys_ram=16023MB used_ram=1920MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=71874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 16:04:34 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Inventory has not changed in ProviderTree for provider: 0e94b4c8-cd49-45e4-9133-d36eb4b2456b {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 16:04:34 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Inventory has not changed for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 16:04:34 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Compute_service record updated for user:user {{(pid=71874) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 16:04:34 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.675s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:04:34 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:04:36 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-c46e5ad6-ae8d-48e4-9355-b534458f4982 tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Acquiring lock "7835bdfc-77dc-4407-8a0a-ef81eca29c91" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:04:36 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-c46e5ad6-ae8d-48e4-9355-b534458f4982 tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Lock "7835bdfc-77dc-4407-8a0a-ef81eca29c91" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:04:36 user nova-compute[71874]: DEBUG nova.compute.manager [None req-c46e5ad6-ae8d-48e4-9355-b534458f4982 tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] [instance: 7835bdfc-77dc-4407-8a0a-ef81eca29c91] Starting instance... {{(pid=71874) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 16:04:36 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-c46e5ad6-ae8d-48e4-9355-b534458f4982 tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:04:36 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-c46e5ad6-ae8d-48e4-9355-b534458f4982 tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:04:36 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-c46e5ad6-ae8d-48e4-9355-b534458f4982 tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71874) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 16:04:36 user nova-compute[71874]: INFO nova.compute.claims [None req-c46e5ad6-ae8d-48e4-9355-b534458f4982 tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] [instance: 7835bdfc-77dc-4407-8a0a-ef81eca29c91] Claim successful on node user
Apr 12 16:04:36 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-c46e5ad6-ae8d-48e4-9355-b534458f4982 tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Inventory has not changed in ProviderTree for provider: 0e94b4c8-cd49-45e4-9133-d36eb4b2456b {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 16:04:36 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-c46e5ad6-ae8d-48e4-9355-b534458f4982 tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Inventory has not changed for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 16:04:36 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:04:36 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-c46e5ad6-ae8d-48e4-9355-b534458f4982 tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.475s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:04:36 user nova-compute[71874]: DEBUG nova.compute.manager [None req-c46e5ad6-ae8d-48e4-9355-b534458f4982 tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] [instance: 7835bdfc-77dc-4407-8a0a-ef81eca29c91] Start building networks asynchronously for instance. {{(pid=71874) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 16:04:36 user nova-compute[71874]: DEBUG nova.compute.manager [None req-c46e5ad6-ae8d-48e4-9355-b534458f4982 tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] [instance: 7835bdfc-77dc-4407-8a0a-ef81eca29c91] Allocating IP information in the background. {{(pid=71874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 16:04:36 user nova-compute[71874]: DEBUG nova.network.neutron [None req-c46e5ad6-ae8d-48e4-9355-b534458f4982 tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] [instance: 7835bdfc-77dc-4407-8a0a-ef81eca29c91] allocate_for_instance() {{(pid=71874) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 16:04:36 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-c46e5ad6-ae8d-48e4-9355-b534458f4982 tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] [instance: 7835bdfc-77dc-4407-8a0a-ef81eca29c91] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 16:04:36 user nova-compute[71874]: DEBUG nova.compute.manager [None req-c46e5ad6-ae8d-48e4-9355-b534458f4982 tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] [instance: 7835bdfc-77dc-4407-8a0a-ef81eca29c91] Start building block device mappings for instance. {{(pid=71874) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 16:04:37 user nova-compute[71874]: DEBUG nova.policy [None req-c46e5ad6-ae8d-48e4-9355-b534458f4982 tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '584e4a8ef8c943a7a4ab711cf3adc366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9decbec41a40484b9dd236a12964a08a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71874) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 16:04:37 user nova-compute[71874]: DEBUG nova.compute.manager [None req-c46e5ad6-ae8d-48e4-9355-b534458f4982 tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] [instance: 7835bdfc-77dc-4407-8a0a-ef81eca29c91] Start spawning the instance on the hypervisor. {{(pid=71874) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 16:04:37 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-c46e5ad6-ae8d-48e4-9355-b534458f4982 tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] [instance: 7835bdfc-77dc-4407-8a0a-ef81eca29c91] Creating instance directory {{(pid=71874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 16:04:37 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-c46e5ad6-ae8d-48e4-9355-b534458f4982 tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] [instance: 7835bdfc-77dc-4407-8a0a-ef81eca29c91] Creating image(s)
Apr 12 16:04:37 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-c46e5ad6-ae8d-48e4-9355-b534458f4982 tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Acquiring lock "/opt/stack/data/nova/instances/7835bdfc-77dc-4407-8a0a-ef81eca29c91/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:04:37 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-c46e5ad6-ae8d-48e4-9355-b534458f4982 tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Lock "/opt/stack/data/nova/instances/7835bdfc-77dc-4407-8a0a-ef81eca29c91/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:04:37 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-c46e5ad6-ae8d-48e4-9355-b534458f4982 tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Lock "/opt/stack/data/nova/instances/7835bdfc-77dc-4407-8a0a-ef81eca29c91/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:04:37 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-c46e5ad6-ae8d-48e4-9355-b534458f4982 tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:04:37 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-c46e5ad6-ae8d-48e4-9355-b534458f4982 tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json" returned: 0 in 0.204s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:04:37 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-c46e5ad6-ae8d-48e4-9355-b534458f4982 tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Acquiring lock "b88df1b37cb431f52bc53b5616015c89b5bec411" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:04:37 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-c46e5ad6-ae8d-48e4-9355-b534458f4982 tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Lock "b88df1b37cb431f52bc53b5616015c89b5bec411" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:04:37 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-c46e5ad6-ae8d-48e4-9355-b534458f4982 tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:04:37 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-c46e5ad6-ae8d-48e4-9355-b534458f4982 tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json" returned: 0 in 0.148s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:04:37 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-c46e5ad6-ae8d-48e4-9355-b534458f4982 tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411,backing_fmt=raw /opt/stack/data/nova/instances/7835bdfc-77dc-4407-8a0a-ef81eca29c91/disk 1073741824 {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:04:37 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-c46e5ad6-ae8d-48e4-9355-b534458f4982 tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411,backing_fmt=raw /opt/stack/data/nova/instances/7835bdfc-77dc-4407-8a0a-ef81eca29c91/disk 1073741824" returned: 0 in 0.065s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:04:37 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-c46e5ad6-ae8d-48e4-9355-b534458f4982 tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Lock "b88df1b37cb431f52bc53b5616015c89b5bec411" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.222s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:04:37 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-c46e5ad6-ae8d-48e4-9355-b534458f4982 tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:04:37 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:04:37 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-c46e5ad6-ae8d-48e4-9355-b534458f4982 tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json" returned: 0 in 0.158s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:04:37 user nova-compute[71874]: DEBUG nova.virt.disk.api [None req-c46e5ad6-ae8d-48e4-9355-b534458f4982 tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7835bdfc-77dc-4407-8a0a-ef81eca29c91/disk. size=1073741824 {{(pid=71874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 16:04:37 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-c46e5ad6-ae8d-48e4-9355-b534458f4982 tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7835bdfc-77dc-4407-8a0a-ef81eca29c91/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:04:37 user nova-compute[71874]: DEBUG nova.network.neutron [None req-c46e5ad6-ae8d-48e4-9355-b534458f4982 tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] [instance: 7835bdfc-77dc-4407-8a0a-ef81eca29c91] Successfully created port: d0b3ae35-a6cc-416c-86a7-6ea400e14660 {{(pid=71874) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 16:04:37 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-c46e5ad6-ae8d-48e4-9355-b534458f4982 tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7835bdfc-77dc-4407-8a0a-ef81eca29c91/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:04:37 user nova-compute[71874]: DEBUG nova.virt.disk.api [None req-c46e5ad6-ae8d-48e4-9355-b534458f4982 tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Cannot resize image /opt/stack/data/nova/instances/7835bdfc-77dc-4407-8a0a-ef81eca29c91/disk to a smaller size. {{(pid=71874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 16:04:37 user nova-compute[71874]: DEBUG nova.objects.instance [None req-c46e5ad6-ae8d-48e4-9355-b534458f4982 tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Lazy-loading 'migration_context' on Instance uuid 7835bdfc-77dc-4407-8a0a-ef81eca29c91 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:04:37 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-c46e5ad6-ae8d-48e4-9355-b534458f4982 tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] [instance: 7835bdfc-77dc-4407-8a0a-ef81eca29c91] Created local disks {{(pid=71874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 16:04:37 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-c46e5ad6-ae8d-48e4-9355-b534458f4982 tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] [instance: 7835bdfc-77dc-4407-8a0a-ef81eca29c91] Ensure instance console log exists: /opt/stack/data/nova/instances/7835bdfc-77dc-4407-8a0a-ef81eca29c91/console.log {{(pid=71874) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 16:04:37 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-c46e5ad6-ae8d-48e4-9355-b534458f4982 tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:04:37 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-c46e5ad6-ae8d-48e4-9355-b534458f4982 tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:04:37 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-c46e5ad6-ae8d-48e4-9355-b534458f4982 tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:04:38 user nova-compute[71874]: DEBUG nova.network.neutron [None req-c46e5ad6-ae8d-48e4-9355-b534458f4982 tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] [instance: 7835bdfc-77dc-4407-8a0a-ef81eca29c91] Successfully updated port: d0b3ae35-a6cc-416c-86a7-6ea400e14660 {{(pid=71874) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 16:04:38 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-c46e5ad6-ae8d-48e4-9355-b534458f4982 tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Acquiring lock "refresh_cache-7835bdfc-77dc-4407-8a0a-ef81eca29c91" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:04:38 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-c46e5ad6-ae8d-48e4-9355-b534458f4982 tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Acquired lock "refresh_cache-7835bdfc-77dc-4407-8a0a-ef81eca29c91" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:04:38 user nova-compute[71874]: DEBUG nova.network.neutron [None req-c46e5ad6-ae8d-48e4-9355-b534458f4982 tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] [instance: 7835bdfc-77dc-4407-8a0a-ef81eca29c91] Building network info cache for instance {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 16:04:39 user nova-compute[71874]: DEBUG nova.network.neutron [None req-c46e5ad6-ae8d-48e4-9355-b534458f4982 tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] [instance: 7835bdfc-77dc-4407-8a0a-ef81eca29c91] Instance cache missing network info. {{(pid=71874) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 16:04:39 user nova-compute[71874]: DEBUG nova.compute.manager [req-3fb1bf7a-522c-4902-b366-5cf5d23cf9fd req-c2fa09bb-b691-43ca-9fb2-00cc426b2ea1 service nova] [instance: 7835bdfc-77dc-4407-8a0a-ef81eca29c91] Received event network-changed-d0b3ae35-a6cc-416c-86a7-6ea400e14660 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:04:39 user nova-compute[71874]: DEBUG nova.compute.manager [req-3fb1bf7a-522c-4902-b366-5cf5d23cf9fd req-c2fa09bb-b691-43ca-9fb2-00cc426b2ea1 service nova] [instance: 7835bdfc-77dc-4407-8a0a-ef81eca29c91] Refreshing instance network info cache due to event network-changed-d0b3ae35-a6cc-416c-86a7-6ea400e14660. {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 16:04:39 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-3fb1bf7a-522c-4902-b366-5cf5d23cf9fd req-c2fa09bb-b691-43ca-9fb2-00cc426b2ea1 service nova] Acquiring lock "refresh_cache-7835bdfc-77dc-4407-8a0a-ef81eca29c91" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:04:39 user nova-compute[71874]: DEBUG nova.network.neutron [None req-c46e5ad6-ae8d-48e4-9355-b534458f4982 tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] [instance: 7835bdfc-77dc-4407-8a0a-ef81eca29c91] Updating instance_info_cache with network_info: [{"id": "d0b3ae35-a6cc-416c-86a7-6ea400e14660", "address": "fa:16:3e:3e:6b:29", "network": {"id": "6f3d0490-15bc-474a-a508-bc36fefa8464", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1471674556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9decbec41a40484b9dd236a12964a08a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0b3ae35-a6", "ovs_interfaceid": "d0b3ae35-a6cc-416c-86a7-6ea400e14660", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:04:39 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-c46e5ad6-ae8d-48e4-9355-b534458f4982 tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Releasing lock "refresh_cache-7835bdfc-77dc-4407-8a0a-ef81eca29c91" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:04:39 user nova-compute[71874]: DEBUG nova.compute.manager [None req-c46e5ad6-ae8d-48e4-9355-b534458f4982 tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] [instance: 7835bdfc-77dc-4407-8a0a-ef81eca29c91] Instance network_info: |[{"id": "d0b3ae35-a6cc-416c-86a7-6ea400e14660", "address": "fa:16:3e:3e:6b:29", "network": {"id": "6f3d0490-15bc-474a-a508-bc36fefa8464", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1471674556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9decbec41a40484b9dd236a12964a08a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0b3ae35-a6", "ovs_interfaceid": "d0b3ae35-a6cc-416c-86a7-6ea400e14660", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 16:04:39 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-3fb1bf7a-522c-4902-b366-5cf5d23cf9fd req-c2fa09bb-b691-43ca-9fb2-00cc426b2ea1 service nova] Acquired lock "refresh_cache-7835bdfc-77dc-4407-8a0a-ef81eca29c91" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:04:39 user nova-compute[71874]: DEBUG nova.network.neutron [req-3fb1bf7a-522c-4902-b366-5cf5d23cf9fd req-c2fa09bb-b691-43ca-9fb2-00cc426b2ea1 service nova] [instance: 7835bdfc-77dc-4407-8a0a-ef81eca29c91] Refreshing network info cache for port d0b3ae35-a6cc-416c-86a7-6ea400e14660 {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 16:04:39 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-c46e5ad6-ae8d-48e4-9355-b534458f4982 tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] [instance: 7835bdfc-77dc-4407-8a0a-ef81eca29c91] Start _get_guest_xml network_info=[{"id": "d0b3ae35-a6cc-416c-86a7-6ea400e14660", "address": "fa:16:3e:3e:6b:29", "network": {"id": "6f3d0490-15bc-474a-a508-bc36fefa8464", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1471674556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9decbec41a40484b9dd236a12964a08a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0b3ae35-a6", "ovs_interfaceid": "d0b3ae35-a6cc-416c-86a7-6ea400e14660", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T15:55:37Z,direct_url=<?>,disk_format='qcow2',id=9dc63f14-8b70-4e72-89f2-13464f2f5c7c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='61a4936d9b7744c0b488d81c9b7746b6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T15:55:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_options': None, 'image_id': '9dc63f14-8b70-4e72-89f2-13464f2f5c7c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 16:04:39 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-c46e5ad6-ae8d-48e4-9355-b534458f4982 tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:04:39 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-c46e5ad6-ae8d-48e4-9355-b534458f4982 tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:04:39 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-c46e5ad6-ae8d-48e4-9355-b534458f4982 tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71874) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 16:04:39 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-c46e5ad6-ae8d-48e4-9355-b534458f4982 tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T15:56:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T15:55:37Z,direct_url=<?>,disk_format='qcow2',id=9dc63f14-8b70-4e72-89f2-13464f2f5c7c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='61a4936d9b7744c0b488d81c9b7746b6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T15:55:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 16:04:39 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-c46e5ad6-ae8d-48e4-9355-b534458f4982 tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Flavor limits 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 16:04:39 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-c46e5ad6-ae8d-48e4-9355-b534458f4982 tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Image limits 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 16:04:39 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-c46e5ad6-ae8d-48e4-9355-b534458f4982 tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Flavor pref 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 16:04:39 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-c46e5ad6-ae8d-48e4-9355-b534458f4982 tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Image pref 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 16:04:39 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-c46e5ad6-ae8d-48e4-9355-b534458f4982 tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 16:04:39 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-c46e5ad6-ae8d-48e4-9355-b534458f4982 tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 16:04:39 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-c46e5ad6-ae8d-48e4-9355-b534458f4982 tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 16:04:39 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-c46e5ad6-ae8d-48e4-9355-b534458f4982 tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Got 1 possible topologies {{(pid=71874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 16:04:39 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-c46e5ad6-ae8d-48e4-9355-b534458f4982 tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 16:04:39 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-c46e5ad6-ae8d-48e4-9355-b534458f4982 tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 16:04:39 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-c46e5ad6-ae8d-48e4-9355-b534458f4982 tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T16:04:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-454092624',display_name='tempest-DeleteServersTestJSON-server-454092624',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-454092624',id=19,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9decbec41a40484b9dd236a12964a08a',ramdisk_id='',reservation_id='r-dczwkkay',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1867736040',owner_user_name='tempest-DeleteServersTestJSON-1867736040-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T16:04:37Z,user_data=None,user_id='584e4a8ef8c943a7a4ab711cf3adc366',uuid=7835bdfc-77dc-4407-8a0a-ef81eca29c91,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d0b3ae35-a6cc-416c-86a7-6ea400e14660", "address": "fa:16:3e:3e:6b:29", "network": {"id": "6f3d0490-15bc-474a-a508-bc36fefa8464", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1471674556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9decbec41a40484b9dd236a12964a08a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0b3ae35-a6", "ovs_interfaceid": "d0b3ae35-a6cc-416c-86a7-6ea400e14660", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 16:04:39 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-c46e5ad6-ae8d-48e4-9355-b534458f4982 tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Converting VIF {"id": "d0b3ae35-a6cc-416c-86a7-6ea400e14660", "address": "fa:16:3e:3e:6b:29", "network": {"id": "6f3d0490-15bc-474a-a508-bc36fefa8464", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1471674556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9decbec41a40484b9dd236a12964a08a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0b3ae35-a6", "ovs_interfaceid": "d0b3ae35-a6cc-416c-86a7-6ea400e14660", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:04:39 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-c46e5ad6-ae8d-48e4-9355-b534458f4982 tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:6b:29,bridge_name='br-int',has_traffic_filtering=True,id=d0b3ae35-a6cc-416c-86a7-6ea400e14660,network=Network(6f3d0490-15bc-474a-a508-bc36fefa8464),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0b3ae35-a6') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:04:39 user nova-compute[71874]: DEBUG nova.objects.instance [None req-c46e5ad6-ae8d-48e4-9355-b534458f4982 tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Lazy-loading 'pci_devices' on Instance uuid 7835bdfc-77dc-4407-8a0a-ef81eca29c91 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:04:39 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-c46e5ad6-ae8d-48e4-9355-b534458f4982 tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] [instance: 7835bdfc-77dc-4407-8a0a-ef81eca29c91] End _get_guest_xml xml=<domain type="kvm">
Apr 12 16:04:39 user nova-compute[71874]:   <uuid>7835bdfc-77dc-4407-8a0a-ef81eca29c91</uuid>
Apr 12 16:04:39 user nova-compute[71874]:   <name>instance-00000013</name>
Apr 12 16:04:39 user nova-compute[71874]:   <memory>131072</memory>
Apr 12 16:04:39 user nova-compute[71874]:   <vcpu>1</vcpu>
Apr 12 16:04:39 user nova-compute[71874]:   <metadata>
Apr 12 16:04:39 user nova-compute[71874]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 16:04:39 user nova-compute[71874]:       <nova:package version="0.0.0"/>
Apr 12 16:04:39 user nova-compute[71874]:       <nova:name>tempest-DeleteServersTestJSON-server-454092624</nova:name>
Apr 12 16:04:39 user nova-compute[71874]:       <nova:creationTime>2023-04-12 16:04:39</nova:creationTime>
Apr 12 16:04:39 user nova-compute[71874]:       <nova:flavor name="m1.nano">
Apr 12 16:04:39 user nova-compute[71874]:         <nova:memory>128</nova:memory>
Apr 12 16:04:39 user nova-compute[71874]:         <nova:disk>1</nova:disk>
Apr 12 16:04:39 user nova-compute[71874]:         <nova:swap>0</nova:swap>
Apr 12 16:04:39 user nova-compute[71874]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 16:04:39 user nova-compute[71874]:         <nova:vcpus>1</nova:vcpus>
Apr 12 16:04:39 user nova-compute[71874]:       </nova:flavor>
Apr 12 16:04:39 user nova-compute[71874]:       <nova:owner>
Apr 12 16:04:39 user nova-compute[71874]:         <nova:user uuid="584e4a8ef8c943a7a4ab711cf3adc366">tempest-DeleteServersTestJSON-1867736040-project-member</nova:user>
Apr 12 16:04:39 user nova-compute[71874]:         <nova:project uuid="9decbec41a40484b9dd236a12964a08a">tempest-DeleteServersTestJSON-1867736040</nova:project>
Apr 12 16:04:39 user nova-compute[71874]:       </nova:owner>
Apr 12 16:04:39 user nova-compute[71874]:       <nova:root type="image" uuid="9dc63f14-8b70-4e72-89f2-13464f2f5c7c"/>
Apr 12 16:04:39 user nova-compute[71874]:       <nova:ports>
Apr 12 16:04:39 user nova-compute[71874]:         <nova:port uuid="d0b3ae35-a6cc-416c-86a7-6ea400e14660">
Apr 12 16:04:39 user nova-compute[71874]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 12 16:04:39 user nova-compute[71874]:         </nova:port>
Apr 12 16:04:39 user nova-compute[71874]:       </nova:ports>
Apr 12 16:04:39 user nova-compute[71874]:     </nova:instance>
Apr 12 16:04:39 user nova-compute[71874]:   </metadata>
Apr 12 16:04:39 user nova-compute[71874]:   <sysinfo type="smbios">
Apr 12 16:04:39 user nova-compute[71874]:     <system>
Apr 12 16:04:39 user nova-compute[71874]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 16:04:39 user nova-compute[71874]:       <entry name="product">OpenStack Nova</entry>
Apr 12 16:04:39 user nova-compute[71874]:       <entry name="version">0.0.0</entry>
Apr 12 16:04:39 user nova-compute[71874]:       <entry name="serial">7835bdfc-77dc-4407-8a0a-ef81eca29c91</entry>
Apr 12 16:04:39 user nova-compute[71874]:       <entry name="uuid">7835bdfc-77dc-4407-8a0a-ef81eca29c91</entry>
Apr 12 16:04:39 user nova-compute[71874]:       <entry name="family">Virtual Machine</entry>
Apr 12 16:04:39 user nova-compute[71874]:     </system>
Apr 12 16:04:39 user nova-compute[71874]:   </sysinfo>
Apr 12 16:04:39 user nova-compute[71874]:   <os>
Apr 12 16:04:39 user nova-compute[71874]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 16:04:39 user nova-compute[71874]:     <boot dev="hd"/>
Apr 12 16:04:39 user nova-compute[71874]:     <smbios mode="sysinfo"/>
Apr 12 16:04:39 user nova-compute[71874]:   </os>
Apr 12 16:04:39 user nova-compute[71874]:   <features>
Apr 12 16:04:39 user nova-compute[71874]:     <acpi/>
Apr 12 16:04:39 user nova-compute[71874]:     <apic/>
Apr 12 16:04:39 user nova-compute[71874]:     <vmcoreinfo/>
Apr 12 16:04:39 user nova-compute[71874]:   </features>
Apr 12 16:04:39 user nova-compute[71874]:   <clock offset="utc">
Apr 12 16:04:39 user nova-compute[71874]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 16:04:39 user nova-compute[71874]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 16:04:39 user nova-compute[71874]:     <timer name="hpet" present="no"/>
Apr 12 16:04:39 user nova-compute[71874]:   </clock>
Apr 12 16:04:39 user nova-compute[71874]:   <cpu mode="custom" match="exact">
Apr 12 16:04:39 user nova-compute[71874]:     <model>Nehalem</model>
Apr 12 16:04:39 user nova-compute[71874]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 16:04:39 user nova-compute[71874]:   </cpu>
Apr 12 16:04:39 user nova-compute[71874]:   <devices>
Apr 12 16:04:39 user nova-compute[71874]:     <disk type="file" device="disk">
Apr 12 16:04:39 user nova-compute[71874]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 16:04:39 user nova-compute[71874]:       <source file="/opt/stack/data/nova/instances/7835bdfc-77dc-4407-8a0a-ef81eca29c91/disk"/>
Apr 12 16:04:39 user nova-compute[71874]:       <target dev="vda" bus="virtio"/>
Apr 12 16:04:39 user nova-compute[71874]:     </disk>
Apr 12 16:04:39 user nova-compute[71874]:     <interface type="ethernet">
Apr 12 16:04:39 user nova-compute[71874]:       <mac address="fa:16:3e:3e:6b:29"/>
Apr 12 16:04:39 user nova-compute[71874]:       <model type="virtio"/>
Apr 12 16:04:39 user nova-compute[71874]:       <mtu size="1442"/>
Apr 12 16:04:39 user nova-compute[71874]:       <target dev="tapd0b3ae35-a6"/>
Apr 12 16:04:39 user nova-compute[71874]:     </interface>
Apr 12 16:04:39 user nova-compute[71874]:     <serial type="pty">
Apr 12 16:04:39 user nova-compute[71874]:       <log file="/opt/stack/data/nova/instances/7835bdfc-77dc-4407-8a0a-ef81eca29c91/console.log" append="off"/>
Apr 12 16:04:39 user nova-compute[71874]:     </serial>
Apr 12 16:04:39 user nova-compute[71874]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 16:04:39 user nova-compute[71874]:     <video>
Apr 12 16:04:39 user nova-compute[71874]:       <model type="virtio"/>
Apr 12 16:04:39 user nova-compute[71874]:     </video>
Apr 12 16:04:39 user nova-compute[71874]:     <rng model="virtio">
Apr 12 16:04:39 user nova-compute[71874]:       <backend model="random">/dev/urandom</backend>
Apr 12 16:04:39 user nova-compute[71874]:     </rng>
Apr 12 16:04:39 user nova-compute[71874]:     <controller type="usb" index="0" model="none"/>
Apr 12 16:04:39 user nova-compute[71874]:     <memballoon model="virtio">
Apr 12 16:04:39 user nova-compute[71874]:       <stats period="10"/>
Apr 12 16:04:39 user nova-compute[71874]:     </memballoon>
Apr 12 16:04:39 user nova-compute[71874]:   </devices>
Apr 12 16:04:39 user nova-compute[71874]: </domain>
Apr 12 16:04:39 user nova-compute[71874]:  {{(pid=71874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 16:04:39 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-c46e5ad6-ae8d-48e4-9355-b534458f4982 tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T16:04:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-454092624',display_name='tempest-DeleteServersTestJSON-server-454092624',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-454092624',id=19,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9decbec41a40484b9dd236a12964a08a',ramdisk_id='',reservation_id='r-dczwkkay',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1867736040',owner_user_name='tempest-DeleteServersTestJSON-1867736040-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T16:04:37Z,user_data=None,user_id='584e4a8ef8c943a7a4ab711cf3adc366',uuid=7835bdfc-77dc-4407-8a0a-ef81eca29c91,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d0b3ae35-a6cc-416c-86a7-6ea400e14660", "address": "fa:16:3e:3e:6b:29", "network": {"id": "6f3d0490-15bc-474a-a508-bc36fefa8464", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1471674556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9decbec41a40484b9dd236a12964a08a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0b3ae35-a6", "ovs_interfaceid": "d0b3ae35-a6cc-416c-86a7-6ea400e14660", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 16:04:39 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-c46e5ad6-ae8d-48e4-9355-b534458f4982 tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Converting VIF {"id": "d0b3ae35-a6cc-416c-86a7-6ea400e14660", "address": "fa:16:3e:3e:6b:29", "network": {"id": "6f3d0490-15bc-474a-a508-bc36fefa8464", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1471674556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9decbec41a40484b9dd236a12964a08a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0b3ae35-a6", "ovs_interfaceid": "d0b3ae35-a6cc-416c-86a7-6ea400e14660", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:04:39 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-c46e5ad6-ae8d-48e4-9355-b534458f4982 tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:6b:29,bridge_name='br-int',has_traffic_filtering=True,id=d0b3ae35-a6cc-416c-86a7-6ea400e14660,network=Network(6f3d0490-15bc-474a-a508-bc36fefa8464),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0b3ae35-a6') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:04:39 user nova-compute[71874]: DEBUG os_vif [None req-c46e5ad6-ae8d-48e4-9355-b534458f4982 tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:6b:29,bridge_name='br-int',has_traffic_filtering=True,id=d0b3ae35-a6cc-416c-86a7-6ea400e14660,network=Network(6f3d0490-15bc-474a-a508-bc36fefa8464),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0b3ae35-a6') {{(pid=71874) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 16:04:39 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:04:39 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:04:39 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 16:04:39 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:04:39 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd0b3ae35-a6, may_exist=True) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:04:39 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd0b3ae35-a6, col_values=(('external_ids', {'iface-id': 'd0b3ae35-a6cc-416c-86a7-6ea400e14660', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3e:6b:29', 'vm-uuid': '7835bdfc-77dc-4407-8a0a-ef81eca29c91'}),)) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:04:39 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:04:39 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:04:39 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:04:39 user nova-compute[71874]: INFO os_vif [None req-c46e5ad6-ae8d-48e4-9355-b534458f4982 tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:6b:29,bridge_name='br-int',has_traffic_filtering=True,id=d0b3ae35-a6cc-416c-86a7-6ea400e14660,network=Network(6f3d0490-15bc-474a-a508-bc36fefa8464),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0b3ae35-a6')
Apr 12 16:04:39 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-c46e5ad6-ae8d-48e4-9355-b534458f4982 tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] No BDM found with device name vda, not building metadata. {{(pid=71874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 16:04:39 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-c46e5ad6-ae8d-48e4-9355-b534458f4982 tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] No VIF found with MAC fa:16:3e:3e:6b:29, not building metadata {{(pid=71874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 16:04:39 user nova-compute[71874]: DEBUG nova.network.neutron [req-3fb1bf7a-522c-4902-b366-5cf5d23cf9fd req-c2fa09bb-b691-43ca-9fb2-00cc426b2ea1 service nova] [instance: 7835bdfc-77dc-4407-8a0a-ef81eca29c91] Updated VIF entry in instance network info cache for port d0b3ae35-a6cc-416c-86a7-6ea400e14660. {{(pid=71874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 16:04:39 user nova-compute[71874]: DEBUG nova.network.neutron [req-3fb1bf7a-522c-4902-b366-5cf5d23cf9fd req-c2fa09bb-b691-43ca-9fb2-00cc426b2ea1 service nova] [instance: 7835bdfc-77dc-4407-8a0a-ef81eca29c91] Updating instance_info_cache with network_info: [{"id": "d0b3ae35-a6cc-416c-86a7-6ea400e14660", "address": "fa:16:3e:3e:6b:29", "network": {"id": "6f3d0490-15bc-474a-a508-bc36fefa8464", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1471674556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9decbec41a40484b9dd236a12964a08a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0b3ae35-a6", "ovs_interfaceid": "d0b3ae35-a6cc-416c-86a7-6ea400e14660", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:04:39 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-3fb1bf7a-522c-4902-b366-5cf5d23cf9fd req-c2fa09bb-b691-43ca-9fb2-00cc426b2ea1 service nova] Releasing lock "refresh_cache-7835bdfc-77dc-4407-8a0a-ef81eca29c91" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:04:40 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:04:41 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:04:41 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:04:41 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:04:41 user nova-compute[71874]: DEBUG nova.compute.manager [req-a1414f53-e501-4a02-bd6a-673ca70d5d1d req-6fd5354c-9b81-436b-bc0c-025371cf4ae7 service nova] [instance: 7835bdfc-77dc-4407-8a0a-ef81eca29c91] Received event network-vif-plugged-d0b3ae35-a6cc-416c-86a7-6ea400e14660 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:04:41 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-a1414f53-e501-4a02-bd6a-673ca70d5d1d req-6fd5354c-9b81-436b-bc0c-025371cf4ae7 service nova] Acquiring lock "7835bdfc-77dc-4407-8a0a-ef81eca29c91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:04:41 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-a1414f53-e501-4a02-bd6a-673ca70d5d1d req-6fd5354c-9b81-436b-bc0c-025371cf4ae7 service nova] Lock "7835bdfc-77dc-4407-8a0a-ef81eca29c91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:04:41 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-a1414f53-e501-4a02-bd6a-673ca70d5d1d req-6fd5354c-9b81-436b-bc0c-025371cf4ae7 service nova] Lock "7835bdfc-77dc-4407-8a0a-ef81eca29c91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:04:41 user nova-compute[71874]: DEBUG nova.compute.manager [req-a1414f53-e501-4a02-bd6a-673ca70d5d1d req-6fd5354c-9b81-436b-bc0c-025371cf4ae7 service nova] [instance: 7835bdfc-77dc-4407-8a0a-ef81eca29c91] No waiting events found dispatching network-vif-plugged-d0b3ae35-a6cc-416c-86a7-6ea400e14660 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:04:41 user nova-compute[71874]: WARNING nova.compute.manager [req-a1414f53-e501-4a02-bd6a-673ca70d5d1d req-6fd5354c-9b81-436b-bc0c-025371cf4ae7 service nova] [instance: 7835bdfc-77dc-4407-8a0a-ef81eca29c91] Received unexpected event network-vif-plugged-d0b3ae35-a6cc-416c-86a7-6ea400e14660 for instance with vm_state building and task_state spawning.
Apr 12 16:04:41 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:04:41 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:04:41 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:04:41 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:04:42 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:04:43 user nova-compute[71874]: DEBUG nova.virt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Emitting event <LifecycleEvent: 1681315483.3627238, 7835bdfc-77dc-4407-8a0a-ef81eca29c91 => Resumed> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:04:43 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 7835bdfc-77dc-4407-8a0a-ef81eca29c91] VM Resumed (Lifecycle Event)
Apr 12 16:04:43 user nova-compute[71874]: DEBUG nova.compute.manager [None req-c46e5ad6-ae8d-48e4-9355-b534458f4982 tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] [instance: 7835bdfc-77dc-4407-8a0a-ef81eca29c91] Instance event wait completed in 0 seconds for  {{(pid=71874) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 16:04:43 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-c46e5ad6-ae8d-48e4-9355-b534458f4982 tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] [instance: 7835bdfc-77dc-4407-8a0a-ef81eca29c91] Guest created on hypervisor {{(pid=71874) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 16:04:43 user nova-compute[71874]: INFO nova.virt.libvirt.driver [-] [instance: 7835bdfc-77dc-4407-8a0a-ef81eca29c91] Instance spawned successfully.
Apr 12 16:04:43 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-c46e5ad6-ae8d-48e4-9355-b534458f4982 tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] [instance: 7835bdfc-77dc-4407-8a0a-ef81eca29c91] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 16:04:43 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 7835bdfc-77dc-4407-8a0a-ef81eca29c91] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:04:43 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-c46e5ad6-ae8d-48e4-9355-b534458f4982 tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] [instance: 7835bdfc-77dc-4407-8a0a-ef81eca29c91] Found default for hw_cdrom_bus of ide {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:04:43 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-c46e5ad6-ae8d-48e4-9355-b534458f4982 tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] [instance: 7835bdfc-77dc-4407-8a0a-ef81eca29c91] Found default for hw_disk_bus of virtio {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:04:43 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-c46e5ad6-ae8d-48e4-9355-b534458f4982 tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] [instance: 7835bdfc-77dc-4407-8a0a-ef81eca29c91] Found default for hw_input_bus of None {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:04:43 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-c46e5ad6-ae8d-48e4-9355-b534458f4982 tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] [instance: 7835bdfc-77dc-4407-8a0a-ef81eca29c91] Found default for hw_pointer_model of None {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:04:43 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-c46e5ad6-ae8d-48e4-9355-b534458f4982 tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] [instance: 7835bdfc-77dc-4407-8a0a-ef81eca29c91] Found default for hw_video_model of virtio {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:04:43 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-c46e5ad6-ae8d-48e4-9355-b534458f4982 tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] [instance: 7835bdfc-77dc-4407-8a0a-ef81eca29c91] Found default for hw_vif_model of virtio {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:04:43 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 7835bdfc-77dc-4407-8a0a-ef81eca29c91] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 16:04:43 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 7835bdfc-77dc-4407-8a0a-ef81eca29c91] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 16:04:43 user nova-compute[71874]: DEBUG nova.virt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Emitting event <LifecycleEvent: 1681315483.3640468, 7835bdfc-77dc-4407-8a0a-ef81eca29c91 => Started> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:04:43 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 7835bdfc-77dc-4407-8a0a-ef81eca29c91] VM Started (Lifecycle Event)
Apr 12 16:04:43 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 7835bdfc-77dc-4407-8a0a-ef81eca29c91] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:04:43 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 7835bdfc-77dc-4407-8a0a-ef81eca29c91] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 16:04:43 user nova-compute[71874]: DEBUG nova.compute.manager [req-c6db31d8-57a4-4d01-bd87-b6a5f8e6eae6 req-e09ac1a2-1419-4fe4-add4-b9387d52b3d5 service nova] [instance: 7835bdfc-77dc-4407-8a0a-ef81eca29c91] Received event network-vif-plugged-d0b3ae35-a6cc-416c-86a7-6ea400e14660 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:04:43 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-c6db31d8-57a4-4d01-bd87-b6a5f8e6eae6 req-e09ac1a2-1419-4fe4-add4-b9387d52b3d5 service nova] Acquiring lock "7835bdfc-77dc-4407-8a0a-ef81eca29c91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:04:43 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-c6db31d8-57a4-4d01-bd87-b6a5f8e6eae6 req-e09ac1a2-1419-4fe4-add4-b9387d52b3d5 service nova] Lock "7835bdfc-77dc-4407-8a0a-ef81eca29c91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:04:43 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-c6db31d8-57a4-4d01-bd87-b6a5f8e6eae6 req-e09ac1a2-1419-4fe4-add4-b9387d52b3d5 service nova] Lock "7835bdfc-77dc-4407-8a0a-ef81eca29c91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:04:43 user nova-compute[71874]: DEBUG nova.compute.manager [req-c6db31d8-57a4-4d01-bd87-b6a5f8e6eae6 req-e09ac1a2-1419-4fe4-add4-b9387d52b3d5 service nova] [instance: 7835bdfc-77dc-4407-8a0a-ef81eca29c91] No waiting events found dispatching network-vif-plugged-d0b3ae35-a6cc-416c-86a7-6ea400e14660 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:04:43 user nova-compute[71874]: WARNING nova.compute.manager [req-c6db31d8-57a4-4d01-bd87-b6a5f8e6eae6 req-e09ac1a2-1419-4fe4-add4-b9387d52b3d5 service nova] [instance: 7835bdfc-77dc-4407-8a0a-ef81eca29c91] Received unexpected event network-vif-plugged-d0b3ae35-a6cc-416c-86a7-6ea400e14660 for instance with vm_state building and task_state spawning.
Apr 12 16:04:43 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 7835bdfc-77dc-4407-8a0a-ef81eca29c91] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 16:04:43 user nova-compute[71874]: INFO nova.compute.manager [None req-c46e5ad6-ae8d-48e4-9355-b534458f4982 tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] [instance: 7835bdfc-77dc-4407-8a0a-ef81eca29c91] Took 6.49 seconds to spawn the instance on the hypervisor.
Apr 12 16:04:43 user nova-compute[71874]: DEBUG nova.compute.manager [None req-c46e5ad6-ae8d-48e4-9355-b534458f4982 tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] [instance: 7835bdfc-77dc-4407-8a0a-ef81eca29c91] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:04:43 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-21d46542-2116-466e-ac17-9d59ade099db tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] Acquiring lock "cb8fd1e4-401b-4f73-a789-b7183f9003fb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:04:43 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-21d46542-2116-466e-ac17-9d59ade099db tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] Lock "cb8fd1e4-401b-4f73-a789-b7183f9003fb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:04:43 user nova-compute[71874]: DEBUG nova.compute.manager [None req-21d46542-2116-466e-ac17-9d59ade099db tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] [instance: cb8fd1e4-401b-4f73-a789-b7183f9003fb] Starting instance... {{(pid=71874) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 16:04:43 user nova-compute[71874]: INFO nova.compute.manager [None req-c46e5ad6-ae8d-48e4-9355-b534458f4982 tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] [instance: 7835bdfc-77dc-4407-8a0a-ef81eca29c91] Took 7.40 seconds to build instance.
Apr 12 16:04:43 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-21d46542-2116-466e-ac17-9d59ade099db tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:04:43 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-21d46542-2116-466e-ac17-9d59ade099db tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:04:43 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-21d46542-2116-466e-ac17-9d59ade099db tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71874) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 16:04:43 user nova-compute[71874]: INFO nova.compute.claims [None req-21d46542-2116-466e-ac17-9d59ade099db tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] [instance: cb8fd1e4-401b-4f73-a789-b7183f9003fb] Claim successful on node user
Apr 12 16:04:43 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-c46e5ad6-ae8d-48e4-9355-b534458f4982 tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Lock "7835bdfc-77dc-4407-8a0a-ef81eca29c91" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.510s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:04:43 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-21bd938f-857e-4f07-84f7-7375a9d8f539 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Acquiring lock "2285eef6-6613-4802-a988-3fae065fa92d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:04:43 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-21bd938f-857e-4f07-84f7-7375a9d8f539 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Lock "2285eef6-6613-4802-a988-3fae065fa92d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:04:43 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-21bd938f-857e-4f07-84f7-7375a9d8f539 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Acquiring lock "2285eef6-6613-4802-a988-3fae065fa92d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:04:43 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-21bd938f-857e-4f07-84f7-7375a9d8f539 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Lock "2285eef6-6613-4802-a988-3fae065fa92d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:04:43 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-21bd938f-857e-4f07-84f7-7375a9d8f539 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Lock "2285eef6-6613-4802-a988-3fae065fa92d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:04:43 user nova-compute[71874]: INFO nova.compute.manager [None req-21bd938f-857e-4f07-84f7-7375a9d8f539 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] [instance: 2285eef6-6613-4802-a988-3fae065fa92d] Terminating instance
Apr 12 16:04:43 user nova-compute[71874]: DEBUG nova.compute.manager [None req-21bd938f-857e-4f07-84f7-7375a9d8f539 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] [instance: 2285eef6-6613-4802-a988-3fae065fa92d] Start destroying the instance on the hypervisor. {{(pid=71874) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 16:04:43 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:04:43 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:04:44 user nova-compute[71874]: DEBUG nova.compute.manager [req-e5ce900e-b349-4d80-b450-592dfe46f165 req-d25427bf-b926-41cf-8366-9b093b80bb80 service nova] [instance: 2285eef6-6613-4802-a988-3fae065fa92d] Received event network-vif-unplugged-56615a48-49c1-42dd-8326-5806056ea7cf {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:04:44 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-e5ce900e-b349-4d80-b450-592dfe46f165 req-d25427bf-b926-41cf-8366-9b093b80bb80 service nova] Acquiring lock "2285eef6-6613-4802-a988-3fae065fa92d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:04:44 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-e5ce900e-b349-4d80-b450-592dfe46f165 req-d25427bf-b926-41cf-8366-9b093b80bb80 service nova] Lock "2285eef6-6613-4802-a988-3fae065fa92d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:04:44 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-e5ce900e-b349-4d80-b450-592dfe46f165 req-d25427bf-b926-41cf-8366-9b093b80bb80 service nova] Lock "2285eef6-6613-4802-a988-3fae065fa92d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:04:44 user nova-compute[71874]: DEBUG nova.compute.manager [req-e5ce900e-b349-4d80-b450-592dfe46f165 req-d25427bf-b926-41cf-8366-9b093b80bb80 service nova] [instance: 2285eef6-6613-4802-a988-3fae065fa92d] No waiting events found dispatching network-vif-unplugged-56615a48-49c1-42dd-8326-5806056ea7cf {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:04:44 user nova-compute[71874]: DEBUG nova.compute.manager [req-e5ce900e-b349-4d80-b450-592dfe46f165 req-d25427bf-b926-41cf-8366-9b093b80bb80 service nova] [instance: 2285eef6-6613-4802-a988-3fae065fa92d] Received event network-vif-unplugged-56615a48-49c1-42dd-8326-5806056ea7cf for instance with task_state deleting. {{(pid=71874) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 16:04:44 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-21d46542-2116-466e-ac17-9d59ade099db tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] Inventory has not changed in ProviderTree for provider: 0e94b4c8-cd49-45e4-9133-d36eb4b2456b {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 16:04:44 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-21d46542-2116-466e-ac17-9d59ade099db tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] Inventory has not changed for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 16:04:44 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-21d46542-2116-466e-ac17-9d59ade099db tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.529s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:04:44 user nova-compute[71874]: DEBUG nova.compute.manager [None req-21d46542-2116-466e-ac17-9d59ade099db tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] [instance: cb8fd1e4-401b-4f73-a789-b7183f9003fb] Start building networks asynchronously for instance. {{(pid=71874) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 16:04:44 user nova-compute[71874]: DEBUG nova.compute.manager [None req-21d46542-2116-466e-ac17-9d59ade099db tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] [instance: cb8fd1e4-401b-4f73-a789-b7183f9003fb] Allocating IP information in the background. {{(pid=71874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 16:04:44 user nova-compute[71874]: DEBUG nova.network.neutron [None req-21d46542-2116-466e-ac17-9d59ade099db tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] [instance: cb8fd1e4-401b-4f73-a789-b7183f9003fb] allocate_for_instance() {{(pid=71874) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 16:04:44 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-21d46542-2116-466e-ac17-9d59ade099db tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] [instance: cb8fd1e4-401b-4f73-a789-b7183f9003fb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 16:04:44 user nova-compute[71874]: DEBUG nova.compute.manager [None req-21d46542-2116-466e-ac17-9d59ade099db tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] [instance: cb8fd1e4-401b-4f73-a789-b7183f9003fb] Start building block device mappings for instance. {{(pid=71874) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 16:04:44 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:04:44 user nova-compute[71874]: DEBUG nova.compute.manager [None req-21d46542-2116-466e-ac17-9d59ade099db tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] [instance: cb8fd1e4-401b-4f73-a789-b7183f9003fb] Start spawning the instance on the hypervisor. {{(pid=71874) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 16:04:44 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-21d46542-2116-466e-ac17-9d59ade099db tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] [instance: cb8fd1e4-401b-4f73-a789-b7183f9003fb] Creating instance directory {{(pid=71874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 16:04:44 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-21d46542-2116-466e-ac17-9d59ade099db tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] [instance: cb8fd1e4-401b-4f73-a789-b7183f9003fb] Creating image(s)
Apr 12 16:04:44 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-21d46542-2116-466e-ac17-9d59ade099db tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] Acquiring lock "/opt/stack/data/nova/instances/cb8fd1e4-401b-4f73-a789-b7183f9003fb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:04:44 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-21d46542-2116-466e-ac17-9d59ade099db tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] Lock "/opt/stack/data/nova/instances/cb8fd1e4-401b-4f73-a789-b7183f9003fb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:04:44 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-21d46542-2116-466e-ac17-9d59ade099db tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] Lock "/opt/stack/data/nova/instances/cb8fd1e4-401b-4f73-a789-b7183f9003fb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:04:44 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-21d46542-2116-466e-ac17-9d59ade099db tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:04:44 user nova-compute[71874]: DEBUG nova.policy [None req-21d46542-2116-466e-ac17-9d59ade099db tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4e119bed0d354349b36bc6cf426e4929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b99813570054c54ada10220d1fe69ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71874) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 16:04:44 user nova-compute[71874]: INFO nova.virt.libvirt.driver [-] [instance: 2285eef6-6613-4802-a988-3fae065fa92d] Instance destroyed successfully.
Apr 12 16:04:44 user nova-compute[71874]: DEBUG nova.objects.instance [None req-21bd938f-857e-4f07-84f7-7375a9d8f539 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Lazy-loading 'resources' on Instance uuid 2285eef6-6613-4802-a988-3fae065fa92d {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:04:44 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-21bd938f-857e-4f07-84f7-7375a9d8f539 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T16:02:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1401858867',display_name='tempest-VolumesActionsTest-instance-1401858867',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1401858867',id=16,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T16:02:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1bde51ff8bde4dcdb14fcda0fc92d564',ramdisk_id='',reservation_id='r-9env1k09',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-104284977',owner_user_name='tempest-VolumesActionsTest-104284977-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T16:02:59Z,user_data=None,user_id='c5d01dd905404e4aa08a31f25fa53338',uuid=2285eef6-6613-4802-a988-3fae065fa92d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "56615a48-49c1-42dd-8326-5806056ea7cf", "address": "fa:16:3e:92:c0:85", "network": {"id": "33052061-3a43-449e-b742-4ffa29dfc039", "bridge": "br-int", "label": "tempest-VolumesActionsTest-564180421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "1bde51ff8bde4dcdb14fcda0fc92d564", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56615a48-49", "ovs_interfaceid": "56615a48-49c1-42dd-8326-5806056ea7cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 16:04:44 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-21bd938f-857e-4f07-84f7-7375a9d8f539 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Converting VIF {"id": "56615a48-49c1-42dd-8326-5806056ea7cf", "address": "fa:16:3e:92:c0:85", "network": {"id": "33052061-3a43-449e-b742-4ffa29dfc039", "bridge": "br-int", "label": "tempest-VolumesActionsTest-564180421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "1bde51ff8bde4dcdb14fcda0fc92d564", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56615a48-49", "ovs_interfaceid": "56615a48-49c1-42dd-8326-5806056ea7cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:04:44 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-21bd938f-857e-4f07-84f7-7375a9d8f539 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:c0:85,bridge_name='br-int',has_traffic_filtering=True,id=56615a48-49c1-42dd-8326-5806056ea7cf,network=Network(33052061-3a43-449e-b742-4ffa29dfc039),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56615a48-49') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:04:44 user nova-compute[71874]: DEBUG os_vif [None req-21bd938f-857e-4f07-84f7-7375a9d8f539 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:c0:85,bridge_name='br-int',has_traffic_filtering=True,id=56615a48-49c1-42dd-8326-5806056ea7cf,network=Network(33052061-3a43-449e-b742-4ffa29dfc039),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56615a48-49') {{(pid=71874) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 16:04:44 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:04:44 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap56615a48-49, bridge=br-int, if_exists=True) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:04:44 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:04:44 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:04:44 user nova-compute[71874]: INFO os_vif [None req-21bd938f-857e-4f07-84f7-7375a9d8f539 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:c0:85,bridge_name='br-int',has_traffic_filtering=True,id=56615a48-49c1-42dd-8326-5806056ea7cf,network=Network(33052061-3a43-449e-b742-4ffa29dfc039),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56615a48-49')
Apr 12 16:04:44 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-21bd938f-857e-4f07-84f7-7375a9d8f539 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] [instance: 2285eef6-6613-4802-a988-3fae065fa92d] Deleting instance files /opt/stack/data/nova/instances/2285eef6-6613-4802-a988-3fae065fa92d_del
Apr 12 16:04:44 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-21bd938f-857e-4f07-84f7-7375a9d8f539 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] [instance: 2285eef6-6613-4802-a988-3fae065fa92d] Deletion of /opt/stack/data/nova/instances/2285eef6-6613-4802-a988-3fae065fa92d_del complete
Apr 12 16:04:44 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-21d46542-2116-466e-ac17-9d59ade099db tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json" returned: 0 in 0.152s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:04:44 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-21d46542-2116-466e-ac17-9d59ade099db tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] Acquiring lock "b88df1b37cb431f52bc53b5616015c89b5bec411" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:04:44 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-21d46542-2116-466e-ac17-9d59ade099db tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] Lock "b88df1b37cb431f52bc53b5616015c89b5bec411" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:04:44 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-21d46542-2116-466e-ac17-9d59ade099db tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:04:44 user nova-compute[71874]: INFO nova.compute.manager [None req-21bd938f-857e-4f07-84f7-7375a9d8f539 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] [instance: 2285eef6-6613-4802-a988-3fae065fa92d] Took 0.94 seconds to destroy the instance on the hypervisor.
Apr 12 16:04:44 user nova-compute[71874]: DEBUG oslo.service.loopingcall [None req-21bd938f-857e-4f07-84f7-7375a9d8f539 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71874) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 16:04:44 user nova-compute[71874]: DEBUG nova.compute.manager [-] [instance: 2285eef6-6613-4802-a988-3fae065fa92d] Deallocating network for instance {{(pid=71874) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 16:04:44 user nova-compute[71874]: DEBUG nova.network.neutron [-] [instance: 2285eef6-6613-4802-a988-3fae065fa92d] deallocate_for_instance() {{(pid=71874) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 16:04:44 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-21d46542-2116-466e-ac17-9d59ade099db tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json" returned: 0 in 0.157s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:04:44 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-21d46542-2116-466e-ac17-9d59ade099db tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411,backing_fmt=raw /opt/stack/data/nova/instances/cb8fd1e4-401b-4f73-a789-b7183f9003fb/disk 1073741824 {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:04:44 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-21d46542-2116-466e-ac17-9d59ade099db tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411,backing_fmt=raw /opt/stack/data/nova/instances/cb8fd1e4-401b-4f73-a789-b7183f9003fb/disk 1073741824" returned: 0 in 0.051s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:04:44 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-21d46542-2116-466e-ac17-9d59ade099db tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] Lock "b88df1b37cb431f52bc53b5616015c89b5bec411" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.213s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:04:44 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-21d46542-2116-466e-ac17-9d59ade099db tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:04:45 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-21d46542-2116-466e-ac17-9d59ade099db tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json" returned: 0 in 0.170s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:04:45 user nova-compute[71874]: DEBUG nova.virt.disk.api [None req-21d46542-2116-466e-ac17-9d59ade099db tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cb8fd1e4-401b-4f73-a789-b7183f9003fb/disk. size=1073741824 {{(pid=71874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 16:04:45 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-21d46542-2116-466e-ac17-9d59ade099db tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb8fd1e4-401b-4f73-a789-b7183f9003fb/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:04:45 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-21d46542-2116-466e-ac17-9d59ade099db tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb8fd1e4-401b-4f73-a789-b7183f9003fb/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:04:45 user nova-compute[71874]: DEBUG nova.virt.disk.api [None req-21d46542-2116-466e-ac17-9d59ade099db tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] Cannot resize image /opt/stack/data/nova/instances/cb8fd1e4-401b-4f73-a789-b7183f9003fb/disk to a smaller size. {{(pid=71874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 16:04:45 user nova-compute[71874]: DEBUG nova.objects.instance [None req-21d46542-2116-466e-ac17-9d59ade099db tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] Lazy-loading 'migration_context' on Instance uuid cb8fd1e4-401b-4f73-a789-b7183f9003fb {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:04:45 user nova-compute[71874]: DEBUG nova.network.neutron [-] [instance: 2285eef6-6613-4802-a988-3fae065fa92d] Updating instance_info_cache with network_info: [] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:04:45 user nova-compute[71874]: INFO nova.compute.manager [-] [instance: 2285eef6-6613-4802-a988-3fae065fa92d] Took 0.52 seconds to deallocate network for instance.
Apr 12 16:04:45 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-21d46542-2116-466e-ac17-9d59ade099db tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] [instance: cb8fd1e4-401b-4f73-a789-b7183f9003fb] Created local disks {{(pid=71874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 16:04:45 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-21d46542-2116-466e-ac17-9d59ade099db tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] [instance: cb8fd1e4-401b-4f73-a789-b7183f9003fb] Ensure instance console log exists: /opt/stack/data/nova/instances/cb8fd1e4-401b-4f73-a789-b7183f9003fb/console.log {{(pid=71874) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 16:04:45 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-21d46542-2116-466e-ac17-9d59ade099db tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:04:45 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-21d46542-2116-466e-ac17-9d59ade099db tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:04:45 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-21d46542-2116-466e-ac17-9d59ade099db tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:04:45 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-21bd938f-857e-4f07-84f7-7375a9d8f539 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:04:45 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-21bd938f-857e-4f07-84f7-7375a9d8f539 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:04:45 user nova-compute[71874]: DEBUG nova.network.neutron [None req-21d46542-2116-466e-ac17-9d59ade099db tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] [instance: cb8fd1e4-401b-4f73-a789-b7183f9003fb] Successfully created port: 7a9fa84a-39d3-4580-b205-6a75686ba943 {{(pid=71874) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 16:04:45 user nova-compute[71874]: DEBUG nova.compute.manager [req-aaed3ba1-73d2-43c1-8112-3f0cf4ad3e89 req-14a1414a-e5ea-4bca-b434-095ba22068ac service nova] [instance: 2285eef6-6613-4802-a988-3fae065fa92d] Received event network-vif-deleted-56615a48-49c1-42dd-8326-5806056ea7cf {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:04:45 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-21bd938f-857e-4f07-84f7-7375a9d8f539 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Inventory has not changed in ProviderTree for provider: 0e94b4c8-cd49-45e4-9133-d36eb4b2456b {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 16:04:45 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-21bd938f-857e-4f07-84f7-7375a9d8f539 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Inventory has not changed for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 16:04:46 user nova-compute[71874]: DEBUG nova.network.neutron [None req-21d46542-2116-466e-ac17-9d59ade099db tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] [instance: cb8fd1e4-401b-4f73-a789-b7183f9003fb] Successfully updated port: 7a9fa84a-39d3-4580-b205-6a75686ba943 {{(pid=71874) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 16:04:46 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-21bd938f-857e-4f07-84f7-7375a9d8f539 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.743s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:04:46 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-21d46542-2116-466e-ac17-9d59ade099db tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] Acquiring lock "refresh_cache-cb8fd1e4-401b-4f73-a789-b7183f9003fb" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:04:46 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-21d46542-2116-466e-ac17-9d59ade099db tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] Acquired lock "refresh_cache-cb8fd1e4-401b-4f73-a789-b7183f9003fb" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:04:46 user nova-compute[71874]: DEBUG nova.network.neutron [None req-21d46542-2116-466e-ac17-9d59ade099db tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] [instance: cb8fd1e4-401b-4f73-a789-b7183f9003fb] Building network info cache for instance {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 16:04:46 user nova-compute[71874]: INFO nova.scheduler.client.report [None req-21bd938f-857e-4f07-84f7-7375a9d8f539 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Deleted allocations for instance 2285eef6-6613-4802-a988-3fae065fa92d
Apr 12 16:04:46 user nova-compute[71874]: DEBUG nova.network.neutron [None req-21d46542-2116-466e-ac17-9d59ade099db tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] [instance: cb8fd1e4-401b-4f73-a789-b7183f9003fb] Instance cache missing network info. {{(pid=71874) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 16:04:46 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-21bd938f-857e-4f07-84f7-7375a9d8f539 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Lock "2285eef6-6613-4802-a988-3fae065fa92d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.436s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:04:46 user nova-compute[71874]: DEBUG nova.compute.manager [req-c77b747a-ee85-42a9-8912-a90bd7252404 req-fbc8719d-c83b-4df6-addd-d4bd11b1a76e service nova] [instance: 2285eef6-6613-4802-a988-3fae065fa92d] Received event network-vif-plugged-56615a48-49c1-42dd-8326-5806056ea7cf {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:04:46 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-c77b747a-ee85-42a9-8912-a90bd7252404 req-fbc8719d-c83b-4df6-addd-d4bd11b1a76e service nova] Acquiring lock "2285eef6-6613-4802-a988-3fae065fa92d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:04:46 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-c77b747a-ee85-42a9-8912-a90bd7252404 req-fbc8719d-c83b-4df6-addd-d4bd11b1a76e service nova] Lock "2285eef6-6613-4802-a988-3fae065fa92d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:04:46 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-c77b747a-ee85-42a9-8912-a90bd7252404 req-fbc8719d-c83b-4df6-addd-d4bd11b1a76e service nova] Lock "2285eef6-6613-4802-a988-3fae065fa92d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:04:46 user nova-compute[71874]: DEBUG nova.compute.manager [req-c77b747a-ee85-42a9-8912-a90bd7252404 req-fbc8719d-c83b-4df6-addd-d4bd11b1a76e service nova] [instance: 2285eef6-6613-4802-a988-3fae065fa92d] No waiting events found dispatching network-vif-plugged-56615a48-49c1-42dd-8326-5806056ea7cf {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:04:46 user nova-compute[71874]: WARNING nova.compute.manager [req-c77b747a-ee85-42a9-8912-a90bd7252404 req-fbc8719d-c83b-4df6-addd-d4bd11b1a76e service nova] [instance: 2285eef6-6613-4802-a988-3fae065fa92d] Received unexpected event network-vif-plugged-56615a48-49c1-42dd-8326-5806056ea7cf for instance with vm_state deleted and task_state None.
Apr 12 16:04:46 user nova-compute[71874]: DEBUG nova.compute.manager [req-c77b747a-ee85-42a9-8912-a90bd7252404 req-fbc8719d-c83b-4df6-addd-d4bd11b1a76e service nova] [instance: cb8fd1e4-401b-4f73-a789-b7183f9003fb] Received event network-changed-7a9fa84a-39d3-4580-b205-6a75686ba943 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:04:46 user nova-compute[71874]: DEBUG nova.compute.manager [req-c77b747a-ee85-42a9-8912-a90bd7252404 req-fbc8719d-c83b-4df6-addd-d4bd11b1a76e service nova] [instance: cb8fd1e4-401b-4f73-a789-b7183f9003fb] Refreshing instance network info cache due to event network-changed-7a9fa84a-39d3-4580-b205-6a75686ba943. {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 16:04:46 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-c77b747a-ee85-42a9-8912-a90bd7252404 req-fbc8719d-c83b-4df6-addd-d4bd11b1a76e service nova] Acquiring lock "refresh_cache-cb8fd1e4-401b-4f73-a789-b7183f9003fb" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:04:46 user nova-compute[71874]: DEBUG nova.network.neutron [None req-21d46542-2116-466e-ac17-9d59ade099db tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] [instance: cb8fd1e4-401b-4f73-a789-b7183f9003fb] Updating instance_info_cache with network_info: [{"id": "7a9fa84a-39d3-4580-b205-6a75686ba943", "address": "fa:16:3e:f6:7d:a4", "network": {"id": "cc06c7b9-be5a-4a83-b96b-ecc971b74bde", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "61a4936d9b7744c0b488d81c9b7746b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a9fa84a-39", "ovs_interfaceid": "7a9fa84a-39d3-4580-b205-6a75686ba943", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:04:46 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-21d46542-2116-466e-ac17-9d59ade099db tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] Releasing lock "refresh_cache-cb8fd1e4-401b-4f73-a789-b7183f9003fb" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:04:46 user nova-compute[71874]: DEBUG nova.compute.manager [None req-21d46542-2116-466e-ac17-9d59ade099db tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] [instance: cb8fd1e4-401b-4f73-a789-b7183f9003fb] Instance network_info: |[{"id": "7a9fa84a-39d3-4580-b205-6a75686ba943", "address": "fa:16:3e:f6:7d:a4", "network": {"id": "cc06c7b9-be5a-4a83-b96b-ecc971b74bde", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "61a4936d9b7744c0b488d81c9b7746b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a9fa84a-39", "ovs_interfaceid": "7a9fa84a-39d3-4580-b205-6a75686ba943", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 16:04:46 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-c77b747a-ee85-42a9-8912-a90bd7252404 req-fbc8719d-c83b-4df6-addd-d4bd11b1a76e service nova] Acquired lock "refresh_cache-cb8fd1e4-401b-4f73-a789-b7183f9003fb" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:04:46 user nova-compute[71874]: DEBUG nova.network.neutron [req-c77b747a-ee85-42a9-8912-a90bd7252404 req-fbc8719d-c83b-4df6-addd-d4bd11b1a76e service nova] [instance: cb8fd1e4-401b-4f73-a789-b7183f9003fb] Refreshing network info cache for port 7a9fa84a-39d3-4580-b205-6a75686ba943 {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 16:04:46 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-21d46542-2116-466e-ac17-9d59ade099db tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] [instance: cb8fd1e4-401b-4f73-a789-b7183f9003fb] Start _get_guest_xml network_info=[{"id": "7a9fa84a-39d3-4580-b205-6a75686ba943", "address": "fa:16:3e:f6:7d:a4", "network": {"id": "cc06c7b9-be5a-4a83-b96b-ecc971b74bde", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "61a4936d9b7744c0b488d81c9b7746b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a9fa84a-39", "ovs_interfaceid": "7a9fa84a-39d3-4580-b205-6a75686ba943", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T15:55:37Z,direct_url=<?>,disk_format='qcow2',id=9dc63f14-8b70-4e72-89f2-13464f2f5c7c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='61a4936d9b7744c0b488d81c9b7746b6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T15:55:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_options': None, 'image_id': '9dc63f14-8b70-4e72-89f2-13464f2f5c7c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 16:04:46 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-21d46542-2116-466e-ac17-9d59ade099db tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:04:46 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-21d46542-2116-466e-ac17-9d59ade099db tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:04:46 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-21d46542-2116-466e-ac17-9d59ade099db tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71874) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 16:04:46 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-21d46542-2116-466e-ac17-9d59ade099db tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T15:56:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T15:55:37Z,direct_url=<?>,disk_format='qcow2',id=9dc63f14-8b70-4e72-89f2-13464f2f5c7c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='61a4936d9b7744c0b488d81c9b7746b6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T15:55:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 16:04:46 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-21d46542-2116-466e-ac17-9d59ade099db tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] Flavor limits 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 16:04:46 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-21d46542-2116-466e-ac17-9d59ade099db tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] Image limits 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 16:04:46 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-21d46542-2116-466e-ac17-9d59ade099db tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] Flavor pref 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 16:04:46 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-21d46542-2116-466e-ac17-9d59ade099db tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] Image pref 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 16:04:46 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-21d46542-2116-466e-ac17-9d59ade099db tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 16:04:46 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-21d46542-2116-466e-ac17-9d59ade099db tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 16:04:46 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-21d46542-2116-466e-ac17-9d59ade099db tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 16:04:46 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-21d46542-2116-466e-ac17-9d59ade099db tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] Got 1 possible topologies {{(pid=71874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 16:04:46 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-21d46542-2116-466e-ac17-9d59ade099db tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 16:04:46 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-21d46542-2116-466e-ac17-9d59ade099db tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 16:04:46 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-21d46542-2116-466e-ac17-9d59ade099db tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T16:04:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1370025872',display_name='tempest-VolumesNegativeTest-instance-1370025872',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1370025872',id=20,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1b99813570054c54ada10220d1fe69ae',ramdisk_id='',reservation_id='r-7fomv020',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-877189983',owner_user_name='tempest-VolumesNegativeTest-877189983-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T16:04:44Z,user_data=None,user_id='4e119bed0d354349b36bc6cf426e4929',uuid=cb8fd1e4-401b-4f73-a789-b7183f9003fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7a9fa84a-39d3-4580-b205-6a75686ba943", "address": "fa:16:3e:f6:7d:a4", "network": {"id": "cc06c7b9-be5a-4a83-b96b-ecc971b74bde", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "61a4936d9b7744c0b488d81c9b7746b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a9fa84a-39", "ovs_interfaceid": "7a9fa84a-39d3-4580-b205-6a75686ba943", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 16:04:46 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-21d46542-2116-466e-ac17-9d59ade099db tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] Converting VIF {"id": "7a9fa84a-39d3-4580-b205-6a75686ba943", "address": "fa:16:3e:f6:7d:a4", "network": {"id": "cc06c7b9-be5a-4a83-b96b-ecc971b74bde", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "61a4936d9b7744c0b488d81c9b7746b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a9fa84a-39", "ovs_interfaceid": "7a9fa84a-39d3-4580-b205-6a75686ba943", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:04:46 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-21d46542-2116-466e-ac17-9d59ade099db tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:7d:a4,bridge_name='br-int',has_traffic_filtering=True,id=7a9fa84a-39d3-4580-b205-6a75686ba943,network=Network(cc06c7b9-be5a-4a83-b96b-ecc971b74bde),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a9fa84a-39') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:04:46 user nova-compute[71874]: DEBUG nova.objects.instance [None req-21d46542-2116-466e-ac17-9d59ade099db tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] Lazy-loading 'pci_devices' on Instance uuid cb8fd1e4-401b-4f73-a789-b7183f9003fb {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:04:46 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-21d46542-2116-466e-ac17-9d59ade099db tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] [instance: cb8fd1e4-401b-4f73-a789-b7183f9003fb] End _get_guest_xml xml=<domain type="kvm">
Apr 12 16:04:46 user nova-compute[71874]:   <uuid>cb8fd1e4-401b-4f73-a789-b7183f9003fb</uuid>
Apr 12 16:04:46 user nova-compute[71874]:   <name>instance-00000014</name>
Apr 12 16:04:46 user nova-compute[71874]:   <memory>131072</memory>
Apr 12 16:04:46 user nova-compute[71874]:   <vcpu>1</vcpu>
Apr 12 16:04:46 user nova-compute[71874]:   <metadata>
Apr 12 16:04:46 user nova-compute[71874]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 16:04:46 user nova-compute[71874]:       <nova:package version="0.0.0"/>
Apr 12 16:04:46 user nova-compute[71874]:       <nova:name>tempest-VolumesNegativeTest-instance-1370025872</nova:name>
Apr 12 16:04:46 user nova-compute[71874]:       <nova:creationTime>2023-04-12 16:04:46</nova:creationTime>
Apr 12 16:04:46 user nova-compute[71874]:       <nova:flavor name="m1.nano">
Apr 12 16:04:46 user nova-compute[71874]:         <nova:memory>128</nova:memory>
Apr 12 16:04:46 user nova-compute[71874]:         <nova:disk>1</nova:disk>
Apr 12 16:04:46 user nova-compute[71874]:         <nova:swap>0</nova:swap>
Apr 12 16:04:46 user nova-compute[71874]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 16:04:46 user nova-compute[71874]:         <nova:vcpus>1</nova:vcpus>
Apr 12 16:04:46 user nova-compute[71874]:       </nova:flavor>
Apr 12 16:04:46 user nova-compute[71874]:       <nova:owner>
Apr 12 16:04:46 user nova-compute[71874]:         <nova:user uuid="4e119bed0d354349b36bc6cf426e4929">tempest-VolumesNegativeTest-877189983-project-member</nova:user>
Apr 12 16:04:46 user nova-compute[71874]:         <nova:project uuid="1b99813570054c54ada10220d1fe69ae">tempest-VolumesNegativeTest-877189983</nova:project>
Apr 12 16:04:46 user nova-compute[71874]:       </nova:owner>
Apr 12 16:04:46 user nova-compute[71874]:       <nova:root type="image" uuid="9dc63f14-8b70-4e72-89f2-13464f2f5c7c"/>
Apr 12 16:04:46 user nova-compute[71874]:       <nova:ports>
Apr 12 16:04:46 user nova-compute[71874]:         <nova:port uuid="7a9fa84a-39d3-4580-b205-6a75686ba943">
Apr 12 16:04:46 user nova-compute[71874]:           <nova:ip type="fixed" address="192.168.233.28" ipVersion="4"/>
Apr 12 16:04:46 user nova-compute[71874]:         </nova:port>
Apr 12 16:04:46 user nova-compute[71874]:       </nova:ports>
Apr 12 16:04:46 user nova-compute[71874]:     </nova:instance>
Apr 12 16:04:46 user nova-compute[71874]:   </metadata>
Apr 12 16:04:46 user nova-compute[71874]:   <sysinfo type="smbios">
Apr 12 16:04:46 user nova-compute[71874]:     <system>
Apr 12 16:04:46 user nova-compute[71874]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 16:04:46 user nova-compute[71874]:       <entry name="product">OpenStack Nova</entry>
Apr 12 16:04:46 user nova-compute[71874]:       <entry name="version">0.0.0</entry>
Apr 12 16:04:46 user nova-compute[71874]:       <entry name="serial">cb8fd1e4-401b-4f73-a789-b7183f9003fb</entry>
Apr 12 16:04:46 user nova-compute[71874]:       <entry name="uuid">cb8fd1e4-401b-4f73-a789-b7183f9003fb</entry>
Apr 12 16:04:46 user nova-compute[71874]:       <entry name="family">Virtual Machine</entry>
Apr 12 16:04:46 user nova-compute[71874]:     </system>
Apr 12 16:04:46 user nova-compute[71874]:   </sysinfo>
Apr 12 16:04:46 user nova-compute[71874]:   <os>
Apr 12 16:04:46 user nova-compute[71874]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 16:04:46 user nova-compute[71874]:     <boot dev="hd"/>
Apr 12 16:04:46 user nova-compute[71874]:     <smbios mode="sysinfo"/>
Apr 12 16:04:46 user nova-compute[71874]:   </os>
Apr 12 16:04:46 user nova-compute[71874]:   <features>
Apr 12 16:04:46 user nova-compute[71874]:     <acpi/>
Apr 12 16:04:46 user nova-compute[71874]:     <apic/>
Apr 12 16:04:46 user nova-compute[71874]:     <vmcoreinfo/>
Apr 12 16:04:46 user nova-compute[71874]:   </features>
Apr 12 16:04:46 user nova-compute[71874]:   <clock offset="utc">
Apr 12 16:04:46 user nova-compute[71874]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 16:04:46 user nova-compute[71874]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 16:04:46 user nova-compute[71874]:     <timer name="hpet" present="no"/>
Apr 12 16:04:46 user nova-compute[71874]:   </clock>
Apr 12 16:04:46 user nova-compute[71874]:   <cpu mode="custom" match="exact">
Apr 12 16:04:46 user nova-compute[71874]:     <model>Nehalem</model>
Apr 12 16:04:46 user nova-compute[71874]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 16:04:46 user nova-compute[71874]:   </cpu>
Apr 12 16:04:46 user nova-compute[71874]:   <devices>
Apr 12 16:04:46 user nova-compute[71874]:     <disk type="file" device="disk">
Apr 12 16:04:46 user nova-compute[71874]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 16:04:46 user nova-compute[71874]:       <source file="/opt/stack/data/nova/instances/cb8fd1e4-401b-4f73-a789-b7183f9003fb/disk"/>
Apr 12 16:04:46 user nova-compute[71874]:       <target dev="vda" bus="virtio"/>
Apr 12 16:04:46 user nova-compute[71874]:     </disk>
Apr 12 16:04:46 user nova-compute[71874]:     <interface type="ethernet">
Apr 12 16:04:46 user nova-compute[71874]:       <mac address="fa:16:3e:f6:7d:a4"/>
Apr 12 16:04:46 user nova-compute[71874]:       <model type="virtio"/>
Apr 12 16:04:46 user nova-compute[71874]:       <mtu size="1442"/>
Apr 12 16:04:46 user nova-compute[71874]:       <target dev="tap7a9fa84a-39"/>
Apr 12 16:04:46 user nova-compute[71874]:     </interface>
Apr 12 16:04:46 user nova-compute[71874]:     <serial type="pty">
Apr 12 16:04:46 user nova-compute[71874]:       <log file="/opt/stack/data/nova/instances/cb8fd1e4-401b-4f73-a789-b7183f9003fb/console.log" append="off"/>
Apr 12 16:04:46 user nova-compute[71874]:     </serial>
Apr 12 16:04:46 user nova-compute[71874]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 16:04:46 user nova-compute[71874]:     <video>
Apr 12 16:04:46 user nova-compute[71874]:       <model type="virtio"/>
Apr 12 16:04:46 user nova-compute[71874]:     </video>
Apr 12 16:04:46 user nova-compute[71874]:     <rng model="virtio">
Apr 12 16:04:46 user nova-compute[71874]:       <backend model="random">/dev/urandom</backend>
Apr 12 16:04:46 user nova-compute[71874]:     </rng>
Apr 12 16:04:46 user nova-compute[71874]:     <controller type="usb" index="0" model="none"/>
Apr 12 16:04:46 user nova-compute[71874]:     <memballoon model="virtio">
Apr 12 16:04:46 user nova-compute[71874]:       <stats period="10"/>
Apr 12 16:04:46 user nova-compute[71874]:     </memballoon>
Apr 12 16:04:46 user nova-compute[71874]:   </devices>
Apr 12 16:04:46 user nova-compute[71874]: </domain>
Apr 12 16:04:46 user nova-compute[71874]:  {{(pid=71874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 16:04:46 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-21d46542-2116-466e-ac17-9d59ade099db tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T16:04:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1370025872',display_name='tempest-VolumesNegativeTest-instance-1370025872',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1370025872',id=20,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1b99813570054c54ada10220d1fe69ae',ramdisk_id='',reservation_id='r-7fomv020',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-877189983',owner_user_name='tempest-VolumesNegativeTest-877189983-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T16:04:44Z,user_data=None,user_id='4e119bed0d354349b36bc6cf426e4929',uuid=cb8fd1e4-401b-4f73-a789-b7183f9003fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7a9fa84a-39d3-4580-b205-6a75686ba943", "address": "fa:16:3e:f6:7d:a4", "network": {"id": "cc06c7b9-be5a-4a83-b96b-ecc971b74bde", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "61a4936d9b7744c0b488d81c9b7746b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a9fa84a-39", "ovs_interfaceid": "7a9fa84a-39d3-4580-b205-6a75686ba943", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 16:04:46 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-21d46542-2116-466e-ac17-9d59ade099db tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] Converting VIF {"id": "7a9fa84a-39d3-4580-b205-6a75686ba943", "address": "fa:16:3e:f6:7d:a4", "network": {"id": "cc06c7b9-be5a-4a83-b96b-ecc971b74bde", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "61a4936d9b7744c0b488d81c9b7746b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a9fa84a-39", "ovs_interfaceid": "7a9fa84a-39d3-4580-b205-6a75686ba943", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:04:46 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-21d46542-2116-466e-ac17-9d59ade099db tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:7d:a4,bridge_name='br-int',has_traffic_filtering=True,id=7a9fa84a-39d3-4580-b205-6a75686ba943,network=Network(cc06c7b9-be5a-4a83-b96b-ecc971b74bde),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a9fa84a-39') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:04:46 user nova-compute[71874]: DEBUG os_vif [None req-21d46542-2116-466e-ac17-9d59ade099db tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:7d:a4,bridge_name='br-int',has_traffic_filtering=True,id=7a9fa84a-39d3-4580-b205-6a75686ba943,network=Network(cc06c7b9-be5a-4a83-b96b-ecc971b74bde),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a9fa84a-39') {{(pid=71874) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 16:04:46 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:04:46 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:04:46 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 16:04:46 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:04:46 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7a9fa84a-39, may_exist=True) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:04:46 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7a9fa84a-39, col_values=(('external_ids', {'iface-id': '7a9fa84a-39d3-4580-b205-6a75686ba943', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f6:7d:a4', 'vm-uuid': 'cb8fd1e4-401b-4f73-a789-b7183f9003fb'}),)) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:04:46 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:04:46 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:04:46 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:04:46 user nova-compute[71874]: INFO os_vif [None req-21d46542-2116-466e-ac17-9d59ade099db tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:7d:a4,bridge_name='br-int',has_traffic_filtering=True,id=7a9fa84a-39d3-4580-b205-6a75686ba943,network=Network(cc06c7b9-be5a-4a83-b96b-ecc971b74bde),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a9fa84a-39')
Apr 12 16:04:46 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-21d46542-2116-466e-ac17-9d59ade099db tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] No BDM found with device name vda, not building metadata. {{(pid=71874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 16:04:46 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-21d46542-2116-466e-ac17-9d59ade099db tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] No VIF found with MAC fa:16:3e:f6:7d:a4, not building metadata {{(pid=71874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 16:04:47 user nova-compute[71874]: DEBUG nova.network.neutron [req-c77b747a-ee85-42a9-8912-a90bd7252404 req-fbc8719d-c83b-4df6-addd-d4bd11b1a76e service nova] [instance: cb8fd1e4-401b-4f73-a789-b7183f9003fb] Updated VIF entry in instance network info cache for port 7a9fa84a-39d3-4580-b205-6a75686ba943. {{(pid=71874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 16:04:47 user nova-compute[71874]: DEBUG nova.network.neutron [req-c77b747a-ee85-42a9-8912-a90bd7252404 req-fbc8719d-c83b-4df6-addd-d4bd11b1a76e service nova] [instance: cb8fd1e4-401b-4f73-a789-b7183f9003fb] Updating instance_info_cache with network_info: [{"id": "7a9fa84a-39d3-4580-b205-6a75686ba943", "address": "fa:16:3e:f6:7d:a4", "network": {"id": "cc06c7b9-be5a-4a83-b96b-ecc971b74bde", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "61a4936d9b7744c0b488d81c9b7746b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a9fa84a-39", "ovs_interfaceid": "7a9fa84a-39d3-4580-b205-6a75686ba943", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:04:47 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-c77b747a-ee85-42a9-8912-a90bd7252404 req-fbc8719d-c83b-4df6-addd-d4bd11b1a76e service nova] Releasing lock "refresh_cache-cb8fd1e4-401b-4f73-a789-b7183f9003fb" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:04:47 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:04:47 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:04:48 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:04:48 user nova-compute[71874]: DEBUG nova.compute.manager [req-90c8362f-b0a3-4656-b9f5-c185a6793fc6 req-e6f229ee-1b2f-47cb-8d95-787d66d7664e service nova] [instance: cb8fd1e4-401b-4f73-a789-b7183f9003fb] Received event network-vif-plugged-7a9fa84a-39d3-4580-b205-6a75686ba943 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:04:48 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-90c8362f-b0a3-4656-b9f5-c185a6793fc6 req-e6f229ee-1b2f-47cb-8d95-787d66d7664e service nova] Acquiring lock "cb8fd1e4-401b-4f73-a789-b7183f9003fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:04:48 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-90c8362f-b0a3-4656-b9f5-c185a6793fc6 req-e6f229ee-1b2f-47cb-8d95-787d66d7664e service nova] Lock "cb8fd1e4-401b-4f73-a789-b7183f9003fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:04:48 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-90c8362f-b0a3-4656-b9f5-c185a6793fc6 req-e6f229ee-1b2f-47cb-8d95-787d66d7664e service nova] Lock "cb8fd1e4-401b-4f73-a789-b7183f9003fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:04:48 user nova-compute[71874]: DEBUG nova.compute.manager [req-90c8362f-b0a3-4656-b9f5-c185a6793fc6 req-e6f229ee-1b2f-47cb-8d95-787d66d7664e service nova] [instance: cb8fd1e4-401b-4f73-a789-b7183f9003fb] No waiting events found dispatching network-vif-plugged-7a9fa84a-39d3-4580-b205-6a75686ba943 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:04:48 user nova-compute[71874]: WARNING nova.compute.manager [req-90c8362f-b0a3-4656-b9f5-c185a6793fc6 req-e6f229ee-1b2f-47cb-8d95-787d66d7664e service nova] [instance: cb8fd1e4-401b-4f73-a789-b7183f9003fb] Received unexpected event network-vif-plugged-7a9fa84a-39d3-4580-b205-6a75686ba943 for instance with vm_state building and task_state spawning.
Apr 12 16:04:48 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:04:48 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:04:48 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:04:49 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:04:50 user nova-compute[71874]: DEBUG nova.compute.manager [req-8ff1136a-6740-4a85-ac18-80481e76781e req-bf77d90f-d9de-48f6-9a0e-4774a0efb641 service nova] [instance: cb8fd1e4-401b-4f73-a789-b7183f9003fb] Received event network-vif-plugged-7a9fa84a-39d3-4580-b205-6a75686ba943 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:04:50 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-8ff1136a-6740-4a85-ac18-80481e76781e req-bf77d90f-d9de-48f6-9a0e-4774a0efb641 service nova] Acquiring lock "cb8fd1e4-401b-4f73-a789-b7183f9003fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:04:50 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-8ff1136a-6740-4a85-ac18-80481e76781e req-bf77d90f-d9de-48f6-9a0e-4774a0efb641 service nova] Lock "cb8fd1e4-401b-4f73-a789-b7183f9003fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:04:50 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-8ff1136a-6740-4a85-ac18-80481e76781e req-bf77d90f-d9de-48f6-9a0e-4774a0efb641 service nova] Lock "cb8fd1e4-401b-4f73-a789-b7183f9003fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:04:50 user nova-compute[71874]: DEBUG nova.compute.manager [req-8ff1136a-6740-4a85-ac18-80481e76781e req-bf77d90f-d9de-48f6-9a0e-4774a0efb641 service nova] [instance: cb8fd1e4-401b-4f73-a789-b7183f9003fb] No waiting events found dispatching network-vif-plugged-7a9fa84a-39d3-4580-b205-6a75686ba943 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:04:50 user nova-compute[71874]: WARNING nova.compute.manager [req-8ff1136a-6740-4a85-ac18-80481e76781e req-bf77d90f-d9de-48f6-9a0e-4774a0efb641 service nova] [instance: cb8fd1e4-401b-4f73-a789-b7183f9003fb] Received unexpected event network-vif-plugged-7a9fa84a-39d3-4580-b205-6a75686ba943 for instance with vm_state building and task_state spawning.
Apr 12 16:04:50 user nova-compute[71874]: DEBUG nova.virt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Emitting event <LifecycleEvent: 1681315490.6291792, cb8fd1e4-401b-4f73-a789-b7183f9003fb => Resumed> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:04:50 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: cb8fd1e4-401b-4f73-a789-b7183f9003fb] VM Resumed (Lifecycle Event)
Apr 12 16:04:50 user nova-compute[71874]: DEBUG nova.compute.manager [None req-21d46542-2116-466e-ac17-9d59ade099db tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] [instance: cb8fd1e4-401b-4f73-a789-b7183f9003fb] Instance event wait completed in 0 seconds for  {{(pid=71874) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 16:04:50 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-21d46542-2116-466e-ac17-9d59ade099db tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] [instance: cb8fd1e4-401b-4f73-a789-b7183f9003fb] Guest created on hypervisor {{(pid=71874) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 16:04:50 user nova-compute[71874]: INFO nova.virt.libvirt.driver [-] [instance: cb8fd1e4-401b-4f73-a789-b7183f9003fb] Instance spawned successfully.
Apr 12 16:04:50 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-21d46542-2116-466e-ac17-9d59ade099db tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] [instance: cb8fd1e4-401b-4f73-a789-b7183f9003fb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 16:04:50 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: cb8fd1e4-401b-4f73-a789-b7183f9003fb] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:04:50 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: cb8fd1e4-401b-4f73-a789-b7183f9003fb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 16:04:50 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-21d46542-2116-466e-ac17-9d59ade099db tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] [instance: cb8fd1e4-401b-4f73-a789-b7183f9003fb] Found default for hw_cdrom_bus of ide {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:04:50 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-21d46542-2116-466e-ac17-9d59ade099db tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] [instance: cb8fd1e4-401b-4f73-a789-b7183f9003fb] Found default for hw_disk_bus of virtio {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:04:50 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-21d46542-2116-466e-ac17-9d59ade099db tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] [instance: cb8fd1e4-401b-4f73-a789-b7183f9003fb] Found default for hw_input_bus of None {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:04:50 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-21d46542-2116-466e-ac17-9d59ade099db tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] [instance: cb8fd1e4-401b-4f73-a789-b7183f9003fb] Found default for hw_pointer_model of None {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:04:50 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-21d46542-2116-466e-ac17-9d59ade099db tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] [instance: cb8fd1e4-401b-4f73-a789-b7183f9003fb] Found default for hw_video_model of virtio {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:04:50 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-21d46542-2116-466e-ac17-9d59ade099db tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] [instance: cb8fd1e4-401b-4f73-a789-b7183f9003fb] Found default for hw_vif_model of virtio {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:04:50 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: cb8fd1e4-401b-4f73-a789-b7183f9003fb] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 16:04:50 user nova-compute[71874]: DEBUG nova.virt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Emitting event <LifecycleEvent: 1681315490.630698, cb8fd1e4-401b-4f73-a789-b7183f9003fb => Started> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:04:50 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: cb8fd1e4-401b-4f73-a789-b7183f9003fb] VM Started (Lifecycle Event)
Apr 12 16:04:50 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: cb8fd1e4-401b-4f73-a789-b7183f9003fb] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:04:50 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: cb8fd1e4-401b-4f73-a789-b7183f9003fb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 16:04:50 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: cb8fd1e4-401b-4f73-a789-b7183f9003fb] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 16:04:50 user nova-compute[71874]: INFO nova.compute.manager [None req-21d46542-2116-466e-ac17-9d59ade099db tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] [instance: cb8fd1e4-401b-4f73-a789-b7183f9003fb] Took 6.20 seconds to spawn the instance on the hypervisor.
Apr 12 16:04:50 user nova-compute[71874]: DEBUG nova.compute.manager [None req-21d46542-2116-466e-ac17-9d59ade099db tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] [instance: cb8fd1e4-401b-4f73-a789-b7183f9003fb] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:04:50 user nova-compute[71874]: INFO nova.compute.manager [None req-21d46542-2116-466e-ac17-9d59ade099db tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] [instance: cb8fd1e4-401b-4f73-a789-b7183f9003fb] Took 7.09 seconds to build instance.
Apr 12 16:04:50 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-21d46542-2116-466e-ac17-9d59ade099db tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] Lock "cb8fd1e4-401b-4f73-a789-b7183f9003fb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.198s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:04:51 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:04:52 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:04:56 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:04:57 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:04:59 user nova-compute[71874]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681315484.635287, 2285eef6-6613-4802-a988-3fae065fa92d => Stopped> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:04:59 user nova-compute[71874]: INFO nova.compute.manager [-] [instance: 2285eef6-6613-4802-a988-3fae065fa92d] VM Stopped (Lifecycle Event)
Apr 12 16:04:59 user nova-compute[71874]: DEBUG nova.compute.manager [None req-481506ba-da35-4508-b560-5f28e1f2a603 None None] [instance: 2285eef6-6613-4802-a988-3fae065fa92d] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:05:01 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:05:02 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:05:06 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:05:07 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:05:09 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-558f79b8-29fc-4842-9e9b-3228d5eff766 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Acquiring lock "fc19fd8d-3285-4ceb-8714-a0ba139f3045" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:05:09 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-558f79b8-29fc-4842-9e9b-3228d5eff766 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "fc19fd8d-3285-4ceb-8714-a0ba139f3045" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:05:09 user nova-compute[71874]: INFO nova.compute.manager [None req-558f79b8-29fc-4842-9e9b-3228d5eff766 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] Detaching volume cfd27585-75c7-4a04-a93a-79e4236a36f7
Apr 12 16:05:09 user nova-compute[71874]: INFO nova.virt.block_device [None req-558f79b8-29fc-4842-9e9b-3228d5eff766 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] Attempting to driver detach volume cfd27585-75c7-4a04-a93a-79e4236a36f7 from mountpoint /dev/vdc
Apr 12 16:05:09 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-558f79b8-29fc-4842-9e9b-3228d5eff766 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Attempting to detach device vdc from instance fc19fd8d-3285-4ceb-8714-a0ba139f3045 from the persistent domain config. {{(pid=71874) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 16:05:09 user nova-compute[71874]: DEBUG nova.virt.libvirt.guest [None req-558f79b8-29fc-4842-9e9b-3228d5eff766 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 16:05:09 user nova-compute[71874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 16:05:09 user nova-compute[71874]:   <source dev="/dev/sdd"/>
Apr 12 16:05:09 user nova-compute[71874]:   <target dev="vdc" bus="virtio"/>
Apr 12 16:05:09 user nova-compute[71874]:   <serial>cfd27585-75c7-4a04-a93a-79e4236a36f7</serial>
Apr 12 16:05:09 user nova-compute[71874]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 12 16:05:09 user nova-compute[71874]: </disk>
Apr 12 16:05:09 user nova-compute[71874]:  {{(pid=71874) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 16:05:09 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-558f79b8-29fc-4842-9e9b-3228d5eff766 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Successfully detached device vdc from instance fc19fd8d-3285-4ceb-8714-a0ba139f3045 from the persistent domain config.
Apr 12 16:05:09 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-558f79b8-29fc-4842-9e9b-3228d5eff766 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance fc19fd8d-3285-4ceb-8714-a0ba139f3045 from the live domain config. {{(pid=71874) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 16:05:09 user nova-compute[71874]: DEBUG nova.virt.libvirt.guest [None req-558f79b8-29fc-4842-9e9b-3228d5eff766 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 16:05:09 user nova-compute[71874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 16:05:09 user nova-compute[71874]:   <source dev="/dev/sdd"/>
Apr 12 16:05:09 user nova-compute[71874]:   <target dev="vdc" bus="virtio"/>
Apr 12 16:05:09 user nova-compute[71874]:   <serial>cfd27585-75c7-4a04-a93a-79e4236a36f7</serial>
Apr 12 16:05:09 user nova-compute[71874]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 12 16:05:09 user nova-compute[71874]: </disk>
Apr 12 16:05:09 user nova-compute[71874]:  {{(pid=71874) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 16:05:09 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Received event <DeviceRemovedEvent: 1681315509.7117872, fc19fd8d-3285-4ceb-8714-a0ba139f3045 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=71874) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 16:05:09 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-558f79b8-29fc-4842-9e9b-3228d5eff766 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance fc19fd8d-3285-4ceb-8714-a0ba139f3045 {{(pid=71874) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 16:05:09 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-558f79b8-29fc-4842-9e9b-3228d5eff766 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Successfully detached device vdc from instance fc19fd8d-3285-4ceb-8714-a0ba139f3045 from the live domain config.
Apr 12 16:05:09 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-558f79b8-29fc-4842-9e9b-3228d5eff766 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] calling os-brick to detach iSCSI Volume {{(pid=71874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 16:05:09 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-558f79b8-29fc-4842-9e9b-3228d5eff766 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3c0216320>, {'target_iqn': 'iqn.2010-10.org.openstack:cfd27585-75c7-4a04-a93a-79e4236a36f7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hWavuZEb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:05:09 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-558f79b8-29fc-4842-9e9b-3228d5eff766 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:05:09 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-558f79b8-29fc-4842-9e9b-3228d5eff766 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:05:09 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-558f79b8-29fc-4842-9e9b-3228d5eff766 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:05:09 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:05:09 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:05:09 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[58c4cc0d-5d4f-4ac6-b206-5e592a133272]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cfd27585-75c7-4a04-a93a-79e4236a36f7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b09d128a-0198-4cfc-942f-323bd2f41d53\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:05:09 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-558f79b8-29fc-4842-9e9b-3228d5eff766 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 16:05:09 user nova-compute[71874]: No targets found.
Apr 12 16:05:09 user nova-compute[71874]: iSNS:
Apr 12 16:05:09 user nova-compute[71874]: No targets found.
Apr 12 16:05:09 user nova-compute[71874]: STATIC:
Apr 12 16:05:09 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:cfd27585-75c7-4a04-a93a-79e4236a36f7
Apr 12 16:05:09 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:05:09 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:05:09 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2
Apr 12 16:05:09 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:05:09 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:05:09 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:b09d128a-0198-4cfc-942f-323bd2f41d53
Apr 12 16:05:09 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:05:09 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:05:09 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2
Apr 12 16:05:09 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:05:09 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:05:09 user nova-compute[71874]: FIRMWARE:
Apr 12 16:05:09 user nova-compute[71874]: No targets found.
Apr 12 16:05:09 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:05:09 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-558f79b8-29fc-4842-9e9b-3228d5eff766 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 16:05:09 user nova-compute[71874]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 16:05:09 user nova-compute[71874]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71874) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 16:05:09 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-558f79b8-29fc-4842-9e9b-3228d5eff766 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cfd27585-75c7-4a04-a93a-79e4236a36f7', 0)] {{(pid=71874) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 16:05:09 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:05:09 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:05:09 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[948ee6a6-64a5-4930-8143-b31a501e2c0b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b09d128a-0198-4cfc-942f-323bd2f41d53\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cfd27585-75c7-4a04-a93a-79e4236a36f7\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:05:09 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:05:09 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:05:09 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[baf7f447-479c-4122-96e5-960632c79b44]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b09d128a-0198-4cfc-942f-323bd2f41d53 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfd27585-75c7-4a04-a93a-79e4236a36f7 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:05:09 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-558f79b8-29fc-4842-9e9b-3228d5eff766 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:05:09 user nova-compute[71874]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b09d128a-0198-4cfc-942f-323bd2f41d53 (non-flash)
Apr 12 16:05:09 user nova-compute[71874]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfd27585-75c7-4a04-a93a-79e4236a36f7 (non-flash)
Apr 12 16:05:09 user nova-compute[71874]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 (non-flash)
Apr 12 16:05:09 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:05:09 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-558f79b8-29fc-4842-9e9b-3228d5eff766 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:05:09 user nova-compute[71874]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b09d128a-0198-4cfc-942f-323bd2f41d53 (non-flash)
Apr 12 16:05:09 user nova-compute[71874]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfd27585-75c7-4a04-a93a-79e4236a36f7 (non-flash)
Apr 12 16:05:09 user nova-compute[71874]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 (non-flash)
Apr 12 16:05:09 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:05:09 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-558f79b8-29fc-4842-9e9b-3228d5eff766 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc39c201ab0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cfd27585-75c7-4a04-a93a-79e4236a36f7'): ({'sdd'}, set())}) {{(pid=71874) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 16:05:09 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-558f79b8-29fc-4842-9e9b-3228d5eff766 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Removing single pathed devices sdd {{(pid=71874) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 16:05:09 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:05:09 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:05:09 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[6548c3b3-dbf6-4a1c-8076-fdb8d736ca03]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:05:09 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:05:09 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:05:09 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[99b31018-9553-4de9-9d30-8532b1f9b08e]: (4, ('ok\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:05:09 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-558f79b8-29fc-4842-9e9b-3228d5eff766 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Flushing IO for device /dev/sdd {{(pid=71874) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 16:05:09 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:05:09 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:05:09 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb39bd74-7849-4af5-abae-5773c70c23b4]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:05:09 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-558f79b8-29fc-4842-9e9b-3228d5eff766 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71874) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 16:05:09 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:05:09 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.036s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:05:09 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3ed9b9c-f0d5-42e0-a389-437a7badfd69]: (4, ('1', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:05:09 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-558f79b8-29fc-4842-9e9b-3228d5eff766 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71874) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 16:05:09 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-558f79b8-29fc-4842-9e9b-3228d5eff766 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] SCSI volumes sdd have been removed. {{(pid=71874) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 16:05:09 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-558f79b8-29fc-4842-9e9b-3228d5eff766 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cfd27585-75c7-4a04-a93a-79e4236a36f7')] {{(pid=71874) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 16:05:09 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfd27585-75c7-4a04-a93a-79e4236a36f7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:05:09 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfd27585-75c7-4a04-a93a-79e4236a36f7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:05:09 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c571bae-34bc-4bd1-9c89-764d9a4f9ad8]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:05:09 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-558f79b8-29fc-4842-9e9b-3228d5eff766 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:05:09 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfd27585-75c7-4a04-a93a-79e4236a36f7 -p 172.16.0.220:3260 --logout {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:05:10 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfd27585-75c7-4a04-a93a-79e4236a36f7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:05:10 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6442a48-aeb9-4b16-875e-bc3046c25ca9]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:cfd27585-75c7-4a04-a93a-79e4236a36f7, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:cfd27585-75c7-4a04-a93a-79e4236a36f7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:05:10 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-558f79b8-29fc-4842-9e9b-3228d5eff766 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:cfd27585-75c7-4a04-a93a-79e4236a36f7, portal: 172.16.0.220,3260]
Apr 12 16:05:10 user nova-compute[71874]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:cfd27585-75c7-4a04-a93a-79e4236a36f7, portal: 172.16.0.220,3260] successful.
Apr 12 16:05:10 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:05:10 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfd27585-75c7-4a04-a93a-79e4236a36f7 -p 172.16.0.220:3260 --op delete {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:05:10 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfd27585-75c7-4a04-a93a-79e4236a36f7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:05:10 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[7775764e-58df-4fcb-8ec6-d81dcc1be231]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:05:10 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-558f79b8-29fc-4842-9e9b-3228d5eff766 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:05:10 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-558f79b8-29fc-4842-9e9b-3228d5eff766 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.328s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:05:10 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-558f79b8-29fc-4842-9e9b-3228d5eff766 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] <== disconnect_volume: return (329ms) None {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:05:10 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-558f79b8-29fc-4842-9e9b-3228d5eff766 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] Disconnected iSCSI Volume {{(pid=71874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 16:05:10 user nova-compute[71874]: DEBUG nova.objects.instance [None req-558f79b8-29fc-4842-9e9b-3228d5eff766 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lazy-loading 'flavor' on Instance uuid fc19fd8d-3285-4ceb-8714-a0ba139f3045 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:05:10 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-558f79b8-29fc-4842-9e9b-3228d5eff766 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "fc19fd8d-3285-4ceb-8714-a0ba139f3045" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.684s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:05:11 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:05:11 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:05:11 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Cleaning up deleted instances {{(pid=71874) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 12 16:05:11 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] There are 0 instances to clean {{(pid=71874) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 12 16:05:12 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:05:12 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:05:12 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71874) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 12 16:05:15 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:05:16 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:05:16 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:05:16 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71874) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 16:05:17 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-5c710970-b795-4631-a974-0d7c59ee599a tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "920c6512-180d-46e1-b0cf-240d34c3fc97" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:05:17 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-5c710970-b795-4631-a974-0d7c59ee599a tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "920c6512-180d-46e1-b0cf-240d34c3fc97" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:05:17 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-5c710970-b795-4631-a974-0d7c59ee599a tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "920c6512-180d-46e1-b0cf-240d34c3fc97-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:05:17 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-5c710970-b795-4631-a974-0d7c59ee599a tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "920c6512-180d-46e1-b0cf-240d34c3fc97-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:05:17 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-5c710970-b795-4631-a974-0d7c59ee599a tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "920c6512-180d-46e1-b0cf-240d34c3fc97-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:05:17 user nova-compute[71874]: INFO nova.compute.manager [None req-5c710970-b795-4631-a974-0d7c59ee599a tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: 920c6512-180d-46e1-b0cf-240d34c3fc97] Terminating instance
Apr 12 16:05:17 user nova-compute[71874]: DEBUG nova.compute.manager [None req-5c710970-b795-4631-a974-0d7c59ee599a tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: 920c6512-180d-46e1-b0cf-240d34c3fc97] Start destroying the instance on the hypervisor. {{(pid=71874) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 16:05:17 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:05:17 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:05:17 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:05:17 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:05:17 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Starting heal instance info cache {{(pid=71874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 16:05:17 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] [instance: 920c6512-180d-46e1-b0cf-240d34c3fc97] Skipping network cache update for instance because it is being deleted. {{(pid=71874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9841}}
Apr 12 16:05:17 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Didn't find any instances for network info cache update. {{(pid=71874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 12 16:05:17 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:05:17 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:05:17 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:05:17 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:05:18 user nova-compute[71874]: DEBUG nova.compute.manager [req-fe9f5bc8-7ce0-4e14-8a94-45c4735759b5 req-e13bd06e-caa9-4dfb-a95d-be42c5eb4553 service nova] [instance: 920c6512-180d-46e1-b0cf-240d34c3fc97] Received event network-vif-unplugged-f0f2f7c4-d9e5-4b71-88d0-1f66e8d7a81e {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:05:18 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-fe9f5bc8-7ce0-4e14-8a94-45c4735759b5 req-e13bd06e-caa9-4dfb-a95d-be42c5eb4553 service nova] Acquiring lock "920c6512-180d-46e1-b0cf-240d34c3fc97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:05:18 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-fe9f5bc8-7ce0-4e14-8a94-45c4735759b5 req-e13bd06e-caa9-4dfb-a95d-be42c5eb4553 service nova] Lock "920c6512-180d-46e1-b0cf-240d34c3fc97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:05:18 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-fe9f5bc8-7ce0-4e14-8a94-45c4735759b5 req-e13bd06e-caa9-4dfb-a95d-be42c5eb4553 service nova] Lock "920c6512-180d-46e1-b0cf-240d34c3fc97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:05:18 user nova-compute[71874]: DEBUG nova.compute.manager [req-fe9f5bc8-7ce0-4e14-8a94-45c4735759b5 req-e13bd06e-caa9-4dfb-a95d-be42c5eb4553 service nova] [instance: 920c6512-180d-46e1-b0cf-240d34c3fc97] No waiting events found dispatching network-vif-unplugged-f0f2f7c4-d9e5-4b71-88d0-1f66e8d7a81e {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:05:18 user nova-compute[71874]: DEBUG nova.compute.manager [req-fe9f5bc8-7ce0-4e14-8a94-45c4735759b5 req-e13bd06e-caa9-4dfb-a95d-be42c5eb4553 service nova] [instance: 920c6512-180d-46e1-b0cf-240d34c3fc97] Received event network-vif-unplugged-f0f2f7c4-d9e5-4b71-88d0-1f66e8d7a81e for instance with task_state deleting. {{(pid=71874) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 16:05:18 user nova-compute[71874]: INFO nova.virt.libvirt.driver [-] [instance: 920c6512-180d-46e1-b0cf-240d34c3fc97] Instance destroyed successfully.
Apr 12 16:05:18 user nova-compute[71874]: DEBUG nova.objects.instance [None req-5c710970-b795-4631-a974-0d7c59ee599a tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lazy-loading 'resources' on Instance uuid 920c6512-180d-46e1-b0cf-240d34c3fc97 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:05:18 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-5c710970-b795-4631-a974-0d7c59ee599a tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T15:59:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-564264734',display_name='tempest-AttachVolumeNegativeTest-server-564264734',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-564264734',id=6,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKL8mRKoQBwSpXabs7lbNBcQQ+v0lDGL36wi/OpmOmwBfUVFldN2KTVLXYYnjIUA6HtcnsAqIEqMv/Fg1gZorrfhXrwT58AUeYmBczJa1dUqudRokgSOxtQEOgjrUHlOaQ==',key_name='tempest-keypair-774364981',keypairs=<?>,launch_index=0,launched_at=2023-04-12T15:59:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='28d940eae5394293b87cfced45911ab4',ramdisk_id='',reservation_id='r-06mtljg2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-288610953',owner_user_name='tempest-AttachVolumeNegativeTest-288610953-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T15:59:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5a514f6d877a4ab0bec597fee13ce9db',uuid=920c6512-180d-46e1-b0cf-240d34c3fc97,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f0f2f7c4-d9e5-4b71-88d0-1f66e8d7a81e", "address": "fa:16:3e:5f:51:3d", "network": {"id": "e71b9966-9a95-4f66-b3b1-36b05d05853c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-310205564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28d940eae5394293b87cfced45911ab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0f2f7c4-d9", "ovs_interfaceid": "f0f2f7c4-d9e5-4b71-88d0-1f66e8d7a81e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 16:05:18 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-5c710970-b795-4631-a974-0d7c59ee599a tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Converting VIF {"id": "f0f2f7c4-d9e5-4b71-88d0-1f66e8d7a81e", "address": "fa:16:3e:5f:51:3d", "network": {"id": "e71b9966-9a95-4f66-b3b1-36b05d05853c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-310205564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28d940eae5394293b87cfced45911ab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0f2f7c4-d9", "ovs_interfaceid": "f0f2f7c4-d9e5-4b71-88d0-1f66e8d7a81e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:05:18 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-5c710970-b795-4631-a974-0d7c59ee599a tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5f:51:3d,bridge_name='br-int',has_traffic_filtering=True,id=f0f2f7c4-d9e5-4b71-88d0-1f66e8d7a81e,network=Network(e71b9966-9a95-4f66-b3b1-36b05d05853c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0f2f7c4-d9') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:05:18 user nova-compute[71874]: DEBUG os_vif [None req-5c710970-b795-4631-a974-0d7c59ee599a tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5f:51:3d,bridge_name='br-int',has_traffic_filtering=True,id=f0f2f7c4-d9e5-4b71-88d0-1f66e8d7a81e,network=Network(e71b9966-9a95-4f66-b3b1-36b05d05853c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0f2f7c4-d9') {{(pid=71874) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 16:05:18 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:05:18 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf0f2f7c4-d9, bridge=br-int, if_exists=True) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:05:18 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:05:18 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:05:18 user nova-compute[71874]: INFO os_vif [None req-5c710970-b795-4631-a974-0d7c59ee599a tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5f:51:3d,bridge_name='br-int',has_traffic_filtering=True,id=f0f2f7c4-d9e5-4b71-88d0-1f66e8d7a81e,network=Network(e71b9966-9a95-4f66-b3b1-36b05d05853c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0f2f7c4-d9')
Apr 12 16:05:18 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-5c710970-b795-4631-a974-0d7c59ee599a tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: 920c6512-180d-46e1-b0cf-240d34c3fc97] Deleting instance files /opt/stack/data/nova/instances/920c6512-180d-46e1-b0cf-240d34c3fc97_del
Apr 12 16:05:18 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-5c710970-b795-4631-a974-0d7c59ee599a tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: 920c6512-180d-46e1-b0cf-240d34c3fc97] Deletion of /opt/stack/data/nova/instances/920c6512-180d-46e1-b0cf-240d34c3fc97_del complete
Apr 12 16:05:18 user nova-compute[71874]: INFO nova.compute.manager [None req-5c710970-b795-4631-a974-0d7c59ee599a tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: 920c6512-180d-46e1-b0cf-240d34c3fc97] Took 0.87 seconds to destroy the instance on the hypervisor.
Apr 12 16:05:18 user nova-compute[71874]: DEBUG oslo.service.loopingcall [None req-5c710970-b795-4631-a974-0d7c59ee599a tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71874) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 16:05:18 user nova-compute[71874]: DEBUG nova.compute.manager [-] [instance: 920c6512-180d-46e1-b0cf-240d34c3fc97] Deallocating network for instance {{(pid=71874) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 16:05:18 user nova-compute[71874]: DEBUG nova.network.neutron [-] [instance: 920c6512-180d-46e1-b0cf-240d34c3fc97] deallocate_for_instance() {{(pid=71874) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 16:05:18 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:05:18 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:05:18 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:05:18 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:05:18 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:05:18 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Auditing locally available compute resources for user (node: user) {{(pid=71874) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 16:05:19 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc19fd8d-3285-4ceb-8714-a0ba139f3045/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:05:19 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc19fd8d-3285-4ceb-8714-a0ba139f3045/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:05:19 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc19fd8d-3285-4ceb-8714-a0ba139f3045/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:05:19 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc19fd8d-3285-4ceb-8714-a0ba139f3045/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:05:19 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:05:19 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:05:19 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:05:19 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:05:19 user nova-compute[71874]: DEBUG nova.network.neutron [-] [instance: 920c6512-180d-46e1-b0cf-240d34c3fc97] Updating instance_info_cache with network_info: [] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:05:19 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7835bdfc-77dc-4407-8a0a-ef81eca29c91/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:05:19 user nova-compute[71874]: INFO nova.compute.manager [-] [instance: 920c6512-180d-46e1-b0cf-240d34c3fc97] Took 1.26 seconds to deallocate network for instance.
Apr 12 16:05:19 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-5c710970-b795-4631-a974-0d7c59ee599a tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:05:19 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-5c710970-b795-4631-a974-0d7c59ee599a tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:05:19 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7835bdfc-77dc-4407-8a0a-ef81eca29c91/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:05:19 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7835bdfc-77dc-4407-8a0a-ef81eca29c91/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:05:19 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7835bdfc-77dc-4407-8a0a-ef81eca29c91/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:05:19 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afebffae-dbf6-4876-8c9f-0364f0fde49c/disk.rescue --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:05:20 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afebffae-dbf6-4876-8c9f-0364f0fde49c/disk.rescue --force-share --output=json" returned: 0 in 0.167s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:05:20 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afebffae-dbf6-4876-8c9f-0364f0fde49c/disk.rescue --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:05:20 user nova-compute[71874]: DEBUG nova.compute.manager [req-3bd8ea2d-ad5d-4432-86b9-03faaa463b53 req-5b33b55b-9448-407e-88bc-d73790fe11ba service nova] [instance: 920c6512-180d-46e1-b0cf-240d34c3fc97] Received event network-vif-plugged-f0f2f7c4-d9e5-4b71-88d0-1f66e8d7a81e {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:05:20 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-3bd8ea2d-ad5d-4432-86b9-03faaa463b53 req-5b33b55b-9448-407e-88bc-d73790fe11ba service nova] Acquiring lock "920c6512-180d-46e1-b0cf-240d34c3fc97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:05:20 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-3bd8ea2d-ad5d-4432-86b9-03faaa463b53 req-5b33b55b-9448-407e-88bc-d73790fe11ba service nova] Lock "920c6512-180d-46e1-b0cf-240d34c3fc97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:05:20 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-3bd8ea2d-ad5d-4432-86b9-03faaa463b53 req-5b33b55b-9448-407e-88bc-d73790fe11ba service nova] Lock "920c6512-180d-46e1-b0cf-240d34c3fc97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:05:20 user nova-compute[71874]: DEBUG nova.compute.manager [req-3bd8ea2d-ad5d-4432-86b9-03faaa463b53 req-5b33b55b-9448-407e-88bc-d73790fe11ba service nova] [instance: 920c6512-180d-46e1-b0cf-240d34c3fc97] No waiting events found dispatching network-vif-plugged-f0f2f7c4-d9e5-4b71-88d0-1f66e8d7a81e {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:05:20 user nova-compute[71874]: WARNING nova.compute.manager [req-3bd8ea2d-ad5d-4432-86b9-03faaa463b53 req-5b33b55b-9448-407e-88bc-d73790fe11ba service nova] [instance: 920c6512-180d-46e1-b0cf-240d34c3fc97] Received unexpected event network-vif-plugged-f0f2f7c4-d9e5-4b71-88d0-1f66e8d7a81e for instance with vm_state deleted and task_state None.
Apr 12 16:05:20 user nova-compute[71874]: DEBUG nova.compute.manager [req-3bd8ea2d-ad5d-4432-86b9-03faaa463b53 req-5b33b55b-9448-407e-88bc-d73790fe11ba service nova] [instance: 920c6512-180d-46e1-b0cf-240d34c3fc97] Received event network-vif-deleted-f0f2f7c4-d9e5-4b71-88d0-1f66e8d7a81e {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:05:20 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afebffae-dbf6-4876-8c9f-0364f0fde49c/disk.rescue --force-share --output=json" returned: 0 in 0.148s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:05:20 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afebffae-dbf6-4876-8c9f-0364f0fde49c/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:05:20 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afebffae-dbf6-4876-8c9f-0364f0fde49c/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:05:20 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afebffae-dbf6-4876-8c9f-0364f0fde49c/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:05:20 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-5c710970-b795-4631-a974-0d7c59ee599a tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Inventory has not changed in ProviderTree for provider: 0e94b4c8-cd49-45e4-9133-d36eb4b2456b {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 16:05:20 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-5c710970-b795-4631-a974-0d7c59ee599a tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Inventory has not changed for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 16:05:20 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afebffae-dbf6-4876-8c9f-0364f0fde49c/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:05:20 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 16:05:20 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f52ee906-c8fd-4cd5-842e-de98a5099c4f/disk.rescue --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:05:20 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-5c710970-b795-4631-a974-0d7c59ee599a tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.852s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:05:20 user nova-compute[71874]: INFO nova.scheduler.client.report [None req-5c710970-b795-4631-a974-0d7c59ee599a tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Deleted allocations for instance 920c6512-180d-46e1-b0cf-240d34c3fc97
Apr 12 16:05:20 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f52ee906-c8fd-4cd5-842e-de98a5099c4f/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:05:20 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f52ee906-c8fd-4cd5-842e-de98a5099c4f/disk.rescue --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:05:20 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-5c710970-b795-4631-a974-0d7c59ee599a tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "920c6512-180d-46e1-b0cf-240d34c3fc97" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.225s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:05:20 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f52ee906-c8fd-4cd5-842e-de98a5099c4f/disk.rescue --force-share --output=json" returned: 0 in 0.140s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:05:20 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/608fbea2-b42b-4bb9-94a7-2b76dcdc2001/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:05:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/608fbea2-b42b-4bb9-94a7-2b76dcdc2001/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:05:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/608fbea2-b42b-4bb9-94a7-2b76dcdc2001/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:05:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/608fbea2-b42b-4bb9-94a7-2b76dcdc2001/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:05:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473a30c4-5aa4-481c-8859-fda815d14872/disk.rescue --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:05:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473a30c4-5aa4-481c-8859-fda815d14872/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:05:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473a30c4-5aa4-481c-8859-fda815d14872/disk.rescue --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:05:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473a30c4-5aa4-481c-8859-fda815d14872/disk.rescue --force-share --output=json" returned: 0 in 0.134s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:05:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473a30c4-5aa4-481c-8859-fda815d14872/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:05:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473a30c4-5aa4-481c-8859-fda815d14872/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:05:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473a30c4-5aa4-481c-8859-fda815d14872/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:05:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473a30c4-5aa4-481c-8859-fda815d14872/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:05:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6caa4977-8333-4171-8825-2c3bfb52f80b/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:05:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6caa4977-8333-4171-8825-2c3bfb52f80b/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:05:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6caa4977-8333-4171-8825-2c3bfb52f80b/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:05:22 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6caa4977-8333-4171-8825-2c3bfb52f80b/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:05:22 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb8fd1e4-401b-4f73-a789-b7183f9003fb/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:05:22 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb8fd1e4-401b-4f73-a789-b7183f9003fb/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:05:22 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb8fd1e4-401b-4f73-a789-b7183f9003fb/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:05:22 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb8fd1e4-401b-4f73-a789-b7183f9003fb/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:05:22 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:05:22 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:05:22 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:05:22 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:05:22 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 16:05:22 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=71874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 16:05:23 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:05:23 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:05:23 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Hypervisor/Node resource view: name=user free_ram=7286MB free_disk=26.098739624023438GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71874) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 16:05:23 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:05:23 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:05:23 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance afebffae-dbf6-4876-8c9f-0364f0fde49c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:05:23 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 473a30c4-5aa4-481c-8859-fda815d14872 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:05:23 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 608fbea2-b42b-4bb9-94a7-2b76dcdc2001 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:05:23 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:05:23 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance f52ee906-c8fd-4cd5-842e-de98a5099c4f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:05:23 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance fc19fd8d-3285-4ceb-8714-a0ba139f3045 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:05:23 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:05:23 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 6caa4977-8333-4171-8825-2c3bfb52f80b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:05:23 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 85b91251-9735-4812-9f11-003a7951a6f3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:05:23 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 7835bdfc-77dc-4407-8a0a-ef81eca29c91 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:05:23 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance cb8fd1e4-401b-4f73-a789-b7183f9003fb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:05:23 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=71874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 16:05:23 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Final resource view: name=user phys_ram=16023MB used_ram=1920MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=71874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 16:05:23 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Refreshing inventories for resource provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b {{(pid=71874) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 12 16:05:23 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Updating ProviderTree inventory for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 12 16:05:23 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Updating inventory in ProviderTree for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 12 16:05:23 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Refreshing aggregate associations for resource provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b, aggregates: None {{(pid=71874) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 12 16:05:23 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:05:23 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Refreshing trait associations for resource provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b, traits: COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_ACCELERATORS,HW_CPU_X86_MMX,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE2,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_FDC,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE {{(pid=71874) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 12 16:05:23 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Inventory has not changed in ProviderTree for provider: 0e94b4c8-cd49-45e4-9133-d36eb4b2456b {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 16:05:23 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Inventory has not changed for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 16:05:23 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Compute_service record updated for user:user {{(pid=71874) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 16:05:23 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.590s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:05:23 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:05:24 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:05:24 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:05:24 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:05:24 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:05:27 user nova-compute[71874]: DEBUG nova.compute.manager [req-6c1e2bd4-bf74-460d-96a3-29f076c4f305 req-26a2da69-543c-443c-800d-f91162464abd service nova] [instance: ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e] Received event network-changed-20f49d80-ccad-450e-baed-417505f17cc2 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:05:27 user nova-compute[71874]: DEBUG nova.compute.manager [req-6c1e2bd4-bf74-460d-96a3-29f076c4f305 req-26a2da69-543c-443c-800d-f91162464abd service nova] [instance: ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e] Refreshing instance network info cache due to event network-changed-20f49d80-ccad-450e-baed-417505f17cc2. {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 16:05:27 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-6c1e2bd4-bf74-460d-96a3-29f076c4f305 req-26a2da69-543c-443c-800d-f91162464abd service nova] Acquiring lock "refresh_cache-ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:05:27 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-6c1e2bd4-bf74-460d-96a3-29f076c4f305 req-26a2da69-543c-443c-800d-f91162464abd service nova] Acquired lock "refresh_cache-ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:05:27 user nova-compute[71874]: DEBUG nova.network.neutron [req-6c1e2bd4-bf74-460d-96a3-29f076c4f305 req-26a2da69-543c-443c-800d-f91162464abd service nova] [instance: ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e] Refreshing network info cache for port 20f49d80-ccad-450e-baed-417505f17cc2 {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 16:05:27 user nova-compute[71874]: DEBUG nova.network.neutron [req-6c1e2bd4-bf74-460d-96a3-29f076c4f305 req-26a2da69-543c-443c-800d-f91162464abd service nova] [instance: ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e] Updated VIF entry in instance network info cache for port 20f49d80-ccad-450e-baed-417505f17cc2. {{(pid=71874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 16:05:27 user nova-compute[71874]: DEBUG nova.network.neutron [req-6c1e2bd4-bf74-460d-96a3-29f076c4f305 req-26a2da69-543c-443c-800d-f91162464abd service nova] [instance: ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e] Updating instance_info_cache with network_info: [{"id": "20f49d80-ccad-450e-baed-417505f17cc2", "address": "fa:16:3e:28:84:c8", "network": {"id": "0a97bb8e-9c19-41f1-bfcd-428e3ea3492f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-6019148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76f559719f5f43c3a47a0aaf1e699193", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20f49d80-cc", "ovs_interfaceid": "20f49d80-ccad-450e-baed-417505f17cc2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:05:27 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-6c1e2bd4-bf74-460d-96a3-29f076c4f305 req-26a2da69-543c-443c-800d-f91162464abd service nova] Releasing lock "refresh_cache-ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:05:27 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:05:28 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:05:28 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-eb35493b-6340-4d99-bc64-cededf6f6d44 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Acquiring lock "ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:05:28 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-eb35493b-6340-4d99-bc64-cededf6f6d44 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Lock "ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:05:28 user nova-compute[71874]: DEBUG nova.objects.instance [None req-eb35493b-6340-4d99-bc64-cededf6f6d44 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Lazy-loading 'flavor' on Instance uuid ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:05:28 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-eb35493b-6340-4d99-bc64-cededf6f6d44 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Lock "ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:05:28 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-eb35493b-6340-4d99-bc64-cededf6f6d44 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Acquiring lock "ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:05:28 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-eb35493b-6340-4d99-bc64-cededf6f6d44 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Lock "ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:05:28 user nova-compute[71874]: INFO nova.compute.manager [None req-eb35493b-6340-4d99-bc64-cededf6f6d44 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] [instance: ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e] Attaching volume 8a7e94ba-eba5-4550-99a9-78eda9d700df to /dev/vdb
Apr 12 16:05:29 user nova-compute[71874]: DEBUG os_brick.utils [None req-eb35493b-6340-4d99-bc64-cededf6f6d44 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:05:29 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:05:29 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:05:29 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f74a30d-a997-4ec5-89a6-f131ba8456f5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:61a48d4489d2\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:05:29 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:05:29 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:05:29 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b981589-9f65-4ba3-9a6d-9d3218eee32f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:05:29 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:05:29 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:05:29 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[f80ec7d1-0af3-4e0e-a354-73d4146b43ea]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:05:29 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[43ca3d68-3fac-4ca7-bc6b-0b576dc1a9a2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:05:29 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-eb35493b-6340-4d99-bc64-cededf6f6d44 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Running cmd (subprocess): nvme version {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:05:29 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-eb35493b-6340-4d99-bc64-cededf6f6d44 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] 'nvme version' failed. Not Retrying. {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 16:05:29 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.nvmeof [None req-eb35493b-6340-4d99-bc64-cededf6f6d44 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] nvme not present on system {{(pid=71874) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 16:05:29 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:05:29 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 16:05:29 user nova-compute[71874]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 16:05:29 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7103dbb-c07e-4c30-9cdc-099fafb477e7]: (4, '') {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:05:29 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.lightos [None req-eb35493b-6340-4d99-bc64-cededf6f6d44 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71874) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 16:05:29 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.lightos [None req-eb35493b-6340-4d99-bc64-cededf6f6d44 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71874) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 16:05:29 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.lightos [None req-eb35493b-6340-4d99-bc64-cededf6f6d44 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] LIGHTOS: no hostnqn found. {{(pid=71874) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 16:05:29 user nova-compute[71874]: DEBUG os_brick.utils [None req-eb35493b-6340-4d99-bc64-cededf6f6d44 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:61a48d4489d2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:05:29 user nova-compute[71874]: DEBUG nova.virt.block_device [None req-eb35493b-6340-4d99-bc64-cededf6f6d44 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] [instance: ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e] Updating existing volume attachment record: 8c7b8fd9-94d2-42e2-9711-c509f72e5b6c {{(pid=71874) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 16:05:32 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:05:33 user nova-compute[71874]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681315518.3424964, 920c6512-180d-46e1-b0cf-240d34c3fc97 => Stopped> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:05:33 user nova-compute[71874]: INFO nova.compute.manager [-] [instance: 920c6512-180d-46e1-b0cf-240d34c3fc97] VM Stopped (Lifecycle Event)
Apr 12 16:05:33 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb35493b-6340-4d99-bc64-cededf6f6d44 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] [instance: ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e] Calling os-brick to attach iSCSI Volume {{(pid=71874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 16:05:33 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb35493b-6340-4d99-bc64-cededf6f6d44 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3c0216320>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8a7e94ba-eba5-4550-99a9-78eda9d700df', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ldyAWEQz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:05:33 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-eb35493b-6340-4d99-bc64-cededf6f6d44 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:05:33 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-eb35493b-6340-4d99-bc64-cededf6f6d44 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:05:33 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-eb35493b-6340-4d99-bc64-cededf6f6d44 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:05:33 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-eb35493b-6340-4d99-bc64-cededf6f6d44 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:05:33 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-eb35493b-6340-4d99-bc64-cededf6f6d44 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8a7e94ba-eba5-4550-99a9-78eda9d700df" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:05:33 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-eb35493b-6340-4d99-bc64-cededf6f6d44 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8a7e94ba-eba5-4550-99a9-78eda9d700df" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:05:33 user nova-compute[71874]: INFO os_brick.initiator.connectors.iscsi [None req-eb35493b-6340-4d99-bc64-cededf6f6d44 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 16:05:33 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a7e94ba-eba5-4550-99a9-78eda9d700df -p 172.16.0.220:3260 {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:05:33 user nova-compute[71874]: DEBUG nova.compute.manager [None req-4fbc589c-0f60-4b07-ab87-288281d30573 None None] [instance: 920c6512-180d-46e1-b0cf-240d34c3fc97] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:05:33 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:05:33 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a7e94ba-eba5-4550-99a9-78eda9d700df -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:05:33 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e20c3b4-9e51-4937-843f-6c225515813e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:05:33 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb35493b-6340-4d99-bc64-cededf6f6d44 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 16:05:33 user nova-compute[71874]:  {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:05:33 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a7e94ba-eba5-4550-99a9-78eda9d700df -p 172.16.0.220:3260 --interface default --op new {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:05:33 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a7e94ba-eba5-4550-99a9-78eda9d700df -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:05:33 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb0a6805-f646-476f-874c-be766c9298bf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8a7e94ba-eba5-4550-99a9-78eda9d700df] added\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:05:33 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb35493b-6340-4d99-bc64-cededf6f6d44 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8a7e94ba-eba5-4550-99a9-78eda9d700df] added
Apr 12 16:05:33 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:05:33 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a7e94ba-eba5-4550-99a9-78eda9d700df -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:05:33 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a7e94ba-eba5-4550-99a9-78eda9d700df -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:05:33 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[3728ce48-5413-4345-8c6b-33d5067f7176]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:05:33 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb35493b-6340-4d99-bc64-cededf6f6d44 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:05:33 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a7e94ba-eba5-4550-99a9-78eda9d700df -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:05:33 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a7e94ba-eba5-4550-99a9-78eda9d700df -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:05:33 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[aff64886-422c-4ced-b0d5-0d371191379b]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:05:33 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb35493b-6340-4d99-bc64-cededf6f6d44 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:05:33 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a7e94ba-eba5-4550-99a9-78eda9d700df -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ldyAWEQz {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:05:33 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a7e94ba-eba5-4550-99a9-78eda9d700df -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ldyAWEQz" returned: 0 in 0.021s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:05:33 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e650d1a-f66a-4e71-b137-864826afd1f8]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:05:33 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb35493b-6340-4d99-bc64-cededf6f6d44 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ldyAWEQz'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:05:33 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a7e94ba-eba5-4550-99a9-78eda9d700df -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:05:33 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a7e94ba-eba5-4550-99a9-78eda9d700df -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:05:33 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[f13f74fa-0fd3-4f9a-9ef3-0ae799c330c1]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:05:33 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb35493b-6340-4d99-bc64-cededf6f6d44 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:05:33 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:05:33 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:05:33 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fc5c05c-0137-4225-b297-0877bcafeb8d]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b09d128a-0198-4cfc-942f-323bd2f41d53 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:05:33 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb35493b-6340-4d99-bc64-cededf6f6d44 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:05:33 user nova-compute[71874]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b09d128a-0198-4cfc-942f-323bd2f41d53 (non-flash)
Apr 12 16:05:33 user nova-compute[71874]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 (non-flash)
Apr 12 16:05:33 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:05:33 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb35493b-6340-4d99-bc64-cededf6f6d44 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:05:33 user nova-compute[71874]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b09d128a-0198-4cfc-942f-323bd2f41d53 (non-flash)
Apr 12 16:05:33 user nova-compute[71874]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 (non-flash)
Apr 12 16:05:33 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:05:33 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a7e94ba-eba5-4550-99a9-78eda9d700df -p 172.16.0.220:3260 --login {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:05:33 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a7e94ba-eba5-4550-99a9-78eda9d700df -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:05:33 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d032f53-9625-4496-978c-460d9e1c2170]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8a7e94ba-eba5-4550-99a9-78eda9d700df, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8a7e94ba-eba5-4550-99a9-78eda9d700df, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:05:33 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb35493b-6340-4d99-bc64-cededf6f6d44 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8a7e94ba-eba5-4550-99a9-78eda9d700df, portal: 172.16.0.220,3260]
Apr 12 16:05:33 user nova-compute[71874]: Login to [iface: default, target: iqn.2010-10.org.openstack:8a7e94ba-eba5-4550-99a9-78eda9d700df, portal: 172.16.0.220,3260] successful.
Apr 12 16:05:33 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:05:33 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a7e94ba-eba5-4550-99a9-78eda9d700df -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:05:33 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a7e94ba-eba5-4550-99a9-78eda9d700df -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:05:33 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[39ec3ce5-c3a6-4576-8fd4-7ef1b5ef2307]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:05:33 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb35493b-6340-4d99-bc64-cededf6f6d44 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:05:33 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:05:33 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:05:33 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa319206-3000-4223-a957-97f1faef860a]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b09d128a-0198-4cfc-942f-323bd2f41d53 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a7e94ba-eba5-4550-99a9-78eda9d700df (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:05:33 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb35493b-6340-4d99-bc64-cededf6f6d44 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:05:33 user nova-compute[71874]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b09d128a-0198-4cfc-942f-323bd2f41d53 (non-flash)
Apr 12 16:05:33 user nova-compute[71874]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 (non-flash)
Apr 12 16:05:33 user nova-compute[71874]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a7e94ba-eba5-4550-99a9-78eda9d700df (non-flash)
Apr 12 16:05:33 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:05:33 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb35493b-6340-4d99-bc64-cededf6f6d44 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:05:33 user nova-compute[71874]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b09d128a-0198-4cfc-942f-323bd2f41d53 (non-flash)
Apr 12 16:05:33 user nova-compute[71874]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 (non-flash)
Apr 12 16:05:33 user nova-compute[71874]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a7e94ba-eba5-4550-99a9-78eda9d700df (non-flash)
Apr 12 16:05:33 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:05:33 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-eb35493b-6340-4d99-bc64-cededf6f6d44 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8a7e94ba-eba5-4550-99a9-78eda9d700df" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.295s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:05:33 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb35493b-6340-4d99-bc64-cededf6f6d44 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Connected to 172.16.0.220:3260 {{(pid=71874) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 16:05:33 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-eb35493b-6340-4d99-bc64-cededf6f6d44 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] HCTL ('35', '-', '-', 0) found on session 20 with lun 0 {{(pid=71874) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 16:05:33 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-eb35493b-6340-4d99-bc64-cededf6f6d44 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71874) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 16:05:33 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:05:33 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:05:33 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7c60b79-eddf-4c2f-afcc-da1870bc4a34]: (4, ('- - 0', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:05:33 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-eb35493b-6340-4d99-bc64-cededf6f6d44 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Searching for a device in session 20 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71874) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 16:05:33 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb35493b-6340-4d99-bc64-cededf6f6d44 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:8a7e94ba-eba5-4550-99a9-78eda9d700df', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ldyAWEQz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71874) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 16:05:34 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-eb35493b-6340-4d99-bc64-cededf6f6d44 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.333s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:05:34 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb35493b-6340-4d99-bc64-cededf6f6d44 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] <== connect_volume: return (1335ms) {'type': 'block', 'scsi_wwn': '23638656232393937', 'path': '/dev/sdd'} {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:05:34 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb35493b-6340-4d99-bc64-cededf6f6d44 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] [instance: ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23638656232393937', 'path': '/dev/sdd'} {{(pid=71874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 16:05:34 user nova-compute[71874]: DEBUG nova.objects.instance [None req-eb35493b-6340-4d99-bc64-cededf6f6d44 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Lazy-loading 'flavor' on Instance uuid ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:05:34 user nova-compute[71874]: DEBUG nova.virt.libvirt.guest [None req-eb35493b-6340-4d99-bc64-cededf6f6d44 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 16:05:34 user nova-compute[71874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 16:05:34 user nova-compute[71874]:   <source dev="/dev/sdd"/>
Apr 12 16:05:34 user nova-compute[71874]:   <target dev="vdb" bus="virtio"/>
Apr 12 16:05:34 user nova-compute[71874]:   <serial>8a7e94ba-eba5-4550-99a9-78eda9d700df</serial>
Apr 12 16:05:34 user nova-compute[71874]: </disk>
Apr 12 16:05:34 user nova-compute[71874]:  {{(pid=71874) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 16:05:35 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-eb35493b-6340-4d99-bc64-cededf6f6d44 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] No BDM found with device name vda, not building metadata. {{(pid=71874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 16:05:35 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-eb35493b-6340-4d99-bc64-cededf6f6d44 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 16:05:35 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-eb35493b-6340-4d99-bc64-cededf6f6d44 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] No VIF found with MAC fa:16:3e:28:84:c8, not building metadata {{(pid=71874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 16:05:35 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-eb35493b-6340-4d99-bc64-cededf6f6d44 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Lock "ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.285s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:05:36 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-ad625a46-0c98-4ace-9894-a1a9efa8a8bf tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Acquiring lock "ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:05:36 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-ad625a46-0c98-4ace-9894-a1a9efa8a8bf tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Lock "ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:05:36 user nova-compute[71874]: INFO nova.compute.manager [None req-ad625a46-0c98-4ace-9894-a1a9efa8a8bf tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] [instance: ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e] Detaching volume 8a7e94ba-eba5-4550-99a9-78eda9d700df
Apr 12 16:05:36 user nova-compute[71874]: INFO nova.virt.block_device [None req-ad625a46-0c98-4ace-9894-a1a9efa8a8bf tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] [instance: ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e] Attempting to driver detach volume 8a7e94ba-eba5-4550-99a9-78eda9d700df from mountpoint /dev/vdb
Apr 12 16:05:36 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-ad625a46-0c98-4ace-9894-a1a9efa8a8bf tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Attempting to detach device vdb from instance ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e from the persistent domain config. {{(pid=71874) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 16:05:36 user nova-compute[71874]: DEBUG nova.virt.libvirt.guest [None req-ad625a46-0c98-4ace-9894-a1a9efa8a8bf tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 16:05:36 user nova-compute[71874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 16:05:36 user nova-compute[71874]:   <source dev="/dev/sdd"/>
Apr 12 16:05:36 user nova-compute[71874]:   <target dev="vdb" bus="virtio"/>
Apr 12 16:05:36 user nova-compute[71874]:   <serial>8a7e94ba-eba5-4550-99a9-78eda9d700df</serial>
Apr 12 16:05:36 user nova-compute[71874]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 16:05:36 user nova-compute[71874]: </disk>
Apr 12 16:05:36 user nova-compute[71874]:  {{(pid=71874) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 16:05:36 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-ad625a46-0c98-4ace-9894-a1a9efa8a8bf tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Successfully detached device vdb from instance ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e from the persistent domain config.
Apr 12 16:05:36 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-ad625a46-0c98-4ace-9894-a1a9efa8a8bf tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e from the live domain config. {{(pid=71874) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 16:05:36 user nova-compute[71874]: DEBUG nova.virt.libvirt.guest [None req-ad625a46-0c98-4ace-9894-a1a9efa8a8bf tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 16:05:36 user nova-compute[71874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 16:05:36 user nova-compute[71874]:   <source dev="/dev/sdd"/>
Apr 12 16:05:36 user nova-compute[71874]:   <target dev="vdb" bus="virtio"/>
Apr 12 16:05:36 user nova-compute[71874]:   <serial>8a7e94ba-eba5-4550-99a9-78eda9d700df</serial>
Apr 12 16:05:36 user nova-compute[71874]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 16:05:36 user nova-compute[71874]: </disk>
Apr 12 16:05:36 user nova-compute[71874]:  {{(pid=71874) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 16:05:36 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Received event <DeviceRemovedEvent: 1681315536.5813568, ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71874) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 16:05:36 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-ad625a46-0c98-4ace-9894-a1a9efa8a8bf tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e {{(pid=71874) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 16:05:36 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-ad625a46-0c98-4ace-9894-a1a9efa8a8bf tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Successfully detached device vdb from instance ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e from the live domain config.
Apr 12 16:05:36 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad625a46-0c98-4ace-9894-a1a9efa8a8bf tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] [instance: ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e] calling os-brick to detach iSCSI Volume {{(pid=71874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 16:05:36 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad625a46-0c98-4ace-9894-a1a9efa8a8bf tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3c0216320>, {'target_iqn': 'iqn.2010-10.org.openstack:8a7e94ba-eba5-4550-99a9-78eda9d700df', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ldyAWEQz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:05:36 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-ad625a46-0c98-4ace-9894-a1a9efa8a8bf tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:05:36 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-ad625a46-0c98-4ace-9894-a1a9efa8a8bf tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:05:36 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-ad625a46-0c98-4ace-9894-a1a9efa8a8bf tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:05:36 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:05:36 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:05:36 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[53863a77-df00-4fbe-95b8-ae22ba7e1029]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8a7e94ba-eba5-4550-99a9-78eda9d700df\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b09d128a-0198-4cfc-942f-323bd2f41d53\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:05:36 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad625a46-0c98-4ace-9894-a1a9efa8a8bf tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 16:05:36 user nova-compute[71874]: No targets found.
Apr 12 16:05:36 user nova-compute[71874]: iSNS:
Apr 12 16:05:36 user nova-compute[71874]: No targets found.
Apr 12 16:05:36 user nova-compute[71874]: STATIC:
Apr 12 16:05:36 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:8a7e94ba-eba5-4550-99a9-78eda9d700df
Apr 12 16:05:36 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:05:36 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:05:36 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2
Apr 12 16:05:36 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:05:36 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:05:36 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:b09d128a-0198-4cfc-942f-323bd2f41d53
Apr 12 16:05:36 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:05:36 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:05:36 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2
Apr 12 16:05:36 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:05:36 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:05:36 user nova-compute[71874]: FIRMWARE:
Apr 12 16:05:36 user nova-compute[71874]: No targets found.
Apr 12 16:05:36 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:05:36 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad625a46-0c98-4ace-9894-a1a9efa8a8bf tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 16:05:36 user nova-compute[71874]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 16:05:36 user nova-compute[71874]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71874) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 16:05:36 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad625a46-0c98-4ace-9894-a1a9efa8a8bf tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8a7e94ba-eba5-4550-99a9-78eda9d700df', 0)] {{(pid=71874) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 16:05:36 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:05:36 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:05:36 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[57bf227d-1aeb-4c1b-8798-e543edf58a58]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a7e94ba-eba5-4550-99a9-78eda9d700df\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b09d128a-0198-4cfc-942f-323bd2f41d53\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:05:36 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:05:36 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:05:36 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[d91d2ab1-4f78-4a40-aff2-c07ff37390ee]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b09d128a-0198-4cfc-942f-323bd2f41d53 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a7e94ba-eba5-4550-99a9-78eda9d700df (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:05:36 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad625a46-0c98-4ace-9894-a1a9efa8a8bf tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:05:36 user nova-compute[71874]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b09d128a-0198-4cfc-942f-323bd2f41d53 (non-flash)
Apr 12 16:05:36 user nova-compute[71874]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 (non-flash)
Apr 12 16:05:36 user nova-compute[71874]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a7e94ba-eba5-4550-99a9-78eda9d700df (non-flash)
Apr 12 16:05:36 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:05:36 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad625a46-0c98-4ace-9894-a1a9efa8a8bf tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:05:36 user nova-compute[71874]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b09d128a-0198-4cfc-942f-323bd2f41d53 (non-flash)
Apr 12 16:05:36 user nova-compute[71874]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 (non-flash)
Apr 12 16:05:36 user nova-compute[71874]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a7e94ba-eba5-4550-99a9-78eda9d700df (non-flash)
Apr 12 16:05:36 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:05:36 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad625a46-0c98-4ace-9894-a1a9efa8a8bf tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc39c203b50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8a7e94ba-eba5-4550-99a9-78eda9d700df'): ({'sdd'}, set())}) {{(pid=71874) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 16:05:36 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-ad625a46-0c98-4ace-9894-a1a9efa8a8bf tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Removing single pathed devices sdd {{(pid=71874) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 16:05:36 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:05:36 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:05:36 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8472277-77eb-4b81-8bf4-0a903f93bf01]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:05:36 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:05:36 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.025s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:05:36 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[91c32903-371a-4d86-8643-27148ef0c176]: (4, ('ok\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:05:36 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-ad625a46-0c98-4ace-9894-a1a9efa8a8bf tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Flushing IO for device /dev/sdd {{(pid=71874) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 16:05:36 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:05:36 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:05:36 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5ed2974-44f1-488a-a014-6c9e8ba66c0c]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:05:36 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-ad625a46-0c98-4ace-9894-a1a9efa8a8bf tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71874) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 16:05:36 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:05:36 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.046s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:05:36 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd4443d1-7745-43d1-a893-3d6996e91301]: (4, ('1', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:05:36 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-ad625a46-0c98-4ace-9894-a1a9efa8a8bf tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71874) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 16:05:36 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-ad625a46-0c98-4ace-9894-a1a9efa8a8bf tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] SCSI volumes sdd have been removed. {{(pid=71874) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 16:05:36 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad625a46-0c98-4ace-9894-a1a9efa8a8bf tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8a7e94ba-eba5-4550-99a9-78eda9d700df')] {{(pid=71874) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 16:05:36 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a7e94ba-eba5-4550-99a9-78eda9d700df -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:05:36 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a7e94ba-eba5-4550-99a9-78eda9d700df -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:05:36 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9ac6227-716f-441c-bd3a-c23aa3970734]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:05:36 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad625a46-0c98-4ace-9894-a1a9efa8a8bf tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:05:36 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a7e94ba-eba5-4550-99a9-78eda9d700df -p 172.16.0.220:3260 --logout {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:05:36 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a7e94ba-eba5-4550-99a9-78eda9d700df -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:05:36 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7d3b36c-9e45-436e-80ec-ddb23957a970]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:8a7e94ba-eba5-4550-99a9-78eda9d700df, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:8a7e94ba-eba5-4550-99a9-78eda9d700df, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:05:36 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad625a46-0c98-4ace-9894-a1a9efa8a8bf tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:8a7e94ba-eba5-4550-99a9-78eda9d700df, portal: 172.16.0.220,3260]
Apr 12 16:05:36 user nova-compute[71874]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:8a7e94ba-eba5-4550-99a9-78eda9d700df, portal: 172.16.0.220,3260] successful.
Apr 12 16:05:36 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:05:36 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a7e94ba-eba5-4550-99a9-78eda9d700df -p 172.16.0.220:3260 --op delete {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:05:36 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a7e94ba-eba5-4550-99a9-78eda9d700df -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:05:36 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[237ff8bc-078a-45da-aacb-4b572a8763ba]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:05:36 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad625a46-0c98-4ace-9894-a1a9efa8a8bf tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:05:36 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-ad625a46-0c98-4ace-9894-a1a9efa8a8bf tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:05:36 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad625a46-0c98-4ace-9894-a1a9efa8a8bf tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] <== disconnect_volume: return (338ms) None {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:05:36 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad625a46-0c98-4ace-9894-a1a9efa8a8bf tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] [instance: ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e] Disconnected iSCSI Volume {{(pid=71874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 16:05:37 user nova-compute[71874]: DEBUG nova.objects.instance [None req-ad625a46-0c98-4ace-9894-a1a9efa8a8bf tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Lazy-loading 'flavor' on Instance uuid ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:05:37 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-ad625a46-0c98-4ace-9894-a1a9efa8a8bf tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Lock "ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.683s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:05:37 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:05:38 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:05:42 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:05:43 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:05:46 user nova-compute[71874]: DEBUG nova.compute.manager [req-88b599d9-bbd3-4b25-aab7-346ef985f7da req-6001b8d9-1f2b-4a7a-99fc-234413486dce service nova] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Received event network-changed-c42ace22-d91b-4e4b-909e-19aaa428515a {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:05:46 user nova-compute[71874]: DEBUG nova.compute.manager [req-88b599d9-bbd3-4b25-aab7-346ef985f7da req-6001b8d9-1f2b-4a7a-99fc-234413486dce service nova] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Refreshing instance network info cache due to event network-changed-c42ace22-d91b-4e4b-909e-19aaa428515a. {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 16:05:46 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-88b599d9-bbd3-4b25-aab7-346ef985f7da req-6001b8d9-1f2b-4a7a-99fc-234413486dce service nova] Acquiring lock "refresh_cache-6caa4977-8333-4171-8825-2c3bfb52f80b" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:05:46 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-88b599d9-bbd3-4b25-aab7-346ef985f7da req-6001b8d9-1f2b-4a7a-99fc-234413486dce service nova] Acquired lock "refresh_cache-6caa4977-8333-4171-8825-2c3bfb52f80b" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:05:46 user nova-compute[71874]: DEBUG nova.network.neutron [req-88b599d9-bbd3-4b25-aab7-346ef985f7da req-6001b8d9-1f2b-4a7a-99fc-234413486dce service nova] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Refreshing network info cache for port c42ace22-d91b-4e4b-909e-19aaa428515a {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 16:05:47 user nova-compute[71874]: DEBUG nova.network.neutron [req-88b599d9-bbd3-4b25-aab7-346ef985f7da req-6001b8d9-1f2b-4a7a-99fc-234413486dce service nova] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Updated VIF entry in instance network info cache for port c42ace22-d91b-4e4b-909e-19aaa428515a. {{(pid=71874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 16:05:47 user nova-compute[71874]: DEBUG nova.network.neutron [req-88b599d9-bbd3-4b25-aab7-346ef985f7da req-6001b8d9-1f2b-4a7a-99fc-234413486dce service nova] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Updating instance_info_cache with network_info: [{"id": "c42ace22-d91b-4e4b-909e-19aaa428515a", "address": "fa:16:3e:3e:cd:0b", "network": {"id": "0e139ef7-ae53-4cce-9063-218ac1a19c0c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2058204483-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3deffbb4769b4985b038b4adcd82b018", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc42ace22-d9", "ovs_interfaceid": "c42ace22-d91b-4e4b-909e-19aaa428515a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:05:47 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-88b599d9-bbd3-4b25-aab7-346ef985f7da req-6001b8d9-1f2b-4a7a-99fc-234413486dce service nova] Releasing lock "refresh_cache-6caa4977-8333-4171-8825-2c3bfb52f80b" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:05:47 user nova-compute[71874]: DEBUG nova.compute.manager [None req-f05508b2-2ea6-4505-b67b-590b3be08803 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:05:47 user nova-compute[71874]: INFO nova.compute.manager [None req-f05508b2-2ea6-4505-b67b-590b3be08803 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] instance snapshotting
Apr 12 16:05:47 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:05:47 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-f05508b2-2ea6-4505-b67b-590b3be08803 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Beginning live snapshot process
Apr 12 16:05:47 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-f05508b2-2ea6-4505-b67b-590b3be08803 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6caa4977-8333-4171-8825-2c3bfb52f80b/disk --force-share --output=json -f qcow2 {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:05:48 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-f05508b2-2ea6-4505-b67b-590b3be08803 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6caa4977-8333-4171-8825-2c3bfb52f80b/disk --force-share --output=json -f qcow2" returned: 0 in 0.168s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:05:48 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-f05508b2-2ea6-4505-b67b-590b3be08803 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6caa4977-8333-4171-8825-2c3bfb52f80b/disk --force-share --output=json -f qcow2 {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:05:48 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-f05508b2-2ea6-4505-b67b-590b3be08803 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6caa4977-8333-4171-8825-2c3bfb52f80b/disk --force-share --output=json -f qcow2" returned: 0 in 0.155s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:05:48 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-f05508b2-2ea6-4505-b67b-590b3be08803 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:05:48 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:05:48 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-f05508b2-2ea6-4505-b67b-590b3be08803 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json" returned: 0 in 0.142s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:05:48 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-f05508b2-2ea6-4505-b67b-590b3be08803 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp0rnezz0z/9a85391caf3b41f5820717825d4b3f3f.delta 1073741824 {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:05:48 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-f05508b2-2ea6-4505-b67b-590b3be08803 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp0rnezz0z/9a85391caf3b41f5820717825d4b3f3f.delta 1073741824" returned: 0 in 0.058s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:05:48 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-f05508b2-2ea6-4505-b67b-590b3be08803 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Quiescing instance not available: QEMU guest agent is not enabled.
Apr 12 16:05:49 user nova-compute[71874]: DEBUG nova.virt.libvirt.guest [None req-f05508b2-2ea6-4505-b67b-590b3be08803 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] COPY block job progress, current cursor: 0 final cursor: 43778048 {{(pid=71874) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 16:05:49 user nova-compute[71874]: DEBUG nova.virt.libvirt.guest [None req-f05508b2-2ea6-4505-b67b-590b3be08803 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] COPY block job progress, current cursor: 43778048 final cursor: 43778048 {{(pid=71874) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 16:05:49 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-f05508b2-2ea6-4505-b67b-590b3be08803 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Skipping quiescing instance: QEMU guest agent is not enabled.
Apr 12 16:05:49 user nova-compute[71874]: DEBUG nova.privsep.utils [None req-f05508b2-2ea6-4505-b67b-590b3be08803 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71874) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 12 16:05:49 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-f05508b2-2ea6-4505-b67b-590b3be08803 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp0rnezz0z/9a85391caf3b41f5820717825d4b3f3f.delta /opt/stack/data/nova/instances/snapshots/tmp0rnezz0z/9a85391caf3b41f5820717825d4b3f3f {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:05:50 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-f05508b2-2ea6-4505-b67b-590b3be08803 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp0rnezz0z/9a85391caf3b41f5820717825d4b3f3f.delta /opt/stack/data/nova/instances/snapshots/tmp0rnezz0z/9a85391caf3b41f5820717825d4b3f3f" returned: 0 in 0.491s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:05:50 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-f05508b2-2ea6-4505-b67b-590b3be08803 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Snapshot extracted, beginning image upload
Apr 12 16:05:52 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:05:53 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:05:53 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:05:54 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-f05508b2-2ea6-4505-b67b-590b3be08803 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Snapshot image upload complete
Apr 12 16:05:54 user nova-compute[71874]: INFO nova.compute.manager [None req-f05508b2-2ea6-4505-b67b-590b3be08803 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Took 6.32 seconds to snapshot the instance on the hypervisor.
Apr 12 16:05:54 user nova-compute[71874]: DEBUG nova.compute.manager [req-9713e790-0dfa-4a5c-8a7a-5b4a86038ef5 req-9ca67d22-145b-41a4-83d7-af64c7475cc4 service nova] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] Received event network-changed-567c632f-4b91-46d8-ade5-c694ee9023c1 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:05:54 user nova-compute[71874]: DEBUG nova.compute.manager [req-9713e790-0dfa-4a5c-8a7a-5b4a86038ef5 req-9ca67d22-145b-41a4-83d7-af64c7475cc4 service nova] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] Refreshing instance network info cache due to event network-changed-567c632f-4b91-46d8-ade5-c694ee9023c1. {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 16:05:54 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-9713e790-0dfa-4a5c-8a7a-5b4a86038ef5 req-9ca67d22-145b-41a4-83d7-af64c7475cc4 service nova] Acquiring lock "refresh_cache-85b91251-9735-4812-9f11-003a7951a6f3" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:05:54 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-9713e790-0dfa-4a5c-8a7a-5b4a86038ef5 req-9ca67d22-145b-41a4-83d7-af64c7475cc4 service nova] Acquired lock "refresh_cache-85b91251-9735-4812-9f11-003a7951a6f3" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:05:54 user nova-compute[71874]: DEBUG nova.network.neutron [req-9713e790-0dfa-4a5c-8a7a-5b4a86038ef5 req-9ca67d22-145b-41a4-83d7-af64c7475cc4 service nova] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] Refreshing network info cache for port 567c632f-4b91-46d8-ade5-c694ee9023c1 {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 16:05:54 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d0c55c5b-f33c-495a-aac7-69f25777b84d tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Acquiring lock "85b91251-9735-4812-9f11-003a7951a6f3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:05:54 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d0c55c5b-f33c-495a-aac7-69f25777b84d tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Lock "85b91251-9735-4812-9f11-003a7951a6f3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:05:54 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d0c55c5b-f33c-495a-aac7-69f25777b84d tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Acquiring lock "85b91251-9735-4812-9f11-003a7951a6f3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:05:54 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d0c55c5b-f33c-495a-aac7-69f25777b84d tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Lock "85b91251-9735-4812-9f11-003a7951a6f3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:05:54 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d0c55c5b-f33c-495a-aac7-69f25777b84d tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Lock "85b91251-9735-4812-9f11-003a7951a6f3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:05:54 user nova-compute[71874]: INFO nova.compute.manager [None req-d0c55c5b-f33c-495a-aac7-69f25777b84d tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] Terminating instance
Apr 12 16:05:54 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d0c55c5b-f33c-495a-aac7-69f25777b84d tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] Start destroying the instance on the hypervisor. {{(pid=71874) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 16:05:54 user nova-compute[71874]: DEBUG nova.network.neutron [req-9713e790-0dfa-4a5c-8a7a-5b4a86038ef5 req-9ca67d22-145b-41a4-83d7-af64c7475cc4 service nova] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] Updated VIF entry in instance network info cache for port 567c632f-4b91-46d8-ade5-c694ee9023c1. {{(pid=71874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 16:05:55 user nova-compute[71874]: DEBUG nova.network.neutron [req-9713e790-0dfa-4a5c-8a7a-5b4a86038ef5 req-9ca67d22-145b-41a4-83d7-af64c7475cc4 service nova] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] Updating instance_info_cache with network_info: [{"id": "567c632f-4b91-46d8-ade5-c694ee9023c1", "address": "fa:16:3e:d5:b1:e0", "network": {"id": "0b7c67f6-057a-4bb5-aa44-db5290d55865", "bridge": "br-int", "label": "tempest-TestShelveInstance-825161862-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a46b4e80a65541d6bab94b5edfc26e5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap567c632f-4b", "ovs_interfaceid": "567c632f-4b91-46d8-ade5-c694ee9023c1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:05:55 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-9713e790-0dfa-4a5c-8a7a-5b4a86038ef5 req-9ca67d22-145b-41a4-83d7-af64c7475cc4 service nova] Releasing lock "refresh_cache-85b91251-9735-4812-9f11-003a7951a6f3" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:05:55 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:05:55 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:05:55 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:05:55 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:05:55 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:05:55 user nova-compute[71874]: DEBUG nova.compute.manager [req-6e0249ca-81bd-4faf-865a-45e28afb4c86 req-bc307694-ed71-49a2-abb1-7cb7e6f385e1 service nova] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] Received event network-vif-unplugged-567c632f-4b91-46d8-ade5-c694ee9023c1 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:05:55 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-6e0249ca-81bd-4faf-865a-45e28afb4c86 req-bc307694-ed71-49a2-abb1-7cb7e6f385e1 service nova] Acquiring lock "85b91251-9735-4812-9f11-003a7951a6f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:05:55 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-6e0249ca-81bd-4faf-865a-45e28afb4c86 req-bc307694-ed71-49a2-abb1-7cb7e6f385e1 service nova] Lock "85b91251-9735-4812-9f11-003a7951a6f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:05:55 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-6e0249ca-81bd-4faf-865a-45e28afb4c86 req-bc307694-ed71-49a2-abb1-7cb7e6f385e1 service nova] Lock "85b91251-9735-4812-9f11-003a7951a6f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:05:55 user nova-compute[71874]: DEBUG nova.compute.manager [req-6e0249ca-81bd-4faf-865a-45e28afb4c86 req-bc307694-ed71-49a2-abb1-7cb7e6f385e1 service nova] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] No waiting events found dispatching network-vif-unplugged-567c632f-4b91-46d8-ade5-c694ee9023c1 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:05:55 user nova-compute[71874]: DEBUG nova.compute.manager [req-6e0249ca-81bd-4faf-865a-45e28afb4c86 req-bc307694-ed71-49a2-abb1-7cb7e6f385e1 service nova] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] Received event network-vif-unplugged-567c632f-4b91-46d8-ade5-c694ee9023c1 for instance with task_state deleting. {{(pid=71874) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 16:05:56 user nova-compute[71874]: INFO nova.virt.libvirt.driver [-] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] Instance destroyed successfully.
Apr 12 16:05:56 user nova-compute[71874]: DEBUG nova.objects.instance [None req-d0c55c5b-f33c-495a-aac7-69f25777b84d tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Lazy-loading 'resources' on Instance uuid 85b91251-9735-4812-9f11-003a7951a6f3 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:05:56 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-d0c55c5b-f33c-495a-aac7-69f25777b84d tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-12T16:00:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1745076225',display_name='tempest-TestShelveInstance-server-1745076225',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1745076225',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGrjGxRBnu9rsB4dVnF551Ir+USJO3Xww91Gyq7pzJHhLIC+yf3sqYFIB7zX6y2mMrg16l4hILlV14T+O7phmEsFD6kmLB6HpztKchow4NACtmWzqkjfiJtDlHrmoWu0KQ==',key_name='tempest-TestShelveInstance-509475392',keypairs=<?>,launch_index=0,launched_at=2023-04-12T16:04:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a46b4e80a65541d6bab94b5edfc26e5b',ramdisk_id='',reservation_id='r-ffojuop7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-346701715',owner_user_name='tempest-TestShelveInstance-346701715-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T16:04:16Z,user_data=None,user_id='6acbd977c4b4494db95f879777184489',uuid=85b91251-9735-4812-9f11-003a7951a6f3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "567c632f-4b91-46d8-ade5-c694ee9023c1", "address": "fa:16:3e:d5:b1:e0", "network": {"id": "0b7c67f6-057a-4bb5-aa44-db5290d55865", "bridge": "br-int", "label": "tempest-TestShelveInstance-825161862-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a46b4e80a65541d6bab94b5edfc26e5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap567c632f-4b", "ovs_interfaceid": "567c632f-4b91-46d8-ade5-c694ee9023c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 16:05:56 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-d0c55c5b-f33c-495a-aac7-69f25777b84d tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Converting VIF {"id": "567c632f-4b91-46d8-ade5-c694ee9023c1", "address": "fa:16:3e:d5:b1:e0", "network": {"id": "0b7c67f6-057a-4bb5-aa44-db5290d55865", "bridge": "br-int", "label": "tempest-TestShelveInstance-825161862-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a46b4e80a65541d6bab94b5edfc26e5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap567c632f-4b", "ovs_interfaceid": "567c632f-4b91-46d8-ade5-c694ee9023c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:05:56 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-d0c55c5b-f33c-495a-aac7-69f25777b84d tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:b1:e0,bridge_name='br-int',has_traffic_filtering=True,id=567c632f-4b91-46d8-ade5-c694ee9023c1,network=Network(0b7c67f6-057a-4bb5-aa44-db5290d55865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap567c632f-4b') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:05:56 user nova-compute[71874]: DEBUG os_vif [None req-d0c55c5b-f33c-495a-aac7-69f25777b84d tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:b1:e0,bridge_name='br-int',has_traffic_filtering=True,id=567c632f-4b91-46d8-ade5-c694ee9023c1,network=Network(0b7c67f6-057a-4bb5-aa44-db5290d55865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap567c632f-4b') {{(pid=71874) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 16:05:56 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:05:56 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap567c632f-4b, bridge=br-int, if_exists=True) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:05:56 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:05:56 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:05:56 user nova-compute[71874]: INFO os_vif [None req-d0c55c5b-f33c-495a-aac7-69f25777b84d tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:b1:e0,bridge_name='br-int',has_traffic_filtering=True,id=567c632f-4b91-46d8-ade5-c694ee9023c1,network=Network(0b7c67f6-057a-4bb5-aa44-db5290d55865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap567c632f-4b')
Apr 12 16:05:56 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0c55c5b-f33c-495a-aac7-69f25777b84d tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] calling os-brick to detach iSCSI Volume {{(pid=71874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 16:05:56 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0c55c5b-f33c-495a-aac7-69f25777b84d tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3c0216320>, {'target_iqn': 'iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xHtihcnd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:05:56 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-d0c55c5b-f33c-495a-aac7-69f25777b84d tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:05:56 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-d0c55c5b-f33c-495a-aac7-69f25777b84d tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:05:56 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-d0c55c5b-f33c-495a-aac7-69f25777b84d tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:05:56 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:05:56 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.033s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:05:56 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[de95d1a3-000f-493c-96a9-a81098543af2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0d741bce-1d89-40e8-be08-38272a1fc9ea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b09d128a-0198-4cfc-942f-323bd2f41d53\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:05:56 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0c55c5b-f33c-495a-aac7-69f25777b84d tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 16:05:56 user nova-compute[71874]: No targets found.
Apr 12 16:05:56 user nova-compute[71874]: iSNS:
Apr 12 16:05:56 user nova-compute[71874]: No targets found.
Apr 12 16:05:56 user nova-compute[71874]: STATIC:
Apr 12 16:05:56 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2
Apr 12 16:05:56 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:05:56 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:05:56 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:0d741bce-1d89-40e8-be08-38272a1fc9ea
Apr 12 16:05:56 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:05:56 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:05:56 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:b09d128a-0198-4cfc-942f-323bd2f41d53
Apr 12 16:05:56 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:05:56 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:05:56 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2
Apr 12 16:05:56 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:05:56 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:05:56 user nova-compute[71874]: FIRMWARE:
Apr 12 16:05:56 user nova-compute[71874]: No targets found.
Apr 12 16:05:56 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:05:56 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0c55c5b-f33c-495a-aac7-69f25777b84d tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 16:05:56 user nova-compute[71874]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 16:05:56 user nova-compute[71874]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71874) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 16:05:56 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0c55c5b-f33c-495a-aac7-69f25777b84d tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2', 0)] {{(pid=71874) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 16:05:56 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:05:56 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:05:56 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[e58b0c98-b55b-46ef-a963-26525b5855e0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0d741bce-1d89-40e8-be08-38272a1fc9ea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b09d128a-0198-4cfc-942f-323bd2f41d53\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:05:56 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:05:56 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:05:56 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5883540-bb57-4ab2-a1b1-cb6c9db03a5b]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b09d128a-0198-4cfc-942f-323bd2f41d53 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d741bce-1d89-40e8-be08-38272a1fc9ea (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:05:56 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0c55c5b-f33c-495a-aac7-69f25777b84d tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:05:56 user nova-compute[71874]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b09d128a-0198-4cfc-942f-323bd2f41d53 (non-flash)
Apr 12 16:05:56 user nova-compute[71874]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 (non-flash)
Apr 12 16:05:56 user nova-compute[71874]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d741bce-1d89-40e8-be08-38272a1fc9ea (non-flash)
Apr 12 16:05:56 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:05:56 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0c55c5b-f33c-495a-aac7-69f25777b84d tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:05:56 user nova-compute[71874]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b09d128a-0198-4cfc-942f-323bd2f41d53 (non-flash)
Apr 12 16:05:56 user nova-compute[71874]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 (non-flash)
Apr 12 16:05:56 user nova-compute[71874]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d741bce-1d89-40e8-be08-38272a1fc9ea (non-flash)
Apr 12 16:05:56 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:05:56 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0c55c5b-f33c-495a-aac7-69f25777b84d tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc39c2020e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2'): ({'sde'}, set())}) {{(pid=71874) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 16:05:56 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-d0c55c5b-f33c-495a-aac7-69f25777b84d tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Removing single pathed devices sde {{(pid=71874) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 16:05:56 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:05:56 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:05:56 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf7a8060-4194-4c4b-8c88-6dad1c66f534]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:05:56 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:05:56 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:05:56 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[e62e8996-26fb-44fb-bf8b-267513ed70fb]: (4, ('ok\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:05:56 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-d0c55c5b-f33c-495a-aac7-69f25777b84d tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Flushing IO for device /dev/sde {{(pid=71874) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 16:05:56 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:05:56 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.039s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:05:56 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc0ae901-a943-4374-8f94-52ad037954cd]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:05:56 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-d0c55c5b-f33c-495a-aac7-69f25777b84d tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71874) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 16:05:56 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:05:56 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.211s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:05:56 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[4882ed25-9793-4d89-95cc-4299ed2b1b1e]: (4, ('1', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:05:56 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-d0c55c5b-f33c-495a-aac7-69f25777b84d tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71874) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 16:05:56 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-d0c55c5b-f33c-495a-aac7-69f25777b84d tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] SCSI volumes sde have been removed. {{(pid=71874) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 16:05:56 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0c55c5b-f33c-495a-aac7-69f25777b84d tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2')] {{(pid=71874) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 16:05:56 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:05:56 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:05:56 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2d2bf83-4832-40c1-a965-5dd75ad9906d]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:05:56 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0c55c5b-f33c-495a-aac7-69f25777b84d tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:05:56 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 -p 172.16.0.220:3260 --logout {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:05:56 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:05:56 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa925802-1786-44fa-97b9-51e043c8c23c]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:05:56 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0c55c5b-f33c-495a-aac7-69f25777b84d tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2, portal: 172.16.0.220,3260]
Apr 12 16:05:56 user nova-compute[71874]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2, portal: 172.16.0.220,3260] successful.
Apr 12 16:05:56 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:05:56 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 -p 172.16.0.220:3260 --op delete {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:05:57 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:863633c1-6f4e-41f5-b72c-91ca428b73b2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:05:57 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ac895e6-07c5-454f-9e51-1c7ac1326380]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:05:57 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0c55c5b-f33c-495a-aac7-69f25777b84d tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:05:57 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-d0c55c5b-f33c-495a-aac7-69f25777b84d tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.530s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:05:57 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0c55c5b-f33c-495a-aac7-69f25777b84d tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] <== disconnect_volume: return (531ms) None {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:05:57 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0c55c5b-f33c-495a-aac7-69f25777b84d tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] Disconnected iSCSI Volume {{(pid=71874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 16:05:57 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-d0c55c5b-f33c-495a-aac7-69f25777b84d tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] Deleting instance files /opt/stack/data/nova/instances/85b91251-9735-4812-9f11-003a7951a6f3_del
Apr 12 16:05:57 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-d0c55c5b-f33c-495a-aac7-69f25777b84d tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] Deletion of /opt/stack/data/nova/instances/85b91251-9735-4812-9f11-003a7951a6f3_del complete
Apr 12 16:05:57 user nova-compute[71874]: INFO nova.compute.manager [None req-d0c55c5b-f33c-495a-aac7-69f25777b84d tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] Took 2.27 seconds to destroy the instance on the hypervisor.
Apr 12 16:05:57 user nova-compute[71874]: DEBUG oslo.service.loopingcall [None req-d0c55c5b-f33c-495a-aac7-69f25777b84d tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71874) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 16:05:57 user nova-compute[71874]: DEBUG nova.compute.manager [-] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] Deallocating network for instance {{(pid=71874) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 16:05:57 user nova-compute[71874]: DEBUG nova.network.neutron [-] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] deallocate_for_instance() {{(pid=71874) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 16:05:57 user nova-compute[71874]: INFO nova.compute.manager [None req-5b6d5177-c9a9-4f68-8e43-b497ac0f92ed tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] Unrescuing
Apr 12 16:05:57 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-5b6d5177-c9a9-4f68-8e43-b497ac0f92ed tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Acquiring lock "refresh_cache-afebffae-dbf6-4876-8c9f-0364f0fde49c" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:05:57 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-5b6d5177-c9a9-4f68-8e43-b497ac0f92ed tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Acquired lock "refresh_cache-afebffae-dbf6-4876-8c9f-0364f0fde49c" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:05:57 user nova-compute[71874]: DEBUG nova.network.neutron [None req-5b6d5177-c9a9-4f68-8e43-b497ac0f92ed tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] Building network info cache for instance {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 16:05:57 user nova-compute[71874]: DEBUG nova.network.neutron [-] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] Updating instance_info_cache with network_info: [] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:05:57 user nova-compute[71874]: INFO nova.compute.manager [-] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] Took 0.61 seconds to deallocate network for instance.
Apr 12 16:05:57 user nova-compute[71874]: DEBUG nova.compute.manager [req-5c5e4a90-71d8-4b9c-baff-5ca5597aa4b2 req-9c70d29f-626d-4c7c-84dd-0c35abf68819 service nova] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] Received event network-vif-plugged-567c632f-4b91-46d8-ade5-c694ee9023c1 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:05:57 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-5c5e4a90-71d8-4b9c-baff-5ca5597aa4b2 req-9c70d29f-626d-4c7c-84dd-0c35abf68819 service nova] Acquiring lock "85b91251-9735-4812-9f11-003a7951a6f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:05:57 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-5c5e4a90-71d8-4b9c-baff-5ca5597aa4b2 req-9c70d29f-626d-4c7c-84dd-0c35abf68819 service nova] Lock "85b91251-9735-4812-9f11-003a7951a6f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:05:57 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-5c5e4a90-71d8-4b9c-baff-5ca5597aa4b2 req-9c70d29f-626d-4c7c-84dd-0c35abf68819 service nova] Lock "85b91251-9735-4812-9f11-003a7951a6f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:05:57 user nova-compute[71874]: DEBUG nova.compute.manager [req-5c5e4a90-71d8-4b9c-baff-5ca5597aa4b2 req-9c70d29f-626d-4c7c-84dd-0c35abf68819 service nova] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] No waiting events found dispatching network-vif-plugged-567c632f-4b91-46d8-ade5-c694ee9023c1 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:05:57 user nova-compute[71874]: WARNING nova.compute.manager [req-5c5e4a90-71d8-4b9c-baff-5ca5597aa4b2 req-9c70d29f-626d-4c7c-84dd-0c35abf68819 service nova] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] Received unexpected event network-vif-plugged-567c632f-4b91-46d8-ade5-c694ee9023c1 for instance with vm_state active and task_state deleting.
Apr 12 16:05:57 user nova-compute[71874]: DEBUG nova.compute.manager [req-5c5e4a90-71d8-4b9c-baff-5ca5597aa4b2 req-9c70d29f-626d-4c7c-84dd-0c35abf68819 service nova] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] Received event network-vif-deleted-567c632f-4b91-46d8-ade5-c694ee9023c1 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:05:57 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:05:58 user nova-compute[71874]: DEBUG nova.network.neutron [None req-5b6d5177-c9a9-4f68-8e43-b497ac0f92ed tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] Updating instance_info_cache with network_info: [{"id": "c4b29e0b-0ad8-4897-acf3-76004ac0338b", "address": "fa:16:3e:b8:23:a7", "network": {"id": "06fae0be-02dd-4962-a1ac-fd0413772758", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1493924857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3fe48a3b7d846a195f1e47cc7f69695", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4b29e0b-0a", "ovs_interfaceid": "c4b29e0b-0ad8-4897-acf3-76004ac0338b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:05:58 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-5b6d5177-c9a9-4f68-8e43-b497ac0f92ed tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Releasing lock "refresh_cache-afebffae-dbf6-4876-8c9f-0364f0fde49c" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:05:58 user nova-compute[71874]: DEBUG nova.objects.instance [None req-5b6d5177-c9a9-4f68-8e43-b497ac0f92ed tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lazy-loading 'flavor' on Instance uuid afebffae-dbf6-4876-8c9f-0364f0fde49c {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:05:58 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:05:58 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:05:58 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:05:58 user nova-compute[71874]: INFO nova.compute.manager [None req-d0c55c5b-f33c-495a-aac7-69f25777b84d tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] Took 0.92 seconds to detach 1 volumes for instance.
Apr 12 16:05:58 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d0c55c5b-f33c-495a-aac7-69f25777b84d tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] Deleting volume: 863633c1-6f4e-41f5-b72c-91ca428b73b2 {{(pid=71874) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 12 16:05:58 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d0c55c5b-f33c-495a-aac7-69f25777b84d tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:05:58 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d0c55c5b-f33c-495a-aac7-69f25777b84d tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:05:58 user nova-compute[71874]: DEBUG nova.compute.manager [req-98a0b82f-9163-4995-b84b-08689b179bcc req-3f75cff5-bdfb-46cb-aec7-dfb8c034bd4a service nova] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] Received event network-vif-unplugged-c4b29e0b-0ad8-4897-acf3-76004ac0338b {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:05:58 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-98a0b82f-9163-4995-b84b-08689b179bcc req-3f75cff5-bdfb-46cb-aec7-dfb8c034bd4a service nova] Acquiring lock "afebffae-dbf6-4876-8c9f-0364f0fde49c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:05:58 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-98a0b82f-9163-4995-b84b-08689b179bcc req-3f75cff5-bdfb-46cb-aec7-dfb8c034bd4a service nova] Lock "afebffae-dbf6-4876-8c9f-0364f0fde49c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:05:58 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-98a0b82f-9163-4995-b84b-08689b179bcc req-3f75cff5-bdfb-46cb-aec7-dfb8c034bd4a service nova] Lock "afebffae-dbf6-4876-8c9f-0364f0fde49c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:05:58 user nova-compute[71874]: DEBUG nova.compute.manager [req-98a0b82f-9163-4995-b84b-08689b179bcc req-3f75cff5-bdfb-46cb-aec7-dfb8c034bd4a service nova] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] No waiting events found dispatching network-vif-unplugged-c4b29e0b-0ad8-4897-acf3-76004ac0338b {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:05:58 user nova-compute[71874]: WARNING nova.compute.manager [req-98a0b82f-9163-4995-b84b-08689b179bcc req-3f75cff5-bdfb-46cb-aec7-dfb8c034bd4a service nova] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] Received unexpected event network-vif-unplugged-c4b29e0b-0ad8-4897-acf3-76004ac0338b for instance with vm_state rescued and task_state unrescuing.
Apr 12 16:05:58 user nova-compute[71874]: INFO nova.virt.libvirt.driver [-] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] Instance destroyed successfully.
Apr 12 16:05:59 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-d0c55c5b-f33c-495a-aac7-69f25777b84d tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Inventory has not changed in ProviderTree for provider: 0e94b4c8-cd49-45e4-9133-d36eb4b2456b {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 16:05:59 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-d0c55c5b-f33c-495a-aac7-69f25777b84d tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Inventory has not changed for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 16:05:59 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d0c55c5b-f33c-495a-aac7-69f25777b84d tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.476s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:05:59 user nova-compute[71874]: INFO nova.scheduler.client.report [None req-d0c55c5b-f33c-495a-aac7-69f25777b84d tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Deleted allocations for instance 85b91251-9735-4812-9f11-003a7951a6f3
Apr 12 16:05:59 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d0c55c5b-f33c-495a-aac7-69f25777b84d tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Lock "85b91251-9735-4812-9f11-003a7951a6f3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.590s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:05:59 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-9e9e616c-c437-4fb2-8a30-cbd3fe87f133 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Acquiring lock "fc19fd8d-3285-4ceb-8714-a0ba139f3045" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:05:59 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-9e9e616c-c437-4fb2-8a30-cbd3fe87f133 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "fc19fd8d-3285-4ceb-8714-a0ba139f3045" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:05:59 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-9e9e616c-c437-4fb2-8a30-cbd3fe87f133 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Acquiring lock "fc19fd8d-3285-4ceb-8714-a0ba139f3045-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:05:59 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-9e9e616c-c437-4fb2-8a30-cbd3fe87f133 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "fc19fd8d-3285-4ceb-8714-a0ba139f3045-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:05:59 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-9e9e616c-c437-4fb2-8a30-cbd3fe87f133 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "fc19fd8d-3285-4ceb-8714-a0ba139f3045-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:05:59 user nova-compute[71874]: INFO nova.compute.manager [None req-9e9e616c-c437-4fb2-8a30-cbd3fe87f133 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] Terminating instance
Apr 12 16:05:59 user nova-compute[71874]: DEBUG nova.compute.manager [None req-9e9e616c-c437-4fb2-8a30-cbd3fe87f133 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] Start destroying the instance on the hypervisor. {{(pid=71874) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 16:05:59 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:05:59 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:05:59 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:05:59 user nova-compute[71874]: DEBUG nova.compute.manager [req-f782e782-5c29-4ae9-b0b9-12605d7a6051 req-ee8f177e-6d0c-44c0-aa3c-b80fa9a7e1ed service nova] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] Received event network-vif-unplugged-12acc77d-6a56-426a-acda-16438c358c44 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:05:59 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-f782e782-5c29-4ae9-b0b9-12605d7a6051 req-ee8f177e-6d0c-44c0-aa3c-b80fa9a7e1ed service nova] Acquiring lock "fc19fd8d-3285-4ceb-8714-a0ba139f3045-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:05:59 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-f782e782-5c29-4ae9-b0b9-12605d7a6051 req-ee8f177e-6d0c-44c0-aa3c-b80fa9a7e1ed service nova] Lock "fc19fd8d-3285-4ceb-8714-a0ba139f3045-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:05:59 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-f782e782-5c29-4ae9-b0b9-12605d7a6051 req-ee8f177e-6d0c-44c0-aa3c-b80fa9a7e1ed service nova] Lock "fc19fd8d-3285-4ceb-8714-a0ba139f3045-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:05:59 user nova-compute[71874]: DEBUG nova.compute.manager [req-f782e782-5c29-4ae9-b0b9-12605d7a6051 req-ee8f177e-6d0c-44c0-aa3c-b80fa9a7e1ed service nova] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] No waiting events found dispatching network-vif-unplugged-12acc77d-6a56-426a-acda-16438c358c44 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:05:59 user nova-compute[71874]: DEBUG nova.compute.manager [req-f782e782-5c29-4ae9-b0b9-12605d7a6051 req-ee8f177e-6d0c-44c0-aa3c-b80fa9a7e1ed service nova] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] Received event network-vif-unplugged-12acc77d-6a56-426a-acda-16438c358c44 for instance with task_state deleting. {{(pid=71874) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 16:06:00 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:06:00 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:06:00 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:06:00 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:06:00 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:06:00 user nova-compute[71874]: DEBUG nova.compute.manager [req-5d433752-e007-4191-9572-3b4a07a862c8 req-dd92562f-22d7-4294-98c9-eba2cd3894f7 service nova] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] Received event network-vif-plugged-c4b29e0b-0ad8-4897-acf3-76004ac0338b {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:06:00 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-5d433752-e007-4191-9572-3b4a07a862c8 req-dd92562f-22d7-4294-98c9-eba2cd3894f7 service nova] Acquiring lock "afebffae-dbf6-4876-8c9f-0364f0fde49c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:06:00 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-5d433752-e007-4191-9572-3b4a07a862c8 req-dd92562f-22d7-4294-98c9-eba2cd3894f7 service nova] Lock "afebffae-dbf6-4876-8c9f-0364f0fde49c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:06:00 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-5d433752-e007-4191-9572-3b4a07a862c8 req-dd92562f-22d7-4294-98c9-eba2cd3894f7 service nova] Lock "afebffae-dbf6-4876-8c9f-0364f0fde49c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:06:00 user nova-compute[71874]: DEBUG nova.compute.manager [req-5d433752-e007-4191-9572-3b4a07a862c8 req-dd92562f-22d7-4294-98c9-eba2cd3894f7 service nova] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] No waiting events found dispatching network-vif-plugged-c4b29e0b-0ad8-4897-acf3-76004ac0338b {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:06:00 user nova-compute[71874]: WARNING nova.compute.manager [req-5d433752-e007-4191-9572-3b4a07a862c8 req-dd92562f-22d7-4294-98c9-eba2cd3894f7 service nova] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] Received unexpected event network-vif-plugged-c4b29e0b-0ad8-4897-acf3-76004ac0338b for instance with vm_state rescued and task_state unrescuing.
Apr 12 16:06:00 user nova-compute[71874]: DEBUG nova.compute.manager [req-5d433752-e007-4191-9572-3b4a07a862c8 req-dd92562f-22d7-4294-98c9-eba2cd3894f7 service nova] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] Received event network-vif-plugged-c4b29e0b-0ad8-4897-acf3-76004ac0338b {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:06:00 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-5d433752-e007-4191-9572-3b4a07a862c8 req-dd92562f-22d7-4294-98c9-eba2cd3894f7 service nova] Acquiring lock "afebffae-dbf6-4876-8c9f-0364f0fde49c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:06:00 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-5d433752-e007-4191-9572-3b4a07a862c8 req-dd92562f-22d7-4294-98c9-eba2cd3894f7 service nova] Lock "afebffae-dbf6-4876-8c9f-0364f0fde49c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:06:00 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-5d433752-e007-4191-9572-3b4a07a862c8 req-dd92562f-22d7-4294-98c9-eba2cd3894f7 service nova] Lock "afebffae-dbf6-4876-8c9f-0364f0fde49c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:06:00 user nova-compute[71874]: DEBUG nova.compute.manager [req-5d433752-e007-4191-9572-3b4a07a862c8 req-dd92562f-22d7-4294-98c9-eba2cd3894f7 service nova] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] No waiting events found dispatching network-vif-plugged-c4b29e0b-0ad8-4897-acf3-76004ac0338b {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:06:00 user nova-compute[71874]: WARNING nova.compute.manager [req-5d433752-e007-4191-9572-3b4a07a862c8 req-dd92562f-22d7-4294-98c9-eba2cd3894f7 service nova] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] Received unexpected event network-vif-plugged-c4b29e0b-0ad8-4897-acf3-76004ac0338b for instance with vm_state rescued and task_state unrescuing.
Apr 12 16:06:01 user nova-compute[71874]: INFO nova.virt.libvirt.driver [-] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] Instance destroyed successfully.
Apr 12 16:06:01 user nova-compute[71874]: DEBUG nova.objects.instance [None req-9e9e616c-c437-4fb2-8a30-cbd3fe87f133 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lazy-loading 'resources' on Instance uuid fc19fd8d-3285-4ceb-8714-a0ba139f3045 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:06:01 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-9e9e616c-c437-4fb2-8a30-cbd3fe87f133 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-12T15:59:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-791161427',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-791161427',id=5,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP/Xq604Ni9GyIbrWoJD7InG3g/r5BKu6klFR/hZ1bKdq3Hy1Mk7Pe+nAKjrfzX5p0VIQ/uMvcVFsrX06k2D5Iq1KlW5EZ6pMRc39ATodyZ/r0xBGzk9bUr1v/CNzPJ0EQ==',key_name='tempest-keypair-1362669684',keypairs=<?>,launch_index=0,launched_at=2023-04-12T16:03:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1fa122cbabe94c6f93c862b4daf31e50',ramdisk_id='',reservation_id='r-z1kj5zi3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-292107264',owner_user_name='tempest-AttachVolumeShelveTestJSON-292107264-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T16:03:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c1abec24caf74dc8a27b64c21a9d4a59',uuid=fc19fd8d-3285-4ceb-8714-a0ba139f3045,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "12acc77d-6a56-426a-acda-16438c358c44", "address": "fa:16:3e:9f:92:7f", "network": {"id": "eb4dd4b5-96d4-4b53-b510-d41e2775b92f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-596111273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fa122cbabe94c6f93c862b4daf31e50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12acc77d-6a", "ovs_interfaceid": "12acc77d-6a56-426a-acda-16438c358c44", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 16:06:01 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-9e9e616c-c437-4fb2-8a30-cbd3fe87f133 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Converting VIF {"id": "12acc77d-6a56-426a-acda-16438c358c44", "address": "fa:16:3e:9f:92:7f", "network": {"id": "eb4dd4b5-96d4-4b53-b510-d41e2775b92f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-596111273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fa122cbabe94c6f93c862b4daf31e50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12acc77d-6a", "ovs_interfaceid": "12acc77d-6a56-426a-acda-16438c358c44", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:06:01 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-9e9e616c-c437-4fb2-8a30-cbd3fe87f133 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9f:92:7f,bridge_name='br-int',has_traffic_filtering=True,id=12acc77d-6a56-426a-acda-16438c358c44,network=Network(eb4dd4b5-96d4-4b53-b510-d41e2775b92f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12acc77d-6a') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:06:01 user nova-compute[71874]: DEBUG os_vif [None req-9e9e616c-c437-4fb2-8a30-cbd3fe87f133 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9f:92:7f,bridge_name='br-int',has_traffic_filtering=True,id=12acc77d-6a56-426a-acda-16438c358c44,network=Network(eb4dd4b5-96d4-4b53-b510-d41e2775b92f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12acc77d-6a') {{(pid=71874) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 16:06:01 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:06:01 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap12acc77d-6a, bridge=br-int, if_exists=True) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:06:01 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:06:01 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:06:01 user nova-compute[71874]: INFO os_vif [None req-9e9e616c-c437-4fb2-8a30-cbd3fe87f133 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9f:92:7f,bridge_name='br-int',has_traffic_filtering=True,id=12acc77d-6a56-426a-acda-16438c358c44,network=Network(eb4dd4b5-96d4-4b53-b510-d41e2775b92f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12acc77d-6a')
Apr 12 16:06:01 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-9e9e616c-c437-4fb2-8a30-cbd3fe87f133 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] Deleting instance files /opt/stack/data/nova/instances/fc19fd8d-3285-4ceb-8714-a0ba139f3045_del
Apr 12 16:06:01 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-9e9e616c-c437-4fb2-8a30-cbd3fe87f133 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] Deletion of /opt/stack/data/nova/instances/fc19fd8d-3285-4ceb-8714-a0ba139f3045_del complete
Apr 12 16:06:01 user nova-compute[71874]: INFO nova.compute.manager [None req-9e9e616c-c437-4fb2-8a30-cbd3fe87f133 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] Took 1.73 seconds to destroy the instance on the hypervisor.
Apr 12 16:06:01 user nova-compute[71874]: DEBUG oslo.service.loopingcall [None req-9e9e616c-c437-4fb2-8a30-cbd3fe87f133 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71874) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 16:06:01 user nova-compute[71874]: DEBUG nova.compute.manager [-] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] Deallocating network for instance {{(pid=71874) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 16:06:01 user nova-compute[71874]: DEBUG nova.network.neutron [-] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] deallocate_for_instance() {{(pid=71874) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 16:06:01 user nova-compute[71874]: DEBUG nova.compute.manager [req-75c2d99b-c661-4d7c-bc33-1e9a171b4ce7 req-3cd70f8c-0d9e-42c1-9b82-24eb7e4ea34c service nova] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] Received event network-vif-plugged-12acc77d-6a56-426a-acda-16438c358c44 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:06:01 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-75c2d99b-c661-4d7c-bc33-1e9a171b4ce7 req-3cd70f8c-0d9e-42c1-9b82-24eb7e4ea34c service nova] Acquiring lock "fc19fd8d-3285-4ceb-8714-a0ba139f3045-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:06:01 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-75c2d99b-c661-4d7c-bc33-1e9a171b4ce7 req-3cd70f8c-0d9e-42c1-9b82-24eb7e4ea34c service nova] Lock "fc19fd8d-3285-4ceb-8714-a0ba139f3045-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:06:01 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-75c2d99b-c661-4d7c-bc33-1e9a171b4ce7 req-3cd70f8c-0d9e-42c1-9b82-24eb7e4ea34c service nova] Lock "fc19fd8d-3285-4ceb-8714-a0ba139f3045-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:06:01 user nova-compute[71874]: DEBUG nova.compute.manager [req-75c2d99b-c661-4d7c-bc33-1e9a171b4ce7 req-3cd70f8c-0d9e-42c1-9b82-24eb7e4ea34c service nova] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] No waiting events found dispatching network-vif-plugged-12acc77d-6a56-426a-acda-16438c358c44 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:06:01 user nova-compute[71874]: WARNING nova.compute.manager [req-75c2d99b-c661-4d7c-bc33-1e9a171b4ce7 req-3cd70f8c-0d9e-42c1-9b82-24eb7e4ea34c service nova] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] Received unexpected event network-vif-plugged-12acc77d-6a56-426a-acda-16438c358c44 for instance with vm_state active and task_state deleting.
Apr 12 16:06:02 user nova-compute[71874]: DEBUG nova.network.neutron [-] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] Updating instance_info_cache with network_info: [] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:06:02 user nova-compute[71874]: INFO nova.compute.manager [-] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] Took 0.88 seconds to deallocate network for instance.
Apr 12 16:06:02 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-9e9e616c-c437-4fb2-8a30-cbd3fe87f133 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:06:02 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-9e9e616c-c437-4fb2-8a30-cbd3fe87f133 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:06:02 user nova-compute[71874]: DEBUG nova.compute.manager [req-bbd6296b-f3a0-4e8b-ae23-55da4edae5a2 req-b70a194b-0b7f-49b0-a1d5-daf191f2920d service nova] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] Received event network-vif-deleted-12acc77d-6a56-426a-acda-16438c358c44 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:06:02 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-9e9e616c-c437-4fb2-8a30-cbd3fe87f133 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Inventory has not changed in ProviderTree for provider: 0e94b4c8-cd49-45e4-9133-d36eb4b2456b {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 16:06:02 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-9e9e616c-c437-4fb2-8a30-cbd3fe87f133 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Inventory has not changed for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 16:06:02 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-9e9e616c-c437-4fb2-8a30-cbd3fe87f133 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.307s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:06:02 user nova-compute[71874]: INFO nova.scheduler.client.report [None req-9e9e616c-c437-4fb2-8a30-cbd3fe87f133 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Deleted allocations for instance fc19fd8d-3285-4ceb-8714-a0ba139f3045
Apr 12 16:06:02 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-9e9e616c-c437-4fb2-8a30-cbd3fe87f133 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "fc19fd8d-3285-4ceb-8714-a0ba139f3045" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.095s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:06:02 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:06:03 user nova-compute[71874]: DEBUG nova.compute.manager [req-b6dae3b8-d882-45a7-8885-3ab155aba682 req-a17b975f-f40b-48df-a2d5-5ba14f00e5c9 service nova] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] Received event network-vif-plugged-c4b29e0b-0ad8-4897-acf3-76004ac0338b {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:06:03 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-b6dae3b8-d882-45a7-8885-3ab155aba682 req-a17b975f-f40b-48df-a2d5-5ba14f00e5c9 service nova] Acquiring lock "afebffae-dbf6-4876-8c9f-0364f0fde49c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:06:03 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-b6dae3b8-d882-45a7-8885-3ab155aba682 req-a17b975f-f40b-48df-a2d5-5ba14f00e5c9 service nova] Lock "afebffae-dbf6-4876-8c9f-0364f0fde49c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:06:03 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-b6dae3b8-d882-45a7-8885-3ab155aba682 req-a17b975f-f40b-48df-a2d5-5ba14f00e5c9 service nova] Lock "afebffae-dbf6-4876-8c9f-0364f0fde49c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:06:03 user nova-compute[71874]: DEBUG nova.compute.manager [req-b6dae3b8-d882-45a7-8885-3ab155aba682 req-a17b975f-f40b-48df-a2d5-5ba14f00e5c9 service nova] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] No waiting events found dispatching network-vif-plugged-c4b29e0b-0ad8-4897-acf3-76004ac0338b {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:06:03 user nova-compute[71874]: WARNING nova.compute.manager [req-b6dae3b8-d882-45a7-8885-3ab155aba682 req-a17b975f-f40b-48df-a2d5-5ba14f00e5c9 service nova] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] Received unexpected event network-vif-plugged-c4b29e0b-0ad8-4897-acf3-76004ac0338b for instance with vm_state rescued and task_state unrescuing.
Apr 12 16:06:03 user nova-compute[71874]: DEBUG nova.virt.libvirt.host [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Removed pending event for afebffae-dbf6-4876-8c9f-0364f0fde49c due to event {{(pid=71874) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 12 16:06:03 user nova-compute[71874]: DEBUG nova.virt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Emitting event <LifecycleEvent: 1681315563.0490367, afebffae-dbf6-4876-8c9f-0364f0fde49c => Resumed> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:06:03 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] VM Resumed (Lifecycle Event)
Apr 12 16:06:03 user nova-compute[71874]: DEBUG nova.compute.manager [None req-5b6d5177-c9a9-4f68-8e43-b497ac0f92ed tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:06:03 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:06:03 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 16:06:03 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 12 16:06:03 user nova-compute[71874]: DEBUG nova.virt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Emitting event <LifecycleEvent: 1681315563.0506186, afebffae-dbf6-4876-8c9f-0364f0fde49c => Started> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:06:03 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] VM Started (Lifecycle Event)
Apr 12 16:06:03 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:06:03 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 16:06:04 user nova-compute[71874]: INFO nova.compute.manager [None req-7a86f91a-8991-48ab-a169-216f8c465f09 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] Unrescuing
Apr 12 16:06:04 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-7a86f91a-8991-48ab-a169-216f8c465f09 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Acquiring lock "refresh_cache-f52ee906-c8fd-4cd5-842e-de98a5099c4f" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:06:04 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-7a86f91a-8991-48ab-a169-216f8c465f09 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Acquired lock "refresh_cache-f52ee906-c8fd-4cd5-842e-de98a5099c4f" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:06:04 user nova-compute[71874]: DEBUG nova.network.neutron [None req-7a86f91a-8991-48ab-a169-216f8c465f09 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] Building network info cache for instance {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 16:06:05 user nova-compute[71874]: DEBUG nova.network.neutron [None req-7a86f91a-8991-48ab-a169-216f8c465f09 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] Updating instance_info_cache with network_info: [{"id": "955511f0-eca8-447d-a105-fdd5f182de62", "address": "fa:16:3e:ec:61:14", "network": {"id": "b36306e0-04c5-4b1b-8022-05ff121c4e43", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1503204786-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9210f81232304e179d3e09914a492442", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap955511f0-ec", "ovs_interfaceid": "955511f0-eca8-447d-a105-fdd5f182de62", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:06:05 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-7a86f91a-8991-48ab-a169-216f8c465f09 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Releasing lock "refresh_cache-f52ee906-c8fd-4cd5-842e-de98a5099c4f" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:06:05 user nova-compute[71874]: DEBUG nova.objects.instance [None req-7a86f91a-8991-48ab-a169-216f8c465f09 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lazy-loading 'flavor' on Instance uuid f52ee906-c8fd-4cd5-842e-de98a5099c4f {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:06:05 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._sync_power_states {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:06:05 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:06:05 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:06:05 user nova-compute[71874]: DEBUG nova.compute.manager [req-146c6bf1-2062-4d3e-9c20-4dc21a7f3f3e req-c8637b6d-6f86-4a7a-a9bf-edf9919da0d6 service nova] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] Received event network-vif-unplugged-955511f0-eca8-447d-a105-fdd5f182de62 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:06:05 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-146c6bf1-2062-4d3e-9c20-4dc21a7f3f3e req-c8637b6d-6f86-4a7a-a9bf-edf9919da0d6 service nova] Acquiring lock "f52ee906-c8fd-4cd5-842e-de98a5099c4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:06:05 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-146c6bf1-2062-4d3e-9c20-4dc21a7f3f3e req-c8637b6d-6f86-4a7a-a9bf-edf9919da0d6 service nova] Lock "f52ee906-c8fd-4cd5-842e-de98a5099c4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:06:05 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-146c6bf1-2062-4d3e-9c20-4dc21a7f3f3e req-c8637b6d-6f86-4a7a-a9bf-edf9919da0d6 service nova] Lock "f52ee906-c8fd-4cd5-842e-de98a5099c4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:06:05 user nova-compute[71874]: DEBUG nova.compute.manager [req-146c6bf1-2062-4d3e-9c20-4dc21a7f3f3e req-c8637b6d-6f86-4a7a-a9bf-edf9919da0d6 service nova] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] No waiting events found dispatching network-vif-unplugged-955511f0-eca8-447d-a105-fdd5f182de62 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:06:05 user nova-compute[71874]: WARNING nova.compute.manager [req-146c6bf1-2062-4d3e-9c20-4dc21a7f3f3e req-c8637b6d-6f86-4a7a-a9bf-edf9919da0d6 service nova] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] Received unexpected event network-vif-unplugged-955511f0-eca8-447d-a105-fdd5f182de62 for instance with vm_state rescued and task_state unrescuing.
Apr 12 16:06:05 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:06:05 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:06:05 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Triggering sync for uuid afebffae-dbf6-4876-8c9f-0364f0fde49c {{(pid=71874) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 16:06:05 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Triggering sync for uuid 473a30c4-5aa4-481c-8859-fda815d14872 {{(pid=71874) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 16:06:05 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Triggering sync for uuid 608fbea2-b42b-4bb9-94a7-2b76dcdc2001 {{(pid=71874) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 16:06:05 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Triggering sync for uuid f52ee906-c8fd-4cd5-842e-de98a5099c4f {{(pid=71874) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 16:06:05 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Triggering sync for uuid ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e {{(pid=71874) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 16:06:05 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Triggering sync for uuid 6caa4977-8333-4171-8825-2c3bfb52f80b {{(pid=71874) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 16:06:05 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Triggering sync for uuid 7835bdfc-77dc-4407-8a0a-ef81eca29c91 {{(pid=71874) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 16:06:05 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Triggering sync for uuid cb8fd1e4-401b-4f73-a789-b7183f9003fb {{(pid=71874) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 16:06:05 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Triggering sync for uuid dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 {{(pid=71874) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 16:06:05 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquiring lock "afebffae-dbf6-4876-8c9f-0364f0fde49c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:06:05 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "afebffae-dbf6-4876-8c9f-0364f0fde49c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:06:05 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquiring lock "473a30c4-5aa4-481c-8859-fda815d14872" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:06:05 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "473a30c4-5aa4-481c-8859-fda815d14872" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:06:05 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquiring lock "608fbea2-b42b-4bb9-94a7-2b76dcdc2001" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:06:05 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "608fbea2-b42b-4bb9-94a7-2b76dcdc2001" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:06:05 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquiring lock "f52ee906-c8fd-4cd5-842e-de98a5099c4f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:06:05 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "f52ee906-c8fd-4cd5-842e-de98a5099c4f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:06:05 user nova-compute[71874]: INFO nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 12 16:06:05 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "f52ee906-c8fd-4cd5-842e-de98a5099c4f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:06:05 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquiring lock "ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:06:05 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:06:05 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquiring lock "6caa4977-8333-4171-8825-2c3bfb52f80b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:06:05 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "6caa4977-8333-4171-8825-2c3bfb52f80b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:06:05 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquiring lock "7835bdfc-77dc-4407-8a0a-ef81eca29c91" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:06:05 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "7835bdfc-77dc-4407-8a0a-ef81eca29c91" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:06:05 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquiring lock "cb8fd1e4-401b-4f73-a789-b7183f9003fb" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:06:05 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "cb8fd1e4-401b-4f73-a789-b7183f9003fb" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:06:05 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquiring lock "dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:06:05 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:06:05 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "608fbea2-b42b-4bb9-94a7-2b76dcdc2001" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.076s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:06:05 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "7835bdfc-77dc-4407-8a0a-ef81eca29c91" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.073s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:06:05 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "afebffae-dbf6-4876-8c9f-0364f0fde49c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.088s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:06:05 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.092s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:06:05 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "cb8fd1e4-401b-4f73-a789-b7183f9003fb" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.101s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:06:05 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "473a30c4-5aa4-481c-8859-fda815d14872" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.108s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:06:05 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "6caa4977-8333-4171-8825-2c3bfb52f80b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.109s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:06:05 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.127s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:06:06 user nova-compute[71874]: INFO nova.virt.libvirt.driver [-] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] Instance destroyed successfully.
Apr 12 16:06:06 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:06:07 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:06:07 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:06:07 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:06:07 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:06:07 user nova-compute[71874]: DEBUG nova.compute.manager [req-122a67ef-bc0b-4d34-95be-778ab1b185aa req-f293a0a6-b53c-4a92-9f5b-c786400e7d4b service nova] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] Received event network-vif-plugged-955511f0-eca8-447d-a105-fdd5f182de62 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:06:07 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-122a67ef-bc0b-4d34-95be-778ab1b185aa req-f293a0a6-b53c-4a92-9f5b-c786400e7d4b service nova] Acquiring lock "f52ee906-c8fd-4cd5-842e-de98a5099c4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:06:07 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-122a67ef-bc0b-4d34-95be-778ab1b185aa req-f293a0a6-b53c-4a92-9f5b-c786400e7d4b service nova] Lock "f52ee906-c8fd-4cd5-842e-de98a5099c4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:06:07 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-122a67ef-bc0b-4d34-95be-778ab1b185aa req-f293a0a6-b53c-4a92-9f5b-c786400e7d4b service nova] Lock "f52ee906-c8fd-4cd5-842e-de98a5099c4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:06:07 user nova-compute[71874]: DEBUG nova.compute.manager [req-122a67ef-bc0b-4d34-95be-778ab1b185aa req-f293a0a6-b53c-4a92-9f5b-c786400e7d4b service nova] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] No waiting events found dispatching network-vif-plugged-955511f0-eca8-447d-a105-fdd5f182de62 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:06:07 user nova-compute[71874]: WARNING nova.compute.manager [req-122a67ef-bc0b-4d34-95be-778ab1b185aa req-f293a0a6-b53c-4a92-9f5b-c786400e7d4b service nova] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] Received unexpected event network-vif-plugged-955511f0-eca8-447d-a105-fdd5f182de62 for instance with vm_state rescued and task_state unrescuing.
Apr 12 16:06:07 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:06:07 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:06:07 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:06:09 user nova-compute[71874]: DEBUG nova.compute.manager [req-09861049-98b6-4c99-ae12-05d42ca1f293 req-23ae7fc4-1cb7-4032-a256-605530e0eea3 service nova] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] Received event network-vif-plugged-955511f0-eca8-447d-a105-fdd5f182de62 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:06:09 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-09861049-98b6-4c99-ae12-05d42ca1f293 req-23ae7fc4-1cb7-4032-a256-605530e0eea3 service nova] Acquiring lock "f52ee906-c8fd-4cd5-842e-de98a5099c4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:06:09 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-09861049-98b6-4c99-ae12-05d42ca1f293 req-23ae7fc4-1cb7-4032-a256-605530e0eea3 service nova] Lock "f52ee906-c8fd-4cd5-842e-de98a5099c4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:06:09 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-09861049-98b6-4c99-ae12-05d42ca1f293 req-23ae7fc4-1cb7-4032-a256-605530e0eea3 service nova] Lock "f52ee906-c8fd-4cd5-842e-de98a5099c4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:06:09 user nova-compute[71874]: DEBUG nova.compute.manager [req-09861049-98b6-4c99-ae12-05d42ca1f293 req-23ae7fc4-1cb7-4032-a256-605530e0eea3 service nova] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] No waiting events found dispatching network-vif-plugged-955511f0-eca8-447d-a105-fdd5f182de62 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:06:09 user nova-compute[71874]: WARNING nova.compute.manager [req-09861049-98b6-4c99-ae12-05d42ca1f293 req-23ae7fc4-1cb7-4032-a256-605530e0eea3 service nova] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] Received unexpected event network-vif-plugged-955511f0-eca8-447d-a105-fdd5f182de62 for instance with vm_state rescued and task_state unrescuing.
Apr 12 16:06:09 user nova-compute[71874]: DEBUG nova.compute.manager [req-09861049-98b6-4c99-ae12-05d42ca1f293 req-23ae7fc4-1cb7-4032-a256-605530e0eea3 service nova] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] Received event network-vif-plugged-955511f0-eca8-447d-a105-fdd5f182de62 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:06:09 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-09861049-98b6-4c99-ae12-05d42ca1f293 req-23ae7fc4-1cb7-4032-a256-605530e0eea3 service nova] Acquiring lock "f52ee906-c8fd-4cd5-842e-de98a5099c4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:06:09 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-09861049-98b6-4c99-ae12-05d42ca1f293 req-23ae7fc4-1cb7-4032-a256-605530e0eea3 service nova] Lock "f52ee906-c8fd-4cd5-842e-de98a5099c4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:06:09 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-09861049-98b6-4c99-ae12-05d42ca1f293 req-23ae7fc4-1cb7-4032-a256-605530e0eea3 service nova] Lock "f52ee906-c8fd-4cd5-842e-de98a5099c4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:06:09 user nova-compute[71874]: DEBUG nova.compute.manager [req-09861049-98b6-4c99-ae12-05d42ca1f293 req-23ae7fc4-1cb7-4032-a256-605530e0eea3 service nova] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] No waiting events found dispatching network-vif-plugged-955511f0-eca8-447d-a105-fdd5f182de62 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:06:09 user nova-compute[71874]: WARNING nova.compute.manager [req-09861049-98b6-4c99-ae12-05d42ca1f293 req-23ae7fc4-1cb7-4032-a256-605530e0eea3 service nova] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] Received unexpected event network-vif-plugged-955511f0-eca8-447d-a105-fdd5f182de62 for instance with vm_state rescued and task_state unrescuing.
Apr 12 16:06:09 user nova-compute[71874]: DEBUG nova.virt.libvirt.host [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Removed pending event for f52ee906-c8fd-4cd5-842e-de98a5099c4f due to event {{(pid=71874) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 12 16:06:09 user nova-compute[71874]: DEBUG nova.virt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Emitting event <LifecycleEvent: 1681315569.8534691, f52ee906-c8fd-4cd5-842e-de98a5099c4f => Resumed> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:06:09 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] VM Resumed (Lifecycle Event)
Apr 12 16:06:09 user nova-compute[71874]: DEBUG nova.compute.manager [None req-7a86f91a-8991-48ab-a169-216f8c465f09 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:06:09 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:06:09 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 16:06:09 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 12 16:06:09 user nova-compute[71874]: DEBUG nova.virt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Emitting event <LifecycleEvent: 1681315569.8633604, f52ee906-c8fd-4cd5-842e-de98a5099c4f => Started> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:06:09 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] VM Started (Lifecycle Event)
Apr 12 16:06:09 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:06:09 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 16:06:11 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:06:11 user nova-compute[71874]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681315556.4305522, 85b91251-9735-4812-9f11-003a7951a6f3 => Stopped> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:06:11 user nova-compute[71874]: INFO nova.compute.manager [-] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] VM Stopped (Lifecycle Event)
Apr 12 16:06:11 user nova-compute[71874]: DEBUG nova.compute.manager [None req-c6c62eac-9234-4b4c-81d8-bdb76a8124a6 None None] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:06:11 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-08cfde56-c547-4ee6-9b8e-722504f28c1e tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "357dd90d-8c53-4193-ad64-edfa894116cf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:06:11 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-08cfde56-c547-4ee6-9b8e-722504f28c1e tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "357dd90d-8c53-4193-ad64-edfa894116cf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:06:11 user nova-compute[71874]: DEBUG nova.compute.manager [None req-08cfde56-c547-4ee6-9b8e-722504f28c1e tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: 357dd90d-8c53-4193-ad64-edfa894116cf] Starting instance... {{(pid=71874) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 16:06:11 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-08cfde56-c547-4ee6-9b8e-722504f28c1e tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:06:11 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-08cfde56-c547-4ee6-9b8e-722504f28c1e tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:06:11 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-08cfde56-c547-4ee6-9b8e-722504f28c1e tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71874) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 16:06:11 user nova-compute[71874]: INFO nova.compute.claims [None req-08cfde56-c547-4ee6-9b8e-722504f28c1e tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: 357dd90d-8c53-4193-ad64-edfa894116cf] Claim successful on node user
Apr 12 16:06:12 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-08cfde56-c547-4ee6-9b8e-722504f28c1e tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Inventory has not changed in ProviderTree for provider: 0e94b4c8-cd49-45e4-9133-d36eb4b2456b {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 16:06:12 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-08cfde56-c547-4ee6-9b8e-722504f28c1e tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Inventory has not changed for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 16:06:12 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-08cfde56-c547-4ee6-9b8e-722504f28c1e tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.570s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:06:12 user nova-compute[71874]: DEBUG nova.compute.manager [None req-08cfde56-c547-4ee6-9b8e-722504f28c1e tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: 357dd90d-8c53-4193-ad64-edfa894116cf] Start building networks asynchronously for instance. {{(pid=71874) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 16:06:12 user nova-compute[71874]: DEBUG nova.compute.manager [None req-08cfde56-c547-4ee6-9b8e-722504f28c1e tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: 357dd90d-8c53-4193-ad64-edfa894116cf] Allocating IP information in the background. {{(pid=71874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 16:06:12 user nova-compute[71874]: DEBUG nova.network.neutron [None req-08cfde56-c547-4ee6-9b8e-722504f28c1e tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: 357dd90d-8c53-4193-ad64-edfa894116cf] allocate_for_instance() {{(pid=71874) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 16:06:12 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-08cfde56-c547-4ee6-9b8e-722504f28c1e tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: 357dd90d-8c53-4193-ad64-edfa894116cf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 16:06:12 user nova-compute[71874]: DEBUG nova.compute.manager [None req-08cfde56-c547-4ee6-9b8e-722504f28c1e tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: 357dd90d-8c53-4193-ad64-edfa894116cf] Start building block device mappings for instance. {{(pid=71874) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 16:06:12 user nova-compute[71874]: DEBUG nova.policy [None req-08cfde56-c547-4ee6-9b8e-722504f28c1e tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5a514f6d877a4ab0bec597fee13ce9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d940eae5394293b87cfced45911ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71874) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 16:06:12 user nova-compute[71874]: DEBUG nova.compute.manager [None req-08cfde56-c547-4ee6-9b8e-722504f28c1e tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: 357dd90d-8c53-4193-ad64-edfa894116cf] Start spawning the instance on the hypervisor. {{(pid=71874) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 16:06:12 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-08cfde56-c547-4ee6-9b8e-722504f28c1e tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: 357dd90d-8c53-4193-ad64-edfa894116cf] Creating instance directory {{(pid=71874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 16:06:12 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-08cfde56-c547-4ee6-9b8e-722504f28c1e tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: 357dd90d-8c53-4193-ad64-edfa894116cf] Creating image(s)
Apr 12 16:06:12 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-08cfde56-c547-4ee6-9b8e-722504f28c1e tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "/opt/stack/data/nova/instances/357dd90d-8c53-4193-ad64-edfa894116cf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:06:12 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-08cfde56-c547-4ee6-9b8e-722504f28c1e tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "/opt/stack/data/nova/instances/357dd90d-8c53-4193-ad64-edfa894116cf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:06:12 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-08cfde56-c547-4ee6-9b8e-722504f28c1e tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "/opt/stack/data/nova/instances/357dd90d-8c53-4193-ad64-edfa894116cf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:06:12 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-08cfde56-c547-4ee6-9b8e-722504f28c1e tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:06:12 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-08cfde56-c547-4ee6-9b8e-722504f28c1e tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json" returned: 0 in 0.138s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:06:12 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-08cfde56-c547-4ee6-9b8e-722504f28c1e tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "b88df1b37cb431f52bc53b5616015c89b5bec411" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:06:12 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-08cfde56-c547-4ee6-9b8e-722504f28c1e tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "b88df1b37cb431f52bc53b5616015c89b5bec411" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:06:12 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-08cfde56-c547-4ee6-9b8e-722504f28c1e tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:06:12 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-08cfde56-c547-4ee6-9b8e-722504f28c1e tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json" returned: 0 in 0.158s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:06:12 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-08cfde56-c547-4ee6-9b8e-722504f28c1e tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411,backing_fmt=raw /opt/stack/data/nova/instances/357dd90d-8c53-4193-ad64-edfa894116cf/disk 1073741824 {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:06:12 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:06:12 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-08cfde56-c547-4ee6-9b8e-722504f28c1e tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411,backing_fmt=raw /opt/stack/data/nova/instances/357dd90d-8c53-4193-ad64-edfa894116cf/disk 1073741824" returned: 0 in 0.062s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:06:12 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-08cfde56-c547-4ee6-9b8e-722504f28c1e tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "b88df1b37cb431f52bc53b5616015c89b5bec411" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.226s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:06:12 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-08cfde56-c547-4ee6-9b8e-722504f28c1e tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:06:12 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-08cfde56-c547-4ee6-9b8e-722504f28c1e tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json" returned: 0 in 0.137s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:06:12 user nova-compute[71874]: DEBUG nova.virt.disk.api [None req-08cfde56-c547-4ee6-9b8e-722504f28c1e tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Checking if we can resize image /opt/stack/data/nova/instances/357dd90d-8c53-4193-ad64-edfa894116cf/disk. size=1073741824 {{(pid=71874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 16:06:12 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-08cfde56-c547-4ee6-9b8e-722504f28c1e tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/357dd90d-8c53-4193-ad64-edfa894116cf/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:06:13 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-08cfde56-c547-4ee6-9b8e-722504f28c1e tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/357dd90d-8c53-4193-ad64-edfa894116cf/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:06:13 user nova-compute[71874]: DEBUG nova.virt.disk.api [None req-08cfde56-c547-4ee6-9b8e-722504f28c1e tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Cannot resize image /opt/stack/data/nova/instances/357dd90d-8c53-4193-ad64-edfa894116cf/disk to a smaller size. {{(pid=71874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 16:06:13 user nova-compute[71874]: DEBUG nova.objects.instance [None req-08cfde56-c547-4ee6-9b8e-722504f28c1e tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lazy-loading 'migration_context' on Instance uuid 357dd90d-8c53-4193-ad64-edfa894116cf {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:06:13 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-08cfde56-c547-4ee6-9b8e-722504f28c1e tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: 357dd90d-8c53-4193-ad64-edfa894116cf] Created local disks {{(pid=71874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 16:06:13 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-08cfde56-c547-4ee6-9b8e-722504f28c1e tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: 357dd90d-8c53-4193-ad64-edfa894116cf] Ensure instance console log exists: /opt/stack/data/nova/instances/357dd90d-8c53-4193-ad64-edfa894116cf/console.log {{(pid=71874) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 16:06:13 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-08cfde56-c547-4ee6-9b8e-722504f28c1e tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:06:13 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-08cfde56-c547-4ee6-9b8e-722504f28c1e tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:06:13 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-08cfde56-c547-4ee6-9b8e-722504f28c1e tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:06:13 user nova-compute[71874]: DEBUG nova.network.neutron [None req-08cfde56-c547-4ee6-9b8e-722504f28c1e tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: 357dd90d-8c53-4193-ad64-edfa894116cf] Successfully created port: 94db3bc9-9ecc-4f15-8105-4abb2ff9d1e5 {{(pid=71874) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 16:06:14 user nova-compute[71874]: DEBUG nova.network.neutron [None req-08cfde56-c547-4ee6-9b8e-722504f28c1e tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: 357dd90d-8c53-4193-ad64-edfa894116cf] Successfully updated port: 94db3bc9-9ecc-4f15-8105-4abb2ff9d1e5 {{(pid=71874) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 16:06:14 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-08cfde56-c547-4ee6-9b8e-722504f28c1e tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "refresh_cache-357dd90d-8c53-4193-ad64-edfa894116cf" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:06:14 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-08cfde56-c547-4ee6-9b8e-722504f28c1e tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquired lock "refresh_cache-357dd90d-8c53-4193-ad64-edfa894116cf" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:06:14 user nova-compute[71874]: DEBUG nova.network.neutron [None req-08cfde56-c547-4ee6-9b8e-722504f28c1e tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: 357dd90d-8c53-4193-ad64-edfa894116cf] Building network info cache for instance {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 16:06:14 user nova-compute[71874]: DEBUG nova.compute.manager [req-6a039674-f123-44ae-b85c-446c84fa143b req-e2a9208b-12a7-454f-bbaa-92bfff179603 service nova] [instance: 357dd90d-8c53-4193-ad64-edfa894116cf] Received event network-changed-94db3bc9-9ecc-4f15-8105-4abb2ff9d1e5 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:06:14 user nova-compute[71874]: DEBUG nova.compute.manager [req-6a039674-f123-44ae-b85c-446c84fa143b req-e2a9208b-12a7-454f-bbaa-92bfff179603 service nova] [instance: 357dd90d-8c53-4193-ad64-edfa894116cf] Refreshing instance network info cache due to event network-changed-94db3bc9-9ecc-4f15-8105-4abb2ff9d1e5. {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 16:06:14 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-6a039674-f123-44ae-b85c-446c84fa143b req-e2a9208b-12a7-454f-bbaa-92bfff179603 service nova] Acquiring lock "refresh_cache-357dd90d-8c53-4193-ad64-edfa894116cf" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:06:14 user nova-compute[71874]: DEBUG nova.network.neutron [None req-08cfde56-c547-4ee6-9b8e-722504f28c1e tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: 357dd90d-8c53-4193-ad64-edfa894116cf] Instance cache missing network info. {{(pid=71874) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 16:06:14 user nova-compute[71874]: DEBUG nova.network.neutron [None req-08cfde56-c547-4ee6-9b8e-722504f28c1e tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: 357dd90d-8c53-4193-ad64-edfa894116cf] Updating instance_info_cache with network_info: [{"id": "94db3bc9-9ecc-4f15-8105-4abb2ff9d1e5", "address": "fa:16:3e:54:6b:70", "network": {"id": "e71b9966-9a95-4f66-b3b1-36b05d05853c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-310205564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28d940eae5394293b87cfced45911ab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94db3bc9-9e", "ovs_interfaceid": "94db3bc9-9ecc-4f15-8105-4abb2ff9d1e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:06:14 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-08cfde56-c547-4ee6-9b8e-722504f28c1e tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Releasing lock "refresh_cache-357dd90d-8c53-4193-ad64-edfa894116cf" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:06:14 user nova-compute[71874]: DEBUG nova.compute.manager [None req-08cfde56-c547-4ee6-9b8e-722504f28c1e tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: 357dd90d-8c53-4193-ad64-edfa894116cf] Instance network_info: |[{"id": "94db3bc9-9ecc-4f15-8105-4abb2ff9d1e5", "address": "fa:16:3e:54:6b:70", "network": {"id": "e71b9966-9a95-4f66-b3b1-36b05d05853c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-310205564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28d940eae5394293b87cfced45911ab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94db3bc9-9e", "ovs_interfaceid": "94db3bc9-9ecc-4f15-8105-4abb2ff9d1e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 16:06:14 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-6a039674-f123-44ae-b85c-446c84fa143b req-e2a9208b-12a7-454f-bbaa-92bfff179603 service nova] Acquired lock "refresh_cache-357dd90d-8c53-4193-ad64-edfa894116cf" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:06:14 user nova-compute[71874]: DEBUG nova.network.neutron [req-6a039674-f123-44ae-b85c-446c84fa143b req-e2a9208b-12a7-454f-bbaa-92bfff179603 service nova] [instance: 357dd90d-8c53-4193-ad64-edfa894116cf] Refreshing network info cache for port 94db3bc9-9ecc-4f15-8105-4abb2ff9d1e5 {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 16:06:14 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-08cfde56-c547-4ee6-9b8e-722504f28c1e tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: 357dd90d-8c53-4193-ad64-edfa894116cf] Start _get_guest_xml network_info=[{"id": "94db3bc9-9ecc-4f15-8105-4abb2ff9d1e5", "address": "fa:16:3e:54:6b:70", "network": {"id": "e71b9966-9a95-4f66-b3b1-36b05d05853c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-310205564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28d940eae5394293b87cfced45911ab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94db3bc9-9e", "ovs_interfaceid": "94db3bc9-9ecc-4f15-8105-4abb2ff9d1e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T15:55:37Z,direct_url=<?>,disk_format='qcow2',id=9dc63f14-8b70-4e72-89f2-13464f2f5c7c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='61a4936d9b7744c0b488d81c9b7746b6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T15:55:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_options': None, 'image_id': '9dc63f14-8b70-4e72-89f2-13464f2f5c7c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 16:06:14 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-08cfde56-c547-4ee6-9b8e-722504f28c1e tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:06:14 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-08cfde56-c547-4ee6-9b8e-722504f28c1e tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:06:14 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-08cfde56-c547-4ee6-9b8e-722504f28c1e tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71874) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 16:06:14 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-08cfde56-c547-4ee6-9b8e-722504f28c1e tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T15:56:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T15:55:37Z,direct_url=<?>,disk_format='qcow2',id=9dc63f14-8b70-4e72-89f2-13464f2f5c7c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='61a4936d9b7744c0b488d81c9b7746b6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T15:55:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 16:06:14 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-08cfde56-c547-4ee6-9b8e-722504f28c1e tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Flavor limits 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 16:06:14 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-08cfde56-c547-4ee6-9b8e-722504f28c1e tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Image limits 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 16:06:14 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-08cfde56-c547-4ee6-9b8e-722504f28c1e tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Flavor pref 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 16:06:14 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-08cfde56-c547-4ee6-9b8e-722504f28c1e tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Image pref 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 16:06:14 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-08cfde56-c547-4ee6-9b8e-722504f28c1e tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 16:06:14 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-08cfde56-c547-4ee6-9b8e-722504f28c1e tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 16:06:14 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-08cfde56-c547-4ee6-9b8e-722504f28c1e tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 16:06:14 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-08cfde56-c547-4ee6-9b8e-722504f28c1e tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Got 1 possible topologies {{(pid=71874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 16:06:14 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-08cfde56-c547-4ee6-9b8e-722504f28c1e tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 16:06:14 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-08cfde56-c547-4ee6-9b8e-722504f28c1e tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 16:06:14 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-08cfde56-c547-4ee6-9b8e-722504f28c1e tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T16:06:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1232221601',display_name='tempest-AttachVolumeNegativeTest-server-1232221601',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1232221601',id=21,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC4UqVSrXTZPE0h1pNy8WZ39Xoqx7byNd1eHVKVZr8IHkBtOGiIXjeTZ8D3+H3VbKhpwfaxKPTTKJQl1smfAloYLeCFE5oooBxOGWYDpen8kfXtiH1Xjes2DlXqlGRiLIw==',key_name='tempest-keypair-724661013',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='28d940eae5394293b87cfced45911ab4',ramdisk_id='',reservation_id='r-5lgxvid1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-288610953',owner_user_name='tempest-AttachVolumeNegativeTest-288610953-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T16:06:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5a514f6d877a4ab0bec597fee13ce9db',uuid=357dd90d-8c53-4193-ad64-edfa894116cf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "94db3bc9-9ecc-4f15-8105-4abb2ff9d1e5", "address": "fa:16:3e:54:6b:70", "network": {"id": "e71b9966-9a95-4f66-b3b1-36b05d05853c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-310205564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28d940eae5394293b87cfced45911ab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94db3bc9-9e", "ovs_interfaceid": "94db3bc9-9ecc-4f15-8105-4abb2ff9d1e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 16:06:14 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-08cfde56-c547-4ee6-9b8e-722504f28c1e tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Converting VIF {"id": "94db3bc9-9ecc-4f15-8105-4abb2ff9d1e5", "address": "fa:16:3e:54:6b:70", "network": {"id": "e71b9966-9a95-4f66-b3b1-36b05d05853c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-310205564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28d940eae5394293b87cfced45911ab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94db3bc9-9e", "ovs_interfaceid": "94db3bc9-9ecc-4f15-8105-4abb2ff9d1e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:06:14 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-08cfde56-c547-4ee6-9b8e-722504f28c1e tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:6b:70,bridge_name='br-int',has_traffic_filtering=True,id=94db3bc9-9ecc-4f15-8105-4abb2ff9d1e5,network=Network(e71b9966-9a95-4f66-b3b1-36b05d05853c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94db3bc9-9e') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:06:14 user nova-compute[71874]: DEBUG nova.objects.instance [None req-08cfde56-c547-4ee6-9b8e-722504f28c1e tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lazy-loading 'pci_devices' on Instance uuid 357dd90d-8c53-4193-ad64-edfa894116cf {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:06:14 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-08cfde56-c547-4ee6-9b8e-722504f28c1e tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: 357dd90d-8c53-4193-ad64-edfa894116cf] End _get_guest_xml xml=<domain type="kvm">
Apr 12 16:06:14 user nova-compute[71874]:   <uuid>357dd90d-8c53-4193-ad64-edfa894116cf</uuid>
Apr 12 16:06:14 user nova-compute[71874]:   <name>instance-00000015</name>
Apr 12 16:06:14 user nova-compute[71874]:   <memory>131072</memory>
Apr 12 16:06:14 user nova-compute[71874]:   <vcpu>1</vcpu>
Apr 12 16:06:14 user nova-compute[71874]:   <metadata>
Apr 12 16:06:14 user nova-compute[71874]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 16:06:14 user nova-compute[71874]:       <nova:package version="0.0.0"/>
Apr 12 16:06:14 user nova-compute[71874]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1232221601</nova:name>
Apr 12 16:06:14 user nova-compute[71874]:       <nova:creationTime>2023-04-12 16:06:14</nova:creationTime>
Apr 12 16:06:14 user nova-compute[71874]:       <nova:flavor name="m1.nano">
Apr 12 16:06:14 user nova-compute[71874]:         <nova:memory>128</nova:memory>
Apr 12 16:06:14 user nova-compute[71874]:         <nova:disk>1</nova:disk>
Apr 12 16:06:14 user nova-compute[71874]:         <nova:swap>0</nova:swap>
Apr 12 16:06:14 user nova-compute[71874]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 16:06:14 user nova-compute[71874]:         <nova:vcpus>1</nova:vcpus>
Apr 12 16:06:14 user nova-compute[71874]:       </nova:flavor>
Apr 12 16:06:14 user nova-compute[71874]:       <nova:owner>
Apr 12 16:06:14 user nova-compute[71874]:         <nova:user uuid="5a514f6d877a4ab0bec597fee13ce9db">tempest-AttachVolumeNegativeTest-288610953-project-member</nova:user>
Apr 12 16:06:14 user nova-compute[71874]:         <nova:project uuid="28d940eae5394293b87cfced45911ab4">tempest-AttachVolumeNegativeTest-288610953</nova:project>
Apr 12 16:06:14 user nova-compute[71874]:       </nova:owner>
Apr 12 16:06:14 user nova-compute[71874]:       <nova:root type="image" uuid="9dc63f14-8b70-4e72-89f2-13464f2f5c7c"/>
Apr 12 16:06:14 user nova-compute[71874]:       <nova:ports>
Apr 12 16:06:14 user nova-compute[71874]:         <nova:port uuid="94db3bc9-9ecc-4f15-8105-4abb2ff9d1e5">
Apr 12 16:06:14 user nova-compute[71874]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 12 16:06:14 user nova-compute[71874]:         </nova:port>
Apr 12 16:06:14 user nova-compute[71874]:       </nova:ports>
Apr 12 16:06:14 user nova-compute[71874]:     </nova:instance>
Apr 12 16:06:14 user nova-compute[71874]:   </metadata>
Apr 12 16:06:14 user nova-compute[71874]:   <sysinfo type="smbios">
Apr 12 16:06:14 user nova-compute[71874]:     <system>
Apr 12 16:06:14 user nova-compute[71874]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 16:06:14 user nova-compute[71874]:       <entry name="product">OpenStack Nova</entry>
Apr 12 16:06:14 user nova-compute[71874]:       <entry name="version">0.0.0</entry>
Apr 12 16:06:14 user nova-compute[71874]:       <entry name="serial">357dd90d-8c53-4193-ad64-edfa894116cf</entry>
Apr 12 16:06:14 user nova-compute[71874]:       <entry name="uuid">357dd90d-8c53-4193-ad64-edfa894116cf</entry>
Apr 12 16:06:14 user nova-compute[71874]:       <entry name="family">Virtual Machine</entry>
Apr 12 16:06:14 user nova-compute[71874]:     </system>
Apr 12 16:06:14 user nova-compute[71874]:   </sysinfo>
Apr 12 16:06:14 user nova-compute[71874]:   <os>
Apr 12 16:06:14 user nova-compute[71874]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 16:06:14 user nova-compute[71874]:     <boot dev="hd"/>
Apr 12 16:06:14 user nova-compute[71874]:     <smbios mode="sysinfo"/>
Apr 12 16:06:14 user nova-compute[71874]:   </os>
Apr 12 16:06:14 user nova-compute[71874]:   <features>
Apr 12 16:06:14 user nova-compute[71874]:     <acpi/>
Apr 12 16:06:14 user nova-compute[71874]:     <apic/>
Apr 12 16:06:14 user nova-compute[71874]:     <vmcoreinfo/>
Apr 12 16:06:14 user nova-compute[71874]:   </features>
Apr 12 16:06:14 user nova-compute[71874]:   <clock offset="utc">
Apr 12 16:06:14 user nova-compute[71874]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 16:06:14 user nova-compute[71874]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 16:06:14 user nova-compute[71874]:     <timer name="hpet" present="no"/>
Apr 12 16:06:14 user nova-compute[71874]:   </clock>
Apr 12 16:06:14 user nova-compute[71874]:   <cpu mode="custom" match="exact">
Apr 12 16:06:14 user nova-compute[71874]:     <model>Nehalem</model>
Apr 12 16:06:14 user nova-compute[71874]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 16:06:14 user nova-compute[71874]:   </cpu>
Apr 12 16:06:14 user nova-compute[71874]:   <devices>
Apr 12 16:06:14 user nova-compute[71874]:     <disk type="file" device="disk">
Apr 12 16:06:14 user nova-compute[71874]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 16:06:14 user nova-compute[71874]:       <source file="/opt/stack/data/nova/instances/357dd90d-8c53-4193-ad64-edfa894116cf/disk"/>
Apr 12 16:06:14 user nova-compute[71874]:       <target dev="vda" bus="virtio"/>
Apr 12 16:06:14 user nova-compute[71874]:     </disk>
Apr 12 16:06:14 user nova-compute[71874]:     <interface type="ethernet">
Apr 12 16:06:14 user nova-compute[71874]:       <mac address="fa:16:3e:54:6b:70"/>
Apr 12 16:06:14 user nova-compute[71874]:       <model type="virtio"/>
Apr 12 16:06:14 user nova-compute[71874]:       <mtu size="1442"/>
Apr 12 16:06:14 user nova-compute[71874]:       <target dev="tap94db3bc9-9e"/>
Apr 12 16:06:14 user nova-compute[71874]:     </interface>
Apr 12 16:06:14 user nova-compute[71874]:     <serial type="pty">
Apr 12 16:06:14 user nova-compute[71874]:       <log file="/opt/stack/data/nova/instances/357dd90d-8c53-4193-ad64-edfa894116cf/console.log" append="off"/>
Apr 12 16:06:14 user nova-compute[71874]:     </serial>
Apr 12 16:06:14 user nova-compute[71874]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 16:06:14 user nova-compute[71874]:     <video>
Apr 12 16:06:14 user nova-compute[71874]:       <model type="virtio"/>
Apr 12 16:06:14 user nova-compute[71874]:     </video>
Apr 12 16:06:14 user nova-compute[71874]:     <rng model="virtio">
Apr 12 16:06:14 user nova-compute[71874]:       <backend model="random">/dev/urandom</backend>
Apr 12 16:06:14 user nova-compute[71874]:     </rng>
Apr 12 16:06:14 user nova-compute[71874]:     <controller type="usb" index="0" model="none"/>
Apr 12 16:06:14 user nova-compute[71874]:     <memballoon model="virtio">
Apr 12 16:06:14 user nova-compute[71874]:       <stats period="10"/>
Apr 12 16:06:14 user nova-compute[71874]:     </memballoon>
Apr 12 16:06:14 user nova-compute[71874]:   </devices>
Apr 12 16:06:14 user nova-compute[71874]: </domain>
Apr 12 16:06:14 user nova-compute[71874]:  {{(pid=71874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 16:06:14 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-08cfde56-c547-4ee6-9b8e-722504f28c1e tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T16:06:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1232221601',display_name='tempest-AttachVolumeNegativeTest-server-1232221601',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1232221601',id=21,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC4UqVSrXTZPE0h1pNy8WZ39Xoqx7byNd1eHVKVZr8IHkBtOGiIXjeTZ8D3+H3VbKhpwfaxKPTTKJQl1smfAloYLeCFE5oooBxOGWYDpen8kfXtiH1Xjes2DlXqlGRiLIw==',key_name='tempest-keypair-724661013',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='28d940eae5394293b87cfced45911ab4',ramdisk_id='',reservation_id='r-5lgxvid1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-288610953',owner_user_name='tempest-AttachVolumeNegativeTest-288610953-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T16:06:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5a514f6d877a4ab0bec597fee13ce9db',uuid=357dd90d-8c53-4193-ad64-edfa894116cf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "94db3bc9-9ecc-4f15-8105-4abb2ff9d1e5", "address": "fa:16:3e:54:6b:70", "network": {"id": "e71b9966-9a95-4f66-b3b1-36b05d05853c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-310205564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28d940eae5394293b87cfced45911ab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94db3bc9-9e", "ovs_interfaceid": "94db3bc9-9ecc-4f15-8105-4abb2ff9d1e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 16:06:14 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-08cfde56-c547-4ee6-9b8e-722504f28c1e tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Converting VIF {"id": "94db3bc9-9ecc-4f15-8105-4abb2ff9d1e5", "address": "fa:16:3e:54:6b:70", "network": {"id": "e71b9966-9a95-4f66-b3b1-36b05d05853c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-310205564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28d940eae5394293b87cfced45911ab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94db3bc9-9e", "ovs_interfaceid": "94db3bc9-9ecc-4f15-8105-4abb2ff9d1e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:06:14 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-08cfde56-c547-4ee6-9b8e-722504f28c1e tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:6b:70,bridge_name='br-int',has_traffic_filtering=True,id=94db3bc9-9ecc-4f15-8105-4abb2ff9d1e5,network=Network(e71b9966-9a95-4f66-b3b1-36b05d05853c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94db3bc9-9e') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:06:14 user nova-compute[71874]: DEBUG os_vif [None req-08cfde56-c547-4ee6-9b8e-722504f28c1e tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:6b:70,bridge_name='br-int',has_traffic_filtering=True,id=94db3bc9-9ecc-4f15-8105-4abb2ff9d1e5,network=Network(e71b9966-9a95-4f66-b3b1-36b05d05853c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94db3bc9-9e') {{(pid=71874) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 16:06:14 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:06:14 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:06:14 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 16:06:14 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:06:14 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap94db3bc9-9e, may_exist=True) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:06:14 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap94db3bc9-9e, col_values=(('external_ids', {'iface-id': '94db3bc9-9ecc-4f15-8105-4abb2ff9d1e5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:54:6b:70', 'vm-uuid': '357dd90d-8c53-4193-ad64-edfa894116cf'}),)) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:06:14 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:06:14 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:06:14 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:06:14 user nova-compute[71874]: INFO os_vif [None req-08cfde56-c547-4ee6-9b8e-722504f28c1e tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:6b:70,bridge_name='br-int',has_traffic_filtering=True,id=94db3bc9-9ecc-4f15-8105-4abb2ff9d1e5,network=Network(e71b9966-9a95-4f66-b3b1-36b05d05853c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94db3bc9-9e')
Apr 12 16:06:14 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-08cfde56-c547-4ee6-9b8e-722504f28c1e tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] No BDM found with device name vda, not building metadata. {{(pid=71874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 16:06:14 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-08cfde56-c547-4ee6-9b8e-722504f28c1e tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] No VIF found with MAC fa:16:3e:54:6b:70, not building metadata {{(pid=71874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 16:06:15 user nova-compute[71874]: DEBUG nova.network.neutron [req-6a039674-f123-44ae-b85c-446c84fa143b req-e2a9208b-12a7-454f-bbaa-92bfff179603 service nova] [instance: 357dd90d-8c53-4193-ad64-edfa894116cf] Updated VIF entry in instance network info cache for port 94db3bc9-9ecc-4f15-8105-4abb2ff9d1e5. {{(pid=71874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 16:06:15 user nova-compute[71874]: DEBUG nova.network.neutron [req-6a039674-f123-44ae-b85c-446c84fa143b req-e2a9208b-12a7-454f-bbaa-92bfff179603 service nova] [instance: 357dd90d-8c53-4193-ad64-edfa894116cf] Updating instance_info_cache with network_info: [{"id": "94db3bc9-9ecc-4f15-8105-4abb2ff9d1e5", "address": "fa:16:3e:54:6b:70", "network": {"id": "e71b9966-9a95-4f66-b3b1-36b05d05853c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-310205564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28d940eae5394293b87cfced45911ab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94db3bc9-9e", "ovs_interfaceid": "94db3bc9-9ecc-4f15-8105-4abb2ff9d1e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:06:15 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-6a039674-f123-44ae-b85c-446c84fa143b req-e2a9208b-12a7-454f-bbaa-92bfff179603 service nova] Releasing lock "refresh_cache-357dd90d-8c53-4193-ad64-edfa894116cf" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:06:15 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-62d369bc-4ff2-4286-ac4c-af9736be8a7f tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:06:15 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-62d369bc-4ff2-4286-ac4c-af9736be8a7f tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:06:15 user nova-compute[71874]: INFO nova.compute.manager [None req-62d369bc-4ff2-4286-ac4c-af9736be8a7f tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Detaching volume b09d128a-0198-4cfc-942f-323bd2f41d53
Apr 12 16:06:15 user nova-compute[71874]: INFO nova.virt.block_device [None req-62d369bc-4ff2-4286-ac4c-af9736be8a7f tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Attempting to driver detach volume b09d128a-0198-4cfc-942f-323bd2f41d53 from mountpoint /dev/vdb
Apr 12 16:06:15 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-62d369bc-4ff2-4286-ac4c-af9736be8a7f tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Attempting to detach device vdb from instance dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 from the persistent domain config. {{(pid=71874) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 16:06:15 user nova-compute[71874]: DEBUG nova.virt.libvirt.guest [None req-62d369bc-4ff2-4286-ac4c-af9736be8a7f tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 16:06:15 user nova-compute[71874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 16:06:15 user nova-compute[71874]:   <source dev="/dev/sdc"/>
Apr 12 16:06:15 user nova-compute[71874]:   <target dev="vdb" bus="virtio"/>
Apr 12 16:06:15 user nova-compute[71874]:   <serial>b09d128a-0198-4cfc-942f-323bd2f41d53</serial>
Apr 12 16:06:15 user nova-compute[71874]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 12 16:06:15 user nova-compute[71874]: </disk>
Apr 12 16:06:15 user nova-compute[71874]:  {{(pid=71874) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 16:06:15 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-62d369bc-4ff2-4286-ac4c-af9736be8a7f tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Successfully detached device vdb from instance dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 from the persistent domain config.
Apr 12 16:06:15 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-62d369bc-4ff2-4286-ac4c-af9736be8a7f tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 from the live domain config. {{(pid=71874) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 16:06:15 user nova-compute[71874]: DEBUG nova.virt.libvirt.guest [None req-62d369bc-4ff2-4286-ac4c-af9736be8a7f tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 16:06:15 user nova-compute[71874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 16:06:15 user nova-compute[71874]:   <source dev="/dev/sdc"/>
Apr 12 16:06:15 user nova-compute[71874]:   <target dev="vdb" bus="virtio"/>
Apr 12 16:06:15 user nova-compute[71874]:   <serial>b09d128a-0198-4cfc-942f-323bd2f41d53</serial>
Apr 12 16:06:15 user nova-compute[71874]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 12 16:06:15 user nova-compute[71874]: </disk>
Apr 12 16:06:15 user nova-compute[71874]:  {{(pid=71874) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 16:06:16 user nova-compute[71874]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681315561.1420443, fc19fd8d-3285-4ceb-8714-a0ba139f3045 => Stopped> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:06:16 user nova-compute[71874]: INFO nova.compute.manager [-] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] VM Stopped (Lifecycle Event)
Apr 12 16:06:16 user nova-compute[71874]: DEBUG nova.compute.manager [None req-7919bc0a-1134-41fb-99c9-bf58dc3c1c0b None None] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:06:16 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Received event <DeviceRemovedEvent: 1681315576.2075307, dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71874) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 16:06:16 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-62d369bc-4ff2-4286-ac4c-af9736be8a7f tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 {{(pid=71874) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 16:06:16 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-62d369bc-4ff2-4286-ac4c-af9736be8a7f tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Successfully detached device vdb from instance dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 from the live domain config.
Apr 12 16:06:16 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-62d369bc-4ff2-4286-ac4c-af9736be8a7f tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] calling os-brick to detach iSCSI Volume {{(pid=71874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 16:06:16 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d369bc-4ff2-4286-ac4c-af9736be8a7f tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3c0216320>, {'target_iqn': 'iqn.2010-10.org.openstack:b09d128a-0198-4cfc-942f-323bd2f41d53', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dwXLiHIo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:06:16 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-62d369bc-4ff2-4286-ac4c-af9736be8a7f tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:06:16 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-62d369bc-4ff2-4286-ac4c-af9736be8a7f tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:06:16 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-62d369bc-4ff2-4286-ac4c-af9736be8a7f tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:06:16 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:06:16 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:06:16 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[494007fd-1576-4908-a3b1-1e1f5941eafe]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b09d128a-0198-4cfc-942f-323bd2f41d53\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:06:16 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d369bc-4ff2-4286-ac4c-af9736be8a7f tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 16:06:16 user nova-compute[71874]: No targets found.
Apr 12 16:06:16 user nova-compute[71874]: iSNS:
Apr 12 16:06:16 user nova-compute[71874]: No targets found.
Apr 12 16:06:16 user nova-compute[71874]: STATIC:
Apr 12 16:06:16 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:b09d128a-0198-4cfc-942f-323bd2f41d53
Apr 12 16:06:16 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:06:16 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:06:16 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2
Apr 12 16:06:16 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:06:16 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:06:16 user nova-compute[71874]: FIRMWARE:
Apr 12 16:06:16 user nova-compute[71874]: No targets found.
Apr 12 16:06:16 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:06:16 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d369bc-4ff2-4286-ac4c-af9736be8a7f tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 16:06:16 user nova-compute[71874]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 16:06:16 user nova-compute[71874]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71874) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 16:06:16 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d369bc-4ff2-4286-ac4c-af9736be8a7f tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b09d128a-0198-4cfc-942f-323bd2f41d53', 0)] {{(pid=71874) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 16:06:16 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:06:16 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:06:16 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf125305-7240-4601-824a-5a7463d6cb85]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b09d128a-0198-4cfc-942f-323bd2f41d53\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:06:16 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:06:16 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:06:16 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6e5fd79-59d9-431d-840d-95170436120a]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b09d128a-0198-4cfc-942f-323bd2f41d53 (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:06:16 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d369bc-4ff2-4286-ac4c-af9736be8a7f tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:06:16 user nova-compute[71874]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b09d128a-0198-4cfc-942f-323bd2f41d53 (non-flash)
Apr 12 16:06:16 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:06:16 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d369bc-4ff2-4286-ac4c-af9736be8a7f tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:06:16 user nova-compute[71874]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b09d128a-0198-4cfc-942f-323bd2f41d53 (non-flash)
Apr 12 16:06:16 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:06:16 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d369bc-4ff2-4286-ac4c-af9736be8a7f tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc3c03d1e10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b09d128a-0198-4cfc-942f-323bd2f41d53'): ({'sdc'}, set())}) {{(pid=71874) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 16:06:16 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-62d369bc-4ff2-4286-ac4c-af9736be8a7f tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Removing single pathed devices sdc {{(pid=71874) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 16:06:16 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:06:16 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:06:16 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fcb9ac2-39c8-414e-838a-f82a9b66a23f]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:06:16 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:06:16 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:06:16 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cf9ba8a-0bda-4f3f-a6b1-20a96c5b37f8]: (4, ('ok\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:06:16 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-62d369bc-4ff2-4286-ac4c-af9736be8a7f tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Flushing IO for device /dev/sdc {{(pid=71874) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 16:06:16 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:06:16 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.023s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:06:16 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d0e05bc-4c90-4c5c-ba9f-08f7e7c63c25]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:06:16 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-62d369bc-4ff2-4286-ac4c-af9736be8a7f tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71874) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 16:06:16 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:06:16 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.060s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:06:16 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[78c91b15-c17e-4ef7-adb6-7c958efe8d37]: (4, ('1', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:06:16 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-62d369bc-4ff2-4286-ac4c-af9736be8a7f tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71874) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 16:06:16 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-62d369bc-4ff2-4286-ac4c-af9736be8a7f tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] SCSI volumes sdc have been removed. {{(pid=71874) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 16:06:16 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d369bc-4ff2-4286-ac4c-af9736be8a7f tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b09d128a-0198-4cfc-942f-323bd2f41d53')] {{(pid=71874) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 16:06:16 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b09d128a-0198-4cfc-942f-323bd2f41d53 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:06:16 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b09d128a-0198-4cfc-942f-323bd2f41d53 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:06:16 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[05cf371b-086e-4509-8060-dcfb628cba9e]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:06:16 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d369bc-4ff2-4286-ac4c-af9736be8a7f tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:06:16 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b09d128a-0198-4cfc-942f-323bd2f41d53 -p 172.16.0.220:3260 --logout {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:06:16 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:06:16 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b09d128a-0198-4cfc-942f-323bd2f41d53 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:06:16 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca0e5167-10fa-4cc6-a764-c2beea03cec9]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:b09d128a-0198-4cfc-942f-323bd2f41d53, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:b09d128a-0198-4cfc-942f-323bd2f41d53, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:06:16 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d369bc-4ff2-4286-ac4c-af9736be8a7f tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:b09d128a-0198-4cfc-942f-323bd2f41d53, portal: 172.16.0.220,3260]
Apr 12 16:06:16 user nova-compute[71874]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:b09d128a-0198-4cfc-942f-323bd2f41d53, portal: 172.16.0.220,3260] successful.
Apr 12 16:06:16 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:06:16 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b09d128a-0198-4cfc-942f-323bd2f41d53 -p 172.16.0.220:3260 --op delete {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:06:16 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b09d128a-0198-4cfc-942f-323bd2f41d53 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:06:16 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[c00404ca-67fc-4b52-b107-fdd3503e0a9d]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:06:16 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d369bc-4ff2-4286-ac4c-af9736be8a7f tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:06:16 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-62d369bc-4ff2-4286-ac4c-af9736be8a7f tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.383s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:06:16 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-62d369bc-4ff2-4286-ac4c-af9736be8a7f tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] <== disconnect_volume: return (385ms) None {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:06:16 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-62d369bc-4ff2-4286-ac4c-af9736be8a7f tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Disconnected iSCSI Volume {{(pid=71874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 16:06:16 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:06:16 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:06:16 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:06:16 user nova-compute[71874]: DEBUG nova.compute.manager [req-fc7b20bf-d7c5-45a3-afff-c5bda1467037 req-b7052141-18ab-4d5e-b95c-05e0705c2a69 service nova] [instance: 357dd90d-8c53-4193-ad64-edfa894116cf] Received event network-vif-plugged-94db3bc9-9ecc-4f15-8105-4abb2ff9d1e5 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:06:16 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-fc7b20bf-d7c5-45a3-afff-c5bda1467037 req-b7052141-18ab-4d5e-b95c-05e0705c2a69 service nova] Acquiring lock "357dd90d-8c53-4193-ad64-edfa894116cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:06:16 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-fc7b20bf-d7c5-45a3-afff-c5bda1467037 req-b7052141-18ab-4d5e-b95c-05e0705c2a69 service nova] Lock "357dd90d-8c53-4193-ad64-edfa894116cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:06:16 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-fc7b20bf-d7c5-45a3-afff-c5bda1467037 req-b7052141-18ab-4d5e-b95c-05e0705c2a69 service nova] Lock "357dd90d-8c53-4193-ad64-edfa894116cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:06:16 user nova-compute[71874]: DEBUG nova.compute.manager [req-fc7b20bf-d7c5-45a3-afff-c5bda1467037 req-b7052141-18ab-4d5e-b95c-05e0705c2a69 service nova] [instance: 357dd90d-8c53-4193-ad64-edfa894116cf] No waiting events found dispatching network-vif-plugged-94db3bc9-9ecc-4f15-8105-4abb2ff9d1e5 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:06:16 user nova-compute[71874]: WARNING nova.compute.manager [req-fc7b20bf-d7c5-45a3-afff-c5bda1467037 req-b7052141-18ab-4d5e-b95c-05e0705c2a69 service nova] [instance: 357dd90d-8c53-4193-ad64-edfa894116cf] Received unexpected event network-vif-plugged-94db3bc9-9ecc-4f15-8105-4abb2ff9d1e5 for instance with vm_state building and task_state spawning.
Apr 12 16:06:17 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:06:17 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:06:17 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:06:17 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:06:17 user nova-compute[71874]: DEBUG nova.objects.instance [None req-62d369bc-4ff2-4286-ac4c-af9736be8a7f tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lazy-loading 'flavor' on Instance uuid dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:06:17 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-62d369bc-4ff2-4286-ac4c-af9736be8a7f tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.218s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:06:17 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:06:17 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:06:17 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71874) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 16:06:18 user nova-compute[71874]: DEBUG nova.virt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Emitting event <LifecycleEvent: 1681315578.8160994, 357dd90d-8c53-4193-ad64-edfa894116cf => Resumed> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:06:18 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 357dd90d-8c53-4193-ad64-edfa894116cf] VM Resumed (Lifecycle Event)
Apr 12 16:06:18 user nova-compute[71874]: DEBUG nova.compute.manager [None req-08cfde56-c547-4ee6-9b8e-722504f28c1e tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: 357dd90d-8c53-4193-ad64-edfa894116cf] Instance event wait completed in 0 seconds for  {{(pid=71874) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 16:06:18 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-08cfde56-c547-4ee6-9b8e-722504f28c1e tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: 357dd90d-8c53-4193-ad64-edfa894116cf] Guest created on hypervisor {{(pid=71874) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 16:06:18 user nova-compute[71874]: INFO nova.virt.libvirt.driver [-] [instance: 357dd90d-8c53-4193-ad64-edfa894116cf] Instance spawned successfully.
Apr 12 16:06:18 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-08cfde56-c547-4ee6-9b8e-722504f28c1e tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: 357dd90d-8c53-4193-ad64-edfa894116cf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 16:06:18 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 357dd90d-8c53-4193-ad64-edfa894116cf] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:06:18 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 357dd90d-8c53-4193-ad64-edfa894116cf] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 16:06:18 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-08cfde56-c547-4ee6-9b8e-722504f28c1e tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: 357dd90d-8c53-4193-ad64-edfa894116cf] Found default for hw_cdrom_bus of ide {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:06:18 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-08cfde56-c547-4ee6-9b8e-722504f28c1e tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: 357dd90d-8c53-4193-ad64-edfa894116cf] Found default for hw_disk_bus of virtio {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:06:18 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-08cfde56-c547-4ee6-9b8e-722504f28c1e tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: 357dd90d-8c53-4193-ad64-edfa894116cf] Found default for hw_input_bus of None {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:06:18 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-08cfde56-c547-4ee6-9b8e-722504f28c1e tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: 357dd90d-8c53-4193-ad64-edfa894116cf] Found default for hw_pointer_model of None {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:06:18 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-08cfde56-c547-4ee6-9b8e-722504f28c1e tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: 357dd90d-8c53-4193-ad64-edfa894116cf] Found default for hw_video_model of virtio {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:06:18 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-08cfde56-c547-4ee6-9b8e-722504f28c1e tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: 357dd90d-8c53-4193-ad64-edfa894116cf] Found default for hw_vif_model of virtio {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:06:18 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:06:18 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 357dd90d-8c53-4193-ad64-edfa894116cf] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 16:06:18 user nova-compute[71874]: DEBUG nova.virt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Emitting event <LifecycleEvent: 1681315578.8188825, 357dd90d-8c53-4193-ad64-edfa894116cf => Started> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:06:18 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 357dd90d-8c53-4193-ad64-edfa894116cf] VM Started (Lifecycle Event)
Apr 12 16:06:18 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:06:18 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:06:18 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:06:18 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Auditing locally available compute resources for user (node: user) {{(pid=71874) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 16:06:18 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 357dd90d-8c53-4193-ad64-edfa894116cf] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:06:18 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 357dd90d-8c53-4193-ad64-edfa894116cf] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 16:06:18 user nova-compute[71874]: DEBUG nova.compute.manager [req-2a1c5dfe-1a12-4cf3-8700-96f5600c8c39 req-3fa897ae-1daa-4c8b-b03f-f6cd5a821dda service nova] [instance: 357dd90d-8c53-4193-ad64-edfa894116cf] Received event network-vif-plugged-94db3bc9-9ecc-4f15-8105-4abb2ff9d1e5 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:06:18 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-2a1c5dfe-1a12-4cf3-8700-96f5600c8c39 req-3fa897ae-1daa-4c8b-b03f-f6cd5a821dda service nova] Acquiring lock "357dd90d-8c53-4193-ad64-edfa894116cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:06:18 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-2a1c5dfe-1a12-4cf3-8700-96f5600c8c39 req-3fa897ae-1daa-4c8b-b03f-f6cd5a821dda service nova] Lock "357dd90d-8c53-4193-ad64-edfa894116cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:06:18 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-2a1c5dfe-1a12-4cf3-8700-96f5600c8c39 req-3fa897ae-1daa-4c8b-b03f-f6cd5a821dda service nova] Lock "357dd90d-8c53-4193-ad64-edfa894116cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:06:18 user nova-compute[71874]: DEBUG nova.compute.manager [req-2a1c5dfe-1a12-4cf3-8700-96f5600c8c39 req-3fa897ae-1daa-4c8b-b03f-f6cd5a821dda service nova] [instance: 357dd90d-8c53-4193-ad64-edfa894116cf] No waiting events found dispatching network-vif-plugged-94db3bc9-9ecc-4f15-8105-4abb2ff9d1e5 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:06:18 user nova-compute[71874]: WARNING nova.compute.manager [req-2a1c5dfe-1a12-4cf3-8700-96f5600c8c39 req-3fa897ae-1daa-4c8b-b03f-f6cd5a821dda service nova] [instance: 357dd90d-8c53-4193-ad64-edfa894116cf] Received unexpected event network-vif-plugged-94db3bc9-9ecc-4f15-8105-4abb2ff9d1e5 for instance with vm_state building and task_state spawning.
Apr 12 16:06:18 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 357dd90d-8c53-4193-ad64-edfa894116cf] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 16:06:18 user nova-compute[71874]: INFO nova.compute.manager [None req-08cfde56-c547-4ee6-9b8e-722504f28c1e tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: 357dd90d-8c53-4193-ad64-edfa894116cf] Took 6.52 seconds to spawn the instance on the hypervisor.
Apr 12 16:06:18 user nova-compute[71874]: DEBUG nova.compute.manager [None req-08cfde56-c547-4ee6-9b8e-722504f28c1e tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: 357dd90d-8c53-4193-ad64-edfa894116cf] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:06:19 user nova-compute[71874]: INFO nova.compute.manager [None req-08cfde56-c547-4ee6-9b8e-722504f28c1e tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: 357dd90d-8c53-4193-ad64-edfa894116cf] Took 7.39 seconds to build instance.
Apr 12 16:06:19 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-08cfde56-c547-4ee6-9b8e-722504f28c1e tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "357dd90d-8c53-4193-ad64-edfa894116cf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.498s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:06:19 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:06:19 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:06:19 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:06:19 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:06:19 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7835bdfc-77dc-4407-8a0a-ef81eca29c91/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:06:19 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7835bdfc-77dc-4407-8a0a-ef81eca29c91/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:06:19 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7835bdfc-77dc-4407-8a0a-ef81eca29c91/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:06:19 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7835bdfc-77dc-4407-8a0a-ef81eca29c91/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:06:19 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afebffae-dbf6-4876-8c9f-0364f0fde49c/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:06:19 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afebffae-dbf6-4876-8c9f-0364f0fde49c/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:06:19 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afebffae-dbf6-4876-8c9f-0364f0fde49c/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:06:19 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:06:19 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afebffae-dbf6-4876-8c9f-0364f0fde49c/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:06:19 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 16:06:19 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/608fbea2-b42b-4bb9-94a7-2b76dcdc2001/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:06:20 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/608fbea2-b42b-4bb9-94a7-2b76dcdc2001/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:06:20 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/608fbea2-b42b-4bb9-94a7-2b76dcdc2001/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:06:20 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/608fbea2-b42b-4bb9-94a7-2b76dcdc2001/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:06:20 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/357dd90d-8c53-4193-ad64-edfa894116cf/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:06:20 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/357dd90d-8c53-4193-ad64-edfa894116cf/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:06:20 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/357dd90d-8c53-4193-ad64-edfa894116cf/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:06:20 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/357dd90d-8c53-4193-ad64-edfa894116cf/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:06:20 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473a30c4-5aa4-481c-8859-fda815d14872/disk.rescue --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:06:20 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473a30c4-5aa4-481c-8859-fda815d14872/disk.rescue --force-share --output=json" returned: 0 in 0.133s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:06:20 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473a30c4-5aa4-481c-8859-fda815d14872/disk.rescue --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:06:20 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473a30c4-5aa4-481c-8859-fda815d14872/disk.rescue --force-share --output=json" returned: 0 in 0.139s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:06:20 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473a30c4-5aa4-481c-8859-fda815d14872/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:06:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473a30c4-5aa4-481c-8859-fda815d14872/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:06:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473a30c4-5aa4-481c-8859-fda815d14872/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:06:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473a30c4-5aa4-481c-8859-fda815d14872/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:06:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6caa4977-8333-4171-8825-2c3bfb52f80b/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:06:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6caa4977-8333-4171-8825-2c3bfb52f80b/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:06:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6caa4977-8333-4171-8825-2c3bfb52f80b/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:06:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6caa4977-8333-4171-8825-2c3bfb52f80b/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:06:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb8fd1e4-401b-4f73-a789-b7183f9003fb/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:06:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb8fd1e4-401b-4f73-a789-b7183f9003fb/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:06:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb8fd1e4-401b-4f73-a789-b7183f9003fb/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:06:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb8fd1e4-401b-4f73-a789-b7183f9003fb/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:06:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:06:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:06:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:06:22 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:06:22 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:06:22 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:06:22 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Hypervisor/Node resource view: name=user free_ram=7668MB free_disk=26.080795288085938GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71874) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 16:06:22 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:06:22 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:06:22 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance afebffae-dbf6-4876-8c9f-0364f0fde49c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:06:22 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 473a30c4-5aa4-481c-8859-fda815d14872 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:06:22 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 608fbea2-b42b-4bb9-94a7-2b76dcdc2001 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:06:22 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:06:22 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance f52ee906-c8fd-4cd5-842e-de98a5099c4f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:06:22 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:06:22 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 6caa4977-8333-4171-8825-2c3bfb52f80b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:06:22 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 7835bdfc-77dc-4407-8a0a-ef81eca29c91 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:06:22 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance cb8fd1e4-401b-4f73-a789-b7183f9003fb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:06:22 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 357dd90d-8c53-4193-ad64-edfa894116cf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:06:22 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=71874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 16:06:22 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Final resource view: name=user phys_ram=16023MB used_ram=1792MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=71874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 16:06:22 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:06:23 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Inventory has not changed in ProviderTree for provider: 0e94b4c8-cd49-45e4-9133-d36eb4b2456b {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 16:06:23 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Inventory has not changed for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 16:06:23 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Compute_service record updated for user:user {{(pid=71874) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 16:06:23 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.486s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:06:24 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:06:24 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:06:24 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Starting heal instance info cache {{(pid=71874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 16:06:24 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Rebuilding the list of instances to heal {{(pid=71874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 16:06:24 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquiring lock "refresh_cache-afebffae-dbf6-4876-8c9f-0364f0fde49c" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:06:24 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquired lock "refresh_cache-afebffae-dbf6-4876-8c9f-0364f0fde49c" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:06:24 user nova-compute[71874]: DEBUG nova.network.neutron [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] Forcefully refreshing network info cache for instance {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 16:06:24 user nova-compute[71874]: DEBUG nova.objects.instance [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lazy-loading 'info_cache' on Instance uuid afebffae-dbf6-4876-8c9f-0364f0fde49c {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:06:24 user nova-compute[71874]: DEBUG nova.network.neutron [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] Updating instance_info_cache with network_info: [{"id": "c4b29e0b-0ad8-4897-acf3-76004ac0338b", "address": "fa:16:3e:b8:23:a7", "network": {"id": "06fae0be-02dd-4962-a1ac-fd0413772758", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1493924857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3fe48a3b7d846a195f1e47cc7f69695", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4b29e0b-0a", "ovs_interfaceid": "c4b29e0b-0ad8-4897-acf3-76004ac0338b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:06:24 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Releasing lock "refresh_cache-afebffae-dbf6-4876-8c9f-0364f0fde49c" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:06:24 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] Updated the network info_cache for instance {{(pid=71874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 16:06:24 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:06:24 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:06:24 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:06:24 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:06:24 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:06:24 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:06:27 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-b5a0d3b1-bdc7-4c33-b6bf-d9800ac9d9bc tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Acquiring lock "7835bdfc-77dc-4407-8a0a-ef81eca29c91" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:06:27 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-b5a0d3b1-bdc7-4c33-b6bf-d9800ac9d9bc tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Lock "7835bdfc-77dc-4407-8a0a-ef81eca29c91" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:06:27 user nova-compute[71874]: DEBUG nova.objects.instance [None req-b5a0d3b1-bdc7-4c33-b6bf-d9800ac9d9bc tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Lazy-loading 'flavor' on Instance uuid 7835bdfc-77dc-4407-8a0a-ef81eca29c91 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:06:27 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-b5a0d3b1-bdc7-4c33-b6bf-d9800ac9d9bc tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Lock "7835bdfc-77dc-4407-8a0a-ef81eca29c91" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.070s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:06:27 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-b5a0d3b1-bdc7-4c33-b6bf-d9800ac9d9bc tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Acquiring lock "7835bdfc-77dc-4407-8a0a-ef81eca29c91" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:06:27 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-b5a0d3b1-bdc7-4c33-b6bf-d9800ac9d9bc tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Lock "7835bdfc-77dc-4407-8a0a-ef81eca29c91" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:06:27 user nova-compute[71874]: INFO nova.compute.manager [None req-b5a0d3b1-bdc7-4c33-b6bf-d9800ac9d9bc tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] [instance: 7835bdfc-77dc-4407-8a0a-ef81eca29c91] Attaching volume a1a05ef1-b072-47ea-8888-974917b35236 to /dev/vdb
Apr 12 16:06:27 user nova-compute[71874]: DEBUG os_brick.utils [None req-b5a0d3b1-bdc7-4c33-b6bf-d9800ac9d9bc tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:06:27 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:06:27 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:06:27 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[326b525e-c8b9-48e4-bafe-6e74c3040725]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:61a48d4489d2\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:06:27 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:06:27 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:06:27 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b125734-7409-49aa-87c7-28e02b607f47]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:06:27 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:06:27 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:06:27 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[26b08d48-ff84-429d-8b3e-9c9f43a14407]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:06:27 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[0acf6b94-1e60-4344-a34c-f8acaf316c7c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:06:27 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-b5a0d3b1-bdc7-4c33-b6bf-d9800ac9d9bc tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Running cmd (subprocess): nvme version {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:06:27 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-b5a0d3b1-bdc7-4c33-b6bf-d9800ac9d9bc tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] 'nvme version' failed. Not Retrying. {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 16:06:27 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b5a0d3b1-bdc7-4c33-b6bf-d9800ac9d9bc tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] nvme not present on system {{(pid=71874) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 16:06:27 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:06:27 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 16:06:27 user nova-compute[71874]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 16:06:27 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[8146bed8-9438-4094-91d8-98c172e823f6]: (4, '') {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:06:27 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.lightos [None req-b5a0d3b1-bdc7-4c33-b6bf-d9800ac9d9bc tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71874) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 16:06:27 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.lightos [None req-b5a0d3b1-bdc7-4c33-b6bf-d9800ac9d9bc tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71874) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 16:06:27 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.lightos [None req-b5a0d3b1-bdc7-4c33-b6bf-d9800ac9d9bc tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] LIGHTOS: no hostnqn found. {{(pid=71874) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 16:06:27 user nova-compute[71874]: DEBUG os_brick.utils [None req-b5a0d3b1-bdc7-4c33-b6bf-d9800ac9d9bc tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:61a48d4489d2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:06:27 user nova-compute[71874]: DEBUG nova.virt.block_device [None req-b5a0d3b1-bdc7-4c33-b6bf-d9800ac9d9bc tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] [instance: 7835bdfc-77dc-4407-8a0a-ef81eca29c91] Updating existing volume attachment record: 6cc3dcdf-f5a8-403e-a86f-44e8cc8f43f3 {{(pid=71874) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 16:06:27 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:06:27 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-af552783-3cc2-4b83-acde-a4c0777c34bc tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Acquiring lock "1496d262-ad85-4da5-be83-035c9806bd20" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:06:27 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-af552783-3cc2-4b83-acde-a4c0777c34bc tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Lock "1496d262-ad85-4da5-be83-035c9806bd20" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:06:27 user nova-compute[71874]: DEBUG nova.compute.manager [None req-af552783-3cc2-4b83-acde-a4c0777c34bc tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] [instance: 1496d262-ad85-4da5-be83-035c9806bd20] Starting instance... {{(pid=71874) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 16:06:27 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-af552783-3cc2-4b83-acde-a4c0777c34bc tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:06:27 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-af552783-3cc2-4b83-acde-a4c0777c34bc tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:06:27 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-af552783-3cc2-4b83-acde-a4c0777c34bc tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71874) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 16:06:27 user nova-compute[71874]: INFO nova.compute.claims [None req-af552783-3cc2-4b83-acde-a4c0777c34bc tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] [instance: 1496d262-ad85-4da5-be83-035c9806bd20] Claim successful on node user
Apr 12 16:06:28 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-af552783-3cc2-4b83-acde-a4c0777c34bc tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Inventory has not changed in ProviderTree for provider: 0e94b4c8-cd49-45e4-9133-d36eb4b2456b {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 16:06:28 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-af552783-3cc2-4b83-acde-a4c0777c34bc tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Inventory has not changed for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 16:06:28 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-af552783-3cc2-4b83-acde-a4c0777c34bc tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.478s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:06:28 user nova-compute[71874]: DEBUG nova.compute.manager [None req-af552783-3cc2-4b83-acde-a4c0777c34bc tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] [instance: 1496d262-ad85-4da5-be83-035c9806bd20] Start building networks asynchronously for instance. {{(pid=71874) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 16:06:28 user nova-compute[71874]: DEBUG nova.compute.manager [None req-af552783-3cc2-4b83-acde-a4c0777c34bc tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] [instance: 1496d262-ad85-4da5-be83-035c9806bd20] Allocating IP information in the background. {{(pid=71874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 16:06:28 user nova-compute[71874]: DEBUG nova.network.neutron [None req-af552783-3cc2-4b83-acde-a4c0777c34bc tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] [instance: 1496d262-ad85-4da5-be83-035c9806bd20] allocate_for_instance() {{(pid=71874) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 16:06:28 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-af552783-3cc2-4b83-acde-a4c0777c34bc tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] [instance: 1496d262-ad85-4da5-be83-035c9806bd20] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 16:06:28 user nova-compute[71874]: DEBUG nova.compute.manager [None req-af552783-3cc2-4b83-acde-a4c0777c34bc tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] [instance: 1496d262-ad85-4da5-be83-035c9806bd20] Start building block device mappings for instance. {{(pid=71874) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 16:06:28 user nova-compute[71874]: DEBUG nova.policy [None req-af552783-3cc2-4b83-acde-a4c0777c34bc tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2b65791f14d34508b8a9a0849a9bf89e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f559719f5f43c3a47a0aaf1e699193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71874) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 16:06:28 user nova-compute[71874]: DEBUG nova.compute.manager [None req-af552783-3cc2-4b83-acde-a4c0777c34bc tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] [instance: 1496d262-ad85-4da5-be83-035c9806bd20] Start spawning the instance on the hypervisor. {{(pid=71874) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 16:06:28 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-af552783-3cc2-4b83-acde-a4c0777c34bc tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] [instance: 1496d262-ad85-4da5-be83-035c9806bd20] Creating instance directory {{(pid=71874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 16:06:28 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-af552783-3cc2-4b83-acde-a4c0777c34bc tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] [instance: 1496d262-ad85-4da5-be83-035c9806bd20] Creating image(s)
Apr 12 16:06:28 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-af552783-3cc2-4b83-acde-a4c0777c34bc tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Acquiring lock "/opt/stack/data/nova/instances/1496d262-ad85-4da5-be83-035c9806bd20/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:06:28 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-af552783-3cc2-4b83-acde-a4c0777c34bc tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Lock "/opt/stack/data/nova/instances/1496d262-ad85-4da5-be83-035c9806bd20/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:06:28 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-af552783-3cc2-4b83-acde-a4c0777c34bc tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Lock "/opt/stack/data/nova/instances/1496d262-ad85-4da5-be83-035c9806bd20/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:06:28 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-af552783-3cc2-4b83-acde-a4c0777c34bc tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:06:28 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-af552783-3cc2-4b83-acde-a4c0777c34bc tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json" returned: 0 in 0.133s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:06:28 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-af552783-3cc2-4b83-acde-a4c0777c34bc tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Acquiring lock "b88df1b37cb431f52bc53b5616015c89b5bec411" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:06:28 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-af552783-3cc2-4b83-acde-a4c0777c34bc tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Lock "b88df1b37cb431f52bc53b5616015c89b5bec411" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:06:28 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-af552783-3cc2-4b83-acde-a4c0777c34bc tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:06:28 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-af552783-3cc2-4b83-acde-a4c0777c34bc tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json" returned: 0 in 0.138s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:06:28 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-af552783-3cc2-4b83-acde-a4c0777c34bc tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411,backing_fmt=raw /opt/stack/data/nova/instances/1496d262-ad85-4da5-be83-035c9806bd20/disk 1073741824 {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:06:29 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-af552783-3cc2-4b83-acde-a4c0777c34bc tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411,backing_fmt=raw /opt/stack/data/nova/instances/1496d262-ad85-4da5-be83-035c9806bd20/disk 1073741824" returned: 0 in 0.046s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:06:29 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-af552783-3cc2-4b83-acde-a4c0777c34bc tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Lock "b88df1b37cb431f52bc53b5616015c89b5bec411" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.192s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:06:29 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-af552783-3cc2-4b83-acde-a4c0777c34bc tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:06:29 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-af552783-3cc2-4b83-acde-a4c0777c34bc tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json" returned: 0 in 0.142s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:06:29 user nova-compute[71874]: DEBUG nova.virt.disk.api [None req-af552783-3cc2-4b83-acde-a4c0777c34bc tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1496d262-ad85-4da5-be83-035c9806bd20/disk. size=1073741824 {{(pid=71874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 16:06:29 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-af552783-3cc2-4b83-acde-a4c0777c34bc tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1496d262-ad85-4da5-be83-035c9806bd20/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:06:29 user nova-compute[71874]: DEBUG nova.network.neutron [None req-af552783-3cc2-4b83-acde-a4c0777c34bc tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] [instance: 1496d262-ad85-4da5-be83-035c9806bd20] Successfully created port: 035ef219-1c48-4c0c-944d-686a6af767e5 {{(pid=71874) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 16:06:29 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-af552783-3cc2-4b83-acde-a4c0777c34bc tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1496d262-ad85-4da5-be83-035c9806bd20/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:06:29 user nova-compute[71874]: DEBUG nova.virt.disk.api [None req-af552783-3cc2-4b83-acde-a4c0777c34bc tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Cannot resize image /opt/stack/data/nova/instances/1496d262-ad85-4da5-be83-035c9806bd20/disk to a smaller size. {{(pid=71874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 16:06:29 user nova-compute[71874]: DEBUG nova.objects.instance [None req-af552783-3cc2-4b83-acde-a4c0777c34bc tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Lazy-loading 'migration_context' on Instance uuid 1496d262-ad85-4da5-be83-035c9806bd20 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:06:29 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-af552783-3cc2-4b83-acde-a4c0777c34bc tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] [instance: 1496d262-ad85-4da5-be83-035c9806bd20] Created local disks {{(pid=71874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 16:06:29 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-af552783-3cc2-4b83-acde-a4c0777c34bc tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] [instance: 1496d262-ad85-4da5-be83-035c9806bd20] Ensure instance console log exists: /opt/stack/data/nova/instances/1496d262-ad85-4da5-be83-035c9806bd20/console.log {{(pid=71874) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 16:06:29 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-af552783-3cc2-4b83-acde-a4c0777c34bc tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:06:29 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-af552783-3cc2-4b83-acde-a4c0777c34bc tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:06:29 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-af552783-3cc2-4b83-acde-a4c0777c34bc tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:06:29 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:06:29 user nova-compute[71874]: DEBUG nova.network.neutron [None req-af552783-3cc2-4b83-acde-a4c0777c34bc tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] [instance: 1496d262-ad85-4da5-be83-035c9806bd20] Successfully updated port: 035ef219-1c48-4c0c-944d-686a6af767e5 {{(pid=71874) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 16:06:29 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-af552783-3cc2-4b83-acde-a4c0777c34bc tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Acquiring lock "refresh_cache-1496d262-ad85-4da5-be83-035c9806bd20" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:06:29 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-af552783-3cc2-4b83-acde-a4c0777c34bc tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Acquired lock "refresh_cache-1496d262-ad85-4da5-be83-035c9806bd20" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:06:29 user nova-compute[71874]: DEBUG nova.network.neutron [None req-af552783-3cc2-4b83-acde-a4c0777c34bc tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] [instance: 1496d262-ad85-4da5-be83-035c9806bd20] Building network info cache for instance {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 16:06:30 user nova-compute[71874]: DEBUG nova.compute.manager [req-b3773902-ec2e-4023-9dca-fc95744c196e req-95d7bff7-d68d-42e9-a572-30de6e81f50a service nova] [instance: 1496d262-ad85-4da5-be83-035c9806bd20] Received event network-changed-035ef219-1c48-4c0c-944d-686a6af767e5 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:06:30 user nova-compute[71874]: DEBUG nova.compute.manager [req-b3773902-ec2e-4023-9dca-fc95744c196e req-95d7bff7-d68d-42e9-a572-30de6e81f50a service nova] [instance: 1496d262-ad85-4da5-be83-035c9806bd20] Refreshing instance network info cache due to event network-changed-035ef219-1c48-4c0c-944d-686a6af767e5. {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 16:06:30 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-b3773902-ec2e-4023-9dca-fc95744c196e req-95d7bff7-d68d-42e9-a572-30de6e81f50a service nova] Acquiring lock "refresh_cache-1496d262-ad85-4da5-be83-035c9806bd20" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:06:30 user nova-compute[71874]: DEBUG nova.network.neutron [None req-af552783-3cc2-4b83-acde-a4c0777c34bc tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] [instance: 1496d262-ad85-4da5-be83-035c9806bd20] Instance cache missing network info. {{(pid=71874) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 16:06:30 user nova-compute[71874]: DEBUG nova.network.neutron [None req-af552783-3cc2-4b83-acde-a4c0777c34bc tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] [instance: 1496d262-ad85-4da5-be83-035c9806bd20] Updating instance_info_cache with network_info: [{"id": "035ef219-1c48-4c0c-944d-686a6af767e5", "address": "fa:16:3e:0f:eb:c1", "network": {"id": "0a97bb8e-9c19-41f1-bfcd-428e3ea3492f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-6019148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76f559719f5f43c3a47a0aaf1e699193", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap035ef219-1c", "ovs_interfaceid": "035ef219-1c48-4c0c-944d-686a6af767e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:06:30 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-af552783-3cc2-4b83-acde-a4c0777c34bc tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Releasing lock "refresh_cache-1496d262-ad85-4da5-be83-035c9806bd20" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:06:30 user nova-compute[71874]: DEBUG nova.compute.manager [None req-af552783-3cc2-4b83-acde-a4c0777c34bc tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] [instance: 1496d262-ad85-4da5-be83-035c9806bd20] Instance network_info: |[{"id": "035ef219-1c48-4c0c-944d-686a6af767e5", "address": "fa:16:3e:0f:eb:c1", "network": {"id": "0a97bb8e-9c19-41f1-bfcd-428e3ea3492f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-6019148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76f559719f5f43c3a47a0aaf1e699193", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap035ef219-1c", "ovs_interfaceid": "035ef219-1c48-4c0c-944d-686a6af767e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 16:06:30 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-b3773902-ec2e-4023-9dca-fc95744c196e req-95d7bff7-d68d-42e9-a572-30de6e81f50a service nova] Acquired lock "refresh_cache-1496d262-ad85-4da5-be83-035c9806bd20" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:06:30 user nova-compute[71874]: DEBUG nova.network.neutron [req-b3773902-ec2e-4023-9dca-fc95744c196e req-95d7bff7-d68d-42e9-a572-30de6e81f50a service nova] [instance: 1496d262-ad85-4da5-be83-035c9806bd20] Refreshing network info cache for port 035ef219-1c48-4c0c-944d-686a6af767e5 {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 16:06:30 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-af552783-3cc2-4b83-acde-a4c0777c34bc tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] [instance: 1496d262-ad85-4da5-be83-035c9806bd20] Start _get_guest_xml network_info=[{"id": "035ef219-1c48-4c0c-944d-686a6af767e5", "address": "fa:16:3e:0f:eb:c1", "network": {"id": "0a97bb8e-9c19-41f1-bfcd-428e3ea3492f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-6019148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76f559719f5f43c3a47a0aaf1e699193", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap035ef219-1c", "ovs_interfaceid": "035ef219-1c48-4c0c-944d-686a6af767e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T15:55:37Z,direct_url=<?>,disk_format='qcow2',id=9dc63f14-8b70-4e72-89f2-13464f2f5c7c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='61a4936d9b7744c0b488d81c9b7746b6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T15:55:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_options': None, 'image_id': '9dc63f14-8b70-4e72-89f2-13464f2f5c7c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 16:06:30 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-af552783-3cc2-4b83-acde-a4c0777c34bc tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:06:30 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-af552783-3cc2-4b83-acde-a4c0777c34bc tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:06:30 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-af552783-3cc2-4b83-acde-a4c0777c34bc tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71874) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 16:06:30 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-af552783-3cc2-4b83-acde-a4c0777c34bc tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T15:56:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T15:55:37Z,direct_url=<?>,disk_format='qcow2',id=9dc63f14-8b70-4e72-89f2-13464f2f5c7c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='61a4936d9b7744c0b488d81c9b7746b6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T15:55:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 16:06:30 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-af552783-3cc2-4b83-acde-a4c0777c34bc tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Flavor limits 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 16:06:30 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-af552783-3cc2-4b83-acde-a4c0777c34bc tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Image limits 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 16:06:30 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-af552783-3cc2-4b83-acde-a4c0777c34bc tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Flavor pref 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 16:06:30 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-af552783-3cc2-4b83-acde-a4c0777c34bc tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Image pref 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 16:06:30 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-af552783-3cc2-4b83-acde-a4c0777c34bc tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 16:06:30 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-af552783-3cc2-4b83-acde-a4c0777c34bc tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 16:06:30 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-af552783-3cc2-4b83-acde-a4c0777c34bc tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 16:06:30 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-af552783-3cc2-4b83-acde-a4c0777c34bc tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Got 1 possible topologies {{(pid=71874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 16:06:30 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-af552783-3cc2-4b83-acde-a4c0777c34bc tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 16:06:30 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-af552783-3cc2-4b83-acde-a4c0777c34bc tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 16:06:30 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-af552783-3cc2-4b83-acde-a4c0777c34bc tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T16:06:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1697600412',display_name='tempest-VolumesAdminNegativeTest-server-1697600412',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1697600412',id=22,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='76f559719f5f43c3a47a0aaf1e699193',ramdisk_id='',reservation_id='r-g80zt5vk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-716771515',owner_user_name='tempest-VolumesAdminNegativeTest-716771515-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T16:06:29Z,user_data=None,user_id='2b65791f14d34508b8a9a0849a9bf89e',uuid=1496d262-ad85-4da5-be83-035c9806bd20,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "035ef219-1c48-4c0c-944d-686a6af767e5", "address": "fa:16:3e:0f:eb:c1", "network": {"id": "0a97bb8e-9c19-41f1-bfcd-428e3ea3492f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-6019148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76f559719f5f43c3a47a0aaf1e699193", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap035ef219-1c", "ovs_interfaceid": "035ef219-1c48-4c0c-944d-686a6af767e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 16:06:30 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-af552783-3cc2-4b83-acde-a4c0777c34bc tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Converting VIF {"id": "035ef219-1c48-4c0c-944d-686a6af767e5", "address": "fa:16:3e:0f:eb:c1", "network": {"id": "0a97bb8e-9c19-41f1-bfcd-428e3ea3492f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-6019148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76f559719f5f43c3a47a0aaf1e699193", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap035ef219-1c", "ovs_interfaceid": "035ef219-1c48-4c0c-944d-686a6af767e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:06:30 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-af552783-3cc2-4b83-acde-a4c0777c34bc tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:eb:c1,bridge_name='br-int',has_traffic_filtering=True,id=035ef219-1c48-4c0c-944d-686a6af767e5,network=Network(0a97bb8e-9c19-41f1-bfcd-428e3ea3492f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap035ef219-1c') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:06:30 user nova-compute[71874]: DEBUG nova.objects.instance [None req-af552783-3cc2-4b83-acde-a4c0777c34bc tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Lazy-loading 'pci_devices' on Instance uuid 1496d262-ad85-4da5-be83-035c9806bd20 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:06:30 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-af552783-3cc2-4b83-acde-a4c0777c34bc tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] [instance: 1496d262-ad85-4da5-be83-035c9806bd20] End _get_guest_xml xml=<domain type="kvm">
Apr 12 16:06:30 user nova-compute[71874]:   <uuid>1496d262-ad85-4da5-be83-035c9806bd20</uuid>
Apr 12 16:06:30 user nova-compute[71874]:   <name>instance-00000016</name>
Apr 12 16:06:30 user nova-compute[71874]:   <memory>131072</memory>
Apr 12 16:06:30 user nova-compute[71874]:   <vcpu>1</vcpu>
Apr 12 16:06:30 user nova-compute[71874]:   <metadata>
Apr 12 16:06:30 user nova-compute[71874]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 16:06:30 user nova-compute[71874]:       <nova:package version="0.0.0"/>
Apr 12 16:06:30 user nova-compute[71874]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1697600412</nova:name>
Apr 12 16:06:30 user nova-compute[71874]:       <nova:creationTime>2023-04-12 16:06:30</nova:creationTime>
Apr 12 16:06:30 user nova-compute[71874]:       <nova:flavor name="m1.nano">
Apr 12 16:06:30 user nova-compute[71874]:         <nova:memory>128</nova:memory>
Apr 12 16:06:30 user nova-compute[71874]:         <nova:disk>1</nova:disk>
Apr 12 16:06:30 user nova-compute[71874]:         <nova:swap>0</nova:swap>
Apr 12 16:06:30 user nova-compute[71874]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 16:06:30 user nova-compute[71874]:         <nova:vcpus>1</nova:vcpus>
Apr 12 16:06:30 user nova-compute[71874]:       </nova:flavor>
Apr 12 16:06:30 user nova-compute[71874]:       <nova:owner>
Apr 12 16:06:30 user nova-compute[71874]:         <nova:user uuid="2b65791f14d34508b8a9a0849a9bf89e">tempest-VolumesAdminNegativeTest-716771515-project-member</nova:user>
Apr 12 16:06:30 user nova-compute[71874]:         <nova:project uuid="76f559719f5f43c3a47a0aaf1e699193">tempest-VolumesAdminNegativeTest-716771515</nova:project>
Apr 12 16:06:30 user nova-compute[71874]:       </nova:owner>
Apr 12 16:06:30 user nova-compute[71874]:       <nova:root type="image" uuid="9dc63f14-8b70-4e72-89f2-13464f2f5c7c"/>
Apr 12 16:06:30 user nova-compute[71874]:       <nova:ports>
Apr 12 16:06:30 user nova-compute[71874]:         <nova:port uuid="035ef219-1c48-4c0c-944d-686a6af767e5">
Apr 12 16:06:30 user nova-compute[71874]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 12 16:06:30 user nova-compute[71874]:         </nova:port>
Apr 12 16:06:30 user nova-compute[71874]:       </nova:ports>
Apr 12 16:06:30 user nova-compute[71874]:     </nova:instance>
Apr 12 16:06:30 user nova-compute[71874]:   </metadata>
Apr 12 16:06:30 user nova-compute[71874]:   <sysinfo type="smbios">
Apr 12 16:06:30 user nova-compute[71874]:     <system>
Apr 12 16:06:30 user nova-compute[71874]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 16:06:30 user nova-compute[71874]:       <entry name="product">OpenStack Nova</entry>
Apr 12 16:06:30 user nova-compute[71874]:       <entry name="version">0.0.0</entry>
Apr 12 16:06:30 user nova-compute[71874]:       <entry name="serial">1496d262-ad85-4da5-be83-035c9806bd20</entry>
Apr 12 16:06:30 user nova-compute[71874]:       <entry name="uuid">1496d262-ad85-4da5-be83-035c9806bd20</entry>
Apr 12 16:06:30 user nova-compute[71874]:       <entry name="family">Virtual Machine</entry>
Apr 12 16:06:30 user nova-compute[71874]:     </system>
Apr 12 16:06:30 user nova-compute[71874]:   </sysinfo>
Apr 12 16:06:30 user nova-compute[71874]:   <os>
Apr 12 16:06:30 user nova-compute[71874]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 16:06:30 user nova-compute[71874]:     <boot dev="hd"/>
Apr 12 16:06:30 user nova-compute[71874]:     <smbios mode="sysinfo"/>
Apr 12 16:06:30 user nova-compute[71874]:   </os>
Apr 12 16:06:30 user nova-compute[71874]:   <features>
Apr 12 16:06:30 user nova-compute[71874]:     <acpi/>
Apr 12 16:06:30 user nova-compute[71874]:     <apic/>
Apr 12 16:06:30 user nova-compute[71874]:     <vmcoreinfo/>
Apr 12 16:06:30 user nova-compute[71874]:   </features>
Apr 12 16:06:30 user nova-compute[71874]:   <clock offset="utc">
Apr 12 16:06:30 user nova-compute[71874]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 16:06:30 user nova-compute[71874]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 16:06:30 user nova-compute[71874]:     <timer name="hpet" present="no"/>
Apr 12 16:06:30 user nova-compute[71874]:   </clock>
Apr 12 16:06:30 user nova-compute[71874]:   <cpu mode="custom" match="exact">
Apr 12 16:06:30 user nova-compute[71874]:     <model>Nehalem</model>
Apr 12 16:06:30 user nova-compute[71874]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 16:06:30 user nova-compute[71874]:   </cpu>
Apr 12 16:06:30 user nova-compute[71874]:   <devices>
Apr 12 16:06:30 user nova-compute[71874]:     <disk type="file" device="disk">
Apr 12 16:06:30 user nova-compute[71874]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 16:06:30 user nova-compute[71874]:       <source file="/opt/stack/data/nova/instances/1496d262-ad85-4da5-be83-035c9806bd20/disk"/>
Apr 12 16:06:30 user nova-compute[71874]:       <target dev="vda" bus="virtio"/>
Apr 12 16:06:30 user nova-compute[71874]:     </disk>
Apr 12 16:06:30 user nova-compute[71874]:     <interface type="ethernet">
Apr 12 16:06:30 user nova-compute[71874]:       <mac address="fa:16:3e:0f:eb:c1"/>
Apr 12 16:06:30 user nova-compute[71874]:       <model type="virtio"/>
Apr 12 16:06:30 user nova-compute[71874]:       <mtu size="1442"/>
Apr 12 16:06:30 user nova-compute[71874]:       <target dev="tap035ef219-1c"/>
Apr 12 16:06:30 user nova-compute[71874]:     </interface>
Apr 12 16:06:30 user nova-compute[71874]:     <serial type="pty">
Apr 12 16:06:30 user nova-compute[71874]:       <log file="/opt/stack/data/nova/instances/1496d262-ad85-4da5-be83-035c9806bd20/console.log" append="off"/>
Apr 12 16:06:30 user nova-compute[71874]:     </serial>
Apr 12 16:06:30 user nova-compute[71874]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 16:06:30 user nova-compute[71874]:     <video>
Apr 12 16:06:30 user nova-compute[71874]:       <model type="virtio"/>
Apr 12 16:06:30 user nova-compute[71874]:     </video>
Apr 12 16:06:30 user nova-compute[71874]:     <rng model="virtio">
Apr 12 16:06:30 user nova-compute[71874]:       <backend model="random">/dev/urandom</backend>
Apr 12 16:06:30 user nova-compute[71874]:     </rng>
Apr 12 16:06:30 user nova-compute[71874]:     <controller type="usb" index="0" model="none"/>
Apr 12 16:06:30 user nova-compute[71874]:     <memballoon model="virtio">
Apr 12 16:06:30 user nova-compute[71874]:       <stats period="10"/>
Apr 12 16:06:30 user nova-compute[71874]:     </memballoon>
Apr 12 16:06:30 user nova-compute[71874]:   </devices>
Apr 12 16:06:30 user nova-compute[71874]: </domain>
Apr 12 16:06:30 user nova-compute[71874]:  {{(pid=71874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 16:06:30 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-af552783-3cc2-4b83-acde-a4c0777c34bc tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T16:06:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1697600412',display_name='tempest-VolumesAdminNegativeTest-server-1697600412',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1697600412',id=22,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='76f559719f5f43c3a47a0aaf1e699193',ramdisk_id='',reservation_id='r-g80zt5vk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-716771515',owner_user_name='tempest-VolumesAdminNegativeTest-716771515-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T16:06:29Z,user_data=None,user_id='2b65791f14d34508b8a9a0849a9bf89e',uuid=1496d262-ad85-4da5-be83-035c9806bd20,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "035ef219-1c48-4c0c-944d-686a6af767e5", "address": "fa:16:3e:0f:eb:c1", "network": {"id": "0a97bb8e-9c19-41f1-bfcd-428e3ea3492f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-6019148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76f559719f5f43c3a47a0aaf1e699193", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap035ef219-1c", "ovs_interfaceid": "035ef219-1c48-4c0c-944d-686a6af767e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 16:06:30 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-af552783-3cc2-4b83-acde-a4c0777c34bc tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Converting VIF {"id": "035ef219-1c48-4c0c-944d-686a6af767e5", "address": "fa:16:3e:0f:eb:c1", "network": {"id": "0a97bb8e-9c19-41f1-bfcd-428e3ea3492f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-6019148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76f559719f5f43c3a47a0aaf1e699193", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap035ef219-1c", "ovs_interfaceid": "035ef219-1c48-4c0c-944d-686a6af767e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:06:30 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-af552783-3cc2-4b83-acde-a4c0777c34bc tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:eb:c1,bridge_name='br-int',has_traffic_filtering=True,id=035ef219-1c48-4c0c-944d-686a6af767e5,network=Network(0a97bb8e-9c19-41f1-bfcd-428e3ea3492f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap035ef219-1c') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:06:30 user nova-compute[71874]: DEBUG os_vif [None req-af552783-3cc2-4b83-acde-a4c0777c34bc tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:eb:c1,bridge_name='br-int',has_traffic_filtering=True,id=035ef219-1c48-4c0c-944d-686a6af767e5,network=Network(0a97bb8e-9c19-41f1-bfcd-428e3ea3492f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap035ef219-1c') {{(pid=71874) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 16:06:30 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:06:30 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:06:30 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 16:06:30 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:06:30 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap035ef219-1c, may_exist=True) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:06:30 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap035ef219-1c, col_values=(('external_ids', {'iface-id': '035ef219-1c48-4c0c-944d-686a6af767e5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0f:eb:c1', 'vm-uuid': '1496d262-ad85-4da5-be83-035c9806bd20'}),)) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:06:30 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:06:30 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:06:30 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:06:30 user nova-compute[71874]: INFO os_vif [None req-af552783-3cc2-4b83-acde-a4c0777c34bc tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:eb:c1,bridge_name='br-int',has_traffic_filtering=True,id=035ef219-1c48-4c0c-944d-686a6af767e5,network=Network(0a97bb8e-9c19-41f1-bfcd-428e3ea3492f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap035ef219-1c')
Apr 12 16:06:30 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-af552783-3cc2-4b83-acde-a4c0777c34bc tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] No BDM found with device name vda, not building metadata. {{(pid=71874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 16:06:30 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-af552783-3cc2-4b83-acde-a4c0777c34bc tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] No VIF found with MAC fa:16:3e:0f:eb:c1, not building metadata {{(pid=71874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 16:06:30 user nova-compute[71874]: DEBUG nova.network.neutron [req-b3773902-ec2e-4023-9dca-fc95744c196e req-95d7bff7-d68d-42e9-a572-30de6e81f50a service nova] [instance: 1496d262-ad85-4da5-be83-035c9806bd20] Updated VIF entry in instance network info cache for port 035ef219-1c48-4c0c-944d-686a6af767e5. {{(pid=71874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 16:06:30 user nova-compute[71874]: DEBUG nova.network.neutron [req-b3773902-ec2e-4023-9dca-fc95744c196e req-95d7bff7-d68d-42e9-a572-30de6e81f50a service nova] [instance: 1496d262-ad85-4da5-be83-035c9806bd20] Updating instance_info_cache with network_info: [{"id": "035ef219-1c48-4c0c-944d-686a6af767e5", "address": "fa:16:3e:0f:eb:c1", "network": {"id": "0a97bb8e-9c19-41f1-bfcd-428e3ea3492f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-6019148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76f559719f5f43c3a47a0aaf1e699193", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap035ef219-1c", "ovs_interfaceid": "035ef219-1c48-4c0c-944d-686a6af767e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:06:30 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-b3773902-ec2e-4023-9dca-fc95744c196e req-95d7bff7-d68d-42e9-a572-30de6e81f50a service nova] Releasing lock "refresh_cache-1496d262-ad85-4da5-be83-035c9806bd20" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:06:31 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:06:31 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:06:31 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:06:32 user nova-compute[71874]: DEBUG nova.compute.manager [req-1ea012fb-737d-4c3c-94ea-8f77ea0bd5bf req-e37c7e90-d866-4572-8c60-b44505d320b0 service nova] [instance: 1496d262-ad85-4da5-be83-035c9806bd20] Received event network-vif-plugged-035ef219-1c48-4c0c-944d-686a6af767e5 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:06:32 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-1ea012fb-737d-4c3c-94ea-8f77ea0bd5bf req-e37c7e90-d866-4572-8c60-b44505d320b0 service nova] Acquiring lock "1496d262-ad85-4da5-be83-035c9806bd20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:06:32 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-1ea012fb-737d-4c3c-94ea-8f77ea0bd5bf req-e37c7e90-d866-4572-8c60-b44505d320b0 service nova] Lock "1496d262-ad85-4da5-be83-035c9806bd20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:06:32 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-1ea012fb-737d-4c3c-94ea-8f77ea0bd5bf req-e37c7e90-d866-4572-8c60-b44505d320b0 service nova] Lock "1496d262-ad85-4da5-be83-035c9806bd20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:06:32 user nova-compute[71874]: DEBUG nova.compute.manager [req-1ea012fb-737d-4c3c-94ea-8f77ea0bd5bf req-e37c7e90-d866-4572-8c60-b44505d320b0 service nova] [instance: 1496d262-ad85-4da5-be83-035c9806bd20] No waiting events found dispatching network-vif-plugged-035ef219-1c48-4c0c-944d-686a6af767e5 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:06:32 user nova-compute[71874]: WARNING nova.compute.manager [req-1ea012fb-737d-4c3c-94ea-8f77ea0bd5bf req-e37c7e90-d866-4572-8c60-b44505d320b0 service nova] [instance: 1496d262-ad85-4da5-be83-035c9806bd20] Received unexpected event network-vif-plugged-035ef219-1c48-4c0c-944d-686a6af767e5 for instance with vm_state building and task_state spawning.
Apr 12 16:06:32 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:06:32 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:06:32 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b5a0d3b1-bdc7-4c33-b6bf-d9800ac9d9bc tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] [instance: 7835bdfc-77dc-4407-8a0a-ef81eca29c91] Calling os-brick to attach iSCSI Volume {{(pid=71874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 16:06:32 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5a0d3b1-bdc7-4c33-b6bf-d9800ac9d9bc tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3c0216320>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a1a05ef1-b072-47ea-8888-974917b35236', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pXBtrAUk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:06:32 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-b5a0d3b1-bdc7-4c33-b6bf-d9800ac9d9bc tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:06:32 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-b5a0d3b1-bdc7-4c33-b6bf-d9800ac9d9bc tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:06:32 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-b5a0d3b1-bdc7-4c33-b6bf-d9800ac9d9bc tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:06:32 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-b5a0d3b1-bdc7-4c33-b6bf-d9800ac9d9bc tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:06:32 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-b5a0d3b1-bdc7-4c33-b6bf-d9800ac9d9bc tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a1a05ef1-b072-47ea-8888-974917b35236" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:06:32 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-b5a0d3b1-bdc7-4c33-b6bf-d9800ac9d9bc tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a1a05ef1-b072-47ea-8888-974917b35236" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:06:32 user nova-compute[71874]: INFO os_brick.initiator.connectors.iscsi [None req-b5a0d3b1-bdc7-4c33-b6bf-d9800ac9d9bc tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 16:06:32 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1a05ef1-b072-47ea-8888-974917b35236 -p 172.16.0.220:3260 {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:06:32 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1a05ef1-b072-47ea-8888-974917b35236 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:06:32 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[a39b055a-c647-4e7b-bb42-c4f902ba09e3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:06:32 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5a0d3b1-bdc7-4c33-b6bf-d9800ac9d9bc tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 16:06:32 user nova-compute[71874]:  {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:06:32 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1a05ef1-b072-47ea-8888-974917b35236 -p 172.16.0.220:3260 --interface default --op new {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:06:32 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1a05ef1-b072-47ea-8888-974917b35236 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:06:32 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd39b92c-42f4-41ae-b3f5-6d77048d80b9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a1a05ef1-b072-47ea-8888-974917b35236] added\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:06:32 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5a0d3b1-bdc7-4c33-b6bf-d9800ac9d9bc tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a1a05ef1-b072-47ea-8888-974917b35236] added
Apr 12 16:06:32 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:06:32 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1a05ef1-b072-47ea-8888-974917b35236 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:06:32 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1a05ef1-b072-47ea-8888-974917b35236 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:06:32 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[c59d44e0-928d-4bcc-8f78-e4c838e1bca9]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:06:32 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5a0d3b1-bdc7-4c33-b6bf-d9800ac9d9bc tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:06:32 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1a05ef1-b072-47ea-8888-974917b35236 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:06:32 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1a05ef1-b072-47ea-8888-974917b35236 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:06:32 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[3993f40a-70c8-487a-9c53-9f333bd76ce9]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:06:32 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5a0d3b1-bdc7-4c33-b6bf-d9800ac9d9bc tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:06:32 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1a05ef1-b072-47ea-8888-974917b35236 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pXBtrAUk {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:06:32 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1a05ef1-b072-47ea-8888-974917b35236 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pXBtrAUk" returned: 0 in 0.020s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:06:32 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bbb011c-3a48-4fc5-8dc7-5c192416e120]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:06:32 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5a0d3b1-bdc7-4c33-b6bf-d9800ac9d9bc tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pXBtrAUk'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:06:32 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1a05ef1-b072-47ea-8888-974917b35236 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:06:32 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1a05ef1-b072-47ea-8888-974917b35236 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:06:32 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e2bbedc-2bdc-4666-88b5-e0873a78f984]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:06:32 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5a0d3b1-bdc7-4c33-b6bf-d9800ac9d9bc tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:06:32 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:06:32 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:06:32 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd152f1e-07a5-4e35-b8c2-b9cc8aa3e36a]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:06:32 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5a0d3b1-bdc7-4c33-b6bf-d9800ac9d9bc tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:06:32 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:06:32 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5a0d3b1-bdc7-4c33-b6bf-d9800ac9d9bc tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:06:32 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:06:32 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1a05ef1-b072-47ea-8888-974917b35236 -p 172.16.0.220:3260 --login {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:06:32 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1a05ef1-b072-47ea-8888-974917b35236 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:06:32 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[d92f5f9e-42d7-4ac0-a94b-79a70d428b8a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a1a05ef1-b072-47ea-8888-974917b35236, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a1a05ef1-b072-47ea-8888-974917b35236, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:06:32 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5a0d3b1-bdc7-4c33-b6bf-d9800ac9d9bc tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a1a05ef1-b072-47ea-8888-974917b35236, portal: 172.16.0.220,3260]
Apr 12 16:06:32 user nova-compute[71874]: Login to [iface: default, target: iqn.2010-10.org.openstack:a1a05ef1-b072-47ea-8888-974917b35236, portal: 172.16.0.220,3260] successful.
Apr 12 16:06:32 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:06:32 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1a05ef1-b072-47ea-8888-974917b35236 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:06:32 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1a05ef1-b072-47ea-8888-974917b35236 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:06:32 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ba889fc-dc90-4249-88b0-0d870c6d5706]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:06:32 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5a0d3b1-bdc7-4c33-b6bf-d9800ac9d9bc tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:06:32 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:06:32 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:06:32 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[47fd3363-a3a5-4530-9b92-966073e85c26]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1a05ef1-b072-47ea-8888-974917b35236 (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:06:32 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5a0d3b1-bdc7-4c33-b6bf-d9800ac9d9bc tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:06:32 user nova-compute[71874]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1a05ef1-b072-47ea-8888-974917b35236 (non-flash)
Apr 12 16:06:32 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:06:32 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5a0d3b1-bdc7-4c33-b6bf-d9800ac9d9bc tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:06:32 user nova-compute[71874]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1a05ef1-b072-47ea-8888-974917b35236 (non-flash)
Apr 12 16:06:32 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:06:32 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-b5a0d3b1-bdc7-4c33-b6bf-d9800ac9d9bc tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a1a05ef1-b072-47ea-8888-974917b35236" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.277s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:06:32 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5a0d3b1-bdc7-4c33-b6bf-d9800ac9d9bc tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Connected to 172.16.0.220:3260 {{(pid=71874) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 16:06:32 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-b5a0d3b1-bdc7-4c33-b6bf-d9800ac9d9bc tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] HCTL ('34', '-', '-', 0) found on session 22 with lun 0 {{(pid=71874) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 16:06:32 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-b5a0d3b1-bdc7-4c33-b6bf-d9800ac9d9bc tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71874) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 16:06:32 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:06:32 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:06:32 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[75dc1bbc-ca6e-4fbb-b8ef-59687b057f7c]: (4, ('- - 0', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:06:32 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-b5a0d3b1-bdc7-4c33-b6bf-d9800ac9d9bc tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Searching for a device in session 22 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71874) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 16:06:32 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5a0d3b1-bdc7-4c33-b6bf-d9800ac9d9bc tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:a1a05ef1-b072-47ea-8888-974917b35236', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pXBtrAUk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71874) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 16:06:32 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:06:33 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-b5a0d3b1-bdc7-4c33-b6bf-d9800ac9d9bc tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.306s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:06:33 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5a0d3b1-bdc7-4c33-b6bf-d9800ac9d9bc tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] <== connect_volume: return (1309ms) {'type': 'block', 'scsi_wwn': '26538343730333263', 'path': '/dev/sdc'} {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:06:33 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b5a0d3b1-bdc7-4c33-b6bf-d9800ac9d9bc tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] [instance: 7835bdfc-77dc-4407-8a0a-ef81eca29c91] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26538343730333263', 'path': '/dev/sdc'} {{(pid=71874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 16:06:33 user nova-compute[71874]: DEBUG nova.objects.instance [None req-b5a0d3b1-bdc7-4c33-b6bf-d9800ac9d9bc tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Lazy-loading 'flavor' on Instance uuid 7835bdfc-77dc-4407-8a0a-ef81eca29c91 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:06:33 user nova-compute[71874]: DEBUG nova.virt.libvirt.guest [None req-b5a0d3b1-bdc7-4c33-b6bf-d9800ac9d9bc tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 16:06:33 user nova-compute[71874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 16:06:33 user nova-compute[71874]:   <source dev="/dev/sdc"/>
Apr 12 16:06:33 user nova-compute[71874]:   <target dev="vdb" bus="virtio"/>
Apr 12 16:06:33 user nova-compute[71874]:   <serial>a1a05ef1-b072-47ea-8888-974917b35236</serial>
Apr 12 16:06:33 user nova-compute[71874]: </disk>
Apr 12 16:06:33 user nova-compute[71874]:  {{(pid=71874) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 16:06:33 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-449c8517-a8e2-498a-9131-55b24f08c8bb tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] Acquiring lock "cb8fd1e4-401b-4f73-a789-b7183f9003fb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:06:33 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-449c8517-a8e2-498a-9131-55b24f08c8bb tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] Lock "cb8fd1e4-401b-4f73-a789-b7183f9003fb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:06:33 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-449c8517-a8e2-498a-9131-55b24f08c8bb tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] Acquiring lock "cb8fd1e4-401b-4f73-a789-b7183f9003fb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:06:33 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-449c8517-a8e2-498a-9131-55b24f08c8bb tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] Lock "cb8fd1e4-401b-4f73-a789-b7183f9003fb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:06:33 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-449c8517-a8e2-498a-9131-55b24f08c8bb tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] Lock "cb8fd1e4-401b-4f73-a789-b7183f9003fb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:06:33 user nova-compute[71874]: INFO nova.compute.manager [None req-449c8517-a8e2-498a-9131-55b24f08c8bb tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] [instance: cb8fd1e4-401b-4f73-a789-b7183f9003fb] Terminating instance
Apr 12 16:06:33 user nova-compute[71874]: DEBUG nova.compute.manager [None req-449c8517-a8e2-498a-9131-55b24f08c8bb tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] [instance: cb8fd1e4-401b-4f73-a789-b7183f9003fb] Start destroying the instance on the hypervisor. {{(pid=71874) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 16:06:33 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:06:33 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:06:33 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:06:33 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:06:33 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:06:34 user nova-compute[71874]: DEBUG nova.compute.manager [req-43de9876-4d4e-4ad0-81a6-8eccc0826a63 req-672a1b58-0210-4621-ac48-5eb7d9064090 service nova] [instance: cb8fd1e4-401b-4f73-a789-b7183f9003fb] Received event network-vif-unplugged-7a9fa84a-39d3-4580-b205-6a75686ba943 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:06:34 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-43de9876-4d4e-4ad0-81a6-8eccc0826a63 req-672a1b58-0210-4621-ac48-5eb7d9064090 service nova] Acquiring lock "cb8fd1e4-401b-4f73-a789-b7183f9003fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:06:34 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-43de9876-4d4e-4ad0-81a6-8eccc0826a63 req-672a1b58-0210-4621-ac48-5eb7d9064090 service nova] Lock "cb8fd1e4-401b-4f73-a789-b7183f9003fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:06:34 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-43de9876-4d4e-4ad0-81a6-8eccc0826a63 req-672a1b58-0210-4621-ac48-5eb7d9064090 service nova] Lock "cb8fd1e4-401b-4f73-a789-b7183f9003fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:06:34 user nova-compute[71874]: DEBUG nova.compute.manager [req-43de9876-4d4e-4ad0-81a6-8eccc0826a63 req-672a1b58-0210-4621-ac48-5eb7d9064090 service nova] [instance: cb8fd1e4-401b-4f73-a789-b7183f9003fb] No waiting events found dispatching network-vif-unplugged-7a9fa84a-39d3-4580-b205-6a75686ba943 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:06:34 user nova-compute[71874]: DEBUG nova.compute.manager [req-43de9876-4d4e-4ad0-81a6-8eccc0826a63 req-672a1b58-0210-4621-ac48-5eb7d9064090 service nova] [instance: cb8fd1e4-401b-4f73-a789-b7183f9003fb] Received event network-vif-unplugged-7a9fa84a-39d3-4580-b205-6a75686ba943 for instance with task_state deleting. {{(pid=71874) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 16:06:34 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-b5a0d3b1-bdc7-4c33-b6bf-d9800ac9d9bc tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] No BDM found with device name vda, not building metadata. {{(pid=71874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 16:06:34 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-b5a0d3b1-bdc7-4c33-b6bf-d9800ac9d9bc tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 16:06:34 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-b5a0d3b1-bdc7-4c33-b6bf-d9800ac9d9bc tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] No VIF found with MAC fa:16:3e:3e:6b:29, not building metadata {{(pid=71874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 16:06:34 user nova-compute[71874]: DEBUG nova.virt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Emitting event <LifecycleEvent: 1681315594.0866315, 1496d262-ad85-4da5-be83-035c9806bd20 => Resumed> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:06:34 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 1496d262-ad85-4da5-be83-035c9806bd20] VM Resumed (Lifecycle Event)
Apr 12 16:06:34 user nova-compute[71874]: DEBUG nova.compute.manager [None req-af552783-3cc2-4b83-acde-a4c0777c34bc tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] [instance: 1496d262-ad85-4da5-be83-035c9806bd20] Instance event wait completed in 0 seconds for  {{(pid=71874) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 16:06:34 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-af552783-3cc2-4b83-acde-a4c0777c34bc tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] [instance: 1496d262-ad85-4da5-be83-035c9806bd20] Guest created on hypervisor {{(pid=71874) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 16:06:34 user nova-compute[71874]: INFO nova.virt.libvirt.driver [-] [instance: 1496d262-ad85-4da5-be83-035c9806bd20] Instance spawned successfully.
Apr 12 16:06:34 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-af552783-3cc2-4b83-acde-a4c0777c34bc tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] [instance: 1496d262-ad85-4da5-be83-035c9806bd20] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 16:06:34 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 1496d262-ad85-4da5-be83-035c9806bd20] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:06:34 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 1496d262-ad85-4da5-be83-035c9806bd20] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 16:06:34 user nova-compute[71874]: DEBUG nova.compute.manager [req-81402aef-b381-4a1c-a240-b26f4a571591 req-fd6720c4-b4c2-4b2a-bcac-e2b3376566ac service nova] [instance: 1496d262-ad85-4da5-be83-035c9806bd20] Received event network-vif-plugged-035ef219-1c48-4c0c-944d-686a6af767e5 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:06:34 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-81402aef-b381-4a1c-a240-b26f4a571591 req-fd6720c4-b4c2-4b2a-bcac-e2b3376566ac service nova] Acquiring lock "1496d262-ad85-4da5-be83-035c9806bd20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:06:34 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-81402aef-b381-4a1c-a240-b26f4a571591 req-fd6720c4-b4c2-4b2a-bcac-e2b3376566ac service nova] Lock "1496d262-ad85-4da5-be83-035c9806bd20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:06:34 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-81402aef-b381-4a1c-a240-b26f4a571591 req-fd6720c4-b4c2-4b2a-bcac-e2b3376566ac service nova] Lock "1496d262-ad85-4da5-be83-035c9806bd20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:06:34 user nova-compute[71874]: DEBUG nova.compute.manager [req-81402aef-b381-4a1c-a240-b26f4a571591 req-fd6720c4-b4c2-4b2a-bcac-e2b3376566ac service nova] [instance: 1496d262-ad85-4da5-be83-035c9806bd20] No waiting events found dispatching network-vif-plugged-035ef219-1c48-4c0c-944d-686a6af767e5 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:06:34 user nova-compute[71874]: WARNING nova.compute.manager [req-81402aef-b381-4a1c-a240-b26f4a571591 req-fd6720c4-b4c2-4b2a-bcac-e2b3376566ac service nova] [instance: 1496d262-ad85-4da5-be83-035c9806bd20] Received unexpected event network-vif-plugged-035ef219-1c48-4c0c-944d-686a6af767e5 for instance with vm_state building and task_state spawning.
Apr 12 16:06:34 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 1496d262-ad85-4da5-be83-035c9806bd20] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 16:06:34 user nova-compute[71874]: DEBUG nova.virt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Emitting event <LifecycleEvent: 1681315594.08854, 1496d262-ad85-4da5-be83-035c9806bd20 => Started> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:06:34 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 1496d262-ad85-4da5-be83-035c9806bd20] VM Started (Lifecycle Event)
Apr 12 16:06:34 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-af552783-3cc2-4b83-acde-a4c0777c34bc tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] [instance: 1496d262-ad85-4da5-be83-035c9806bd20] Found default for hw_cdrom_bus of ide {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:06:34 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-af552783-3cc2-4b83-acde-a4c0777c34bc tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] [instance: 1496d262-ad85-4da5-be83-035c9806bd20] Found default for hw_disk_bus of virtio {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:06:34 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-af552783-3cc2-4b83-acde-a4c0777c34bc tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] [instance: 1496d262-ad85-4da5-be83-035c9806bd20] Found default for hw_input_bus of None {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:06:34 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-af552783-3cc2-4b83-acde-a4c0777c34bc tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] [instance: 1496d262-ad85-4da5-be83-035c9806bd20] Found default for hw_pointer_model of None {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:06:34 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-af552783-3cc2-4b83-acde-a4c0777c34bc tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] [instance: 1496d262-ad85-4da5-be83-035c9806bd20] Found default for hw_video_model of virtio {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:06:34 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-af552783-3cc2-4b83-acde-a4c0777c34bc tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] [instance: 1496d262-ad85-4da5-be83-035c9806bd20] Found default for hw_vif_model of virtio {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:06:34 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 1496d262-ad85-4da5-be83-035c9806bd20] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:06:34 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 1496d262-ad85-4da5-be83-035c9806bd20] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 16:06:34 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:06:34 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-b5a0d3b1-bdc7-4c33-b6bf-d9800ac9d9bc tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Lock "7835bdfc-77dc-4407-8a0a-ef81eca29c91" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.865s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:06:34 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:06:34 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 1496d262-ad85-4da5-be83-035c9806bd20] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 16:06:34 user nova-compute[71874]: INFO nova.virt.libvirt.driver [-] [instance: cb8fd1e4-401b-4f73-a789-b7183f9003fb] Instance destroyed successfully.
Apr 12 16:06:34 user nova-compute[71874]: DEBUG nova.objects.instance [None req-449c8517-a8e2-498a-9131-55b24f08c8bb tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] Lazy-loading 'resources' on Instance uuid cb8fd1e4-401b-4f73-a789-b7183f9003fb {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:06:34 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-449c8517-a8e2-498a-9131-55b24f08c8bb tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T16:04:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1370025872',display_name='tempest-VolumesNegativeTest-instance-1370025872',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1370025872',id=20,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T16:04:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1b99813570054c54ada10220d1fe69ae',ramdisk_id='',reservation_id='r-7fomv020',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-877189983',owner_user_name='tempest-VolumesNegativeTest-877189983-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T16:04:51Z,user_data=None,user_id='4e119bed0d354349b36bc6cf426e4929',uuid=cb8fd1e4-401b-4f73-a789-b7183f9003fb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7a9fa84a-39d3-4580-b205-6a75686ba943", "address": "fa:16:3e:f6:7d:a4", "network": {"id": "cc06c7b9-be5a-4a83-b96b-ecc971b74bde", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "61a4936d9b7744c0b488d81c9b7746b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a9fa84a-39", "ovs_interfaceid": "7a9fa84a-39d3-4580-b205-6a75686ba943", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 16:06:34 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-449c8517-a8e2-498a-9131-55b24f08c8bb tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] Converting VIF {"id": "7a9fa84a-39d3-4580-b205-6a75686ba943", "address": "fa:16:3e:f6:7d:a4", "network": {"id": "cc06c7b9-be5a-4a83-b96b-ecc971b74bde", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "61a4936d9b7744c0b488d81c9b7746b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a9fa84a-39", "ovs_interfaceid": "7a9fa84a-39d3-4580-b205-6a75686ba943", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:06:34 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-449c8517-a8e2-498a-9131-55b24f08c8bb tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:7d:a4,bridge_name='br-int',has_traffic_filtering=True,id=7a9fa84a-39d3-4580-b205-6a75686ba943,network=Network(cc06c7b9-be5a-4a83-b96b-ecc971b74bde),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a9fa84a-39') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:06:34 user nova-compute[71874]: DEBUG os_vif [None req-449c8517-a8e2-498a-9131-55b24f08c8bb tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:7d:a4,bridge_name='br-int',has_traffic_filtering=True,id=7a9fa84a-39d3-4580-b205-6a75686ba943,network=Network(cc06c7b9-be5a-4a83-b96b-ecc971b74bde),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a9fa84a-39') {{(pid=71874) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 16:06:34 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:06:34 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7a9fa84a-39, bridge=br-int, if_exists=True) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:06:34 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:06:34 user nova-compute[71874]: INFO os_vif [None req-449c8517-a8e2-498a-9131-55b24f08c8bb tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:7d:a4,bridge_name='br-int',has_traffic_filtering=True,id=7a9fa84a-39d3-4580-b205-6a75686ba943,network=Network(cc06c7b9-be5a-4a83-b96b-ecc971b74bde),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a9fa84a-39')
Apr 12 16:06:34 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-449c8517-a8e2-498a-9131-55b24f08c8bb tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] [instance: cb8fd1e4-401b-4f73-a789-b7183f9003fb] Deleting instance files /opt/stack/data/nova/instances/cb8fd1e4-401b-4f73-a789-b7183f9003fb_del
Apr 12 16:06:34 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-449c8517-a8e2-498a-9131-55b24f08c8bb tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] [instance: cb8fd1e4-401b-4f73-a789-b7183f9003fb] Deletion of /opt/stack/data/nova/instances/cb8fd1e4-401b-4f73-a789-b7183f9003fb_del complete
Apr 12 16:06:34 user nova-compute[71874]: INFO nova.compute.manager [None req-af552783-3cc2-4b83-acde-a4c0777c34bc tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] [instance: 1496d262-ad85-4da5-be83-035c9806bd20] Took 5.63 seconds to spawn the instance on the hypervisor.
Apr 12 16:06:34 user nova-compute[71874]: DEBUG nova.compute.manager [None req-af552783-3cc2-4b83-acde-a4c0777c34bc tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] [instance: 1496d262-ad85-4da5-be83-035c9806bd20] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:06:34 user nova-compute[71874]: INFO nova.compute.manager [None req-449c8517-a8e2-498a-9131-55b24f08c8bb tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] [instance: cb8fd1e4-401b-4f73-a789-b7183f9003fb] Took 0.68 seconds to destroy the instance on the hypervisor.
Apr 12 16:06:34 user nova-compute[71874]: DEBUG oslo.service.loopingcall [None req-449c8517-a8e2-498a-9131-55b24f08c8bb tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71874) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 16:06:34 user nova-compute[71874]: DEBUG nova.compute.manager [-] [instance: cb8fd1e4-401b-4f73-a789-b7183f9003fb] Deallocating network for instance {{(pid=71874) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 16:06:34 user nova-compute[71874]: DEBUG nova.network.neutron [-] [instance: cb8fd1e4-401b-4f73-a789-b7183f9003fb] deallocate_for_instance() {{(pid=71874) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 16:06:34 user nova-compute[71874]: INFO nova.compute.manager [None req-af552783-3cc2-4b83-acde-a4c0777c34bc tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] [instance: 1496d262-ad85-4da5-be83-035c9806bd20] Took 6.48 seconds to build instance.
Apr 12 16:06:34 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-af552783-3cc2-4b83-acde-a4c0777c34bc tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Lock "1496d262-ad85-4da5-be83-035c9806bd20" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.600s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:06:35 user nova-compute[71874]: DEBUG nova.network.neutron [-] [instance: cb8fd1e4-401b-4f73-a789-b7183f9003fb] Updating instance_info_cache with network_info: [] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:06:35 user nova-compute[71874]: INFO nova.compute.manager [-] [instance: cb8fd1e4-401b-4f73-a789-b7183f9003fb] Took 0.78 seconds to deallocate network for instance.
Apr 12 16:06:35 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-77f0be82-18a1-400f-9604-250ca2c73fad tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Acquiring lock "7835bdfc-77dc-4407-8a0a-ef81eca29c91" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:06:35 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-77f0be82-18a1-400f-9604-250ca2c73fad tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Lock "7835bdfc-77dc-4407-8a0a-ef81eca29c91" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:06:35 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-77f0be82-18a1-400f-9604-250ca2c73fad tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Acquiring lock "7835bdfc-77dc-4407-8a0a-ef81eca29c91-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:06:35 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-77f0be82-18a1-400f-9604-250ca2c73fad tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Lock "7835bdfc-77dc-4407-8a0a-ef81eca29c91-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:06:35 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-77f0be82-18a1-400f-9604-250ca2c73fad tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Lock "7835bdfc-77dc-4407-8a0a-ef81eca29c91-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:06:35 user nova-compute[71874]: INFO nova.compute.manager [None req-77f0be82-18a1-400f-9604-250ca2c73fad tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] [instance: 7835bdfc-77dc-4407-8a0a-ef81eca29c91] Terminating instance
Apr 12 16:06:35 user nova-compute[71874]: DEBUG nova.compute.manager [None req-77f0be82-18a1-400f-9604-250ca2c73fad tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] [instance: 7835bdfc-77dc-4407-8a0a-ef81eca29c91] Start destroying the instance on the hypervisor. {{(pid=71874) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 16:06:35 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-449c8517-a8e2-498a-9131-55b24f08c8bb tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:06:35 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-449c8517-a8e2-498a-9131-55b24f08c8bb tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:06:35 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:06:35 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:06:35 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:06:35 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-449c8517-a8e2-498a-9131-55b24f08c8bb tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] Inventory has not changed in ProviderTree for provider: 0e94b4c8-cd49-45e4-9133-d36eb4b2456b {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 16:06:35 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-449c8517-a8e2-498a-9131-55b24f08c8bb tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] Inventory has not changed for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 16:06:35 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-449c8517-a8e2-498a-9131-55b24f08c8bb tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.523s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:06:35 user nova-compute[71874]: INFO nova.scheduler.client.report [None req-449c8517-a8e2-498a-9131-55b24f08c8bb tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] Deleted allocations for instance cb8fd1e4-401b-4f73-a789-b7183f9003fb
Apr 12 16:06:35 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-449c8517-a8e2-498a-9131-55b24f08c8bb tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] Lock "cb8fd1e4-401b-4f73-a789-b7183f9003fb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.178s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:06:35 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:06:35 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:06:35 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:06:35 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:06:35 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:06:35 user nova-compute[71874]: INFO nova.virt.libvirt.driver [-] [instance: 7835bdfc-77dc-4407-8a0a-ef81eca29c91] Instance destroyed successfully.
Apr 12 16:06:35 user nova-compute[71874]: DEBUG nova.objects.instance [None req-77f0be82-18a1-400f-9604-250ca2c73fad tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Lazy-loading 'resources' on Instance uuid 7835bdfc-77dc-4407-8a0a-ef81eca29c91 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:06:36 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-77f0be82-18a1-400f-9604-250ca2c73fad tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T16:04:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-454092624',display_name='tempest-DeleteServersTestJSON-server-454092624',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-454092624',id=19,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T16:04:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9decbec41a40484b9dd236a12964a08a',ramdisk_id='',reservation_id='r-dczwkkay',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-1867736040',owner_user_name='tempest-DeleteServersTestJSON-1867736040-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T16:04:44Z,user_data=None,user_id='584e4a8ef8c943a7a4ab711cf3adc366',uuid=7835bdfc-77dc-4407-8a0a-ef81eca29c91,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d0b3ae35-a6cc-416c-86a7-6ea400e14660", "address": "fa:16:3e:3e:6b:29", "network": {"id": "6f3d0490-15bc-474a-a508-bc36fefa8464", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1471674556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9decbec41a40484b9dd236a12964a08a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0b3ae35-a6", "ovs_interfaceid": "d0b3ae35-a6cc-416c-86a7-6ea400e14660", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 16:06:36 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-77f0be82-18a1-400f-9604-250ca2c73fad tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Converting VIF {"id": "d0b3ae35-a6cc-416c-86a7-6ea400e14660", "address": "fa:16:3e:3e:6b:29", "network": {"id": "6f3d0490-15bc-474a-a508-bc36fefa8464", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1471674556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9decbec41a40484b9dd236a12964a08a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0b3ae35-a6", "ovs_interfaceid": "d0b3ae35-a6cc-416c-86a7-6ea400e14660", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:06:36 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-77f0be82-18a1-400f-9604-250ca2c73fad tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:6b:29,bridge_name='br-int',has_traffic_filtering=True,id=d0b3ae35-a6cc-416c-86a7-6ea400e14660,network=Network(6f3d0490-15bc-474a-a508-bc36fefa8464),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0b3ae35-a6') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:06:36 user nova-compute[71874]: DEBUG os_vif [None req-77f0be82-18a1-400f-9604-250ca2c73fad tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:6b:29,bridge_name='br-int',has_traffic_filtering=True,id=d0b3ae35-a6cc-416c-86a7-6ea400e14660,network=Network(6f3d0490-15bc-474a-a508-bc36fefa8464),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0b3ae35-a6') {{(pid=71874) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 16:06:36 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:06:36 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd0b3ae35-a6, bridge=br-int, if_exists=True) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:06:36 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:06:36 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:06:36 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:06:36 user nova-compute[71874]: INFO os_vif [None req-77f0be82-18a1-400f-9604-250ca2c73fad tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:6b:29,bridge_name='br-int',has_traffic_filtering=True,id=d0b3ae35-a6cc-416c-86a7-6ea400e14660,network=Network(6f3d0490-15bc-474a-a508-bc36fefa8464),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0b3ae35-a6')
Apr 12 16:06:36 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-77f0be82-18a1-400f-9604-250ca2c73fad tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] [instance: 7835bdfc-77dc-4407-8a0a-ef81eca29c91] calling os-brick to detach iSCSI Volume {{(pid=71874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 16:06:36 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-77f0be82-18a1-400f-9604-250ca2c73fad tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3c0216320>, {'target_iqn': 'iqn.2010-10.org.openstack:a1a05ef1-b072-47ea-8888-974917b35236', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pXBtrAUk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:06:36 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-77f0be82-18a1-400f-9604-250ca2c73fad tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:06:36 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-77f0be82-18a1-400f-9604-250ca2c73fad tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:06:36 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-77f0be82-18a1-400f-9604-250ca2c73fad tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:06:36 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:06:36 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:06:36 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[11cc3d43-41b7-4a68-b8d0-e3debd92863e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a1a05ef1-b072-47ea-8888-974917b35236\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:06:36 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-77f0be82-18a1-400f-9604-250ca2c73fad tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 16:06:36 user nova-compute[71874]: No targets found.
Apr 12 16:06:36 user nova-compute[71874]: iSNS:
Apr 12 16:06:36 user nova-compute[71874]: No targets found.
Apr 12 16:06:36 user nova-compute[71874]: STATIC:
Apr 12 16:06:36 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:a1a05ef1-b072-47ea-8888-974917b35236
Apr 12 16:06:36 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:06:36 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:06:36 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2
Apr 12 16:06:36 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:06:36 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:06:36 user nova-compute[71874]: FIRMWARE:
Apr 12 16:06:36 user nova-compute[71874]: No targets found.
Apr 12 16:06:36 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:06:36 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-77f0be82-18a1-400f-9604-250ca2c73fad tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 16:06:36 user nova-compute[71874]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 16:06:36 user nova-compute[71874]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71874) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 16:06:36 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-77f0be82-18a1-400f-9604-250ca2c73fad tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a1a05ef1-b072-47ea-8888-974917b35236', 0)] {{(pid=71874) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 16:06:36 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:06:36 user nova-compute[71874]: DEBUG nova.compute.manager [req-4edb9761-c6ea-4317-84dd-55b68fe314a8 req-8895baaa-03eb-4ff7-b0da-871bc8165c35 service nova] [instance: cb8fd1e4-401b-4f73-a789-b7183f9003fb] Received event network-vif-plugged-7a9fa84a-39d3-4580-b205-6a75686ba943 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:06:36 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-4edb9761-c6ea-4317-84dd-55b68fe314a8 req-8895baaa-03eb-4ff7-b0da-871bc8165c35 service nova] Acquiring lock "cb8fd1e4-401b-4f73-a789-b7183f9003fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:06:36 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-4edb9761-c6ea-4317-84dd-55b68fe314a8 req-8895baaa-03eb-4ff7-b0da-871bc8165c35 service nova] Lock "cb8fd1e4-401b-4f73-a789-b7183f9003fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:06:36 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-4edb9761-c6ea-4317-84dd-55b68fe314a8 req-8895baaa-03eb-4ff7-b0da-871bc8165c35 service nova] Lock "cb8fd1e4-401b-4f73-a789-b7183f9003fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:06:36 user nova-compute[71874]: DEBUG nova.compute.manager [req-4edb9761-c6ea-4317-84dd-55b68fe314a8 req-8895baaa-03eb-4ff7-b0da-871bc8165c35 service nova] [instance: cb8fd1e4-401b-4f73-a789-b7183f9003fb] No waiting events found dispatching network-vif-plugged-7a9fa84a-39d3-4580-b205-6a75686ba943 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:06:36 user nova-compute[71874]: WARNING nova.compute.manager [req-4edb9761-c6ea-4317-84dd-55b68fe314a8 req-8895baaa-03eb-4ff7-b0da-871bc8165c35 service nova] [instance: cb8fd1e4-401b-4f73-a789-b7183f9003fb] Received unexpected event network-vif-plugged-7a9fa84a-39d3-4580-b205-6a75686ba943 for instance with vm_state deleted and task_state None.
Apr 12 16:06:36 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.030s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:06:36 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[f54a77e4-f833-4ca9-a84c-28ee89a6f86a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a1a05ef1-b072-47ea-8888-974917b35236\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:06:36 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:06:36 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:06:36 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[df893cb1-1351-4bd0-bba7-4d621c86f620]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1a05ef1-b072-47ea-8888-974917b35236 (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:06:36 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-77f0be82-18a1-400f-9604-250ca2c73fad tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:06:36 user nova-compute[71874]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1a05ef1-b072-47ea-8888-974917b35236 (non-flash)
Apr 12 16:06:36 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:06:36 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-77f0be82-18a1-400f-9604-250ca2c73fad tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:06:36 user nova-compute[71874]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1a05ef1-b072-47ea-8888-974917b35236 (non-flash)
Apr 12 16:06:36 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:06:36 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-77f0be82-18a1-400f-9604-250ca2c73fad tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc3c02a0280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a1a05ef1-b072-47ea-8888-974917b35236'): ({'sdc'}, set())}) {{(pid=71874) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 16:06:36 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-77f0be82-18a1-400f-9604-250ca2c73fad tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Removing single pathed devices sdc {{(pid=71874) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 16:06:36 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:06:36 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:06:36 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2f8111d-a0e8-422c-82ca-a49a0f0f5319]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:06:36 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:06:36 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:06:36 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[34ddb15b-eddd-4c1f-985f-e8e52e2297c5]: (4, ('ok\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:06:36 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-77f0be82-18a1-400f-9604-250ca2c73fad tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Flushing IO for device /dev/sdc {{(pid=71874) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 16:06:36 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:06:36 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:06:36 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[63837263-1ac3-489f-95cd-d279f5a7e190]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:06:36 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-77f0be82-18a1-400f-9604-250ca2c73fad tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71874) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 16:06:36 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:06:36 user nova-compute[71874]: DEBUG nova.compute.manager [req-20a66064-41ea-4b04-8897-dffb25810aed req-f53e5baf-cc73-4a12-96c3-395e2c28a2e6 service nova] [instance: cb8fd1e4-401b-4f73-a789-b7183f9003fb] Received event network-vif-deleted-7a9fa84a-39d3-4580-b205-6a75686ba943 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:06:36 user nova-compute[71874]: DEBUG nova.compute.manager [req-20a66064-41ea-4b04-8897-dffb25810aed req-f53e5baf-cc73-4a12-96c3-395e2c28a2e6 service nova] [instance: 7835bdfc-77dc-4407-8a0a-ef81eca29c91] Received event network-vif-unplugged-d0b3ae35-a6cc-416c-86a7-6ea400e14660 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:06:36 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-20a66064-41ea-4b04-8897-dffb25810aed req-f53e5baf-cc73-4a12-96c3-395e2c28a2e6 service nova] Acquiring lock "7835bdfc-77dc-4407-8a0a-ef81eca29c91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:06:36 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-20a66064-41ea-4b04-8897-dffb25810aed req-f53e5baf-cc73-4a12-96c3-395e2c28a2e6 service nova] Lock "7835bdfc-77dc-4407-8a0a-ef81eca29c91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:06:36 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-20a66064-41ea-4b04-8897-dffb25810aed req-f53e5baf-cc73-4a12-96c3-395e2c28a2e6 service nova] Lock "7835bdfc-77dc-4407-8a0a-ef81eca29c91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:06:36 user nova-compute[71874]: DEBUG nova.compute.manager [req-20a66064-41ea-4b04-8897-dffb25810aed req-f53e5baf-cc73-4a12-96c3-395e2c28a2e6 service nova] [instance: 7835bdfc-77dc-4407-8a0a-ef81eca29c91] No waiting events found dispatching network-vif-unplugged-d0b3ae35-a6cc-416c-86a7-6ea400e14660 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:06:36 user nova-compute[71874]: DEBUG nova.compute.manager [req-20a66064-41ea-4b04-8897-dffb25810aed req-f53e5baf-cc73-4a12-96c3-395e2c28a2e6 service nova] [instance: 7835bdfc-77dc-4407-8a0a-ef81eca29c91] Received event network-vif-unplugged-d0b3ae35-a6cc-416c-86a7-6ea400e14660 for instance with task_state deleting. {{(pid=71874) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 16:06:36 user nova-compute[71874]: DEBUG nova.compute.manager [req-20a66064-41ea-4b04-8897-dffb25810aed req-f53e5baf-cc73-4a12-96c3-395e2c28a2e6 service nova] [instance: 7835bdfc-77dc-4407-8a0a-ef81eca29c91] Received event network-vif-plugged-d0b3ae35-a6cc-416c-86a7-6ea400e14660 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:06:36 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-20a66064-41ea-4b04-8897-dffb25810aed req-f53e5baf-cc73-4a12-96c3-395e2c28a2e6 service nova] Acquiring lock "7835bdfc-77dc-4407-8a0a-ef81eca29c91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:06:36 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-20a66064-41ea-4b04-8897-dffb25810aed req-f53e5baf-cc73-4a12-96c3-395e2c28a2e6 service nova] Lock "7835bdfc-77dc-4407-8a0a-ef81eca29c91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:06:36 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-20a66064-41ea-4b04-8897-dffb25810aed req-f53e5baf-cc73-4a12-96c3-395e2c28a2e6 service nova] Lock "7835bdfc-77dc-4407-8a0a-ef81eca29c91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:06:36 user nova-compute[71874]: DEBUG nova.compute.manager [req-20a66064-41ea-4b04-8897-dffb25810aed req-f53e5baf-cc73-4a12-96c3-395e2c28a2e6 service nova] [instance: 7835bdfc-77dc-4407-8a0a-ef81eca29c91] No waiting events found dispatching network-vif-plugged-d0b3ae35-a6cc-416c-86a7-6ea400e14660 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:06:36 user nova-compute[71874]: WARNING nova.compute.manager [req-20a66064-41ea-4b04-8897-dffb25810aed req-f53e5baf-cc73-4a12-96c3-395e2c28a2e6 service nova] [instance: 7835bdfc-77dc-4407-8a0a-ef81eca29c91] Received unexpected event network-vif-plugged-d0b3ae35-a6cc-416c-86a7-6ea400e14660 for instance with vm_state active and task_state deleting.
Apr 12 16:06:36 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.038s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:06:36 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[14ae7bed-78e4-4fde-a98e-0629104b7b9c]: (4, ('1', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:06:36 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-77f0be82-18a1-400f-9604-250ca2c73fad tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71874) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 16:06:36 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-77f0be82-18a1-400f-9604-250ca2c73fad tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] SCSI volumes sdc have been removed. {{(pid=71874) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 16:06:36 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-77f0be82-18a1-400f-9604-250ca2c73fad tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a1a05ef1-b072-47ea-8888-974917b35236')] {{(pid=71874) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 16:06:36 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1a05ef1-b072-47ea-8888-974917b35236 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:06:36 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1a05ef1-b072-47ea-8888-974917b35236 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.032s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:06:36 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[70152d0f-629b-4d98-8f64-eb306b69c97c]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:06:36 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-77f0be82-18a1-400f-9604-250ca2c73fad tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:06:36 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1a05ef1-b072-47ea-8888-974917b35236 -p 172.16.0.220:3260 --logout {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:06:36 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1a05ef1-b072-47ea-8888-974917b35236 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:06:36 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff4ce66c-8404-43f1-b992-d1c9f465d03e]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:a1a05ef1-b072-47ea-8888-974917b35236, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:a1a05ef1-b072-47ea-8888-974917b35236, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:06:36 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-77f0be82-18a1-400f-9604-250ca2c73fad tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:a1a05ef1-b072-47ea-8888-974917b35236, portal: 172.16.0.220,3260]
Apr 12 16:06:36 user nova-compute[71874]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:a1a05ef1-b072-47ea-8888-974917b35236, portal: 172.16.0.220,3260] successful.
Apr 12 16:06:36 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:06:36 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1a05ef1-b072-47ea-8888-974917b35236 -p 172.16.0.220:3260 --op delete {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:06:36 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1a05ef1-b072-47ea-8888-974917b35236 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:06:36 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfb04dc9-5d52-45c3-85ae-82b1e3aa0d20]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:06:36 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-77f0be82-18a1-400f-9604-250ca2c73fad tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:06:36 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-77f0be82-18a1-400f-9604-250ca2c73fad tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.363s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:06:36 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-77f0be82-18a1-400f-9604-250ca2c73fad tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] <== disconnect_volume: return (364ms) None {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:06:36 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-77f0be82-18a1-400f-9604-250ca2c73fad tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] [instance: 7835bdfc-77dc-4407-8a0a-ef81eca29c91] Disconnected iSCSI Volume {{(pid=71874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 16:06:36 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-77f0be82-18a1-400f-9604-250ca2c73fad tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] [instance: 7835bdfc-77dc-4407-8a0a-ef81eca29c91] Deleting instance files /opt/stack/data/nova/instances/7835bdfc-77dc-4407-8a0a-ef81eca29c91_del
Apr 12 16:06:36 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-77f0be82-18a1-400f-9604-250ca2c73fad tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] [instance: 7835bdfc-77dc-4407-8a0a-ef81eca29c91] Deletion of /opt/stack/data/nova/instances/7835bdfc-77dc-4407-8a0a-ef81eca29c91_del complete
Apr 12 16:06:36 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:06:36 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:06:36 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:06:36 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:06:36 user nova-compute[71874]: INFO nova.compute.manager [None req-77f0be82-18a1-400f-9604-250ca2c73fad tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] [instance: 7835bdfc-77dc-4407-8a0a-ef81eca29c91] Took 1.44 seconds to destroy the instance on the hypervisor.
Apr 12 16:06:36 user nova-compute[71874]: DEBUG oslo.service.loopingcall [None req-77f0be82-18a1-400f-9604-250ca2c73fad tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71874) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 16:06:36 user nova-compute[71874]: DEBUG nova.compute.manager [-] [instance: 7835bdfc-77dc-4407-8a0a-ef81eca29c91] Deallocating network for instance {{(pid=71874) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 16:06:36 user nova-compute[71874]: DEBUG nova.network.neutron [-] [instance: 7835bdfc-77dc-4407-8a0a-ef81eca29c91] deallocate_for_instance() {{(pid=71874) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 16:06:36 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:06:36 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:06:36 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:06:37 user nova-compute[71874]: DEBUG nova.network.neutron [-] [instance: 7835bdfc-77dc-4407-8a0a-ef81eca29c91] Updating instance_info_cache with network_info: [] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:06:37 user nova-compute[71874]: INFO nova.compute.manager [-] [instance: 7835bdfc-77dc-4407-8a0a-ef81eca29c91] Took 0.69 seconds to deallocate network for instance.
Apr 12 16:06:37 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:06:38 user nova-compute[71874]: INFO nova.compute.manager [None req-77f0be82-18a1-400f-9604-250ca2c73fad tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] [instance: 7835bdfc-77dc-4407-8a0a-ef81eca29c91] Took 0.85 seconds to detach 1 volumes for instance.
Apr 12 16:06:38 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-77f0be82-18a1-400f-9604-250ca2c73fad tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:06:38 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-77f0be82-18a1-400f-9604-250ca2c73fad tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:06:38 user nova-compute[71874]: DEBUG nova.compute.manager [req-e5ede8f6-f0df-4f3b-9807-838025477c4e req-b5f9b9f6-78af-4e3a-bd2b-abef19564ba5 service nova] [instance: 7835bdfc-77dc-4407-8a0a-ef81eca29c91] Received event network-vif-plugged-d0b3ae35-a6cc-416c-86a7-6ea400e14660 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:06:38 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-e5ede8f6-f0df-4f3b-9807-838025477c4e req-b5f9b9f6-78af-4e3a-bd2b-abef19564ba5 service nova] Acquiring lock "7835bdfc-77dc-4407-8a0a-ef81eca29c91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:06:38 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-e5ede8f6-f0df-4f3b-9807-838025477c4e req-b5f9b9f6-78af-4e3a-bd2b-abef19564ba5 service nova] Lock "7835bdfc-77dc-4407-8a0a-ef81eca29c91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:06:38 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-e5ede8f6-f0df-4f3b-9807-838025477c4e req-b5f9b9f6-78af-4e3a-bd2b-abef19564ba5 service nova] Lock "7835bdfc-77dc-4407-8a0a-ef81eca29c91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:06:38 user nova-compute[71874]: DEBUG nova.compute.manager [req-e5ede8f6-f0df-4f3b-9807-838025477c4e req-b5f9b9f6-78af-4e3a-bd2b-abef19564ba5 service nova] [instance: 7835bdfc-77dc-4407-8a0a-ef81eca29c91] No waiting events found dispatching network-vif-plugged-d0b3ae35-a6cc-416c-86a7-6ea400e14660 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:06:38 user nova-compute[71874]: WARNING nova.compute.manager [req-e5ede8f6-f0df-4f3b-9807-838025477c4e req-b5f9b9f6-78af-4e3a-bd2b-abef19564ba5 service nova] [instance: 7835bdfc-77dc-4407-8a0a-ef81eca29c91] Received unexpected event network-vif-plugged-d0b3ae35-a6cc-416c-86a7-6ea400e14660 for instance with vm_state deleted and task_state None.
Apr 12 16:06:38 user nova-compute[71874]: DEBUG nova.compute.manager [req-e5ede8f6-f0df-4f3b-9807-838025477c4e req-b5f9b9f6-78af-4e3a-bd2b-abef19564ba5 service nova] [instance: 7835bdfc-77dc-4407-8a0a-ef81eca29c91] Received event network-vif-plugged-d0b3ae35-a6cc-416c-86a7-6ea400e14660 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:06:38 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-e5ede8f6-f0df-4f3b-9807-838025477c4e req-b5f9b9f6-78af-4e3a-bd2b-abef19564ba5 service nova] Acquiring lock "7835bdfc-77dc-4407-8a0a-ef81eca29c91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:06:38 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-e5ede8f6-f0df-4f3b-9807-838025477c4e req-b5f9b9f6-78af-4e3a-bd2b-abef19564ba5 service nova] Lock "7835bdfc-77dc-4407-8a0a-ef81eca29c91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:06:38 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-e5ede8f6-f0df-4f3b-9807-838025477c4e req-b5f9b9f6-78af-4e3a-bd2b-abef19564ba5 service nova] Lock "7835bdfc-77dc-4407-8a0a-ef81eca29c91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:06:38 user nova-compute[71874]: DEBUG nova.compute.manager [req-e5ede8f6-f0df-4f3b-9807-838025477c4e req-b5f9b9f6-78af-4e3a-bd2b-abef19564ba5 service nova] [instance: 7835bdfc-77dc-4407-8a0a-ef81eca29c91] No waiting events found dispatching network-vif-plugged-d0b3ae35-a6cc-416c-86a7-6ea400e14660 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:06:38 user nova-compute[71874]: WARNING nova.compute.manager [req-e5ede8f6-f0df-4f3b-9807-838025477c4e req-b5f9b9f6-78af-4e3a-bd2b-abef19564ba5 service nova] [instance: 7835bdfc-77dc-4407-8a0a-ef81eca29c91] Received unexpected event network-vif-plugged-d0b3ae35-a6cc-416c-86a7-6ea400e14660 for instance with vm_state deleted and task_state None.
Apr 12 16:06:38 user nova-compute[71874]: DEBUG nova.compute.manager [req-e5ede8f6-f0df-4f3b-9807-838025477c4e req-b5f9b9f6-78af-4e3a-bd2b-abef19564ba5 service nova] [instance: 7835bdfc-77dc-4407-8a0a-ef81eca29c91] Received event network-vif-unplugged-d0b3ae35-a6cc-416c-86a7-6ea400e14660 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:06:38 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-e5ede8f6-f0df-4f3b-9807-838025477c4e req-b5f9b9f6-78af-4e3a-bd2b-abef19564ba5 service nova] Acquiring lock "7835bdfc-77dc-4407-8a0a-ef81eca29c91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:06:38 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-e5ede8f6-f0df-4f3b-9807-838025477c4e req-b5f9b9f6-78af-4e3a-bd2b-abef19564ba5 service nova] Lock "7835bdfc-77dc-4407-8a0a-ef81eca29c91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:06:38 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-e5ede8f6-f0df-4f3b-9807-838025477c4e req-b5f9b9f6-78af-4e3a-bd2b-abef19564ba5 service nova] Lock "7835bdfc-77dc-4407-8a0a-ef81eca29c91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:06:38 user nova-compute[71874]: DEBUG nova.compute.manager [req-e5ede8f6-f0df-4f3b-9807-838025477c4e req-b5f9b9f6-78af-4e3a-bd2b-abef19564ba5 service nova] [instance: 7835bdfc-77dc-4407-8a0a-ef81eca29c91] No waiting events found dispatching network-vif-unplugged-d0b3ae35-a6cc-416c-86a7-6ea400e14660 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:06:38 user nova-compute[71874]: WARNING nova.compute.manager [req-e5ede8f6-f0df-4f3b-9807-838025477c4e req-b5f9b9f6-78af-4e3a-bd2b-abef19564ba5 service nova] [instance: 7835bdfc-77dc-4407-8a0a-ef81eca29c91] Received unexpected event network-vif-unplugged-d0b3ae35-a6cc-416c-86a7-6ea400e14660 for instance with vm_state deleted and task_state None.
Apr 12 16:06:38 user nova-compute[71874]: DEBUG nova.compute.manager [req-e5ede8f6-f0df-4f3b-9807-838025477c4e req-b5f9b9f6-78af-4e3a-bd2b-abef19564ba5 service nova] [instance: 7835bdfc-77dc-4407-8a0a-ef81eca29c91] Received event network-vif-plugged-d0b3ae35-a6cc-416c-86a7-6ea400e14660 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:06:38 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-e5ede8f6-f0df-4f3b-9807-838025477c4e req-b5f9b9f6-78af-4e3a-bd2b-abef19564ba5 service nova] Acquiring lock "7835bdfc-77dc-4407-8a0a-ef81eca29c91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:06:38 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-e5ede8f6-f0df-4f3b-9807-838025477c4e req-b5f9b9f6-78af-4e3a-bd2b-abef19564ba5 service nova] Lock "7835bdfc-77dc-4407-8a0a-ef81eca29c91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:06:38 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-e5ede8f6-f0df-4f3b-9807-838025477c4e req-b5f9b9f6-78af-4e3a-bd2b-abef19564ba5 service nova] Lock "7835bdfc-77dc-4407-8a0a-ef81eca29c91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:06:38 user nova-compute[71874]: DEBUG nova.compute.manager [req-e5ede8f6-f0df-4f3b-9807-838025477c4e req-b5f9b9f6-78af-4e3a-bd2b-abef19564ba5 service nova] [instance: 7835bdfc-77dc-4407-8a0a-ef81eca29c91] No waiting events found dispatching network-vif-plugged-d0b3ae35-a6cc-416c-86a7-6ea400e14660 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:06:38 user nova-compute[71874]: WARNING nova.compute.manager [req-e5ede8f6-f0df-4f3b-9807-838025477c4e req-b5f9b9f6-78af-4e3a-bd2b-abef19564ba5 service nova] [instance: 7835bdfc-77dc-4407-8a0a-ef81eca29c91] Received unexpected event network-vif-plugged-d0b3ae35-a6cc-416c-86a7-6ea400e14660 for instance with vm_state deleted and task_state None.
Apr 12 16:06:38 user nova-compute[71874]: DEBUG nova.compute.manager [req-e5ede8f6-f0df-4f3b-9807-838025477c4e req-b5f9b9f6-78af-4e3a-bd2b-abef19564ba5 service nova] [instance: 7835bdfc-77dc-4407-8a0a-ef81eca29c91] Received event network-vif-deleted-d0b3ae35-a6cc-416c-86a7-6ea400e14660 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:06:38 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-77f0be82-18a1-400f-9604-250ca2c73fad tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Inventory has not changed in ProviderTree for provider: 0e94b4c8-cd49-45e4-9133-d36eb4b2456b {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 16:06:38 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-77f0be82-18a1-400f-9604-250ca2c73fad tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Inventory has not changed for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 16:06:38 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-77f0be82-18a1-400f-9604-250ca2c73fad tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.343s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:06:38 user nova-compute[71874]: INFO nova.scheduler.client.report [None req-77f0be82-18a1-400f-9604-250ca2c73fad tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Deleted allocations for instance 7835bdfc-77dc-4407-8a0a-ef81eca29c91
Apr 12 16:06:38 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-77f0be82-18a1-400f-9604-250ca2c73fad tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Lock "7835bdfc-77dc-4407-8a0a-ef81eca29c91" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.518s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:06:41 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:06:46 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:06:46 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:06:46 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71874) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 16:06:46 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71874) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 16:06:46 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71874) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 16:06:46 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:06:47 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:06:47 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:06:49 user nova-compute[71874]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681315594.2727878, cb8fd1e4-401b-4f73-a789-b7183f9003fb => Stopped> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:06:49 user nova-compute[71874]: INFO nova.compute.manager [-] [instance: cb8fd1e4-401b-4f73-a789-b7183f9003fb] VM Stopped (Lifecycle Event)
Apr 12 16:06:49 user nova-compute[71874]: DEBUG nova.compute.manager [None req-c6f18b17-736b-4a81-97f0-6c0464779017 None None] [instance: cb8fd1e4-401b-4f73-a789-b7183f9003fb] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:06:50 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:06:50 user nova-compute[71874]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681315595.9760604, 7835bdfc-77dc-4407-8a0a-ef81eca29c91 => Stopped> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:06:50 user nova-compute[71874]: INFO nova.compute.manager [-] [instance: 7835bdfc-77dc-4407-8a0a-ef81eca29c91] VM Stopped (Lifecycle Event)
Apr 12 16:06:51 user nova-compute[71874]: DEBUG nova.compute.manager [None req-3fa988ad-e03c-43ca-b1d5-b7e5e8932001 None None] [instance: 7835bdfc-77dc-4407-8a0a-ef81eca29c91] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:06:51 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:06:52 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:06:53 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-c5b32526-554a-4a9b-ad13-2985b23b796f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Acquiring lock "d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:06:53 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-c5b32526-554a-4a9b-ad13-2985b23b796f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:06:53 user nova-compute[71874]: DEBUG nova.compute.manager [None req-c5b32526-554a-4a9b-ad13-2985b23b796f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] Starting instance... {{(pid=71874) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 16:06:53 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-c5b32526-554a-4a9b-ad13-2985b23b796f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:06:53 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-c5b32526-554a-4a9b-ad13-2985b23b796f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:06:53 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-c5b32526-554a-4a9b-ad13-2985b23b796f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71874) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 16:06:53 user nova-compute[71874]: INFO nova.compute.claims [None req-c5b32526-554a-4a9b-ad13-2985b23b796f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] Claim successful on node user
Apr 12 16:06:54 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-c5b32526-554a-4a9b-ad13-2985b23b796f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Inventory has not changed in ProviderTree for provider: 0e94b4c8-cd49-45e4-9133-d36eb4b2456b {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 16:06:54 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-c5b32526-554a-4a9b-ad13-2985b23b796f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Inventory has not changed for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 16:06:54 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-c5b32526-554a-4a9b-ad13-2985b23b796f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.380s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:06:54 user nova-compute[71874]: DEBUG nova.compute.manager [None req-c5b32526-554a-4a9b-ad13-2985b23b796f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] Start building networks asynchronously for instance. {{(pid=71874) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 16:06:54 user nova-compute[71874]: DEBUG nova.compute.manager [None req-c5b32526-554a-4a9b-ad13-2985b23b796f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] Allocating IP information in the background. {{(pid=71874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 16:06:54 user nova-compute[71874]: DEBUG nova.network.neutron [None req-c5b32526-554a-4a9b-ad13-2985b23b796f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] allocate_for_instance() {{(pid=71874) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 16:06:54 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-c5b32526-554a-4a9b-ad13-2985b23b796f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 16:06:54 user nova-compute[71874]: DEBUG nova.compute.manager [None req-c5b32526-554a-4a9b-ad13-2985b23b796f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] Start building block device mappings for instance. {{(pid=71874) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 16:06:54 user nova-compute[71874]: DEBUG nova.policy [None req-c5b32526-554a-4a9b-ad13-2985b23b796f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c1abec24caf74dc8a27b64c21a9d4a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fa122cbabe94c6f93c862b4daf31e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71874) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 16:06:54 user nova-compute[71874]: DEBUG nova.compute.manager [None req-c5b32526-554a-4a9b-ad13-2985b23b796f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] Start spawning the instance on the hypervisor. {{(pid=71874) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 16:06:54 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-c5b32526-554a-4a9b-ad13-2985b23b796f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] Creating instance directory {{(pid=71874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 16:06:54 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-c5b32526-554a-4a9b-ad13-2985b23b796f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] Creating image(s)
Apr 12 16:06:54 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-c5b32526-554a-4a9b-ad13-2985b23b796f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Acquiring lock "/opt/stack/data/nova/instances/d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:06:54 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-c5b32526-554a-4a9b-ad13-2985b23b796f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "/opt/stack/data/nova/instances/d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.003s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:06:54 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-c5b32526-554a-4a9b-ad13-2985b23b796f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "/opt/stack/data/nova/instances/d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:06:54 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-c5b32526-554a-4a9b-ad13-2985b23b796f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:06:54 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-c5b32526-554a-4a9b-ad13-2985b23b796f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json" returned: 0 in 0.139s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:06:54 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-c5b32526-554a-4a9b-ad13-2985b23b796f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Acquiring lock "b88df1b37cb431f52bc53b5616015c89b5bec411" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:06:54 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-c5b32526-554a-4a9b-ad13-2985b23b796f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "b88df1b37cb431f52bc53b5616015c89b5bec411" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:06:54 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-c5b32526-554a-4a9b-ad13-2985b23b796f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:06:54 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-c5b32526-554a-4a9b-ad13-2985b23b796f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json" returned: 0 in 0.132s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:06:54 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-c5b32526-554a-4a9b-ad13-2985b23b796f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411,backing_fmt=raw /opt/stack/data/nova/instances/d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e/disk 1073741824 {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:06:54 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-c5b32526-554a-4a9b-ad13-2985b23b796f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411,backing_fmt=raw /opt/stack/data/nova/instances/d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e/disk 1073741824" returned: 0 in 0.051s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:06:54 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-c5b32526-554a-4a9b-ad13-2985b23b796f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "b88df1b37cb431f52bc53b5616015c89b5bec411" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.190s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:06:54 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-c5b32526-554a-4a9b-ad13-2985b23b796f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:06:54 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-c5b32526-554a-4a9b-ad13-2985b23b796f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json" returned: 0 in 0.137s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:06:54 user nova-compute[71874]: DEBUG nova.virt.disk.api [None req-c5b32526-554a-4a9b-ad13-2985b23b796f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e/disk. size=1073741824 {{(pid=71874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 16:06:54 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-c5b32526-554a-4a9b-ad13-2985b23b796f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:06:55 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:06:55 user nova-compute[71874]: DEBUG nova.network.neutron [None req-c5b32526-554a-4a9b-ad13-2985b23b796f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] Successfully created port: e2e566dd-85b6-43a5-b007-15d987e2af56 {{(pid=71874) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 16:06:55 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-c5b32526-554a-4a9b-ad13-2985b23b796f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:06:55 user nova-compute[71874]: DEBUG nova.virt.disk.api [None req-c5b32526-554a-4a9b-ad13-2985b23b796f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Cannot resize image /opt/stack/data/nova/instances/d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e/disk to a smaller size. {{(pid=71874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 16:06:55 user nova-compute[71874]: DEBUG nova.objects.instance [None req-c5b32526-554a-4a9b-ad13-2985b23b796f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lazy-loading 'migration_context' on Instance uuid d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:06:55 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-c5b32526-554a-4a9b-ad13-2985b23b796f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] Created local disks {{(pid=71874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 16:06:55 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-c5b32526-554a-4a9b-ad13-2985b23b796f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] Ensure instance console log exists: /opt/stack/data/nova/instances/d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e/console.log {{(pid=71874) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 16:06:55 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-c5b32526-554a-4a9b-ad13-2985b23b796f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:06:55 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-c5b32526-554a-4a9b-ad13-2985b23b796f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:06:55 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-c5b32526-554a-4a9b-ad13-2985b23b796f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:06:56 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:06:56 user nova-compute[71874]: DEBUG nova.network.neutron [None req-c5b32526-554a-4a9b-ad13-2985b23b796f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] Successfully updated port: e2e566dd-85b6-43a5-b007-15d987e2af56 {{(pid=71874) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 16:06:56 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-c5b32526-554a-4a9b-ad13-2985b23b796f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Acquiring lock "refresh_cache-d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:06:56 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-c5b32526-554a-4a9b-ad13-2985b23b796f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Acquired lock "refresh_cache-d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:06:56 user nova-compute[71874]: DEBUG nova.network.neutron [None req-c5b32526-554a-4a9b-ad13-2985b23b796f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] Building network info cache for instance {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 16:06:56 user nova-compute[71874]: DEBUG nova.compute.manager [req-3ec253d3-7d5f-4bc2-b0ff-41f2aed99361 req-d9ce6b63-cab3-425a-b335-5fd9487f0483 service nova] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] Received event network-changed-e2e566dd-85b6-43a5-b007-15d987e2af56 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:06:56 user nova-compute[71874]: DEBUG nova.compute.manager [req-3ec253d3-7d5f-4bc2-b0ff-41f2aed99361 req-d9ce6b63-cab3-425a-b335-5fd9487f0483 service nova] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] Refreshing instance network info cache due to event network-changed-e2e566dd-85b6-43a5-b007-15d987e2af56. {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 16:06:56 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-3ec253d3-7d5f-4bc2-b0ff-41f2aed99361 req-d9ce6b63-cab3-425a-b335-5fd9487f0483 service nova] Acquiring lock "refresh_cache-d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:06:56 user nova-compute[71874]: DEBUG nova.network.neutron [None req-c5b32526-554a-4a9b-ad13-2985b23b796f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] Instance cache missing network info. {{(pid=71874) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 16:06:56 user nova-compute[71874]: DEBUG nova.network.neutron [None req-c5b32526-554a-4a9b-ad13-2985b23b796f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] Updating instance_info_cache with network_info: [{"id": "e2e566dd-85b6-43a5-b007-15d987e2af56", "address": "fa:16:3e:88:85:6b", "network": {"id": "eb4dd4b5-96d4-4b53-b510-d41e2775b92f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-596111273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fa122cbabe94c6f93c862b4daf31e50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2e566dd-85", "ovs_interfaceid": "e2e566dd-85b6-43a5-b007-15d987e2af56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:06:56 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-c5b32526-554a-4a9b-ad13-2985b23b796f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Releasing lock "refresh_cache-d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:06:56 user nova-compute[71874]: DEBUG nova.compute.manager [None req-c5b32526-554a-4a9b-ad13-2985b23b796f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] Instance network_info: |[{"id": "e2e566dd-85b6-43a5-b007-15d987e2af56", "address": "fa:16:3e:88:85:6b", "network": {"id": "eb4dd4b5-96d4-4b53-b510-d41e2775b92f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-596111273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fa122cbabe94c6f93c862b4daf31e50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2e566dd-85", "ovs_interfaceid": "e2e566dd-85b6-43a5-b007-15d987e2af56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 16:06:56 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-3ec253d3-7d5f-4bc2-b0ff-41f2aed99361 req-d9ce6b63-cab3-425a-b335-5fd9487f0483 service nova] Acquired lock "refresh_cache-d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:06:56 user nova-compute[71874]: DEBUG nova.network.neutron [req-3ec253d3-7d5f-4bc2-b0ff-41f2aed99361 req-d9ce6b63-cab3-425a-b335-5fd9487f0483 service nova] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] Refreshing network info cache for port e2e566dd-85b6-43a5-b007-15d987e2af56 {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 16:06:56 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-c5b32526-554a-4a9b-ad13-2985b23b796f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] Start _get_guest_xml network_info=[{"id": "e2e566dd-85b6-43a5-b007-15d987e2af56", "address": "fa:16:3e:88:85:6b", "network": {"id": "eb4dd4b5-96d4-4b53-b510-d41e2775b92f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-596111273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fa122cbabe94c6f93c862b4daf31e50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2e566dd-85", "ovs_interfaceid": "e2e566dd-85b6-43a5-b007-15d987e2af56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T15:55:37Z,direct_url=<?>,disk_format='qcow2',id=9dc63f14-8b70-4e72-89f2-13464f2f5c7c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='61a4936d9b7744c0b488d81c9b7746b6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T15:55:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_options': None, 'image_id': '9dc63f14-8b70-4e72-89f2-13464f2f5c7c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 16:06:56 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-c5b32526-554a-4a9b-ad13-2985b23b796f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:06:56 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-c5b32526-554a-4a9b-ad13-2985b23b796f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:06:56 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-c5b32526-554a-4a9b-ad13-2985b23b796f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71874) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 16:06:56 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-c5b32526-554a-4a9b-ad13-2985b23b796f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T15:56:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T15:55:37Z,direct_url=<?>,disk_format='qcow2',id=9dc63f14-8b70-4e72-89f2-13464f2f5c7c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='61a4936d9b7744c0b488d81c9b7746b6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T15:55:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 16:06:56 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-c5b32526-554a-4a9b-ad13-2985b23b796f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Flavor limits 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 16:06:56 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-c5b32526-554a-4a9b-ad13-2985b23b796f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Image limits 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 16:06:56 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-c5b32526-554a-4a9b-ad13-2985b23b796f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Flavor pref 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 16:06:56 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-c5b32526-554a-4a9b-ad13-2985b23b796f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Image pref 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 16:06:56 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-c5b32526-554a-4a9b-ad13-2985b23b796f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 16:06:56 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-c5b32526-554a-4a9b-ad13-2985b23b796f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 16:06:56 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-c5b32526-554a-4a9b-ad13-2985b23b796f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 16:06:56 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-c5b32526-554a-4a9b-ad13-2985b23b796f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Got 1 possible topologies {{(pid=71874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 16:06:56 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-c5b32526-554a-4a9b-ad13-2985b23b796f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 16:06:56 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-c5b32526-554a-4a9b-ad13-2985b23b796f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 16:06:56 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-c5b32526-554a-4a9b-ad13-2985b23b796f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T16:06:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-555700697',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-555700697',id=23,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBqm4X1GPAEsvdMh1GO761bXVv1VUyRSugyouG8rhVils1/hHVrIYx63R3qDcmpgztzn8AC8dxMFAH78ymrOF6BZDB1CDRnw9cjgtplakD6t2lDEw7VFcHyaQTdxPCChxA==',key_name='tempest-keypair-746668212',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1fa122cbabe94c6f93c862b4daf31e50',ramdisk_id='',reservation_id='r-pdzop9wc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-292107264',owner_user_name='tempest-AttachVolumeShelveTestJSON-292107264-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T16:06:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c1abec24caf74dc8a27b64c21a9d4a59',uuid=d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e2e566dd-85b6-43a5-b007-15d987e2af56", "address": "fa:16:3e:88:85:6b", "network": {"id": "eb4dd4b5-96d4-4b53-b510-d41e2775b92f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-596111273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fa122cbabe94c6f93c862b4daf31e50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2e566dd-85", "ovs_interfaceid": "e2e566dd-85b6-43a5-b007-15d987e2af56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 16:06:56 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-c5b32526-554a-4a9b-ad13-2985b23b796f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Converting VIF {"id": "e2e566dd-85b6-43a5-b007-15d987e2af56", "address": "fa:16:3e:88:85:6b", "network": {"id": "eb4dd4b5-96d4-4b53-b510-d41e2775b92f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-596111273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fa122cbabe94c6f93c862b4daf31e50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2e566dd-85", "ovs_interfaceid": "e2e566dd-85b6-43a5-b007-15d987e2af56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:06:56 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-c5b32526-554a-4a9b-ad13-2985b23b796f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:85:6b,bridge_name='br-int',has_traffic_filtering=True,id=e2e566dd-85b6-43a5-b007-15d987e2af56,network=Network(eb4dd4b5-96d4-4b53-b510-d41e2775b92f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2e566dd-85') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:06:56 user nova-compute[71874]: DEBUG nova.objects.instance [None req-c5b32526-554a-4a9b-ad13-2985b23b796f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lazy-loading 'pci_devices' on Instance uuid d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:06:56 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-c5b32526-554a-4a9b-ad13-2985b23b796f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] End _get_guest_xml xml=<domain type="kvm">
Apr 12 16:06:56 user nova-compute[71874]:   <uuid>d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e</uuid>
Apr 12 16:06:56 user nova-compute[71874]:   <name>instance-00000017</name>
Apr 12 16:06:56 user nova-compute[71874]:   <memory>131072</memory>
Apr 12 16:06:56 user nova-compute[71874]:   <vcpu>1</vcpu>
Apr 12 16:06:56 user nova-compute[71874]:   <metadata>
Apr 12 16:06:56 user nova-compute[71874]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 16:06:56 user nova-compute[71874]:       <nova:package version="0.0.0"/>
Apr 12 16:06:56 user nova-compute[71874]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-555700697</nova:name>
Apr 12 16:06:56 user nova-compute[71874]:       <nova:creationTime>2023-04-12 16:06:56</nova:creationTime>
Apr 12 16:06:56 user nova-compute[71874]:       <nova:flavor name="m1.nano">
Apr 12 16:06:56 user nova-compute[71874]:         <nova:memory>128</nova:memory>
Apr 12 16:06:56 user nova-compute[71874]:         <nova:disk>1</nova:disk>
Apr 12 16:06:56 user nova-compute[71874]:         <nova:swap>0</nova:swap>
Apr 12 16:06:56 user nova-compute[71874]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 16:06:56 user nova-compute[71874]:         <nova:vcpus>1</nova:vcpus>
Apr 12 16:06:56 user nova-compute[71874]:       </nova:flavor>
Apr 12 16:06:56 user nova-compute[71874]:       <nova:owner>
Apr 12 16:06:56 user nova-compute[71874]:         <nova:user uuid="c1abec24caf74dc8a27b64c21a9d4a59">tempest-AttachVolumeShelveTestJSON-292107264-project-member</nova:user>
Apr 12 16:06:56 user nova-compute[71874]:         <nova:project uuid="1fa122cbabe94c6f93c862b4daf31e50">tempest-AttachVolumeShelveTestJSON-292107264</nova:project>
Apr 12 16:06:56 user nova-compute[71874]:       </nova:owner>
Apr 12 16:06:56 user nova-compute[71874]:       <nova:root type="image" uuid="9dc63f14-8b70-4e72-89f2-13464f2f5c7c"/>
Apr 12 16:06:56 user nova-compute[71874]:       <nova:ports>
Apr 12 16:06:56 user nova-compute[71874]:         <nova:port uuid="e2e566dd-85b6-43a5-b007-15d987e2af56">
Apr 12 16:06:56 user nova-compute[71874]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 12 16:06:56 user nova-compute[71874]:         </nova:port>
Apr 12 16:06:56 user nova-compute[71874]:       </nova:ports>
Apr 12 16:06:56 user nova-compute[71874]:     </nova:instance>
Apr 12 16:06:56 user nova-compute[71874]:   </metadata>
Apr 12 16:06:56 user nova-compute[71874]:   <sysinfo type="smbios">
Apr 12 16:06:56 user nova-compute[71874]:     <system>
Apr 12 16:06:56 user nova-compute[71874]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 16:06:56 user nova-compute[71874]:       <entry name="product">OpenStack Nova</entry>
Apr 12 16:06:56 user nova-compute[71874]:       <entry name="version">0.0.0</entry>
Apr 12 16:06:56 user nova-compute[71874]:       <entry name="serial">d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e</entry>
Apr 12 16:06:56 user nova-compute[71874]:       <entry name="uuid">d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e</entry>
Apr 12 16:06:56 user nova-compute[71874]:       <entry name="family">Virtual Machine</entry>
Apr 12 16:06:56 user nova-compute[71874]:     </system>
Apr 12 16:06:56 user nova-compute[71874]:   </sysinfo>
Apr 12 16:06:56 user nova-compute[71874]:   <os>
Apr 12 16:06:56 user nova-compute[71874]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 16:06:56 user nova-compute[71874]:     <boot dev="hd"/>
Apr 12 16:06:56 user nova-compute[71874]:     <smbios mode="sysinfo"/>
Apr 12 16:06:56 user nova-compute[71874]:   </os>
Apr 12 16:06:56 user nova-compute[71874]:   <features>
Apr 12 16:06:56 user nova-compute[71874]:     <acpi/>
Apr 12 16:06:56 user nova-compute[71874]:     <apic/>
Apr 12 16:06:56 user nova-compute[71874]:     <vmcoreinfo/>
Apr 12 16:06:56 user nova-compute[71874]:   </features>
Apr 12 16:06:56 user nova-compute[71874]:   <clock offset="utc">
Apr 12 16:06:56 user nova-compute[71874]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 16:06:56 user nova-compute[71874]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 16:06:56 user nova-compute[71874]:     <timer name="hpet" present="no"/>
Apr 12 16:06:56 user nova-compute[71874]:   </clock>
Apr 12 16:06:56 user nova-compute[71874]:   <cpu mode="custom" match="exact">
Apr 12 16:06:56 user nova-compute[71874]:     <model>Nehalem</model>
Apr 12 16:06:56 user nova-compute[71874]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 16:06:56 user nova-compute[71874]:   </cpu>
Apr 12 16:06:56 user nova-compute[71874]:   <devices>
Apr 12 16:06:56 user nova-compute[71874]:     <disk type="file" device="disk">
Apr 12 16:06:56 user nova-compute[71874]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 16:06:56 user nova-compute[71874]:       <source file="/opt/stack/data/nova/instances/d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e/disk"/>
Apr 12 16:06:56 user nova-compute[71874]:       <target dev="vda" bus="virtio"/>
Apr 12 16:06:56 user nova-compute[71874]:     </disk>
Apr 12 16:06:56 user nova-compute[71874]:     <interface type="ethernet">
Apr 12 16:06:56 user nova-compute[71874]:       <mac address="fa:16:3e:88:85:6b"/>
Apr 12 16:06:56 user nova-compute[71874]:       <model type="virtio"/>
Apr 12 16:06:56 user nova-compute[71874]:       <mtu size="1442"/>
Apr 12 16:06:56 user nova-compute[71874]:       <target dev="tape2e566dd-85"/>
Apr 12 16:06:56 user nova-compute[71874]:     </interface>
Apr 12 16:06:56 user nova-compute[71874]:     <serial type="pty">
Apr 12 16:06:56 user nova-compute[71874]:       <log file="/opt/stack/data/nova/instances/d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e/console.log" append="off"/>
Apr 12 16:06:56 user nova-compute[71874]:     </serial>
Apr 12 16:06:56 user nova-compute[71874]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 16:06:56 user nova-compute[71874]:     <video>
Apr 12 16:06:56 user nova-compute[71874]:       <model type="virtio"/>
Apr 12 16:06:56 user nova-compute[71874]:     </video>
Apr 12 16:06:56 user nova-compute[71874]:     <rng model="virtio">
Apr 12 16:06:56 user nova-compute[71874]:       <backend model="random">/dev/urandom</backend>
Apr 12 16:06:56 user nova-compute[71874]:     </rng>
Apr 12 16:06:56 user nova-compute[71874]:     <controller type="usb" index="0" model="none"/>
Apr 12 16:06:56 user nova-compute[71874]:     <memballoon model="virtio">
Apr 12 16:06:56 user nova-compute[71874]:       <stats period="10"/>
Apr 12 16:06:56 user nova-compute[71874]:     </memballoon>
Apr 12 16:06:56 user nova-compute[71874]:   </devices>
Apr 12 16:06:56 user nova-compute[71874]: </domain>
Apr 12 16:06:56 user nova-compute[71874]:  {{(pid=71874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 16:06:56 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-c5b32526-554a-4a9b-ad13-2985b23b796f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T16:06:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-555700697',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-555700697',id=23,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBqm4X1GPAEsvdMh1GO761bXVv1VUyRSugyouG8rhVils1/hHVrIYx63R3qDcmpgztzn8AC8dxMFAH78ymrOF6BZDB1CDRnw9cjgtplakD6t2lDEw7VFcHyaQTdxPCChxA==',key_name='tempest-keypair-746668212',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1fa122cbabe94c6f93c862b4daf31e50',ramdisk_id='',reservation_id='r-pdzop9wc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-292107264',owner_user_name='tempest-AttachVolumeShelveTestJSON-292107264-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T16:06:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c1abec24caf74dc8a27b64c21a9d4a59',uuid=d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e2e566dd-85b6-43a5-b007-15d987e2af56", "address": "fa:16:3e:88:85:6b", "network": {"id": "eb4dd4b5-96d4-4b53-b510-d41e2775b92f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-596111273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fa122cbabe94c6f93c862b4daf31e50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2e566dd-85", "ovs_interfaceid": "e2e566dd-85b6-43a5-b007-15d987e2af56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 16:06:56 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-c5b32526-554a-4a9b-ad13-2985b23b796f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Converting VIF {"id": "e2e566dd-85b6-43a5-b007-15d987e2af56", "address": "fa:16:3e:88:85:6b", "network": {"id": "eb4dd4b5-96d4-4b53-b510-d41e2775b92f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-596111273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fa122cbabe94c6f93c862b4daf31e50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2e566dd-85", "ovs_interfaceid": "e2e566dd-85b6-43a5-b007-15d987e2af56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:06:56 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-c5b32526-554a-4a9b-ad13-2985b23b796f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:85:6b,bridge_name='br-int',has_traffic_filtering=True,id=e2e566dd-85b6-43a5-b007-15d987e2af56,network=Network(eb4dd4b5-96d4-4b53-b510-d41e2775b92f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2e566dd-85') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:06:56 user nova-compute[71874]: DEBUG os_vif [None req-c5b32526-554a-4a9b-ad13-2985b23b796f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:85:6b,bridge_name='br-int',has_traffic_filtering=True,id=e2e566dd-85b6-43a5-b007-15d987e2af56,network=Network(eb4dd4b5-96d4-4b53-b510-d41e2775b92f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2e566dd-85') {{(pid=71874) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 16:06:56 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:06:56 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:06:56 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 16:06:56 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:06:56 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape2e566dd-85, may_exist=True) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:06:56 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape2e566dd-85, col_values=(('external_ids', {'iface-id': 'e2e566dd-85b6-43a5-b007-15d987e2af56', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:88:85:6b', 'vm-uuid': 'd9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e'}),)) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:06:56 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:06:56 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:06:56 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:06:56 user nova-compute[71874]: INFO os_vif [None req-c5b32526-554a-4a9b-ad13-2985b23b796f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:85:6b,bridge_name='br-int',has_traffic_filtering=True,id=e2e566dd-85b6-43a5-b007-15d987e2af56,network=Network(eb4dd4b5-96d4-4b53-b510-d41e2775b92f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2e566dd-85')
Apr 12 16:06:56 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-c5b32526-554a-4a9b-ad13-2985b23b796f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] No BDM found with device name vda, not building metadata. {{(pid=71874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 16:06:56 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-c5b32526-554a-4a9b-ad13-2985b23b796f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] No VIF found with MAC fa:16:3e:88:85:6b, not building metadata {{(pid=71874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 16:06:57 user nova-compute[71874]: DEBUG nova.network.neutron [req-3ec253d3-7d5f-4bc2-b0ff-41f2aed99361 req-d9ce6b63-cab3-425a-b335-5fd9487f0483 service nova] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] Updated VIF entry in instance network info cache for port e2e566dd-85b6-43a5-b007-15d987e2af56. {{(pid=71874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 16:06:57 user nova-compute[71874]: DEBUG nova.network.neutron [req-3ec253d3-7d5f-4bc2-b0ff-41f2aed99361 req-d9ce6b63-cab3-425a-b335-5fd9487f0483 service nova] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] Updating instance_info_cache with network_info: [{"id": "e2e566dd-85b6-43a5-b007-15d987e2af56", "address": "fa:16:3e:88:85:6b", "network": {"id": "eb4dd4b5-96d4-4b53-b510-d41e2775b92f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-596111273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fa122cbabe94c6f93c862b4daf31e50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2e566dd-85", "ovs_interfaceid": "e2e566dd-85b6-43a5-b007-15d987e2af56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:06:57 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-3ec253d3-7d5f-4bc2-b0ff-41f2aed99361 req-d9ce6b63-cab3-425a-b335-5fd9487f0483 service nova] Releasing lock "refresh_cache-d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:06:57 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:06:58 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:06:58 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:06:58 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:06:58 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:06:58 user nova-compute[71874]: DEBUG nova.compute.manager [req-c6fe85b1-d657-41f2-9f2e-dab50b2ad236 req-b46a5674-eafe-41d6-b48e-165cc8832e01 service nova] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] Received event network-vif-plugged-e2e566dd-85b6-43a5-b007-15d987e2af56 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:06:58 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-c6fe85b1-d657-41f2-9f2e-dab50b2ad236 req-b46a5674-eafe-41d6-b48e-165cc8832e01 service nova] Acquiring lock "d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:06:58 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-c6fe85b1-d657-41f2-9f2e-dab50b2ad236 req-b46a5674-eafe-41d6-b48e-165cc8832e01 service nova] Lock "d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:06:58 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-c6fe85b1-d657-41f2-9f2e-dab50b2ad236 req-b46a5674-eafe-41d6-b48e-165cc8832e01 service nova] Lock "d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:06:58 user nova-compute[71874]: DEBUG nova.compute.manager [req-c6fe85b1-d657-41f2-9f2e-dab50b2ad236 req-b46a5674-eafe-41d6-b48e-165cc8832e01 service nova] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] No waiting events found dispatching network-vif-plugged-e2e566dd-85b6-43a5-b007-15d987e2af56 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:06:58 user nova-compute[71874]: WARNING nova.compute.manager [req-c6fe85b1-d657-41f2-9f2e-dab50b2ad236 req-b46a5674-eafe-41d6-b48e-165cc8832e01 service nova] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] Received unexpected event network-vif-plugged-e2e566dd-85b6-43a5-b007-15d987e2af56 for instance with vm_state building and task_state spawning.
Apr 12 16:06:58 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:06:58 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:06:58 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:07:00 user nova-compute[71874]: DEBUG nova.virt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Emitting event <LifecycleEvent: 1681315620.4405189, d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e => Resumed> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:07:00 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] VM Resumed (Lifecycle Event)
Apr 12 16:07:00 user nova-compute[71874]: DEBUG nova.compute.manager [None req-c5b32526-554a-4a9b-ad13-2985b23b796f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] Instance event wait completed in 0 seconds for  {{(pid=71874) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 16:07:00 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-c5b32526-554a-4a9b-ad13-2985b23b796f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] Guest created on hypervisor {{(pid=71874) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 16:07:00 user nova-compute[71874]: INFO nova.virt.libvirt.driver [-] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] Instance spawned successfully.
Apr 12 16:07:00 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-c5b32526-554a-4a9b-ad13-2985b23b796f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 16:07:00 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-c5b32526-554a-4a9b-ad13-2985b23b796f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] Found default for hw_cdrom_bus of ide {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:07:00 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-c5b32526-554a-4a9b-ad13-2985b23b796f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] Found default for hw_disk_bus of virtio {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:07:00 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-c5b32526-554a-4a9b-ad13-2985b23b796f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] Found default for hw_input_bus of None {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:07:00 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-c5b32526-554a-4a9b-ad13-2985b23b796f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] Found default for hw_pointer_model of None {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:07:00 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-c5b32526-554a-4a9b-ad13-2985b23b796f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] Found default for hw_video_model of virtio {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:07:00 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-c5b32526-554a-4a9b-ad13-2985b23b796f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] Found default for hw_vif_model of virtio {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:07:00 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:07:00 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 16:07:00 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 16:07:00 user nova-compute[71874]: DEBUG nova.virt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Emitting event <LifecycleEvent: 1681315620.443192, d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e => Started> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:07:00 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] VM Started (Lifecycle Event)
Apr 12 16:07:00 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:07:00 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 16:07:00 user nova-compute[71874]: INFO nova.compute.manager [None req-c5b32526-554a-4a9b-ad13-2985b23b796f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] Took 6.08 seconds to spawn the instance on the hypervisor.
Apr 12 16:07:00 user nova-compute[71874]: DEBUG nova.compute.manager [None req-c5b32526-554a-4a9b-ad13-2985b23b796f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:07:00 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 16:07:00 user nova-compute[71874]: DEBUG nova.compute.manager [req-0583a55d-50fd-4ad7-855a-d7997e0d424a req-8e9ab1fb-6f7d-489e-93d1-aa5662accbed service nova] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] Received event network-vif-plugged-e2e566dd-85b6-43a5-b007-15d987e2af56 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:07:00 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-0583a55d-50fd-4ad7-855a-d7997e0d424a req-8e9ab1fb-6f7d-489e-93d1-aa5662accbed service nova] Acquiring lock "d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:07:00 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-0583a55d-50fd-4ad7-855a-d7997e0d424a req-8e9ab1fb-6f7d-489e-93d1-aa5662accbed service nova] Lock "d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:07:00 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-0583a55d-50fd-4ad7-855a-d7997e0d424a req-8e9ab1fb-6f7d-489e-93d1-aa5662accbed service nova] Lock "d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:07:00 user nova-compute[71874]: DEBUG nova.compute.manager [req-0583a55d-50fd-4ad7-855a-d7997e0d424a req-8e9ab1fb-6f7d-489e-93d1-aa5662accbed service nova] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] No waiting events found dispatching network-vif-plugged-e2e566dd-85b6-43a5-b007-15d987e2af56 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:07:00 user nova-compute[71874]: WARNING nova.compute.manager [req-0583a55d-50fd-4ad7-855a-d7997e0d424a req-8e9ab1fb-6f7d-489e-93d1-aa5662accbed service nova] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] Received unexpected event network-vif-plugged-e2e566dd-85b6-43a5-b007-15d987e2af56 for instance with vm_state building and task_state spawning.
Apr 12 16:07:00 user nova-compute[71874]: INFO nova.compute.manager [None req-c5b32526-554a-4a9b-ad13-2985b23b796f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] Took 6.79 seconds to build instance.
Apr 12 16:07:00 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-c5b32526-554a-4a9b-ad13-2985b23b796f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.883s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:07:01 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:07:02 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:07:02 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:07:06 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:07:06 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:07:07 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:07:08 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:07:11 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:07:12 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-f9ac6fb4-da4b-4ae3-ac19-e50438fbe57b tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Acquiring lock "78b6940a-f97a-4535-8973-3c2a5befbbab" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:07:12 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-f9ac6fb4-da4b-4ae3-ac19-e50438fbe57b tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lock "78b6940a-f97a-4535-8973-3c2a5befbbab" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:07:12 user nova-compute[71874]: DEBUG nova.compute.manager [None req-f9ac6fb4-da4b-4ae3-ac19-e50438fbe57b tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] [instance: 78b6940a-f97a-4535-8973-3c2a5befbbab] Starting instance... {{(pid=71874) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 16:07:12 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-f9ac6fb4-da4b-4ae3-ac19-e50438fbe57b tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:07:12 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-f9ac6fb4-da4b-4ae3-ac19-e50438fbe57b tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:07:12 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-f9ac6fb4-da4b-4ae3-ac19-e50438fbe57b tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71874) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 16:07:12 user nova-compute[71874]: INFO nova.compute.claims [None req-f9ac6fb4-da4b-4ae3-ac19-e50438fbe57b tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] [instance: 78b6940a-f97a-4535-8973-3c2a5befbbab] Claim successful on node user
Apr 12 16:07:12 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:07:12 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-f9ac6fb4-da4b-4ae3-ac19-e50438fbe57b tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Inventory has not changed in ProviderTree for provider: 0e94b4c8-cd49-45e4-9133-d36eb4b2456b {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 16:07:12 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-f9ac6fb4-da4b-4ae3-ac19-e50438fbe57b tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Inventory has not changed for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 16:07:12 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-f9ac6fb4-da4b-4ae3-ac19-e50438fbe57b tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.421s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:07:12 user nova-compute[71874]: DEBUG nova.compute.manager [None req-f9ac6fb4-da4b-4ae3-ac19-e50438fbe57b tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] [instance: 78b6940a-f97a-4535-8973-3c2a5befbbab] Start building networks asynchronously for instance. {{(pid=71874) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 16:07:13 user nova-compute[71874]: DEBUG nova.compute.manager [None req-f9ac6fb4-da4b-4ae3-ac19-e50438fbe57b tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] [instance: 78b6940a-f97a-4535-8973-3c2a5befbbab] Allocating IP information in the background. {{(pid=71874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 16:07:13 user nova-compute[71874]: DEBUG nova.network.neutron [None req-f9ac6fb4-da4b-4ae3-ac19-e50438fbe57b tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] [instance: 78b6940a-f97a-4535-8973-3c2a5befbbab] allocate_for_instance() {{(pid=71874) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 16:07:13 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-f9ac6fb4-da4b-4ae3-ac19-e50438fbe57b tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] [instance: 78b6940a-f97a-4535-8973-3c2a5befbbab] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 16:07:13 user nova-compute[71874]: DEBUG nova.compute.manager [None req-f9ac6fb4-da4b-4ae3-ac19-e50438fbe57b tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] [instance: 78b6940a-f97a-4535-8973-3c2a5befbbab] Start building block device mappings for instance. {{(pid=71874) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 16:07:13 user nova-compute[71874]: DEBUG nova.compute.manager [None req-f9ac6fb4-da4b-4ae3-ac19-e50438fbe57b tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] [instance: 78b6940a-f97a-4535-8973-3c2a5befbbab] Start spawning the instance on the hypervisor. {{(pid=71874) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 16:07:13 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-f9ac6fb4-da4b-4ae3-ac19-e50438fbe57b tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] [instance: 78b6940a-f97a-4535-8973-3c2a5befbbab] Creating instance directory {{(pid=71874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 16:07:13 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-f9ac6fb4-da4b-4ae3-ac19-e50438fbe57b tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] [instance: 78b6940a-f97a-4535-8973-3c2a5befbbab] Creating image(s)
Apr 12 16:07:13 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-f9ac6fb4-da4b-4ae3-ac19-e50438fbe57b tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Acquiring lock "/opt/stack/data/nova/instances/78b6940a-f97a-4535-8973-3c2a5befbbab/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:07:13 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-f9ac6fb4-da4b-4ae3-ac19-e50438fbe57b tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lock "/opt/stack/data/nova/instances/78b6940a-f97a-4535-8973-3c2a5befbbab/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:07:13 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-f9ac6fb4-da4b-4ae3-ac19-e50438fbe57b tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lock "/opt/stack/data/nova/instances/78b6940a-f97a-4535-8973-3c2a5befbbab/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:07:13 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-f9ac6fb4-da4b-4ae3-ac19-e50438fbe57b tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:07:13 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-f9ac6fb4-da4b-4ae3-ac19-e50438fbe57b tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json" returned: 0 in 0.134s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:07:13 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-f9ac6fb4-da4b-4ae3-ac19-e50438fbe57b tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Acquiring lock "b88df1b37cb431f52bc53b5616015c89b5bec411" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:07:13 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-f9ac6fb4-da4b-4ae3-ac19-e50438fbe57b tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lock "b88df1b37cb431f52bc53b5616015c89b5bec411" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:07:13 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-f9ac6fb4-da4b-4ae3-ac19-e50438fbe57b tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:07:13 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-f9ac6fb4-da4b-4ae3-ac19-e50438fbe57b tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json" returned: 0 in 0.128s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:07:13 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-f9ac6fb4-da4b-4ae3-ac19-e50438fbe57b tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411,backing_fmt=raw /opt/stack/data/nova/instances/78b6940a-f97a-4535-8973-3c2a5befbbab/disk 1073741824 {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:07:13 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-f9ac6fb4-da4b-4ae3-ac19-e50438fbe57b tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411,backing_fmt=raw /opt/stack/data/nova/instances/78b6940a-f97a-4535-8973-3c2a5befbbab/disk 1073741824" returned: 0 in 0.049s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:07:13 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-f9ac6fb4-da4b-4ae3-ac19-e50438fbe57b tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lock "b88df1b37cb431f52bc53b5616015c89b5bec411" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.184s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:07:13 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-f9ac6fb4-da4b-4ae3-ac19-e50438fbe57b tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:07:13 user nova-compute[71874]: DEBUG nova.policy [None req-f9ac6fb4-da4b-4ae3-ac19-e50438fbe57b tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5e0ffc0972674609b17fe2780751dfc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77372a5e83c4fc882b0a0b0eea46f06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71874) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 16:07:13 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-f9ac6fb4-da4b-4ae3-ac19-e50438fbe57b tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json" returned: 0 in 0.129s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:07:13 user nova-compute[71874]: DEBUG nova.virt.disk.api [None req-f9ac6fb4-da4b-4ae3-ac19-e50438fbe57b tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Checking if we can resize image /opt/stack/data/nova/instances/78b6940a-f97a-4535-8973-3c2a5befbbab/disk. size=1073741824 {{(pid=71874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 16:07:13 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-f9ac6fb4-da4b-4ae3-ac19-e50438fbe57b tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78b6940a-f97a-4535-8973-3c2a5befbbab/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:07:13 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-f9ac6fb4-da4b-4ae3-ac19-e50438fbe57b tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78b6940a-f97a-4535-8973-3c2a5befbbab/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:07:13 user nova-compute[71874]: DEBUG nova.virt.disk.api [None req-f9ac6fb4-da4b-4ae3-ac19-e50438fbe57b tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Cannot resize image /opt/stack/data/nova/instances/78b6940a-f97a-4535-8973-3c2a5befbbab/disk to a smaller size. {{(pid=71874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 16:07:13 user nova-compute[71874]: DEBUG nova.objects.instance [None req-f9ac6fb4-da4b-4ae3-ac19-e50438fbe57b tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lazy-loading 'migration_context' on Instance uuid 78b6940a-f97a-4535-8973-3c2a5befbbab {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:07:13 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-f9ac6fb4-da4b-4ae3-ac19-e50438fbe57b tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] [instance: 78b6940a-f97a-4535-8973-3c2a5befbbab] Created local disks {{(pid=71874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 16:07:13 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-f9ac6fb4-da4b-4ae3-ac19-e50438fbe57b tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] [instance: 78b6940a-f97a-4535-8973-3c2a5befbbab] Ensure instance console log exists: /opt/stack/data/nova/instances/78b6940a-f97a-4535-8973-3c2a5befbbab/console.log {{(pid=71874) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 16:07:13 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-f9ac6fb4-da4b-4ae3-ac19-e50438fbe57b tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:07:13 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-f9ac6fb4-da4b-4ae3-ac19-e50438fbe57b tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:07:13 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-f9ac6fb4-da4b-4ae3-ac19-e50438fbe57b tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:07:14 user nova-compute[71874]: DEBUG nova.network.neutron [None req-f9ac6fb4-da4b-4ae3-ac19-e50438fbe57b tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] [instance: 78b6940a-f97a-4535-8973-3c2a5befbbab] Successfully created port: db313dea-d267-434a-96bb-d099b17ab2d4 {{(pid=71874) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 16:07:14 user nova-compute[71874]: DEBUG nova.network.neutron [None req-f9ac6fb4-da4b-4ae3-ac19-e50438fbe57b tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] [instance: 78b6940a-f97a-4535-8973-3c2a5befbbab] Successfully updated port: db313dea-d267-434a-96bb-d099b17ab2d4 {{(pid=71874) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 16:07:14 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-f9ac6fb4-da4b-4ae3-ac19-e50438fbe57b tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Acquiring lock "refresh_cache-78b6940a-f97a-4535-8973-3c2a5befbbab" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:07:14 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-f9ac6fb4-da4b-4ae3-ac19-e50438fbe57b tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Acquired lock "refresh_cache-78b6940a-f97a-4535-8973-3c2a5befbbab" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:07:14 user nova-compute[71874]: DEBUG nova.network.neutron [None req-f9ac6fb4-da4b-4ae3-ac19-e50438fbe57b tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] [instance: 78b6940a-f97a-4535-8973-3c2a5befbbab] Building network info cache for instance {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 16:07:14 user nova-compute[71874]: DEBUG nova.compute.manager [req-ddd89596-d622-4300-8f62-50af78f71f87 req-308175ea-f8c1-4b88-ba3b-cf62e4768846 service nova] [instance: 78b6940a-f97a-4535-8973-3c2a5befbbab] Received event network-changed-db313dea-d267-434a-96bb-d099b17ab2d4 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:07:14 user nova-compute[71874]: DEBUG nova.compute.manager [req-ddd89596-d622-4300-8f62-50af78f71f87 req-308175ea-f8c1-4b88-ba3b-cf62e4768846 service nova] [instance: 78b6940a-f97a-4535-8973-3c2a5befbbab] Refreshing instance network info cache due to event network-changed-db313dea-d267-434a-96bb-d099b17ab2d4. {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 16:07:14 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-ddd89596-d622-4300-8f62-50af78f71f87 req-308175ea-f8c1-4b88-ba3b-cf62e4768846 service nova] Acquiring lock "refresh_cache-78b6940a-f97a-4535-8973-3c2a5befbbab" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:07:14 user nova-compute[71874]: DEBUG nova.network.neutron [None req-f9ac6fb4-da4b-4ae3-ac19-e50438fbe57b tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] [instance: 78b6940a-f97a-4535-8973-3c2a5befbbab] Instance cache missing network info. {{(pid=71874) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 16:07:15 user nova-compute[71874]: DEBUG nova.network.neutron [None req-f9ac6fb4-da4b-4ae3-ac19-e50438fbe57b tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] [instance: 78b6940a-f97a-4535-8973-3c2a5befbbab] Updating instance_info_cache with network_info: [{"id": "db313dea-d267-434a-96bb-d099b17ab2d4", "address": "fa:16:3e:4c:7a:4f", "network": {"id": "1c560b5e-bb6f-42eb-b9b2-6b3f2eaed0f8", "bridge": "br-int", "label": "tempest-TestStampPattern-1356757354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a77372a5e83c4fc882b0a0b0eea46f06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb313dea-d2", "ovs_interfaceid": "db313dea-d267-434a-96bb-d099b17ab2d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:07:15 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-f9ac6fb4-da4b-4ae3-ac19-e50438fbe57b tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Releasing lock "refresh_cache-78b6940a-f97a-4535-8973-3c2a5befbbab" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:07:15 user nova-compute[71874]: DEBUG nova.compute.manager [None req-f9ac6fb4-da4b-4ae3-ac19-e50438fbe57b tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] [instance: 78b6940a-f97a-4535-8973-3c2a5befbbab] Instance network_info: |[{"id": "db313dea-d267-434a-96bb-d099b17ab2d4", "address": "fa:16:3e:4c:7a:4f", "network": {"id": "1c560b5e-bb6f-42eb-b9b2-6b3f2eaed0f8", "bridge": "br-int", "label": "tempest-TestStampPattern-1356757354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a77372a5e83c4fc882b0a0b0eea46f06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb313dea-d2", "ovs_interfaceid": "db313dea-d267-434a-96bb-d099b17ab2d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 16:07:15 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-ddd89596-d622-4300-8f62-50af78f71f87 req-308175ea-f8c1-4b88-ba3b-cf62e4768846 service nova] Acquired lock "refresh_cache-78b6940a-f97a-4535-8973-3c2a5befbbab" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:07:15 user nova-compute[71874]: DEBUG nova.network.neutron [req-ddd89596-d622-4300-8f62-50af78f71f87 req-308175ea-f8c1-4b88-ba3b-cf62e4768846 service nova] [instance: 78b6940a-f97a-4535-8973-3c2a5befbbab] Refreshing network info cache for port db313dea-d267-434a-96bb-d099b17ab2d4 {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 16:07:15 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-f9ac6fb4-da4b-4ae3-ac19-e50438fbe57b tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] [instance: 78b6940a-f97a-4535-8973-3c2a5befbbab] Start _get_guest_xml network_info=[{"id": "db313dea-d267-434a-96bb-d099b17ab2d4", "address": "fa:16:3e:4c:7a:4f", "network": {"id": "1c560b5e-bb6f-42eb-b9b2-6b3f2eaed0f8", "bridge": "br-int", "label": "tempest-TestStampPattern-1356757354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a77372a5e83c4fc882b0a0b0eea46f06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb313dea-d2", "ovs_interfaceid": "db313dea-d267-434a-96bb-d099b17ab2d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T15:55:37Z,direct_url=<?>,disk_format='qcow2',id=9dc63f14-8b70-4e72-89f2-13464f2f5c7c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='61a4936d9b7744c0b488d81c9b7746b6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T15:55:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_options': None, 'image_id': '9dc63f14-8b70-4e72-89f2-13464f2f5c7c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 16:07:15 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-f9ac6fb4-da4b-4ae3-ac19-e50438fbe57b tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:07:15 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-f9ac6fb4-da4b-4ae3-ac19-e50438fbe57b tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:07:15 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-f9ac6fb4-da4b-4ae3-ac19-e50438fbe57b tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71874) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 16:07:15 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-f9ac6fb4-da4b-4ae3-ac19-e50438fbe57b tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T15:56:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T15:55:37Z,direct_url=<?>,disk_format='qcow2',id=9dc63f14-8b70-4e72-89f2-13464f2f5c7c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='61a4936d9b7744c0b488d81c9b7746b6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T15:55:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 16:07:15 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-f9ac6fb4-da4b-4ae3-ac19-e50438fbe57b tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Flavor limits 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 16:07:15 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-f9ac6fb4-da4b-4ae3-ac19-e50438fbe57b tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Image limits 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 16:07:15 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-f9ac6fb4-da4b-4ae3-ac19-e50438fbe57b tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Flavor pref 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 16:07:15 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-f9ac6fb4-da4b-4ae3-ac19-e50438fbe57b tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Image pref 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 16:07:15 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-f9ac6fb4-da4b-4ae3-ac19-e50438fbe57b tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 16:07:15 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-f9ac6fb4-da4b-4ae3-ac19-e50438fbe57b tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 16:07:15 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-f9ac6fb4-da4b-4ae3-ac19-e50438fbe57b tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 16:07:15 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-f9ac6fb4-da4b-4ae3-ac19-e50438fbe57b tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Got 1 possible topologies {{(pid=71874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 16:07:15 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-f9ac6fb4-da4b-4ae3-ac19-e50438fbe57b tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 16:07:15 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-f9ac6fb4-da4b-4ae3-ac19-e50438fbe57b tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 16:07:15 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-f9ac6fb4-da4b-4ae3-ac19-e50438fbe57b tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T16:07:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1441208586',display_name='tempest-TestStampPattern-server-1441208586',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-1441208586',id=24,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM9rCdORWoFaEzbUsNhuoBFSyjDv4K5w82ZJzoi+0Rba6d3tv8xkR5nGe+5wcm9lUrYy4FRmQCBzLyX7FSGTRKcYmN9F41l7pVMhhHvTYmD+PQt4JX5BTIQ1nRCFqJvvxg==',key_name='tempest-TestStampPattern-1321754823',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a77372a5e83c4fc882b0a0b0eea46f06',ramdisk_id='',reservation_id='r-3v4gwg0k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1256589700',owner_user_name='tempest-TestStampPattern-1256589700-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T16:07:13Z,user_data=None,user_id='5e0ffc0972674609b17fe2780751dfc5',uuid=78b6940a-f97a-4535-8973-3c2a5befbbab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "db313dea-d267-434a-96bb-d099b17ab2d4", "address": "fa:16:3e:4c:7a:4f", "network": {"id": "1c560b5e-bb6f-42eb-b9b2-6b3f2eaed0f8", "bridge": "br-int", "label": "tempest-TestStampPattern-1356757354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a77372a5e83c4fc882b0a0b0eea46f06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb313dea-d2", "ovs_interfaceid": "db313dea-d267-434a-96bb-d099b17ab2d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 16:07:15 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-f9ac6fb4-da4b-4ae3-ac19-e50438fbe57b tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Converting VIF {"id": "db313dea-d267-434a-96bb-d099b17ab2d4", "address": "fa:16:3e:4c:7a:4f", "network": {"id": "1c560b5e-bb6f-42eb-b9b2-6b3f2eaed0f8", "bridge": "br-int", "label": "tempest-TestStampPattern-1356757354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a77372a5e83c4fc882b0a0b0eea46f06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb313dea-d2", "ovs_interfaceid": "db313dea-d267-434a-96bb-d099b17ab2d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:07:15 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-f9ac6fb4-da4b-4ae3-ac19-e50438fbe57b tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:7a:4f,bridge_name='br-int',has_traffic_filtering=True,id=db313dea-d267-434a-96bb-d099b17ab2d4,network=Network(1c560b5e-bb6f-42eb-b9b2-6b3f2eaed0f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb313dea-d2') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:07:15 user nova-compute[71874]: DEBUG nova.objects.instance [None req-f9ac6fb4-da4b-4ae3-ac19-e50438fbe57b tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lazy-loading 'pci_devices' on Instance uuid 78b6940a-f97a-4535-8973-3c2a5befbbab {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:07:15 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-f9ac6fb4-da4b-4ae3-ac19-e50438fbe57b tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] [instance: 78b6940a-f97a-4535-8973-3c2a5befbbab] End _get_guest_xml xml=<domain type="kvm">
Apr 12 16:07:15 user nova-compute[71874]:   <uuid>78b6940a-f97a-4535-8973-3c2a5befbbab</uuid>
Apr 12 16:07:15 user nova-compute[71874]:   <name>instance-00000018</name>
Apr 12 16:07:15 user nova-compute[71874]:   <memory>131072</memory>
Apr 12 16:07:15 user nova-compute[71874]:   <vcpu>1</vcpu>
Apr 12 16:07:15 user nova-compute[71874]:   <metadata>
Apr 12 16:07:15 user nova-compute[71874]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 16:07:15 user nova-compute[71874]:       <nova:package version="0.0.0"/>
Apr 12 16:07:15 user nova-compute[71874]:       <nova:name>tempest-TestStampPattern-server-1441208586</nova:name>
Apr 12 16:07:15 user nova-compute[71874]:       <nova:creationTime>2023-04-12 16:07:15</nova:creationTime>
Apr 12 16:07:15 user nova-compute[71874]:       <nova:flavor name="m1.nano">
Apr 12 16:07:15 user nova-compute[71874]:         <nova:memory>128</nova:memory>
Apr 12 16:07:15 user nova-compute[71874]:         <nova:disk>1</nova:disk>
Apr 12 16:07:15 user nova-compute[71874]:         <nova:swap>0</nova:swap>
Apr 12 16:07:15 user nova-compute[71874]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 16:07:15 user nova-compute[71874]:         <nova:vcpus>1</nova:vcpus>
Apr 12 16:07:15 user nova-compute[71874]:       </nova:flavor>
Apr 12 16:07:15 user nova-compute[71874]:       <nova:owner>
Apr 12 16:07:15 user nova-compute[71874]:         <nova:user uuid="5e0ffc0972674609b17fe2780751dfc5">tempest-TestStampPattern-1256589700-project-member</nova:user>
Apr 12 16:07:15 user nova-compute[71874]:         <nova:project uuid="a77372a5e83c4fc882b0a0b0eea46f06">tempest-TestStampPattern-1256589700</nova:project>
Apr 12 16:07:15 user nova-compute[71874]:       </nova:owner>
Apr 12 16:07:15 user nova-compute[71874]:       <nova:root type="image" uuid="9dc63f14-8b70-4e72-89f2-13464f2f5c7c"/>
Apr 12 16:07:15 user nova-compute[71874]:       <nova:ports>
Apr 12 16:07:15 user nova-compute[71874]:         <nova:port uuid="db313dea-d267-434a-96bb-d099b17ab2d4">
Apr 12 16:07:15 user nova-compute[71874]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 12 16:07:15 user nova-compute[71874]:         </nova:port>
Apr 12 16:07:15 user nova-compute[71874]:       </nova:ports>
Apr 12 16:07:15 user nova-compute[71874]:     </nova:instance>
Apr 12 16:07:15 user nova-compute[71874]:   </metadata>
Apr 12 16:07:15 user nova-compute[71874]:   <sysinfo type="smbios">
Apr 12 16:07:15 user nova-compute[71874]:     <system>
Apr 12 16:07:15 user nova-compute[71874]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 16:07:15 user nova-compute[71874]:       <entry name="product">OpenStack Nova</entry>
Apr 12 16:07:15 user nova-compute[71874]:       <entry name="version">0.0.0</entry>
Apr 12 16:07:15 user nova-compute[71874]:       <entry name="serial">78b6940a-f97a-4535-8973-3c2a5befbbab</entry>
Apr 12 16:07:15 user nova-compute[71874]:       <entry name="uuid">78b6940a-f97a-4535-8973-3c2a5befbbab</entry>
Apr 12 16:07:15 user nova-compute[71874]:       <entry name="family">Virtual Machine</entry>
Apr 12 16:07:15 user nova-compute[71874]:     </system>
Apr 12 16:07:15 user nova-compute[71874]:   </sysinfo>
Apr 12 16:07:15 user nova-compute[71874]:   <os>
Apr 12 16:07:15 user nova-compute[71874]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 16:07:15 user nova-compute[71874]:     <boot dev="hd"/>
Apr 12 16:07:15 user nova-compute[71874]:     <smbios mode="sysinfo"/>
Apr 12 16:07:15 user nova-compute[71874]:   </os>
Apr 12 16:07:15 user nova-compute[71874]:   <features>
Apr 12 16:07:15 user nova-compute[71874]:     <acpi/>
Apr 12 16:07:15 user nova-compute[71874]:     <apic/>
Apr 12 16:07:15 user nova-compute[71874]:     <vmcoreinfo/>
Apr 12 16:07:15 user nova-compute[71874]:   </features>
Apr 12 16:07:15 user nova-compute[71874]:   <clock offset="utc">
Apr 12 16:07:15 user nova-compute[71874]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 16:07:15 user nova-compute[71874]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 16:07:15 user nova-compute[71874]:     <timer name="hpet" present="no"/>
Apr 12 16:07:15 user nova-compute[71874]:   </clock>
Apr 12 16:07:15 user nova-compute[71874]:   <cpu mode="custom" match="exact">
Apr 12 16:07:15 user nova-compute[71874]:     <model>Nehalem</model>
Apr 12 16:07:15 user nova-compute[71874]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 16:07:15 user nova-compute[71874]:   </cpu>
Apr 12 16:07:15 user nova-compute[71874]:   <devices>
Apr 12 16:07:15 user nova-compute[71874]:     <disk type="file" device="disk">
Apr 12 16:07:15 user nova-compute[71874]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 16:07:15 user nova-compute[71874]:       <source file="/opt/stack/data/nova/instances/78b6940a-f97a-4535-8973-3c2a5befbbab/disk"/>
Apr 12 16:07:15 user nova-compute[71874]:       <target dev="vda" bus="virtio"/>
Apr 12 16:07:15 user nova-compute[71874]:     </disk>
Apr 12 16:07:15 user nova-compute[71874]:     <interface type="ethernet">
Apr 12 16:07:15 user nova-compute[71874]:       <mac address="fa:16:3e:4c:7a:4f"/>
Apr 12 16:07:15 user nova-compute[71874]:       <model type="virtio"/>
Apr 12 16:07:15 user nova-compute[71874]:       <mtu size="1442"/>
Apr 12 16:07:15 user nova-compute[71874]:       <target dev="tapdb313dea-d2"/>
Apr 12 16:07:15 user nova-compute[71874]:     </interface>
Apr 12 16:07:15 user nova-compute[71874]:     <serial type="pty">
Apr 12 16:07:15 user nova-compute[71874]:       <log file="/opt/stack/data/nova/instances/78b6940a-f97a-4535-8973-3c2a5befbbab/console.log" append="off"/>
Apr 12 16:07:15 user nova-compute[71874]:     </serial>
Apr 12 16:07:15 user nova-compute[71874]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 16:07:15 user nova-compute[71874]:     <video>
Apr 12 16:07:15 user nova-compute[71874]:       <model type="virtio"/>
Apr 12 16:07:15 user nova-compute[71874]:     </video>
Apr 12 16:07:15 user nova-compute[71874]:     <rng model="virtio">
Apr 12 16:07:15 user nova-compute[71874]:       <backend model="random">/dev/urandom</backend>
Apr 12 16:07:15 user nova-compute[71874]:     </rng>
Apr 12 16:07:15 user nova-compute[71874]:     <controller type="usb" index="0" model="none"/>
Apr 12 16:07:15 user nova-compute[71874]:     <memballoon model="virtio">
Apr 12 16:07:15 user nova-compute[71874]:       <stats period="10"/>
Apr 12 16:07:15 user nova-compute[71874]:     </memballoon>
Apr 12 16:07:15 user nova-compute[71874]:   </devices>
Apr 12 16:07:15 user nova-compute[71874]: </domain>
Apr 12 16:07:15 user nova-compute[71874]:  {{(pid=71874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 16:07:15 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-f9ac6fb4-da4b-4ae3-ac19-e50438fbe57b tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T16:07:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1441208586',display_name='tempest-TestStampPattern-server-1441208586',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-1441208586',id=24,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM9rCdORWoFaEzbUsNhuoBFSyjDv4K5w82ZJzoi+0Rba6d3tv8xkR5nGe+5wcm9lUrYy4FRmQCBzLyX7FSGTRKcYmN9F41l7pVMhhHvTYmD+PQt4JX5BTIQ1nRCFqJvvxg==',key_name='tempest-TestStampPattern-1321754823',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a77372a5e83c4fc882b0a0b0eea46f06',ramdisk_id='',reservation_id='r-3v4gwg0k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1256589700',owner_user_name='tempest-TestStampPattern-1256589700-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T16:07:13Z,user_data=None,user_id='5e0ffc0972674609b17fe2780751dfc5',uuid=78b6940a-f97a-4535-8973-3c2a5befbbab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "db313dea-d267-434a-96bb-d099b17ab2d4", "address": "fa:16:3e:4c:7a:4f", "network": {"id": "1c560b5e-bb6f-42eb-b9b2-6b3f2eaed0f8", "bridge": "br-int", "label": "tempest-TestStampPattern-1356757354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a77372a5e83c4fc882b0a0b0eea46f06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb313dea-d2", "ovs_interfaceid": "db313dea-d267-434a-96bb-d099b17ab2d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 16:07:15 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-f9ac6fb4-da4b-4ae3-ac19-e50438fbe57b tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Converting VIF {"id": "db313dea-d267-434a-96bb-d099b17ab2d4", "address": "fa:16:3e:4c:7a:4f", "network": {"id": "1c560b5e-bb6f-42eb-b9b2-6b3f2eaed0f8", "bridge": "br-int", "label": "tempest-TestStampPattern-1356757354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a77372a5e83c4fc882b0a0b0eea46f06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb313dea-d2", "ovs_interfaceid": "db313dea-d267-434a-96bb-d099b17ab2d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:07:15 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-f9ac6fb4-da4b-4ae3-ac19-e50438fbe57b tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:7a:4f,bridge_name='br-int',has_traffic_filtering=True,id=db313dea-d267-434a-96bb-d099b17ab2d4,network=Network(1c560b5e-bb6f-42eb-b9b2-6b3f2eaed0f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb313dea-d2') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:07:15 user nova-compute[71874]: DEBUG os_vif [None req-f9ac6fb4-da4b-4ae3-ac19-e50438fbe57b tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:7a:4f,bridge_name='br-int',has_traffic_filtering=True,id=db313dea-d267-434a-96bb-d099b17ab2d4,network=Network(1c560b5e-bb6f-42eb-b9b2-6b3f2eaed0f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb313dea-d2') {{(pid=71874) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 16:07:15 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:07:15 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:07:15 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 16:07:15 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:07:15 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdb313dea-d2, may_exist=True) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:07:15 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdb313dea-d2, col_values=(('external_ids', {'iface-id': 'db313dea-d267-434a-96bb-d099b17ab2d4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4c:7a:4f', 'vm-uuid': '78b6940a-f97a-4535-8973-3c2a5befbbab'}),)) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:07:15 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:07:15 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:07:15 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:07:15 user nova-compute[71874]: INFO os_vif [None req-f9ac6fb4-da4b-4ae3-ac19-e50438fbe57b tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:7a:4f,bridge_name='br-int',has_traffic_filtering=True,id=db313dea-d267-434a-96bb-d099b17ab2d4,network=Network(1c560b5e-bb6f-42eb-b9b2-6b3f2eaed0f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb313dea-d2')
Apr 12 16:07:15 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-f9ac6fb4-da4b-4ae3-ac19-e50438fbe57b tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] No BDM found with device name vda, not building metadata. {{(pid=71874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 16:07:15 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-f9ac6fb4-da4b-4ae3-ac19-e50438fbe57b tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] No VIF found with MAC fa:16:3e:4c:7a:4f, not building metadata {{(pid=71874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 16:07:15 user nova-compute[71874]: DEBUG nova.network.neutron [req-ddd89596-d622-4300-8f62-50af78f71f87 req-308175ea-f8c1-4b88-ba3b-cf62e4768846 service nova] [instance: 78b6940a-f97a-4535-8973-3c2a5befbbab] Updated VIF entry in instance network info cache for port db313dea-d267-434a-96bb-d099b17ab2d4. {{(pid=71874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 16:07:15 user nova-compute[71874]: DEBUG nova.network.neutron [req-ddd89596-d622-4300-8f62-50af78f71f87 req-308175ea-f8c1-4b88-ba3b-cf62e4768846 service nova] [instance: 78b6940a-f97a-4535-8973-3c2a5befbbab] Updating instance_info_cache with network_info: [{"id": "db313dea-d267-434a-96bb-d099b17ab2d4", "address": "fa:16:3e:4c:7a:4f", "network": {"id": "1c560b5e-bb6f-42eb-b9b2-6b3f2eaed0f8", "bridge": "br-int", "label": "tempest-TestStampPattern-1356757354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a77372a5e83c4fc882b0a0b0eea46f06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb313dea-d2", "ovs_interfaceid": "db313dea-d267-434a-96bb-d099b17ab2d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:07:15 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-ddd89596-d622-4300-8f62-50af78f71f87 req-308175ea-f8c1-4b88-ba3b-cf62e4768846 service nova] Releasing lock "refresh_cache-78b6940a-f97a-4535-8973-3c2a5befbbab" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:07:16 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:07:16 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:07:16 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:07:16 user nova-compute[71874]: DEBUG nova.compute.manager [req-20c15c77-a04e-4095-b897-249230147b66 req-3b5477ea-d42e-4fe6-b83e-c146fc1bdb78 service nova] [instance: 78b6940a-f97a-4535-8973-3c2a5befbbab] Received event network-vif-plugged-db313dea-d267-434a-96bb-d099b17ab2d4 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:07:16 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-20c15c77-a04e-4095-b897-249230147b66 req-3b5477ea-d42e-4fe6-b83e-c146fc1bdb78 service nova] Acquiring lock "78b6940a-f97a-4535-8973-3c2a5befbbab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:07:16 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-20c15c77-a04e-4095-b897-249230147b66 req-3b5477ea-d42e-4fe6-b83e-c146fc1bdb78 service nova] Lock "78b6940a-f97a-4535-8973-3c2a5befbbab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:07:16 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-20c15c77-a04e-4095-b897-249230147b66 req-3b5477ea-d42e-4fe6-b83e-c146fc1bdb78 service nova] Lock "78b6940a-f97a-4535-8973-3c2a5befbbab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:07:16 user nova-compute[71874]: DEBUG nova.compute.manager [req-20c15c77-a04e-4095-b897-249230147b66 req-3b5477ea-d42e-4fe6-b83e-c146fc1bdb78 service nova] [instance: 78b6940a-f97a-4535-8973-3c2a5befbbab] No waiting events found dispatching network-vif-plugged-db313dea-d267-434a-96bb-d099b17ab2d4 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:07:16 user nova-compute[71874]: WARNING nova.compute.manager [req-20c15c77-a04e-4095-b897-249230147b66 req-3b5477ea-d42e-4fe6-b83e-c146fc1bdb78 service nova] [instance: 78b6940a-f97a-4535-8973-3c2a5befbbab] Received unexpected event network-vif-plugged-db313dea-d267-434a-96bb-d099b17ab2d4 for instance with vm_state building and task_state spawning.
Apr 12 16:07:17 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:07:17 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:07:17 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:07:17 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:07:17 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:07:18 user nova-compute[71874]: DEBUG nova.virt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Emitting event <LifecycleEvent: 1681315638.8133829, 78b6940a-f97a-4535-8973-3c2a5befbbab => Resumed> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:07:18 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 78b6940a-f97a-4535-8973-3c2a5befbbab] VM Resumed (Lifecycle Event)
Apr 12 16:07:18 user nova-compute[71874]: DEBUG nova.compute.manager [None req-f9ac6fb4-da4b-4ae3-ac19-e50438fbe57b tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] [instance: 78b6940a-f97a-4535-8973-3c2a5befbbab] Instance event wait completed in 0 seconds for  {{(pid=71874) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 16:07:18 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-f9ac6fb4-da4b-4ae3-ac19-e50438fbe57b tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] [instance: 78b6940a-f97a-4535-8973-3c2a5befbbab] Guest created on hypervisor {{(pid=71874) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 16:07:18 user nova-compute[71874]: INFO nova.virt.libvirt.driver [-] [instance: 78b6940a-f97a-4535-8973-3c2a5befbbab] Instance spawned successfully.
Apr 12 16:07:18 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-f9ac6fb4-da4b-4ae3-ac19-e50438fbe57b tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] [instance: 78b6940a-f97a-4535-8973-3c2a5befbbab] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 16:07:18 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 78b6940a-f97a-4535-8973-3c2a5befbbab] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:07:18 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 78b6940a-f97a-4535-8973-3c2a5befbbab] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 16:07:18 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-f9ac6fb4-da4b-4ae3-ac19-e50438fbe57b tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] [instance: 78b6940a-f97a-4535-8973-3c2a5befbbab] Found default for hw_cdrom_bus of ide {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:07:18 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-f9ac6fb4-da4b-4ae3-ac19-e50438fbe57b tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] [instance: 78b6940a-f97a-4535-8973-3c2a5befbbab] Found default for hw_disk_bus of virtio {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:07:18 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-f9ac6fb4-da4b-4ae3-ac19-e50438fbe57b tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] [instance: 78b6940a-f97a-4535-8973-3c2a5befbbab] Found default for hw_input_bus of None {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:07:18 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-f9ac6fb4-da4b-4ae3-ac19-e50438fbe57b tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] [instance: 78b6940a-f97a-4535-8973-3c2a5befbbab] Found default for hw_pointer_model of None {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:07:18 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-f9ac6fb4-da4b-4ae3-ac19-e50438fbe57b tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] [instance: 78b6940a-f97a-4535-8973-3c2a5befbbab] Found default for hw_video_model of virtio {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:07:18 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-f9ac6fb4-da4b-4ae3-ac19-e50438fbe57b tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] [instance: 78b6940a-f97a-4535-8973-3c2a5befbbab] Found default for hw_vif_model of virtio {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:07:18 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 78b6940a-f97a-4535-8973-3c2a5befbbab] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 16:07:18 user nova-compute[71874]: DEBUG nova.virt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Emitting event <LifecycleEvent: 1681315638.8153436, 78b6940a-f97a-4535-8973-3c2a5befbbab => Started> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:07:18 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 78b6940a-f97a-4535-8973-3c2a5befbbab] VM Started (Lifecycle Event)
Apr 12 16:07:18 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 78b6940a-f97a-4535-8973-3c2a5befbbab] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:07:18 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 78b6940a-f97a-4535-8973-3c2a5befbbab] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 16:07:18 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 78b6940a-f97a-4535-8973-3c2a5befbbab] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 16:07:18 user nova-compute[71874]: INFO nova.compute.manager [None req-f9ac6fb4-da4b-4ae3-ac19-e50438fbe57b tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] [instance: 78b6940a-f97a-4535-8973-3c2a5befbbab] Took 5.77 seconds to spawn the instance on the hypervisor.
Apr 12 16:07:18 user nova-compute[71874]: DEBUG nova.compute.manager [None req-f9ac6fb4-da4b-4ae3-ac19-e50438fbe57b tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] [instance: 78b6940a-f97a-4535-8973-3c2a5befbbab] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:07:18 user nova-compute[71874]: DEBUG nova.compute.manager [req-539b24c2-04f9-4968-aff9-4bf1806cfd77 req-b835544d-6d20-49d7-9c62-b96c8777fb1d service nova] [instance: 78b6940a-f97a-4535-8973-3c2a5befbbab] Received event network-vif-plugged-db313dea-d267-434a-96bb-d099b17ab2d4 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:07:18 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-539b24c2-04f9-4968-aff9-4bf1806cfd77 req-b835544d-6d20-49d7-9c62-b96c8777fb1d service nova] Acquiring lock "78b6940a-f97a-4535-8973-3c2a5befbbab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:07:18 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-539b24c2-04f9-4968-aff9-4bf1806cfd77 req-b835544d-6d20-49d7-9c62-b96c8777fb1d service nova] Lock "78b6940a-f97a-4535-8973-3c2a5befbbab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:07:18 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-539b24c2-04f9-4968-aff9-4bf1806cfd77 req-b835544d-6d20-49d7-9c62-b96c8777fb1d service nova] Lock "78b6940a-f97a-4535-8973-3c2a5befbbab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:07:18 user nova-compute[71874]: DEBUG nova.compute.manager [req-539b24c2-04f9-4968-aff9-4bf1806cfd77 req-b835544d-6d20-49d7-9c62-b96c8777fb1d service nova] [instance: 78b6940a-f97a-4535-8973-3c2a5befbbab] No waiting events found dispatching network-vif-plugged-db313dea-d267-434a-96bb-d099b17ab2d4 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:07:18 user nova-compute[71874]: WARNING nova.compute.manager [req-539b24c2-04f9-4968-aff9-4bf1806cfd77 req-b835544d-6d20-49d7-9c62-b96c8777fb1d service nova] [instance: 78b6940a-f97a-4535-8973-3c2a5befbbab] Received unexpected event network-vif-plugged-db313dea-d267-434a-96bb-d099b17ab2d4 for instance with vm_state building and task_state spawning.
Apr 12 16:07:19 user nova-compute[71874]: INFO nova.compute.manager [None req-f9ac6fb4-da4b-4ae3-ac19-e50438fbe57b tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] [instance: 78b6940a-f97a-4535-8973-3c2a5befbbab] Took 6.53 seconds to build instance.
Apr 12 16:07:19 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-f9ac6fb4-da4b-4ae3-ac19-e50438fbe57b tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lock "78b6940a-f97a-4535-8973-3c2a5befbbab" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.625s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:07:19 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:07:19 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:07:19 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Starting heal instance info cache {{(pid=71874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 16:07:19 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquiring lock "refresh_cache-473a30c4-5aa4-481c-8859-fda815d14872" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:07:19 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquired lock "refresh_cache-473a30c4-5aa4-481c-8859-fda815d14872" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:07:19 user nova-compute[71874]: DEBUG nova.network.neutron [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] [instance: 473a30c4-5aa4-481c-8859-fda815d14872] Forcefully refreshing network info cache for instance {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 16:07:20 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:07:20 user nova-compute[71874]: DEBUG nova.network.neutron [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] [instance: 473a30c4-5aa4-481c-8859-fda815d14872] Updating instance_info_cache with network_info: [{"id": "556d7c96-2d40-43fc-83fe-2059479a5265", "address": "fa:16:3e:f3:a2:9e", "network": {"id": "06fae0be-02dd-4962-a1ac-fd0413772758", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1493924857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3fe48a3b7d846a195f1e47cc7f69695", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap556d7c96-2d", "ovs_interfaceid": "556d7c96-2d40-43fc-83fe-2059479a5265", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:07:20 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Releasing lock "refresh_cache-473a30c4-5aa4-481c-8859-fda815d14872" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:07:20 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] [instance: 473a30c4-5aa4-481c-8859-fda815d14872] Updated the network info_cache for instance {{(pid=71874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 16:07:20 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:07:20 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:07:20 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71874) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 16:07:20 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:07:20 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:07:20 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:07:20 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:07:20 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:07:20 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Auditing locally available compute resources for user (node: user) {{(pid=71874) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 16:07:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:07:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:07:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:07:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:07:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afebffae-dbf6-4876-8c9f-0364f0fde49c/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:07:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afebffae-dbf6-4876-8c9f-0364f0fde49c/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:07:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afebffae-dbf6-4876-8c9f-0364f0fde49c/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:07:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afebffae-dbf6-4876-8c9f-0364f0fde49c/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:07:21 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 16:07:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/608fbea2-b42b-4bb9-94a7-2b76dcdc2001/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:07:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/608fbea2-b42b-4bb9-94a7-2b76dcdc2001/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:07:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/608fbea2-b42b-4bb9-94a7-2b76dcdc2001/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:07:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/608fbea2-b42b-4bb9-94a7-2b76dcdc2001/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:07:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:07:22 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:07:22 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:07:22 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:07:22 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/357dd90d-8c53-4193-ad64-edfa894116cf/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:07:22 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/357dd90d-8c53-4193-ad64-edfa894116cf/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:07:22 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/357dd90d-8c53-4193-ad64-edfa894116cf/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:07:22 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/357dd90d-8c53-4193-ad64-edfa894116cf/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:07:22 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78b6940a-f97a-4535-8973-3c2a5befbbab/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:07:22 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78b6940a-f97a-4535-8973-3c2a5befbbab/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:07:22 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78b6940a-f97a-4535-8973-3c2a5befbbab/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:07:22 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78b6940a-f97a-4535-8973-3c2a5befbbab/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:07:22 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473a30c4-5aa4-481c-8859-fda815d14872/disk.rescue --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:07:22 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:07:22 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473a30c4-5aa4-481c-8859-fda815d14872/disk.rescue --force-share --output=json" returned: 0 in 0.140s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:07:22 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473a30c4-5aa4-481c-8859-fda815d14872/disk.rescue --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:07:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473a30c4-5aa4-481c-8859-fda815d14872/disk.rescue --force-share --output=json" returned: 0 in 0.140s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:07:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473a30c4-5aa4-481c-8859-fda815d14872/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:07:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473a30c4-5aa4-481c-8859-fda815d14872/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:07:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473a30c4-5aa4-481c-8859-fda815d14872/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:07:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473a30c4-5aa4-481c-8859-fda815d14872/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:07:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6caa4977-8333-4171-8825-2c3bfb52f80b/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:07:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6caa4977-8333-4171-8825-2c3bfb52f80b/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:07:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6caa4977-8333-4171-8825-2c3bfb52f80b/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:07:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6caa4977-8333-4171-8825-2c3bfb52f80b/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:07:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:07:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:07:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:07:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:07:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1496d262-ad85-4da5-be83-035c9806bd20/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:07:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1496d262-ad85-4da5-be83-035c9806bd20/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:07:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1496d262-ad85-4da5-be83-035c9806bd20/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:07:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1496d262-ad85-4da5-be83-035c9806bd20/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:07:24 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:07:24 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:07:24 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Hypervisor/Node resource view: name=user free_ram=7574MB free_disk=26.046550750732422GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71874) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 16:07:24 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:07:24 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:07:25 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance afebffae-dbf6-4876-8c9f-0364f0fde49c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:07:25 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 473a30c4-5aa4-481c-8859-fda815d14872 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:07:25 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 608fbea2-b42b-4bb9-94a7-2b76dcdc2001 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:07:25 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:07:25 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance f52ee906-c8fd-4cd5-842e-de98a5099c4f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:07:25 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:07:25 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 6caa4977-8333-4171-8825-2c3bfb52f80b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:07:25 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 357dd90d-8c53-4193-ad64-edfa894116cf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:07:25 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 1496d262-ad85-4da5-be83-035c9806bd20 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:07:25 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:07:25 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 78b6940a-f97a-4535-8973-3c2a5befbbab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:07:25 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=71874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 16:07:25 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Final resource view: name=user phys_ram=16023MB used_ram=1920MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=71874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 16:07:25 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Inventory has not changed in ProviderTree for provider: 0e94b4c8-cd49-45e4-9133-d36eb4b2456b {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 16:07:25 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:07:25 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Inventory has not changed for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 16:07:25 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Compute_service record updated for user:user {{(pid=71874) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 16:07:25 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.491s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:07:26 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:07:26 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:07:26 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:07:26 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:07:27 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:07:30 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:07:31 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:07:32 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:07:35 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:07:37 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:07:40 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d97aea9b-ae6b-4e64-9239-62f759df67a5 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Acquiring lock "6caa4977-8333-4171-8825-2c3bfb52f80b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:07:40 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d97aea9b-ae6b-4e64-9239-62f759df67a5 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Lock "6caa4977-8333-4171-8825-2c3bfb52f80b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:07:40 user nova-compute[71874]: DEBUG nova.objects.instance [None req-d97aea9b-ae6b-4e64-9239-62f759df67a5 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Lazy-loading 'flavor' on Instance uuid 6caa4977-8333-4171-8825-2c3bfb52f80b {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:07:40 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d97aea9b-ae6b-4e64-9239-62f759df67a5 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Lock "6caa4977-8333-4171-8825-2c3bfb52f80b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:07:40 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:07:40 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d97aea9b-ae6b-4e64-9239-62f759df67a5 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Acquiring lock "6caa4977-8333-4171-8825-2c3bfb52f80b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:07:40 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d97aea9b-ae6b-4e64-9239-62f759df67a5 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Lock "6caa4977-8333-4171-8825-2c3bfb52f80b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:07:40 user nova-compute[71874]: INFO nova.compute.manager [None req-d97aea9b-ae6b-4e64-9239-62f759df67a5 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Attaching volume 7cc863d9-b797-4b5b-b8ce-30ebe55b9519 to /dev/vdb
Apr 12 16:07:40 user nova-compute[71874]: DEBUG os_brick.utils [None req-d97aea9b-ae6b-4e64-9239-62f759df67a5 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:07:40 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:07:40 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:07:40 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a2a5cda-70ff-4d9f-a6b2-c1f08cb543df]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:61a48d4489d2\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:07:40 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:07:40 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:07:40 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3974556-b867-4a4a-a932-eb368c7de4c3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:07:40 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:07:40 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:07:40 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[27368ce1-957d-4f33-804f-54df389f922d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:07:40 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[934b5993-9234-489f-bc08-c31819b8b424]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:07:40 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d97aea9b-ae6b-4e64-9239-62f759df67a5 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Running cmd (subprocess): nvme version {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:07:40 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d97aea9b-ae6b-4e64-9239-62f759df67a5 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] 'nvme version' failed. Not Retrying. {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 16:07:40 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d97aea9b-ae6b-4e64-9239-62f759df67a5 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] nvme not present on system {{(pid=71874) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 16:07:40 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:07:40 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 16:07:40 user nova-compute[71874]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 16:07:40 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[56035ed7-d61b-413a-bf18-1046074714f5]: (4, '') {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:07:40 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.lightos [None req-d97aea9b-ae6b-4e64-9239-62f759df67a5 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71874) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 16:07:40 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.lightos [None req-d97aea9b-ae6b-4e64-9239-62f759df67a5 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71874) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 16:07:40 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.lightos [None req-d97aea9b-ae6b-4e64-9239-62f759df67a5 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] LIGHTOS: no hostnqn found. {{(pid=71874) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 16:07:40 user nova-compute[71874]: DEBUG os_brick.utils [None req-d97aea9b-ae6b-4e64-9239-62f759df67a5 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:61a48d4489d2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:07:40 user nova-compute[71874]: DEBUG nova.virt.block_device [None req-d97aea9b-ae6b-4e64-9239-62f759df67a5 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Updating existing volume attachment record: 8f14f919-7ab4-4bc4-a1a2-b2ab5fc60889 {{(pid=71874) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 16:07:42 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:07:45 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:07:45 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d97aea9b-ae6b-4e64-9239-62f759df67a5 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Calling os-brick to attach iSCSI Volume {{(pid=71874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 16:07:45 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-d97aea9b-ae6b-4e64-9239-62f759df67a5 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3c0216320>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7cc863d9-b797-4b5b-b8ce-30ebe55b9519', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SQEodxul', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:07:45 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-d97aea9b-ae6b-4e64-9239-62f759df67a5 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:07:45 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-d97aea9b-ae6b-4e64-9239-62f759df67a5 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:07:45 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-d97aea9b-ae6b-4e64-9239-62f759df67a5 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:07:45 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-d97aea9b-ae6b-4e64-9239-62f759df67a5 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:07:45 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-d97aea9b-ae6b-4e64-9239-62f759df67a5 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7cc863d9-b797-4b5b-b8ce-30ebe55b9519" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:07:45 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-d97aea9b-ae6b-4e64-9239-62f759df67a5 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7cc863d9-b797-4b5b-b8ce-30ebe55b9519" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:07:45 user nova-compute[71874]: INFO os_brick.initiator.connectors.iscsi [None req-d97aea9b-ae6b-4e64-9239-62f759df67a5 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 16:07:45 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cc863d9-b797-4b5b-b8ce-30ebe55b9519 -p 172.16.0.220:3260 {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:07:45 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cc863d9-b797-4b5b-b8ce-30ebe55b9519 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:07:45 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b6895a4-6e8c-4366-b258-0e95cc032f34]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:07:45 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-d97aea9b-ae6b-4e64-9239-62f759df67a5 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 16:07:45 user nova-compute[71874]:  {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:07:45 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cc863d9-b797-4b5b-b8ce-30ebe55b9519 -p 172.16.0.220:3260 --interface default --op new {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:07:45 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cc863d9-b797-4b5b-b8ce-30ebe55b9519 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:07:45 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fa03a4b-8ac9-4d6b-b409-86e0d94d4e04]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7cc863d9-b797-4b5b-b8ce-30ebe55b9519] added\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:07:45 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-d97aea9b-ae6b-4e64-9239-62f759df67a5 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7cc863d9-b797-4b5b-b8ce-30ebe55b9519] added
Apr 12 16:07:45 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:07:45 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cc863d9-b797-4b5b-b8ce-30ebe55b9519 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:07:45 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cc863d9-b797-4b5b-b8ce-30ebe55b9519 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:07:45 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1e16558-adec-409a-8437-0632105291b2]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:07:45 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-d97aea9b-ae6b-4e64-9239-62f759df67a5 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:07:45 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cc863d9-b797-4b5b-b8ce-30ebe55b9519 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:07:45 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cc863d9-b797-4b5b-b8ce-30ebe55b9519 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:07:45 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f39c81c-f97c-44cc-adf1-87b8e6c0d631]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:07:45 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-d97aea9b-ae6b-4e64-9239-62f759df67a5 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:07:45 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cc863d9-b797-4b5b-b8ce-30ebe55b9519 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SQEodxul {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:07:45 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cc863d9-b797-4b5b-b8ce-30ebe55b9519 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SQEodxul" returned: 0 in 0.021s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:07:45 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcae9e80-6d5a-4221-ad1f-30013395a935]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:07:45 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-d97aea9b-ae6b-4e64-9239-62f759df67a5 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SQEodxul'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:07:45 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cc863d9-b797-4b5b-b8ce-30ebe55b9519 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:07:45 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cc863d9-b797-4b5b-b8ce-30ebe55b9519 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:07:45 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[636f500f-1359-4b86-a52e-3b39b60fb644]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:07:45 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-d97aea9b-ae6b-4e64-9239-62f759df67a5 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:07:45 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:07:45 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:07:45 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[7560bff9-9482-48a9-b219-d23ab365a7eb]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:07:45 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-d97aea9b-ae6b-4e64-9239-62f759df67a5 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:07:45 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:07:45 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-d97aea9b-ae6b-4e64-9239-62f759df67a5 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:07:45 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:07:45 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cc863d9-b797-4b5b-b8ce-30ebe55b9519 -p 172.16.0.220:3260 --login {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:07:45 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cc863d9-b797-4b5b-b8ce-30ebe55b9519 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:07:45 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b40cf20-f410-42b9-8387-e3d69312c016]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7cc863d9-b797-4b5b-b8ce-30ebe55b9519, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7cc863d9-b797-4b5b-b8ce-30ebe55b9519, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:07:45 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-d97aea9b-ae6b-4e64-9239-62f759df67a5 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7cc863d9-b797-4b5b-b8ce-30ebe55b9519, portal: 172.16.0.220,3260]
Apr 12 16:07:45 user nova-compute[71874]: Login to [iface: default, target: iqn.2010-10.org.openstack:7cc863d9-b797-4b5b-b8ce-30ebe55b9519, portal: 172.16.0.220,3260] successful.
Apr 12 16:07:45 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:07:45 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cc863d9-b797-4b5b-b8ce-30ebe55b9519 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:07:46 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cc863d9-b797-4b5b-b8ce-30ebe55b9519 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:07:46 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[6243b0a9-020e-4e3e-a9a6-257089291685]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:07:46 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-d97aea9b-ae6b-4e64-9239-62f759df67a5 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:07:46 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:07:46 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:07:46 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[808070cd-08d0-4524-84e1-d1ddd6912cbf]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cc863d9-b797-4b5b-b8ce-30ebe55b9519 (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:07:46 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-d97aea9b-ae6b-4e64-9239-62f759df67a5 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:07:46 user nova-compute[71874]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cc863d9-b797-4b5b-b8ce-30ebe55b9519 (non-flash)
Apr 12 16:07:46 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:07:46 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-d97aea9b-ae6b-4e64-9239-62f759df67a5 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:07:46 user nova-compute[71874]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cc863d9-b797-4b5b-b8ce-30ebe55b9519 (non-flash)
Apr 12 16:07:46 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:07:46 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-d97aea9b-ae6b-4e64-9239-62f759df67a5 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7cc863d9-b797-4b5b-b8ce-30ebe55b9519" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.285s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:07:46 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-d97aea9b-ae6b-4e64-9239-62f759df67a5 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Connected to 172.16.0.220:3260 {{(pid=71874) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 16:07:46 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-d97aea9b-ae6b-4e64-9239-62f759df67a5 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] HCTL ('34', '-', '-', 0) found on session 23 with lun 0 {{(pid=71874) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 16:07:46 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-d97aea9b-ae6b-4e64-9239-62f759df67a5 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71874) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 16:07:46 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:07:46 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:07:46 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[45e93507-c5ac-4918-bef6-3b021ec4c4f0]: (4, ('- - 0', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:07:46 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-d97aea9b-ae6b-4e64-9239-62f759df67a5 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Searching for a device in session 23 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71874) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 16:07:46 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-d97aea9b-ae6b-4e64-9239-62f759df67a5 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:7cc863d9-b797-4b5b-b8ce-30ebe55b9519', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SQEodxul', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71874) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 16:07:47 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-d97aea9b-ae6b-4e64-9239-62f759df67a5 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.323s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:07:47 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-d97aea9b-ae6b-4e64-9239-62f759df67a5 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] <== connect_volume: return (1326ms) {'type': 'block', 'scsi_wwn': '26434663736343730', 'path': '/dev/sdc'} {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:07:47 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d97aea9b-ae6b-4e64-9239-62f759df67a5 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26434663736343730', 'path': '/dev/sdc'} {{(pid=71874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 16:07:47 user nova-compute[71874]: DEBUG nova.objects.instance [None req-d97aea9b-ae6b-4e64-9239-62f759df67a5 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Lazy-loading 'flavor' on Instance uuid 6caa4977-8333-4171-8825-2c3bfb52f80b {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:07:47 user nova-compute[71874]: DEBUG nova.virt.libvirt.guest [None req-d97aea9b-ae6b-4e64-9239-62f759df67a5 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 16:07:47 user nova-compute[71874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 16:07:47 user nova-compute[71874]:   <source dev="/dev/sdc"/>
Apr 12 16:07:47 user nova-compute[71874]:   <target dev="vdb" bus="virtio"/>
Apr 12 16:07:47 user nova-compute[71874]:   <serial>7cc863d9-b797-4b5b-b8ce-30ebe55b9519</serial>
Apr 12 16:07:47 user nova-compute[71874]: </disk>
Apr 12 16:07:47 user nova-compute[71874]:  {{(pid=71874) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 16:07:47 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d97aea9b-ae6b-4e64-9239-62f759df67a5 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] No BDM found with device name vda, not building metadata. {{(pid=71874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 16:07:47 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d97aea9b-ae6b-4e64-9239-62f759df67a5 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 16:07:47 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d97aea9b-ae6b-4e64-9239-62f759df67a5 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] No VIF found with MAC fa:16:3e:3e:cd:0b, not building metadata {{(pid=71874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 16:07:47 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d97aea9b-ae6b-4e64-9239-62f759df67a5 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Lock "6caa4977-8333-4171-8825-2c3bfb52f80b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.350s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:07:47 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:07:48 user nova-compute[71874]: INFO nova.compute.manager [None req-395dc8ac-4fab-4487-be2c-61a015fcb029 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Rescuing
Apr 12 16:07:48 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-395dc8ac-4fab-4487-be2c-61a015fcb029 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Acquiring lock "refresh_cache-6caa4977-8333-4171-8825-2c3bfb52f80b" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:07:48 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-395dc8ac-4fab-4487-be2c-61a015fcb029 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Acquired lock "refresh_cache-6caa4977-8333-4171-8825-2c3bfb52f80b" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:07:48 user nova-compute[71874]: DEBUG nova.network.neutron [None req-395dc8ac-4fab-4487-be2c-61a015fcb029 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Building network info cache for instance {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 16:07:48 user nova-compute[71874]: DEBUG nova.network.neutron [None req-395dc8ac-4fab-4487-be2c-61a015fcb029 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Updating instance_info_cache with network_info: [{"id": "c42ace22-d91b-4e4b-909e-19aaa428515a", "address": "fa:16:3e:3e:cd:0b", "network": {"id": "0e139ef7-ae53-4cce-9063-218ac1a19c0c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2058204483-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3deffbb4769b4985b038b4adcd82b018", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc42ace22-d9", "ovs_interfaceid": "c42ace22-d91b-4e4b-909e-19aaa428515a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:07:48 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-395dc8ac-4fab-4487-be2c-61a015fcb029 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Releasing lock "refresh_cache-6caa4977-8333-4171-8825-2c3bfb52f80b" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:07:48 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:07:48 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:07:48 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:07:48 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:07:48 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:07:49 user nova-compute[71874]: DEBUG nova.compute.manager [req-9d10ca12-3259-49b3-8dd8-28581c7fda56 req-03b88d94-fd7c-4e18-8f2c-ce580fa5be81 service nova] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Received event network-vif-unplugged-c42ace22-d91b-4e4b-909e-19aaa428515a {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:07:49 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-9d10ca12-3259-49b3-8dd8-28581c7fda56 req-03b88d94-fd7c-4e18-8f2c-ce580fa5be81 service nova] Acquiring lock "6caa4977-8333-4171-8825-2c3bfb52f80b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:07:49 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-9d10ca12-3259-49b3-8dd8-28581c7fda56 req-03b88d94-fd7c-4e18-8f2c-ce580fa5be81 service nova] Lock "6caa4977-8333-4171-8825-2c3bfb52f80b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:07:49 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-9d10ca12-3259-49b3-8dd8-28581c7fda56 req-03b88d94-fd7c-4e18-8f2c-ce580fa5be81 service nova] Lock "6caa4977-8333-4171-8825-2c3bfb52f80b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:07:49 user nova-compute[71874]: DEBUG nova.compute.manager [req-9d10ca12-3259-49b3-8dd8-28581c7fda56 req-03b88d94-fd7c-4e18-8f2c-ce580fa5be81 service nova] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] No waiting events found dispatching network-vif-unplugged-c42ace22-d91b-4e4b-909e-19aaa428515a {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:07:49 user nova-compute[71874]: WARNING nova.compute.manager [req-9d10ca12-3259-49b3-8dd8-28581c7fda56 req-03b88d94-fd7c-4e18-8f2c-ce580fa5be81 service nova] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Received unexpected event network-vif-unplugged-c42ace22-d91b-4e4b-909e-19aaa428515a for instance with vm_state active and task_state rescuing.
Apr 12 16:07:49 user nova-compute[71874]: INFO nova.virt.libvirt.driver [-] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Instance destroyed successfully.
Apr 12 16:07:49 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-395dc8ac-4fab-4487-be2c-61a015fcb029 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Attempting a stable device rescue
Apr 12 16:07:49 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-395dc8ac-4fab-4487-be2c-61a015fcb029 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=71874) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 12 16:07:49 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-395dc8ac-4fab-4487-be2c-61a015fcb029 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Instance directory exists: not creating {{(pid=71874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 12 16:07:49 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-395dc8ac-4fab-4487-be2c-61a015fcb029 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Creating image(s)
Apr 12 16:07:49 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-395dc8ac-4fab-4487-be2c-61a015fcb029 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Acquiring lock "/opt/stack/data/nova/instances/6caa4977-8333-4171-8825-2c3bfb52f80b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:07:49 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-395dc8ac-4fab-4487-be2c-61a015fcb029 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Lock "/opt/stack/data/nova/instances/6caa4977-8333-4171-8825-2c3bfb52f80b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:07:49 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-395dc8ac-4fab-4487-be2c-61a015fcb029 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Lock "/opt/stack/data/nova/instances/6caa4977-8333-4171-8825-2c3bfb52f80b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:07:49 user nova-compute[71874]: DEBUG nova.objects.instance [None req-395dc8ac-4fab-4487-be2c-61a015fcb029 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Lazy-loading 'trusted_certs' on Instance uuid 6caa4977-8333-4171-8825-2c3bfb52f80b {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:07:49 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-395dc8ac-4fab-4487-be2c-61a015fcb029 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Acquiring lock "7efeb74bac27733de1d4c37119b7cddc1b5c42be" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:07:49 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-395dc8ac-4fab-4487-be2c-61a015fcb029 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Lock "7efeb74bac27733de1d4c37119b7cddc1b5c42be" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:07:50 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-395dc8ac-4fab-4487-be2c-61a015fcb029 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7efeb74bac27733de1d4c37119b7cddc1b5c42be.part --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:07:50 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:07:50 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-395dc8ac-4fab-4487-be2c-61a015fcb029 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7efeb74bac27733de1d4c37119b7cddc1b5c42be.part --force-share --output=json" returned: 0 in 0.138s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:07:50 user nova-compute[71874]: DEBUG nova.virt.images [None req-395dc8ac-4fab-4487-be2c-61a015fcb029 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] 7cf43834-8139-44fb-a821-3bb62ca931b4 was qcow2, converting to raw {{(pid=71874) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 12 16:07:50 user nova-compute[71874]: DEBUG nova.privsep.utils [None req-395dc8ac-4fab-4487-be2c-61a015fcb029 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71874) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 12 16:07:50 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-395dc8ac-4fab-4487-be2c-61a015fcb029 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7efeb74bac27733de1d4c37119b7cddc1b5c42be.part /opt/stack/data/nova/instances/_base/7efeb74bac27733de1d4c37119b7cddc1b5c42be.converted {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:07:51 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-395dc8ac-4fab-4487-be2c-61a015fcb029 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7efeb74bac27733de1d4c37119b7cddc1b5c42be.part /opt/stack/data/nova/instances/_base/7efeb74bac27733de1d4c37119b7cddc1b5c42be.converted" returned: 0 in 0.499s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:07:51 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-395dc8ac-4fab-4487-be2c-61a015fcb029 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7efeb74bac27733de1d4c37119b7cddc1b5c42be.converted --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:07:51 user nova-compute[71874]: DEBUG nova.compute.manager [req-ba07a94d-3f03-413c-9a4b-7c9770588430 req-9bfbd49b-7d5e-4154-b725-8f7ab8bb1d8a service nova] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Received event network-vif-plugged-c42ace22-d91b-4e4b-909e-19aaa428515a {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:07:51 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-ba07a94d-3f03-413c-9a4b-7c9770588430 req-9bfbd49b-7d5e-4154-b725-8f7ab8bb1d8a service nova] Acquiring lock "6caa4977-8333-4171-8825-2c3bfb52f80b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:07:51 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-ba07a94d-3f03-413c-9a4b-7c9770588430 req-9bfbd49b-7d5e-4154-b725-8f7ab8bb1d8a service nova] Lock "6caa4977-8333-4171-8825-2c3bfb52f80b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:07:51 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-ba07a94d-3f03-413c-9a4b-7c9770588430 req-9bfbd49b-7d5e-4154-b725-8f7ab8bb1d8a service nova] Lock "6caa4977-8333-4171-8825-2c3bfb52f80b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:07:51 user nova-compute[71874]: DEBUG nova.compute.manager [req-ba07a94d-3f03-413c-9a4b-7c9770588430 req-9bfbd49b-7d5e-4154-b725-8f7ab8bb1d8a service nova] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] No waiting events found dispatching network-vif-plugged-c42ace22-d91b-4e4b-909e-19aaa428515a {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:07:51 user nova-compute[71874]: WARNING nova.compute.manager [req-ba07a94d-3f03-413c-9a4b-7c9770588430 req-9bfbd49b-7d5e-4154-b725-8f7ab8bb1d8a service nova] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Received unexpected event network-vif-plugged-c42ace22-d91b-4e4b-909e-19aaa428515a for instance with vm_state active and task_state rescuing.
Apr 12 16:07:51 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-395dc8ac-4fab-4487-be2c-61a015fcb029 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7efeb74bac27733de1d4c37119b7cddc1b5c42be.converted --force-share --output=json" returned: 0 in 0.142s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:07:51 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-395dc8ac-4fab-4487-be2c-61a015fcb029 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Lock "7efeb74bac27733de1d4c37119b7cddc1b5c42be" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.643s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:07:51 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-395dc8ac-4fab-4487-be2c-61a015fcb029 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Acquiring lock "7efeb74bac27733de1d4c37119b7cddc1b5c42be" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:07:51 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-395dc8ac-4fab-4487-be2c-61a015fcb029 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Lock "7efeb74bac27733de1d4c37119b7cddc1b5c42be" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:07:51 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-395dc8ac-4fab-4487-be2c-61a015fcb029 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7efeb74bac27733de1d4c37119b7cddc1b5c42be --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:07:51 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-395dc8ac-4fab-4487-be2c-61a015fcb029 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7efeb74bac27733de1d4c37119b7cddc1b5c42be --force-share --output=json" returned: 0 in 0.136s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:07:51 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-395dc8ac-4fab-4487-be2c-61a015fcb029 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7efeb74bac27733de1d4c37119b7cddc1b5c42be,backing_fmt=raw /opt/stack/data/nova/instances/6caa4977-8333-4171-8825-2c3bfb52f80b/disk.rescue {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:07:51 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-395dc8ac-4fab-4487-be2c-61a015fcb029 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7efeb74bac27733de1d4c37119b7cddc1b5c42be,backing_fmt=raw /opt/stack/data/nova/instances/6caa4977-8333-4171-8825-2c3bfb52f80b/disk.rescue" returned: 0 in 0.060s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:07:51 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-395dc8ac-4fab-4487-be2c-61a015fcb029 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Lock "7efeb74bac27733de1d4c37119b7cddc1b5c42be" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.203s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:07:51 user nova-compute[71874]: DEBUG nova.objects.instance [None req-395dc8ac-4fab-4487-be2c-61a015fcb029 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Lazy-loading 'migration_context' on Instance uuid 6caa4977-8333-4171-8825-2c3bfb52f80b {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:07:51 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-395dc8ac-4fab-4487-be2c-61a015fcb029 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Created local disks {{(pid=71874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 16:07:51 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-395dc8ac-4fab-4487-be2c-61a015fcb029 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Start _get_guest_xml network_info=[{"id": "c42ace22-d91b-4e4b-909e-19aaa428515a", "address": "fa:16:3e:3e:cd:0b", "network": {"id": "0e139ef7-ae53-4cce-9063-218ac1a19c0c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2058204483-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-2058204483-network", "vif_mac": "fa:16:3e:3e:cd:0b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3deffbb4769b4985b038b4adcd82b018", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc42ace22-d9", "ovs_interfaceid": "c42ace22-d91b-4e4b-909e-19aaa428515a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T15:55:37Z,direct_url=<?>,disk_format='qcow2',id=9dc63f14-8b70-4e72-89f2-13464f2f5c7c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='61a4936d9b7744c0b488d81c9b7746b6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T15:55:39Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '7cf43834-8139-44fb-a821-3bb62ca931b4', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_options': None, 'image_id': '9dc63f14-8b70-4e72-89f2-13464f2f5c7c'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'delete_on_termination': False, 'attachment_id': '8f14f919-7ab4-4bc4-a1a2-b2ab5fc60889', 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7cc863d9-b797-4b5b-b8ce-30ebe55b9519', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SQEodxul', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '6caa4977-8333-4171-8825-2c3bfb52f80b', 'attached_at': '', 'detached_at': '', 'volume_id': '7cc863d9-b797-4b5b-b8ce-30ebe55b9519', 'serial': '7cc863d9-b797-4b5b-b8ce-30ebe55b9519'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': None, 'volume_type': None} {{(pid=71874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 16:07:51 user nova-compute[71874]: DEBUG nova.objects.instance [None req-395dc8ac-4fab-4487-be2c-61a015fcb029 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Lazy-loading 'resources' on Instance uuid 6caa4977-8333-4171-8825-2c3bfb52f80b {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:07:51 user nova-compute[71874]: DEBUG nova.objects.instance [None req-395dc8ac-4fab-4487-be2c-61a015fcb029 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Lazy-loading 'numa_topology' on Instance uuid 6caa4977-8333-4171-8825-2c3bfb52f80b {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:07:51 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-395dc8ac-4fab-4487-be2c-61a015fcb029 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:07:51 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-395dc8ac-4fab-4487-be2c-61a015fcb029 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:07:51 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-395dc8ac-4fab-4487-be2c-61a015fcb029 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71874) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 16:07:51 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-395dc8ac-4fab-4487-be2c-61a015fcb029 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T15:56:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T15:55:37Z,direct_url=<?>,disk_format='qcow2',id=9dc63f14-8b70-4e72-89f2-13464f2f5c7c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='61a4936d9b7744c0b488d81c9b7746b6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T15:55:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 16:07:51 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-395dc8ac-4fab-4487-be2c-61a015fcb029 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Flavor limits 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 16:07:51 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-395dc8ac-4fab-4487-be2c-61a015fcb029 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Image limits 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 16:07:51 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-395dc8ac-4fab-4487-be2c-61a015fcb029 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Flavor pref 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 16:07:51 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-395dc8ac-4fab-4487-be2c-61a015fcb029 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Image pref 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 16:07:51 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-395dc8ac-4fab-4487-be2c-61a015fcb029 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 16:07:51 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-395dc8ac-4fab-4487-be2c-61a015fcb029 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 16:07:51 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-395dc8ac-4fab-4487-be2c-61a015fcb029 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 16:07:51 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-395dc8ac-4fab-4487-be2c-61a015fcb029 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Got 1 possible topologies {{(pid=71874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 16:07:51 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-395dc8ac-4fab-4487-be2c-61a015fcb029 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 16:07:51 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-395dc8ac-4fab-4487-be2c-61a015fcb029 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 16:07:51 user nova-compute[71874]: DEBUG nova.objects.instance [None req-395dc8ac-4fab-4487-be2c-61a015fcb029 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6caa4977-8333-4171-8825-2c3bfb52f80b {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:07:51 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-395dc8ac-4fab-4487-be2c-61a015fcb029 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Calling os-brick to attach iSCSI Volume {{(pid=71874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 16:07:51 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-395dc8ac-4fab-4487-be2c-61a015fcb029 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3c0216320>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7cc863d9-b797-4b5b-b8ce-30ebe55b9519', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SQEodxul', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:07:51 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-395dc8ac-4fab-4487-be2c-61a015fcb029 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:07:51 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-395dc8ac-4fab-4487-be2c-61a015fcb029 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:07:51 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-395dc8ac-4fab-4487-be2c-61a015fcb029 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:07:51 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-395dc8ac-4fab-4487-be2c-61a015fcb029 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:07:51 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-395dc8ac-4fab-4487-be2c-61a015fcb029 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7cc863d9-b797-4b5b-b8ce-30ebe55b9519" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:07:51 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-395dc8ac-4fab-4487-be2c-61a015fcb029 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7cc863d9-b797-4b5b-b8ce-30ebe55b9519" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:07:51 user nova-compute[71874]: INFO os_brick.initiator.connectors.iscsi [None req-395dc8ac-4fab-4487-be2c-61a015fcb029 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 16:07:51 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cc863d9-b797-4b5b-b8ce-30ebe55b9519 -p 172.16.0.220:3260 {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:07:51 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cc863d9-b797-4b5b-b8ce-30ebe55b9519 -p 172.16.0.220:3260" returned: 0 in 0.023s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:07:51 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[98ac751d-6c3d-47f6-819b-752ec2660e28]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:7cc863d9-b797-4b5b-b8ce-30ebe55b9519\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = SQEodxul\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:07:51 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-395dc8ac-4fab-4487-be2c-61a015fcb029 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Apr 12 16:07:51 user nova-compute[71874]: node.name = iqn.2010-10.org.openstack:7cc863d9-b797-4b5b-b8ce-30ebe55b9519
Apr 12 16:07:51 user nova-compute[71874]: node.tpgt = -1
Apr 12 16:07:51 user nova-compute[71874]: node.startup = automatic
Apr 12 16:07:51 user nova-compute[71874]: node.leading_login = No
Apr 12 16:07:51 user nova-compute[71874]: iface.iscsi_ifacename = default
Apr 12 16:07:51 user nova-compute[71874]: iface.net_ifacename = <empty>
Apr 12 16:07:51 user nova-compute[71874]: iface.ipaddress = <empty>
Apr 12 16:07:51 user nova-compute[71874]: iface.prefix_len = 0
Apr 12 16:07:51 user nova-compute[71874]: iface.hwaddress = <empty>
Apr 12 16:07:51 user nova-compute[71874]: iface.transport_name = tcp
Apr 12 16:07:51 user nova-compute[71874]: iface.initiatorname = <empty>
Apr 12 16:07:51 user nova-compute[71874]: iface.state = <empty>
Apr 12 16:07:51 user nova-compute[71874]: iface.vlan_id = 0
Apr 12 16:07:51 user nova-compute[71874]: iface.vlan_priority = 0
Apr 12 16:07:51 user nova-compute[71874]: iface.vlan_state = <empty>
Apr 12 16:07:51 user nova-compute[71874]: iface.iface_num = 0
Apr 12 16:07:51 user nova-compute[71874]: iface.mtu = 0
Apr 12 16:07:51 user nova-compute[71874]: iface.port = 0
Apr 12 16:07:51 user nova-compute[71874]: iface.bootproto = <empty>
Apr 12 16:07:51 user nova-compute[71874]: iface.subnet_mask = <empty>
Apr 12 16:07:51 user nova-compute[71874]: iface.gateway = <empty>
Apr 12 16:07:51 user nova-compute[71874]: iface.dhcp_alt_client_id_state = <empty>
Apr 12 16:07:51 user nova-compute[71874]: iface.dhcp_alt_client_id = <empty>
Apr 12 16:07:51 user nova-compute[71874]: iface.dhcp_dns = <empty>
Apr 12 16:07:51 user nova-compute[71874]: iface.dhcp_learn_iqn = <empty>
Apr 12 16:07:51 user nova-compute[71874]: iface.dhcp_req_vendor_id_state = <empty>
Apr 12 16:07:51 user nova-compute[71874]: iface.dhcp_vendor_id_state = <empty>
Apr 12 16:07:51 user nova-compute[71874]: iface.dhcp_vendor_id = <empty>
Apr 12 16:07:51 user nova-compute[71874]: iface.dhcp_slp_da = <empty>
Apr 12 16:07:51 user nova-compute[71874]: iface.fragmentation = <empty>
Apr 12 16:07:51 user nova-compute[71874]: iface.gratuitous_arp = <empty>
Apr 12 16:07:51 user nova-compute[71874]: iface.incoming_forwarding = <empty>
Apr 12 16:07:51 user nova-compute[71874]: iface.tos_state = <empty>
Apr 12 16:07:51 user nova-compute[71874]: iface.tos = 0
Apr 12 16:07:51 user nova-compute[71874]: iface.ttl = 0
Apr 12 16:07:51 user nova-compute[71874]: iface.delayed_ack = <empty>
Apr 12 16:07:51 user nova-compute[71874]: iface.tcp_nagle = <empty>
Apr 12 16:07:51 user nova-compute[71874]: iface.tcp_wsf_state = <empty>
Apr 12 16:07:51 user nova-compute[71874]: iface.tcp_wsf = 0
Apr 12 16:07:51 user nova-compute[71874]: iface.tcp_timer_scale = 0
Apr 12 16:07:51 user nova-compute[71874]: iface.tcp_timestamp = <empty>
Apr 12 16:07:51 user nova-compute[71874]: iface.redirect = <empty>
Apr 12 16:07:51 user nova-compute[71874]: iface.def_task_mgmt_timeout = 0
Apr 12 16:07:51 user nova-compute[71874]: iface.header_digest = <empty>
Apr 12 16:07:51 user nova-compute[71874]: iface.data_digest = <empty>
Apr 12 16:07:51 user nova-compute[71874]: iface.immediate_data = <empty>
Apr 12 16:07:51 user nova-compute[71874]: iface.initial_r2t = <empty>
Apr 12 16:07:51 user nova-compute[71874]: iface.data_seq_inorder = <empty>
Apr 12 16:07:51 user nova-compute[71874]: iface.data_pdu_inorder = <empty>
Apr 12 16:07:51 user nova-compute[71874]: iface.erl = 0
Apr 12 16:07:51 user nova-compute[71874]: iface.max_receive_data_len = 0
Apr 12 16:07:51 user nova-compute[71874]: iface.first_burst_len = 0
Apr 12 16:07:51 user nova-compute[71874]: iface.max_outstanding_r2t = 0
Apr 12 16:07:51 user nova-compute[71874]: iface.max_burst_len = 0
Apr 12 16:07:51 user nova-compute[71874]: iface.chap_auth = <empty>
Apr 12 16:07:51 user nova-compute[71874]: iface.bidi_chap = <empty>
Apr 12 16:07:51 user nova-compute[71874]: iface.strict_login_compliance = <empty>
Apr 12 16:07:51 user nova-compute[71874]: iface.discovery_auth = <empty>
Apr 12 16:07:51 user nova-compute[71874]: iface.discovery_logout = <empty>
Apr 12 16:07:51 user nova-compute[71874]: node.discovery_address = <empty>
Apr 12 16:07:51 user nova-compute[71874]: node.discovery_port = 0
Apr 12 16:07:51 user nova-compute[71874]: node.discovery_type = static
Apr 12 16:07:51 user nova-compute[71874]: node.session.initial_cmdsn = 0
Apr 12 16:07:51 user nova-compute[71874]: node.session.initial_login_retry_max = 8
Apr 12 16:07:51 user nova-compute[71874]: node.session.xmit_thread_priority = -20
Apr 12 16:07:51 user nova-compute[71874]: node.session.cmds_max = 128
Apr 12 16:07:51 user nova-compute[71874]: node.session.queue_depth = 32
Apr 12 16:07:51 user nova-compute[71874]: node.session.nr_sessions = 1
Apr 12 16:07:51 user nova-compute[71874]: node.session.auth.authmethod = CHAP
Apr 12 16:07:51 user nova-compute[71874]: node.session.auth.username = SQEodxul
Apr 12 16:07:51 user nova-compute[71874]: node.session.auth.password = ***
Apr 12 16:07:51 user nova-compute[71874]: node.session.auth.username_in = <empty>
Apr 12 16:07:51 user nova-compute[71874]: node.session.auth.password_in = <empty>
Apr 12 16:07:51 user nova-compute[71874]: node.session.auth.chap_algs = MD5
Apr 12 16:07:51 user nova-compute[71874]: node.session.timeo.replacement_timeout = 120
Apr 12 16:07:51 user nova-compute[71874]: node.session.err_timeo.abort_timeout = 15
Apr 12 16:07:51 user nova-compute[71874]: node.session.err_timeo.lu_reset_timeout = 30
Apr 12 16:07:51 user nova-compute[71874]: node.session.err_timeo.tgt_reset_timeout = 30
Apr 12 16:07:51 user nova-compute[71874]: node.session.err_timeo.host_reset_timeout = 60
Apr 12 16:07:51 user nova-compute[71874]: node.session.iscsi.FastAbort = Yes
Apr 12 16:07:51 user nova-compute[71874]: node.session.iscsi.InitialR2T = No
Apr 12 16:07:51 user nova-compute[71874]: node.session.iscsi.ImmediateData = Yes
Apr 12 16:07:51 user nova-compute[71874]: node.session.iscsi.FirstBurstLength = 262144
Apr 12 16:07:51 user nova-compute[71874]: node.session.iscsi.MaxBurstLength = 16776192
Apr 12 16:07:51 user nova-compute[71874]: node.session.iscsi.DefaultTime2Retain = 0
Apr 12 16:07:51 user nova-compute[71874]: node.session.iscsi.DefaultTime2Wait = 2
Apr 12 16:07:51 user nova-compute[71874]: node.session.iscsi.MaxConnections = 1
Apr 12 16:07:51 user nova-compute[71874]: node.session.iscsi.MaxOutstandingR2T = 1
Apr 12 16:07:51 user nova-compute[71874]: node.session.iscsi.ERL = 0
Apr 12 16:07:51 user nova-compute[71874]: node.session.scan = manual
Apr 12 16:07:51 user nova-compute[71874]: node.session.reopen_max = 0
Apr 12 16:07:51 user nova-compute[71874]: node.conn[0].address = 172.16.0.220
Apr 12 16:07:51 user nova-compute[71874]: node.conn[0].port = 3260
Apr 12 16:07:51 user nova-compute[71874]: node.conn[0].startup = manual
Apr 12 16:07:51 user nova-compute[71874]: node.conn[0].tcp.window_size = 524288
Apr 12 16:07:51 user nova-compute[71874]: node.conn[0].tcp.type_of_service = 0
Apr 12 16:07:51 user nova-compute[71874]: node.conn[0].timeo.logout_timeout = 15
Apr 12 16:07:51 user nova-compute[71874]: node.conn[0].timeo.login_timeout = 15
Apr 12 16:07:51 user nova-compute[71874]: node.conn[0].timeo.auth_timeout = 45
Apr 12 16:07:51 user nova-compute[71874]: node.conn[0].timeo.noop_out_interval = 5
Apr 12 16:07:51 user nova-compute[71874]: node.conn[0].timeo.noop_out_timeout = 5
Apr 12 16:07:51 user nova-compute[71874]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Apr 12 16:07:51 user nova-compute[71874]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Apr 12 16:07:51 user nova-compute[71874]: node.conn[0].iscsi.HeaderDigest = None
Apr 12 16:07:51 user nova-compute[71874]: node.conn[0].iscsi.DataDigest = None
Apr 12 16:07:51 user nova-compute[71874]: node.conn[0].iscsi.IFMarker = No
Apr 12 16:07:51 user nova-compute[71874]: node.conn[0].iscsi.OFMarker = No
Apr 12 16:07:51 user nova-compute[71874]: # END RECORD
Apr 12 16:07:51 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:07:51 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cc863d9-b797-4b5b-b8ce-30ebe55b9519 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:07:51 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cc863d9-b797-4b5b-b8ce-30ebe55b9519 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:07:51 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[982e4202-54fb-43be-b896-c547cf515db6]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:07:51 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-395dc8ac-4fab-4487-be2c-61a015fcb029 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:07:51 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cc863d9-b797-4b5b-b8ce-30ebe55b9519 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:07:51 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cc863d9-b797-4b5b-b8ce-30ebe55b9519 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:07:51 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b77a17f-da63-40b1-b590-ce0ec8945ab6]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:07:51 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-395dc8ac-4fab-4487-be2c-61a015fcb029 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:07:51 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cc863d9-b797-4b5b-b8ce-30ebe55b9519 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SQEodxul {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:07:51 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cc863d9-b797-4b5b-b8ce-30ebe55b9519 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SQEodxul" returned: 0 in 0.018s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:07:51 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[70c8eb49-7df5-4da7-bbb5-148e8450ea46]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:07:51 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-395dc8ac-4fab-4487-be2c-61a015fcb029 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SQEodxul'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:07:51 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cc863d9-b797-4b5b-b8ce-30ebe55b9519 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:07:51 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cc863d9-b797-4b5b-b8ce-30ebe55b9519 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:07:51 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cc5218c-e434-4ade-addc-b9ba4d5aa391]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:07:51 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-395dc8ac-4fab-4487-be2c-61a015fcb029 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:07:51 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:07:51 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:07:51 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa74862f-926b-4829-9151-f2c5fb4e2ccc]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cc863d9-b797-4b5b-b8ce-30ebe55b9519 (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:07:51 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-395dc8ac-4fab-4487-be2c-61a015fcb029 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:07:51 user nova-compute[71874]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cc863d9-b797-4b5b-b8ce-30ebe55b9519 (non-flash)
Apr 12 16:07:51 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:07:51 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-395dc8ac-4fab-4487-be2c-61a015fcb029 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:07:51 user nova-compute[71874]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cc863d9-b797-4b5b-b8ce-30ebe55b9519 (non-flash)
Apr 12 16:07:51 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:07:51 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-395dc8ac-4fab-4487-be2c-61a015fcb029 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7cc863d9-b797-4b5b-b8ce-30ebe55b9519" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.149s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:07:51 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-395dc8ac-4fab-4487-be2c-61a015fcb029 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Connected to 172.16.0.220:3260 {{(pid=71874) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 16:07:51 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-395dc8ac-4fab-4487-be2c-61a015fcb029 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] HCTL ('34', '0', '0', 0) found on session 23 with lun 0 {{(pid=71874) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 16:07:51 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-395dc8ac-4fab-4487-be2c-61a015fcb029 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=71874) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 16:07:51 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:07:51 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:07:51 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cea0c1c-fd15-45ed-afb1-ac527b6b34f2]: (4, ('0 0 0', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:07:51 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-395dc8ac-4fab-4487-be2c-61a015fcb029 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Searching for a device in session 23 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=71874) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 16:07:51 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-395dc8ac-4fab-4487-be2c-61a015fcb029 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:7cc863d9-b797-4b5b-b8ce-30ebe55b9519', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SQEodxul', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=71874) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 16:07:51 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-395dc8ac-4fab-4487-be2c-61a015fcb029 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.173s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:07:51 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-395dc8ac-4fab-4487-be2c-61a015fcb029 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] <== connect_volume: return (174ms) {'type': 'block', 'scsi_wwn': '26434663736343730', 'path': '/dev/sdc'} {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:07:51 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-395dc8ac-4fab-4487-be2c-61a015fcb029 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26434663736343730', 'path': '/dev/sdc'} {{(pid=71874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 16:07:51 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-395dc8ac-4fab-4487-be2c-61a015fcb029 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T16:03:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-689097339',display_name='tempest-ServerStableDeviceRescueTest-server-689097339',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-689097339',id=18,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAam8LYyB+LjNdQE4JBvTI3p3CIYJWs7/MCfiZUy9Xd8eIW/jYHvtZuhkG/lsvTL9zeSBHrSduF7W+pN/Bj80hUnONEMW2bSoSjFErg09RBlgz7o7NI0zfHfHDu88Z99bg==',key_name='tempest-keypair-1356498122',keypairs=<?>,launch_index=0,launched_at=2023-04-12T16:04:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3deffbb4769b4985b038b4adcd82b018',ramdisk_id='',reservation_id='r-vjrj0b0t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-692889073',owner_user_name='tempest-ServerStableDeviceRescueTest-692889073-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T16:05:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f76e286bd75a4cbaad7a7b735014f3d7',uuid=6caa4977-8333-4171-8825-2c3bfb52f80b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c42ace22-d91b-4e4b-909e-19aaa428515a", "address": "fa:16:3e:3e:cd:0b", "network": {"id": "0e139ef7-ae53-4cce-9063-218ac1a19c0c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2058204483-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-2058204483-network", "vif_mac": "fa:16:3e:3e:cd:0b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3deffbb4769b4985b038b4adcd82b018", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc42ace22-d9", "ovs_interfaceid": "c42ace22-d91b-4e4b-909e-19aaa428515a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 16:07:51 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-395dc8ac-4fab-4487-be2c-61a015fcb029 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Converting VIF {"id": "c42ace22-d91b-4e4b-909e-19aaa428515a", "address": "fa:16:3e:3e:cd:0b", "network": {"id": "0e139ef7-ae53-4cce-9063-218ac1a19c0c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2058204483-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-2058204483-network", "vif_mac": "fa:16:3e:3e:cd:0b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3deffbb4769b4985b038b4adcd82b018", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc42ace22-d9", "ovs_interfaceid": "c42ace22-d91b-4e4b-909e-19aaa428515a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:07:51 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-395dc8ac-4fab-4487-be2c-61a015fcb029 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3e:cd:0b,bridge_name='br-int',has_traffic_filtering=True,id=c42ace22-d91b-4e4b-909e-19aaa428515a,network=Network(0e139ef7-ae53-4cce-9063-218ac1a19c0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc42ace22-d9') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:07:51 user nova-compute[71874]: DEBUG nova.objects.instance [None req-395dc8ac-4fab-4487-be2c-61a015fcb029 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Lazy-loading 'pci_devices' on Instance uuid 6caa4977-8333-4171-8825-2c3bfb52f80b {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:07:51 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-395dc8ac-4fab-4487-be2c-61a015fcb029 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] End _get_guest_xml xml=<domain type="kvm">
Apr 12 16:07:51 user nova-compute[71874]:   <uuid>6caa4977-8333-4171-8825-2c3bfb52f80b</uuid>
Apr 12 16:07:51 user nova-compute[71874]:   <name>instance-00000012</name>
Apr 12 16:07:51 user nova-compute[71874]:   <memory>131072</memory>
Apr 12 16:07:51 user nova-compute[71874]:   <vcpu>1</vcpu>
Apr 12 16:07:51 user nova-compute[71874]:   <metadata>
Apr 12 16:07:51 user nova-compute[71874]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 16:07:51 user nova-compute[71874]:       <nova:package version="0.0.0"/>
Apr 12 16:07:51 user nova-compute[71874]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-689097339</nova:name>
Apr 12 16:07:51 user nova-compute[71874]:       <nova:creationTime>2023-04-12 16:07:51</nova:creationTime>
Apr 12 16:07:51 user nova-compute[71874]:       <nova:flavor name="m1.nano">
Apr 12 16:07:51 user nova-compute[71874]:         <nova:memory>128</nova:memory>
Apr 12 16:07:51 user nova-compute[71874]:         <nova:disk>1</nova:disk>
Apr 12 16:07:51 user nova-compute[71874]:         <nova:swap>0</nova:swap>
Apr 12 16:07:51 user nova-compute[71874]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 16:07:51 user nova-compute[71874]:         <nova:vcpus>1</nova:vcpus>
Apr 12 16:07:51 user nova-compute[71874]:       </nova:flavor>
Apr 12 16:07:51 user nova-compute[71874]:       <nova:owner>
Apr 12 16:07:51 user nova-compute[71874]:         <nova:user uuid="f76e286bd75a4cbaad7a7b735014f3d7">tempest-ServerStableDeviceRescueTest-692889073-project-member</nova:user>
Apr 12 16:07:51 user nova-compute[71874]:         <nova:project uuid="3deffbb4769b4985b038b4adcd82b018">tempest-ServerStableDeviceRescueTest-692889073</nova:project>
Apr 12 16:07:51 user nova-compute[71874]:       </nova:owner>
Apr 12 16:07:51 user nova-compute[71874]:       <nova:root type="image" uuid="9dc63f14-8b70-4e72-89f2-13464f2f5c7c"/>
Apr 12 16:07:51 user nova-compute[71874]:       <nova:ports>
Apr 12 16:07:51 user nova-compute[71874]:         <nova:port uuid="c42ace22-d91b-4e4b-909e-19aaa428515a">
Apr 12 16:07:51 user nova-compute[71874]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Apr 12 16:07:51 user nova-compute[71874]:         </nova:port>
Apr 12 16:07:51 user nova-compute[71874]:       </nova:ports>
Apr 12 16:07:51 user nova-compute[71874]:     </nova:instance>
Apr 12 16:07:51 user nova-compute[71874]:   </metadata>
Apr 12 16:07:51 user nova-compute[71874]:   <sysinfo type="smbios">
Apr 12 16:07:51 user nova-compute[71874]:     <system>
Apr 12 16:07:51 user nova-compute[71874]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 16:07:51 user nova-compute[71874]:       <entry name="product">OpenStack Nova</entry>
Apr 12 16:07:51 user nova-compute[71874]:       <entry name="version">0.0.0</entry>
Apr 12 16:07:51 user nova-compute[71874]:       <entry name="serial">6caa4977-8333-4171-8825-2c3bfb52f80b</entry>
Apr 12 16:07:51 user nova-compute[71874]:       <entry name="uuid">6caa4977-8333-4171-8825-2c3bfb52f80b</entry>
Apr 12 16:07:51 user nova-compute[71874]:       <entry name="family">Virtual Machine</entry>
Apr 12 16:07:51 user nova-compute[71874]:     </system>
Apr 12 16:07:51 user nova-compute[71874]:   </sysinfo>
Apr 12 16:07:51 user nova-compute[71874]:   <os>
Apr 12 16:07:51 user nova-compute[71874]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 16:07:51 user nova-compute[71874]:     <smbios mode="sysinfo"/>
Apr 12 16:07:51 user nova-compute[71874]:   </os>
Apr 12 16:07:51 user nova-compute[71874]:   <features>
Apr 12 16:07:51 user nova-compute[71874]:     <acpi/>
Apr 12 16:07:51 user nova-compute[71874]:     <apic/>
Apr 12 16:07:51 user nova-compute[71874]:     <vmcoreinfo/>
Apr 12 16:07:51 user nova-compute[71874]:   </features>
Apr 12 16:07:51 user nova-compute[71874]:   <clock offset="utc">
Apr 12 16:07:51 user nova-compute[71874]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 16:07:51 user nova-compute[71874]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 16:07:51 user nova-compute[71874]:     <timer name="hpet" present="no"/>
Apr 12 16:07:51 user nova-compute[71874]:   </clock>
Apr 12 16:07:51 user nova-compute[71874]:   <cpu mode="custom" match="exact">
Apr 12 16:07:51 user nova-compute[71874]:     <model>Nehalem</model>
Apr 12 16:07:51 user nova-compute[71874]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 16:07:51 user nova-compute[71874]:   </cpu>
Apr 12 16:07:51 user nova-compute[71874]:   <devices>
Apr 12 16:07:51 user nova-compute[71874]:     <disk type="file" device="disk">
Apr 12 16:07:51 user nova-compute[71874]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 16:07:51 user nova-compute[71874]:       <source file="/opt/stack/data/nova/instances/6caa4977-8333-4171-8825-2c3bfb52f80b/disk"/>
Apr 12 16:07:51 user nova-compute[71874]:       <target dev="vda" bus="virtio"/>
Apr 12 16:07:51 user nova-compute[71874]:     </disk>
Apr 12 16:07:51 user nova-compute[71874]:     <disk type="block" device="disk">
Apr 12 16:07:51 user nova-compute[71874]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 16:07:51 user nova-compute[71874]:       <source dev="/dev/sdc"/>
Apr 12 16:07:51 user nova-compute[71874]:       <target dev="vdb" bus="virtio"/>
Apr 12 16:07:51 user nova-compute[71874]:       <serial>7cc863d9-b797-4b5b-b8ce-30ebe55b9519</serial>
Apr 12 16:07:51 user nova-compute[71874]:     </disk>
Apr 12 16:07:51 user nova-compute[71874]:     <disk type="file" device="disk">
Apr 12 16:07:51 user nova-compute[71874]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 16:07:51 user nova-compute[71874]:       <source file="/opt/stack/data/nova/instances/6caa4977-8333-4171-8825-2c3bfb52f80b/disk.rescue"/>
Apr 12 16:07:51 user nova-compute[71874]:       <target dev="vdc" bus="virtio"/>
Apr 12 16:07:51 user nova-compute[71874]:       <boot order="1"/>
Apr 12 16:07:51 user nova-compute[71874]:     </disk>
Apr 12 16:07:51 user nova-compute[71874]:     <interface type="ethernet">
Apr 12 16:07:51 user nova-compute[71874]:       <mac address="fa:16:3e:3e:cd:0b"/>
Apr 12 16:07:51 user nova-compute[71874]:       <model type="virtio"/>
Apr 12 16:07:51 user nova-compute[71874]:       <mtu size="1442"/>
Apr 12 16:07:51 user nova-compute[71874]:       <target dev="tapc42ace22-d9"/>
Apr 12 16:07:51 user nova-compute[71874]:     </interface>
Apr 12 16:07:51 user nova-compute[71874]:     <serial type="pty">
Apr 12 16:07:51 user nova-compute[71874]:       <log file="/opt/stack/data/nova/instances/6caa4977-8333-4171-8825-2c3bfb52f80b/console.log" append="off"/>
Apr 12 16:07:51 user nova-compute[71874]:     </serial>
Apr 12 16:07:51 user nova-compute[71874]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 16:07:51 user nova-compute[71874]:     <video>
Apr 12 16:07:51 user nova-compute[71874]:       <model type="virtio"/>
Apr 12 16:07:51 user nova-compute[71874]:     </video>
Apr 12 16:07:51 user nova-compute[71874]:     <rng model="virtio">
Apr 12 16:07:51 user nova-compute[71874]:       <backend model="random">/dev/urandom</backend>
Apr 12 16:07:51 user nova-compute[71874]:     </rng>
Apr 12 16:07:51 user nova-compute[71874]:     <controller type="usb" index="0" model="none"/>
Apr 12 16:07:51 user nova-compute[71874]:     <memballoon model="virtio">
Apr 12 16:07:51 user nova-compute[71874]:       <stats period="10"/>
Apr 12 16:07:51 user nova-compute[71874]:     </memballoon>
Apr 12 16:07:51 user nova-compute[71874]:   </devices>
Apr 12 16:07:51 user nova-compute[71874]: </domain>
Apr 12 16:07:51 user nova-compute[71874]:  {{(pid=71874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 16:07:51 user nova-compute[71874]: INFO nova.virt.libvirt.driver [-] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Instance destroyed successfully.
Apr 12 16:07:51 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-395dc8ac-4fab-4487-be2c-61a015fcb029 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] No BDM found with device name vda, not building metadata. {{(pid=71874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 16:07:51 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-395dc8ac-4fab-4487-be2c-61a015fcb029 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 16:07:51 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-395dc8ac-4fab-4487-be2c-61a015fcb029 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 16:07:51 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-395dc8ac-4fab-4487-be2c-61a015fcb029 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] No VIF found with MAC fa:16:3e:3e:cd:0b, not building metadata {{(pid=71874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 16:07:52 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-a5d4f90e-c5b9-4263-b06f-5f7d81fe40b9 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Acquiring lock "7f641c6b-b508-42a7-ae98-c2bfb841d798" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:07:52 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-a5d4f90e-c5b9-4263-b06f-5f7d81fe40b9 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "7f641c6b-b508-42a7-ae98-c2bfb841d798" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:07:52 user nova-compute[71874]: DEBUG nova.compute.manager [None req-a5d4f90e-c5b9-4263-b06f-5f7d81fe40b9 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] Starting instance... {{(pid=71874) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 16:07:52 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-a5d4f90e-c5b9-4263-b06f-5f7d81fe40b9 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:07:52 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-a5d4f90e-c5b9-4263-b06f-5f7d81fe40b9 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:07:52 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-a5d4f90e-c5b9-4263-b06f-5f7d81fe40b9 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71874) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 16:07:52 user nova-compute[71874]: INFO nova.compute.claims [None req-a5d4f90e-c5b9-4263-b06f-5f7d81fe40b9 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] Claim successful on node user
Apr 12 16:07:52 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:07:53 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-a5d4f90e-c5b9-4263-b06f-5f7d81fe40b9 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Inventory has not changed in ProviderTree for provider: 0e94b4c8-cd49-45e4-9133-d36eb4b2456b {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 16:07:53 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-a5d4f90e-c5b9-4263-b06f-5f7d81fe40b9 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Inventory has not changed for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 16:07:53 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-a5d4f90e-c5b9-4263-b06f-5f7d81fe40b9 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.524s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:07:53 user nova-compute[71874]: DEBUG nova.compute.manager [None req-a5d4f90e-c5b9-4263-b06f-5f7d81fe40b9 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] Start building networks asynchronously for instance. {{(pid=71874) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 16:07:53 user nova-compute[71874]: DEBUG nova.compute.manager [None req-a5d4f90e-c5b9-4263-b06f-5f7d81fe40b9 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] Allocating IP information in the background. {{(pid=71874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 16:07:53 user nova-compute[71874]: DEBUG nova.network.neutron [None req-a5d4f90e-c5b9-4263-b06f-5f7d81fe40b9 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] allocate_for_instance() {{(pid=71874) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 16:07:53 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-a5d4f90e-c5b9-4263-b06f-5f7d81fe40b9 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 16:07:53 user nova-compute[71874]: DEBUG nova.compute.manager [None req-a5d4f90e-c5b9-4263-b06f-5f7d81fe40b9 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] Start building block device mappings for instance. {{(pid=71874) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 16:07:53 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:07:53 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:07:53 user nova-compute[71874]: DEBUG nova.policy [None req-a5d4f90e-c5b9-4263-b06f-5f7d81fe40b9 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '880266e3fa4d4dd889648c10208a1f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fe48a3b7d846a195f1e47cc7f69695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71874) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 16:07:53 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:07:53 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:07:53 user nova-compute[71874]: DEBUG nova.compute.manager [None req-a5d4f90e-c5b9-4263-b06f-5f7d81fe40b9 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] Start spawning the instance on the hypervisor. {{(pid=71874) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 16:07:53 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-a5d4f90e-c5b9-4263-b06f-5f7d81fe40b9 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] Creating instance directory {{(pid=71874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 16:07:53 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-a5d4f90e-c5b9-4263-b06f-5f7d81fe40b9 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] Creating image(s)
Apr 12 16:07:53 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-a5d4f90e-c5b9-4263-b06f-5f7d81fe40b9 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Acquiring lock "/opt/stack/data/nova/instances/7f641c6b-b508-42a7-ae98-c2bfb841d798/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:07:53 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-a5d4f90e-c5b9-4263-b06f-5f7d81fe40b9 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "/opt/stack/data/nova/instances/7f641c6b-b508-42a7-ae98-c2bfb841d798/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:07:53 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-a5d4f90e-c5b9-4263-b06f-5f7d81fe40b9 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "/opt/stack/data/nova/instances/7f641c6b-b508-42a7-ae98-c2bfb841d798/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:07:53 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-a5d4f90e-c5b9-4263-b06f-5f7d81fe40b9 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:07:53 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-a5d4f90e-c5b9-4263-b06f-5f7d81fe40b9 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json" returned: 0 in 0.157s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:07:53 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-a5d4f90e-c5b9-4263-b06f-5f7d81fe40b9 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Acquiring lock "b88df1b37cb431f52bc53b5616015c89b5bec411" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:07:53 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-a5d4f90e-c5b9-4263-b06f-5f7d81fe40b9 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "b88df1b37cb431f52bc53b5616015c89b5bec411" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:07:53 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-a5d4f90e-c5b9-4263-b06f-5f7d81fe40b9 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:07:53 user nova-compute[71874]: DEBUG nova.compute.manager [req-3d63f467-9779-496e-9db2-b15babbe89fd req-9e56f72b-2bfd-47d7-a4ad-25a201555e56 service nova] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Received event network-vif-plugged-c42ace22-d91b-4e4b-909e-19aaa428515a {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:07:53 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-3d63f467-9779-496e-9db2-b15babbe89fd req-9e56f72b-2bfd-47d7-a4ad-25a201555e56 service nova] Acquiring lock "6caa4977-8333-4171-8825-2c3bfb52f80b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:07:53 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-3d63f467-9779-496e-9db2-b15babbe89fd req-9e56f72b-2bfd-47d7-a4ad-25a201555e56 service nova] Lock "6caa4977-8333-4171-8825-2c3bfb52f80b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:07:53 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-3d63f467-9779-496e-9db2-b15babbe89fd req-9e56f72b-2bfd-47d7-a4ad-25a201555e56 service nova] Lock "6caa4977-8333-4171-8825-2c3bfb52f80b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:07:53 user nova-compute[71874]: DEBUG nova.compute.manager [req-3d63f467-9779-496e-9db2-b15babbe89fd req-9e56f72b-2bfd-47d7-a4ad-25a201555e56 service nova] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] No waiting events found dispatching network-vif-plugged-c42ace22-d91b-4e4b-909e-19aaa428515a {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:07:53 user nova-compute[71874]: WARNING nova.compute.manager [req-3d63f467-9779-496e-9db2-b15babbe89fd req-9e56f72b-2bfd-47d7-a4ad-25a201555e56 service nova] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Received unexpected event network-vif-plugged-c42ace22-d91b-4e4b-909e-19aaa428515a for instance with vm_state active and task_state rescuing.
Apr 12 16:07:53 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-a5d4f90e-c5b9-4263-b06f-5f7d81fe40b9 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json" returned: 0 in 0.161s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:07:53 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-a5d4f90e-c5b9-4263-b06f-5f7d81fe40b9 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411,backing_fmt=raw /opt/stack/data/nova/instances/7f641c6b-b508-42a7-ae98-c2bfb841d798/disk 1073741824 {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:07:53 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-a5d4f90e-c5b9-4263-b06f-5f7d81fe40b9 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411,backing_fmt=raw /opt/stack/data/nova/instances/7f641c6b-b508-42a7-ae98-c2bfb841d798/disk 1073741824" returned: 0 in 0.057s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:07:53 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-a5d4f90e-c5b9-4263-b06f-5f7d81fe40b9 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "b88df1b37cb431f52bc53b5616015c89b5bec411" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.222s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:07:53 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-a5d4f90e-c5b9-4263-b06f-5f7d81fe40b9 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:07:54 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-a5d4f90e-c5b9-4263-b06f-5f7d81fe40b9 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json" returned: 0 in 0.169s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:07:54 user nova-compute[71874]: DEBUG nova.virt.disk.api [None req-a5d4f90e-c5b9-4263-b06f-5f7d81fe40b9 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7f641c6b-b508-42a7-ae98-c2bfb841d798/disk. size=1073741824 {{(pid=71874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 16:07:54 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-a5d4f90e-c5b9-4263-b06f-5f7d81fe40b9 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f641c6b-b508-42a7-ae98-c2bfb841d798/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:07:54 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:07:54 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-a5d4f90e-c5b9-4263-b06f-5f7d81fe40b9 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f641c6b-b508-42a7-ae98-c2bfb841d798/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:07:54 user nova-compute[71874]: DEBUG nova.virt.disk.api [None req-a5d4f90e-c5b9-4263-b06f-5f7d81fe40b9 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Cannot resize image /opt/stack/data/nova/instances/7f641c6b-b508-42a7-ae98-c2bfb841d798/disk to a smaller size. {{(pid=71874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 16:07:54 user nova-compute[71874]: DEBUG nova.objects.instance [None req-a5d4f90e-c5b9-4263-b06f-5f7d81fe40b9 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lazy-loading 'migration_context' on Instance uuid 7f641c6b-b508-42a7-ae98-c2bfb841d798 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:07:54 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-a5d4f90e-c5b9-4263-b06f-5f7d81fe40b9 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] Created local disks {{(pid=71874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 16:07:54 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-a5d4f90e-c5b9-4263-b06f-5f7d81fe40b9 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] Ensure instance console log exists: /opt/stack/data/nova/instances/7f641c6b-b508-42a7-ae98-c2bfb841d798/console.log {{(pid=71874) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 16:07:54 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-a5d4f90e-c5b9-4263-b06f-5f7d81fe40b9 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:07:54 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-a5d4f90e-c5b9-4263-b06f-5f7d81fe40b9 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:07:54 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-a5d4f90e-c5b9-4263-b06f-5f7d81fe40b9 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:07:54 user nova-compute[71874]: DEBUG nova.network.neutron [None req-a5d4f90e-c5b9-4263-b06f-5f7d81fe40b9 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] Successfully created port: 746786a9-c889-4ece-bc5e-a905bf8deb5c {{(pid=71874) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 16:07:55 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:07:55 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:07:55 user nova-compute[71874]: DEBUG nova.compute.manager [req-b6d63918-c675-49e1-9d27-e01b64dddc6b req-db8e3e6a-27d0-4b8d-804c-319c495e4cfe service nova] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Received event network-vif-plugged-c42ace22-d91b-4e4b-909e-19aaa428515a {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:07:55 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-b6d63918-c675-49e1-9d27-e01b64dddc6b req-db8e3e6a-27d0-4b8d-804c-319c495e4cfe service nova] Acquiring lock "6caa4977-8333-4171-8825-2c3bfb52f80b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:07:55 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-b6d63918-c675-49e1-9d27-e01b64dddc6b req-db8e3e6a-27d0-4b8d-804c-319c495e4cfe service nova] Lock "6caa4977-8333-4171-8825-2c3bfb52f80b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:07:55 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-b6d63918-c675-49e1-9d27-e01b64dddc6b req-db8e3e6a-27d0-4b8d-804c-319c495e4cfe service nova] Lock "6caa4977-8333-4171-8825-2c3bfb52f80b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:07:55 user nova-compute[71874]: DEBUG nova.compute.manager [req-b6d63918-c675-49e1-9d27-e01b64dddc6b req-db8e3e6a-27d0-4b8d-804c-319c495e4cfe service nova] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] No waiting events found dispatching network-vif-plugged-c42ace22-d91b-4e4b-909e-19aaa428515a {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:07:55 user nova-compute[71874]: WARNING nova.compute.manager [req-b6d63918-c675-49e1-9d27-e01b64dddc6b req-db8e3e6a-27d0-4b8d-804c-319c495e4cfe service nova] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Received unexpected event network-vif-plugged-c42ace22-d91b-4e4b-909e-19aaa428515a for instance with vm_state active and task_state rescuing.
Apr 12 16:07:55 user nova-compute[71874]: DEBUG nova.network.neutron [None req-a5d4f90e-c5b9-4263-b06f-5f7d81fe40b9 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] Successfully updated port: 746786a9-c889-4ece-bc5e-a905bf8deb5c {{(pid=71874) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 16:07:55 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-a5d4f90e-c5b9-4263-b06f-5f7d81fe40b9 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Acquiring lock "refresh_cache-7f641c6b-b508-42a7-ae98-c2bfb841d798" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:07:55 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-a5d4f90e-c5b9-4263-b06f-5f7d81fe40b9 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Acquired lock "refresh_cache-7f641c6b-b508-42a7-ae98-c2bfb841d798" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:07:55 user nova-compute[71874]: DEBUG nova.network.neutron [None req-a5d4f90e-c5b9-4263-b06f-5f7d81fe40b9 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] Building network info cache for instance {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 16:07:55 user nova-compute[71874]: DEBUG nova.compute.manager [req-cfa1e9dc-929f-4181-af74-6ecc9cb1e9ff req-68e941ec-0589-4ffc-ac00-2107f1f56c9c service nova] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] Received event network-changed-746786a9-c889-4ece-bc5e-a905bf8deb5c {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:07:55 user nova-compute[71874]: DEBUG nova.compute.manager [req-cfa1e9dc-929f-4181-af74-6ecc9cb1e9ff req-68e941ec-0589-4ffc-ac00-2107f1f56c9c service nova] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] Refreshing instance network info cache due to event network-changed-746786a9-c889-4ece-bc5e-a905bf8deb5c. {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 16:07:55 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-cfa1e9dc-929f-4181-af74-6ecc9cb1e9ff req-68e941ec-0589-4ffc-ac00-2107f1f56c9c service nova] Acquiring lock "refresh_cache-7f641c6b-b508-42a7-ae98-c2bfb841d798" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:07:55 user nova-compute[71874]: DEBUG nova.network.neutron [None req-a5d4f90e-c5b9-4263-b06f-5f7d81fe40b9 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] Instance cache missing network info. {{(pid=71874) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 16:07:56 user nova-compute[71874]: DEBUG nova.network.neutron [None req-a5d4f90e-c5b9-4263-b06f-5f7d81fe40b9 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] Updating instance_info_cache with network_info: [{"id": "746786a9-c889-4ece-bc5e-a905bf8deb5c", "address": "fa:16:3e:aa:23:e3", "network": {"id": "06fae0be-02dd-4962-a1ac-fd0413772758", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1493924857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3fe48a3b7d846a195f1e47cc7f69695", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap746786a9-c8", "ovs_interfaceid": "746786a9-c889-4ece-bc5e-a905bf8deb5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:07:56 user nova-compute[71874]: DEBUG nova.virt.libvirt.host [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Removed pending event for 6caa4977-8333-4171-8825-2c3bfb52f80b due to event {{(pid=71874) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 12 16:07:56 user nova-compute[71874]: DEBUG nova.virt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Emitting event <LifecycleEvent: 1681315676.2514253, 6caa4977-8333-4171-8825-2c3bfb52f80b => Resumed> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:07:56 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] VM Resumed (Lifecycle Event)
Apr 12 16:07:56 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-a5d4f90e-c5b9-4263-b06f-5f7d81fe40b9 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Releasing lock "refresh_cache-7f641c6b-b508-42a7-ae98-c2bfb841d798" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:07:56 user nova-compute[71874]: DEBUG nova.compute.manager [None req-a5d4f90e-c5b9-4263-b06f-5f7d81fe40b9 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] Instance network_info: |[{"id": "746786a9-c889-4ece-bc5e-a905bf8deb5c", "address": "fa:16:3e:aa:23:e3", "network": {"id": "06fae0be-02dd-4962-a1ac-fd0413772758", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1493924857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3fe48a3b7d846a195f1e47cc7f69695", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap746786a9-c8", "ovs_interfaceid": "746786a9-c889-4ece-bc5e-a905bf8deb5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 16:07:56 user nova-compute[71874]: DEBUG nova.compute.manager [None req-395dc8ac-4fab-4487-be2c-61a015fcb029 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:07:56 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-cfa1e9dc-929f-4181-af74-6ecc9cb1e9ff req-68e941ec-0589-4ffc-ac00-2107f1f56c9c service nova] Acquired lock "refresh_cache-7f641c6b-b508-42a7-ae98-c2bfb841d798" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:07:56 user nova-compute[71874]: DEBUG nova.network.neutron [req-cfa1e9dc-929f-4181-af74-6ecc9cb1e9ff req-68e941ec-0589-4ffc-ac00-2107f1f56c9c service nova] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] Refreshing network info cache for port 746786a9-c889-4ece-bc5e-a905bf8deb5c {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 16:07:56 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-a5d4f90e-c5b9-4263-b06f-5f7d81fe40b9 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] Start _get_guest_xml network_info=[{"id": "746786a9-c889-4ece-bc5e-a905bf8deb5c", "address": "fa:16:3e:aa:23:e3", "network": {"id": "06fae0be-02dd-4962-a1ac-fd0413772758", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1493924857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3fe48a3b7d846a195f1e47cc7f69695", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap746786a9-c8", "ovs_interfaceid": "746786a9-c889-4ece-bc5e-a905bf8deb5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T15:55:37Z,direct_url=<?>,disk_format='qcow2',id=9dc63f14-8b70-4e72-89f2-13464f2f5c7c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='61a4936d9b7744c0b488d81c9b7746b6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T15:55:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_options': None, 'image_id': '9dc63f14-8b70-4e72-89f2-13464f2f5c7c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 16:07:56 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:07:56 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 16:07:56 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-a5d4f90e-c5b9-4263-b06f-5f7d81fe40b9 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:07:56 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-a5d4f90e-c5b9-4263-b06f-5f7d81fe40b9 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:07:56 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-a5d4f90e-c5b9-4263-b06f-5f7d81fe40b9 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71874) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 16:07:56 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-a5d4f90e-c5b9-4263-b06f-5f7d81fe40b9 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T15:56:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T15:55:37Z,direct_url=<?>,disk_format='qcow2',id=9dc63f14-8b70-4e72-89f2-13464f2f5c7c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='61a4936d9b7744c0b488d81c9b7746b6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T15:55:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 16:07:56 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-a5d4f90e-c5b9-4263-b06f-5f7d81fe40b9 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Flavor limits 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 16:07:56 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-a5d4f90e-c5b9-4263-b06f-5f7d81fe40b9 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Image limits 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 16:07:56 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-a5d4f90e-c5b9-4263-b06f-5f7d81fe40b9 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Flavor pref 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 16:07:56 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-a5d4f90e-c5b9-4263-b06f-5f7d81fe40b9 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Image pref 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 16:07:56 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-a5d4f90e-c5b9-4263-b06f-5f7d81fe40b9 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 16:07:56 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-a5d4f90e-c5b9-4263-b06f-5f7d81fe40b9 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 16:07:56 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-a5d4f90e-c5b9-4263-b06f-5f7d81fe40b9 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 16:07:56 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-a5d4f90e-c5b9-4263-b06f-5f7d81fe40b9 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Got 1 possible topologies {{(pid=71874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 16:07:56 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-a5d4f90e-c5b9-4263-b06f-5f7d81fe40b9 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 16:07:56 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-a5d4f90e-c5b9-4263-b06f-5f7d81fe40b9 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 16:07:56 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-a5d4f90e-c5b9-4263-b06f-5f7d81fe40b9 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T16:07:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1180614007',display_name='tempest-ServerRescueNegativeTestJSON-server-1180614007',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1180614007',id=25,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPrkO3n8O4MAhGHzu305sUcOksNuZEgf5S2SaBBr3Crg5JA/Jbvt/iKbwzA0RYiZC3er8snS/bVFp1ZVLE3mVV6weKk+F4a0jnCrqA1XiOQQWJzF35GqBgQiIFDFUaocAg==',key_name='tempest-keypair-1217848071',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b3fe48a3b7d846a195f1e47cc7f69695',ramdisk_id='',reservation_id='r-ij3c9obi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-984710343',owner_user_name='tempest-ServerRescueNegativeTestJSON-984710343-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T16:07:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='880266e3fa4d4dd889648c10208a1f8e',uuid=7f641c6b-b508-42a7-ae98-c2bfb841d798,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "746786a9-c889-4ece-bc5e-a905bf8deb5c", "address": "fa:16:3e:aa:23:e3", "network": {"id": "06fae0be-02dd-4962-a1ac-fd0413772758", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1493924857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3fe48a3b7d846a195f1e47cc7f69695", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap746786a9-c8", "ovs_interfaceid": "746786a9-c889-4ece-bc5e-a905bf8deb5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 16:07:56 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-a5d4f90e-c5b9-4263-b06f-5f7d81fe40b9 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Converting VIF {"id": "746786a9-c889-4ece-bc5e-a905bf8deb5c", "address": "fa:16:3e:aa:23:e3", "network": {"id": "06fae0be-02dd-4962-a1ac-fd0413772758", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1493924857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3fe48a3b7d846a195f1e47cc7f69695", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap746786a9-c8", "ovs_interfaceid": "746786a9-c889-4ece-bc5e-a905bf8deb5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:07:56 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-a5d4f90e-c5b9-4263-b06f-5f7d81fe40b9 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:23:e3,bridge_name='br-int',has_traffic_filtering=True,id=746786a9-c889-4ece-bc5e-a905bf8deb5c,network=Network(06fae0be-02dd-4962-a1ac-fd0413772758),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap746786a9-c8') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:07:56 user nova-compute[71874]: DEBUG nova.objects.instance [None req-a5d4f90e-c5b9-4263-b06f-5f7d81fe40b9 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lazy-loading 'pci_devices' on Instance uuid 7f641c6b-b508-42a7-ae98-c2bfb841d798 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:07:56 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 12 16:07:56 user nova-compute[71874]: DEBUG nova.virt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Emitting event <LifecycleEvent: 1681315676.2520044, 6caa4977-8333-4171-8825-2c3bfb52f80b => Started> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:07:56 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] VM Started (Lifecycle Event)
Apr 12 16:07:56 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-a5d4f90e-c5b9-4263-b06f-5f7d81fe40b9 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] End _get_guest_xml xml=<domain type="kvm">
Apr 12 16:07:56 user nova-compute[71874]:   <uuid>7f641c6b-b508-42a7-ae98-c2bfb841d798</uuid>
Apr 12 16:07:56 user nova-compute[71874]:   <name>instance-00000019</name>
Apr 12 16:07:56 user nova-compute[71874]:   <memory>131072</memory>
Apr 12 16:07:56 user nova-compute[71874]:   <vcpu>1</vcpu>
Apr 12 16:07:56 user nova-compute[71874]:   <metadata>
Apr 12 16:07:56 user nova-compute[71874]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 16:07:56 user nova-compute[71874]:       <nova:package version="0.0.0"/>
Apr 12 16:07:56 user nova-compute[71874]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1180614007</nova:name>
Apr 12 16:07:56 user nova-compute[71874]:       <nova:creationTime>2023-04-12 16:07:56</nova:creationTime>
Apr 12 16:07:56 user nova-compute[71874]:       <nova:flavor name="m1.nano">
Apr 12 16:07:56 user nova-compute[71874]:         <nova:memory>128</nova:memory>
Apr 12 16:07:56 user nova-compute[71874]:         <nova:disk>1</nova:disk>
Apr 12 16:07:56 user nova-compute[71874]:         <nova:swap>0</nova:swap>
Apr 12 16:07:56 user nova-compute[71874]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 16:07:56 user nova-compute[71874]:         <nova:vcpus>1</nova:vcpus>
Apr 12 16:07:56 user nova-compute[71874]:       </nova:flavor>
Apr 12 16:07:56 user nova-compute[71874]:       <nova:owner>
Apr 12 16:07:56 user nova-compute[71874]:         <nova:user uuid="880266e3fa4d4dd889648c10208a1f8e">tempest-ServerRescueNegativeTestJSON-984710343-project-member</nova:user>
Apr 12 16:07:56 user nova-compute[71874]:         <nova:project uuid="b3fe48a3b7d846a195f1e47cc7f69695">tempest-ServerRescueNegativeTestJSON-984710343</nova:project>
Apr 12 16:07:56 user nova-compute[71874]:       </nova:owner>
Apr 12 16:07:56 user nova-compute[71874]:       <nova:root type="image" uuid="9dc63f14-8b70-4e72-89f2-13464f2f5c7c"/>
Apr 12 16:07:56 user nova-compute[71874]:       <nova:ports>
Apr 12 16:07:56 user nova-compute[71874]:         <nova:port uuid="746786a9-c889-4ece-bc5e-a905bf8deb5c">
Apr 12 16:07:56 user nova-compute[71874]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 12 16:07:56 user nova-compute[71874]:         </nova:port>
Apr 12 16:07:56 user nova-compute[71874]:       </nova:ports>
Apr 12 16:07:56 user nova-compute[71874]:     </nova:instance>
Apr 12 16:07:56 user nova-compute[71874]:   </metadata>
Apr 12 16:07:56 user nova-compute[71874]:   <sysinfo type="smbios">
Apr 12 16:07:56 user nova-compute[71874]:     <system>
Apr 12 16:07:56 user nova-compute[71874]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 16:07:56 user nova-compute[71874]:       <entry name="product">OpenStack Nova</entry>
Apr 12 16:07:56 user nova-compute[71874]:       <entry name="version">0.0.0</entry>
Apr 12 16:07:56 user nova-compute[71874]:       <entry name="serial">7f641c6b-b508-42a7-ae98-c2bfb841d798</entry>
Apr 12 16:07:56 user nova-compute[71874]:       <entry name="uuid">7f641c6b-b508-42a7-ae98-c2bfb841d798</entry>
Apr 12 16:07:56 user nova-compute[71874]:       <entry name="family">Virtual Machine</entry>
Apr 12 16:07:56 user nova-compute[71874]:     </system>
Apr 12 16:07:56 user nova-compute[71874]:   </sysinfo>
Apr 12 16:07:56 user nova-compute[71874]:   <os>
Apr 12 16:07:56 user nova-compute[71874]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 16:07:56 user nova-compute[71874]:     <boot dev="hd"/>
Apr 12 16:07:56 user nova-compute[71874]:     <smbios mode="sysinfo"/>
Apr 12 16:07:56 user nova-compute[71874]:   </os>
Apr 12 16:07:56 user nova-compute[71874]:   <features>
Apr 12 16:07:56 user nova-compute[71874]:     <acpi/>
Apr 12 16:07:56 user nova-compute[71874]:     <apic/>
Apr 12 16:07:56 user nova-compute[71874]:     <vmcoreinfo/>
Apr 12 16:07:56 user nova-compute[71874]:   </features>
Apr 12 16:07:56 user nova-compute[71874]:   <clock offset="utc">
Apr 12 16:07:56 user nova-compute[71874]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 16:07:56 user nova-compute[71874]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 16:07:56 user nova-compute[71874]:     <timer name="hpet" present="no"/>
Apr 12 16:07:56 user nova-compute[71874]:   </clock>
Apr 12 16:07:56 user nova-compute[71874]:   <cpu mode="custom" match="exact">
Apr 12 16:07:56 user nova-compute[71874]:     <model>Nehalem</model>
Apr 12 16:07:56 user nova-compute[71874]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 16:07:56 user nova-compute[71874]:   </cpu>
Apr 12 16:07:56 user nova-compute[71874]:   <devices>
Apr 12 16:07:56 user nova-compute[71874]:     <disk type="file" device="disk">
Apr 12 16:07:56 user nova-compute[71874]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 16:07:56 user nova-compute[71874]:       <source file="/opt/stack/data/nova/instances/7f641c6b-b508-42a7-ae98-c2bfb841d798/disk"/>
Apr 12 16:07:56 user nova-compute[71874]:       <target dev="vda" bus="virtio"/>
Apr 12 16:07:56 user nova-compute[71874]:     </disk>
Apr 12 16:07:56 user nova-compute[71874]:     <interface type="ethernet">
Apr 12 16:07:56 user nova-compute[71874]:       <mac address="fa:16:3e:aa:23:e3"/>
Apr 12 16:07:56 user nova-compute[71874]:       <model type="virtio"/>
Apr 12 16:07:56 user nova-compute[71874]:       <mtu size="1442"/>
Apr 12 16:07:56 user nova-compute[71874]:       <target dev="tap746786a9-c8"/>
Apr 12 16:07:56 user nova-compute[71874]:     </interface>
Apr 12 16:07:56 user nova-compute[71874]:     <serial type="pty">
Apr 12 16:07:56 user nova-compute[71874]:       <log file="/opt/stack/data/nova/instances/7f641c6b-b508-42a7-ae98-c2bfb841d798/console.log" append="off"/>
Apr 12 16:07:56 user nova-compute[71874]:     </serial>
Apr 12 16:07:56 user nova-compute[71874]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 16:07:56 user nova-compute[71874]:     <video>
Apr 12 16:07:56 user nova-compute[71874]:       <model type="virtio"/>
Apr 12 16:07:56 user nova-compute[71874]:     </video>
Apr 12 16:07:56 user nova-compute[71874]:     <rng model="virtio">
Apr 12 16:07:56 user nova-compute[71874]:       <backend model="random">/dev/urandom</backend>
Apr 12 16:07:56 user nova-compute[71874]:     </rng>
Apr 12 16:07:56 user nova-compute[71874]:     <controller type="usb" index="0" model="none"/>
Apr 12 16:07:56 user nova-compute[71874]:     <memballoon model="virtio">
Apr 12 16:07:56 user nova-compute[71874]:       <stats period="10"/>
Apr 12 16:07:56 user nova-compute[71874]:     </memballoon>
Apr 12 16:07:56 user nova-compute[71874]:   </devices>
Apr 12 16:07:56 user nova-compute[71874]: </domain>
Apr 12 16:07:56 user nova-compute[71874]:  {{(pid=71874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 16:07:56 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-a5d4f90e-c5b9-4263-b06f-5f7d81fe40b9 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T16:07:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1180614007',display_name='tempest-ServerRescueNegativeTestJSON-server-1180614007',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1180614007',id=25,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPrkO3n8O4MAhGHzu305sUcOksNuZEgf5S2SaBBr3Crg5JA/Jbvt/iKbwzA0RYiZC3er8snS/bVFp1ZVLE3mVV6weKk+F4a0jnCrqA1XiOQQWJzF35GqBgQiIFDFUaocAg==',key_name='tempest-keypair-1217848071',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b3fe48a3b7d846a195f1e47cc7f69695',ramdisk_id='',reservation_id='r-ij3c9obi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-984710343',owner_user_name='tempest-ServerRescueNegativeTestJSON-984710343-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T16:07:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='880266e3fa4d4dd889648c10208a1f8e',uuid=7f641c6b-b508-42a7-ae98-c2bfb841d798,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "746786a9-c889-4ece-bc5e-a905bf8deb5c", "address": "fa:16:3e:aa:23:e3", "network": {"id": "06fae0be-02dd-4962-a1ac-fd0413772758", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1493924857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3fe48a3b7d846a195f1e47cc7f69695", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap746786a9-c8", "ovs_interfaceid": "746786a9-c889-4ece-bc5e-a905bf8deb5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 16:07:56 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-a5d4f90e-c5b9-4263-b06f-5f7d81fe40b9 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Converting VIF {"id": "746786a9-c889-4ece-bc5e-a905bf8deb5c", "address": "fa:16:3e:aa:23:e3", "network": {"id": "06fae0be-02dd-4962-a1ac-fd0413772758", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1493924857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3fe48a3b7d846a195f1e47cc7f69695", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap746786a9-c8", "ovs_interfaceid": "746786a9-c889-4ece-bc5e-a905bf8deb5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:07:56 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-a5d4f90e-c5b9-4263-b06f-5f7d81fe40b9 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:23:e3,bridge_name='br-int',has_traffic_filtering=True,id=746786a9-c889-4ece-bc5e-a905bf8deb5c,network=Network(06fae0be-02dd-4962-a1ac-fd0413772758),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap746786a9-c8') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:07:56 user nova-compute[71874]: DEBUG os_vif [None req-a5d4f90e-c5b9-4263-b06f-5f7d81fe40b9 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:23:e3,bridge_name='br-int',has_traffic_filtering=True,id=746786a9-c889-4ece-bc5e-a905bf8deb5c,network=Network(06fae0be-02dd-4962-a1ac-fd0413772758),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap746786a9-c8') {{(pid=71874) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 16:07:56 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:07:56 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:07:56 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 16:07:56 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:07:56 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap746786a9-c8, may_exist=True) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:07:56 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap746786a9-c8, col_values=(('external_ids', {'iface-id': '746786a9-c889-4ece-bc5e-a905bf8deb5c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:aa:23:e3', 'vm-uuid': '7f641c6b-b508-42a7-ae98-c2bfb841d798'}),)) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:07:56 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:07:56 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:07:56 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:07:56 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 16:07:56 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:07:56 user nova-compute[71874]: INFO os_vif [None req-a5d4f90e-c5b9-4263-b06f-5f7d81fe40b9 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:23:e3,bridge_name='br-int',has_traffic_filtering=True,id=746786a9-c889-4ece-bc5e-a905bf8deb5c,network=Network(06fae0be-02dd-4962-a1ac-fd0413772758),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap746786a9-c8')
Apr 12 16:07:56 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-a5d4f90e-c5b9-4263-b06f-5f7d81fe40b9 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] No BDM found with device name vda, not building metadata. {{(pid=71874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 16:07:56 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-a5d4f90e-c5b9-4263-b06f-5f7d81fe40b9 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] No VIF found with MAC fa:16:3e:aa:23:e3, not building metadata {{(pid=71874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 16:07:56 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-3720f937-dabf-47ac-bd0b-7dee391810d2 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Acquiring lock "016ae41d-b098-4126-ace7-3da00b40cb9c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:07:56 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-3720f937-dabf-47ac-bd0b-7dee391810d2 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "016ae41d-b098-4126-ace7-3da00b40cb9c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:07:56 user nova-compute[71874]: DEBUG nova.compute.manager [None req-3720f937-dabf-47ac-bd0b-7dee391810d2 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 016ae41d-b098-4126-ace7-3da00b40cb9c] Starting instance... {{(pid=71874) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 16:07:56 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-3720f937-dabf-47ac-bd0b-7dee391810d2 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:07:56 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-3720f937-dabf-47ac-bd0b-7dee391810d2 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:07:56 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-3720f937-dabf-47ac-bd0b-7dee391810d2 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71874) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 16:07:56 user nova-compute[71874]: INFO nova.compute.claims [None req-3720f937-dabf-47ac-bd0b-7dee391810d2 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 016ae41d-b098-4126-ace7-3da00b40cb9c] Claim successful on node user
Apr 12 16:07:57 user nova-compute[71874]: DEBUG nova.network.neutron [req-cfa1e9dc-929f-4181-af74-6ecc9cb1e9ff req-68e941ec-0589-4ffc-ac00-2107f1f56c9c service nova] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] Updated VIF entry in instance network info cache for port 746786a9-c889-4ece-bc5e-a905bf8deb5c. {{(pid=71874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 16:07:57 user nova-compute[71874]: DEBUG nova.network.neutron [req-cfa1e9dc-929f-4181-af74-6ecc9cb1e9ff req-68e941ec-0589-4ffc-ac00-2107f1f56c9c service nova] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] Updating instance_info_cache with network_info: [{"id": "746786a9-c889-4ece-bc5e-a905bf8deb5c", "address": "fa:16:3e:aa:23:e3", "network": {"id": "06fae0be-02dd-4962-a1ac-fd0413772758", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1493924857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3fe48a3b7d846a195f1e47cc7f69695", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap746786a9-c8", "ovs_interfaceid": "746786a9-c889-4ece-bc5e-a905bf8deb5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:07:57 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-cfa1e9dc-929f-4181-af74-6ecc9cb1e9ff req-68e941ec-0589-4ffc-ac00-2107f1f56c9c service nova] Releasing lock "refresh_cache-7f641c6b-b508-42a7-ae98-c2bfb841d798" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:07:57 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-3720f937-dabf-47ac-bd0b-7dee391810d2 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Inventory has not changed in ProviderTree for provider: 0e94b4c8-cd49-45e4-9133-d36eb4b2456b {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 16:07:57 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-3720f937-dabf-47ac-bd0b-7dee391810d2 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Inventory has not changed for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 16:07:57 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-3720f937-dabf-47ac-bd0b-7dee391810d2 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.641s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:07:57 user nova-compute[71874]: DEBUG nova.compute.manager [None req-3720f937-dabf-47ac-bd0b-7dee391810d2 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 016ae41d-b098-4126-ace7-3da00b40cb9c] Start building networks asynchronously for instance. {{(pid=71874) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 16:07:57 user nova-compute[71874]: DEBUG nova.compute.manager [None req-3720f937-dabf-47ac-bd0b-7dee391810d2 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 016ae41d-b098-4126-ace7-3da00b40cb9c] Allocating IP information in the background. {{(pid=71874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 16:07:57 user nova-compute[71874]: DEBUG nova.network.neutron [None req-3720f937-dabf-47ac-bd0b-7dee391810d2 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 016ae41d-b098-4126-ace7-3da00b40cb9c] allocate_for_instance() {{(pid=71874) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 16:07:57 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-3720f937-dabf-47ac-bd0b-7dee391810d2 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 016ae41d-b098-4126-ace7-3da00b40cb9c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 16:07:57 user nova-compute[71874]: DEBUG nova.compute.manager [None req-3720f937-dabf-47ac-bd0b-7dee391810d2 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 016ae41d-b098-4126-ace7-3da00b40cb9c] Start building block device mappings for instance. {{(pid=71874) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 16:07:57 user nova-compute[71874]: DEBUG nova.policy [None req-3720f937-dabf-47ac-bd0b-7dee391810d2 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '73f9fa5bc22a4824b3cdcb8cf7bb380c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9210f81232304e179d3e09914a492442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71874) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 16:07:57 user nova-compute[71874]: DEBUG nova.compute.manager [None req-3720f937-dabf-47ac-bd0b-7dee391810d2 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 016ae41d-b098-4126-ace7-3da00b40cb9c] Start spawning the instance on the hypervisor. {{(pid=71874) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 16:07:57 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-3720f937-dabf-47ac-bd0b-7dee391810d2 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 016ae41d-b098-4126-ace7-3da00b40cb9c] Creating instance directory {{(pid=71874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 16:07:57 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-3720f937-dabf-47ac-bd0b-7dee391810d2 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 016ae41d-b098-4126-ace7-3da00b40cb9c] Creating image(s)
Apr 12 16:07:57 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-3720f937-dabf-47ac-bd0b-7dee391810d2 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Acquiring lock "/opt/stack/data/nova/instances/016ae41d-b098-4126-ace7-3da00b40cb9c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:07:57 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-3720f937-dabf-47ac-bd0b-7dee391810d2 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "/opt/stack/data/nova/instances/016ae41d-b098-4126-ace7-3da00b40cb9c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:07:57 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-3720f937-dabf-47ac-bd0b-7dee391810d2 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "/opt/stack/data/nova/instances/016ae41d-b098-4126-ace7-3da00b40cb9c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:07:57 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-3720f937-dabf-47ac-bd0b-7dee391810d2 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:07:57 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-3720f937-dabf-47ac-bd0b-7dee391810d2 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json" returned: 0 in 0.168s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:07:57 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-3720f937-dabf-47ac-bd0b-7dee391810d2 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Acquiring lock "b88df1b37cb431f52bc53b5616015c89b5bec411" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:07:57 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-3720f937-dabf-47ac-bd0b-7dee391810d2 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "b88df1b37cb431f52bc53b5616015c89b5bec411" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:07:57 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-3720f937-dabf-47ac-bd0b-7dee391810d2 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:07:57 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:07:57 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-3720f937-dabf-47ac-bd0b-7dee391810d2 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json" returned: 0 in 0.203s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:07:57 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-3720f937-dabf-47ac-bd0b-7dee391810d2 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411,backing_fmt=raw /opt/stack/data/nova/instances/016ae41d-b098-4126-ace7-3da00b40cb9c/disk 1073741824 {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:07:58 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:07:58 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:07:58 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:07:58 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-3720f937-dabf-47ac-bd0b-7dee391810d2 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411,backing_fmt=raw /opt/stack/data/nova/instances/016ae41d-b098-4126-ace7-3da00b40cb9c/disk 1073741824" returned: 0 in 0.081s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:07:58 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-3720f937-dabf-47ac-bd0b-7dee391810d2 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "b88df1b37cb431f52bc53b5616015c89b5bec411" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.289s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:07:58 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-3720f937-dabf-47ac-bd0b-7dee391810d2 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:07:58 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-3720f937-dabf-47ac-bd0b-7dee391810d2 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json" returned: 0 in 0.171s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:07:58 user nova-compute[71874]: DEBUG nova.virt.disk.api [None req-3720f937-dabf-47ac-bd0b-7dee391810d2 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Checking if we can resize image /opt/stack/data/nova/instances/016ae41d-b098-4126-ace7-3da00b40cb9c/disk. size=1073741824 {{(pid=71874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 16:07:58 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-3720f937-dabf-47ac-bd0b-7dee391810d2 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/016ae41d-b098-4126-ace7-3da00b40cb9c/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:07:58 user nova-compute[71874]: DEBUG nova.compute.manager [req-5f04b3d5-f407-41c7-a162-52d23723fa7e req-76af3452-c78c-4976-888a-8f430af0731d service nova] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] Received event network-vif-plugged-746786a9-c889-4ece-bc5e-a905bf8deb5c {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:07:58 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-5f04b3d5-f407-41c7-a162-52d23723fa7e req-76af3452-c78c-4976-888a-8f430af0731d service nova] Acquiring lock "7f641c6b-b508-42a7-ae98-c2bfb841d798-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:07:58 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-5f04b3d5-f407-41c7-a162-52d23723fa7e req-76af3452-c78c-4976-888a-8f430af0731d service nova] Lock "7f641c6b-b508-42a7-ae98-c2bfb841d798-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:07:58 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-5f04b3d5-f407-41c7-a162-52d23723fa7e req-76af3452-c78c-4976-888a-8f430af0731d service nova] Lock "7f641c6b-b508-42a7-ae98-c2bfb841d798-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:07:58 user nova-compute[71874]: DEBUG nova.compute.manager [req-5f04b3d5-f407-41c7-a162-52d23723fa7e req-76af3452-c78c-4976-888a-8f430af0731d service nova] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] No waiting events found dispatching network-vif-plugged-746786a9-c889-4ece-bc5e-a905bf8deb5c {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:07:58 user nova-compute[71874]: WARNING nova.compute.manager [req-5f04b3d5-f407-41c7-a162-52d23723fa7e req-76af3452-c78c-4976-888a-8f430af0731d service nova] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] Received unexpected event network-vif-plugged-746786a9-c889-4ece-bc5e-a905bf8deb5c for instance with vm_state building and task_state spawning.
Apr 12 16:07:58 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:07:58 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-3720f937-dabf-47ac-bd0b-7dee391810d2 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/016ae41d-b098-4126-ace7-3da00b40cb9c/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:07:58 user nova-compute[71874]: DEBUG nova.virt.disk.api [None req-3720f937-dabf-47ac-bd0b-7dee391810d2 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Cannot resize image /opt/stack/data/nova/instances/016ae41d-b098-4126-ace7-3da00b40cb9c/disk to a smaller size. {{(pid=71874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 16:07:58 user nova-compute[71874]: DEBUG nova.objects.instance [None req-3720f937-dabf-47ac-bd0b-7dee391810d2 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lazy-loading 'migration_context' on Instance uuid 016ae41d-b098-4126-ace7-3da00b40cb9c {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:07:58 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-3720f937-dabf-47ac-bd0b-7dee391810d2 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 016ae41d-b098-4126-ace7-3da00b40cb9c] Created local disks {{(pid=71874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 16:07:58 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-3720f937-dabf-47ac-bd0b-7dee391810d2 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 016ae41d-b098-4126-ace7-3da00b40cb9c] Ensure instance console log exists: /opt/stack/data/nova/instances/016ae41d-b098-4126-ace7-3da00b40cb9c/console.log {{(pid=71874) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 16:07:58 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-3720f937-dabf-47ac-bd0b-7dee391810d2 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:07:58 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-3720f937-dabf-47ac-bd0b-7dee391810d2 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:07:58 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-3720f937-dabf-47ac-bd0b-7dee391810d2 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:07:58 user nova-compute[71874]: DEBUG nova.network.neutron [None req-3720f937-dabf-47ac-bd0b-7dee391810d2 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 016ae41d-b098-4126-ace7-3da00b40cb9c] Successfully created port: 6aeec58e-a9ce-429d-a931-f860d7352c2e {{(pid=71874) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 16:07:59 user nova-compute[71874]: DEBUG nova.network.neutron [None req-3720f937-dabf-47ac-bd0b-7dee391810d2 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 016ae41d-b098-4126-ace7-3da00b40cb9c] Successfully updated port: 6aeec58e-a9ce-429d-a931-f860d7352c2e {{(pid=71874) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 16:07:59 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-3720f937-dabf-47ac-bd0b-7dee391810d2 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Acquiring lock "refresh_cache-016ae41d-b098-4126-ace7-3da00b40cb9c" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:07:59 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-3720f937-dabf-47ac-bd0b-7dee391810d2 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Acquired lock "refresh_cache-016ae41d-b098-4126-ace7-3da00b40cb9c" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:07:59 user nova-compute[71874]: DEBUG nova.network.neutron [None req-3720f937-dabf-47ac-bd0b-7dee391810d2 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 016ae41d-b098-4126-ace7-3da00b40cb9c] Building network info cache for instance {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 16:07:59 user nova-compute[71874]: DEBUG nova.compute.manager [req-bfbc0889-5606-4e59-8147-41f0726ded81 req-1fed4131-ee39-4052-b568-27aaa1556047 service nova] [instance: 016ae41d-b098-4126-ace7-3da00b40cb9c] Received event network-changed-6aeec58e-a9ce-429d-a931-f860d7352c2e {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:07:59 user nova-compute[71874]: DEBUG nova.compute.manager [req-bfbc0889-5606-4e59-8147-41f0726ded81 req-1fed4131-ee39-4052-b568-27aaa1556047 service nova] [instance: 016ae41d-b098-4126-ace7-3da00b40cb9c] Refreshing instance network info cache due to event network-changed-6aeec58e-a9ce-429d-a931-f860d7352c2e. {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 16:07:59 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-bfbc0889-5606-4e59-8147-41f0726ded81 req-1fed4131-ee39-4052-b568-27aaa1556047 service nova] Acquiring lock "refresh_cache-016ae41d-b098-4126-ace7-3da00b40cb9c" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:07:59 user nova-compute[71874]: DEBUG nova.network.neutron [None req-3720f937-dabf-47ac-bd0b-7dee391810d2 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 016ae41d-b098-4126-ace7-3da00b40cb9c] Instance cache missing network info. {{(pid=71874) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 16:07:59 user nova-compute[71874]: DEBUG nova.network.neutron [None req-3720f937-dabf-47ac-bd0b-7dee391810d2 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 016ae41d-b098-4126-ace7-3da00b40cb9c] Updating instance_info_cache with network_info: [{"id": "6aeec58e-a9ce-429d-a931-f860d7352c2e", "address": "fa:16:3e:8b:30:9b", "network": {"id": "b36306e0-04c5-4b1b-8022-05ff121c4e43", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1503204786-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9210f81232304e179d3e09914a492442", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6aeec58e-a9", "ovs_interfaceid": "6aeec58e-a9ce-429d-a931-f860d7352c2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:07:59 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-3720f937-dabf-47ac-bd0b-7dee391810d2 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Releasing lock "refresh_cache-016ae41d-b098-4126-ace7-3da00b40cb9c" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:07:59 user nova-compute[71874]: DEBUG nova.compute.manager [None req-3720f937-dabf-47ac-bd0b-7dee391810d2 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 016ae41d-b098-4126-ace7-3da00b40cb9c] Instance network_info: |[{"id": "6aeec58e-a9ce-429d-a931-f860d7352c2e", "address": "fa:16:3e:8b:30:9b", "network": {"id": "b36306e0-04c5-4b1b-8022-05ff121c4e43", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1503204786-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9210f81232304e179d3e09914a492442", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6aeec58e-a9", "ovs_interfaceid": "6aeec58e-a9ce-429d-a931-f860d7352c2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 16:07:59 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-bfbc0889-5606-4e59-8147-41f0726ded81 req-1fed4131-ee39-4052-b568-27aaa1556047 service nova] Acquired lock "refresh_cache-016ae41d-b098-4126-ace7-3da00b40cb9c" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:07:59 user nova-compute[71874]: DEBUG nova.network.neutron [req-bfbc0889-5606-4e59-8147-41f0726ded81 req-1fed4131-ee39-4052-b568-27aaa1556047 service nova] [instance: 016ae41d-b098-4126-ace7-3da00b40cb9c] Refreshing network info cache for port 6aeec58e-a9ce-429d-a931-f860d7352c2e {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 16:07:59 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-3720f937-dabf-47ac-bd0b-7dee391810d2 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 016ae41d-b098-4126-ace7-3da00b40cb9c] Start _get_guest_xml network_info=[{"id": "6aeec58e-a9ce-429d-a931-f860d7352c2e", "address": "fa:16:3e:8b:30:9b", "network": {"id": "b36306e0-04c5-4b1b-8022-05ff121c4e43", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1503204786-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9210f81232304e179d3e09914a492442", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6aeec58e-a9", "ovs_interfaceid": "6aeec58e-a9ce-429d-a931-f860d7352c2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T15:55:37Z,direct_url=<?>,disk_format='qcow2',id=9dc63f14-8b70-4e72-89f2-13464f2f5c7c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='61a4936d9b7744c0b488d81c9b7746b6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T15:55:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_options': None, 'image_id': '9dc63f14-8b70-4e72-89f2-13464f2f5c7c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 16:07:59 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-3720f937-dabf-47ac-bd0b-7dee391810d2 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:07:59 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-3720f937-dabf-47ac-bd0b-7dee391810d2 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:07:59 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-3720f937-dabf-47ac-bd0b-7dee391810d2 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71874) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 16:07:59 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-3720f937-dabf-47ac-bd0b-7dee391810d2 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T15:56:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T15:55:37Z,direct_url=<?>,disk_format='qcow2',id=9dc63f14-8b70-4e72-89f2-13464f2f5c7c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='61a4936d9b7744c0b488d81c9b7746b6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T15:55:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 16:07:59 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-3720f937-dabf-47ac-bd0b-7dee391810d2 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Flavor limits 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 16:07:59 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-3720f937-dabf-47ac-bd0b-7dee391810d2 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Image limits 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 16:07:59 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-3720f937-dabf-47ac-bd0b-7dee391810d2 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Flavor pref 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 16:07:59 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-3720f937-dabf-47ac-bd0b-7dee391810d2 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Image pref 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 16:07:59 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-3720f937-dabf-47ac-bd0b-7dee391810d2 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 16:07:59 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-3720f937-dabf-47ac-bd0b-7dee391810d2 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 16:07:59 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-3720f937-dabf-47ac-bd0b-7dee391810d2 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 16:07:59 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-3720f937-dabf-47ac-bd0b-7dee391810d2 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Got 1 possible topologies {{(pid=71874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 16:07:59 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-3720f937-dabf-47ac-bd0b-7dee391810d2 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 16:07:59 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-3720f937-dabf-47ac-bd0b-7dee391810d2 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 16:07:59 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-3720f937-dabf-47ac-bd0b-7dee391810d2 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T16:07:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1903529512',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1903529512',id=26,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9210f81232304e179d3e09914a492442',ramdisk_id='',reservation_id='r-p2olcd7k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1443944578',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T16:07:57Z,user_data=None,user_id='73f9fa5bc22a4824b3cdcb8cf7bb380c',uuid=016ae41d-b098-4126-ace7-3da00b40cb9c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6aeec58e-a9ce-429d-a931-f860d7352c2e", "address": "fa:16:3e:8b:30:9b", "network": {"id": "b36306e0-04c5-4b1b-8022-05ff121c4e43", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1503204786-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9210f81232304e179d3e09914a492442", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6aeec58e-a9", "ovs_interfaceid": "6aeec58e-a9ce-429d-a931-f860d7352c2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 16:07:59 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-3720f937-dabf-47ac-bd0b-7dee391810d2 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Converting VIF {"id": "6aeec58e-a9ce-429d-a931-f860d7352c2e", "address": "fa:16:3e:8b:30:9b", "network": {"id": "b36306e0-04c5-4b1b-8022-05ff121c4e43", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1503204786-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9210f81232304e179d3e09914a492442", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6aeec58e-a9", "ovs_interfaceid": "6aeec58e-a9ce-429d-a931-f860d7352c2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:07:59 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-3720f937-dabf-47ac-bd0b-7dee391810d2 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:30:9b,bridge_name='br-int',has_traffic_filtering=True,id=6aeec58e-a9ce-429d-a931-f860d7352c2e,network=Network(b36306e0-04c5-4b1b-8022-05ff121c4e43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6aeec58e-a9') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:07:59 user nova-compute[71874]: DEBUG nova.objects.instance [None req-3720f937-dabf-47ac-bd0b-7dee391810d2 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lazy-loading 'pci_devices' on Instance uuid 016ae41d-b098-4126-ace7-3da00b40cb9c {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:07:59 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-3720f937-dabf-47ac-bd0b-7dee391810d2 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 016ae41d-b098-4126-ace7-3da00b40cb9c] End _get_guest_xml xml=<domain type="kvm">
Apr 12 16:07:59 user nova-compute[71874]:   <uuid>016ae41d-b098-4126-ace7-3da00b40cb9c</uuid>
Apr 12 16:07:59 user nova-compute[71874]:   <name>instance-0000001a</name>
Apr 12 16:07:59 user nova-compute[71874]:   <memory>131072</memory>
Apr 12 16:07:59 user nova-compute[71874]:   <vcpu>1</vcpu>
Apr 12 16:07:59 user nova-compute[71874]:   <metadata>
Apr 12 16:07:59 user nova-compute[71874]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 16:07:59 user nova-compute[71874]:       <nova:package version="0.0.0"/>
Apr 12 16:07:59 user nova-compute[71874]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1903529512</nova:name>
Apr 12 16:07:59 user nova-compute[71874]:       <nova:creationTime>2023-04-12 16:07:59</nova:creationTime>
Apr 12 16:07:59 user nova-compute[71874]:       <nova:flavor name="m1.nano">
Apr 12 16:07:59 user nova-compute[71874]:         <nova:memory>128</nova:memory>
Apr 12 16:07:59 user nova-compute[71874]:         <nova:disk>1</nova:disk>
Apr 12 16:07:59 user nova-compute[71874]:         <nova:swap>0</nova:swap>
Apr 12 16:07:59 user nova-compute[71874]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 16:07:59 user nova-compute[71874]:         <nova:vcpus>1</nova:vcpus>
Apr 12 16:07:59 user nova-compute[71874]:       </nova:flavor>
Apr 12 16:07:59 user nova-compute[71874]:       <nova:owner>
Apr 12 16:07:59 user nova-compute[71874]:         <nova:user uuid="73f9fa5bc22a4824b3cdcb8cf7bb380c">tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member</nova:user>
Apr 12 16:07:59 user nova-compute[71874]:         <nova:project uuid="9210f81232304e179d3e09914a492442">tempest-ServerBootFromVolumeStableRescueTest-1443944578</nova:project>
Apr 12 16:07:59 user nova-compute[71874]:       </nova:owner>
Apr 12 16:07:59 user nova-compute[71874]:       <nova:root type="image" uuid="9dc63f14-8b70-4e72-89f2-13464f2f5c7c"/>
Apr 12 16:07:59 user nova-compute[71874]:       <nova:ports>
Apr 12 16:07:59 user nova-compute[71874]:         <nova:port uuid="6aeec58e-a9ce-429d-a931-f860d7352c2e">
Apr 12 16:07:59 user nova-compute[71874]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 12 16:07:59 user nova-compute[71874]:         </nova:port>
Apr 12 16:07:59 user nova-compute[71874]:       </nova:ports>
Apr 12 16:07:59 user nova-compute[71874]:     </nova:instance>
Apr 12 16:07:59 user nova-compute[71874]:   </metadata>
Apr 12 16:07:59 user nova-compute[71874]:   <sysinfo type="smbios">
Apr 12 16:07:59 user nova-compute[71874]:     <system>
Apr 12 16:07:59 user nova-compute[71874]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 16:07:59 user nova-compute[71874]:       <entry name="product">OpenStack Nova</entry>
Apr 12 16:07:59 user nova-compute[71874]:       <entry name="version">0.0.0</entry>
Apr 12 16:07:59 user nova-compute[71874]:       <entry name="serial">016ae41d-b098-4126-ace7-3da00b40cb9c</entry>
Apr 12 16:07:59 user nova-compute[71874]:       <entry name="uuid">016ae41d-b098-4126-ace7-3da00b40cb9c</entry>
Apr 12 16:07:59 user nova-compute[71874]:       <entry name="family">Virtual Machine</entry>
Apr 12 16:07:59 user nova-compute[71874]:     </system>
Apr 12 16:07:59 user nova-compute[71874]:   </sysinfo>
Apr 12 16:07:59 user nova-compute[71874]:   <os>
Apr 12 16:07:59 user nova-compute[71874]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 16:07:59 user nova-compute[71874]:     <boot dev="hd"/>
Apr 12 16:07:59 user nova-compute[71874]:     <smbios mode="sysinfo"/>
Apr 12 16:07:59 user nova-compute[71874]:   </os>
Apr 12 16:07:59 user nova-compute[71874]:   <features>
Apr 12 16:07:59 user nova-compute[71874]:     <acpi/>
Apr 12 16:07:59 user nova-compute[71874]:     <apic/>
Apr 12 16:07:59 user nova-compute[71874]:     <vmcoreinfo/>
Apr 12 16:07:59 user nova-compute[71874]:   </features>
Apr 12 16:07:59 user nova-compute[71874]:   <clock offset="utc">
Apr 12 16:07:59 user nova-compute[71874]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 16:07:59 user nova-compute[71874]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 16:07:59 user nova-compute[71874]:     <timer name="hpet" present="no"/>
Apr 12 16:07:59 user nova-compute[71874]:   </clock>
Apr 12 16:07:59 user nova-compute[71874]:   <cpu mode="custom" match="exact">
Apr 12 16:07:59 user nova-compute[71874]:     <model>Nehalem</model>
Apr 12 16:07:59 user nova-compute[71874]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 16:07:59 user nova-compute[71874]:   </cpu>
Apr 12 16:07:59 user nova-compute[71874]:   <devices>
Apr 12 16:07:59 user nova-compute[71874]:     <disk type="file" device="disk">
Apr 12 16:07:59 user nova-compute[71874]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 16:07:59 user nova-compute[71874]:       <source file="/opt/stack/data/nova/instances/016ae41d-b098-4126-ace7-3da00b40cb9c/disk"/>
Apr 12 16:07:59 user nova-compute[71874]:       <target dev="vda" bus="virtio"/>
Apr 12 16:07:59 user nova-compute[71874]:     </disk>
Apr 12 16:07:59 user nova-compute[71874]:     <interface type="ethernet">
Apr 12 16:07:59 user nova-compute[71874]:       <mac address="fa:16:3e:8b:30:9b"/>
Apr 12 16:07:59 user nova-compute[71874]:       <model type="virtio"/>
Apr 12 16:07:59 user nova-compute[71874]:       <mtu size="1442"/>
Apr 12 16:07:59 user nova-compute[71874]:       <target dev="tap6aeec58e-a9"/>
Apr 12 16:07:59 user nova-compute[71874]:     </interface>
Apr 12 16:07:59 user nova-compute[71874]:     <serial type="pty">
Apr 12 16:07:59 user nova-compute[71874]:       <log file="/opt/stack/data/nova/instances/016ae41d-b098-4126-ace7-3da00b40cb9c/console.log" append="off"/>
Apr 12 16:07:59 user nova-compute[71874]:     </serial>
Apr 12 16:07:59 user nova-compute[71874]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 16:07:59 user nova-compute[71874]:     <video>
Apr 12 16:07:59 user nova-compute[71874]:       <model type="virtio"/>
Apr 12 16:07:59 user nova-compute[71874]:     </video>
Apr 12 16:07:59 user nova-compute[71874]:     <rng model="virtio">
Apr 12 16:07:59 user nova-compute[71874]:       <backend model="random">/dev/urandom</backend>
Apr 12 16:07:59 user nova-compute[71874]:     </rng>
Apr 12 16:07:59 user nova-compute[71874]:     <controller type="usb" index="0" model="none"/>
Apr 12 16:07:59 user nova-compute[71874]:     <memballoon model="virtio">
Apr 12 16:07:59 user nova-compute[71874]:       <stats period="10"/>
Apr 12 16:07:59 user nova-compute[71874]:     </memballoon>
Apr 12 16:07:59 user nova-compute[71874]:   </devices>
Apr 12 16:07:59 user nova-compute[71874]: </domain>
Apr 12 16:07:59 user nova-compute[71874]:  {{(pid=71874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 16:07:59 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-3720f937-dabf-47ac-bd0b-7dee391810d2 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T16:07:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1903529512',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1903529512',id=26,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9210f81232304e179d3e09914a492442',ramdisk_id='',reservation_id='r-p2olcd7k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1443944578',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T16:07:57Z,user_data=None,user_id='73f9fa5bc22a4824b3cdcb8cf7bb380c',uuid=016ae41d-b098-4126-ace7-3da00b40cb9c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6aeec58e-a9ce-429d-a931-f860d7352c2e", "address": "fa:16:3e:8b:30:9b", "network": {"id": "b36306e0-04c5-4b1b-8022-05ff121c4e43", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1503204786-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9210f81232304e179d3e09914a492442", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6aeec58e-a9", "ovs_interfaceid": "6aeec58e-a9ce-429d-a931-f860d7352c2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 16:07:59 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-3720f937-dabf-47ac-bd0b-7dee391810d2 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Converting VIF {"id": "6aeec58e-a9ce-429d-a931-f860d7352c2e", "address": "fa:16:3e:8b:30:9b", "network": {"id": "b36306e0-04c5-4b1b-8022-05ff121c4e43", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1503204786-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9210f81232304e179d3e09914a492442", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6aeec58e-a9", "ovs_interfaceid": "6aeec58e-a9ce-429d-a931-f860d7352c2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:07:59 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-3720f937-dabf-47ac-bd0b-7dee391810d2 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:30:9b,bridge_name='br-int',has_traffic_filtering=True,id=6aeec58e-a9ce-429d-a931-f860d7352c2e,network=Network(b36306e0-04c5-4b1b-8022-05ff121c4e43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6aeec58e-a9') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:07:59 user nova-compute[71874]: DEBUG os_vif [None req-3720f937-dabf-47ac-bd0b-7dee391810d2 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:30:9b,bridge_name='br-int',has_traffic_filtering=True,id=6aeec58e-a9ce-429d-a931-f860d7352c2e,network=Network(b36306e0-04c5-4b1b-8022-05ff121c4e43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6aeec58e-a9') {{(pid=71874) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 16:07:59 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:07:59 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:07:59 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 16:07:59 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:07:59 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6aeec58e-a9, may_exist=True) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:07:59 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6aeec58e-a9, col_values=(('external_ids', {'iface-id': '6aeec58e-a9ce-429d-a931-f860d7352c2e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8b:30:9b', 'vm-uuid': '016ae41d-b098-4126-ace7-3da00b40cb9c'}),)) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:07:59 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:07:59 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:07:59 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:07:59 user nova-compute[71874]: INFO os_vif [None req-3720f937-dabf-47ac-bd0b-7dee391810d2 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:30:9b,bridge_name='br-int',has_traffic_filtering=True,id=6aeec58e-a9ce-429d-a931-f860d7352c2e,network=Network(b36306e0-04c5-4b1b-8022-05ff121c4e43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6aeec58e-a9')
Apr 12 16:07:59 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-3720f937-dabf-47ac-bd0b-7dee391810d2 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] No BDM found with device name vda, not building metadata. {{(pid=71874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 16:07:59 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-3720f937-dabf-47ac-bd0b-7dee391810d2 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] No VIF found with MAC fa:16:3e:8b:30:9b, not building metadata {{(pid=71874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 16:08:00 user nova-compute[71874]: DEBUG nova.compute.manager [req-33a2e7eb-4c36-44fd-a27c-108b924f68b6 req-546ef2f2-87cf-493f-9016-067f82878a5a service nova] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] Received event network-vif-plugged-746786a9-c889-4ece-bc5e-a905bf8deb5c {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:08:00 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-33a2e7eb-4c36-44fd-a27c-108b924f68b6 req-546ef2f2-87cf-493f-9016-067f82878a5a service nova] Acquiring lock "7f641c6b-b508-42a7-ae98-c2bfb841d798-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:08:00 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-33a2e7eb-4c36-44fd-a27c-108b924f68b6 req-546ef2f2-87cf-493f-9016-067f82878a5a service nova] Lock "7f641c6b-b508-42a7-ae98-c2bfb841d798-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:08:00 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-33a2e7eb-4c36-44fd-a27c-108b924f68b6 req-546ef2f2-87cf-493f-9016-067f82878a5a service nova] Lock "7f641c6b-b508-42a7-ae98-c2bfb841d798-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:08:00 user nova-compute[71874]: DEBUG nova.compute.manager [req-33a2e7eb-4c36-44fd-a27c-108b924f68b6 req-546ef2f2-87cf-493f-9016-067f82878a5a service nova] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] No waiting events found dispatching network-vif-plugged-746786a9-c889-4ece-bc5e-a905bf8deb5c {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:08:00 user nova-compute[71874]: WARNING nova.compute.manager [req-33a2e7eb-4c36-44fd-a27c-108b924f68b6 req-546ef2f2-87cf-493f-9016-067f82878a5a service nova] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] Received unexpected event network-vif-plugged-746786a9-c889-4ece-bc5e-a905bf8deb5c for instance with vm_state building and task_state spawning.
Apr 12 16:08:00 user nova-compute[71874]: DEBUG nova.virt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Emitting event <LifecycleEvent: 1681315680.472051, 7f641c6b-b508-42a7-ae98-c2bfb841d798 => Resumed> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:08:00 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] VM Resumed (Lifecycle Event)
Apr 12 16:08:00 user nova-compute[71874]: DEBUG nova.compute.manager [None req-a5d4f90e-c5b9-4263-b06f-5f7d81fe40b9 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] Instance event wait completed in 0 seconds for  {{(pid=71874) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 16:08:00 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-a5d4f90e-c5b9-4263-b06f-5f7d81fe40b9 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] Guest created on hypervisor {{(pid=71874) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 16:08:00 user nova-compute[71874]: DEBUG nova.network.neutron [req-bfbc0889-5606-4e59-8147-41f0726ded81 req-1fed4131-ee39-4052-b568-27aaa1556047 service nova] [instance: 016ae41d-b098-4126-ace7-3da00b40cb9c] Updated VIF entry in instance network info cache for port 6aeec58e-a9ce-429d-a931-f860d7352c2e. {{(pid=71874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 16:08:00 user nova-compute[71874]: DEBUG nova.network.neutron [req-bfbc0889-5606-4e59-8147-41f0726ded81 req-1fed4131-ee39-4052-b568-27aaa1556047 service nova] [instance: 016ae41d-b098-4126-ace7-3da00b40cb9c] Updating instance_info_cache with network_info: [{"id": "6aeec58e-a9ce-429d-a931-f860d7352c2e", "address": "fa:16:3e:8b:30:9b", "network": {"id": "b36306e0-04c5-4b1b-8022-05ff121c4e43", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1503204786-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9210f81232304e179d3e09914a492442", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6aeec58e-a9", "ovs_interfaceid": "6aeec58e-a9ce-429d-a931-f860d7352c2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:08:00 user nova-compute[71874]: INFO nova.virt.libvirt.driver [-] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] Instance spawned successfully.
Apr 12 16:08:00 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-a5d4f90e-c5b9-4263-b06f-5f7d81fe40b9 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 16:08:00 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:08:00 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 16:08:00 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-bfbc0889-5606-4e59-8147-41f0726ded81 req-1fed4131-ee39-4052-b568-27aaa1556047 service nova] Releasing lock "refresh_cache-016ae41d-b098-4126-ace7-3da00b40cb9c" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:08:00 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-a5d4f90e-c5b9-4263-b06f-5f7d81fe40b9 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] Found default for hw_cdrom_bus of ide {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:08:00 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-a5d4f90e-c5b9-4263-b06f-5f7d81fe40b9 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] Found default for hw_disk_bus of virtio {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:08:00 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-a5d4f90e-c5b9-4263-b06f-5f7d81fe40b9 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] Found default for hw_input_bus of None {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:08:00 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-a5d4f90e-c5b9-4263-b06f-5f7d81fe40b9 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] Found default for hw_pointer_model of None {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:08:00 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-a5d4f90e-c5b9-4263-b06f-5f7d81fe40b9 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] Found default for hw_video_model of virtio {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:08:00 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-a5d4f90e-c5b9-4263-b06f-5f7d81fe40b9 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] Found default for hw_vif_model of virtio {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:08:00 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 16:08:00 user nova-compute[71874]: DEBUG nova.virt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Emitting event <LifecycleEvent: 1681315680.4787374, 7f641c6b-b508-42a7-ae98-c2bfb841d798 => Started> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:08:00 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] VM Started (Lifecycle Event)
Apr 12 16:08:00 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:08:00 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 16:08:00 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 16:08:00 user nova-compute[71874]: INFO nova.compute.manager [None req-a5d4f90e-c5b9-4263-b06f-5f7d81fe40b9 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] Took 7.11 seconds to spawn the instance on the hypervisor.
Apr 12 16:08:00 user nova-compute[71874]: DEBUG nova.compute.manager [None req-a5d4f90e-c5b9-4263-b06f-5f7d81fe40b9 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:08:00 user nova-compute[71874]: INFO nova.compute.manager [None req-a5d4f90e-c5b9-4263-b06f-5f7d81fe40b9 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] Took 8.10 seconds to build instance.
Apr 12 16:08:00 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-a5d4f90e-c5b9-4263-b06f-5f7d81fe40b9 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "7f641c6b-b508-42a7-ae98-c2bfb841d798" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.216s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:08:01 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:08:01 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:08:01 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:08:01 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:08:01 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:08:02 user nova-compute[71874]: DEBUG nova.compute.manager [req-de5e8200-a756-427f-bbc9-9f89c958175d req-34ff65a3-ddbb-4801-9c25-9987cdde0ce8 service nova] [instance: 016ae41d-b098-4126-ace7-3da00b40cb9c] Received event network-vif-plugged-6aeec58e-a9ce-429d-a931-f860d7352c2e {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:08:02 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-de5e8200-a756-427f-bbc9-9f89c958175d req-34ff65a3-ddbb-4801-9c25-9987cdde0ce8 service nova] Acquiring lock "016ae41d-b098-4126-ace7-3da00b40cb9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:08:02 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-de5e8200-a756-427f-bbc9-9f89c958175d req-34ff65a3-ddbb-4801-9c25-9987cdde0ce8 service nova] Lock "016ae41d-b098-4126-ace7-3da00b40cb9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:08:02 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-de5e8200-a756-427f-bbc9-9f89c958175d req-34ff65a3-ddbb-4801-9c25-9987cdde0ce8 service nova] Lock "016ae41d-b098-4126-ace7-3da00b40cb9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:08:02 user nova-compute[71874]: DEBUG nova.compute.manager [req-de5e8200-a756-427f-bbc9-9f89c958175d req-34ff65a3-ddbb-4801-9c25-9987cdde0ce8 service nova] [instance: 016ae41d-b098-4126-ace7-3da00b40cb9c] No waiting events found dispatching network-vif-plugged-6aeec58e-a9ce-429d-a931-f860d7352c2e {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:08:02 user nova-compute[71874]: WARNING nova.compute.manager [req-de5e8200-a756-427f-bbc9-9f89c958175d req-34ff65a3-ddbb-4801-9c25-9987cdde0ce8 service nova] [instance: 016ae41d-b098-4126-ace7-3da00b40cb9c] Received unexpected event network-vif-plugged-6aeec58e-a9ce-429d-a931-f860d7352c2e for instance with vm_state building and task_state spawning.
Apr 12 16:08:02 user nova-compute[71874]: DEBUG nova.compute.manager [req-de5e8200-a756-427f-bbc9-9f89c958175d req-34ff65a3-ddbb-4801-9c25-9987cdde0ce8 service nova] [instance: 016ae41d-b098-4126-ace7-3da00b40cb9c] Received event network-vif-plugged-6aeec58e-a9ce-429d-a931-f860d7352c2e {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:08:02 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-de5e8200-a756-427f-bbc9-9f89c958175d req-34ff65a3-ddbb-4801-9c25-9987cdde0ce8 service nova] Acquiring lock "016ae41d-b098-4126-ace7-3da00b40cb9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:08:02 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-de5e8200-a756-427f-bbc9-9f89c958175d req-34ff65a3-ddbb-4801-9c25-9987cdde0ce8 service nova] Lock "016ae41d-b098-4126-ace7-3da00b40cb9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:08:02 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-de5e8200-a756-427f-bbc9-9f89c958175d req-34ff65a3-ddbb-4801-9c25-9987cdde0ce8 service nova] Lock "016ae41d-b098-4126-ace7-3da00b40cb9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:08:02 user nova-compute[71874]: DEBUG nova.compute.manager [req-de5e8200-a756-427f-bbc9-9f89c958175d req-34ff65a3-ddbb-4801-9c25-9987cdde0ce8 service nova] [instance: 016ae41d-b098-4126-ace7-3da00b40cb9c] No waiting events found dispatching network-vif-plugged-6aeec58e-a9ce-429d-a931-f860d7352c2e {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:08:02 user nova-compute[71874]: WARNING nova.compute.manager [req-de5e8200-a756-427f-bbc9-9f89c958175d req-34ff65a3-ddbb-4801-9c25-9987cdde0ce8 service nova] [instance: 016ae41d-b098-4126-ace7-3da00b40cb9c] Received unexpected event network-vif-plugged-6aeec58e-a9ce-429d-a931-f860d7352c2e for instance with vm_state building and task_state spawning.
Apr 12 16:08:02 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:08:02 user nova-compute[71874]: DEBUG nova.compute.manager [req-5b2bff57-de44-4175-a756-ffdaa8711c7a req-514b7f76-26a6-4ba0-9b12-1f9433309c9b service nova] [instance: 357dd90d-8c53-4193-ad64-edfa894116cf] Received event network-changed-94db3bc9-9ecc-4f15-8105-4abb2ff9d1e5 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:08:02 user nova-compute[71874]: DEBUG nova.compute.manager [req-5b2bff57-de44-4175-a756-ffdaa8711c7a req-514b7f76-26a6-4ba0-9b12-1f9433309c9b service nova] [instance: 357dd90d-8c53-4193-ad64-edfa894116cf] Refreshing instance network info cache due to event network-changed-94db3bc9-9ecc-4f15-8105-4abb2ff9d1e5. {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 16:08:02 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-5b2bff57-de44-4175-a756-ffdaa8711c7a req-514b7f76-26a6-4ba0-9b12-1f9433309c9b service nova] Acquiring lock "refresh_cache-357dd90d-8c53-4193-ad64-edfa894116cf" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:08:02 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-5b2bff57-de44-4175-a756-ffdaa8711c7a req-514b7f76-26a6-4ba0-9b12-1f9433309c9b service nova] Acquired lock "refresh_cache-357dd90d-8c53-4193-ad64-edfa894116cf" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:08:02 user nova-compute[71874]: DEBUG nova.network.neutron [req-5b2bff57-de44-4175-a756-ffdaa8711c7a req-514b7f76-26a6-4ba0-9b12-1f9433309c9b service nova] [instance: 357dd90d-8c53-4193-ad64-edfa894116cf] Refreshing network info cache for port 94db3bc9-9ecc-4f15-8105-4abb2ff9d1e5 {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 16:08:03 user nova-compute[71874]: DEBUG nova.network.neutron [req-5b2bff57-de44-4175-a756-ffdaa8711c7a req-514b7f76-26a6-4ba0-9b12-1f9433309c9b service nova] [instance: 357dd90d-8c53-4193-ad64-edfa894116cf] Updated VIF entry in instance network info cache for port 94db3bc9-9ecc-4f15-8105-4abb2ff9d1e5. {{(pid=71874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 16:08:03 user nova-compute[71874]: DEBUG nova.network.neutron [req-5b2bff57-de44-4175-a756-ffdaa8711c7a req-514b7f76-26a6-4ba0-9b12-1f9433309c9b service nova] [instance: 357dd90d-8c53-4193-ad64-edfa894116cf] Updating instance_info_cache with network_info: [{"id": "94db3bc9-9ecc-4f15-8105-4abb2ff9d1e5", "address": "fa:16:3e:54:6b:70", "network": {"id": "e71b9966-9a95-4f66-b3b1-36b05d05853c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-310205564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28d940eae5394293b87cfced45911ab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94db3bc9-9e", "ovs_interfaceid": "94db3bc9-9ecc-4f15-8105-4abb2ff9d1e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:08:03 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-5b2bff57-de44-4175-a756-ffdaa8711c7a req-514b7f76-26a6-4ba0-9b12-1f9433309c9b service nova] Releasing lock "refresh_cache-357dd90d-8c53-4193-ad64-edfa894116cf" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:08:03 user nova-compute[71874]: DEBUG nova.virt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Emitting event <LifecycleEvent: 1681315683.977947, 016ae41d-b098-4126-ace7-3da00b40cb9c => Resumed> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:08:03 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 016ae41d-b098-4126-ace7-3da00b40cb9c] VM Resumed (Lifecycle Event)
Apr 12 16:08:03 user nova-compute[71874]: DEBUG nova.compute.manager [None req-3720f937-dabf-47ac-bd0b-7dee391810d2 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 016ae41d-b098-4126-ace7-3da00b40cb9c] Instance event wait completed in 0 seconds for  {{(pid=71874) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 16:08:03 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-3720f937-dabf-47ac-bd0b-7dee391810d2 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 016ae41d-b098-4126-ace7-3da00b40cb9c] Guest created on hypervisor {{(pid=71874) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 16:08:03 user nova-compute[71874]: INFO nova.virt.libvirt.driver [-] [instance: 016ae41d-b098-4126-ace7-3da00b40cb9c] Instance spawned successfully.
Apr 12 16:08:03 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-3720f937-dabf-47ac-bd0b-7dee391810d2 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 016ae41d-b098-4126-ace7-3da00b40cb9c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 16:08:04 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 016ae41d-b098-4126-ace7-3da00b40cb9c] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:08:04 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 016ae41d-b098-4126-ace7-3da00b40cb9c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 16:08:04 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-3720f937-dabf-47ac-bd0b-7dee391810d2 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 016ae41d-b098-4126-ace7-3da00b40cb9c] Found default for hw_cdrom_bus of ide {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:08:04 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-3720f937-dabf-47ac-bd0b-7dee391810d2 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 016ae41d-b098-4126-ace7-3da00b40cb9c] Found default for hw_disk_bus of virtio {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:08:04 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-3720f937-dabf-47ac-bd0b-7dee391810d2 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 016ae41d-b098-4126-ace7-3da00b40cb9c] Found default for hw_input_bus of None {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:08:04 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-3720f937-dabf-47ac-bd0b-7dee391810d2 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 016ae41d-b098-4126-ace7-3da00b40cb9c] Found default for hw_pointer_model of None {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:08:04 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-3720f937-dabf-47ac-bd0b-7dee391810d2 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 016ae41d-b098-4126-ace7-3da00b40cb9c] Found default for hw_video_model of virtio {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:08:04 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-3720f937-dabf-47ac-bd0b-7dee391810d2 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 016ae41d-b098-4126-ace7-3da00b40cb9c] Found default for hw_vif_model of virtio {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:08:04 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 016ae41d-b098-4126-ace7-3da00b40cb9c] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 16:08:04 user nova-compute[71874]: DEBUG nova.virt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Emitting event <LifecycleEvent: 1681315683.9809134, 016ae41d-b098-4126-ace7-3da00b40cb9c => Started> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:08:04 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 016ae41d-b098-4126-ace7-3da00b40cb9c] VM Started (Lifecycle Event)
Apr 12 16:08:04 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 016ae41d-b098-4126-ace7-3da00b40cb9c] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:08:04 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 016ae41d-b098-4126-ace7-3da00b40cb9c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 16:08:04 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 016ae41d-b098-4126-ace7-3da00b40cb9c] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 16:08:04 user nova-compute[71874]: INFO nova.compute.manager [None req-3720f937-dabf-47ac-bd0b-7dee391810d2 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 016ae41d-b098-4126-ace7-3da00b40cb9c] Took 6.55 seconds to spawn the instance on the hypervisor.
Apr 12 16:08:04 user nova-compute[71874]: DEBUG nova.compute.manager [None req-3720f937-dabf-47ac-bd0b-7dee391810d2 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 016ae41d-b098-4126-ace7-3da00b40cb9c] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:08:04 user nova-compute[71874]: INFO nova.compute.manager [None req-3720f937-dabf-47ac-bd0b-7dee391810d2 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 016ae41d-b098-4126-ace7-3da00b40cb9c] Took 7.57 seconds to build instance.
Apr 12 16:08:04 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-3720f937-dabf-47ac-bd0b-7dee391810d2 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "016ae41d-b098-4126-ace7-3da00b40cb9c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.687s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:08:04 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:08:05 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-a17d3732-4066-4cbe-a74b-444bd3bf9e94 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "357dd90d-8c53-4193-ad64-edfa894116cf" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:08:05 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-a17d3732-4066-4cbe-a74b-444bd3bf9e94 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "357dd90d-8c53-4193-ad64-edfa894116cf" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:08:05 user nova-compute[71874]: DEBUG nova.objects.instance [None req-a17d3732-4066-4cbe-a74b-444bd3bf9e94 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lazy-loading 'flavor' on Instance uuid 357dd90d-8c53-4193-ad64-edfa894116cf {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:08:05 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-a17d3732-4066-4cbe-a74b-444bd3bf9e94 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "357dd90d-8c53-4193-ad64-edfa894116cf" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.076s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:08:05 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-a17d3732-4066-4cbe-a74b-444bd3bf9e94 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "357dd90d-8c53-4193-ad64-edfa894116cf" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:08:05 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-a17d3732-4066-4cbe-a74b-444bd3bf9e94 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "357dd90d-8c53-4193-ad64-edfa894116cf" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:08:05 user nova-compute[71874]: INFO nova.compute.manager [None req-a17d3732-4066-4cbe-a74b-444bd3bf9e94 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: 357dd90d-8c53-4193-ad64-edfa894116cf] Attaching volume 689dae55-b0ff-4639-85a0-96a3a0425490 to /dev/vdb
Apr 12 16:08:05 user nova-compute[71874]: DEBUG os_brick.utils [None req-a17d3732-4066-4cbe-a74b-444bd3bf9e94 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:08:05 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:08:05 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:08:05 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d486a1e-d87b-4a38-92c9-c98ef8482088]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:61a48d4489d2\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:08:05 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:08:05 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:08:05 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[156f710e-93fb-44d2-8dd1-37d5855792db]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:08:05 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:08:06 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:08:06 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[07a40813-348d-4766-9ba7-203c0af58d71]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:08:06 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[564ee526-0eed-497e-a5fd-f26a15cba314]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:08:06 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-a17d3732-4066-4cbe-a74b-444bd3bf9e94 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Running cmd (subprocess): nvme version {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:08:06 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-a17d3732-4066-4cbe-a74b-444bd3bf9e94 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] 'nvme version' failed. Not Retrying. {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 16:08:06 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a17d3732-4066-4cbe-a74b-444bd3bf9e94 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] nvme not present on system {{(pid=71874) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 16:08:06 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:08:06 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 16:08:06 user nova-compute[71874]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 16:08:06 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6a499f8-f18f-4bca-821b-98bc75926dee]: (4, '') {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:08:06 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.lightos [None req-a17d3732-4066-4cbe-a74b-444bd3bf9e94 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71874) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 16:08:06 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.lightos [None req-a17d3732-4066-4cbe-a74b-444bd3bf9e94 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71874) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 16:08:06 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.lightos [None req-a17d3732-4066-4cbe-a74b-444bd3bf9e94 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] LIGHTOS: no hostnqn found. {{(pid=71874) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 16:08:06 user nova-compute[71874]: DEBUG os_brick.utils [None req-a17d3732-4066-4cbe-a74b-444bd3bf9e94 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:61a48d4489d2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:08:06 user nova-compute[71874]: DEBUG nova.virt.block_device [None req-a17d3732-4066-4cbe-a74b-444bd3bf9e94 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: 357dd90d-8c53-4193-ad64-edfa894116cf] Updating existing volume attachment record: 7ddd9cea-7556-42af-9f75-d338f352579a {{(pid=71874) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 16:08:07 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:08:08 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-2a8014ee-185e-43a2-9fe9-7b3942cac4ae tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:08:08 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-2a8014ee-185e-43a2-9fe9-7b3942cac4ae tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:08:08 user nova-compute[71874]: DEBUG nova.objects.instance [None req-2a8014ee-185e-43a2-9fe9-7b3942cac4ae tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lazy-loading 'flavor' on Instance uuid dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:08:08 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-2a8014ee-185e-43a2-9fe9-7b3942cac4ae tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.082s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:08:08 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-2a8014ee-185e-43a2-9fe9-7b3942cac4ae tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:08:08 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-2a8014ee-185e-43a2-9fe9-7b3942cac4ae tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:08:08 user nova-compute[71874]: INFO nova.compute.manager [None req-2a8014ee-185e-43a2-9fe9-7b3942cac4ae tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Attaching volume 9baf883b-de18-43f0-a9d8-fc850bd83297 to /dev/vdb
Apr 12 16:08:08 user nova-compute[71874]: DEBUG os_brick.utils [None req-2a8014ee-185e-43a2-9fe9-7b3942cac4ae tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:08:08 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:08:08 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:08:08 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[61dd558a-ce5a-4212-8a34-3e60a4a4a88b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:61a48d4489d2\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:08:08 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:08:08 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:08:08 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[3475cedd-2679-4c84-b052-805e4ac51563]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:08:08 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:08:08 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:08:08 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fae6b89-c8be-45ec-aab6-cc723d864ed3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:08:08 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[63d69e84-86be-4d4f-880c-08ddc1f966c6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:08:08 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-2a8014ee-185e-43a2-9fe9-7b3942cac4ae tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Running cmd (subprocess): nvme version {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:08:08 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-2a8014ee-185e-43a2-9fe9-7b3942cac4ae tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] 'nvme version' failed. Not Retrying. {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 16:08:08 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2a8014ee-185e-43a2-9fe9-7b3942cac4ae tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] nvme not present on system {{(pid=71874) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 16:08:08 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:08:08 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 16:08:08 user nova-compute[71874]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 16:08:08 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbf7bd92-58f5-4567-8ad8-8fc7a83835a4]: (4, '') {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:08:08 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.lightos [None req-2a8014ee-185e-43a2-9fe9-7b3942cac4ae tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71874) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 16:08:08 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.lightos [None req-2a8014ee-185e-43a2-9fe9-7b3942cac4ae tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71874) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 16:08:08 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.lightos [None req-2a8014ee-185e-43a2-9fe9-7b3942cac4ae tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] LIGHTOS: no hostnqn found. {{(pid=71874) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 16:08:08 user nova-compute[71874]: DEBUG os_brick.utils [None req-2a8014ee-185e-43a2-9fe9-7b3942cac4ae tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:61a48d4489d2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:08:08 user nova-compute[71874]: DEBUG nova.virt.block_device [None req-2a8014ee-185e-43a2-9fe9-7b3942cac4ae tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Updating existing volume attachment record: f0fd44e1-094c-486a-a3a0-6ba5245d5c3c {{(pid=71874) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 16:08:09 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:08:09 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:08:10 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a17d3732-4066-4cbe-a74b-444bd3bf9e94 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: 357dd90d-8c53-4193-ad64-edfa894116cf] Calling os-brick to attach iSCSI Volume {{(pid=71874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 16:08:10 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-a17d3732-4066-4cbe-a74b-444bd3bf9e94 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3c0216320>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:689dae55-b0ff-4639-85a0-96a3a0425490', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ECUitrzx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:08:10 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-a17d3732-4066-4cbe-a74b-444bd3bf9e94 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:08:10 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-a17d3732-4066-4cbe-a74b-444bd3bf9e94 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:08:10 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-a17d3732-4066-4cbe-a74b-444bd3bf9e94 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:08:10 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-a17d3732-4066-4cbe-a74b-444bd3bf9e94 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:08:10 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-a17d3732-4066-4cbe-a74b-444bd3bf9e94 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:689dae55-b0ff-4639-85a0-96a3a0425490" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:08:10 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-a17d3732-4066-4cbe-a74b-444bd3bf9e94 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:689dae55-b0ff-4639-85a0-96a3a0425490" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:08:10 user nova-compute[71874]: INFO os_brick.initiator.connectors.iscsi [None req-a17d3732-4066-4cbe-a74b-444bd3bf9e94 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 16:08:10 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:689dae55-b0ff-4639-85a0-96a3a0425490 -p 172.16.0.220:3260 {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:08:10 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:689dae55-b0ff-4639-85a0-96a3a0425490 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:08:10 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[35f199b7-0eaf-44b1-bd12-ec00438e2c79]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:08:10 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-a17d3732-4066-4cbe-a74b-444bd3bf9e94 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 16:08:10 user nova-compute[71874]:  {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:08:10 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:689dae55-b0ff-4639-85a0-96a3a0425490 -p 172.16.0.220:3260 --interface default --op new {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:08:10 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:689dae55-b0ff-4639-85a0-96a3a0425490 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:08:10 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d3c98e7-c500-454c-aeb7-d06e0a5f1a86]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:689dae55-b0ff-4639-85a0-96a3a0425490] added\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:08:10 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-a17d3732-4066-4cbe-a74b-444bd3bf9e94 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:689dae55-b0ff-4639-85a0-96a3a0425490] added
Apr 12 16:08:10 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:08:10 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:689dae55-b0ff-4639-85a0-96a3a0425490 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:08:10 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:689dae55-b0ff-4639-85a0-96a3a0425490 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:08:10 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ca930e4-b35e-4fd2-93b5-9e66f101e8a3]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:08:10 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-a17d3732-4066-4cbe-a74b-444bd3bf9e94 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:08:10 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:689dae55-b0ff-4639-85a0-96a3a0425490 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:08:10 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:689dae55-b0ff-4639-85a0-96a3a0425490 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:08:10 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[4df9c721-3c8f-4411-8b1f-3253ec24e7c3]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:08:10 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-a17d3732-4066-4cbe-a74b-444bd3bf9e94 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:08:10 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:689dae55-b0ff-4639-85a0-96a3a0425490 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ECUitrzx {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:08:10 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:689dae55-b0ff-4639-85a0-96a3a0425490 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ECUitrzx" returned: 0 in 0.022s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:08:10 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[db2d6107-a640-4ebd-a16d-9071c4d7e34d]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:08:10 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-a17d3732-4066-4cbe-a74b-444bd3bf9e94 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ECUitrzx'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:08:10 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:689dae55-b0ff-4639-85a0-96a3a0425490 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:08:10 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:689dae55-b0ff-4639-85a0-96a3a0425490 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:08:10 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[4513968a-133c-4b12-92c2-05db26bcff20]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:08:10 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-a17d3732-4066-4cbe-a74b-444bd3bf9e94 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:08:10 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:08:10 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:08:10 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd71d7c7-4eb6-4d78-9443-a38d2270380a]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cc863d9-b797-4b5b-b8ce-30ebe55b9519 (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:08:10 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-a17d3732-4066-4cbe-a74b-444bd3bf9e94 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:08:10 user nova-compute[71874]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cc863d9-b797-4b5b-b8ce-30ebe55b9519 (non-flash)
Apr 12 16:08:10 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:08:10 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-a17d3732-4066-4cbe-a74b-444bd3bf9e94 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:08:10 user nova-compute[71874]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cc863d9-b797-4b5b-b8ce-30ebe55b9519 (non-flash)
Apr 12 16:08:10 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:08:10 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:689dae55-b0ff-4639-85a0-96a3a0425490 -p 172.16.0.220:3260 --login {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:08:10 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:689dae55-b0ff-4639-85a0-96a3a0425490 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:08:10 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e826ecc-1eef-4a2e-9ba4-563658dc8858]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:689dae55-b0ff-4639-85a0-96a3a0425490, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:689dae55-b0ff-4639-85a0-96a3a0425490, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:08:10 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-a17d3732-4066-4cbe-a74b-444bd3bf9e94 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:689dae55-b0ff-4639-85a0-96a3a0425490, portal: 172.16.0.220,3260]
Apr 12 16:08:10 user nova-compute[71874]: Login to [iface: default, target: iqn.2010-10.org.openstack:689dae55-b0ff-4639-85a0-96a3a0425490, portal: 172.16.0.220,3260] successful.
Apr 12 16:08:10 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:08:10 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:689dae55-b0ff-4639-85a0-96a3a0425490 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:08:10 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:689dae55-b0ff-4639-85a0-96a3a0425490 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:08:10 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ad41ccb-d2f0-4550-9087-0bd469bca7e9]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:08:11 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-a17d3732-4066-4cbe-a74b-444bd3bf9e94 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:08:11 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:08:11 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:08:11 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[371b5703-d51f-40e2-8055-6e0265c02784]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cc863d9-b797-4b5b-b8ce-30ebe55b9519 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:689dae55-b0ff-4639-85a0-96a3a0425490 (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:08:11 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-a17d3732-4066-4cbe-a74b-444bd3bf9e94 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:08:11 user nova-compute[71874]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cc863d9-b797-4b5b-b8ce-30ebe55b9519 (non-flash)
Apr 12 16:08:11 user nova-compute[71874]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:689dae55-b0ff-4639-85a0-96a3a0425490 (non-flash)
Apr 12 16:08:11 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:08:11 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-a17d3732-4066-4cbe-a74b-444bd3bf9e94 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:08:11 user nova-compute[71874]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cc863d9-b797-4b5b-b8ce-30ebe55b9519 (non-flash)
Apr 12 16:08:11 user nova-compute[71874]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:689dae55-b0ff-4639-85a0-96a3a0425490 (non-flash)
Apr 12 16:08:11 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:08:11 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-a17d3732-4066-4cbe-a74b-444bd3bf9e94 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:689dae55-b0ff-4639-85a0-96a3a0425490" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.334s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:08:11 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-a17d3732-4066-4cbe-a74b-444bd3bf9e94 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Connected to 172.16.0.220:3260 {{(pid=71874) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 16:08:11 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-a17d3732-4066-4cbe-a74b-444bd3bf9e94 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] HCTL ('35', '-', '-', 0) found on session 24 with lun 0 {{(pid=71874) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 16:08:11 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-a17d3732-4066-4cbe-a74b-444bd3bf9e94 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71874) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 16:08:11 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:08:11 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:08:11 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e130a6f-5f76-4acc-bfb0-d3f819ebdf4f]: (4, ('- - 0', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:08:11 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-a17d3732-4066-4cbe-a74b-444bd3bf9e94 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Searching for a device in session 24 and hctl ['35', '*', '*', 0] yield: None {{(pid=71874) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 16:08:11 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:08:12 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-a17d3732-4066-4cbe-a74b-444bd3bf9e94 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Searching for a device in session 24 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71874) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 16:08:12 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-a17d3732-4066-4cbe-a74b-444bd3bf9e94 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:689dae55-b0ff-4639-85a0-96a3a0425490', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ECUitrzx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71874) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 16:08:12 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-a17d3732-4066-4cbe-a74b-444bd3bf9e94 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.363s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:08:12 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-a17d3732-4066-4cbe-a74b-444bd3bf9e94 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] <== connect_volume: return (1365ms) {'type': 'block', 'scsi_wwn': '23438613961393337', 'path': '/dev/sdd'} {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:08:12 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a17d3732-4066-4cbe-a74b-444bd3bf9e94 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: 357dd90d-8c53-4193-ad64-edfa894116cf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23438613961393337', 'path': '/dev/sdd'} {{(pid=71874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 16:08:12 user nova-compute[71874]: DEBUG nova.objects.instance [None req-a17d3732-4066-4cbe-a74b-444bd3bf9e94 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lazy-loading 'flavor' on Instance uuid 357dd90d-8c53-4193-ad64-edfa894116cf {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:08:12 user nova-compute[71874]: DEBUG nova.virt.libvirt.guest [None req-a17d3732-4066-4cbe-a74b-444bd3bf9e94 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 16:08:12 user nova-compute[71874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 16:08:12 user nova-compute[71874]:   <source dev="/dev/sdd"/>
Apr 12 16:08:12 user nova-compute[71874]:   <target dev="vdb" bus="virtio"/>
Apr 12 16:08:12 user nova-compute[71874]:   <serial>689dae55-b0ff-4639-85a0-96a3a0425490</serial>
Apr 12 16:08:12 user nova-compute[71874]: </disk>
Apr 12 16:08:12 user nova-compute[71874]:  {{(pid=71874) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 16:08:12 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-a17d3732-4066-4cbe-a74b-444bd3bf9e94 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] No BDM found with device name vda, not building metadata. {{(pid=71874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 16:08:12 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-a17d3732-4066-4cbe-a74b-444bd3bf9e94 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 16:08:12 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-a17d3732-4066-4cbe-a74b-444bd3bf9e94 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] No VIF found with MAC fa:16:3e:54:6b:70, not building metadata {{(pid=71874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 16:08:12 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:08:12 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-a17d3732-4066-4cbe-a74b-444bd3bf9e94 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "357dd90d-8c53-4193-ad64-edfa894116cf" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.026s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:08:13 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a8014ee-185e-43a2-9fe9-7b3942cac4ae tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Calling os-brick to attach iSCSI Volume {{(pid=71874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 16:08:13 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a8014ee-185e-43a2-9fe9-7b3942cac4ae tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3c0216320>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RGWZNvlY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:08:13 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-2a8014ee-185e-43a2-9fe9-7b3942cac4ae tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:08:13 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-2a8014ee-185e-43a2-9fe9-7b3942cac4ae tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:08:13 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-2a8014ee-185e-43a2-9fe9-7b3942cac4ae tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:08:13 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-2a8014ee-185e-43a2-9fe9-7b3942cac4ae tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:08:13 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-2a8014ee-185e-43a2-9fe9-7b3942cac4ae tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:08:13 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-2a8014ee-185e-43a2-9fe9-7b3942cac4ae tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:08:13 user nova-compute[71874]: INFO os_brick.initiator.connectors.iscsi [None req-2a8014ee-185e-43a2-9fe9-7b3942cac4ae tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 16:08:13 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 -p 172.16.0.220:3260 {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:08:13 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:08:13 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[9159528c-e44e-4687-87ad-c5173fb07834]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:08:13 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a8014ee-185e-43a2-9fe9-7b3942cac4ae tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 16:08:13 user nova-compute[71874]:  {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:08:13 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 -p 172.16.0.220:3260 --interface default --op new {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:08:13 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:08:13 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4aff1d4-57b1-4c24-a4d9-ac0a819c22b1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297] added\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:08:13 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a8014ee-185e-43a2-9fe9-7b3942cac4ae tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297] added
Apr 12 16:08:13 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:08:13 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:08:13 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:08:13 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b5a703f-e8db-411a-b8a3-09c005bf1327]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:08:13 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a8014ee-185e-43a2-9fe9-7b3942cac4ae tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:08:13 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:08:13 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:08:13 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfbbe577-f6d4-40d8-adca-35ee858886aa]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:08:13 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a8014ee-185e-43a2-9fe9-7b3942cac4ae tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:08:13 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RGWZNvlY {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:08:13 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RGWZNvlY" returned: 0 in 0.020s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:08:13 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[d65a74cd-9be0-4829-93ca-53f8f90815ef]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:08:13 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a8014ee-185e-43a2-9fe9-7b3942cac4ae tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RGWZNvlY'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:08:13 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:08:13 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:08:13 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9b02b03-19bf-4991-8b88-4ea3b03ece47]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:08:13 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a8014ee-185e-43a2-9fe9-7b3942cac4ae tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:08:13 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:08:13 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:08:13 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[245f9c8e-f915-40e9-b392-9f7349a5b5c1]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cc863d9-b797-4b5b-b8ce-30ebe55b9519 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:689dae55-b0ff-4639-85a0-96a3a0425490 (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:08:13 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a8014ee-185e-43a2-9fe9-7b3942cac4ae tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:08:13 user nova-compute[71874]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cc863d9-b797-4b5b-b8ce-30ebe55b9519 (non-flash)
Apr 12 16:08:13 user nova-compute[71874]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:689dae55-b0ff-4639-85a0-96a3a0425490 (non-flash)
Apr 12 16:08:13 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:08:13 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a8014ee-185e-43a2-9fe9-7b3942cac4ae tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:08:13 user nova-compute[71874]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cc863d9-b797-4b5b-b8ce-30ebe55b9519 (non-flash)
Apr 12 16:08:13 user nova-compute[71874]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:689dae55-b0ff-4639-85a0-96a3a0425490 (non-flash)
Apr 12 16:08:13 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:08:13 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 -p 172.16.0.220:3260 --login {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:08:13 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:08:13 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[742f138d-5fec-442f-a443-0b5eca8ed880]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:08:13 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a8014ee-185e-43a2-9fe9-7b3942cac4ae tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297, portal: 172.16.0.220,3260]
Apr 12 16:08:13 user nova-compute[71874]: Login to [iface: default, target: iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297, portal: 172.16.0.220,3260] successful.
Apr 12 16:08:13 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:08:13 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:08:13 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:08:13 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[aee3bfd1-bdae-4755-890a-714fb96cfec3]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:08:13 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a8014ee-185e-43a2-9fe9-7b3942cac4ae tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:08:13 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:08:13 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:08:13 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3dfc689-df2a-4f0f-953e-5b2cda61f2a4]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cc863d9-b797-4b5b-b8ce-30ebe55b9519 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:689dae55-b0ff-4639-85a0-96a3a0425490 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:08:13 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a8014ee-185e-43a2-9fe9-7b3942cac4ae tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:08:13 user nova-compute[71874]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cc863d9-b797-4b5b-b8ce-30ebe55b9519 (non-flash)
Apr 12 16:08:13 user nova-compute[71874]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:689dae55-b0ff-4639-85a0-96a3a0425490 (non-flash)
Apr 12 16:08:13 user nova-compute[71874]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 (non-flash)
Apr 12 16:08:13 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:08:13 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a8014ee-185e-43a2-9fe9-7b3942cac4ae tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:08:13 user nova-compute[71874]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cc863d9-b797-4b5b-b8ce-30ebe55b9519 (non-flash)
Apr 12 16:08:13 user nova-compute[71874]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:689dae55-b0ff-4639-85a0-96a3a0425490 (non-flash)
Apr 12 16:08:13 user nova-compute[71874]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 (non-flash)
Apr 12 16:08:13 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:08:13 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-2a8014ee-185e-43a2-9fe9-7b3942cac4ae tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.346s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:08:13 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a8014ee-185e-43a2-9fe9-7b3942cac4ae tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Connected to 172.16.0.220:3260 {{(pid=71874) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 16:08:13 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-2a8014ee-185e-43a2-9fe9-7b3942cac4ae tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] HCTL ('36', '-', '-', 0) found on session 25 with lun 0 {{(pid=71874) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 16:08:13 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-2a8014ee-185e-43a2-9fe9-7b3942cac4ae tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71874) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 16:08:13 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:08:13 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:08:13 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b360fe6-e866-4305-bc2a-0fd36086e641]: (4, ('- - 0', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:08:13 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-2a8014ee-185e-43a2-9fe9-7b3942cac4ae tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Searching for a device in session 25 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71874) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 16:08:13 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a8014ee-185e-43a2-9fe9-7b3942cac4ae tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RGWZNvlY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71874) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 16:08:13 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-fbdc18cd-3ae4-4726-a182-1cfe749bcebc tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "357dd90d-8c53-4193-ad64-edfa894116cf" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:08:13 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-fbdc18cd-3ae4-4726-a182-1cfe749bcebc tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "357dd90d-8c53-4193-ad64-edfa894116cf" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:08:13 user nova-compute[71874]: INFO nova.compute.manager [None req-fbdc18cd-3ae4-4726-a182-1cfe749bcebc tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: 357dd90d-8c53-4193-ad64-edfa894116cf] Detaching volume 689dae55-b0ff-4639-85a0-96a3a0425490
Apr 12 16:08:14 user nova-compute[71874]: INFO nova.virt.block_device [None req-fbdc18cd-3ae4-4726-a182-1cfe749bcebc tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: 357dd90d-8c53-4193-ad64-edfa894116cf] Attempting to driver detach volume 689dae55-b0ff-4639-85a0-96a3a0425490 from mountpoint /dev/vdb
Apr 12 16:08:14 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-fbdc18cd-3ae4-4726-a182-1cfe749bcebc tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Attempting to detach device vdb from instance 357dd90d-8c53-4193-ad64-edfa894116cf from the persistent domain config. {{(pid=71874) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 16:08:14 user nova-compute[71874]: DEBUG nova.virt.libvirt.guest [None req-fbdc18cd-3ae4-4726-a182-1cfe749bcebc tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 16:08:14 user nova-compute[71874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 16:08:14 user nova-compute[71874]:   <source dev="/dev/sdd"/>
Apr 12 16:08:14 user nova-compute[71874]:   <target dev="vdb" bus="virtio"/>
Apr 12 16:08:14 user nova-compute[71874]:   <serial>689dae55-b0ff-4639-85a0-96a3a0425490</serial>
Apr 12 16:08:14 user nova-compute[71874]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 16:08:14 user nova-compute[71874]: </disk>
Apr 12 16:08:14 user nova-compute[71874]:  {{(pid=71874) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 16:08:14 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-fbdc18cd-3ae4-4726-a182-1cfe749bcebc tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Successfully detached device vdb from instance 357dd90d-8c53-4193-ad64-edfa894116cf from the persistent domain config.
Apr 12 16:08:14 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-fbdc18cd-3ae4-4726-a182-1cfe749bcebc tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 357dd90d-8c53-4193-ad64-edfa894116cf from the live domain config. {{(pid=71874) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 16:08:14 user nova-compute[71874]: DEBUG nova.virt.libvirt.guest [None req-fbdc18cd-3ae4-4726-a182-1cfe749bcebc tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 16:08:14 user nova-compute[71874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 16:08:14 user nova-compute[71874]:   <source dev="/dev/sdd"/>
Apr 12 16:08:14 user nova-compute[71874]:   <target dev="vdb" bus="virtio"/>
Apr 12 16:08:14 user nova-compute[71874]:   <serial>689dae55-b0ff-4639-85a0-96a3a0425490</serial>
Apr 12 16:08:14 user nova-compute[71874]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 16:08:14 user nova-compute[71874]: </disk>
Apr 12 16:08:14 user nova-compute[71874]:  {{(pid=71874) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 16:08:14 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Received event <DeviceRemovedEvent: 1681315694.4967675, 357dd90d-8c53-4193-ad64-edfa894116cf => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71874) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 16:08:14 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-fbdc18cd-3ae4-4726-a182-1cfe749bcebc tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 357dd90d-8c53-4193-ad64-edfa894116cf {{(pid=71874) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 16:08:14 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-fbdc18cd-3ae4-4726-a182-1cfe749bcebc tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Successfully detached device vdb from instance 357dd90d-8c53-4193-ad64-edfa894116cf from the live domain config.
Apr 12 16:08:14 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fbdc18cd-3ae4-4726-a182-1cfe749bcebc tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: 357dd90d-8c53-4193-ad64-edfa894116cf] calling os-brick to detach iSCSI Volume {{(pid=71874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 16:08:14 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbdc18cd-3ae4-4726-a182-1cfe749bcebc tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3c0216320>, {'target_iqn': 'iqn.2010-10.org.openstack:689dae55-b0ff-4639-85a0-96a3a0425490', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ECUitrzx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:08:14 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-fbdc18cd-3ae4-4726-a182-1cfe749bcebc tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:08:14 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-fbdc18cd-3ae4-4726-a182-1cfe749bcebc tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:08:14 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-2a8014ee-185e-43a2-9fe9-7b3942cac4ae tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.396s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:08:14 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a8014ee-185e-43a2-9fe9-7b3942cac4ae tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] <== connect_volume: return (1397ms) {'type': 'block', 'scsi_wwn': '23761343031333330', 'path': '/dev/sde'} {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:08:14 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a8014ee-185e-43a2-9fe9-7b3942cac4ae tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23761343031333330', 'path': '/dev/sde'} {{(pid=71874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 16:08:14 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-fbdc18cd-3ae4-4726-a182-1cfe749bcebc tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.264s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:08:14 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:08:14 user nova-compute[71874]: DEBUG nova.objects.instance [None req-2a8014ee-185e-43a2-9fe9-7b3942cac4ae tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lazy-loading 'flavor' on Instance uuid dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:08:14 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:08:14 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[92055c93-b4a6-4c57-b061-8c01e6c7a1ec]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7cc863d9-b797-4b5b-b8ce-30ebe55b9519\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:689dae55-b0ff-4639-85a0-96a3a0425490\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:08:14 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbdc18cd-3ae4-4726-a182-1cfe749bcebc tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 16:08:14 user nova-compute[71874]: No targets found.
Apr 12 16:08:14 user nova-compute[71874]: iSNS:
Apr 12 16:08:14 user nova-compute[71874]: No targets found.
Apr 12 16:08:14 user nova-compute[71874]: STATIC:
Apr 12 16:08:14 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:7cc863d9-b797-4b5b-b8ce-30ebe55b9519
Apr 12 16:08:14 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:08:14 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:08:14 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:689dae55-b0ff-4639-85a0-96a3a0425490
Apr 12 16:08:14 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:08:14 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:08:14 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297
Apr 12 16:08:14 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:08:14 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:08:14 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2
Apr 12 16:08:14 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:08:14 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:08:14 user nova-compute[71874]: FIRMWARE:
Apr 12 16:08:14 user nova-compute[71874]: No targets found.
Apr 12 16:08:14 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:08:14 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbdc18cd-3ae4-4726-a182-1cfe749bcebc tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 16:08:14 user nova-compute[71874]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 16:08:14 user nova-compute[71874]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71874) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 16:08:14 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbdc18cd-3ae4-4726-a182-1cfe749bcebc tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:689dae55-b0ff-4639-85a0-96a3a0425490', 0)] {{(pid=71874) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 16:08:14 user nova-compute[71874]: DEBUG nova.virt.libvirt.guest [None req-2a8014ee-185e-43a2-9fe9-7b3942cac4ae tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 16:08:14 user nova-compute[71874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 16:08:14 user nova-compute[71874]:   <source dev="/dev/sde"/>
Apr 12 16:08:14 user nova-compute[71874]:   <target dev="vdb" bus="virtio"/>
Apr 12 16:08:14 user nova-compute[71874]:   <serial>9baf883b-de18-43f0-a9d8-fc850bd83297</serial>
Apr 12 16:08:14 user nova-compute[71874]: </disk>
Apr 12 16:08:14 user nova-compute[71874]:  {{(pid=71874) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 16:08:14 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:08:14 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:08:14 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[10d33028-f53d-447a-b545-7ae0894915e0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:689dae55-b0ff-4639-85a0-96a3a0425490\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7cc863d9-b797-4b5b-b8ce-30ebe55b9519\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:08:14 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:08:14 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:08:14 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d7c4e96-5d1b-4994-9b08-0f62e586b7fd]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cc863d9-b797-4b5b-b8ce-30ebe55b9519 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:689dae55-b0ff-4639-85a0-96a3a0425490 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:08:14 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbdc18cd-3ae4-4726-a182-1cfe749bcebc tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:08:14 user nova-compute[71874]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cc863d9-b797-4b5b-b8ce-30ebe55b9519 (non-flash)
Apr 12 16:08:14 user nova-compute[71874]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:689dae55-b0ff-4639-85a0-96a3a0425490 (non-flash)
Apr 12 16:08:14 user nova-compute[71874]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 (non-flash)
Apr 12 16:08:14 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:08:14 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbdc18cd-3ae4-4726-a182-1cfe749bcebc tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:08:14 user nova-compute[71874]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cc863d9-b797-4b5b-b8ce-30ebe55b9519 (non-flash)
Apr 12 16:08:14 user nova-compute[71874]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:689dae55-b0ff-4639-85a0-96a3a0425490 (non-flash)
Apr 12 16:08:14 user nova-compute[71874]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 (non-flash)
Apr 12 16:08:14 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:08:14 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbdc18cd-3ae4-4726-a182-1cfe749bcebc tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc3c03d3010>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:689dae55-b0ff-4639-85a0-96a3a0425490'): ({'sdd'}, set())}) {{(pid=71874) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 16:08:14 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-fbdc18cd-3ae4-4726-a182-1cfe749bcebc tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Removing single pathed devices sdd {{(pid=71874) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 16:08:14 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:08:14 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:08:14 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d4c6707-f1e7-4712-bfbb-c689f72da425]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:08:14 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:08:14 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:08:14 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:08:14 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[358bec14-2886-4e06-8bd5-de1f5abb9236]: (4, ('ok\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:08:14 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-fbdc18cd-3ae4-4726-a182-1cfe749bcebc tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Flushing IO for device /dev/sdd {{(pid=71874) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 16:08:14 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:08:14 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:08:14 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[3119cf80-0b5c-4dbb-9d9f-64c7b501662d]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:08:14 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-fbdc18cd-3ae4-4726-a182-1cfe749bcebc tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71874) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 16:08:14 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:08:14 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.044s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:08:14 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[565a79ab-5cf8-4353-bda5-4bbca36775d6]: (4, ('1', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:08:14 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-fbdc18cd-3ae4-4726-a182-1cfe749bcebc tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71874) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 16:08:14 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-fbdc18cd-3ae4-4726-a182-1cfe749bcebc tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] SCSI volumes sdd have been removed. {{(pid=71874) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 16:08:14 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbdc18cd-3ae4-4726-a182-1cfe749bcebc tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:689dae55-b0ff-4639-85a0-96a3a0425490')] {{(pid=71874) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 16:08:14 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:689dae55-b0ff-4639-85a0-96a3a0425490 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:08:15 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:689dae55-b0ff-4639-85a0-96a3a0425490 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:08:15 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[953ddf3e-ecd8-4207-a727-958fa770938a]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:08:15 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbdc18cd-3ae4-4726-a182-1cfe749bcebc tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:08:15 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:689dae55-b0ff-4639-85a0-96a3a0425490 -p 172.16.0.220:3260 --logout {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:08:15 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:689dae55-b0ff-4639-85a0-96a3a0425490 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:08:15 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f8c7a4b-0bea-46e1-ae51-ff092fb2a544]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:689dae55-b0ff-4639-85a0-96a3a0425490, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:689dae55-b0ff-4639-85a0-96a3a0425490, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:08:15 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbdc18cd-3ae4-4726-a182-1cfe749bcebc tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:689dae55-b0ff-4639-85a0-96a3a0425490, portal: 172.16.0.220,3260]
Apr 12 16:08:15 user nova-compute[71874]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:689dae55-b0ff-4639-85a0-96a3a0425490, portal: 172.16.0.220,3260] successful.
Apr 12 16:08:15 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:08:15 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:689dae55-b0ff-4639-85a0-96a3a0425490 -p 172.16.0.220:3260 --op delete {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:08:15 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:689dae55-b0ff-4639-85a0-96a3a0425490 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.041s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:08:15 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[da40bfd3-2b12-4761-8c2b-1ef43e3ed389]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:08:15 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbdc18cd-3ae4-4726-a182-1cfe749bcebc tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:08:15 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-fbdc18cd-3ae4-4726-a182-1cfe749bcebc tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.347s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:08:15 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbdc18cd-3ae4-4726-a182-1cfe749bcebc tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] <== disconnect_volume: return (611ms) None {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:08:15 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fbdc18cd-3ae4-4726-a182-1cfe749bcebc tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: 357dd90d-8c53-4193-ad64-edfa894116cf] Disconnected iSCSI Volume {{(pid=71874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 16:08:15 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-2a8014ee-185e-43a2-9fe9-7b3942cac4ae tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] No BDM found with device name vda, not building metadata. {{(pid=71874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 16:08:15 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-2a8014ee-185e-43a2-9fe9-7b3942cac4ae tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 16:08:15 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-2a8014ee-185e-43a2-9fe9-7b3942cac4ae tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] No VIF found with MAC fa:16:3e:98:72:fa, not building metadata {{(pid=71874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 16:08:15 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-2a8014ee-185e-43a2-9fe9-7b3942cac4ae tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.097s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:08:15 user nova-compute[71874]: DEBUG nova.objects.instance [None req-fbdc18cd-3ae4-4726-a182-1cfe749bcebc tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lazy-loading 'flavor' on Instance uuid 357dd90d-8c53-4193-ad64-edfa894116cf {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:08:16 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-fbdc18cd-3ae4-4726-a182-1cfe749bcebc tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "357dd90d-8c53-4193-ad64-edfa894116cf" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.082s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:08:16 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:08:17 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:08:17 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Stashing vm_state: active {{(pid=71874) _prep_resize /opt/stack/nova/nova/compute/manager.py:5499}}
Apr 12 16:08:18 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:08:18 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:08:18 user nova-compute[71874]: DEBUG nova.objects.instance [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lazy-loading 'pci_requests' on Instance uuid dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:08:18 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71874) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 16:08:18 user nova-compute[71874]: INFO nova.compute.claims [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Claim successful on node user
Apr 12 16:08:18 user nova-compute[71874]: DEBUG nova.objects.instance [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lazy-loading 'resources' on Instance uuid dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:08:18 user nova-compute[71874]: DEBUG nova.objects.instance [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lazy-loading 'pci_devices' on Instance uuid dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:08:18 user nova-compute[71874]: INFO nova.compute.resource_tracker [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Updating resource usage from migration 1fde283e-efad-42fd-8a25-d8ba63358bb1
Apr 12 16:08:18 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Inventory has not changed in ProviderTree for provider: 0e94b4c8-cd49-45e4-9133-d36eb4b2456b {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 16:08:18 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Inventory has not changed for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 16:08:18 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.631s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:08:18 user nova-compute[71874]: INFO nova.compute.manager [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Migrating
Apr 12 16:08:18 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:08:18 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquired lock "compute-rpcapi-router" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:08:18 user nova-compute[71874]: INFO nova.compute.rpcapi [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Apr 12 16:08:18 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Releasing lock "compute-rpcapi-router" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:08:18 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "refresh_cache-dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:08:18 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquired lock "refresh_cache-dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:08:18 user nova-compute[71874]: DEBUG nova.network.neutron [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Building network info cache for instance {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 16:08:19 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:08:19 user nova-compute[71874]: DEBUG nova.network.neutron [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Updating instance_info_cache with network_info: [{"id": "18196ae0-d9c1-4814-8803-c4ba8ad4ab45", "address": "fa:16:3e:98:72:fa", "network": {"id": "e6694358-e361-4952-b859-93755c11721e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-667152893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97ea81bd1962466bbe552424973f71a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18196ae0-d9", "ovs_interfaceid": "18196ae0-d9c1-4814-8803-c4ba8ad4ab45", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:08:19 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:08:19 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Releasing lock "refresh_cache-dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:08:20 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Starting migrate_disk_and_power_off {{(pid=71874) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11460}}
Apr 12 16:08:20 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:08:20 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:08:20 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:08:20 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:08:20 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:08:20 user nova-compute[71874]: DEBUG nova.compute.manager [req-5bf49308-bc69-417c-84e5-1f5d25adaaf9 req-e67c48e5-fb62-4dd1-b086-9665f84026c9 service nova] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Received event network-vif-unplugged-18196ae0-d9c1-4814-8803-c4ba8ad4ab45 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:08:20 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-5bf49308-bc69-417c-84e5-1f5d25adaaf9 req-e67c48e5-fb62-4dd1-b086-9665f84026c9 service nova] Acquiring lock "dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:08:20 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-5bf49308-bc69-417c-84e5-1f5d25adaaf9 req-e67c48e5-fb62-4dd1-b086-9665f84026c9 service nova] Lock "dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:08:20 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-5bf49308-bc69-417c-84e5-1f5d25adaaf9 req-e67c48e5-fb62-4dd1-b086-9665f84026c9 service nova] Lock "dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:08:20 user nova-compute[71874]: DEBUG nova.compute.manager [req-5bf49308-bc69-417c-84e5-1f5d25adaaf9 req-e67c48e5-fb62-4dd1-b086-9665f84026c9 service nova] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] No waiting events found dispatching network-vif-unplugged-18196ae0-d9c1-4814-8803-c4ba8ad4ab45 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:08:20 user nova-compute[71874]: WARNING nova.compute.manager [req-5bf49308-bc69-417c-84e5-1f5d25adaaf9 req-e67c48e5-fb62-4dd1-b086-9665f84026c9 service nova] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Received unexpected event network-vif-unplugged-18196ae0-d9c1-4814-8803-c4ba8ad4ab45 for instance with vm_state active and task_state resize_migrating.
Apr 12 16:08:20 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:08:20 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Starting heal instance info cache {{(pid=71874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 16:08:20 user nova-compute[71874]: INFO nova.virt.libvirt.driver [-] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Instance destroyed successfully.
Apr 12 16:08:20 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-12T15:59:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1390712116',display_name='tempest-ServerActionsTestJSON-server-416657090',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1390712116',id=4,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNmXVADjvoPSh3uGCGCTNS/vcfcDtUjn/vZEaV3bCllfz1ZO8VIgFuZhP+mAsa+G/KA4ubi5U9Vj41YtHGsakdPR5VoByhorvfUv/PIWtER2tn1LWX2mlFyT+T8AEJplPw==',key_name='tempest-keypair-1923467613',keypairs=<?>,launch_index=0,launched_at=2023-04-12T16:03:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='97ea81bd1962466bbe552424973f71a8',ramdisk_id='',reservation_id='r-y3c7iw20',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-631887779',owner_user_name='tempest-ServerActionsTestJSON-631887779-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T16:08:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1a699b3ba8304eadb8a53d465ea340cf',uuid=dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "18196ae0-d9c1-4814-8803-c4ba8ad4ab45", "address": "fa:16:3e:98:72:fa", "network": {"id": "e6694358-e361-4952-b859-93755c11721e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-667152893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-667152893-network", "vif_mac": "fa:16:3e:98:72:fa"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97ea81bd1962466bbe552424973f71a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18196ae0-d9", "ovs_interfaceid": "18196ae0-d9c1-4814-8803-c4ba8ad4ab45", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 16:08:20 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Converting VIF {"id": "18196ae0-d9c1-4814-8803-c4ba8ad4ab45", "address": "fa:16:3e:98:72:fa", "network": {"id": "e6694358-e361-4952-b859-93755c11721e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-667152893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-667152893-network", "vif_mac": "fa:16:3e:98:72:fa"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97ea81bd1962466bbe552424973f71a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18196ae0-d9", "ovs_interfaceid": "18196ae0-d9c1-4814-8803-c4ba8ad4ab45", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:08:20 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:98:72:fa,bridge_name='br-int',has_traffic_filtering=True,id=18196ae0-d9c1-4814-8803-c4ba8ad4ab45,network=Network(e6694358-e361-4952-b859-93755c11721e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18196ae0-d9') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:08:20 user nova-compute[71874]: DEBUG os_vif [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:98:72:fa,bridge_name='br-int',has_traffic_filtering=True,id=18196ae0-d9c1-4814-8803-c4ba8ad4ab45,network=Network(e6694358-e361-4952-b859-93755c11721e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18196ae0-d9') {{(pid=71874) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 16:08:20 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:08:20 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap18196ae0-d9, bridge=br-int, if_exists=True) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:08:20 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:08:20 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:08:20 user nova-compute[71874]: INFO os_vif [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:98:72:fa,bridge_name='br-int',has_traffic_filtering=True,id=18196ae0-d9c1-4814-8803-c4ba8ad4ab45,network=Network(e6694358-e361-4952-b859-93755c11721e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18196ae0-d9')
Apr 12 16:08:20 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] calling os-brick to detach iSCSI Volume {{(pid=71874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 16:08:20 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3c0216320>, {'target_iqn': 'iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RGWZNvlY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:08:20 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:08:20 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:08:20 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:08:20 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:08:20 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:08:20 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5e8bc25-628c-4ec0-b9e3-f5876f9d0e6d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7cc863d9-b797-4b5b-b8ce-30ebe55b9519\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:08:20 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 16:08:20 user nova-compute[71874]: No targets found.
Apr 12 16:08:20 user nova-compute[71874]: iSNS:
Apr 12 16:08:20 user nova-compute[71874]: No targets found.
Apr 12 16:08:20 user nova-compute[71874]: STATIC:
Apr 12 16:08:20 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:7cc863d9-b797-4b5b-b8ce-30ebe55b9519
Apr 12 16:08:20 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:08:20 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:08:20 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297
Apr 12 16:08:20 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:08:20 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:08:20 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2
Apr 12 16:08:20 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:08:20 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:08:20 user nova-compute[71874]: FIRMWARE:
Apr 12 16:08:20 user nova-compute[71874]: No targets found.
Apr 12 16:08:20 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:08:20 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 16:08:20 user nova-compute[71874]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 16:08:20 user nova-compute[71874]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71874) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 16:08:20 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297', 0)] {{(pid=71874) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 16:08:20 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:08:20 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquiring lock "refresh_cache-608fbea2-b42b-4bb9-94a7-2b76dcdc2001" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:08:20 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquired lock "refresh_cache-608fbea2-b42b-4bb9-94a7-2b76dcdc2001" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:08:20 user nova-compute[71874]: DEBUG nova.network.neutron [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] [instance: 608fbea2-b42b-4bb9-94a7-2b76dcdc2001] Forcefully refreshing network info cache for instance {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 16:08:20 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:08:20 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ad9a751-f032-497a-b24d-98e82431736e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7cc863d9-b797-4b5b-b8ce-30ebe55b9519\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:08:20 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:08:20 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:08:20 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[792c8cac-eb6b-40a6-b1ee-a255fda1804d]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cc863d9-b797-4b5b-b8ce-30ebe55b9519 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:08:20 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:08:20 user nova-compute[71874]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cc863d9-b797-4b5b-b8ce-30ebe55b9519 (non-flash)
Apr 12 16:08:20 user nova-compute[71874]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 (non-flash)
Apr 12 16:08:20 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:08:20 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:08:20 user nova-compute[71874]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cc863d9-b797-4b5b-b8ce-30ebe55b9519 (non-flash)
Apr 12 16:08:20 user nova-compute[71874]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 (non-flash)
Apr 12 16:08:20 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:08:20 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc3c0612710>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297'): ({'sde'}, set())}) {{(pid=71874) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 16:08:20 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Removing single pathed devices sde {{(pid=71874) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 16:08:20 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:08:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:08:21 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[3286eee3-5682-4bfa-8f25-f4cf92f36577]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:08:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:08:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:08:21 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea949fba-ecab-4d4c-b500-37986194e832]: (4, ('ok\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:08:21 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Flushing IO for device /dev/sde {{(pid=71874) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 16:08:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:08:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:08:21 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bd63ef7-882a-4888-96a4-c71d3a6749d6]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:08:21 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71874) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 16:08:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:08:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.055s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:08:21 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a09f7b5-7ac2-4d52-aba0-dafcb739fdad]: (4, ('1', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:08:21 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71874) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 16:08:21 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] SCSI volumes sde have been removed. {{(pid=71874) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 16:08:21 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297')] {{(pid=71874) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 16:08:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:08:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:08:21 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[c22069b8-be6a-448e-848e-c43bb334ca31]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:08:21 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:08:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 -p 172.16.0.220:3260 --logout {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:08:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:08:21 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad8ee70b-b3e2-41fa-aa4c-d550372d6250]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:08:21 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297, portal: 172.16.0.220,3260]
Apr 12 16:08:21 user nova-compute[71874]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297, portal: 172.16.0.220,3260] successful.
Apr 12 16:08:21 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:08:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 -p 172.16.0.220:3260 --op delete {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:08:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:08:21 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1413e49-e7ee-4b64-a487-72c1b59ee630]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:08:21 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:08:21 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.347s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:08:21 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] <== disconnect_volume: return (348ms) None {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:08:21 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Disconnected iSCSI Volume {{(pid=71874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 16:08:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:08:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:08:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:08:21 user nova-compute[71874]: DEBUG nova.network.neutron [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] [instance: 608fbea2-b42b-4bb9-94a7-2b76dcdc2001] Updating instance_info_cache with network_info: [{"id": "246d47a5-6953-4e38-8546-63953a8721cf", "address": "fa:16:3e:64:93:eb", "network": {"id": "b36306e0-04c5-4b1b-8022-05ff121c4e43", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1503204786-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9210f81232304e179d3e09914a492442", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap246d47a5-69", "ovs_interfaceid": "246d47a5-6953-4e38-8546-63953a8721cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:08:21 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Releasing lock "refresh_cache-608fbea2-b42b-4bb9-94a7-2b76dcdc2001" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:08:21 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] [instance: 608fbea2-b42b-4bb9-94a7-2b76dcdc2001] Updated the network info_cache for instance {{(pid=71874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 16:08:21 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:08:21 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:08:21 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71874) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 16:08:21 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:08:21 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:08:21 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:08:21 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:08:21 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Auditing locally available compute resources for user (node: user) {{(pid=71874) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 16:08:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:08:21 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] skipping disk /dev/sde (vdb) as it is a volume {{(pid=71874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 16:08:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1_resize/disk /opt/stack/data/nova/instances/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1/disk {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:08:21 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-81523f48-23bf-4a94-bb08-82eeada86ade tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Acquiring lock "1496d262-ad85-4da5-be83-035c9806bd20" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:08:21 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-81523f48-23bf-4a94-bb08-82eeada86ade tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Lock "1496d262-ad85-4da5-be83-035c9806bd20" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:08:21 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-81523f48-23bf-4a94-bb08-82eeada86ade tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Acquiring lock "1496d262-ad85-4da5-be83-035c9806bd20-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:08:21 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-81523f48-23bf-4a94-bb08-82eeada86ade tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Lock "1496d262-ad85-4da5-be83-035c9806bd20-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:08:21 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-81523f48-23bf-4a94-bb08-82eeada86ade tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Lock "1496d262-ad85-4da5-be83-035c9806bd20-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:08:21 user nova-compute[71874]: INFO nova.compute.manager [None req-81523f48-23bf-4a94-bb08-82eeada86ade tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] [instance: 1496d262-ad85-4da5-be83-035c9806bd20] Terminating instance
Apr 12 16:08:21 user nova-compute[71874]: DEBUG nova.compute.manager [None req-81523f48-23bf-4a94-bb08-82eeada86ade tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] [instance: 1496d262-ad85-4da5-be83-035c9806bd20] Start destroying the instance on the hypervisor. {{(pid=71874) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 16:08:21 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:08:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] CMD "cp -r /opt/stack/data/nova/instances/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1_resize/disk /opt/stack/data/nova/instances/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1/disk" returned: 0 in 0.308s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:08:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1_resize/disk.info /opt/stack/data/nova/instances/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1/disk.info {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:08:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] CMD "cp -r /opt/stack/data/nova/instances/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1_resize/disk.info /opt/stack/data/nova/instances/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1/disk.info" returned: 0 in 0.036s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:08:22 user nova-compute[71874]: DEBUG nova.compute.manager [req-7d11a7be-21d0-4793-8742-02aa71d5f596 req-99f86048-9445-4b6b-b014-827a402019c4 service nova] [instance: 1496d262-ad85-4da5-be83-035c9806bd20] Received event network-vif-unplugged-035ef219-1c48-4c0c-944d-686a6af767e5 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:08:22 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-7d11a7be-21d0-4793-8742-02aa71d5f596 req-99f86048-9445-4b6b-b014-827a402019c4 service nova] Acquiring lock "1496d262-ad85-4da5-be83-035c9806bd20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:08:22 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-7d11a7be-21d0-4793-8742-02aa71d5f596 req-99f86048-9445-4b6b-b014-827a402019c4 service nova] Lock "1496d262-ad85-4da5-be83-035c9806bd20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:08:22 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-7d11a7be-21d0-4793-8742-02aa71d5f596 req-99f86048-9445-4b6b-b014-827a402019c4 service nova] Lock "1496d262-ad85-4da5-be83-035c9806bd20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:08:22 user nova-compute[71874]: DEBUG nova.compute.manager [req-7d11a7be-21d0-4793-8742-02aa71d5f596 req-99f86048-9445-4b6b-b014-827a402019c4 service nova] [instance: 1496d262-ad85-4da5-be83-035c9806bd20] No waiting events found dispatching network-vif-unplugged-035ef219-1c48-4c0c-944d-686a6af767e5 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:08:22 user nova-compute[71874]: DEBUG nova.compute.manager [req-7d11a7be-21d0-4793-8742-02aa71d5f596 req-99f86048-9445-4b6b-b014-827a402019c4 service nova] [instance: 1496d262-ad85-4da5-be83-035c9806bd20] Received event network-vif-unplugged-035ef219-1c48-4c0c-944d-686a6af767e5 for instance with task_state deleting. {{(pid=71874) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 16:08:22 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:08:22 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:08:22 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1496d262-ad85-4da5-be83-035c9806bd20/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:08:22 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1496d262-ad85-4da5-be83-035c9806bd20/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:08:22 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1496d262-ad85-4da5-be83-035c9806bd20/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:08:22 user nova-compute[71874]: DEBUG nova.compute.manager [req-7d15956e-c8a3-413a-9112-e2fc4d76c491 req-38ae6721-b522-459e-8601-65b92a58afbb service nova] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Received event network-vif-plugged-18196ae0-d9c1-4814-8803-c4ba8ad4ab45 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:08:22 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-7d15956e-c8a3-413a-9112-e2fc4d76c491 req-38ae6721-b522-459e-8601-65b92a58afbb service nova] Acquiring lock "dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:08:22 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-7d15956e-c8a3-413a-9112-e2fc4d76c491 req-38ae6721-b522-459e-8601-65b92a58afbb service nova] Lock "dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:08:22 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-7d15956e-c8a3-413a-9112-e2fc4d76c491 req-38ae6721-b522-459e-8601-65b92a58afbb service nova] Lock "dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:08:22 user nova-compute[71874]: DEBUG nova.compute.manager [req-7d15956e-c8a3-413a-9112-e2fc4d76c491 req-38ae6721-b522-459e-8601-65b92a58afbb service nova] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] No waiting events found dispatching network-vif-plugged-18196ae0-d9c1-4814-8803-c4ba8ad4ab45 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:08:22 user nova-compute[71874]: WARNING nova.compute.manager [req-7d15956e-c8a3-413a-9112-e2fc4d76c491 req-38ae6721-b522-459e-8601-65b92a58afbb service nova] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Received unexpected event network-vif-plugged-18196ae0-d9c1-4814-8803-c4ba8ad4ab45 for instance with vm_state active and task_state resize_migrating.
Apr 12 16:08:22 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1496d262-ad85-4da5-be83-035c9806bd20/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:08:22 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f641c6b-b508-42a7-ae98-c2bfb841d798/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:08:22 user nova-compute[71874]: INFO nova.virt.libvirt.driver [-] [instance: 1496d262-ad85-4da5-be83-035c9806bd20] Instance destroyed successfully.
Apr 12 16:08:22 user nova-compute[71874]: DEBUG nova.objects.instance [None req-81523f48-23bf-4a94-bb08-82eeada86ade tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Lazy-loading 'resources' on Instance uuid 1496d262-ad85-4da5-be83-035c9806bd20 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:08:22 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-81523f48-23bf-4a94-bb08-82eeada86ade tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T16:06:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1697600412',display_name='tempest-VolumesAdminNegativeTest-server-1697600412',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1697600412',id=22,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T16:06:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='76f559719f5f43c3a47a0aaf1e699193',ramdisk_id='',reservation_id='r-g80zt5vk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-716771515',owner_user_name='tempest-VolumesAdminNegativeTest-716771515-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T16:06:34Z,user_data=None,user_id='2b65791f14d34508b8a9a0849a9bf89e',uuid=1496d262-ad85-4da5-be83-035c9806bd20,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "035ef219-1c48-4c0c-944d-686a6af767e5", "address": "fa:16:3e:0f:eb:c1", "network": {"id": "0a97bb8e-9c19-41f1-bfcd-428e3ea3492f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-6019148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76f559719f5f43c3a47a0aaf1e699193", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap035ef219-1c", "ovs_interfaceid": "035ef219-1c48-4c0c-944d-686a6af767e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 16:08:22 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-81523f48-23bf-4a94-bb08-82eeada86ade tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Converting VIF {"id": "035ef219-1c48-4c0c-944d-686a6af767e5", "address": "fa:16:3e:0f:eb:c1", "network": {"id": "0a97bb8e-9c19-41f1-bfcd-428e3ea3492f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-6019148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76f559719f5f43c3a47a0aaf1e699193", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap035ef219-1c", "ovs_interfaceid": "035ef219-1c48-4c0c-944d-686a6af767e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:08:22 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-81523f48-23bf-4a94-bb08-82eeada86ade tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:eb:c1,bridge_name='br-int',has_traffic_filtering=True,id=035ef219-1c48-4c0c-944d-686a6af767e5,network=Network(0a97bb8e-9c19-41f1-bfcd-428e3ea3492f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap035ef219-1c') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:08:22 user nova-compute[71874]: DEBUG os_vif [None req-81523f48-23bf-4a94-bb08-82eeada86ade tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:eb:c1,bridge_name='br-int',has_traffic_filtering=True,id=035ef219-1c48-4c0c-944d-686a6af767e5,network=Network(0a97bb8e-9c19-41f1-bfcd-428e3ea3492f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap035ef219-1c') {{(pid=71874) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 16:08:22 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:08:22 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap035ef219-1c, bridge=br-int, if_exists=True) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:08:22 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:08:22 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:08:22 user nova-compute[71874]: INFO os_vif [None req-81523f48-23bf-4a94-bb08-82eeada86ade tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:eb:c1,bridge_name='br-int',has_traffic_filtering=True,id=035ef219-1c48-4c0c-944d-686a6af767e5,network=Network(0a97bb8e-9c19-41f1-bfcd-428e3ea3492f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap035ef219-1c')
Apr 12 16:08:22 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-81523f48-23bf-4a94-bb08-82eeada86ade tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] [instance: 1496d262-ad85-4da5-be83-035c9806bd20] Deleting instance files /opt/stack/data/nova/instances/1496d262-ad85-4da5-be83-035c9806bd20_del
Apr 12 16:08:22 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-81523f48-23bf-4a94-bb08-82eeada86ade tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] [instance: 1496d262-ad85-4da5-be83-035c9806bd20] Deletion of /opt/stack/data/nova/instances/1496d262-ad85-4da5-be83-035c9806bd20_del complete
Apr 12 16:08:22 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f641c6b-b508-42a7-ae98-c2bfb841d798/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:08:22 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f641c6b-b508-42a7-ae98-c2bfb841d798/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:08:22 user nova-compute[71874]: INFO nova.compute.manager [None req-81523f48-23bf-4a94-bb08-82eeada86ade tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] [instance: 1496d262-ad85-4da5-be83-035c9806bd20] Took 1.10 seconds to destroy the instance on the hypervisor.
Apr 12 16:08:22 user nova-compute[71874]: DEBUG oslo.service.loopingcall [None req-81523f48-23bf-4a94-bb08-82eeada86ade tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71874) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 16:08:22 user nova-compute[71874]: DEBUG nova.compute.manager [-] [instance: 1496d262-ad85-4da5-be83-035c9806bd20] Deallocating network for instance {{(pid=71874) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 16:08:22 user nova-compute[71874]: DEBUG nova.network.neutron [-] [instance: 1496d262-ad85-4da5-be83-035c9806bd20] deallocate_for_instance() {{(pid=71874) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 16:08:22 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:08:22 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f641c6b-b508-42a7-ae98-c2bfb841d798/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:08:22 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:08:22 user nova-compute[71874]: DEBUG nova.network.neutron [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Port 18196ae0-d9c1-4814-8803-c4ba8ad4ab45 binding to destination host user is already ACTIVE {{(pid=71874) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3161}}
Apr 12 16:08:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:08:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:08:23 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:08:23 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:08:23 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:08:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:08:23 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 16:08:23 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-b5bb173c-1ac4-478d-b96b-a6576db98029 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Acquiring lock "84683344-2893-4446-90ae-e64cd799eb20" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:08:23 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-b5bb173c-1ac4-478d-b96b-a6576db98029 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "84683344-2893-4446-90ae-e64cd799eb20" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:08:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/357dd90d-8c53-4193-ad64-edfa894116cf/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:08:23 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "refresh_cache-dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:08:23 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquired lock "refresh_cache-dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:08:23 user nova-compute[71874]: DEBUG nova.network.neutron [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Building network info cache for instance {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 16:08:23 user nova-compute[71874]: DEBUG nova.compute.manager [None req-b5bb173c-1ac4-478d-b96b-a6576db98029 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: 84683344-2893-4446-90ae-e64cd799eb20] Starting instance... {{(pid=71874) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 16:08:23 user nova-compute[71874]: DEBUG nova.network.neutron [-] [instance: 1496d262-ad85-4da5-be83-035c9806bd20] Updating instance_info_cache with network_info: [] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:08:23 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-b5bb173c-1ac4-478d-b96b-a6576db98029 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:08:23 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-b5bb173c-1ac4-478d-b96b-a6576db98029 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:08:23 user nova-compute[71874]: INFO nova.compute.manager [-] [instance: 1496d262-ad85-4da5-be83-035c9806bd20] Took 0.54 seconds to deallocate network for instance.
Apr 12 16:08:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/357dd90d-8c53-4193-ad64-edfa894116cf/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:08:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/357dd90d-8c53-4193-ad64-edfa894116cf/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:08:23 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-b5bb173c-1ac4-478d-b96b-a6576db98029 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71874) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 16:08:23 user nova-compute[71874]: INFO nova.compute.claims [None req-b5bb173c-1ac4-478d-b96b-a6576db98029 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: 84683344-2893-4446-90ae-e64cd799eb20] Claim successful on node user
Apr 12 16:08:23 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-81523f48-23bf-4a94-bb08-82eeada86ade tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:08:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/357dd90d-8c53-4193-ad64-edfa894116cf/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:08:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473a30c4-5aa4-481c-8859-fda815d14872/disk.rescue --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:08:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473a30c4-5aa4-481c-8859-fda815d14872/disk.rescue --force-share --output=json" returned: 0 in 0.134s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:08:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473a30c4-5aa4-481c-8859-fda815d14872/disk.rescue --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:08:23 user nova-compute[71874]: DEBUG nova.network.neutron [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Updating instance_info_cache with network_info: [{"id": "18196ae0-d9c1-4814-8803-c4ba8ad4ab45", "address": "fa:16:3e:98:72:fa", "network": {"id": "e6694358-e361-4952-b859-93755c11721e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-667152893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97ea81bd1962466bbe552424973f71a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18196ae0-d9", "ovs_interfaceid": "18196ae0-d9c1-4814-8803-c4ba8ad4ab45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:08:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473a30c4-5aa4-481c-8859-fda815d14872/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:08:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473a30c4-5aa4-481c-8859-fda815d14872/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:08:23 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Releasing lock "refresh_cache-dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:08:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473a30c4-5aa4-481c-8859-fda815d14872/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:08:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473a30c4-5aa4-481c-8859-fda815d14872/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:08:24 user nova-compute[71874]: DEBUG os_brick.utils [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:08:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:08:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:08:24 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[1abf3d03-7b0a-456e-85f9-9f152a06763a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:61a48d4489d2\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:08:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:08:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:08:24 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[50f37faf-e26d-4fea-8425-4059d96cf415]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:08:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:08:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473a30c4-5aa4-481c-8859-fda815d14872/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:08:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:08:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:08:24 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[986f806c-ece6-4879-a380-3ec38ee59a66]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:08:24 user nova-compute[71874]: DEBUG nova.compute.manager [req-3e05c762-df4a-41de-81d7-7e752b57b36e req-ae9418d8-fe88-4602-bb5c-1360ea22758c service nova] [instance: 1496d262-ad85-4da5-be83-035c9806bd20] Received event network-vif-plugged-035ef219-1c48-4c0c-944d-686a6af767e5 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:08:24 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-3e05c762-df4a-41de-81d7-7e752b57b36e req-ae9418d8-fe88-4602-bb5c-1360ea22758c service nova] Acquiring lock "1496d262-ad85-4da5-be83-035c9806bd20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:08:24 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-3e05c762-df4a-41de-81d7-7e752b57b36e req-ae9418d8-fe88-4602-bb5c-1360ea22758c service nova] Lock "1496d262-ad85-4da5-be83-035c9806bd20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:08:24 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-3e05c762-df4a-41de-81d7-7e752b57b36e req-ae9418d8-fe88-4602-bb5c-1360ea22758c service nova] Lock "1496d262-ad85-4da5-be83-035c9806bd20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:08:24 user nova-compute[71874]: DEBUG nova.compute.manager [req-3e05c762-df4a-41de-81d7-7e752b57b36e req-ae9418d8-fe88-4602-bb5c-1360ea22758c service nova] [instance: 1496d262-ad85-4da5-be83-035c9806bd20] No waiting events found dispatching network-vif-plugged-035ef219-1c48-4c0c-944d-686a6af767e5 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:08:24 user nova-compute[71874]: WARNING nova.compute.manager [req-3e05c762-df4a-41de-81d7-7e752b57b36e req-ae9418d8-fe88-4602-bb5c-1360ea22758c service nova] [instance: 1496d262-ad85-4da5-be83-035c9806bd20] Received unexpected event network-vif-plugged-035ef219-1c48-4c0c-944d-686a6af767e5 for instance with vm_state deleted and task_state None.
Apr 12 16:08:24 user nova-compute[71874]: DEBUG nova.compute.manager [req-3e05c762-df4a-41de-81d7-7e752b57b36e req-ae9418d8-fe88-4602-bb5c-1360ea22758c service nova] [instance: 1496d262-ad85-4da5-be83-035c9806bd20] Received event network-vif-deleted-035ef219-1c48-4c0c-944d-686a6af767e5 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:08:24 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[288b19aa-f7aa-4d3b-a4ef-920eafe0909d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:08:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Running cmd (subprocess): nvme version {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:08:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] 'nvme version' failed. Not Retrying. {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 16:08:24 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] nvme not present on system {{(pid=71874) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 16:08:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:08:24 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-b5bb173c-1ac4-478d-b96b-a6576db98029 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Inventory has not changed in ProviderTree for provider: 0e94b4c8-cd49-45e4-9133-d36eb4b2456b {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 16:08:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 16:08:24 user nova-compute[71874]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 16:08:24 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[195e8d92-93a0-4eb8-b2d8-299a68280519]: (4, '') {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:08:24 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.lightos [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71874) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 16:08:24 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.lightos [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71874) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 16:08:24 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.lightos [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] LIGHTOS: no hostnqn found. {{(pid=71874) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 16:08:24 user nova-compute[71874]: DEBUG os_brick.utils [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] <== get_connector_properties: return (181ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:61a48d4489d2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:08:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:08:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:08:24 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-b5bb173c-1ac4-478d-b96b-a6576db98029 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Inventory has not changed for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 16:08:24 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-b5bb173c-1ac4-478d-b96b-a6576db98029 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.943s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:08:24 user nova-compute[71874]: DEBUG nova.compute.manager [None req-b5bb173c-1ac4-478d-b96b-a6576db98029 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: 84683344-2893-4446-90ae-e64cd799eb20] Start building networks asynchronously for instance. {{(pid=71874) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 16:08:24 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-81523f48-23bf-4a94-bb08-82eeada86ade tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.881s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:08:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:08:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:08:24 user nova-compute[71874]: DEBUG nova.compute.manager [None req-b5bb173c-1ac4-478d-b96b-a6576db98029 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: 84683344-2893-4446-90ae-e64cd799eb20] Allocating IP information in the background. {{(pid=71874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 16:08:24 user nova-compute[71874]: DEBUG nova.network.neutron [None req-b5bb173c-1ac4-478d-b96b-a6576db98029 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: 84683344-2893-4446-90ae-e64cd799eb20] allocate_for_instance() {{(pid=71874) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 16:08:24 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-b5bb173c-1ac4-478d-b96b-a6576db98029 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: 84683344-2893-4446-90ae-e64cd799eb20] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 16:08:24 user nova-compute[71874]: DEBUG nova.compute.manager [None req-b5bb173c-1ac4-478d-b96b-a6576db98029 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: 84683344-2893-4446-90ae-e64cd799eb20] Start building block device mappings for instance. {{(pid=71874) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 16:08:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:08:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:08:24 user nova-compute[71874]: DEBUG nova.policy [None req-b5bb173c-1ac4-478d-b96b-a6576db98029 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '16a68fa3490940ebaebc8d4ca5746f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236b9e609eb44071bc88971bff96931e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71874) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 16:08:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:08:24 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=71874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 16:08:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/016ae41d-b098-4126-ace7-3da00b40cb9c/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:08:24 user nova-compute[71874]: DEBUG nova.compute.manager [None req-b5bb173c-1ac4-478d-b96b-a6576db98029 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: 84683344-2893-4446-90ae-e64cd799eb20] Start spawning the instance on the hypervisor. {{(pid=71874) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 16:08:24 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-b5bb173c-1ac4-478d-b96b-a6576db98029 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: 84683344-2893-4446-90ae-e64cd799eb20] Creating instance directory {{(pid=71874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 16:08:24 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-b5bb173c-1ac4-478d-b96b-a6576db98029 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: 84683344-2893-4446-90ae-e64cd799eb20] Creating image(s)
Apr 12 16:08:24 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-b5bb173c-1ac4-478d-b96b-a6576db98029 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Acquiring lock "/opt/stack/data/nova/instances/84683344-2893-4446-90ae-e64cd799eb20/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:08:24 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-b5bb173c-1ac4-478d-b96b-a6576db98029 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "/opt/stack/data/nova/instances/84683344-2893-4446-90ae-e64cd799eb20/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:08:24 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-b5bb173c-1ac4-478d-b96b-a6576db98029 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "/opt/stack/data/nova/instances/84683344-2893-4446-90ae-e64cd799eb20/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:08:24 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-b5bb173c-1ac4-478d-b96b-a6576db98029 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Acquiring lock "2f94a73a1a770bd66922be1f3394655a4b9500c6" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:08:24 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-b5bb173c-1ac4-478d-b96b-a6576db98029 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "2f94a73a1a770bd66922be1f3394655a4b9500c6" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:08:25 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-b5bb173c-1ac4-478d-b96b-a6576db98029 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2f94a73a1a770bd66922be1f3394655a4b9500c6.part --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:08:25 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/016ae41d-b098-4126-ace7-3da00b40cb9c/disk --force-share --output=json" returned: 0 in 0.451s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:08:25 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/016ae41d-b098-4126-ace7-3da00b40cb9c/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:08:25 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-b5bb173c-1ac4-478d-b96b-a6576db98029 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2f94a73a1a770bd66922be1f3394655a4b9500c6.part --force-share --output=json" returned: 0 in 0.147s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:08:25 user nova-compute[71874]: DEBUG nova.virt.images [None req-b5bb173c-1ac4-478d-b96b-a6576db98029 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] ca200f21-67f7-4581-9bfc-75465abff368 was qcow2, converting to raw {{(pid=71874) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 12 16:08:25 user nova-compute[71874]: DEBUG nova.privsep.utils [None req-b5bb173c-1ac4-478d-b96b-a6576db98029 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71874) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 12 16:08:25 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-b5bb173c-1ac4-478d-b96b-a6576db98029 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2f94a73a1a770bd66922be1f3394655a4b9500c6.part /opt/stack/data/nova/instances/_base/2f94a73a1a770bd66922be1f3394655a4b9500c6.converted {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:08:25 user nova-compute[71874]: DEBUG nova.network.neutron [None req-b5bb173c-1ac4-478d-b96b-a6576db98029 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: 84683344-2893-4446-90ae-e64cd799eb20] Successfully created port: a8837af3-03f7-4b3d-8a2a-746f2d8038ad {{(pid=71874) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 16:08:25 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/016ae41d-b098-4126-ace7-3da00b40cb9c/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:08:25 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/608fbea2-b42b-4bb9-94a7-2b76dcdc2001/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:08:25 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-81523f48-23bf-4a94-bb08-82eeada86ade tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Inventory has not changed in ProviderTree for provider: 0e94b4c8-cd49-45e4-9133-d36eb4b2456b {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 16:08:25 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-81523f48-23bf-4a94-bb08-82eeada86ade tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Inventory has not changed for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 16:08:25 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/608fbea2-b42b-4bb9-94a7-2b76dcdc2001/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:08:25 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/608fbea2-b42b-4bb9-94a7-2b76dcdc2001/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:08:25 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-81523f48-23bf-4a94-bb08-82eeada86ade tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.229s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:08:25 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-b5bb173c-1ac4-478d-b96b-a6576db98029 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2f94a73a1a770bd66922be1f3394655a4b9500c6.part /opt/stack/data/nova/instances/_base/2f94a73a1a770bd66922be1f3394655a4b9500c6.converted" returned: 0 in 0.371s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:08:25 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-b5bb173c-1ac4-478d-b96b-a6576db98029 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2f94a73a1a770bd66922be1f3394655a4b9500c6.converted --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:08:25 user nova-compute[71874]: INFO nova.scheduler.client.report [None req-81523f48-23bf-4a94-bb08-82eeada86ade tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Deleted allocations for instance 1496d262-ad85-4da5-be83-035c9806bd20
Apr 12 16:08:25 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/608fbea2-b42b-4bb9-94a7-2b76dcdc2001/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:08:25 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6caa4977-8333-4171-8825-2c3bfb52f80b/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:08:25 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-81523f48-23bf-4a94-bb08-82eeada86ade tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Lock "1496d262-ad85-4da5-be83-035c9806bd20" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.019s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:08:25 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-b5bb173c-1ac4-478d-b96b-a6576db98029 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2f94a73a1a770bd66922be1f3394655a4b9500c6.converted --force-share --output=json" returned: 0 in 0.158s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:08:25 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-b5bb173c-1ac4-478d-b96b-a6576db98029 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "2f94a73a1a770bd66922be1f3394655a4b9500c6" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.009s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:08:25 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-b5bb173c-1ac4-478d-b96b-a6576db98029 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2f94a73a1a770bd66922be1f3394655a4b9500c6 --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:08:25 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6caa4977-8333-4171-8825-2c3bfb52f80b/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:08:25 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6caa4977-8333-4171-8825-2c3bfb52f80b/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:08:25 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-b5bb173c-1ac4-478d-b96b-a6576db98029 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2f94a73a1a770bd66922be1f3394655a4b9500c6 --force-share --output=json" returned: 0 in 0.132s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:08:25 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-b5bb173c-1ac4-478d-b96b-a6576db98029 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Acquiring lock "2f94a73a1a770bd66922be1f3394655a4b9500c6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:08:25 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-b5bb173c-1ac4-478d-b96b-a6576db98029 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "2f94a73a1a770bd66922be1f3394655a4b9500c6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:08:25 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-b5bb173c-1ac4-478d-b96b-a6576db98029 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2f94a73a1a770bd66922be1f3394655a4b9500c6 --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:08:25 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6caa4977-8333-4171-8825-2c3bfb52f80b/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:08:25 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 16:08:25 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6caa4977-8333-4171-8825-2c3bfb52f80b/disk.rescue --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:08:26 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-b5bb173c-1ac4-478d-b96b-a6576db98029 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2f94a73a1a770bd66922be1f3394655a4b9500c6 --force-share --output=json" returned: 0 in 0.151s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:08:26 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-b5bb173c-1ac4-478d-b96b-a6576db98029 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2f94a73a1a770bd66922be1f3394655a4b9500c6,backing_fmt=raw /opt/stack/data/nova/instances/84683344-2893-4446-90ae-e64cd799eb20/disk 1073741824 {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:08:26 user nova-compute[71874]: DEBUG nova.network.neutron [None req-b5bb173c-1ac4-478d-b96b-a6576db98029 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: 84683344-2893-4446-90ae-e64cd799eb20] Successfully updated port: a8837af3-03f7-4b3d-8a2a-746f2d8038ad {{(pid=71874) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 16:08:26 user nova-compute[71874]: DEBUG nova.compute.manager [req-8b2fe3eb-2e5e-4898-8ea2-2970dd530e39 req-23ee3321-ca83-4e56-9589-d11fd1d49c36 service nova] [instance: 84683344-2893-4446-90ae-e64cd799eb20] Received event network-changed-a8837af3-03f7-4b3d-8a2a-746f2d8038ad {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:08:26 user nova-compute[71874]: DEBUG nova.compute.manager [req-8b2fe3eb-2e5e-4898-8ea2-2970dd530e39 req-23ee3321-ca83-4e56-9589-d11fd1d49c36 service nova] [instance: 84683344-2893-4446-90ae-e64cd799eb20] Refreshing instance network info cache due to event network-changed-a8837af3-03f7-4b3d-8a2a-746f2d8038ad. {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 16:08:26 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-8b2fe3eb-2e5e-4898-8ea2-2970dd530e39 req-23ee3321-ca83-4e56-9589-d11fd1d49c36 service nova] Acquiring lock "refresh_cache-84683344-2893-4446-90ae-e64cd799eb20" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:08:26 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-8b2fe3eb-2e5e-4898-8ea2-2970dd530e39 req-23ee3321-ca83-4e56-9589-d11fd1d49c36 service nova] Acquired lock "refresh_cache-84683344-2893-4446-90ae-e64cd799eb20" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:08:26 user nova-compute[71874]: DEBUG nova.network.neutron [req-8b2fe3eb-2e5e-4898-8ea2-2970dd530e39 req-23ee3321-ca83-4e56-9589-d11fd1d49c36 service nova] [instance: 84683344-2893-4446-90ae-e64cd799eb20] Refreshing network info cache for port a8837af3-03f7-4b3d-8a2a-746f2d8038ad {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 16:08:26 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-b5bb173c-1ac4-478d-b96b-a6576db98029 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2f94a73a1a770bd66922be1f3394655a4b9500c6,backing_fmt=raw /opt/stack/data/nova/instances/84683344-2893-4446-90ae-e64cd799eb20/disk 1073741824" returned: 0 in 0.060s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:08:26 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-b5bb173c-1ac4-478d-b96b-a6576db98029 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "2f94a73a1a770bd66922be1f3394655a4b9500c6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.216s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:08:26 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-b5bb173c-1ac4-478d-b96b-a6576db98029 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2f94a73a1a770bd66922be1f3394655a4b9500c6 --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:08:26 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-b5bb173c-1ac4-478d-b96b-a6576db98029 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Acquiring lock "refresh_cache-84683344-2893-4446-90ae-e64cd799eb20" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:08:26 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6caa4977-8333-4171-8825-2c3bfb52f80b/disk.rescue --force-share --output=json" returned: 0 in 0.209s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:08:26 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6caa4977-8333-4171-8825-2c3bfb52f80b/disk.rescue --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:08:26 user nova-compute[71874]: DEBUG nova.network.neutron [req-8b2fe3eb-2e5e-4898-8ea2-2970dd530e39 req-23ee3321-ca83-4e56-9589-d11fd1d49c36 service nova] [instance: 84683344-2893-4446-90ae-e64cd799eb20] Instance cache missing network info. {{(pid=71874) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 16:08:26 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-b5bb173c-1ac4-478d-b96b-a6576db98029 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2f94a73a1a770bd66922be1f3394655a4b9500c6 --force-share --output=json" returned: 0 in 0.136s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:08:26 user nova-compute[71874]: DEBUG nova.virt.disk.api [None req-b5bb173c-1ac4-478d-b96b-a6576db98029 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Checking if we can resize image /opt/stack/data/nova/instances/84683344-2893-4446-90ae-e64cd799eb20/disk. size=1073741824 {{(pid=71874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 16:08:26 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-b5bb173c-1ac4-478d-b96b-a6576db98029 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84683344-2893-4446-90ae-e64cd799eb20/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:08:26 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6caa4977-8333-4171-8825-2c3bfb52f80b/disk.rescue --force-share --output=json" returned: 0 in 0.143s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:08:26 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afebffae-dbf6-4876-8c9f-0364f0fde49c/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:08:26 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-b5bb173c-1ac4-478d-b96b-a6576db98029 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84683344-2893-4446-90ae-e64cd799eb20/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:08:26 user nova-compute[71874]: DEBUG nova.virt.disk.api [None req-b5bb173c-1ac4-478d-b96b-a6576db98029 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Cannot resize image /opt/stack/data/nova/instances/84683344-2893-4446-90ae-e64cd799eb20/disk to a smaller size. {{(pid=71874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 16:08:26 user nova-compute[71874]: DEBUG nova.objects.instance [None req-b5bb173c-1ac4-478d-b96b-a6576db98029 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lazy-loading 'migration_context' on Instance uuid 84683344-2893-4446-90ae-e64cd799eb20 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:08:26 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-b5bb173c-1ac4-478d-b96b-a6576db98029 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: 84683344-2893-4446-90ae-e64cd799eb20] Created local disks {{(pid=71874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 16:08:26 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-b5bb173c-1ac4-478d-b96b-a6576db98029 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: 84683344-2893-4446-90ae-e64cd799eb20] Ensure instance console log exists: /opt/stack/data/nova/instances/84683344-2893-4446-90ae-e64cd799eb20/console.log {{(pid=71874) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 16:08:26 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-b5bb173c-1ac4-478d-b96b-a6576db98029 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:08:26 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-b5bb173c-1ac4-478d-b96b-a6576db98029 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:08:26 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-b5bb173c-1ac4-478d-b96b-a6576db98029 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:08:26 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afebffae-dbf6-4876-8c9f-0364f0fde49c/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:08:26 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afebffae-dbf6-4876-8c9f-0364f0fde49c/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:08:26 user nova-compute[71874]: DEBUG nova.network.neutron [req-8b2fe3eb-2e5e-4898-8ea2-2970dd530e39 req-23ee3321-ca83-4e56-9589-d11fd1d49c36 service nova] [instance: 84683344-2893-4446-90ae-e64cd799eb20] Updating instance_info_cache with network_info: [] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:08:26 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-8b2fe3eb-2e5e-4898-8ea2-2970dd530e39 req-23ee3321-ca83-4e56-9589-d11fd1d49c36 service nova] Releasing lock "refresh_cache-84683344-2893-4446-90ae-e64cd799eb20" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:08:26 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-b5bb173c-1ac4-478d-b96b-a6576db98029 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Acquired lock "refresh_cache-84683344-2893-4446-90ae-e64cd799eb20" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:08:26 user nova-compute[71874]: DEBUG nova.network.neutron [None req-b5bb173c-1ac4-478d-b96b-a6576db98029 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: 84683344-2893-4446-90ae-e64cd799eb20] Building network info cache for instance {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 16:08:26 user nova-compute[71874]: DEBUG nova.network.neutron [None req-b5bb173c-1ac4-478d-b96b-a6576db98029 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: 84683344-2893-4446-90ae-e64cd799eb20] Instance cache missing network info. {{(pid=71874) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 16:08:26 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afebffae-dbf6-4876-8c9f-0364f0fde49c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:08:26 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78b6940a-f97a-4535-8973-3c2a5befbbab/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:08:26 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78b6940a-f97a-4535-8973-3c2a5befbbab/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:08:26 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78b6940a-f97a-4535-8973-3c2a5befbbab/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:08:27 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78b6940a-f97a-4535-8973-3c2a5befbbab/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:08:27 user nova-compute[71874]: DEBUG nova.network.neutron [None req-b5bb173c-1ac4-478d-b96b-a6576db98029 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: 84683344-2893-4446-90ae-e64cd799eb20] Updating instance_info_cache with network_info: [{"id": "a8837af3-03f7-4b3d-8a2a-746f2d8038ad", "address": "fa:16:3e:71:77:df", "network": {"id": "58f92787-e3b6-4fd3-bd75-7169f1a36651", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-614349033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "236b9e609eb44071bc88971bff96931e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8837af3-03", "ovs_interfaceid": "a8837af3-03f7-4b3d-8a2a-746f2d8038ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:08:27 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:08:27 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:08:27 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:08:27 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Hypervisor/Node resource view: name=user free_ram=7384MB free_disk=25.902294158935547GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71874) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 16:08:27 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:08:27 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:08:27 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-b5bb173c-1ac4-478d-b96b-a6576db98029 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Releasing lock "refresh_cache-84683344-2893-4446-90ae-e64cd799eb20" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:08:27 user nova-compute[71874]: DEBUG nova.compute.manager [None req-b5bb173c-1ac4-478d-b96b-a6576db98029 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: 84683344-2893-4446-90ae-e64cd799eb20] Instance network_info: |[{"id": "a8837af3-03f7-4b3d-8a2a-746f2d8038ad", "address": "fa:16:3e:71:77:df", "network": {"id": "58f92787-e3b6-4fd3-bd75-7169f1a36651", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-614349033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "236b9e609eb44071bc88971bff96931e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8837af3-03", "ovs_interfaceid": "a8837af3-03f7-4b3d-8a2a-746f2d8038ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 16:08:27 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-b5bb173c-1ac4-478d-b96b-a6576db98029 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: 84683344-2893-4446-90ae-e64cd799eb20] Start _get_guest_xml network_info=[{"id": "a8837af3-03f7-4b3d-8a2a-746f2d8038ad", "address": "fa:16:3e:71:77:df", "network": {"id": "58f92787-e3b6-4fd3-bd75-7169f1a36651", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-614349033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "236b9e609eb44071bc88971bff96931e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8837af3-03", "ovs_interfaceid": "a8837af3-03f7-4b3d-8a2a-746f2d8038ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T16:08:20Z,direct_url=<?>,disk_format='qcow2',id=ca200f21-67f7-4581-9bfc-75465abff368,min_disk=0,min_ram=0,name='tempest-scenario-img--845792162',owner='236b9e609eb44071bc88971bff96931e',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T16:08:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_options': None, 'image_id': 'ca200f21-67f7-4581-9bfc-75465abff368'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 16:08:27 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-b5bb173c-1ac4-478d-b96b-a6576db98029 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:08:27 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-b5bb173c-1ac4-478d-b96b-a6576db98029 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:08:27 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-b5bb173c-1ac4-478d-b96b-a6576db98029 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71874) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 16:08:27 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-b5bb173c-1ac4-478d-b96b-a6576db98029 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T15:56:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T16:08:20Z,direct_url=<?>,disk_format='qcow2',id=ca200f21-67f7-4581-9bfc-75465abff368,min_disk=0,min_ram=0,name='tempest-scenario-img--845792162',owner='236b9e609eb44071bc88971bff96931e',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T16:08:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 16:08:27 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-b5bb173c-1ac4-478d-b96b-a6576db98029 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Flavor limits 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 16:08:27 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-b5bb173c-1ac4-478d-b96b-a6576db98029 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Image limits 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 16:08:27 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-b5bb173c-1ac4-478d-b96b-a6576db98029 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Flavor pref 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 16:08:27 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-b5bb173c-1ac4-478d-b96b-a6576db98029 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Image pref 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 16:08:27 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-b5bb173c-1ac4-478d-b96b-a6576db98029 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 16:08:27 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-b5bb173c-1ac4-478d-b96b-a6576db98029 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 16:08:27 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-b5bb173c-1ac4-478d-b96b-a6576db98029 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 16:08:27 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-b5bb173c-1ac4-478d-b96b-a6576db98029 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Got 1 possible topologies {{(pid=71874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 16:08:27 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-b5bb173c-1ac4-478d-b96b-a6576db98029 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 16:08:27 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-b5bb173c-1ac4-478d-b96b-a6576db98029 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 16:08:27 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-b5bb173c-1ac4-478d-b96b-a6576db98029 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T16:08:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-305874148',display_name='tempest-TestMinimumBasicScenario-server-305874148',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-305874148',id=27,image_ref='ca200f21-67f7-4581-9bfc-75465abff368',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP7vpIGcBykOJPr4ws0YtRwaxvjbKaTb5FQPV2F4kO1x9IPpUHiVmLwjEQx1FAApeD4swefMBOlg2jRi0dXdP+/5EMUIcDTR0iUGAbkMPwCdxqyQhFvFmsSM0dq+TS03mg==',key_name='tempest-TestMinimumBasicScenario-1145355827',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='236b9e609eb44071bc88971bff96931e',ramdisk_id='',reservation_id='r-i04av21o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca200f21-67f7-4581-9bfc-75465abff368',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1374695003',owner_user_name='tempest-TestMinimumBasicScenario-1374695003-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T16:08:25Z,user_data=None,user_id='16a68fa3490940ebaebc8d4ca5746f6e',uuid=84683344-2893-4446-90ae-e64cd799eb20,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a8837af3-03f7-4b3d-8a2a-746f2d8038ad", "address": "fa:16:3e:71:77:df", "network": {"id": "58f92787-e3b6-4fd3-bd75-7169f1a36651", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-614349033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "236b9e609eb44071bc88971bff96931e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8837af3-03", "ovs_interfaceid": "a8837af3-03f7-4b3d-8a2a-746f2d8038ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 16:08:27 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-b5bb173c-1ac4-478d-b96b-a6576db98029 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Converting VIF {"id": "a8837af3-03f7-4b3d-8a2a-746f2d8038ad", "address": "fa:16:3e:71:77:df", "network": {"id": "58f92787-e3b6-4fd3-bd75-7169f1a36651", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-614349033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "236b9e609eb44071bc88971bff96931e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8837af3-03", "ovs_interfaceid": "a8837af3-03f7-4b3d-8a2a-746f2d8038ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:08:27 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-b5bb173c-1ac4-478d-b96b-a6576db98029 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:77:df,bridge_name='br-int',has_traffic_filtering=True,id=a8837af3-03f7-4b3d-8a2a-746f2d8038ad,network=Network(58f92787-e3b6-4fd3-bd75-7169f1a36651),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8837af3-03') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:08:27 user nova-compute[71874]: DEBUG nova.objects.instance [None req-b5bb173c-1ac4-478d-b96b-a6576db98029 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lazy-loading 'pci_devices' on Instance uuid 84683344-2893-4446-90ae-e64cd799eb20 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:08:27 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:08:27 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-b5bb173c-1ac4-478d-b96b-a6576db98029 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: 84683344-2893-4446-90ae-e64cd799eb20] End _get_guest_xml xml=<domain type="kvm">
Apr 12 16:08:27 user nova-compute[71874]:   <uuid>84683344-2893-4446-90ae-e64cd799eb20</uuid>
Apr 12 16:08:27 user nova-compute[71874]:   <name>instance-0000001b</name>
Apr 12 16:08:27 user nova-compute[71874]:   <memory>131072</memory>
Apr 12 16:08:27 user nova-compute[71874]:   <vcpu>1</vcpu>
Apr 12 16:08:27 user nova-compute[71874]:   <metadata>
Apr 12 16:08:27 user nova-compute[71874]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 16:08:27 user nova-compute[71874]:       <nova:package version="0.0.0"/>
Apr 12 16:08:27 user nova-compute[71874]:       <nova:name>tempest-TestMinimumBasicScenario-server-305874148</nova:name>
Apr 12 16:08:27 user nova-compute[71874]:       <nova:creationTime>2023-04-12 16:08:27</nova:creationTime>
Apr 12 16:08:27 user nova-compute[71874]:       <nova:flavor name="m1.nano">
Apr 12 16:08:27 user nova-compute[71874]:         <nova:memory>128</nova:memory>
Apr 12 16:08:27 user nova-compute[71874]:         <nova:disk>1</nova:disk>
Apr 12 16:08:27 user nova-compute[71874]:         <nova:swap>0</nova:swap>
Apr 12 16:08:27 user nova-compute[71874]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 16:08:27 user nova-compute[71874]:         <nova:vcpus>1</nova:vcpus>
Apr 12 16:08:27 user nova-compute[71874]:       </nova:flavor>
Apr 12 16:08:27 user nova-compute[71874]:       <nova:owner>
Apr 12 16:08:27 user nova-compute[71874]:         <nova:user uuid="16a68fa3490940ebaebc8d4ca5746f6e">tempest-TestMinimumBasicScenario-1374695003-project-member</nova:user>
Apr 12 16:08:27 user nova-compute[71874]:         <nova:project uuid="236b9e609eb44071bc88971bff96931e">tempest-TestMinimumBasicScenario-1374695003</nova:project>
Apr 12 16:08:27 user nova-compute[71874]:       </nova:owner>
Apr 12 16:08:27 user nova-compute[71874]:       <nova:root type="image" uuid="ca200f21-67f7-4581-9bfc-75465abff368"/>
Apr 12 16:08:27 user nova-compute[71874]:       <nova:ports>
Apr 12 16:08:27 user nova-compute[71874]:         <nova:port uuid="a8837af3-03f7-4b3d-8a2a-746f2d8038ad">
Apr 12 16:08:27 user nova-compute[71874]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 12 16:08:27 user nova-compute[71874]:         </nova:port>
Apr 12 16:08:27 user nova-compute[71874]:       </nova:ports>
Apr 12 16:08:27 user nova-compute[71874]:     </nova:instance>
Apr 12 16:08:27 user nova-compute[71874]:   </metadata>
Apr 12 16:08:27 user nova-compute[71874]:   <sysinfo type="smbios">
Apr 12 16:08:27 user nova-compute[71874]:     <system>
Apr 12 16:08:27 user nova-compute[71874]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 16:08:27 user nova-compute[71874]:       <entry name="product">OpenStack Nova</entry>
Apr 12 16:08:27 user nova-compute[71874]:       <entry name="version">0.0.0</entry>
Apr 12 16:08:27 user nova-compute[71874]:       <entry name="serial">84683344-2893-4446-90ae-e64cd799eb20</entry>
Apr 12 16:08:27 user nova-compute[71874]:       <entry name="uuid">84683344-2893-4446-90ae-e64cd799eb20</entry>
Apr 12 16:08:27 user nova-compute[71874]:       <entry name="family">Virtual Machine</entry>
Apr 12 16:08:27 user nova-compute[71874]:     </system>
Apr 12 16:08:27 user nova-compute[71874]:   </sysinfo>
Apr 12 16:08:27 user nova-compute[71874]:   <os>
Apr 12 16:08:27 user nova-compute[71874]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 16:08:27 user nova-compute[71874]:     <boot dev="hd"/>
Apr 12 16:08:27 user nova-compute[71874]:     <smbios mode="sysinfo"/>
Apr 12 16:08:27 user nova-compute[71874]:   </os>
Apr 12 16:08:27 user nova-compute[71874]:   <features>
Apr 12 16:08:27 user nova-compute[71874]:     <acpi/>
Apr 12 16:08:27 user nova-compute[71874]:     <apic/>
Apr 12 16:08:27 user nova-compute[71874]:     <vmcoreinfo/>
Apr 12 16:08:27 user nova-compute[71874]:   </features>
Apr 12 16:08:27 user nova-compute[71874]:   <clock offset="utc">
Apr 12 16:08:27 user nova-compute[71874]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 16:08:27 user nova-compute[71874]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 16:08:27 user nova-compute[71874]:     <timer name="hpet" present="no"/>
Apr 12 16:08:27 user nova-compute[71874]:   </clock>
Apr 12 16:08:27 user nova-compute[71874]:   <cpu mode="custom" match="exact">
Apr 12 16:08:27 user nova-compute[71874]:     <model>Nehalem</model>
Apr 12 16:08:27 user nova-compute[71874]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 16:08:27 user nova-compute[71874]:   </cpu>
Apr 12 16:08:27 user nova-compute[71874]:   <devices>
Apr 12 16:08:27 user nova-compute[71874]:     <disk type="file" device="disk">
Apr 12 16:08:27 user nova-compute[71874]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 16:08:27 user nova-compute[71874]:       <source file="/opt/stack/data/nova/instances/84683344-2893-4446-90ae-e64cd799eb20/disk"/>
Apr 12 16:08:27 user nova-compute[71874]:       <target dev="vda" bus="virtio"/>
Apr 12 16:08:27 user nova-compute[71874]:     </disk>
Apr 12 16:08:27 user nova-compute[71874]:     <interface type="ethernet">
Apr 12 16:08:27 user nova-compute[71874]:       <mac address="fa:16:3e:71:77:df"/>
Apr 12 16:08:27 user nova-compute[71874]:       <model type="virtio"/>
Apr 12 16:08:27 user nova-compute[71874]:       <mtu size="1442"/>
Apr 12 16:08:27 user nova-compute[71874]:       <target dev="tapa8837af3-03"/>
Apr 12 16:08:27 user nova-compute[71874]:     </interface>
Apr 12 16:08:27 user nova-compute[71874]:     <serial type="pty">
Apr 12 16:08:27 user nova-compute[71874]:       <log file="/opt/stack/data/nova/instances/84683344-2893-4446-90ae-e64cd799eb20/console.log" append="off"/>
Apr 12 16:08:27 user nova-compute[71874]:     </serial>
Apr 12 16:08:27 user nova-compute[71874]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 16:08:27 user nova-compute[71874]:     <video>
Apr 12 16:08:27 user nova-compute[71874]:       <model type="virtio"/>
Apr 12 16:08:27 user nova-compute[71874]:     </video>
Apr 12 16:08:27 user nova-compute[71874]:     <rng model="virtio">
Apr 12 16:08:27 user nova-compute[71874]:       <backend model="random">/dev/urandom</backend>
Apr 12 16:08:27 user nova-compute[71874]:     </rng>
Apr 12 16:08:27 user nova-compute[71874]:     <controller type="usb" index="0" model="none"/>
Apr 12 16:08:27 user nova-compute[71874]:     <memballoon model="virtio">
Apr 12 16:08:27 user nova-compute[71874]:       <stats period="10"/>
Apr 12 16:08:27 user nova-compute[71874]:     </memballoon>
Apr 12 16:08:27 user nova-compute[71874]:   </devices>
Apr 12 16:08:27 user nova-compute[71874]: </domain>
Apr 12 16:08:27 user nova-compute[71874]:  {{(pid=71874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 16:08:27 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-b5bb173c-1ac4-478d-b96b-a6576db98029 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T16:08:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-305874148',display_name='tempest-TestMinimumBasicScenario-server-305874148',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-305874148',id=27,image_ref='ca200f21-67f7-4581-9bfc-75465abff368',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP7vpIGcBykOJPr4ws0YtRwaxvjbKaTb5FQPV2F4kO1x9IPpUHiVmLwjEQx1FAApeD4swefMBOlg2jRi0dXdP+/5EMUIcDTR0iUGAbkMPwCdxqyQhFvFmsSM0dq+TS03mg==',key_name='tempest-TestMinimumBasicScenario-1145355827',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='236b9e609eb44071bc88971bff96931e',ramdisk_id='',reservation_id='r-i04av21o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca200f21-67f7-4581-9bfc-75465abff368',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1374695003',owner_user_name='tempest-TestMinimumBasicScenario-1374695003-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T16:08:25Z,user_data=None,user_id='16a68fa3490940ebaebc8d4ca5746f6e',uuid=84683344-2893-4446-90ae-e64cd799eb20,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a8837af3-03f7-4b3d-8a2a-746f2d8038ad", "address": "fa:16:3e:71:77:df", "network": {"id": "58f92787-e3b6-4fd3-bd75-7169f1a36651", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-614349033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "236b9e609eb44071bc88971bff96931e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8837af3-03", "ovs_interfaceid": "a8837af3-03f7-4b3d-8a2a-746f2d8038ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 16:08:27 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-b5bb173c-1ac4-478d-b96b-a6576db98029 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Converting VIF {"id": "a8837af3-03f7-4b3d-8a2a-746f2d8038ad", "address": "fa:16:3e:71:77:df", "network": {"id": "58f92787-e3b6-4fd3-bd75-7169f1a36651", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-614349033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "236b9e609eb44071bc88971bff96931e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8837af3-03", "ovs_interfaceid": "a8837af3-03f7-4b3d-8a2a-746f2d8038ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:08:27 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-b5bb173c-1ac4-478d-b96b-a6576db98029 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:77:df,bridge_name='br-int',has_traffic_filtering=True,id=a8837af3-03f7-4b3d-8a2a-746f2d8038ad,network=Network(58f92787-e3b6-4fd3-bd75-7169f1a36651),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8837af3-03') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:08:27 user nova-compute[71874]: DEBUG os_vif [None req-b5bb173c-1ac4-478d-b96b-a6576db98029 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:77:df,bridge_name='br-int',has_traffic_filtering=True,id=a8837af3-03f7-4b3d-8a2a-746f2d8038ad,network=Network(58f92787-e3b6-4fd3-bd75-7169f1a36651),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8837af3-03') {{(pid=71874) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 16:08:27 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:08:27 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:08:27 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 16:08:27 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:08:27 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa8837af3-03, may_exist=True) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:08:27 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa8837af3-03, col_values=(('external_ids', {'iface-id': 'a8837af3-03f7-4b3d-8a2a-746f2d8038ad', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:71:77:df', 'vm-uuid': '84683344-2893-4446-90ae-e64cd799eb20'}),)) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:08:27 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:08:27 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Applying migration context for instance dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 as it has an incoming, in-progress migration 1fde283e-efad-42fd-8a25-d8ba63358bb1. Migration status is post-migrating {{(pid=71874) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:950}}
Apr 12 16:08:27 user nova-compute[71874]: INFO nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Updating resource usage from migration 1fde283e-efad-42fd-8a25-d8ba63358bb1
Apr 12 16:08:27 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:08:27 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:08:27 user nova-compute[71874]: INFO os_vif [None req-b5bb173c-1ac4-478d-b96b-a6576db98029 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:77:df,bridge_name='br-int',has_traffic_filtering=True,id=a8837af3-03f7-4b3d-8a2a-746f2d8038ad,network=Network(58f92787-e3b6-4fd3-bd75-7169f1a36651),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8837af3-03')
Apr 12 16:08:28 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance afebffae-dbf6-4876-8c9f-0364f0fde49c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:08:28 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 473a30c4-5aa4-481c-8859-fda815d14872 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:08:28 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 608fbea2-b42b-4bb9-94a7-2b76dcdc2001 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:08:28 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance f52ee906-c8fd-4cd5-842e-de98a5099c4f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:08:28 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:08:28 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 6caa4977-8333-4171-8825-2c3bfb52f80b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:08:28 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 357dd90d-8c53-4193-ad64-edfa894116cf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:08:28 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:08:28 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 78b6940a-f97a-4535-8973-3c2a5befbbab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:08:28 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 7f641c6b-b508-42a7-ae98-c2bfb841d798 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:08:28 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 016ae41d-b098-4126-ace7-3da00b40cb9c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:08:28 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Migration 1fde283e-efad-42fd-8a25-d8ba63358bb1 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1637}}
Apr 12 16:08:28 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:08:28 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 84683344-2893-4446-90ae-e64cd799eb20 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:08:28 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=71874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 16:08:28 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Final resource view: name=user phys_ram=16023MB used_ram=2368MB phys_disk=40GB used_disk=13GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=71874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 16:08:28 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-b5bb173c-1ac4-478d-b96b-a6576db98029 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] No BDM found with device name vda, not building metadata. {{(pid=71874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 16:08:28 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-b5bb173c-1ac4-478d-b96b-a6576db98029 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] No VIF found with MAC fa:16:3e:71:77:df, not building metadata {{(pid=71874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 16:08:28 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Inventory has not changed in ProviderTree for provider: 0e94b4c8-cd49-45e4-9133-d36eb4b2456b {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 16:08:28 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Inventory has not changed for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 16:08:28 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Compute_service record updated for user:user {{(pid=71874) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 16:08:28 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.622s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:08:28 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:08:28 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:08:28 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:08:28 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:08:28 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:08:29 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Starting finish_migration {{(pid=71874) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11647}}
Apr 12 16:08:29 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Instance directory exists: not creating {{(pid=71874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 12 16:08:29 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Creating image(s)
Apr 12 16:08:29 user nova-compute[71874]: DEBUG nova.objects.instance [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lazy-loading 'trusted_certs' on Instance uuid dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:08:29 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:08:29 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json" returned: 0 in 0.127s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:08:29 user nova-compute[71874]: DEBUG nova.virt.disk.api [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Checking if we can resize image /opt/stack/data/nova/instances/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1/disk. size=1073741824 {{(pid=71874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 16:08:29 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:08:29 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:08:29 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:08:29 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:08:29 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:08:29 user nova-compute[71874]: DEBUG nova.virt.disk.api [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Cannot resize image /opt/stack/data/nova/instances/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1/disk to a smaller size. {{(pid=71874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 16:08:29 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Did not create local disks {{(pid=71874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 12 16:08:29 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Ensure instance console log exists: /opt/stack/data/nova/instances/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1/console.log {{(pid=71874) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 16:08:29 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:08:29 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:08:29 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:08:29 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Start _get_guest_xml network_info=[{"id": "18196ae0-d9c1-4814-8803-c4ba8ad4ab45", "address": "fa:16:3e:98:72:fa", "network": {"id": "e6694358-e361-4952-b859-93755c11721e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-667152893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-667152893-network", "vif_mac": "fa:16:3e:98:72:fa"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97ea81bd1962466bbe552424973f71a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18196ae0-d9", "ovs_interfaceid": "18196ae0-d9c1-4814-8803-c4ba8ad4ab45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T15:55:37Z,direct_url=<?>,disk_format='qcow2',id=9dc63f14-8b70-4e72-89f2-13464f2f5c7c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='61a4936d9b7744c0b488d81c9b7746b6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T15:55:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_options': None, 'image_id': '9dc63f14-8b70-4e72-89f2-13464f2f5c7c'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'delete_on_termination': False, 'attachment_id': '45d5dc0a-4121-4125-afcf-f6e8a4daa2fe', 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RGWZNvlY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1', 'attached_at': '2023-04-12T16:08:29.000000', 'detached_at': '', 'volume_id': '9baf883b-de18-43f0-a9d8-fc850bd83297', 'serial': '9baf883b-de18-43f0-a9d8-fc850bd83297'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': None, 'volume_type': None} {{(pid=71874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 16:08:29 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:08:29 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:08:29 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71874) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 16:08:29 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T15:56:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=192,name='m1.micro',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T15:55:37Z,direct_url=<?>,disk_format='qcow2',id=9dc63f14-8b70-4e72-89f2-13464f2f5c7c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='61a4936d9b7744c0b488d81c9b7746b6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T15:55:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 16:08:29 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Flavor limits 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 16:08:29 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Image limits 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 16:08:29 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Flavor pref 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 16:08:29 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Image pref 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 16:08:29 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 16:08:29 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 16:08:29 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 16:08:29 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Got 1 possible topologies {{(pid=71874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 16:08:29 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 16:08:29 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 16:08:29 user nova-compute[71874]: DEBUG nova.objects.instance [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lazy-loading 'vcpu_model' on Instance uuid dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:08:29 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Calling os-brick to attach iSCSI Volume {{(pid=71874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 16:08:29 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3c0216320>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RGWZNvlY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:08:29 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:08:29 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:08:29 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:08:29 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:08:29 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:08:29 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:08:29 user nova-compute[71874]: INFO os_brick.initiator.connectors.iscsi [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 16:08:29 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 -p 172.16.0.220:3260 {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:08:29 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 -p 172.16.0.220:3260" returned: 21 in 0.030s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:08:29 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[328f1933-3584-4572-ab3c-5aac41721604]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:08:29 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 16:08:29 user nova-compute[71874]:  {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:08:29 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 -p 172.16.0.220:3260 --interface default --op new {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:08:29 user nova-compute[71874]: DEBUG nova.compute.manager [req-142c6609-ca5e-4bfb-acbe-542c647119a9 req-dff608ac-bffd-4005-b6cf-d64873f3ca81 service nova] [instance: 84683344-2893-4446-90ae-e64cd799eb20] Received event network-vif-plugged-a8837af3-03f7-4b3d-8a2a-746f2d8038ad {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:08:29 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-142c6609-ca5e-4bfb-acbe-542c647119a9 req-dff608ac-bffd-4005-b6cf-d64873f3ca81 service nova] Acquiring lock "84683344-2893-4446-90ae-e64cd799eb20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:08:29 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-142c6609-ca5e-4bfb-acbe-542c647119a9 req-dff608ac-bffd-4005-b6cf-d64873f3ca81 service nova] Lock "84683344-2893-4446-90ae-e64cd799eb20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:08:29 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-142c6609-ca5e-4bfb-acbe-542c647119a9 req-dff608ac-bffd-4005-b6cf-d64873f3ca81 service nova] Lock "84683344-2893-4446-90ae-e64cd799eb20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:08:29 user nova-compute[71874]: DEBUG nova.compute.manager [req-142c6609-ca5e-4bfb-acbe-542c647119a9 req-dff608ac-bffd-4005-b6cf-d64873f3ca81 service nova] [instance: 84683344-2893-4446-90ae-e64cd799eb20] No waiting events found dispatching network-vif-plugged-a8837af3-03f7-4b3d-8a2a-746f2d8038ad {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:08:29 user nova-compute[71874]: WARNING nova.compute.manager [req-142c6609-ca5e-4bfb-acbe-542c647119a9 req-dff608ac-bffd-4005-b6cf-d64873f3ca81 service nova] [instance: 84683344-2893-4446-90ae-e64cd799eb20] Received unexpected event network-vif-plugged-a8837af3-03f7-4b3d-8a2a-746f2d8038ad for instance with vm_state building and task_state spawning.
Apr 12 16:08:29 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:08:29 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffb2fe74-39ee-4b31-87d1-ea9172a6ae4b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297] added\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:08:29 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297] added
Apr 12 16:08:29 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:08:29 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:08:29 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:08:29 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ab3b917-ce7a-4b18-919a-5bb4f5a51b3a]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:08:29 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:08:29 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:08:29 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:08:29 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[016aa25e-9d0e-40fe-bfad-038398b1f836]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:08:29 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:08:29 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RGWZNvlY {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:08:29 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RGWZNvlY" returned: 0 in 0.018s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:08:29 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[9534b091-a859-4a67-b066-de33ff8f887d]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:08:29 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RGWZNvlY'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:08:29 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:08:29 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:08:29 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[80d2a2a8-c8c6-4001-b4ba-de57c0bbc1d7]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:08:29 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:08:29 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:08:29 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:08:29 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[86db4ee9-cd46-4416-98ea-d30740a35e36]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cc863d9-b797-4b5b-b8ce-30ebe55b9519 (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:08:29 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:08:29 user nova-compute[71874]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cc863d9-b797-4b5b-b8ce-30ebe55b9519 (non-flash)
Apr 12 16:08:29 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:08:29 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:08:29 user nova-compute[71874]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cc863d9-b797-4b5b-b8ce-30ebe55b9519 (non-flash)
Apr 12 16:08:29 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:08:29 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 -p 172.16.0.220:3260 --login {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:08:29 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 -p 172.16.0.220:3260 --login" returned: 0 in 0.124s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:08:29 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[83162501-138c-4fce-b404-dfe4db3fb5c4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:08:29 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297, portal: 172.16.0.220,3260]
Apr 12 16:08:29 user nova-compute[71874]: Login to [iface: default, target: iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297, portal: 172.16.0.220,3260] successful.
Apr 12 16:08:29 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:08:29 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:08:29 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:08:29 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[86b60189-97de-4b33-83a4-8214f9527985]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:08:29 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:08:29 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:08:29 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:08:29 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce1d9fda-8785-4a03-b362-3aeda5d7e8a7]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cc863d9-b797-4b5b-b8ce-30ebe55b9519 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:08:29 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:08:29 user nova-compute[71874]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cc863d9-b797-4b5b-b8ce-30ebe55b9519 (non-flash)
Apr 12 16:08:29 user nova-compute[71874]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 (non-flash)
Apr 12 16:08:29 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:08:29 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:08:29 user nova-compute[71874]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cc863d9-b797-4b5b-b8ce-30ebe55b9519 (non-flash)
Apr 12 16:08:29 user nova-compute[71874]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 (non-flash)
Apr 12 16:08:29 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:08:29 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.378s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:08:29 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Connected to 172.16.0.220:3260 {{(pid=71874) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 16:08:29 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] HCTL ('35', '-', '-', 0) found on session 26 with lun 0 {{(pid=71874) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 16:08:29 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71874) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 16:08:29 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:08:29 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.023s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:08:29 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff185bbf-a601-46cc-b1dd-3c21a1f44291]: (4, ('- - 0', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:08:29 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Searching for a device in session 26 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71874) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 16:08:29 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RGWZNvlY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71874) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 16:08:30 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:08:30 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:08:30 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:08:30 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.428s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:08:30 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] <== connect_volume: return (1430ms) {'type': 'block', 'scsi_wwn': '23761343031333330', 'path': '/dev/sdd'} {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:08:30 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23761343031333330', 'path': '/dev/sdd'} {{(pid=71874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 16:08:31 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-12T15:59:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1390712116',display_name='tempest-ServerActionsTestJSON-server-416657090',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1390712116',id=4,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNmXVADjvoPSh3uGCGCTNS/vcfcDtUjn/vZEaV3bCllfz1ZO8VIgFuZhP+mAsa+G/KA4ubi5U9Vj41YtHGsakdPR5VoByhorvfUv/PIWtER2tn1LWX2mlFyT+T8AEJplPw==',key_name='tempest-keypair-1923467613',keypairs=<?>,launch_index=0,launched_at=2023-04-12T16:03:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='97ea81bd1962466bbe552424973f71a8',ramdisk_id='',reservation_id='r-y3c7iw20',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-631887779',owner_user_name='tempest-ServerActionsTestJSON-631887779-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T16:08:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1a699b3ba8304eadb8a53d465ea340cf',uuid=dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "18196ae0-d9c1-4814-8803-c4ba8ad4ab45", "address": "fa:16:3e:98:72:fa", "network": {"id": "e6694358-e361-4952-b859-93755c11721e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-667152893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-667152893-network", "vif_mac": "fa:16:3e:98:72:fa"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97ea81bd1962466bbe552424973f71a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18196ae0-d9", "ovs_interfaceid": "18196ae0-d9c1-4814-8803-c4ba8ad4ab45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 16:08:31 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Converting VIF {"id": "18196ae0-d9c1-4814-8803-c4ba8ad4ab45", "address": "fa:16:3e:98:72:fa", "network": {"id": "e6694358-e361-4952-b859-93755c11721e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-667152893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-667152893-network", "vif_mac": "fa:16:3e:98:72:fa"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97ea81bd1962466bbe552424973f71a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18196ae0-d9", "ovs_interfaceid": "18196ae0-d9c1-4814-8803-c4ba8ad4ab45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:08:31 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:72:fa,bridge_name='br-int',has_traffic_filtering=True,id=18196ae0-d9c1-4814-8803-c4ba8ad4ab45,network=Network(e6694358-e361-4952-b859-93755c11721e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18196ae0-d9') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:08:31 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] End _get_guest_xml xml=<domain type="kvm">
Apr 12 16:08:31 user nova-compute[71874]:   <uuid>dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1</uuid>
Apr 12 16:08:31 user nova-compute[71874]:   <name>instance-00000004</name>
Apr 12 16:08:31 user nova-compute[71874]:   <memory>196608</memory>
Apr 12 16:08:31 user nova-compute[71874]:   <vcpu>1</vcpu>
Apr 12 16:08:31 user nova-compute[71874]:   <metadata>
Apr 12 16:08:31 user nova-compute[71874]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 16:08:31 user nova-compute[71874]:       <nova:package version="0.0.0"/>
Apr 12 16:08:31 user nova-compute[71874]:       <nova:name>tempest-ServerActionsTestJSON-server-416657090</nova:name>
Apr 12 16:08:31 user nova-compute[71874]:       <nova:creationTime>2023-04-12 16:08:29</nova:creationTime>
Apr 12 16:08:31 user nova-compute[71874]:       <nova:flavor name="m1.micro">
Apr 12 16:08:31 user nova-compute[71874]:         <nova:memory>192</nova:memory>
Apr 12 16:08:31 user nova-compute[71874]:         <nova:disk>1</nova:disk>
Apr 12 16:08:31 user nova-compute[71874]:         <nova:swap>0</nova:swap>
Apr 12 16:08:31 user nova-compute[71874]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 16:08:31 user nova-compute[71874]:         <nova:vcpus>1</nova:vcpus>
Apr 12 16:08:31 user nova-compute[71874]:       </nova:flavor>
Apr 12 16:08:31 user nova-compute[71874]:       <nova:owner>
Apr 12 16:08:31 user nova-compute[71874]:         <nova:user uuid="1a699b3ba8304eadb8a53d465ea340cf">tempest-ServerActionsTestJSON-631887779-project-member</nova:user>
Apr 12 16:08:31 user nova-compute[71874]:         <nova:project uuid="97ea81bd1962466bbe552424973f71a8">tempest-ServerActionsTestJSON-631887779</nova:project>
Apr 12 16:08:31 user nova-compute[71874]:       </nova:owner>
Apr 12 16:08:31 user nova-compute[71874]:       <nova:root type="image" uuid="9dc63f14-8b70-4e72-89f2-13464f2f5c7c"/>
Apr 12 16:08:31 user nova-compute[71874]:       <nova:ports>
Apr 12 16:08:31 user nova-compute[71874]:         <nova:port uuid="18196ae0-d9c1-4814-8803-c4ba8ad4ab45">
Apr 12 16:08:31 user nova-compute[71874]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 12 16:08:31 user nova-compute[71874]:         </nova:port>
Apr 12 16:08:31 user nova-compute[71874]:       </nova:ports>
Apr 12 16:08:31 user nova-compute[71874]:     </nova:instance>
Apr 12 16:08:31 user nova-compute[71874]:   </metadata>
Apr 12 16:08:31 user nova-compute[71874]:   <sysinfo type="smbios">
Apr 12 16:08:31 user nova-compute[71874]:     <system>
Apr 12 16:08:31 user nova-compute[71874]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 16:08:31 user nova-compute[71874]:       <entry name="product">OpenStack Nova</entry>
Apr 12 16:08:31 user nova-compute[71874]:       <entry name="version">0.0.0</entry>
Apr 12 16:08:31 user nova-compute[71874]:       <entry name="serial">dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1</entry>
Apr 12 16:08:31 user nova-compute[71874]:       <entry name="uuid">dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1</entry>
Apr 12 16:08:31 user nova-compute[71874]:       <entry name="family">Virtual Machine</entry>
Apr 12 16:08:31 user nova-compute[71874]:     </system>
Apr 12 16:08:31 user nova-compute[71874]:   </sysinfo>
Apr 12 16:08:31 user nova-compute[71874]:   <os>
Apr 12 16:08:31 user nova-compute[71874]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 16:08:31 user nova-compute[71874]:     <boot dev="hd"/>
Apr 12 16:08:31 user nova-compute[71874]:     <smbios mode="sysinfo"/>
Apr 12 16:08:31 user nova-compute[71874]:   </os>
Apr 12 16:08:31 user nova-compute[71874]:   <features>
Apr 12 16:08:31 user nova-compute[71874]:     <acpi/>
Apr 12 16:08:31 user nova-compute[71874]:     <apic/>
Apr 12 16:08:31 user nova-compute[71874]:     <vmcoreinfo/>
Apr 12 16:08:31 user nova-compute[71874]:   </features>
Apr 12 16:08:31 user nova-compute[71874]:   <clock offset="utc">
Apr 12 16:08:31 user nova-compute[71874]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 16:08:31 user nova-compute[71874]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 16:08:31 user nova-compute[71874]:     <timer name="hpet" present="no"/>
Apr 12 16:08:31 user nova-compute[71874]:   </clock>
Apr 12 16:08:31 user nova-compute[71874]:   <cpu mode="custom" match="exact">
Apr 12 16:08:31 user nova-compute[71874]:     <model>Nehalem</model>
Apr 12 16:08:31 user nova-compute[71874]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 16:08:31 user nova-compute[71874]:   </cpu>
Apr 12 16:08:31 user nova-compute[71874]:   <devices>
Apr 12 16:08:31 user nova-compute[71874]:     <disk type="file" device="disk">
Apr 12 16:08:31 user nova-compute[71874]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 16:08:31 user nova-compute[71874]:       <source file="/opt/stack/data/nova/instances/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1/disk"/>
Apr 12 16:08:31 user nova-compute[71874]:       <target dev="vda" bus="virtio"/>
Apr 12 16:08:31 user nova-compute[71874]:     </disk>
Apr 12 16:08:31 user nova-compute[71874]:     <disk type="block" device="disk">
Apr 12 16:08:31 user nova-compute[71874]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 16:08:31 user nova-compute[71874]:       <source dev="/dev/sdd"/>
Apr 12 16:08:31 user nova-compute[71874]:       <target dev="vdb" bus="virtio"/>
Apr 12 16:08:31 user nova-compute[71874]:       <serial>9baf883b-de18-43f0-a9d8-fc850bd83297</serial>
Apr 12 16:08:31 user nova-compute[71874]:     </disk>
Apr 12 16:08:31 user nova-compute[71874]:     <interface type="ethernet">
Apr 12 16:08:31 user nova-compute[71874]:       <mac address="fa:16:3e:98:72:fa"/>
Apr 12 16:08:31 user nova-compute[71874]:       <model type="virtio"/>
Apr 12 16:08:31 user nova-compute[71874]:       <mtu size="1442"/>
Apr 12 16:08:31 user nova-compute[71874]:       <target dev="tap18196ae0-d9"/>
Apr 12 16:08:31 user nova-compute[71874]:     </interface>
Apr 12 16:08:31 user nova-compute[71874]:     <serial type="pty">
Apr 12 16:08:31 user nova-compute[71874]:       <log file="/opt/stack/data/nova/instances/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1/console.log" append="off"/>
Apr 12 16:08:31 user nova-compute[71874]:     </serial>
Apr 12 16:08:31 user nova-compute[71874]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 16:08:31 user nova-compute[71874]:     <video>
Apr 12 16:08:31 user nova-compute[71874]:       <model type="virtio"/>
Apr 12 16:08:31 user nova-compute[71874]:     </video>
Apr 12 16:08:31 user nova-compute[71874]:     <rng model="virtio">
Apr 12 16:08:31 user nova-compute[71874]:       <backend model="random">/dev/urandom</backend>
Apr 12 16:08:31 user nova-compute[71874]:     </rng>
Apr 12 16:08:31 user nova-compute[71874]:     <controller type="usb" index="0" model="none"/>
Apr 12 16:08:31 user nova-compute[71874]:     <memballoon model="virtio">
Apr 12 16:08:31 user nova-compute[71874]:       <stats period="10"/>
Apr 12 16:08:31 user nova-compute[71874]:     </memballoon>
Apr 12 16:08:31 user nova-compute[71874]:   </devices>
Apr 12 16:08:31 user nova-compute[71874]: </domain>
Apr 12 16:08:31 user nova-compute[71874]:  {{(pid=71874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 16:08:31 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-12T15:59:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1390712116',display_name='tempest-ServerActionsTestJSON-server-416657090',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1390712116',id=4,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNmXVADjvoPSh3uGCGCTNS/vcfcDtUjn/vZEaV3bCllfz1ZO8VIgFuZhP+mAsa+G/KA4ubi5U9Vj41YtHGsakdPR5VoByhorvfUv/PIWtER2tn1LWX2mlFyT+T8AEJplPw==',key_name='tempest-keypair-1923467613',keypairs=<?>,launch_index=0,launched_at=2023-04-12T16:03:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='97ea81bd1962466bbe552424973f71a8',ramdisk_id='',reservation_id='r-y3c7iw20',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-631887779',owner_user_name='tempest-ServerActionsTestJSON-631887779-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T16:08:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1a699b3ba8304eadb8a53d465ea340cf',uuid=dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "18196ae0-d9c1-4814-8803-c4ba8ad4ab45", "address": "fa:16:3e:98:72:fa", "network": {"id": "e6694358-e361-4952-b859-93755c11721e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-667152893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-667152893-network", "vif_mac": "fa:16:3e:98:72:fa"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97ea81bd1962466bbe552424973f71a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18196ae0-d9", "ovs_interfaceid": "18196ae0-d9c1-4814-8803-c4ba8ad4ab45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 16:08:31 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Converting VIF {"id": "18196ae0-d9c1-4814-8803-c4ba8ad4ab45", "address": "fa:16:3e:98:72:fa", "network": {"id": "e6694358-e361-4952-b859-93755c11721e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-667152893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-667152893-network", "vif_mac": "fa:16:3e:98:72:fa"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97ea81bd1962466bbe552424973f71a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18196ae0-d9", "ovs_interfaceid": "18196ae0-d9c1-4814-8803-c4ba8ad4ab45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:08:31 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:72:fa,bridge_name='br-int',has_traffic_filtering=True,id=18196ae0-d9c1-4814-8803-c4ba8ad4ab45,network=Network(e6694358-e361-4952-b859-93755c11721e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18196ae0-d9') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:08:31 user nova-compute[71874]: DEBUG os_vif [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:72:fa,bridge_name='br-int',has_traffic_filtering=True,id=18196ae0-d9c1-4814-8803-c4ba8ad4ab45,network=Network(e6694358-e361-4952-b859-93755c11721e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18196ae0-d9') {{(pid=71874) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 16:08:31 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:08:31 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:08:31 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 16:08:31 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:08:31 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap18196ae0-d9, may_exist=True) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:08:31 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap18196ae0-d9, col_values=(('external_ids', {'iface-id': '18196ae0-d9c1-4814-8803-c4ba8ad4ab45', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:98:72:fa', 'vm-uuid': 'dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1'}),)) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:08:31 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:08:31 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:08:31 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:08:31 user nova-compute[71874]: INFO os_vif [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:72:fa,bridge_name='br-int',has_traffic_filtering=True,id=18196ae0-d9c1-4814-8803-c4ba8ad4ab45,network=Network(e6694358-e361-4952-b859-93755c11721e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18196ae0-d9')
Apr 12 16:08:31 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] No BDM found with device name vda, not building metadata. {{(pid=71874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 16:08:31 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 16:08:31 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] No VIF found with MAC fa:16:3e:98:72:fa, not building metadata {{(pid=71874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 16:08:31 user nova-compute[71874]: DEBUG nova.compute.manager [req-56b28078-b45b-4327-b8f0-a562a59903e9 req-343c1608-0d92-43d9-8c33-fc646ff065d8 service nova] [instance: 84683344-2893-4446-90ae-e64cd799eb20] Received event network-vif-plugged-a8837af3-03f7-4b3d-8a2a-746f2d8038ad {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:08:31 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-56b28078-b45b-4327-b8f0-a562a59903e9 req-343c1608-0d92-43d9-8c33-fc646ff065d8 service nova] Acquiring lock "84683344-2893-4446-90ae-e64cd799eb20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:08:31 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-56b28078-b45b-4327-b8f0-a562a59903e9 req-343c1608-0d92-43d9-8c33-fc646ff065d8 service nova] Lock "84683344-2893-4446-90ae-e64cd799eb20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:08:31 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-56b28078-b45b-4327-b8f0-a562a59903e9 req-343c1608-0d92-43d9-8c33-fc646ff065d8 service nova] Lock "84683344-2893-4446-90ae-e64cd799eb20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:08:31 user nova-compute[71874]: DEBUG nova.compute.manager [req-56b28078-b45b-4327-b8f0-a562a59903e9 req-343c1608-0d92-43d9-8c33-fc646ff065d8 service nova] [instance: 84683344-2893-4446-90ae-e64cd799eb20] No waiting events found dispatching network-vif-plugged-a8837af3-03f7-4b3d-8a2a-746f2d8038ad {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:08:31 user nova-compute[71874]: WARNING nova.compute.manager [req-56b28078-b45b-4327-b8f0-a562a59903e9 req-343c1608-0d92-43d9-8c33-fc646ff065d8 service nova] [instance: 84683344-2893-4446-90ae-e64cd799eb20] Received unexpected event network-vif-plugged-a8837af3-03f7-4b3d-8a2a-746f2d8038ad for instance with vm_state building and task_state spawning.
Apr 12 16:08:31 user nova-compute[71874]: DEBUG nova.virt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Emitting event <LifecycleEvent: 1681315711.7323492, 84683344-2893-4446-90ae-e64cd799eb20 => Resumed> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:08:31 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 84683344-2893-4446-90ae-e64cd799eb20] VM Resumed (Lifecycle Event)
Apr 12 16:08:31 user nova-compute[71874]: DEBUG nova.compute.manager [None req-b5bb173c-1ac4-478d-b96b-a6576db98029 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: 84683344-2893-4446-90ae-e64cd799eb20] Instance event wait completed in 0 seconds for  {{(pid=71874) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 16:08:31 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-b5bb173c-1ac4-478d-b96b-a6576db98029 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: 84683344-2893-4446-90ae-e64cd799eb20] Guest created on hypervisor {{(pid=71874) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 16:08:31 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 84683344-2893-4446-90ae-e64cd799eb20] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:08:31 user nova-compute[71874]: INFO nova.virt.libvirt.driver [-] [instance: 84683344-2893-4446-90ae-e64cd799eb20] Instance spawned successfully.
Apr 12 16:08:31 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-b5bb173c-1ac4-478d-b96b-a6576db98029 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: 84683344-2893-4446-90ae-e64cd799eb20] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 16:08:31 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 84683344-2893-4446-90ae-e64cd799eb20] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 16:08:31 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-b5bb173c-1ac4-478d-b96b-a6576db98029 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: 84683344-2893-4446-90ae-e64cd799eb20] Found default for hw_cdrom_bus of ide {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:08:31 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-b5bb173c-1ac4-478d-b96b-a6576db98029 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: 84683344-2893-4446-90ae-e64cd799eb20] Found default for hw_disk_bus of virtio {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:08:31 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-b5bb173c-1ac4-478d-b96b-a6576db98029 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: 84683344-2893-4446-90ae-e64cd799eb20] Found default for hw_input_bus of None {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:08:31 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-b5bb173c-1ac4-478d-b96b-a6576db98029 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: 84683344-2893-4446-90ae-e64cd799eb20] Found default for hw_pointer_model of None {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:08:31 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-b5bb173c-1ac4-478d-b96b-a6576db98029 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: 84683344-2893-4446-90ae-e64cd799eb20] Found default for hw_video_model of virtio {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:08:31 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-b5bb173c-1ac4-478d-b96b-a6576db98029 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: 84683344-2893-4446-90ae-e64cd799eb20] Found default for hw_vif_model of virtio {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:08:31 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 84683344-2893-4446-90ae-e64cd799eb20] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 16:08:31 user nova-compute[71874]: DEBUG nova.virt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Emitting event <LifecycleEvent: 1681315711.7339156, 84683344-2893-4446-90ae-e64cd799eb20 => Started> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:08:31 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 84683344-2893-4446-90ae-e64cd799eb20] VM Started (Lifecycle Event)
Apr 12 16:08:31 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 84683344-2893-4446-90ae-e64cd799eb20] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:08:31 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 84683344-2893-4446-90ae-e64cd799eb20] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 16:08:31 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 84683344-2893-4446-90ae-e64cd799eb20] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 16:08:31 user nova-compute[71874]: INFO nova.compute.manager [None req-b5bb173c-1ac4-478d-b96b-a6576db98029 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: 84683344-2893-4446-90ae-e64cd799eb20] Took 7.11 seconds to spawn the instance on the hypervisor.
Apr 12 16:08:31 user nova-compute[71874]: DEBUG nova.compute.manager [None req-b5bb173c-1ac4-478d-b96b-a6576db98029 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: 84683344-2893-4446-90ae-e64cd799eb20] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:08:31 user nova-compute[71874]: INFO nova.compute.manager [None req-b5bb173c-1ac4-478d-b96b-a6576db98029 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: 84683344-2893-4446-90ae-e64cd799eb20] Took 8.59 seconds to build instance.
Apr 12 16:08:31 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-b5bb173c-1ac4-478d-b96b-a6576db98029 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "84683344-2893-4446-90ae-e64cd799eb20" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.724s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:08:32 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:08:32 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:08:32 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:08:32 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:08:33 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:08:33 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:08:33 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:08:33 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:08:33 user nova-compute[71874]: DEBUG nova.compute.manager [req-25733b3f-ecfa-49f3-9370-5e57ae6661b8 req-41a216e4-bd68-424e-821e-006c1aabc5ed service nova] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Received event network-vif-plugged-18196ae0-d9c1-4814-8803-c4ba8ad4ab45 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:08:33 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-25733b3f-ecfa-49f3-9370-5e57ae6661b8 req-41a216e4-bd68-424e-821e-006c1aabc5ed service nova] Acquiring lock "dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:08:33 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-25733b3f-ecfa-49f3-9370-5e57ae6661b8 req-41a216e4-bd68-424e-821e-006c1aabc5ed service nova] Lock "dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:08:33 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-25733b3f-ecfa-49f3-9370-5e57ae6661b8 req-41a216e4-bd68-424e-821e-006c1aabc5ed service nova] Lock "dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:08:33 user nova-compute[71874]: DEBUG nova.compute.manager [req-25733b3f-ecfa-49f3-9370-5e57ae6661b8 req-41a216e4-bd68-424e-821e-006c1aabc5ed service nova] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] No waiting events found dispatching network-vif-plugged-18196ae0-d9c1-4814-8803-c4ba8ad4ab45 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:08:33 user nova-compute[71874]: WARNING nova.compute.manager [req-25733b3f-ecfa-49f3-9370-5e57ae6661b8 req-41a216e4-bd68-424e-821e-006c1aabc5ed service nova] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Received unexpected event network-vif-plugged-18196ae0-d9c1-4814-8803-c4ba8ad4ab45 for instance with vm_state active and task_state resize_finish.
Apr 12 16:08:33 user nova-compute[71874]: DEBUG nova.compute.manager [req-25733b3f-ecfa-49f3-9370-5e57ae6661b8 req-41a216e4-bd68-424e-821e-006c1aabc5ed service nova] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Received event network-vif-plugged-18196ae0-d9c1-4814-8803-c4ba8ad4ab45 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:08:33 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-25733b3f-ecfa-49f3-9370-5e57ae6661b8 req-41a216e4-bd68-424e-821e-006c1aabc5ed service nova] Acquiring lock "dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:08:33 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-25733b3f-ecfa-49f3-9370-5e57ae6661b8 req-41a216e4-bd68-424e-821e-006c1aabc5ed service nova] Lock "dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:08:33 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-25733b3f-ecfa-49f3-9370-5e57ae6661b8 req-41a216e4-bd68-424e-821e-006c1aabc5ed service nova] Lock "dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:08:33 user nova-compute[71874]: DEBUG nova.compute.manager [req-25733b3f-ecfa-49f3-9370-5e57ae6661b8 req-41a216e4-bd68-424e-821e-006c1aabc5ed service nova] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] No waiting events found dispatching network-vif-plugged-18196ae0-d9c1-4814-8803-c4ba8ad4ab45 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:08:33 user nova-compute[71874]: WARNING nova.compute.manager [req-25733b3f-ecfa-49f3-9370-5e57ae6661b8 req-41a216e4-bd68-424e-821e-006c1aabc5ed service nova] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Received unexpected event network-vif-plugged-18196ae0-d9c1-4814-8803-c4ba8ad4ab45 for instance with vm_state active and task_state resize_finish.
Apr 12 16:08:34 user nova-compute[71874]: DEBUG nova.virt.libvirt.host [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Removed pending event for dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 due to event {{(pid=71874) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 12 16:08:34 user nova-compute[71874]: DEBUG nova.virt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Emitting event <LifecycleEvent: 1681315714.7009697, dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 => Resumed> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:08:34 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] VM Resumed (Lifecycle Event)
Apr 12 16:08:34 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Instance event wait completed in 0 seconds for  {{(pid=71874) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 16:08:34 user nova-compute[71874]: INFO nova.virt.libvirt.driver [-] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Instance running successfully.
Apr 12 16:08:34 user nova-compute[71874]: DEBUG nova.virt.libvirt.guest [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Failed to set time: agent not configured {{(pid=71874) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Apr 12 16:08:34 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] finish_migration finished successfully. {{(pid=71874) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11742}}
Apr 12 16:08:34 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:08:34 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=71874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 16:08:34 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] During sync_power_state the instance has a pending task (resize_finish). Skip.
Apr 12 16:08:34 user nova-compute[71874]: DEBUG nova.virt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Emitting event <LifecycleEvent: 1681315714.7025664, dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 => Started> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:08:34 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] VM Started (Lifecycle Event)
Apr 12 16:08:34 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:08:34 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=71874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 16:08:34 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] During sync_power_state the instance has a pending task (resize_finish). Skip.
Apr 12 16:08:36 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:08:37 user nova-compute[71874]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681315702.515246, 1496d262-ad85-4da5-be83-035c9806bd20 => Stopped> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:08:37 user nova-compute[71874]: INFO nova.compute.manager [-] [instance: 1496d262-ad85-4da5-be83-035c9806bd20] VM Stopped (Lifecycle Event)
Apr 12 16:08:37 user nova-compute[71874]: DEBUG nova.compute.manager [None req-63e43196-08ec-4391-8211-dac9395a7730 None None] [instance: 1496d262-ad85-4da5-be83-035c9806bd20] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:08:37 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:08:41 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:08:42 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:08:45 user nova-compute[71874]: DEBUG nova.compute.manager [req-9d05f631-74d4-4d91-a94c-b82ab199528a req-560c0a08-0bf4-4d43-8661-345261d19d17 service nova] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] Received event network-changed-e2e566dd-85b6-43a5-b007-15d987e2af56 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:08:45 user nova-compute[71874]: DEBUG nova.compute.manager [req-9d05f631-74d4-4d91-a94c-b82ab199528a req-560c0a08-0bf4-4d43-8661-345261d19d17 service nova] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] Refreshing instance network info cache due to event network-changed-e2e566dd-85b6-43a5-b007-15d987e2af56. {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 16:08:45 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-9d05f631-74d4-4d91-a94c-b82ab199528a req-560c0a08-0bf4-4d43-8661-345261d19d17 service nova] Acquiring lock "refresh_cache-d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:08:45 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-9d05f631-74d4-4d91-a94c-b82ab199528a req-560c0a08-0bf4-4d43-8661-345261d19d17 service nova] Acquired lock "refresh_cache-d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:08:45 user nova-compute[71874]: DEBUG nova.network.neutron [req-9d05f631-74d4-4d91-a94c-b82ab199528a req-560c0a08-0bf4-4d43-8661-345261d19d17 service nova] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] Refreshing network info cache for port e2e566dd-85b6-43a5-b007-15d987e2af56 {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 16:08:45 user nova-compute[71874]: DEBUG nova.network.neutron [req-9d05f631-74d4-4d91-a94c-b82ab199528a req-560c0a08-0bf4-4d43-8661-345261d19d17 service nova] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] Updated VIF entry in instance network info cache for port e2e566dd-85b6-43a5-b007-15d987e2af56. {{(pid=71874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 16:08:45 user nova-compute[71874]: DEBUG nova.network.neutron [req-9d05f631-74d4-4d91-a94c-b82ab199528a req-560c0a08-0bf4-4d43-8661-345261d19d17 service nova] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] Updating instance_info_cache with network_info: [{"id": "e2e566dd-85b6-43a5-b007-15d987e2af56", "address": "fa:16:3e:88:85:6b", "network": {"id": "eb4dd4b5-96d4-4b53-b510-d41e2775b92f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-596111273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fa122cbabe94c6f93c862b4daf31e50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2e566dd-85", "ovs_interfaceid": "e2e566dd-85b6-43a5-b007-15d987e2af56", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:08:45 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-9d05f631-74d4-4d91-a94c-b82ab199528a req-560c0a08-0bf4-4d43-8661-345261d19d17 service nova] Releasing lock "refresh_cache-d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:08:46 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:08:47 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-2ecb7127-1866-4c3a-a5d4-b48a6e72f02f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Acquiring lock "d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:08:47 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-2ecb7127-1866-4c3a-a5d4-b48a6e72f02f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:08:47 user nova-compute[71874]: INFO nova.compute.manager [None req-2ecb7127-1866-4c3a-a5d4-b48a6e72f02f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] Shelving
Apr 12 16:08:47 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:08:47 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:08:47 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:08:47 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:08:47 user nova-compute[71874]: DEBUG nova.compute.manager [req-0dfb10ab-fe9f-4608-b025-67aa4b614a4a req-f473111b-aa6c-4b42-b71f-f45eb6f2cc17 service nova] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] Received event network-vif-unplugged-e2e566dd-85b6-43a5-b007-15d987e2af56 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:08:47 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-0dfb10ab-fe9f-4608-b025-67aa4b614a4a req-f473111b-aa6c-4b42-b71f-f45eb6f2cc17 service nova] Acquiring lock "d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:08:47 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-0dfb10ab-fe9f-4608-b025-67aa4b614a4a req-f473111b-aa6c-4b42-b71f-f45eb6f2cc17 service nova] Lock "d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:08:47 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-0dfb10ab-fe9f-4608-b025-67aa4b614a4a req-f473111b-aa6c-4b42-b71f-f45eb6f2cc17 service nova] Lock "d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:08:47 user nova-compute[71874]: DEBUG nova.compute.manager [req-0dfb10ab-fe9f-4608-b025-67aa4b614a4a req-f473111b-aa6c-4b42-b71f-f45eb6f2cc17 service nova] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] No waiting events found dispatching network-vif-unplugged-e2e566dd-85b6-43a5-b007-15d987e2af56 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:08:47 user nova-compute[71874]: WARNING nova.compute.manager [req-0dfb10ab-fe9f-4608-b025-67aa4b614a4a req-f473111b-aa6c-4b42-b71f-f45eb6f2cc17 service nova] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] Received unexpected event network-vif-unplugged-e2e566dd-85b6-43a5-b007-15d987e2af56 for instance with vm_state active and task_state shelving.
Apr 12 16:08:47 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:08:47 user nova-compute[71874]: INFO nova.virt.libvirt.driver [-] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] Instance destroyed successfully.
Apr 12 16:08:48 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-2ecb7127-1866-4c3a-a5d4-b48a6e72f02f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] Beginning cold snapshot process
Apr 12 16:08:48 user nova-compute[71874]: DEBUG nova.privsep.utils [None req-2ecb7127-1866-4c3a-a5d4-b48a6e72f02f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71874) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 12 16:08:48 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-2ecb7127-1866-4c3a-a5d4-b48a6e72f02f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e/disk /opt/stack/data/nova/instances/snapshots/tmp0639ib1q/cc81df72a02d49ff91dcc1e96a9ffe3c {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:08:48 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-2ecb7127-1866-4c3a-a5d4-b48a6e72f02f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e/disk /opt/stack/data/nova/instances/snapshots/tmp0639ib1q/cc81df72a02d49ff91dcc1e96a9ffe3c" returned: 0 in 0.500s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:08:48 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-2ecb7127-1866-4c3a-a5d4-b48a6e72f02f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] Snapshot extracted, beginning image upload
Apr 12 16:08:49 user nova-compute[71874]: DEBUG nova.compute.manager [req-e2741538-3927-4935-8e9c-464f0b9aac89 req-5bf7994c-53fa-4a4a-820b-c88cc1213c72 service nova] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] Received event network-vif-plugged-e2e566dd-85b6-43a5-b007-15d987e2af56 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:08:49 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-e2741538-3927-4935-8e9c-464f0b9aac89 req-5bf7994c-53fa-4a4a-820b-c88cc1213c72 service nova] Acquiring lock "d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:08:49 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-e2741538-3927-4935-8e9c-464f0b9aac89 req-5bf7994c-53fa-4a4a-820b-c88cc1213c72 service nova] Lock "d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:08:49 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-e2741538-3927-4935-8e9c-464f0b9aac89 req-5bf7994c-53fa-4a4a-820b-c88cc1213c72 service nova] Lock "d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:08:49 user nova-compute[71874]: DEBUG nova.compute.manager [req-e2741538-3927-4935-8e9c-464f0b9aac89 req-5bf7994c-53fa-4a4a-820b-c88cc1213c72 service nova] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] No waiting events found dispatching network-vif-plugged-e2e566dd-85b6-43a5-b007-15d987e2af56 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:08:49 user nova-compute[71874]: WARNING nova.compute.manager [req-e2741538-3927-4935-8e9c-464f0b9aac89 req-5bf7994c-53fa-4a4a-820b-c88cc1213c72 service nova] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] Received unexpected event network-vif-plugged-e2e566dd-85b6-43a5-b007-15d987e2af56 for instance with vm_state active and task_state shelving_image_uploading.
Apr 12 16:08:50 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-2ecb7127-1866-4c3a-a5d4-b48a6e72f02f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] Snapshot image upload complete
Apr 12 16:08:50 user nova-compute[71874]: DEBUG nova.compute.manager [None req-2ecb7127-1866-4c3a-a5d4-b48a6e72f02f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:08:50 user nova-compute[71874]: INFO nova.compute.manager [None req-2ecb7127-1866-4c3a-a5d4-b48a6e72f02f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] Shelve offloading
Apr 12 16:08:50 user nova-compute[71874]: INFO nova.virt.libvirt.driver [-] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] Instance destroyed successfully.
Apr 12 16:08:50 user nova-compute[71874]: DEBUG nova.compute.manager [None req-2ecb7127-1866-4c3a-a5d4-b48a6e72f02f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:08:50 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-2ecb7127-1866-4c3a-a5d4-b48a6e72f02f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Acquiring lock "refresh_cache-d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:08:50 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-2ecb7127-1866-4c3a-a5d4-b48a6e72f02f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Acquired lock "refresh_cache-d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:08:50 user nova-compute[71874]: DEBUG nova.network.neutron [None req-2ecb7127-1866-4c3a-a5d4-b48a6e72f02f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] Building network info cache for instance {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 16:08:51 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:08:51 user nova-compute[71874]: DEBUG nova.network.neutron [None req-2ecb7127-1866-4c3a-a5d4-b48a6e72f02f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] Updating instance_info_cache with network_info: [{"id": "e2e566dd-85b6-43a5-b007-15d987e2af56", "address": "fa:16:3e:88:85:6b", "network": {"id": "eb4dd4b5-96d4-4b53-b510-d41e2775b92f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-596111273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fa122cbabe94c6f93c862b4daf31e50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2e566dd-85", "ovs_interfaceid": "e2e566dd-85b6-43a5-b007-15d987e2af56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:08:51 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-2ecb7127-1866-4c3a-a5d4-b48a6e72f02f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Releasing lock "refresh_cache-d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:08:51 user nova-compute[71874]: INFO nova.virt.libvirt.driver [-] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] Instance destroyed successfully.
Apr 12 16:08:51 user nova-compute[71874]: DEBUG nova.objects.instance [None req-2ecb7127-1866-4c3a-a5d4-b48a6e72f02f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lazy-loading 'resources' on Instance uuid d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:08:51 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-2ecb7127-1866-4c3a-a5d4-b48a6e72f02f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T16:06:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-555700697',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-555700697',id=23,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBqm4X1GPAEsvdMh1GO761bXVv1VUyRSugyouG8rhVils1/hHVrIYx63R3qDcmpgztzn8AC8dxMFAH78ymrOF6BZDB1CDRnw9cjgtplakD6t2lDEw7VFcHyaQTdxPCChxA==',key_name='tempest-keypair-746668212',keypairs=<?>,launch_index=0,launched_at=2023-04-12T16:07:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='1fa122cbabe94c6f93c862b4daf31e50',ramdisk_id='',reservation_id='r-pdzop9wc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-292107264',owner_user_name='tempest-AttachVolumeShelveTestJSON-292107264-project-member',shelved_at='2023-04-12T16:08:50.856428',shelved_host='user',shelved_image_id='96eb17ec-ea38-4427-980a-a887b607266b'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T16:08:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c1abec24caf74dc8a27b64c21a9d4a59',uuid=d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "e2e566dd-85b6-43a5-b007-15d987e2af56", "address": "fa:16:3e:88:85:6b", "network": {"id": "eb4dd4b5-96d4-4b53-b510-d41e2775b92f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-596111273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fa122cbabe94c6f93c862b4daf31e50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2e566dd-85", "ovs_interfaceid": "e2e566dd-85b6-43a5-b007-15d987e2af56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 16:08:51 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-2ecb7127-1866-4c3a-a5d4-b48a6e72f02f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Converting VIF {"id": "e2e566dd-85b6-43a5-b007-15d987e2af56", "address": "fa:16:3e:88:85:6b", "network": {"id": "eb4dd4b5-96d4-4b53-b510-d41e2775b92f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-596111273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fa122cbabe94c6f93c862b4daf31e50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2e566dd-85", "ovs_interfaceid": "e2e566dd-85b6-43a5-b007-15d987e2af56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:08:51 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-2ecb7127-1866-4c3a-a5d4-b48a6e72f02f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:85:6b,bridge_name='br-int',has_traffic_filtering=True,id=e2e566dd-85b6-43a5-b007-15d987e2af56,network=Network(eb4dd4b5-96d4-4b53-b510-d41e2775b92f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2e566dd-85') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:08:51 user nova-compute[71874]: DEBUG os_vif [None req-2ecb7127-1866-4c3a-a5d4-b48a6e72f02f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:85:6b,bridge_name='br-int',has_traffic_filtering=True,id=e2e566dd-85b6-43a5-b007-15d987e2af56,network=Network(eb4dd4b5-96d4-4b53-b510-d41e2775b92f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2e566dd-85') {{(pid=71874) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 16:08:51 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:08:51 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape2e566dd-85, bridge=br-int, if_exists=True) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:08:52 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:08:52 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:08:52 user nova-compute[71874]: INFO os_vif [None req-2ecb7127-1866-4c3a-a5d4-b48a6e72f02f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:85:6b,bridge_name='br-int',has_traffic_filtering=True,id=e2e566dd-85b6-43a5-b007-15d987e2af56,network=Network(eb4dd4b5-96d4-4b53-b510-d41e2775b92f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2e566dd-85')
Apr 12 16:08:52 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-2ecb7127-1866-4c3a-a5d4-b48a6e72f02f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] Deleting instance files /opt/stack/data/nova/instances/d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e_del
Apr 12 16:08:52 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-2ecb7127-1866-4c3a-a5d4-b48a6e72f02f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] Deletion of /opt/stack/data/nova/instances/d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e_del complete
Apr 12 16:08:52 user nova-compute[71874]: DEBUG nova.compute.manager [req-31113401-bb05-4a93-b838-e6770dbe5876 req-dd52073d-374a-4e43-834d-661bfb372fda service nova] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] Received event network-changed-e2e566dd-85b6-43a5-b007-15d987e2af56 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:08:52 user nova-compute[71874]: DEBUG nova.compute.manager [req-31113401-bb05-4a93-b838-e6770dbe5876 req-dd52073d-374a-4e43-834d-661bfb372fda service nova] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] Refreshing instance network info cache due to event network-changed-e2e566dd-85b6-43a5-b007-15d987e2af56. {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 16:08:52 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-31113401-bb05-4a93-b838-e6770dbe5876 req-dd52073d-374a-4e43-834d-661bfb372fda service nova] Acquiring lock "refresh_cache-d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:08:52 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-31113401-bb05-4a93-b838-e6770dbe5876 req-dd52073d-374a-4e43-834d-661bfb372fda service nova] Acquired lock "refresh_cache-d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:08:52 user nova-compute[71874]: DEBUG nova.network.neutron [req-31113401-bb05-4a93-b838-e6770dbe5876 req-dd52073d-374a-4e43-834d-661bfb372fda service nova] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] Refreshing network info cache for port e2e566dd-85b6-43a5-b007-15d987e2af56 {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 16:08:52 user nova-compute[71874]: INFO nova.scheduler.client.report [None req-2ecb7127-1866-4c3a-a5d4-b48a6e72f02f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Deleted allocations for instance d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e
Apr 12 16:08:52 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-2ecb7127-1866-4c3a-a5d4-b48a6e72f02f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:08:52 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-2ecb7127-1866-4c3a-a5d4-b48a6e72f02f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:08:52 user nova-compute[71874]: DEBUG nova.objects.instance [None req-2ecb7127-1866-4c3a-a5d4-b48a6e72f02f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lazy-loading 'numa_topology' on Instance uuid d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:08:52 user nova-compute[71874]: DEBUG nova.network.neutron [req-31113401-bb05-4a93-b838-e6770dbe5876 req-dd52073d-374a-4e43-834d-661bfb372fda service nova] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] Updated VIF entry in instance network info cache for port e2e566dd-85b6-43a5-b007-15d987e2af56. {{(pid=71874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 16:08:52 user nova-compute[71874]: DEBUG nova.network.neutron [req-31113401-bb05-4a93-b838-e6770dbe5876 req-dd52073d-374a-4e43-834d-661bfb372fda service nova] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] Updating instance_info_cache with network_info: [{"id": "e2e566dd-85b6-43a5-b007-15d987e2af56", "address": "fa:16:3e:88:85:6b", "network": {"id": "eb4dd4b5-96d4-4b53-b510-d41e2775b92f", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-596111273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fa122cbabe94c6f93c862b4daf31e50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tape2e566dd-85", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:08:52 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-31113401-bb05-4a93-b838-e6770dbe5876 req-dd52073d-374a-4e43-834d-661bfb372fda service nova] Releasing lock "refresh_cache-d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:08:52 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-2ecb7127-1866-4c3a-a5d4-b48a6e72f02f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Inventory has not changed in ProviderTree for provider: 0e94b4c8-cd49-45e4-9133-d36eb4b2456b {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 16:08:52 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-2ecb7127-1866-4c3a-a5d4-b48a6e72f02f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Inventory has not changed for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 16:08:52 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-2ecb7127-1866-4c3a-a5d4-b48a6e72f02f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.423s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:08:52 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-2ecb7127-1866-4c3a-a5d4-b48a6e72f02f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 5.309s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:08:52 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:08:57 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:08:57 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:09:02 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:09:02 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:09:02 user nova-compute[71874]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681315727.9509687, d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e => Stopped> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:09:02 user nova-compute[71874]: INFO nova.compute.manager [-] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] VM Stopped (Lifecycle Event)
Apr 12 16:09:02 user nova-compute[71874]: DEBUG nova.compute.manager [None req-0cedbd98-325a-4f1c-a9d8-860d48cc604a None None] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:09:03 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:09:04 user nova-compute[71874]: DEBUG nova.compute.manager [req-d865654c-c31f-4f80-8829-71a58f66ec75 req-35b25b4e-0ed1-4326-ae0b-418f802ddba3 service nova] [instance: 78b6940a-f97a-4535-8973-3c2a5befbbab] Received event network-changed-db313dea-d267-434a-96bb-d099b17ab2d4 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:09:04 user nova-compute[71874]: DEBUG nova.compute.manager [req-d865654c-c31f-4f80-8829-71a58f66ec75 req-35b25b4e-0ed1-4326-ae0b-418f802ddba3 service nova] [instance: 78b6940a-f97a-4535-8973-3c2a5befbbab] Refreshing instance network info cache due to event network-changed-db313dea-d267-434a-96bb-d099b17ab2d4. {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 16:09:04 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-d865654c-c31f-4f80-8829-71a58f66ec75 req-35b25b4e-0ed1-4326-ae0b-418f802ddba3 service nova] Acquiring lock "refresh_cache-78b6940a-f97a-4535-8973-3c2a5befbbab" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:09:04 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-d865654c-c31f-4f80-8829-71a58f66ec75 req-35b25b4e-0ed1-4326-ae0b-418f802ddba3 service nova] Acquired lock "refresh_cache-78b6940a-f97a-4535-8973-3c2a5befbbab" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:09:04 user nova-compute[71874]: DEBUG nova.network.neutron [req-d865654c-c31f-4f80-8829-71a58f66ec75 req-35b25b4e-0ed1-4326-ae0b-418f802ddba3 service nova] [instance: 78b6940a-f97a-4535-8973-3c2a5befbbab] Refreshing network info cache for port db313dea-d267-434a-96bb-d099b17ab2d4 {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 16:09:04 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-4d5d2a7d-3d7c-4021-a6f8-b28934386f1d tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "357dd90d-8c53-4193-ad64-edfa894116cf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:09:04 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-4d5d2a7d-3d7c-4021-a6f8-b28934386f1d tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "357dd90d-8c53-4193-ad64-edfa894116cf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:09:04 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-4d5d2a7d-3d7c-4021-a6f8-b28934386f1d tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "357dd90d-8c53-4193-ad64-edfa894116cf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:09:04 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-4d5d2a7d-3d7c-4021-a6f8-b28934386f1d tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "357dd90d-8c53-4193-ad64-edfa894116cf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:09:04 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-4d5d2a7d-3d7c-4021-a6f8-b28934386f1d tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "357dd90d-8c53-4193-ad64-edfa894116cf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:09:04 user nova-compute[71874]: INFO nova.compute.manager [None req-4d5d2a7d-3d7c-4021-a6f8-b28934386f1d tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: 357dd90d-8c53-4193-ad64-edfa894116cf] Terminating instance
Apr 12 16:09:04 user nova-compute[71874]: DEBUG nova.compute.manager [None req-4d5d2a7d-3d7c-4021-a6f8-b28934386f1d tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: 357dd90d-8c53-4193-ad64-edfa894116cf] Start destroying the instance on the hypervisor. {{(pid=71874) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 16:09:04 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:09:04 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:09:04 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:09:04 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:09:04 user nova-compute[71874]: DEBUG nova.compute.manager [req-74ac71b4-d5c3-4bae-9e72-326e5d4bc098 req-192332d2-6cff-4bb2-b7cc-d405e1aeb951 service nova] [instance: 357dd90d-8c53-4193-ad64-edfa894116cf] Received event network-vif-unplugged-94db3bc9-9ecc-4f15-8105-4abb2ff9d1e5 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:09:04 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-74ac71b4-d5c3-4bae-9e72-326e5d4bc098 req-192332d2-6cff-4bb2-b7cc-d405e1aeb951 service nova] Acquiring lock "357dd90d-8c53-4193-ad64-edfa894116cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:09:04 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-74ac71b4-d5c3-4bae-9e72-326e5d4bc098 req-192332d2-6cff-4bb2-b7cc-d405e1aeb951 service nova] Lock "357dd90d-8c53-4193-ad64-edfa894116cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:09:04 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-74ac71b4-d5c3-4bae-9e72-326e5d4bc098 req-192332d2-6cff-4bb2-b7cc-d405e1aeb951 service nova] Lock "357dd90d-8c53-4193-ad64-edfa894116cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:09:04 user nova-compute[71874]: DEBUG nova.compute.manager [req-74ac71b4-d5c3-4bae-9e72-326e5d4bc098 req-192332d2-6cff-4bb2-b7cc-d405e1aeb951 service nova] [instance: 357dd90d-8c53-4193-ad64-edfa894116cf] No waiting events found dispatching network-vif-unplugged-94db3bc9-9ecc-4f15-8105-4abb2ff9d1e5 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:09:04 user nova-compute[71874]: DEBUG nova.compute.manager [req-74ac71b4-d5c3-4bae-9e72-326e5d4bc098 req-192332d2-6cff-4bb2-b7cc-d405e1aeb951 service nova] [instance: 357dd90d-8c53-4193-ad64-edfa894116cf] Received event network-vif-unplugged-94db3bc9-9ecc-4f15-8105-4abb2ff9d1e5 for instance with task_state deleting. {{(pid=71874) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 16:09:04 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-30c49e5f-b86e-4e86-b0d0-f7d9a501e906 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Acquiring lock "78b6940a-f97a-4535-8973-3c2a5befbbab" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:09:04 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-30c49e5f-b86e-4e86-b0d0-f7d9a501e906 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lock "78b6940a-f97a-4535-8973-3c2a5befbbab" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:09:04 user nova-compute[71874]: DEBUG nova.objects.instance [None req-30c49e5f-b86e-4e86-b0d0-f7d9a501e906 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lazy-loading 'flavor' on Instance uuid 78b6940a-f97a-4535-8973-3c2a5befbbab {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:09:04 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-30c49e5f-b86e-4e86-b0d0-f7d9a501e906 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lock "78b6940a-f97a-4535-8973-3c2a5befbbab" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:09:04 user nova-compute[71874]: DEBUG nova.network.neutron [req-d865654c-c31f-4f80-8829-71a58f66ec75 req-35b25b4e-0ed1-4326-ae0b-418f802ddba3 service nova] [instance: 78b6940a-f97a-4535-8973-3c2a5befbbab] Updated VIF entry in instance network info cache for port db313dea-d267-434a-96bb-d099b17ab2d4. {{(pid=71874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 16:09:04 user nova-compute[71874]: DEBUG nova.network.neutron [req-d865654c-c31f-4f80-8829-71a58f66ec75 req-35b25b4e-0ed1-4326-ae0b-418f802ddba3 service nova] [instance: 78b6940a-f97a-4535-8973-3c2a5befbbab] Updating instance_info_cache with network_info: [{"id": "db313dea-d267-434a-96bb-d099b17ab2d4", "address": "fa:16:3e:4c:7a:4f", "network": {"id": "1c560b5e-bb6f-42eb-b9b2-6b3f2eaed0f8", "bridge": "br-int", "label": "tempest-TestStampPattern-1356757354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a77372a5e83c4fc882b0a0b0eea46f06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb313dea-d2", "ovs_interfaceid": "db313dea-d267-434a-96bb-d099b17ab2d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:09:04 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-d865654c-c31f-4f80-8829-71a58f66ec75 req-35b25b4e-0ed1-4326-ae0b-418f802ddba3 service nova] Releasing lock "refresh_cache-78b6940a-f97a-4535-8973-3c2a5befbbab" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:09:04 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-30c49e5f-b86e-4e86-b0d0-f7d9a501e906 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Acquiring lock "78b6940a-f97a-4535-8973-3c2a5befbbab" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:09:04 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-30c49e5f-b86e-4e86-b0d0-f7d9a501e906 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lock "78b6940a-f97a-4535-8973-3c2a5befbbab" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:09:04 user nova-compute[71874]: INFO nova.compute.manager [None req-30c49e5f-b86e-4e86-b0d0-f7d9a501e906 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] [instance: 78b6940a-f97a-4535-8973-3c2a5befbbab] Attaching volume ba5930f5-72be-4d2a-9ebd-47eae870a1e4 to /dev/vdb
Apr 12 16:09:04 user nova-compute[71874]: DEBUG os_brick.utils [None req-30c49e5f-b86e-4e86-b0d0-f7d9a501e906 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:09:04 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:09:05 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:09:05 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6704c77-c4d2-4357-aa99-15a911059c34]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:61a48d4489d2\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:09:05 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:09:05 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.014s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:09:05 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dde1210-9605-48d1-bfea-149f7f1118b6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:09:05 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:09:05 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:09:05 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cb89e3c-04c4-4adc-82a3-4c5c3b3acca0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:09:05 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[5727d78c-2c8d-4806-b82e-5126d7aa4eb1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:09:05 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-30c49e5f-b86e-4e86-b0d0-f7d9a501e906 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Running cmd (subprocess): nvme version {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:09:05 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-30c49e5f-b86e-4e86-b0d0-f7d9a501e906 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] 'nvme version' failed. Not Retrying. {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 16:09:05 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.nvmeof [None req-30c49e5f-b86e-4e86-b0d0-f7d9a501e906 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] nvme not present on system {{(pid=71874) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 16:09:05 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:09:05 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 16:09:05 user nova-compute[71874]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 16:09:05 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[846392a4-cda7-4931-b21c-98aab8eda876]: (4, '') {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:09:05 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.lightos [None req-30c49e5f-b86e-4e86-b0d0-f7d9a501e906 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71874) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 16:09:05 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.lightos [None req-30c49e5f-b86e-4e86-b0d0-f7d9a501e906 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71874) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 16:09:05 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.lightos [None req-30c49e5f-b86e-4e86-b0d0-f7d9a501e906 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] LIGHTOS: no hostnqn found. {{(pid=71874) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 16:09:05 user nova-compute[71874]: DEBUG os_brick.utils [None req-30c49e5f-b86e-4e86-b0d0-f7d9a501e906 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:61a48d4489d2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:09:05 user nova-compute[71874]: DEBUG nova.virt.block_device [None req-30c49e5f-b86e-4e86-b0d0-f7d9a501e906 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] [instance: 78b6940a-f97a-4535-8973-3c2a5befbbab] Updating existing volume attachment record: fde87416-0487-4700-8e3c-4d47cc2fcbc0 {{(pid=71874) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 16:09:05 user nova-compute[71874]: INFO nova.virt.libvirt.driver [-] [instance: 357dd90d-8c53-4193-ad64-edfa894116cf] Instance destroyed successfully.
Apr 12 16:09:05 user nova-compute[71874]: DEBUG nova.objects.instance [None req-4d5d2a7d-3d7c-4021-a6f8-b28934386f1d tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lazy-loading 'resources' on Instance uuid 357dd90d-8c53-4193-ad64-edfa894116cf {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:09:05 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-4d5d2a7d-3d7c-4021-a6f8-b28934386f1d tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T16:06:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1232221601',display_name='tempest-AttachVolumeNegativeTest-server-1232221601',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1232221601',id=21,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC4UqVSrXTZPE0h1pNy8WZ39Xoqx7byNd1eHVKVZr8IHkBtOGiIXjeTZ8D3+H3VbKhpwfaxKPTTKJQl1smfAloYLeCFE5oooBxOGWYDpen8kfXtiH1Xjes2DlXqlGRiLIw==',key_name='tempest-keypair-724661013',keypairs=<?>,launch_index=0,launched_at=2023-04-12T16:06:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='28d940eae5394293b87cfced45911ab4',ramdisk_id='',reservation_id='r-5lgxvid1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-288610953',owner_user_name='tempest-AttachVolumeNegativeTest-288610953-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T16:06:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5a514f6d877a4ab0bec597fee13ce9db',uuid=357dd90d-8c53-4193-ad64-edfa894116cf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "94db3bc9-9ecc-4f15-8105-4abb2ff9d1e5", "address": "fa:16:3e:54:6b:70", "network": {"id": "e71b9966-9a95-4f66-b3b1-36b05d05853c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-310205564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28d940eae5394293b87cfced45911ab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94db3bc9-9e", "ovs_interfaceid": "94db3bc9-9ecc-4f15-8105-4abb2ff9d1e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 16:09:05 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-4d5d2a7d-3d7c-4021-a6f8-b28934386f1d tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Converting VIF {"id": "94db3bc9-9ecc-4f15-8105-4abb2ff9d1e5", "address": "fa:16:3e:54:6b:70", "network": {"id": "e71b9966-9a95-4f66-b3b1-36b05d05853c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-310205564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28d940eae5394293b87cfced45911ab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94db3bc9-9e", "ovs_interfaceid": "94db3bc9-9ecc-4f15-8105-4abb2ff9d1e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:09:05 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-4d5d2a7d-3d7c-4021-a6f8-b28934386f1d tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:54:6b:70,bridge_name='br-int',has_traffic_filtering=True,id=94db3bc9-9ecc-4f15-8105-4abb2ff9d1e5,network=Network(e71b9966-9a95-4f66-b3b1-36b05d05853c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94db3bc9-9e') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:09:05 user nova-compute[71874]: DEBUG os_vif [None req-4d5d2a7d-3d7c-4021-a6f8-b28934386f1d tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:54:6b:70,bridge_name='br-int',has_traffic_filtering=True,id=94db3bc9-9ecc-4f15-8105-4abb2ff9d1e5,network=Network(e71b9966-9a95-4f66-b3b1-36b05d05853c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94db3bc9-9e') {{(pid=71874) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 16:09:05 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:09:05 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap94db3bc9-9e, bridge=br-int, if_exists=True) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:09:05 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:09:05 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:09:05 user nova-compute[71874]: INFO os_vif [None req-4d5d2a7d-3d7c-4021-a6f8-b28934386f1d tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:54:6b:70,bridge_name='br-int',has_traffic_filtering=True,id=94db3bc9-9ecc-4f15-8105-4abb2ff9d1e5,network=Network(e71b9966-9a95-4f66-b3b1-36b05d05853c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94db3bc9-9e')
Apr 12 16:09:05 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-4d5d2a7d-3d7c-4021-a6f8-b28934386f1d tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: 357dd90d-8c53-4193-ad64-edfa894116cf] Deleting instance files /opt/stack/data/nova/instances/357dd90d-8c53-4193-ad64-edfa894116cf_del
Apr 12 16:09:05 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-4d5d2a7d-3d7c-4021-a6f8-b28934386f1d tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: 357dd90d-8c53-4193-ad64-edfa894116cf] Deletion of /opt/stack/data/nova/instances/357dd90d-8c53-4193-ad64-edfa894116cf_del complete
Apr 12 16:09:05 user nova-compute[71874]: INFO nova.compute.manager [None req-4d5d2a7d-3d7c-4021-a6f8-b28934386f1d tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: 357dd90d-8c53-4193-ad64-edfa894116cf] Took 0.89 seconds to destroy the instance on the hypervisor.
Apr 12 16:09:05 user nova-compute[71874]: DEBUG oslo.service.loopingcall [None req-4d5d2a7d-3d7c-4021-a6f8-b28934386f1d tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71874) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 16:09:05 user nova-compute[71874]: DEBUG nova.compute.manager [-] [instance: 357dd90d-8c53-4193-ad64-edfa894116cf] Deallocating network for instance {{(pid=71874) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 16:09:05 user nova-compute[71874]: DEBUG nova.network.neutron [-] [instance: 357dd90d-8c53-4193-ad64-edfa894116cf] deallocate_for_instance() {{(pid=71874) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 16:09:06 user nova-compute[71874]: DEBUG nova.network.neutron [-] [instance: 357dd90d-8c53-4193-ad64-edfa894116cf] Updating instance_info_cache with network_info: [] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:09:06 user nova-compute[71874]: INFO nova.compute.manager [-] [instance: 357dd90d-8c53-4193-ad64-edfa894116cf] Took 0.81 seconds to deallocate network for instance.
Apr 12 16:09:06 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-4d5d2a7d-3d7c-4021-a6f8-b28934386f1d tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:09:06 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-4d5d2a7d-3d7c-4021-a6f8-b28934386f1d tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:09:06 user nova-compute[71874]: DEBUG nova.compute.manager [req-fc413e5d-2b1b-4c77-8931-4f212b7b6e76 req-59dbd63a-b731-46a3-a92b-f8717a055467 service nova] [instance: 357dd90d-8c53-4193-ad64-edfa894116cf] Received event network-vif-deleted-94db3bc9-9ecc-4f15-8105-4abb2ff9d1e5 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:09:06 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-4d5d2a7d-3d7c-4021-a6f8-b28934386f1d tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Inventory has not changed in ProviderTree for provider: 0e94b4c8-cd49-45e4-9133-d36eb4b2456b {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 16:09:06 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-4d5d2a7d-3d7c-4021-a6f8-b28934386f1d tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Inventory has not changed for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 16:09:06 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-4d5d2a7d-3d7c-4021-a6f8-b28934386f1d tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.376s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:09:06 user nova-compute[71874]: INFO nova.scheduler.client.report [None req-4d5d2a7d-3d7c-4021-a6f8-b28934386f1d tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Deleted allocations for instance 357dd90d-8c53-4193-ad64-edfa894116cf
Apr 12 16:09:06 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-4d5d2a7d-3d7c-4021-a6f8-b28934386f1d tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "357dd90d-8c53-4193-ad64-edfa894116cf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.305s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:09:06 user nova-compute[71874]: DEBUG nova.compute.manager [req-673b81ee-e234-41c1-8d9d-3670b5858601 req-1a81046d-42c0-4be4-9c0b-8af0d3a61783 service nova] [instance: 357dd90d-8c53-4193-ad64-edfa894116cf] Received event network-vif-plugged-94db3bc9-9ecc-4f15-8105-4abb2ff9d1e5 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:09:06 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-673b81ee-e234-41c1-8d9d-3670b5858601 req-1a81046d-42c0-4be4-9c0b-8af0d3a61783 service nova] Acquiring lock "357dd90d-8c53-4193-ad64-edfa894116cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:09:06 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-673b81ee-e234-41c1-8d9d-3670b5858601 req-1a81046d-42c0-4be4-9c0b-8af0d3a61783 service nova] Lock "357dd90d-8c53-4193-ad64-edfa894116cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:09:06 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-673b81ee-e234-41c1-8d9d-3670b5858601 req-1a81046d-42c0-4be4-9c0b-8af0d3a61783 service nova] Lock "357dd90d-8c53-4193-ad64-edfa894116cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:09:06 user nova-compute[71874]: DEBUG nova.compute.manager [req-673b81ee-e234-41c1-8d9d-3670b5858601 req-1a81046d-42c0-4be4-9c0b-8af0d3a61783 service nova] [instance: 357dd90d-8c53-4193-ad64-edfa894116cf] No waiting events found dispatching network-vif-plugged-94db3bc9-9ecc-4f15-8105-4abb2ff9d1e5 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:09:06 user nova-compute[71874]: WARNING nova.compute.manager [req-673b81ee-e234-41c1-8d9d-3670b5858601 req-1a81046d-42c0-4be4-9c0b-8af0d3a61783 service nova] [instance: 357dd90d-8c53-4193-ad64-edfa894116cf] Received unexpected event network-vif-plugged-94db3bc9-9ecc-4f15-8105-4abb2ff9d1e5 for instance with vm_state deleted and task_state None.
Apr 12 16:09:07 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:09:09 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-30c49e5f-b86e-4e86-b0d0-f7d9a501e906 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] [instance: 78b6940a-f97a-4535-8973-3c2a5befbbab] Calling os-brick to attach iSCSI Volume {{(pid=71874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 16:09:09 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-30c49e5f-b86e-4e86-b0d0-f7d9a501e906 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3c0216320>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ba5930f5-72be-4d2a-9ebd-47eae870a1e4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qdQMezSs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:09:09 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-30c49e5f-b86e-4e86-b0d0-f7d9a501e906 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:09:09 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-30c49e5f-b86e-4e86-b0d0-f7d9a501e906 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:09:09 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-30c49e5f-b86e-4e86-b0d0-f7d9a501e906 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:09:09 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-30c49e5f-b86e-4e86-b0d0-f7d9a501e906 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:09:09 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-30c49e5f-b86e-4e86-b0d0-f7d9a501e906 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba5930f5-72be-4d2a-9ebd-47eae870a1e4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:09:09 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-30c49e5f-b86e-4e86-b0d0-f7d9a501e906 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba5930f5-72be-4d2a-9ebd-47eae870a1e4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:09:09 user nova-compute[71874]: INFO os_brick.initiator.connectors.iscsi [None req-30c49e5f-b86e-4e86-b0d0-f7d9a501e906 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 16:09:09 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba5930f5-72be-4d2a-9ebd-47eae870a1e4 -p 172.16.0.220:3260 {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:09:09 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba5930f5-72be-4d2a-9ebd-47eae870a1e4 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:09:09 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1182f4a-d1a9-41f7-8b6d-6890ca8ead98]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:09:09 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-30c49e5f-b86e-4e86-b0d0-f7d9a501e906 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 16:09:09 user nova-compute[71874]:  {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:09:09 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba5930f5-72be-4d2a-9ebd-47eae870a1e4 -p 172.16.0.220:3260 --interface default --op new {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:09:09 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba5930f5-72be-4d2a-9ebd-47eae870a1e4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:09:09 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[eabaeccd-b654-4a1a-9a4c-56ef0ccdf323]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ba5930f5-72be-4d2a-9ebd-47eae870a1e4] added\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:09:09 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-30c49e5f-b86e-4e86-b0d0-f7d9a501e906 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ba5930f5-72be-4d2a-9ebd-47eae870a1e4] added
Apr 12 16:09:09 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:09:09 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba5930f5-72be-4d2a-9ebd-47eae870a1e4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:09:09 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba5930f5-72be-4d2a-9ebd-47eae870a1e4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:09:09 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1201984-d555-4c3a-adfb-ec45249b7ef4]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:09:09 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-30c49e5f-b86e-4e86-b0d0-f7d9a501e906 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:09:09 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba5930f5-72be-4d2a-9ebd-47eae870a1e4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:09:09 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba5930f5-72be-4d2a-9ebd-47eae870a1e4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:09:09 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ac60c98-d9c8-4120-9770-e5a67910f4c8]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:09:09 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-30c49e5f-b86e-4e86-b0d0-f7d9a501e906 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:09:09 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba5930f5-72be-4d2a-9ebd-47eae870a1e4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qdQMezSs {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:09:09 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba5930f5-72be-4d2a-9ebd-47eae870a1e4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qdQMezSs" returned: 0 in 0.025s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:09:09 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[ece99232-15bb-4beb-b7a9-c9aac25b7fd5]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:09:09 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-30c49e5f-b86e-4e86-b0d0-f7d9a501e906 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qdQMezSs'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:09:09 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba5930f5-72be-4d2a-9ebd-47eae870a1e4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:09:09 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba5930f5-72be-4d2a-9ebd-47eae870a1e4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:09:09 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cd24959-6915-4d46-b21d-59fb62ca5314]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:09:09 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-30c49e5f-b86e-4e86-b0d0-f7d9a501e906 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:09:09 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:09:09 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:09:09 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b01f060-6398-418f-9786-e74a6e523dd9]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cc863d9-b797-4b5b-b8ce-30ebe55b9519 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:09:09 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-30c49e5f-b86e-4e86-b0d0-f7d9a501e906 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:09:09 user nova-compute[71874]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cc863d9-b797-4b5b-b8ce-30ebe55b9519 (non-flash)
Apr 12 16:09:09 user nova-compute[71874]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 (non-flash)
Apr 12 16:09:09 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:09:09 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-30c49e5f-b86e-4e86-b0d0-f7d9a501e906 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:09:09 user nova-compute[71874]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cc863d9-b797-4b5b-b8ce-30ebe55b9519 (non-flash)
Apr 12 16:09:09 user nova-compute[71874]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 (non-flash)
Apr 12 16:09:09 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:09:09 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba5930f5-72be-4d2a-9ebd-47eae870a1e4 -p 172.16.0.220:3260 --login {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:09:09 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba5930f5-72be-4d2a-9ebd-47eae870a1e4 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:09:09 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a947294-2a83-44f2-90ea-391b3ccc23aa]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ba5930f5-72be-4d2a-9ebd-47eae870a1e4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ba5930f5-72be-4d2a-9ebd-47eae870a1e4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:09:09 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-30c49e5f-b86e-4e86-b0d0-f7d9a501e906 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ba5930f5-72be-4d2a-9ebd-47eae870a1e4, portal: 172.16.0.220,3260]
Apr 12 16:09:09 user nova-compute[71874]: Login to [iface: default, target: iqn.2010-10.org.openstack:ba5930f5-72be-4d2a-9ebd-47eae870a1e4, portal: 172.16.0.220,3260] successful.
Apr 12 16:09:09 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:09:09 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba5930f5-72be-4d2a-9ebd-47eae870a1e4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:09:09 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba5930f5-72be-4d2a-9ebd-47eae870a1e4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:09:09 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[7053998c-fe2e-4bce-8173-b5bfae3d1ee3]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:09:09 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-30c49e5f-b86e-4e86-b0d0-f7d9a501e906 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:09:09 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:09:09 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:09:09 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[aea2becb-c8f2-4b6d-ac59-2c369092dfe1]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cc863d9-b797-4b5b-b8ce-30ebe55b9519 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba5930f5-72be-4d2a-9ebd-47eae870a1e4 (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:09:09 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-30c49e5f-b86e-4e86-b0d0-f7d9a501e906 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:09:09 user nova-compute[71874]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cc863d9-b797-4b5b-b8ce-30ebe55b9519 (non-flash)
Apr 12 16:09:09 user nova-compute[71874]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 (non-flash)
Apr 12 16:09:09 user nova-compute[71874]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba5930f5-72be-4d2a-9ebd-47eae870a1e4 (non-flash)
Apr 12 16:09:09 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:09:09 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-30c49e5f-b86e-4e86-b0d0-f7d9a501e906 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:09:09 user nova-compute[71874]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cc863d9-b797-4b5b-b8ce-30ebe55b9519 (non-flash)
Apr 12 16:09:09 user nova-compute[71874]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 (non-flash)
Apr 12 16:09:09 user nova-compute[71874]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba5930f5-72be-4d2a-9ebd-47eae870a1e4 (non-flash)
Apr 12 16:09:09 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:09:09 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-30c49e5f-b86e-4e86-b0d0-f7d9a501e906 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba5930f5-72be-4d2a-9ebd-47eae870a1e4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.278s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:09:09 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-30c49e5f-b86e-4e86-b0d0-f7d9a501e906 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Connected to 172.16.0.220:3260 {{(pid=71874) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 16:09:09 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-30c49e5f-b86e-4e86-b0d0-f7d9a501e906 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] HCTL ('36', '-', '-', 0) found on session 27 with lun 0 {{(pid=71874) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 16:09:09 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-30c49e5f-b86e-4e86-b0d0-f7d9a501e906 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71874) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 16:09:09 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:09:09 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:09:09 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e7a0b5f-f83b-4f30-8cb3-8fb76d71ddee]: (4, ('- - 0', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:09:09 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-30c49e5f-b86e-4e86-b0d0-f7d9a501e906 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Searching for a device in session 27 and hctl ['36', '*', '*', 0] yield: None {{(pid=71874) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 16:09:10 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:09:10 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-30c49e5f-b86e-4e86-b0d0-f7d9a501e906 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Searching for a device in session 27 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71874) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 16:09:10 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-30c49e5f-b86e-4e86-b0d0-f7d9a501e906 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:ba5930f5-72be-4d2a-9ebd-47eae870a1e4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qdQMezSs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71874) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 16:09:10 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-30c49e5f-b86e-4e86-b0d0-f7d9a501e906 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.306s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:09:10 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-30c49e5f-b86e-4e86-b0d0-f7d9a501e906 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] <== connect_volume: return (1307ms) {'type': 'block', 'scsi_wwn': '26362313961366235', 'path': '/dev/sde'} {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:09:10 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-30c49e5f-b86e-4e86-b0d0-f7d9a501e906 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] [instance: 78b6940a-f97a-4535-8973-3c2a5befbbab] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26362313961366235', 'path': '/dev/sde'} {{(pid=71874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 16:09:10 user nova-compute[71874]: DEBUG nova.objects.instance [None req-30c49e5f-b86e-4e86-b0d0-f7d9a501e906 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lazy-loading 'flavor' on Instance uuid 78b6940a-f97a-4535-8973-3c2a5befbbab {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:09:10 user nova-compute[71874]: DEBUG nova.virt.libvirt.guest [None req-30c49e5f-b86e-4e86-b0d0-f7d9a501e906 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 16:09:10 user nova-compute[71874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 16:09:10 user nova-compute[71874]:   <source dev="/dev/sde"/>
Apr 12 16:09:10 user nova-compute[71874]:   <target dev="vdb" bus="virtio"/>
Apr 12 16:09:10 user nova-compute[71874]:   <serial>ba5930f5-72be-4d2a-9ebd-47eae870a1e4</serial>
Apr 12 16:09:10 user nova-compute[71874]: </disk>
Apr 12 16:09:10 user nova-compute[71874]:  {{(pid=71874) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 16:09:11 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-30c49e5f-b86e-4e86-b0d0-f7d9a501e906 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] No BDM found with device name vda, not building metadata. {{(pid=71874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 16:09:11 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-30c49e5f-b86e-4e86-b0d0-f7d9a501e906 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 16:09:11 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-30c49e5f-b86e-4e86-b0d0-f7d9a501e906 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] No VIF found with MAC fa:16:3e:4c:7a:4f, not building metadata {{(pid=71874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 16:09:11 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-30c49e5f-b86e-4e86-b0d0-f7d9a501e906 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lock "78b6940a-f97a-4535-8973-3c2a5befbbab" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.335s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:09:12 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-e582b4a5-21dc-406b-ac1c-dd11a518d735 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Acquiring lock "78b6940a-f97a-4535-8973-3c2a5befbbab" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:09:12 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-e582b4a5-21dc-406b-ac1c-dd11a518d735 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lock "78b6940a-f97a-4535-8973-3c2a5befbbab" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:09:12 user nova-compute[71874]: INFO nova.compute.manager [None req-e582b4a5-21dc-406b-ac1c-dd11a518d735 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] [instance: 78b6940a-f97a-4535-8973-3c2a5befbbab] Detaching volume ba5930f5-72be-4d2a-9ebd-47eae870a1e4
Apr 12 16:09:12 user nova-compute[71874]: INFO nova.virt.block_device [None req-e582b4a5-21dc-406b-ac1c-dd11a518d735 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] [instance: 78b6940a-f97a-4535-8973-3c2a5befbbab] Attempting to driver detach volume ba5930f5-72be-4d2a-9ebd-47eae870a1e4 from mountpoint /dev/vdb
Apr 12 16:09:12 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-e582b4a5-21dc-406b-ac1c-dd11a518d735 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Attempting to detach device vdb from instance 78b6940a-f97a-4535-8973-3c2a5befbbab from the persistent domain config. {{(pid=71874) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 16:09:12 user nova-compute[71874]: DEBUG nova.virt.libvirt.guest [None req-e582b4a5-21dc-406b-ac1c-dd11a518d735 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 16:09:12 user nova-compute[71874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 16:09:12 user nova-compute[71874]:   <source dev="/dev/sde"/>
Apr 12 16:09:12 user nova-compute[71874]:   <target dev="vdb" bus="virtio"/>
Apr 12 16:09:12 user nova-compute[71874]:   <serial>ba5930f5-72be-4d2a-9ebd-47eae870a1e4</serial>
Apr 12 16:09:12 user nova-compute[71874]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 16:09:12 user nova-compute[71874]: </disk>
Apr 12 16:09:12 user nova-compute[71874]:  {{(pid=71874) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 16:09:12 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-e582b4a5-21dc-406b-ac1c-dd11a518d735 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Successfully detached device vdb from instance 78b6940a-f97a-4535-8973-3c2a5befbbab from the persistent domain config.
Apr 12 16:09:12 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-e582b4a5-21dc-406b-ac1c-dd11a518d735 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 78b6940a-f97a-4535-8973-3c2a5befbbab from the live domain config. {{(pid=71874) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 16:09:12 user nova-compute[71874]: DEBUG nova.virt.libvirt.guest [None req-e582b4a5-21dc-406b-ac1c-dd11a518d735 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 16:09:12 user nova-compute[71874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 16:09:12 user nova-compute[71874]:   <source dev="/dev/sde"/>
Apr 12 16:09:12 user nova-compute[71874]:   <target dev="vdb" bus="virtio"/>
Apr 12 16:09:12 user nova-compute[71874]:   <serial>ba5930f5-72be-4d2a-9ebd-47eae870a1e4</serial>
Apr 12 16:09:12 user nova-compute[71874]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 16:09:12 user nova-compute[71874]: </disk>
Apr 12 16:09:12 user nova-compute[71874]:  {{(pid=71874) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 16:09:12 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:09:13 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Received event <DeviceRemovedEvent: 1681315753.3664246, 78b6940a-f97a-4535-8973-3c2a5befbbab => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71874) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 16:09:13 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-e582b4a5-21dc-406b-ac1c-dd11a518d735 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 78b6940a-f97a-4535-8973-3c2a5befbbab {{(pid=71874) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 16:09:13 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-e582b4a5-21dc-406b-ac1c-dd11a518d735 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Successfully detached device vdb from instance 78b6940a-f97a-4535-8973-3c2a5befbbab from the live domain config.
Apr 12 16:09:13 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e582b4a5-21dc-406b-ac1c-dd11a518d735 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] [instance: 78b6940a-f97a-4535-8973-3c2a5befbbab] calling os-brick to detach iSCSI Volume {{(pid=71874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 16:09:13 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-e582b4a5-21dc-406b-ac1c-dd11a518d735 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3c0216320>, {'target_iqn': 'iqn.2010-10.org.openstack:ba5930f5-72be-4d2a-9ebd-47eae870a1e4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qdQMezSs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:09:13 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-e582b4a5-21dc-406b-ac1c-dd11a518d735 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:09:13 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-e582b4a5-21dc-406b-ac1c-dd11a518d735 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:09:13 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-e582b4a5-21dc-406b-ac1c-dd11a518d735 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:09:13 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:09:13 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:09:13 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb34054b-c33f-454d-93b8-74eed774a176]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7cc863d9-b797-4b5b-b8ce-30ebe55b9519\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ba5930f5-72be-4d2a-9ebd-47eae870a1e4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:09:13 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-e582b4a5-21dc-406b-ac1c-dd11a518d735 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 16:09:13 user nova-compute[71874]: No targets found.
Apr 12 16:09:13 user nova-compute[71874]: iSNS:
Apr 12 16:09:13 user nova-compute[71874]: No targets found.
Apr 12 16:09:13 user nova-compute[71874]: STATIC:
Apr 12 16:09:13 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:7cc863d9-b797-4b5b-b8ce-30ebe55b9519
Apr 12 16:09:13 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:09:13 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:09:13 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:ba5930f5-72be-4d2a-9ebd-47eae870a1e4
Apr 12 16:09:13 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:09:13 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:09:13 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297
Apr 12 16:09:13 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:09:13 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:09:13 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2
Apr 12 16:09:13 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:09:13 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:09:13 user nova-compute[71874]: FIRMWARE:
Apr 12 16:09:13 user nova-compute[71874]: No targets found.
Apr 12 16:09:13 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:09:13 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-e582b4a5-21dc-406b-ac1c-dd11a518d735 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 16:09:13 user nova-compute[71874]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 16:09:13 user nova-compute[71874]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71874) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 16:09:13 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-e582b4a5-21dc-406b-ac1c-dd11a518d735 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ba5930f5-72be-4d2a-9ebd-47eae870a1e4', 0)] {{(pid=71874) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 16:09:13 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:09:13 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:09:13 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c66c137-2592-474a-83e6-5e36e38270b0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7cc863d9-b797-4b5b-b8ce-30ebe55b9519\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba5930f5-72be-4d2a-9ebd-47eae870a1e4\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:09:13 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:09:13 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:09:13 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d7787ea-4e0b-4307-87d9-cf155ac846e7]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cc863d9-b797-4b5b-b8ce-30ebe55b9519 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba5930f5-72be-4d2a-9ebd-47eae870a1e4 (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:09:13 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-e582b4a5-21dc-406b-ac1c-dd11a518d735 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:09:13 user nova-compute[71874]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cc863d9-b797-4b5b-b8ce-30ebe55b9519 (non-flash)
Apr 12 16:09:13 user nova-compute[71874]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 (non-flash)
Apr 12 16:09:13 user nova-compute[71874]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba5930f5-72be-4d2a-9ebd-47eae870a1e4 (non-flash)
Apr 12 16:09:13 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:09:13 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-e582b4a5-21dc-406b-ac1c-dd11a518d735 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:09:13 user nova-compute[71874]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cc863d9-b797-4b5b-b8ce-30ebe55b9519 (non-flash)
Apr 12 16:09:13 user nova-compute[71874]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 (non-flash)
Apr 12 16:09:13 user nova-compute[71874]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba5930f5-72be-4d2a-9ebd-47eae870a1e4 (non-flash)
Apr 12 16:09:13 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:09:13 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-e582b4a5-21dc-406b-ac1c-dd11a518d735 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc3c03d3c70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ba5930f5-72be-4d2a-9ebd-47eae870a1e4'): ({'sde'}, set())}) {{(pid=71874) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 16:09:13 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-e582b4a5-21dc-406b-ac1c-dd11a518d735 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Removing single pathed devices sde {{(pid=71874) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 16:09:13 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:09:13 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:09:13 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[13222b34-3001-416d-8d99-1ada3d7288d8]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:09:13 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:09:13 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:09:13 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c021669-16c8-4071-a8c3-2471d3dd25e2]: (4, ('ok\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:09:13 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-e582b4a5-21dc-406b-ac1c-dd11a518d735 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Flushing IO for device /dev/sde {{(pid=71874) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 16:09:13 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:09:13 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:09:13 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[722baf80-ad80-400c-ac62-6eaab0c96e20]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:09:13 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-e582b4a5-21dc-406b-ac1c-dd11a518d735 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71874) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 16:09:13 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:09:13 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.042s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:09:13 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[01920e89-faa6-4166-ba28-b3ec6ef5b663]: (4, ('1', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:09:13 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-e582b4a5-21dc-406b-ac1c-dd11a518d735 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71874) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 16:09:13 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-e582b4a5-21dc-406b-ac1c-dd11a518d735 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] SCSI volumes sde have been removed. {{(pid=71874) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 16:09:13 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-e582b4a5-21dc-406b-ac1c-dd11a518d735 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ba5930f5-72be-4d2a-9ebd-47eae870a1e4')] {{(pid=71874) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 16:09:13 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba5930f5-72be-4d2a-9ebd-47eae870a1e4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:09:13 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba5930f5-72be-4d2a-9ebd-47eae870a1e4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:09:13 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[259d90ea-63b9-4fb7-9c8c-97cab426758c]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:09:13 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-e582b4a5-21dc-406b-ac1c-dd11a518d735 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:09:13 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba5930f5-72be-4d2a-9ebd-47eae870a1e4 -p 172.16.0.220:3260 --logout {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:09:13 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba5930f5-72be-4d2a-9ebd-47eae870a1e4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:09:13 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[586b3b8e-3aab-44e9-8c76-411946b2fb33]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:ba5930f5-72be-4d2a-9ebd-47eae870a1e4, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:ba5930f5-72be-4d2a-9ebd-47eae870a1e4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:09:13 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-e582b4a5-21dc-406b-ac1c-dd11a518d735 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:ba5930f5-72be-4d2a-9ebd-47eae870a1e4, portal: 172.16.0.220,3260]
Apr 12 16:09:13 user nova-compute[71874]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:ba5930f5-72be-4d2a-9ebd-47eae870a1e4, portal: 172.16.0.220,3260] successful.
Apr 12 16:09:13 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:09:13 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba5930f5-72be-4d2a-9ebd-47eae870a1e4 -p 172.16.0.220:3260 --op delete {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:09:13 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba5930f5-72be-4d2a-9ebd-47eae870a1e4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:09:13 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[67d9f131-12bd-4e26-8bfb-119966314c93]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:09:13 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-e582b4a5-21dc-406b-ac1c-dd11a518d735 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:09:13 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-e582b4a5-21dc-406b-ac1c-dd11a518d735 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:09:13 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-e582b4a5-21dc-406b-ac1c-dd11a518d735 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] <== disconnect_volume: return (313ms) None {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:09:13 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e582b4a5-21dc-406b-ac1c-dd11a518d735 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] [instance: 78b6940a-f97a-4535-8973-3c2a5befbbab] Disconnected iSCSI Volume {{(pid=71874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 16:09:14 user nova-compute[71874]: DEBUG nova.objects.instance [None req-e582b4a5-21dc-406b-ac1c-dd11a518d735 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lazy-loading 'flavor' on Instance uuid 78b6940a-f97a-4535-8973-3c2a5befbbab {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:09:14 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-c0522bc1-90fb-4856-890c-1c29c59d1c7e tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Acquiring lock "ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:09:14 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-c0522bc1-90fb-4856-890c-1c29c59d1c7e tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Lock "ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:09:14 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-c0522bc1-90fb-4856-890c-1c29c59d1c7e tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Acquiring lock "ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:09:14 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-c0522bc1-90fb-4856-890c-1c29c59d1c7e tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Lock "ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:09:14 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-c0522bc1-90fb-4856-890c-1c29c59d1c7e tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Lock "ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:09:14 user nova-compute[71874]: INFO nova.compute.manager [None req-c0522bc1-90fb-4856-890c-1c29c59d1c7e tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] [instance: ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e] Terminating instance
Apr 12 16:09:14 user nova-compute[71874]: DEBUG nova.compute.manager [None req-c0522bc1-90fb-4856-890c-1c29c59d1c7e tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] [instance: ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e] Start destroying the instance on the hypervisor. {{(pid=71874) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 16:09:14 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-e582b4a5-21dc-406b-ac1c-dd11a518d735 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lock "78b6940a-f97a-4535-8973-3c2a5befbbab" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.739s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:09:14 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:09:14 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:09:14 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:09:14 user nova-compute[71874]: DEBUG nova.compute.manager [req-639c7bed-e6e9-4138-8eda-7ff47841cb5c req-66e2e756-66a7-446e-9112-95f81e0f48cf service nova] [instance: ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e] Received event network-vif-unplugged-20f49d80-ccad-450e-baed-417505f17cc2 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:09:14 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-639c7bed-e6e9-4138-8eda-7ff47841cb5c req-66e2e756-66a7-446e-9112-95f81e0f48cf service nova] Acquiring lock "ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:09:14 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-639c7bed-e6e9-4138-8eda-7ff47841cb5c req-66e2e756-66a7-446e-9112-95f81e0f48cf service nova] Lock "ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:09:14 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-639c7bed-e6e9-4138-8eda-7ff47841cb5c req-66e2e756-66a7-446e-9112-95f81e0f48cf service nova] Lock "ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:09:14 user nova-compute[71874]: DEBUG nova.compute.manager [req-639c7bed-e6e9-4138-8eda-7ff47841cb5c req-66e2e756-66a7-446e-9112-95f81e0f48cf service nova] [instance: ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e] No waiting events found dispatching network-vif-unplugged-20f49d80-ccad-450e-baed-417505f17cc2 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:09:14 user nova-compute[71874]: DEBUG nova.compute.manager [req-639c7bed-e6e9-4138-8eda-7ff47841cb5c req-66e2e756-66a7-446e-9112-95f81e0f48cf service nova] [instance: ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e] Received event network-vif-unplugged-20f49d80-ccad-450e-baed-417505f17cc2 for instance with task_state deleting. {{(pid=71874) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 16:09:15 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:09:15 user nova-compute[71874]: INFO nova.virt.libvirt.driver [-] [instance: ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e] Instance destroyed successfully.
Apr 12 16:09:15 user nova-compute[71874]: DEBUG nova.objects.instance [None req-c0522bc1-90fb-4856-890c-1c29c59d1c7e tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Lazy-loading 'resources' on Instance uuid ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:09:15 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-c0522bc1-90fb-4856-890c-1c29c59d1c7e tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T16:03:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-619835956',display_name='tempest-VolumesAdminNegativeTest-server-619835956',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-619835956',id=17,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI5iGnI/5QUzaemWuPuISz6DoXlthOLrvHmO1ttnNkpfWuy+j+rfVtjrZ0Ne2wROK5ZFJtWT+9pJ5d8Q3gkQxpaFURoacMo45jMZIUZeh23Z6htw6S217IIzKdvKFzW0yA==',key_name='tempest-keypair-2119173920',keypairs=<?>,launch_index=0,launched_at=2023-04-12T16:03:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='76f559719f5f43c3a47a0aaf1e699193',ramdisk_id='',reservation_id='r-8kaeaxi9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-716771515',owner_user_name='tempest-VolumesAdminNegativeTest-716771515-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T16:03:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2b65791f14d34508b8a9a0849a9bf89e',uuid=ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "20f49d80-ccad-450e-baed-417505f17cc2", "address": "fa:16:3e:28:84:c8", "network": {"id": "0a97bb8e-9c19-41f1-bfcd-428e3ea3492f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-6019148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76f559719f5f43c3a47a0aaf1e699193", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20f49d80-cc", "ovs_interfaceid": "20f49d80-ccad-450e-baed-417505f17cc2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 16:09:15 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-c0522bc1-90fb-4856-890c-1c29c59d1c7e tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Converting VIF {"id": "20f49d80-ccad-450e-baed-417505f17cc2", "address": "fa:16:3e:28:84:c8", "network": {"id": "0a97bb8e-9c19-41f1-bfcd-428e3ea3492f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-6019148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76f559719f5f43c3a47a0aaf1e699193", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20f49d80-cc", "ovs_interfaceid": "20f49d80-ccad-450e-baed-417505f17cc2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:09:15 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-c0522bc1-90fb-4856-890c-1c29c59d1c7e tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:28:84:c8,bridge_name='br-int',has_traffic_filtering=True,id=20f49d80-ccad-450e-baed-417505f17cc2,network=Network(0a97bb8e-9c19-41f1-bfcd-428e3ea3492f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20f49d80-cc') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:09:15 user nova-compute[71874]: DEBUG os_vif [None req-c0522bc1-90fb-4856-890c-1c29c59d1c7e tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:84:c8,bridge_name='br-int',has_traffic_filtering=True,id=20f49d80-ccad-450e-baed-417505f17cc2,network=Network(0a97bb8e-9c19-41f1-bfcd-428e3ea3492f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20f49d80-cc') {{(pid=71874) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 16:09:15 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:09:15 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap20f49d80-cc, bridge=br-int, if_exists=True) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:09:15 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:09:15 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:09:15 user nova-compute[71874]: INFO os_vif [None req-c0522bc1-90fb-4856-890c-1c29c59d1c7e tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:84:c8,bridge_name='br-int',has_traffic_filtering=True,id=20f49d80-ccad-450e-baed-417505f17cc2,network=Network(0a97bb8e-9c19-41f1-bfcd-428e3ea3492f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20f49d80-cc')
Apr 12 16:09:15 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-c0522bc1-90fb-4856-890c-1c29c59d1c7e tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] [instance: ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e] Deleting instance files /opt/stack/data/nova/instances/ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e_del
Apr 12 16:09:15 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-c0522bc1-90fb-4856-890c-1c29c59d1c7e tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] [instance: ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e] Deletion of /opt/stack/data/nova/instances/ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e_del complete
Apr 12 16:09:15 user nova-compute[71874]: INFO nova.compute.manager [None req-c0522bc1-90fb-4856-890c-1c29c59d1c7e tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] [instance: ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e] Took 0.88 seconds to destroy the instance on the hypervisor.
Apr 12 16:09:15 user nova-compute[71874]: DEBUG oslo.service.loopingcall [None req-c0522bc1-90fb-4856-890c-1c29c59d1c7e tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71874) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 16:09:15 user nova-compute[71874]: DEBUG nova.compute.manager [-] [instance: ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e] Deallocating network for instance {{(pid=71874) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 16:09:15 user nova-compute[71874]: DEBUG nova.network.neutron [-] [instance: ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e] deallocate_for_instance() {{(pid=71874) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 16:09:16 user nova-compute[71874]: DEBUG nova.network.neutron [-] [instance: ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e] Updating instance_info_cache with network_info: [] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:09:16 user nova-compute[71874]: INFO nova.compute.manager [-] [instance: ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e] Took 1.18 seconds to deallocate network for instance.
Apr 12 16:09:16 user nova-compute[71874]: DEBUG nova.compute.manager [req-e4352754-40a6-4d80-a9bc-4b83f8009b8c req-74a72022-593d-458d-806f-636251ceebf6 service nova] [instance: ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e] Received event network-vif-deleted-20f49d80-ccad-450e-baed-417505f17cc2 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:09:16 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-c0522bc1-90fb-4856-890c-1c29c59d1c7e tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:09:16 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-c0522bc1-90fb-4856-890c-1c29c59d1c7e tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:09:16 user nova-compute[71874]: DEBUG nova.compute.manager [req-50a99a0b-e2a2-4a95-8ead-d801396c877c req-32577c26-ae3e-4eda-8853-87f6b0f1dee3 service nova] [instance: ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e] Received event network-vif-plugged-20f49d80-ccad-450e-baed-417505f17cc2 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:09:16 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-50a99a0b-e2a2-4a95-8ead-d801396c877c req-32577c26-ae3e-4eda-8853-87f6b0f1dee3 service nova] Acquiring lock "ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:09:16 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-50a99a0b-e2a2-4a95-8ead-d801396c877c req-32577c26-ae3e-4eda-8853-87f6b0f1dee3 service nova] Lock "ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:09:16 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-50a99a0b-e2a2-4a95-8ead-d801396c877c req-32577c26-ae3e-4eda-8853-87f6b0f1dee3 service nova] Lock "ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:09:16 user nova-compute[71874]: DEBUG nova.compute.manager [req-50a99a0b-e2a2-4a95-8ead-d801396c877c req-32577c26-ae3e-4eda-8853-87f6b0f1dee3 service nova] [instance: ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e] No waiting events found dispatching network-vif-plugged-20f49d80-ccad-450e-baed-417505f17cc2 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:09:16 user nova-compute[71874]: WARNING nova.compute.manager [req-50a99a0b-e2a2-4a95-8ead-d801396c877c req-32577c26-ae3e-4eda-8853-87f6b0f1dee3 service nova] [instance: ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e] Received unexpected event network-vif-plugged-20f49d80-ccad-450e-baed-417505f17cc2 for instance with vm_state deleted and task_state None.
Apr 12 16:09:16 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-c0522bc1-90fb-4856-890c-1c29c59d1c7e tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Inventory has not changed in ProviderTree for provider: 0e94b4c8-cd49-45e4-9133-d36eb4b2456b {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 16:09:16 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-c0522bc1-90fb-4856-890c-1c29c59d1c7e tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Inventory has not changed for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 16:09:17 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-c0522bc1-90fb-4856-890c-1c29c59d1c7e tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.360s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:09:17 user nova-compute[71874]: INFO nova.scheduler.client.report [None req-c0522bc1-90fb-4856-890c-1c29c59d1c7e tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Deleted allocations for instance ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e
Apr 12 16:09:17 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-c0522bc1-90fb-4856-890c-1c29c59d1c7e tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Lock "ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.597s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:09:17 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:09:20 user nova-compute[71874]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681315745.1223338, 357dd90d-8c53-4193-ad64-edfa894116cf => Stopped> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:09:20 user nova-compute[71874]: INFO nova.compute.manager [-] [instance: 357dd90d-8c53-4193-ad64-edfa894116cf] VM Stopped (Lifecycle Event)
Apr 12 16:09:20 user nova-compute[71874]: DEBUG nova.compute.manager [None req-7b8de468-a45d-4211-939a-cbfa02ddb0cf None None] [instance: 357dd90d-8c53-4193-ad64-edfa894116cf] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:09:20 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:09:20 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:09:20 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:09:20 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:09:20 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:09:20 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:09:20 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Auditing locally available compute resources for user (node: user) {{(pid=71874) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 16:09:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f641c6b-b508-42a7-ae98-c2bfb841d798/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:09:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f641c6b-b508-42a7-ae98-c2bfb841d798/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:09:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f641c6b-b508-42a7-ae98-c2bfb841d798/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:09:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f641c6b-b508-42a7-ae98-c2bfb841d798/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:09:21 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 16:09:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473a30c4-5aa4-481c-8859-fda815d14872/disk.rescue --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:09:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473a30c4-5aa4-481c-8859-fda815d14872/disk.rescue --force-share --output=json" returned: 0 in 0.132s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:09:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473a30c4-5aa4-481c-8859-fda815d14872/disk.rescue --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:09:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473a30c4-5aa4-481c-8859-fda815d14872/disk.rescue --force-share --output=json" returned: 0 in 0.134s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:09:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473a30c4-5aa4-481c-8859-fda815d14872/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:09:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473a30c4-5aa4-481c-8859-fda815d14872/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:09:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473a30c4-5aa4-481c-8859-fda815d14872/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:09:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473a30c4-5aa4-481c-8859-fda815d14872/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:09:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:09:22 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:09:22 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:09:22 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:09:22 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 16:09:22 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/016ae41d-b098-4126-ace7-3da00b40cb9c/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:09:22 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/016ae41d-b098-4126-ace7-3da00b40cb9c/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:09:22 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/016ae41d-b098-4126-ace7-3da00b40cb9c/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:09:22 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/016ae41d-b098-4126-ace7-3da00b40cb9c/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:09:22 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/608fbea2-b42b-4bb9-94a7-2b76dcdc2001/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:09:22 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/608fbea2-b42b-4bb9-94a7-2b76dcdc2001/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:09:22 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/608fbea2-b42b-4bb9-94a7-2b76dcdc2001/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:09:22 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/608fbea2-b42b-4bb9-94a7-2b76dcdc2001/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:09:22 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6caa4977-8333-4171-8825-2c3bfb52f80b/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:09:22 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6caa4977-8333-4171-8825-2c3bfb52f80b/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:09:22 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6caa4977-8333-4171-8825-2c3bfb52f80b/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:09:22 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:09:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6caa4977-8333-4171-8825-2c3bfb52f80b/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:09:23 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 16:09:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6caa4977-8333-4171-8825-2c3bfb52f80b/disk.rescue --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:09:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6caa4977-8333-4171-8825-2c3bfb52f80b/disk.rescue --force-share --output=json" returned: 0 in 0.146s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:09:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6caa4977-8333-4171-8825-2c3bfb52f80b/disk.rescue --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:09:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6caa4977-8333-4171-8825-2c3bfb52f80b/disk.rescue --force-share --output=json" returned: 0 in 0.154s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:09:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84683344-2893-4446-90ae-e64cd799eb20/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:09:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84683344-2893-4446-90ae-e64cd799eb20/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:09:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84683344-2893-4446-90ae-e64cd799eb20/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:09:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84683344-2893-4446-90ae-e64cd799eb20/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:09:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afebffae-dbf6-4876-8c9f-0364f0fde49c/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:09:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afebffae-dbf6-4876-8c9f-0364f0fde49c/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:09:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afebffae-dbf6-4876-8c9f-0364f0fde49c/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:09:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afebffae-dbf6-4876-8c9f-0364f0fde49c/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:09:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78b6940a-f97a-4535-8973-3c2a5befbbab/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:09:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78b6940a-f97a-4535-8973-3c2a5befbbab/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:09:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78b6940a-f97a-4535-8973-3c2a5befbbab/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:09:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78b6940a-f97a-4535-8973-3c2a5befbbab/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:09:24 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:09:24 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:09:24 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Hypervisor/Node resource view: name=user free_ram=7558MB free_disk=25.847332000732422GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71874) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 16:09:24 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:09:24 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:09:24 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Applying migration context for instance dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 as it has an incoming, in-progress migration 1fde283e-efad-42fd-8a25-d8ba63358bb1. Migration status is finished {{(pid=71874) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:950}}
Apr 12 16:09:24 user nova-compute[71874]: INFO nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Updating resource usage from migration 1fde283e-efad-42fd-8a25-d8ba63358bb1
Apr 12 16:09:24 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance afebffae-dbf6-4876-8c9f-0364f0fde49c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:09:24 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 473a30c4-5aa4-481c-8859-fda815d14872 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:09:24 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 608fbea2-b42b-4bb9-94a7-2b76dcdc2001 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:09:24 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance f52ee906-c8fd-4cd5-842e-de98a5099c4f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:09:24 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 6caa4977-8333-4171-8825-2c3bfb52f80b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:09:24 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 78b6940a-f97a-4535-8973-3c2a5befbbab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:09:24 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 7f641c6b-b508-42a7-ae98-c2bfb841d798 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:09:24 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 016ae41d-b098-4126-ace7-3da00b40cb9c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:09:24 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Migration 1fde283e-efad-42fd-8a25-d8ba63358bb1 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1637}}
Apr 12 16:09:24 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:09:24 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 84683344-2893-4446-90ae-e64cd799eb20 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:09:24 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=71874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 16:09:24 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Final resource view: name=user phys_ram=16023MB used_ram=1984MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=71874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 16:09:25 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Inventory has not changed in ProviderTree for provider: 0e94b4c8-cd49-45e4-9133-d36eb4b2456b {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 16:09:25 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:09:25 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Inventory has not changed for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 16:09:25 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Compute_service record updated for user:user {{(pid=71874) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 16:09:25 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.592s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:09:26 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:09:26 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:09:26 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:09:26 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Starting heal instance info cache {{(pid=71874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 16:09:26 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquiring lock "refresh_cache-f52ee906-c8fd-4cd5-842e-de98a5099c4f" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:09:26 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquired lock "refresh_cache-f52ee906-c8fd-4cd5-842e-de98a5099c4f" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:09:26 user nova-compute[71874]: DEBUG nova.network.neutron [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] Forcefully refreshing network info cache for instance {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 16:09:27 user nova-compute[71874]: DEBUG nova.network.neutron [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] Updating instance_info_cache with network_info: [{"id": "955511f0-eca8-447d-a105-fdd5f182de62", "address": "fa:16:3e:ec:61:14", "network": {"id": "b36306e0-04c5-4b1b-8022-05ff121c4e43", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1503204786-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9210f81232304e179d3e09914a492442", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap955511f0-ec", "ovs_interfaceid": "955511f0-eca8-447d-a105-fdd5f182de62", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:09:27 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Releasing lock "refresh_cache-f52ee906-c8fd-4cd5-842e-de98a5099c4f" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:09:27 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] Updated the network info_cache for instance {{(pid=71874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 16:09:27 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:09:27 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:09:27 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:09:27 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:09:27 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:09:27 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71874) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 16:09:27 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:09:30 user nova-compute[71874]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681315755.3169577, ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e => Stopped> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:09:30 user nova-compute[71874]: INFO nova.compute.manager [-] [instance: ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e] VM Stopped (Lifecycle Event)
Apr 12 16:09:30 user nova-compute[71874]: DEBUG nova.compute.manager [None req-b7e4187a-e87f-481a-883a-c31676e35854 None None] [instance: ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:09:30 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:09:32 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:09:35 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:09:37 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:09:38 user nova-compute[71874]: INFO nova.compute.manager [None req-2c6221b9-7779-45df-aa9f-743ac73533cc tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Unrescuing
Apr 12 16:09:38 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-2c6221b9-7779-45df-aa9f-743ac73533cc tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Acquiring lock "refresh_cache-6caa4977-8333-4171-8825-2c3bfb52f80b" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:09:38 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-2c6221b9-7779-45df-aa9f-743ac73533cc tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Acquired lock "refresh_cache-6caa4977-8333-4171-8825-2c3bfb52f80b" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:09:38 user nova-compute[71874]: DEBUG nova.network.neutron [None req-2c6221b9-7779-45df-aa9f-743ac73533cc tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Building network info cache for instance {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 16:09:39 user nova-compute[71874]: DEBUG nova.network.neutron [None req-2c6221b9-7779-45df-aa9f-743ac73533cc tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Updating instance_info_cache with network_info: [{"id": "c42ace22-d91b-4e4b-909e-19aaa428515a", "address": "fa:16:3e:3e:cd:0b", "network": {"id": "0e139ef7-ae53-4cce-9063-218ac1a19c0c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2058204483-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3deffbb4769b4985b038b4adcd82b018", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc42ace22-d9", "ovs_interfaceid": "c42ace22-d91b-4e4b-909e-19aaa428515a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:09:39 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-2c6221b9-7779-45df-aa9f-743ac73533cc tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Releasing lock "refresh_cache-6caa4977-8333-4171-8825-2c3bfb52f80b" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:09:39 user nova-compute[71874]: DEBUG nova.objects.instance [None req-2c6221b9-7779-45df-aa9f-743ac73533cc tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Lazy-loading 'flavor' on Instance uuid 6caa4977-8333-4171-8825-2c3bfb52f80b {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:09:39 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:09:39 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:09:39 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:09:39 user nova-compute[71874]: DEBUG nova.compute.manager [req-8a0e6063-d662-47e1-b3b8-7e73e48a0f0d req-5f49d6af-8d06-4411-b1b0-d088ba1662e8 service nova] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Received event network-vif-unplugged-c42ace22-d91b-4e4b-909e-19aaa428515a {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:09:39 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-8a0e6063-d662-47e1-b3b8-7e73e48a0f0d req-5f49d6af-8d06-4411-b1b0-d088ba1662e8 service nova] Acquiring lock "6caa4977-8333-4171-8825-2c3bfb52f80b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:09:39 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-8a0e6063-d662-47e1-b3b8-7e73e48a0f0d req-5f49d6af-8d06-4411-b1b0-d088ba1662e8 service nova] Lock "6caa4977-8333-4171-8825-2c3bfb52f80b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:09:39 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-8a0e6063-d662-47e1-b3b8-7e73e48a0f0d req-5f49d6af-8d06-4411-b1b0-d088ba1662e8 service nova] Lock "6caa4977-8333-4171-8825-2c3bfb52f80b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:09:39 user nova-compute[71874]: DEBUG nova.compute.manager [req-8a0e6063-d662-47e1-b3b8-7e73e48a0f0d req-5f49d6af-8d06-4411-b1b0-d088ba1662e8 service nova] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] No waiting events found dispatching network-vif-unplugged-c42ace22-d91b-4e4b-909e-19aaa428515a {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:09:39 user nova-compute[71874]: WARNING nova.compute.manager [req-8a0e6063-d662-47e1-b3b8-7e73e48a0f0d req-5f49d6af-8d06-4411-b1b0-d088ba1662e8 service nova] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Received unexpected event network-vif-unplugged-c42ace22-d91b-4e4b-909e-19aaa428515a for instance with vm_state rescued and task_state unrescuing.
Apr 12 16:09:40 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:09:40 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:09:40 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:09:40 user nova-compute[71874]: INFO nova.virt.libvirt.driver [-] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Instance destroyed successfully.
Apr 12 16:09:40 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:09:40 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:09:40 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:09:40 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:09:40 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:09:40 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:09:40 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:09:40 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:09:40 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:09:41 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:09:41 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:09:41 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:09:41 user nova-compute[71874]: DEBUG nova.compute.manager [req-62937e61-5951-4163-83ff-3ec09069f031 req-59fd7c6f-0e1b-4e73-b5fa-14c509110b9a service nova] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Received event network-changed-c42ace22-d91b-4e4b-909e-19aaa428515a {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:09:41 user nova-compute[71874]: DEBUG nova.compute.manager [req-62937e61-5951-4163-83ff-3ec09069f031 req-59fd7c6f-0e1b-4e73-b5fa-14c509110b9a service nova] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Refreshing instance network info cache due to event network-changed-c42ace22-d91b-4e4b-909e-19aaa428515a. {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 16:09:41 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-62937e61-5951-4163-83ff-3ec09069f031 req-59fd7c6f-0e1b-4e73-b5fa-14c509110b9a service nova] Acquiring lock "refresh_cache-6caa4977-8333-4171-8825-2c3bfb52f80b" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:09:41 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-62937e61-5951-4163-83ff-3ec09069f031 req-59fd7c6f-0e1b-4e73-b5fa-14c509110b9a service nova] Acquired lock "refresh_cache-6caa4977-8333-4171-8825-2c3bfb52f80b" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:09:41 user nova-compute[71874]: DEBUG nova.network.neutron [req-62937e61-5951-4163-83ff-3ec09069f031 req-59fd7c6f-0e1b-4e73-b5fa-14c509110b9a service nova] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Refreshing network info cache for port c42ace22-d91b-4e4b-909e-19aaa428515a {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 16:09:42 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:09:42 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:09:42 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:09:42 user nova-compute[71874]: DEBUG nova.network.neutron [req-62937e61-5951-4163-83ff-3ec09069f031 req-59fd7c6f-0e1b-4e73-b5fa-14c509110b9a service nova] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Updated VIF entry in instance network info cache for port c42ace22-d91b-4e4b-909e-19aaa428515a. {{(pid=71874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 16:09:42 user nova-compute[71874]: DEBUG nova.network.neutron [req-62937e61-5951-4163-83ff-3ec09069f031 req-59fd7c6f-0e1b-4e73-b5fa-14c509110b9a service nova] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Updating instance_info_cache with network_info: [{"id": "c42ace22-d91b-4e4b-909e-19aaa428515a", "address": "fa:16:3e:3e:cd:0b", "network": {"id": "0e139ef7-ae53-4cce-9063-218ac1a19c0c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2058204483-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3deffbb4769b4985b038b4adcd82b018", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc42ace22-d9", "ovs_interfaceid": "c42ace22-d91b-4e4b-909e-19aaa428515a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:09:42 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-62937e61-5951-4163-83ff-3ec09069f031 req-59fd7c6f-0e1b-4e73-b5fa-14c509110b9a service nova] Releasing lock "refresh_cache-6caa4977-8333-4171-8825-2c3bfb52f80b" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:09:42 user nova-compute[71874]: DEBUG nova.compute.manager [req-62937e61-5951-4163-83ff-3ec09069f031 req-59fd7c6f-0e1b-4e73-b5fa-14c509110b9a service nova] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Received event network-vif-plugged-c42ace22-d91b-4e4b-909e-19aaa428515a {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:09:42 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-62937e61-5951-4163-83ff-3ec09069f031 req-59fd7c6f-0e1b-4e73-b5fa-14c509110b9a service nova] Acquiring lock "6caa4977-8333-4171-8825-2c3bfb52f80b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:09:42 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-62937e61-5951-4163-83ff-3ec09069f031 req-59fd7c6f-0e1b-4e73-b5fa-14c509110b9a service nova] Lock "6caa4977-8333-4171-8825-2c3bfb52f80b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:09:42 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-62937e61-5951-4163-83ff-3ec09069f031 req-59fd7c6f-0e1b-4e73-b5fa-14c509110b9a service nova] Lock "6caa4977-8333-4171-8825-2c3bfb52f80b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:09:42 user nova-compute[71874]: DEBUG nova.compute.manager [req-62937e61-5951-4163-83ff-3ec09069f031 req-59fd7c6f-0e1b-4e73-b5fa-14c509110b9a service nova] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] No waiting events found dispatching network-vif-plugged-c42ace22-d91b-4e4b-909e-19aaa428515a {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:09:42 user nova-compute[71874]: WARNING nova.compute.manager [req-62937e61-5951-4163-83ff-3ec09069f031 req-59fd7c6f-0e1b-4e73-b5fa-14c509110b9a service nova] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Received unexpected event network-vif-plugged-c42ace22-d91b-4e4b-909e-19aaa428515a for instance with vm_state rescued and task_state unrescuing.
Apr 12 16:09:42 user nova-compute[71874]: DEBUG nova.compute.manager [req-62937e61-5951-4163-83ff-3ec09069f031 req-59fd7c6f-0e1b-4e73-b5fa-14c509110b9a service nova] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Received event network-changed-c42ace22-d91b-4e4b-909e-19aaa428515a {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:09:42 user nova-compute[71874]: DEBUG nova.compute.manager [req-62937e61-5951-4163-83ff-3ec09069f031 req-59fd7c6f-0e1b-4e73-b5fa-14c509110b9a service nova] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Refreshing instance network info cache due to event network-changed-c42ace22-d91b-4e4b-909e-19aaa428515a. {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 16:09:42 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-62937e61-5951-4163-83ff-3ec09069f031 req-59fd7c6f-0e1b-4e73-b5fa-14c509110b9a service nova] Acquiring lock "refresh_cache-6caa4977-8333-4171-8825-2c3bfb52f80b" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:09:42 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-62937e61-5951-4163-83ff-3ec09069f031 req-59fd7c6f-0e1b-4e73-b5fa-14c509110b9a service nova] Acquired lock "refresh_cache-6caa4977-8333-4171-8825-2c3bfb52f80b" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:09:42 user nova-compute[71874]: DEBUG nova.network.neutron [req-62937e61-5951-4163-83ff-3ec09069f031 req-59fd7c6f-0e1b-4e73-b5fa-14c509110b9a service nova] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Refreshing network info cache for port c42ace22-d91b-4e4b-909e-19aaa428515a {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 16:09:42 user nova-compute[71874]: DEBUG nova.network.neutron [req-62937e61-5951-4163-83ff-3ec09069f031 req-59fd7c6f-0e1b-4e73-b5fa-14c509110b9a service nova] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Updated VIF entry in instance network info cache for port c42ace22-d91b-4e4b-909e-19aaa428515a. {{(pid=71874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 16:09:42 user nova-compute[71874]: DEBUG nova.network.neutron [req-62937e61-5951-4163-83ff-3ec09069f031 req-59fd7c6f-0e1b-4e73-b5fa-14c509110b9a service nova] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Updating instance_info_cache with network_info: [{"id": "c42ace22-d91b-4e4b-909e-19aaa428515a", "address": "fa:16:3e:3e:cd:0b", "network": {"id": "0e139ef7-ae53-4cce-9063-218ac1a19c0c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2058204483-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3deffbb4769b4985b038b4adcd82b018", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc42ace22-d9", "ovs_interfaceid": "c42ace22-d91b-4e4b-909e-19aaa428515a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:09:42 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-62937e61-5951-4163-83ff-3ec09069f031 req-59fd7c6f-0e1b-4e73-b5fa-14c509110b9a service nova] Releasing lock "refresh_cache-6caa4977-8333-4171-8825-2c3bfb52f80b" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:09:42 user nova-compute[71874]: DEBUG nova.compute.manager [req-62937e61-5951-4163-83ff-3ec09069f031 req-59fd7c6f-0e1b-4e73-b5fa-14c509110b9a service nova] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Received event network-vif-plugged-c42ace22-d91b-4e4b-909e-19aaa428515a {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:09:42 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-62937e61-5951-4163-83ff-3ec09069f031 req-59fd7c6f-0e1b-4e73-b5fa-14c509110b9a service nova] Acquiring lock "6caa4977-8333-4171-8825-2c3bfb52f80b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:09:42 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-62937e61-5951-4163-83ff-3ec09069f031 req-59fd7c6f-0e1b-4e73-b5fa-14c509110b9a service nova] Lock "6caa4977-8333-4171-8825-2c3bfb52f80b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:09:42 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-62937e61-5951-4163-83ff-3ec09069f031 req-59fd7c6f-0e1b-4e73-b5fa-14c509110b9a service nova] Lock "6caa4977-8333-4171-8825-2c3bfb52f80b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:09:42 user nova-compute[71874]: DEBUG nova.compute.manager [req-62937e61-5951-4163-83ff-3ec09069f031 req-59fd7c6f-0e1b-4e73-b5fa-14c509110b9a service nova] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] No waiting events found dispatching network-vif-plugged-c42ace22-d91b-4e4b-909e-19aaa428515a {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:09:42 user nova-compute[71874]: WARNING nova.compute.manager [req-62937e61-5951-4163-83ff-3ec09069f031 req-59fd7c6f-0e1b-4e73-b5fa-14c509110b9a service nova] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Received unexpected event network-vif-plugged-c42ace22-d91b-4e4b-909e-19aaa428515a for instance with vm_state rescued and task_state unrescuing.
Apr 12 16:09:42 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:09:43 user nova-compute[71874]: DEBUG nova.virt.libvirt.host [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Removed pending event for 6caa4977-8333-4171-8825-2c3bfb52f80b due to event {{(pid=71874) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 12 16:09:43 user nova-compute[71874]: DEBUG nova.virt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Emitting event <LifecycleEvent: 1681315783.807341, 6caa4977-8333-4171-8825-2c3bfb52f80b => Resumed> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:09:43 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] VM Resumed (Lifecycle Event)
Apr 12 16:09:43 user nova-compute[71874]: DEBUG nova.compute.manager [None req-2c6221b9-7779-45df-aa9f-743ac73533cc tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:09:43 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:09:43 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 16:09:43 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-8cc6bed4-af6a-43a0-8ada-ffbed4998ace tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Acquiring lock "7f641c6b-b508-42a7-ae98-c2bfb841d798" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:09:43 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-8cc6bed4-af6a-43a0-8ada-ffbed4998ace tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "7f641c6b-b508-42a7-ae98-c2bfb841d798" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:09:43 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 12 16:09:43 user nova-compute[71874]: DEBUG nova.virt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Emitting event <LifecycleEvent: 1681315783.808849, 6caa4977-8333-4171-8825-2c3bfb52f80b => Started> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:09:43 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] VM Started (Lifecycle Event)
Apr 12 16:09:43 user nova-compute[71874]: DEBUG nova.objects.instance [None req-8cc6bed4-af6a-43a0-8ada-ffbed4998ace tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lazy-loading 'flavor' on Instance uuid 7f641c6b-b508-42a7-ae98-c2bfb841d798 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:09:43 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:09:43 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 16:09:43 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-8cc6bed4-af6a-43a0-8ada-ffbed4998ace tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "7f641c6b-b508-42a7-ae98-c2bfb841d798" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:09:43 user nova-compute[71874]: DEBUG nova.compute.manager [req-9e3ddd1a-5639-4896-af9b-feb5498aa3c6 req-370e2cba-f552-42b4-bff9-caf946751da2 service nova] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Received event network-vif-plugged-c42ace22-d91b-4e4b-909e-19aaa428515a {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:09:43 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-9e3ddd1a-5639-4896-af9b-feb5498aa3c6 req-370e2cba-f552-42b4-bff9-caf946751da2 service nova] Acquiring lock "6caa4977-8333-4171-8825-2c3bfb52f80b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:09:43 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-9e3ddd1a-5639-4896-af9b-feb5498aa3c6 req-370e2cba-f552-42b4-bff9-caf946751da2 service nova] Lock "6caa4977-8333-4171-8825-2c3bfb52f80b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:09:43 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-9e3ddd1a-5639-4896-af9b-feb5498aa3c6 req-370e2cba-f552-42b4-bff9-caf946751da2 service nova] Lock "6caa4977-8333-4171-8825-2c3bfb52f80b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:09:43 user nova-compute[71874]: DEBUG nova.compute.manager [req-9e3ddd1a-5639-4896-af9b-feb5498aa3c6 req-370e2cba-f552-42b4-bff9-caf946751da2 service nova] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] No waiting events found dispatching network-vif-plugged-c42ace22-d91b-4e4b-909e-19aaa428515a {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:09:43 user nova-compute[71874]: WARNING nova.compute.manager [req-9e3ddd1a-5639-4896-af9b-feb5498aa3c6 req-370e2cba-f552-42b4-bff9-caf946751da2 service nova] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Received unexpected event network-vif-plugged-c42ace22-d91b-4e4b-909e-19aaa428515a for instance with vm_state active and task_state None.
Apr 12 16:09:43 user nova-compute[71874]: DEBUG nova.compute.manager [req-9e3ddd1a-5639-4896-af9b-feb5498aa3c6 req-370e2cba-f552-42b4-bff9-caf946751da2 service nova] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] Received event network-changed-746786a9-c889-4ece-bc5e-a905bf8deb5c {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:09:43 user nova-compute[71874]: DEBUG nova.compute.manager [req-9e3ddd1a-5639-4896-af9b-feb5498aa3c6 req-370e2cba-f552-42b4-bff9-caf946751da2 service nova] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] Refreshing instance network info cache due to event network-changed-746786a9-c889-4ece-bc5e-a905bf8deb5c. {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 16:09:43 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-9e3ddd1a-5639-4896-af9b-feb5498aa3c6 req-370e2cba-f552-42b4-bff9-caf946751da2 service nova] Acquiring lock "refresh_cache-7f641c6b-b508-42a7-ae98-c2bfb841d798" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:09:43 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-9e3ddd1a-5639-4896-af9b-feb5498aa3c6 req-370e2cba-f552-42b4-bff9-caf946751da2 service nova] Acquired lock "refresh_cache-7f641c6b-b508-42a7-ae98-c2bfb841d798" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:09:43 user nova-compute[71874]: DEBUG nova.network.neutron [req-9e3ddd1a-5639-4896-af9b-feb5498aa3c6 req-370e2cba-f552-42b4-bff9-caf946751da2 service nova] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] Refreshing network info cache for port 746786a9-c889-4ece-bc5e-a905bf8deb5c {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 16:09:44 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-8cc6bed4-af6a-43a0-8ada-ffbed4998ace tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Acquiring lock "7f641c6b-b508-42a7-ae98-c2bfb841d798" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:09:44 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-8cc6bed4-af6a-43a0-8ada-ffbed4998ace tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "7f641c6b-b508-42a7-ae98-c2bfb841d798" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:09:44 user nova-compute[71874]: INFO nova.compute.manager [None req-8cc6bed4-af6a-43a0-8ada-ffbed4998ace tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] Attaching volume 1f27a002-8dfc-4d90-aa35-ba16586d4366 to /dev/vdb
Apr 12 16:09:44 user nova-compute[71874]: DEBUG os_brick.utils [None req-8cc6bed4-af6a-43a0-8ada-ffbed4998ace tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:09:44 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:09:44 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:09:44 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5494f04-85c1-4f18-b9a0-91f21aeb219b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:61a48d4489d2\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:09:44 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:09:44 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:09:44 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[76fd0f0d-1da7-4b8b-a076-35c389b44704]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:09:44 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:09:44 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:09:44 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[c52b50a1-6446-4798-ae8d-32a98c40ca41]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:09:44 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[04c57244-43b2-4fa6-a645-58ddb4d41c73]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:09:44 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-8cc6bed4-af6a-43a0-8ada-ffbed4998ace tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Running cmd (subprocess): nvme version {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:09:44 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-8cc6bed4-af6a-43a0-8ada-ffbed4998ace tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] 'nvme version' failed. Not Retrying. {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 16:09:44 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8cc6bed4-af6a-43a0-8ada-ffbed4998ace tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] nvme not present on system {{(pid=71874) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 16:09:44 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:09:44 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 16:09:44 user nova-compute[71874]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 16:09:44 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1288901-5269-438a-849a-4f26fa4ec117]: (4, '') {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:09:44 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.lightos [None req-8cc6bed4-af6a-43a0-8ada-ffbed4998ace tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71874) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 16:09:44 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.lightos [None req-8cc6bed4-af6a-43a0-8ada-ffbed4998ace tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71874) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 16:09:44 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.lightos [None req-8cc6bed4-af6a-43a0-8ada-ffbed4998ace tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] LIGHTOS: no hostnqn found. {{(pid=71874) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 16:09:44 user nova-compute[71874]: DEBUG os_brick.utils [None req-8cc6bed4-af6a-43a0-8ada-ffbed4998ace tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:61a48d4489d2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:09:44 user nova-compute[71874]: DEBUG nova.virt.block_device [None req-8cc6bed4-af6a-43a0-8ada-ffbed4998ace tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] Updating existing volume attachment record: 15d6ed1a-cdd9-49da-bfb4-49df3f6d24bd {{(pid=71874) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 16:09:44 user nova-compute[71874]: DEBUG nova.network.neutron [req-9e3ddd1a-5639-4896-af9b-feb5498aa3c6 req-370e2cba-f552-42b4-bff9-caf946751da2 service nova] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] Updated VIF entry in instance network info cache for port 746786a9-c889-4ece-bc5e-a905bf8deb5c. {{(pid=71874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 16:09:44 user nova-compute[71874]: DEBUG nova.network.neutron [req-9e3ddd1a-5639-4896-af9b-feb5498aa3c6 req-370e2cba-f552-42b4-bff9-caf946751da2 service nova] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] Updating instance_info_cache with network_info: [{"id": "746786a9-c889-4ece-bc5e-a905bf8deb5c", "address": "fa:16:3e:aa:23:e3", "network": {"id": "06fae0be-02dd-4962-a1ac-fd0413772758", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1493924857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3fe48a3b7d846a195f1e47cc7f69695", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap746786a9-c8", "ovs_interfaceid": "746786a9-c889-4ece-bc5e-a905bf8deb5c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:09:44 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-9e3ddd1a-5639-4896-af9b-feb5498aa3c6 req-370e2cba-f552-42b4-bff9-caf946751da2 service nova] Releasing lock "refresh_cache-7f641c6b-b508-42a7-ae98-c2bfb841d798" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:09:45 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:09:47 user nova-compute[71874]: DEBUG nova.compute.manager [None req-3d9fb512-3f61-4529-9699-85c1ab0a8990 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 016ae41d-b098-4126-ace7-3da00b40cb9c] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:09:47 user nova-compute[71874]: INFO nova.compute.manager [None req-3d9fb512-3f61-4529-9699-85c1ab0a8990 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 016ae41d-b098-4126-ace7-3da00b40cb9c] instance snapshotting
Apr 12 16:09:47 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-3d9fb512-3f61-4529-9699-85c1ab0a8990 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 016ae41d-b098-4126-ace7-3da00b40cb9c] Beginning live snapshot process
Apr 12 16:09:47 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-3d9fb512-3f61-4529-9699-85c1ab0a8990 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/016ae41d-b098-4126-ace7-3da00b40cb9c/disk --force-share --output=json -f qcow2 {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:09:47 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-3d9fb512-3f61-4529-9699-85c1ab0a8990 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/016ae41d-b098-4126-ace7-3da00b40cb9c/disk --force-share --output=json -f qcow2" returned: 0 in 0.139s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:09:47 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-3d9fb512-3f61-4529-9699-85c1ab0a8990 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/016ae41d-b098-4126-ace7-3da00b40cb9c/disk --force-share --output=json -f qcow2 {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:09:47 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:09:48 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-3d9fb512-3f61-4529-9699-85c1ab0a8990 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/016ae41d-b098-4126-ace7-3da00b40cb9c/disk --force-share --output=json -f qcow2" returned: 0 in 0.144s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:09:48 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-3d9fb512-3f61-4529-9699-85c1ab0a8990 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:09:48 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-3d9fb512-3f61-4529-9699-85c1ab0a8990 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json" returned: 0 in 0.178s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:09:48 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-3d9fb512-3f61-4529-9699-85c1ab0a8990 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpev4ix621/cb55f017d7614b8f9caa61a54d855292.delta 1073741824 {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:09:48 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-3d9fb512-3f61-4529-9699-85c1ab0a8990 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpev4ix621/cb55f017d7614b8f9caa61a54d855292.delta 1073741824" returned: 0 in 0.052s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:09:48 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-3d9fb512-3f61-4529-9699-85c1ab0a8990 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 016ae41d-b098-4126-ace7-3da00b40cb9c] Quiescing instance not available: QEMU guest agent is not enabled.
Apr 12 16:09:48 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8cc6bed4-af6a-43a0-8ada-ffbed4998ace tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] Calling os-brick to attach iSCSI Volume {{(pid=71874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 16:09:48 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cc6bed4-af6a-43a0-8ada-ffbed4998ace tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3c0216320>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1f27a002-8dfc-4d90-aa35-ba16586d4366', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vyOugRUC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:09:48 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-8cc6bed4-af6a-43a0-8ada-ffbed4998ace tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:09:48 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-8cc6bed4-af6a-43a0-8ada-ffbed4998ace tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:09:48 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-8cc6bed4-af6a-43a0-8ada-ffbed4998ace tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:09:48 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-8cc6bed4-af6a-43a0-8ada-ffbed4998ace tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:09:48 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-8cc6bed4-af6a-43a0-8ada-ffbed4998ace tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1f27a002-8dfc-4d90-aa35-ba16586d4366" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:09:48 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-8cc6bed4-af6a-43a0-8ada-ffbed4998ace tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1f27a002-8dfc-4d90-aa35-ba16586d4366" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:09:48 user nova-compute[71874]: INFO os_brick.initiator.connectors.iscsi [None req-8cc6bed4-af6a-43a0-8ada-ffbed4998ace tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 16:09:48 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f27a002-8dfc-4d90-aa35-ba16586d4366 -p 172.16.0.220:3260 {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:09:48 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f27a002-8dfc-4d90-aa35-ba16586d4366 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:09:48 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[51eb320f-b5ea-43f7-9bc4-72925084beee]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:09:48 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cc6bed4-af6a-43a0-8ada-ffbed4998ace tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 16:09:48 user nova-compute[71874]:  {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:09:48 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f27a002-8dfc-4d90-aa35-ba16586d4366 -p 172.16.0.220:3260 --interface default --op new {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:09:49 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f27a002-8dfc-4d90-aa35-ba16586d4366 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:09:49 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd95cada-5fb1-4480-935d-933efe80a027]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1f27a002-8dfc-4d90-aa35-ba16586d4366] added\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:09:49 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cc6bed4-af6a-43a0-8ada-ffbed4998ace tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1f27a002-8dfc-4d90-aa35-ba16586d4366] added
Apr 12 16:09:49 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:09:49 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f27a002-8dfc-4d90-aa35-ba16586d4366 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:09:49 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f27a002-8dfc-4d90-aa35-ba16586d4366 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:09:49 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae1e63cc-1b69-41ca-bf62-fcf63854f1c5]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:09:49 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cc6bed4-af6a-43a0-8ada-ffbed4998ace tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:09:49 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f27a002-8dfc-4d90-aa35-ba16586d4366 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:09:49 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f27a002-8dfc-4d90-aa35-ba16586d4366 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.121s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:09:49 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f03bedd-ff9a-48a8-b10f-ccc8de2bc95f]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:09:49 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cc6bed4-af6a-43a0-8ada-ffbed4998ace tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:09:49 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f27a002-8dfc-4d90-aa35-ba16586d4366 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vyOugRUC {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:09:49 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f27a002-8dfc-4d90-aa35-ba16586d4366 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vyOugRUC" returned: 0 in 0.019s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:09:49 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ac8e223-f81b-4c9e-ab8d-0eded3b91e2e]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:09:49 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cc6bed4-af6a-43a0-8ada-ffbed4998ace tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vyOugRUC'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:09:49 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f27a002-8dfc-4d90-aa35-ba16586d4366 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:09:49 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f27a002-8dfc-4d90-aa35-ba16586d4366 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:09:49 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[17df1bbd-fa21-4335-a043-a71e6da2800e]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:09:49 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cc6bed4-af6a-43a0-8ada-ffbed4998ace tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:09:49 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:09:49 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:09:49 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ae8c4c1-8797-4bca-b799-feafc0e1b1c1]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cc863d9-b797-4b5b-b8ce-30ebe55b9519 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:09:49 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cc6bed4-af6a-43a0-8ada-ffbed4998ace tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:09:49 user nova-compute[71874]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cc863d9-b797-4b5b-b8ce-30ebe55b9519 (non-flash)
Apr 12 16:09:49 user nova-compute[71874]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 (non-flash)
Apr 12 16:09:49 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:09:49 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cc6bed4-af6a-43a0-8ada-ffbed4998ace tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:09:49 user nova-compute[71874]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cc863d9-b797-4b5b-b8ce-30ebe55b9519 (non-flash)
Apr 12 16:09:49 user nova-compute[71874]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 (non-flash)
Apr 12 16:09:49 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:09:49 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f27a002-8dfc-4d90-aa35-ba16586d4366 -p 172.16.0.220:3260 --login {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:09:49 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f27a002-8dfc-4d90-aa35-ba16586d4366 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:09:49 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[347bc15f-0c03-4fd6-aac5-f1acc91bf43d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1f27a002-8dfc-4d90-aa35-ba16586d4366, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1f27a002-8dfc-4d90-aa35-ba16586d4366, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:09:49 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cc6bed4-af6a-43a0-8ada-ffbed4998ace tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1f27a002-8dfc-4d90-aa35-ba16586d4366, portal: 172.16.0.220,3260]
Apr 12 16:09:49 user nova-compute[71874]: Login to [iface: default, target: iqn.2010-10.org.openstack:1f27a002-8dfc-4d90-aa35-ba16586d4366, portal: 172.16.0.220,3260] successful.
Apr 12 16:09:49 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:09:49 user nova-compute[71874]: DEBUG nova.virt.libvirt.guest [None req-3d9fb512-3f61-4529-9699-85c1ab0a8990 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] COPY block job progress, current cursor: 1835008 final cursor: 43778048 {{(pid=71874) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 16:09:49 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f27a002-8dfc-4d90-aa35-ba16586d4366 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:09:49 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f27a002-8dfc-4d90-aa35-ba16586d4366 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:09:49 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[f810c7cf-6912-4c71-8b1d-89d0f50cb409]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:09:49 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cc6bed4-af6a-43a0-8ada-ffbed4998ace tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:09:49 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:09:49 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:09:49 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[486d66e1-155d-4254-9521-9d93083fdef5]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cc863d9-b797-4b5b-b8ce-30ebe55b9519 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f27a002-8dfc-4d90-aa35-ba16586d4366 (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:09:49 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cc6bed4-af6a-43a0-8ada-ffbed4998ace tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:09:49 user nova-compute[71874]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cc863d9-b797-4b5b-b8ce-30ebe55b9519 (non-flash)
Apr 12 16:09:49 user nova-compute[71874]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 (non-flash)
Apr 12 16:09:49 user nova-compute[71874]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f27a002-8dfc-4d90-aa35-ba16586d4366 (non-flash)
Apr 12 16:09:49 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:09:49 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cc6bed4-af6a-43a0-8ada-ffbed4998ace tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:09:49 user nova-compute[71874]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cc863d9-b797-4b5b-b8ce-30ebe55b9519 (non-flash)
Apr 12 16:09:49 user nova-compute[71874]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 (non-flash)
Apr 12 16:09:49 user nova-compute[71874]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f27a002-8dfc-4d90-aa35-ba16586d4366 (non-flash)
Apr 12 16:09:49 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:09:49 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-8cc6bed4-af6a-43a0-8ada-ffbed4998ace tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1f27a002-8dfc-4d90-aa35-ba16586d4366" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.405s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:09:49 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cc6bed4-af6a-43a0-8ada-ffbed4998ace tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Connected to 172.16.0.220:3260 {{(pid=71874) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 16:09:49 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-8cc6bed4-af6a-43a0-8ada-ffbed4998ace tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] HCTL ('36', '-', '-', 0) found on session 28 with lun 0 {{(pid=71874) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 16:09:49 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-8cc6bed4-af6a-43a0-8ada-ffbed4998ace tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71874) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 16:09:49 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:09:49 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:09:49 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[949cc403-6df2-4c89-ad8a-35bf6e19bd70]: (4, ('- - 0', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:09:49 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-8cc6bed4-af6a-43a0-8ada-ffbed4998ace tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Searching for a device in session 28 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71874) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 16:09:49 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cc6bed4-af6a-43a0-8ada-ffbed4998ace tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:1f27a002-8dfc-4d90-aa35-ba16586d4366', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vyOugRUC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71874) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 16:09:49 user nova-compute[71874]: DEBUG nova.virt.libvirt.guest [None req-3d9fb512-3f61-4529-9699-85c1ab0a8990 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] COPY block job progress, current cursor: 43778048 final cursor: 43778048 {{(pid=71874) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 16:09:49 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-3d9fb512-3f61-4529-9699-85c1ab0a8990 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 016ae41d-b098-4126-ace7-3da00b40cb9c] Skipping quiescing instance: QEMU guest agent is not enabled.
Apr 12 16:09:49 user nova-compute[71874]: DEBUG nova.privsep.utils [None req-3d9fb512-3f61-4529-9699-85c1ab0a8990 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71874) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 12 16:09:49 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-3d9fb512-3f61-4529-9699-85c1ab0a8990 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpev4ix621/cb55f017d7614b8f9caa61a54d855292.delta /opt/stack/data/nova/instances/snapshots/tmpev4ix621/cb55f017d7614b8f9caa61a54d855292 {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:09:50 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:09:50 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-3d9fb512-3f61-4529-9699-85c1ab0a8990 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpev4ix621/cb55f017d7614b8f9caa61a54d855292.delta /opt/stack/data/nova/instances/snapshots/tmpev4ix621/cb55f017d7614b8f9caa61a54d855292" returned: 0 in 0.455s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:09:50 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-3d9fb512-3f61-4529-9699-85c1ab0a8990 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 016ae41d-b098-4126-ace7-3da00b40cb9c] Snapshot extracted, beginning image upload
Apr 12 16:09:50 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-8cc6bed4-af6a-43a0-8ada-ffbed4998ace tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.446s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:09:50 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cc6bed4-af6a-43a0-8ada-ffbed4998ace tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] <== connect_volume: return (1448ms) {'type': 'block', 'scsi_wwn': '23262396433626665', 'path': '/dev/sde'} {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:09:50 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8cc6bed4-af6a-43a0-8ada-ffbed4998ace tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23262396433626665', 'path': '/dev/sde'} {{(pid=71874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 16:09:50 user nova-compute[71874]: DEBUG nova.objects.instance [None req-8cc6bed4-af6a-43a0-8ada-ffbed4998ace tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lazy-loading 'flavor' on Instance uuid 7f641c6b-b508-42a7-ae98-c2bfb841d798 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:09:50 user nova-compute[71874]: DEBUG nova.virt.libvirt.guest [None req-8cc6bed4-af6a-43a0-8ada-ffbed4998ace tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 16:09:50 user nova-compute[71874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 16:09:50 user nova-compute[71874]:   <source dev="/dev/sde"/>
Apr 12 16:09:50 user nova-compute[71874]:   <target dev="vdb" bus="virtio"/>
Apr 12 16:09:50 user nova-compute[71874]:   <serial>1f27a002-8dfc-4d90-aa35-ba16586d4366</serial>
Apr 12 16:09:50 user nova-compute[71874]: </disk>
Apr 12 16:09:50 user nova-compute[71874]:  {{(pid=71874) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 16:09:50 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-8cc6bed4-af6a-43a0-8ada-ffbed4998ace tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] No BDM found with device name vda, not building metadata. {{(pid=71874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 16:09:50 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-8cc6bed4-af6a-43a0-8ada-ffbed4998ace tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 16:09:50 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-8cc6bed4-af6a-43a0-8ada-ffbed4998ace tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] No VIF found with MAC fa:16:3e:aa:23:e3, not building metadata {{(pid=71874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 16:09:50 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-8cc6bed4-af6a-43a0-8ada-ffbed4998ace tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "7f641c6b-b508-42a7-ae98-c2bfb841d798" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.918s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:09:51 user nova-compute[71874]: INFO nova.compute.manager [None req-897b35cd-b9cb-449f-bdef-8c39a0a9e6a3 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] Rescuing
Apr 12 16:09:51 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-897b35cd-b9cb-449f-bdef-8c39a0a9e6a3 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Acquiring lock "refresh_cache-7f641c6b-b508-42a7-ae98-c2bfb841d798" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:09:51 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-897b35cd-b9cb-449f-bdef-8c39a0a9e6a3 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Acquired lock "refresh_cache-7f641c6b-b508-42a7-ae98-c2bfb841d798" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:09:51 user nova-compute[71874]: DEBUG nova.network.neutron [None req-897b35cd-b9cb-449f-bdef-8c39a0a9e6a3 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] Building network info cache for instance {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 16:09:52 user nova-compute[71874]: DEBUG nova.network.neutron [None req-897b35cd-b9cb-449f-bdef-8c39a0a9e6a3 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] Updating instance_info_cache with network_info: [{"id": "746786a9-c889-4ece-bc5e-a905bf8deb5c", "address": "fa:16:3e:aa:23:e3", "network": {"id": "06fae0be-02dd-4962-a1ac-fd0413772758", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1493924857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3fe48a3b7d846a195f1e47cc7f69695", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap746786a9-c8", "ovs_interfaceid": "746786a9-c889-4ece-bc5e-a905bf8deb5c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:09:52 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-897b35cd-b9cb-449f-bdef-8c39a0a9e6a3 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Releasing lock "refresh_cache-7f641c6b-b508-42a7-ae98-c2bfb841d798" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:09:52 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:09:52 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-3d9fb512-3f61-4529-9699-85c1ab0a8990 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 016ae41d-b098-4126-ace7-3da00b40cb9c] Snapshot image upload complete
Apr 12 16:09:52 user nova-compute[71874]: INFO nova.compute.manager [None req-3d9fb512-3f61-4529-9699-85c1ab0a8990 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 016ae41d-b098-4126-ace7-3da00b40cb9c] Took 5.17 seconds to snapshot the instance on the hypervisor.
Apr 12 16:09:52 user nova-compute[71874]: DEBUG nova.compute.manager [req-d69b95ad-a5d4-4cca-be94-4f0e2e4225e1 req-15931680-0957-424a-8152-ca8013774a4b service nova] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] Received event network-vif-unplugged-746786a9-c889-4ece-bc5e-a905bf8deb5c {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:09:52 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-d69b95ad-a5d4-4cca-be94-4f0e2e4225e1 req-15931680-0957-424a-8152-ca8013774a4b service nova] Acquiring lock "7f641c6b-b508-42a7-ae98-c2bfb841d798-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:09:52 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-d69b95ad-a5d4-4cca-be94-4f0e2e4225e1 req-15931680-0957-424a-8152-ca8013774a4b service nova] Lock "7f641c6b-b508-42a7-ae98-c2bfb841d798-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:09:52 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-d69b95ad-a5d4-4cca-be94-4f0e2e4225e1 req-15931680-0957-424a-8152-ca8013774a4b service nova] Lock "7f641c6b-b508-42a7-ae98-c2bfb841d798-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:09:52 user nova-compute[71874]: DEBUG nova.compute.manager [req-d69b95ad-a5d4-4cca-be94-4f0e2e4225e1 req-15931680-0957-424a-8152-ca8013774a4b service nova] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] No waiting events found dispatching network-vif-unplugged-746786a9-c889-4ece-bc5e-a905bf8deb5c {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:09:52 user nova-compute[71874]: WARNING nova.compute.manager [req-d69b95ad-a5d4-4cca-be94-4f0e2e4225e1 req-15931680-0957-424a-8152-ca8013774a4b service nova] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] Received unexpected event network-vif-unplugged-746786a9-c889-4ece-bc5e-a905bf8deb5c for instance with vm_state active and task_state rescuing.
Apr 12 16:09:52 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:09:52 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:09:52 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:09:53 user nova-compute[71874]: INFO nova.virt.libvirt.driver [-] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] Instance destroyed successfully.
Apr 12 16:09:53 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-897b35cd-b9cb-449f-bdef-8c39a0a9e6a3 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] Attempting rescue
Apr 12 16:09:53 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-897b35cd-b9cb-449f-bdef-8c39a0a9e6a3 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=71874) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 12 16:09:53 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-897b35cd-b9cb-449f-bdef-8c39a0a9e6a3 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] Instance directory exists: not creating {{(pid=71874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 12 16:09:53 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-897b35cd-b9cb-449f-bdef-8c39a0a9e6a3 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] Creating image(s)
Apr 12 16:09:53 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-897b35cd-b9cb-449f-bdef-8c39a0a9e6a3 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Acquiring lock "/opt/stack/data/nova/instances/7f641c6b-b508-42a7-ae98-c2bfb841d798/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:09:53 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-897b35cd-b9cb-449f-bdef-8c39a0a9e6a3 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "/opt/stack/data/nova/instances/7f641c6b-b508-42a7-ae98-c2bfb841d798/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:09:53 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-897b35cd-b9cb-449f-bdef-8c39a0a9e6a3 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "/opt/stack/data/nova/instances/7f641c6b-b508-42a7-ae98-c2bfb841d798/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:09:53 user nova-compute[71874]: DEBUG nova.objects.instance [None req-897b35cd-b9cb-449f-bdef-8c39a0a9e6a3 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lazy-loading 'trusted_certs' on Instance uuid 7f641c6b-b508-42a7-ae98-c2bfb841d798 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:09:53 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-897b35cd-b9cb-449f-bdef-8c39a0a9e6a3 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Acquiring lock "b88df1b37cb431f52bc53b5616015c89b5bec411" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:09:53 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-897b35cd-b9cb-449f-bdef-8c39a0a9e6a3 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "b88df1b37cb431f52bc53b5616015c89b5bec411" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:09:53 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-897b35cd-b9cb-449f-bdef-8c39a0a9e6a3 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:09:53 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-897b35cd-b9cb-449f-bdef-8c39a0a9e6a3 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json" returned: 0 in 0.125s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:09:53 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-897b35cd-b9cb-449f-bdef-8c39a0a9e6a3 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411,backing_fmt=raw /opt/stack/data/nova/instances/7f641c6b-b508-42a7-ae98-c2bfb841d798/disk.rescue {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:09:53 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-897b35cd-b9cb-449f-bdef-8c39a0a9e6a3 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411,backing_fmt=raw /opt/stack/data/nova/instances/7f641c6b-b508-42a7-ae98-c2bfb841d798/disk.rescue" returned: 0 in 0.058s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:09:53 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-897b35cd-b9cb-449f-bdef-8c39a0a9e6a3 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "b88df1b37cb431f52bc53b5616015c89b5bec411" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.190s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:09:53 user nova-compute[71874]: DEBUG nova.objects.instance [None req-897b35cd-b9cb-449f-bdef-8c39a0a9e6a3 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lazy-loading 'migration_context' on Instance uuid 7f641c6b-b508-42a7-ae98-c2bfb841d798 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:09:53 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-897b35cd-b9cb-449f-bdef-8c39a0a9e6a3 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] Created local disks {{(pid=71874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 16:09:53 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-897b35cd-b9cb-449f-bdef-8c39a0a9e6a3 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] Start _get_guest_xml network_info=[{"id": "746786a9-c889-4ece-bc5e-a905bf8deb5c", "address": "fa:16:3e:aa:23:e3", "network": {"id": "06fae0be-02dd-4962-a1ac-fd0413772758", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1493924857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1493924857-network", "vif_mac": "fa:16:3e:aa:23:e3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3fe48a3b7d846a195f1e47cc7f69695", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap746786a9-c8", "ovs_interfaceid": "746786a9-c889-4ece-bc5e-a905bf8deb5c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T15:55:37Z,direct_url=<?>,disk_format='qcow2',id=9dc63f14-8b70-4e72-89f2-13464f2f5c7c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='61a4936d9b7744c0b488d81c9b7746b6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T15:55:39Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '9dc63f14-8b70-4e72-89f2-13464f2f5c7c', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=71874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 16:09:53 user nova-compute[71874]: DEBUG nova.objects.instance [None req-897b35cd-b9cb-449f-bdef-8c39a0a9e6a3 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lazy-loading 'resources' on Instance uuid 7f641c6b-b508-42a7-ae98-c2bfb841d798 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:09:53 user nova-compute[71874]: DEBUG nova.objects.instance [None req-897b35cd-b9cb-449f-bdef-8c39a0a9e6a3 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lazy-loading 'numa_topology' on Instance uuid 7f641c6b-b508-42a7-ae98-c2bfb841d798 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:09:53 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-897b35cd-b9cb-449f-bdef-8c39a0a9e6a3 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:09:53 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-897b35cd-b9cb-449f-bdef-8c39a0a9e6a3 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:09:53 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-897b35cd-b9cb-449f-bdef-8c39a0a9e6a3 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71874) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 16:09:53 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-897b35cd-b9cb-449f-bdef-8c39a0a9e6a3 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T15:56:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T15:55:37Z,direct_url=<?>,disk_format='qcow2',id=9dc63f14-8b70-4e72-89f2-13464f2f5c7c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='61a4936d9b7744c0b488d81c9b7746b6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T15:55:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 16:09:53 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-897b35cd-b9cb-449f-bdef-8c39a0a9e6a3 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Flavor limits 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 16:09:53 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-897b35cd-b9cb-449f-bdef-8c39a0a9e6a3 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Image limits 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 16:09:53 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-897b35cd-b9cb-449f-bdef-8c39a0a9e6a3 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Flavor pref 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 16:09:53 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-897b35cd-b9cb-449f-bdef-8c39a0a9e6a3 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Image pref 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 16:09:53 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-897b35cd-b9cb-449f-bdef-8c39a0a9e6a3 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 16:09:53 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-897b35cd-b9cb-449f-bdef-8c39a0a9e6a3 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 16:09:53 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-897b35cd-b9cb-449f-bdef-8c39a0a9e6a3 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 16:09:53 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-897b35cd-b9cb-449f-bdef-8c39a0a9e6a3 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Got 1 possible topologies {{(pid=71874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 16:09:53 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-897b35cd-b9cb-449f-bdef-8c39a0a9e6a3 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 16:09:53 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-897b35cd-b9cb-449f-bdef-8c39a0a9e6a3 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 16:09:53 user nova-compute[71874]: DEBUG nova.objects.instance [None req-897b35cd-b9cb-449f-bdef-8c39a0a9e6a3 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7f641c6b-b508-42a7-ae98-c2bfb841d798 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:09:53 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-897b35cd-b9cb-449f-bdef-8c39a0a9e6a3 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T16:07:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1180614007',display_name='tempest-ServerRescueNegativeTestJSON-server-1180614007',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1180614007',id=25,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPrkO3n8O4MAhGHzu305sUcOksNuZEgf5S2SaBBr3Crg5JA/Jbvt/iKbwzA0RYiZC3er8snS/bVFp1ZVLE3mVV6weKk+F4a0jnCrqA1XiOQQWJzF35GqBgQiIFDFUaocAg==',key_name='tempest-keypair-1217848071',keypairs=<?>,launch_index=0,launched_at=2023-04-12T16:08:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b3fe48a3b7d846a195f1e47cc7f69695',ramdisk_id='',reservation_id='r-ij3c9obi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-984710343',owner_user_name='tempest-ServerRescueNegativeTestJSON-984710343-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T16:08:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='880266e3fa4d4dd889648c10208a1f8e',uuid=7f641c6b-b508-42a7-ae98-c2bfb841d798,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "746786a9-c889-4ece-bc5e-a905bf8deb5c", "address": "fa:16:3e:aa:23:e3", "network": {"id": "06fae0be-02dd-4962-a1ac-fd0413772758", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1493924857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1493924857-network", "vif_mac": "fa:16:3e:aa:23:e3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3fe48a3b7d846a195f1e47cc7f69695", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap746786a9-c8", "ovs_interfaceid": "746786a9-c889-4ece-bc5e-a905bf8deb5c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 16:09:53 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-897b35cd-b9cb-449f-bdef-8c39a0a9e6a3 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Converting VIF {"id": "746786a9-c889-4ece-bc5e-a905bf8deb5c", "address": "fa:16:3e:aa:23:e3", "network": {"id": "06fae0be-02dd-4962-a1ac-fd0413772758", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1493924857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1493924857-network", "vif_mac": "fa:16:3e:aa:23:e3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3fe48a3b7d846a195f1e47cc7f69695", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap746786a9-c8", "ovs_interfaceid": "746786a9-c889-4ece-bc5e-a905bf8deb5c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:09:53 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-897b35cd-b9cb-449f-bdef-8c39a0a9e6a3 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:aa:23:e3,bridge_name='br-int',has_traffic_filtering=True,id=746786a9-c889-4ece-bc5e-a905bf8deb5c,network=Network(06fae0be-02dd-4962-a1ac-fd0413772758),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap746786a9-c8') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:09:53 user nova-compute[71874]: DEBUG nova.objects.instance [None req-897b35cd-b9cb-449f-bdef-8c39a0a9e6a3 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lazy-loading 'pci_devices' on Instance uuid 7f641c6b-b508-42a7-ae98-c2bfb841d798 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:09:53 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-897b35cd-b9cb-449f-bdef-8c39a0a9e6a3 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] End _get_guest_xml xml=<domain type="kvm">
Apr 12 16:09:53 user nova-compute[71874]:   <uuid>7f641c6b-b508-42a7-ae98-c2bfb841d798</uuid>
Apr 12 16:09:53 user nova-compute[71874]:   <name>instance-00000019</name>
Apr 12 16:09:53 user nova-compute[71874]:   <memory>131072</memory>
Apr 12 16:09:53 user nova-compute[71874]:   <vcpu>1</vcpu>
Apr 12 16:09:53 user nova-compute[71874]:   <metadata>
Apr 12 16:09:53 user nova-compute[71874]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 16:09:53 user nova-compute[71874]:       <nova:package version="0.0.0"/>
Apr 12 16:09:53 user nova-compute[71874]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1180614007</nova:name>
Apr 12 16:09:53 user nova-compute[71874]:       <nova:creationTime>2023-04-12 16:09:53</nova:creationTime>
Apr 12 16:09:53 user nova-compute[71874]:       <nova:flavor name="m1.nano">
Apr 12 16:09:53 user nova-compute[71874]:         <nova:memory>128</nova:memory>
Apr 12 16:09:53 user nova-compute[71874]:         <nova:disk>1</nova:disk>
Apr 12 16:09:53 user nova-compute[71874]:         <nova:swap>0</nova:swap>
Apr 12 16:09:53 user nova-compute[71874]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 16:09:53 user nova-compute[71874]:         <nova:vcpus>1</nova:vcpus>
Apr 12 16:09:53 user nova-compute[71874]:       </nova:flavor>
Apr 12 16:09:53 user nova-compute[71874]:       <nova:owner>
Apr 12 16:09:53 user nova-compute[71874]:         <nova:user uuid="880266e3fa4d4dd889648c10208a1f8e">tempest-ServerRescueNegativeTestJSON-984710343-project-member</nova:user>
Apr 12 16:09:53 user nova-compute[71874]:         <nova:project uuid="b3fe48a3b7d846a195f1e47cc7f69695">tempest-ServerRescueNegativeTestJSON-984710343</nova:project>
Apr 12 16:09:53 user nova-compute[71874]:       </nova:owner>
Apr 12 16:09:53 user nova-compute[71874]:       <nova:root type="image" uuid="9dc63f14-8b70-4e72-89f2-13464f2f5c7c"/>
Apr 12 16:09:53 user nova-compute[71874]:       <nova:ports>
Apr 12 16:09:53 user nova-compute[71874]:         <nova:port uuid="746786a9-c889-4ece-bc5e-a905bf8deb5c">
Apr 12 16:09:53 user nova-compute[71874]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 12 16:09:53 user nova-compute[71874]:         </nova:port>
Apr 12 16:09:53 user nova-compute[71874]:       </nova:ports>
Apr 12 16:09:53 user nova-compute[71874]:     </nova:instance>
Apr 12 16:09:53 user nova-compute[71874]:   </metadata>
Apr 12 16:09:53 user nova-compute[71874]:   <sysinfo type="smbios">
Apr 12 16:09:53 user nova-compute[71874]:     <system>
Apr 12 16:09:53 user nova-compute[71874]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 16:09:53 user nova-compute[71874]:       <entry name="product">OpenStack Nova</entry>
Apr 12 16:09:53 user nova-compute[71874]:       <entry name="version">0.0.0</entry>
Apr 12 16:09:53 user nova-compute[71874]:       <entry name="serial">7f641c6b-b508-42a7-ae98-c2bfb841d798</entry>
Apr 12 16:09:53 user nova-compute[71874]:       <entry name="uuid">7f641c6b-b508-42a7-ae98-c2bfb841d798</entry>
Apr 12 16:09:53 user nova-compute[71874]:       <entry name="family">Virtual Machine</entry>
Apr 12 16:09:53 user nova-compute[71874]:     </system>
Apr 12 16:09:53 user nova-compute[71874]:   </sysinfo>
Apr 12 16:09:53 user nova-compute[71874]:   <os>
Apr 12 16:09:53 user nova-compute[71874]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 16:09:53 user nova-compute[71874]:     <smbios mode="sysinfo"/>
Apr 12 16:09:53 user nova-compute[71874]:   </os>
Apr 12 16:09:53 user nova-compute[71874]:   <features>
Apr 12 16:09:53 user nova-compute[71874]:     <acpi/>
Apr 12 16:09:53 user nova-compute[71874]:     <apic/>
Apr 12 16:09:53 user nova-compute[71874]:     <vmcoreinfo/>
Apr 12 16:09:53 user nova-compute[71874]:   </features>
Apr 12 16:09:53 user nova-compute[71874]:   <clock offset="utc">
Apr 12 16:09:53 user nova-compute[71874]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 16:09:53 user nova-compute[71874]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 16:09:53 user nova-compute[71874]:     <timer name="hpet" present="no"/>
Apr 12 16:09:53 user nova-compute[71874]:   </clock>
Apr 12 16:09:53 user nova-compute[71874]:   <cpu mode="custom" match="exact">
Apr 12 16:09:53 user nova-compute[71874]:     <model>Nehalem</model>
Apr 12 16:09:53 user nova-compute[71874]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 16:09:53 user nova-compute[71874]:   </cpu>
Apr 12 16:09:53 user nova-compute[71874]:   <devices>
Apr 12 16:09:53 user nova-compute[71874]:     <disk type="file" device="disk">
Apr 12 16:09:53 user nova-compute[71874]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 16:09:53 user nova-compute[71874]:       <source file="/opt/stack/data/nova/instances/7f641c6b-b508-42a7-ae98-c2bfb841d798/disk.rescue"/>
Apr 12 16:09:53 user nova-compute[71874]:       <target dev="vda" bus="virtio"/>
Apr 12 16:09:53 user nova-compute[71874]:     </disk>
Apr 12 16:09:53 user nova-compute[71874]:     <disk type="file" device="disk">
Apr 12 16:09:53 user nova-compute[71874]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 16:09:53 user nova-compute[71874]:       <source file="/opt/stack/data/nova/instances/7f641c6b-b508-42a7-ae98-c2bfb841d798/disk"/>
Apr 12 16:09:53 user nova-compute[71874]:       <target dev="vdb" bus="virtio"/>
Apr 12 16:09:53 user nova-compute[71874]:     </disk>
Apr 12 16:09:53 user nova-compute[71874]:     <interface type="ethernet">
Apr 12 16:09:53 user nova-compute[71874]:       <mac address="fa:16:3e:aa:23:e3"/>
Apr 12 16:09:53 user nova-compute[71874]:       <model type="virtio"/>
Apr 12 16:09:53 user nova-compute[71874]:       <mtu size="1442"/>
Apr 12 16:09:53 user nova-compute[71874]:       <target dev="tap746786a9-c8"/>
Apr 12 16:09:53 user nova-compute[71874]:     </interface>
Apr 12 16:09:53 user nova-compute[71874]:     <serial type="pty">
Apr 12 16:09:53 user nova-compute[71874]:       <log file="/opt/stack/data/nova/instances/7f641c6b-b508-42a7-ae98-c2bfb841d798/console.log" append="off"/>
Apr 12 16:09:53 user nova-compute[71874]:     </serial>
Apr 12 16:09:53 user nova-compute[71874]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 16:09:53 user nova-compute[71874]:     <video>
Apr 12 16:09:53 user nova-compute[71874]:       <model type="virtio"/>
Apr 12 16:09:53 user nova-compute[71874]:     </video>
Apr 12 16:09:53 user nova-compute[71874]:     <rng model="virtio">
Apr 12 16:09:53 user nova-compute[71874]:       <backend model="random">/dev/urandom</backend>
Apr 12 16:09:53 user nova-compute[71874]:     </rng>
Apr 12 16:09:53 user nova-compute[71874]:     <controller type="usb" index="0" model="none"/>
Apr 12 16:09:53 user nova-compute[71874]:     <memballoon model="virtio">
Apr 12 16:09:53 user nova-compute[71874]:       <stats period="10"/>
Apr 12 16:09:53 user nova-compute[71874]:     </memballoon>
Apr 12 16:09:53 user nova-compute[71874]:   </devices>
Apr 12 16:09:53 user nova-compute[71874]: </domain>
Apr 12 16:09:53 user nova-compute[71874]:  {{(pid=71874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 16:09:53 user nova-compute[71874]: INFO nova.virt.libvirt.driver [-] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] Instance destroyed successfully.
Apr 12 16:09:53 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-897b35cd-b9cb-449f-bdef-8c39a0a9e6a3 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] No BDM found with device name vda, not building metadata. {{(pid=71874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 16:09:53 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-897b35cd-b9cb-449f-bdef-8c39a0a9e6a3 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 16:09:53 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-897b35cd-b9cb-449f-bdef-8c39a0a9e6a3 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] No VIF found with MAC fa:16:3e:aa:23:e3, not building metadata {{(pid=71874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 16:09:54 user nova-compute[71874]: DEBUG nova.compute.manager [req-91900251-ea74-41df-b5f9-53989a99975b req-c0cbb543-6bab-4cb8-8cd1-25b4987afb56 service nova] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] Received event network-vif-plugged-746786a9-c889-4ece-bc5e-a905bf8deb5c {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:09:54 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-91900251-ea74-41df-b5f9-53989a99975b req-c0cbb543-6bab-4cb8-8cd1-25b4987afb56 service nova] Acquiring lock "7f641c6b-b508-42a7-ae98-c2bfb841d798-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:09:54 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-91900251-ea74-41df-b5f9-53989a99975b req-c0cbb543-6bab-4cb8-8cd1-25b4987afb56 service nova] Lock "7f641c6b-b508-42a7-ae98-c2bfb841d798-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:09:54 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-91900251-ea74-41df-b5f9-53989a99975b req-c0cbb543-6bab-4cb8-8cd1-25b4987afb56 service nova] Lock "7f641c6b-b508-42a7-ae98-c2bfb841d798-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:09:54 user nova-compute[71874]: DEBUG nova.compute.manager [req-91900251-ea74-41df-b5f9-53989a99975b req-c0cbb543-6bab-4cb8-8cd1-25b4987afb56 service nova] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] No waiting events found dispatching network-vif-plugged-746786a9-c889-4ece-bc5e-a905bf8deb5c {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:09:54 user nova-compute[71874]: WARNING nova.compute.manager [req-91900251-ea74-41df-b5f9-53989a99975b req-c0cbb543-6bab-4cb8-8cd1-25b4987afb56 service nova] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] Received unexpected event network-vif-plugged-746786a9-c889-4ece-bc5e-a905bf8deb5c for instance with vm_state active and task_state rescuing.
Apr 12 16:09:55 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:09:55 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:09:55 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:09:55 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:09:55 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:09:56 user nova-compute[71874]: DEBUG nova.compute.manager [req-bea43efb-83e1-43a1-b9ac-5cbf536dbc64 req-ea0ce83d-48e4-4c72-b5e3-ccadba47ddc7 service nova] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] Received event network-vif-plugged-746786a9-c889-4ece-bc5e-a905bf8deb5c {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:09:56 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-bea43efb-83e1-43a1-b9ac-5cbf536dbc64 req-ea0ce83d-48e4-4c72-b5e3-ccadba47ddc7 service nova] Acquiring lock "7f641c6b-b508-42a7-ae98-c2bfb841d798-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:09:56 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-bea43efb-83e1-43a1-b9ac-5cbf536dbc64 req-ea0ce83d-48e4-4c72-b5e3-ccadba47ddc7 service nova] Lock "7f641c6b-b508-42a7-ae98-c2bfb841d798-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:09:56 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-bea43efb-83e1-43a1-b9ac-5cbf536dbc64 req-ea0ce83d-48e4-4c72-b5e3-ccadba47ddc7 service nova] Lock "7f641c6b-b508-42a7-ae98-c2bfb841d798-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:09:56 user nova-compute[71874]: DEBUG nova.compute.manager [req-bea43efb-83e1-43a1-b9ac-5cbf536dbc64 req-ea0ce83d-48e4-4c72-b5e3-ccadba47ddc7 service nova] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] No waiting events found dispatching network-vif-plugged-746786a9-c889-4ece-bc5e-a905bf8deb5c {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:09:56 user nova-compute[71874]: WARNING nova.compute.manager [req-bea43efb-83e1-43a1-b9ac-5cbf536dbc64 req-ea0ce83d-48e4-4c72-b5e3-ccadba47ddc7 service nova] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] Received unexpected event network-vif-plugged-746786a9-c889-4ece-bc5e-a905bf8deb5c for instance with vm_state active and task_state rescuing.
Apr 12 16:09:56 user nova-compute[71874]: DEBUG nova.compute.manager [req-bea43efb-83e1-43a1-b9ac-5cbf536dbc64 req-ea0ce83d-48e4-4c72-b5e3-ccadba47ddc7 service nova] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] Received event network-vif-plugged-746786a9-c889-4ece-bc5e-a905bf8deb5c {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:09:56 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-bea43efb-83e1-43a1-b9ac-5cbf536dbc64 req-ea0ce83d-48e4-4c72-b5e3-ccadba47ddc7 service nova] Acquiring lock "7f641c6b-b508-42a7-ae98-c2bfb841d798-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:09:56 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-bea43efb-83e1-43a1-b9ac-5cbf536dbc64 req-ea0ce83d-48e4-4c72-b5e3-ccadba47ddc7 service nova] Lock "7f641c6b-b508-42a7-ae98-c2bfb841d798-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:09:56 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-bea43efb-83e1-43a1-b9ac-5cbf536dbc64 req-ea0ce83d-48e4-4c72-b5e3-ccadba47ddc7 service nova] Lock "7f641c6b-b508-42a7-ae98-c2bfb841d798-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:09:56 user nova-compute[71874]: DEBUG nova.compute.manager [req-bea43efb-83e1-43a1-b9ac-5cbf536dbc64 req-ea0ce83d-48e4-4c72-b5e3-ccadba47ddc7 service nova] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] No waiting events found dispatching network-vif-plugged-746786a9-c889-4ece-bc5e-a905bf8deb5c {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:09:56 user nova-compute[71874]: WARNING nova.compute.manager [req-bea43efb-83e1-43a1-b9ac-5cbf536dbc64 req-ea0ce83d-48e4-4c72-b5e3-ccadba47ddc7 service nova] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] Received unexpected event network-vif-plugged-746786a9-c889-4ece-bc5e-a905bf8deb5c for instance with vm_state active and task_state rescuing.
Apr 12 16:09:57 user nova-compute[71874]: DEBUG nova.virt.libvirt.host [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Removed pending event for 7f641c6b-b508-42a7-ae98-c2bfb841d798 due to event {{(pid=71874) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 12 16:09:57 user nova-compute[71874]: DEBUG nova.virt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Emitting event <LifecycleEvent: 1681315797.2524645, 7f641c6b-b508-42a7-ae98-c2bfb841d798 => Resumed> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:09:57 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] VM Resumed (Lifecycle Event)
Apr 12 16:09:57 user nova-compute[71874]: DEBUG nova.compute.manager [None req-897b35cd-b9cb-449f-bdef-8c39a0a9e6a3 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:09:57 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:09:57 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 16:09:57 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 12 16:09:57 user nova-compute[71874]: DEBUG nova.virt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Emitting event <LifecycleEvent: 1681315797.2617016, 7f641c6b-b508-42a7-ae98-c2bfb841d798 => Started> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:09:57 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] VM Started (Lifecycle Event)
Apr 12 16:09:57 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:09:57 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 16:09:57 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 12 16:09:57 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:09:58 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-bfe8f037-e253-49fc-9142-99421ca2e161 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "f2511c44-8365-4e8c-9814-172547111b9f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:09:58 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-bfe8f037-e253-49fc-9142-99421ca2e161 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "f2511c44-8365-4e8c-9814-172547111b9f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:09:58 user nova-compute[71874]: DEBUG nova.compute.manager [None req-bfe8f037-e253-49fc-9142-99421ca2e161 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: f2511c44-8365-4e8c-9814-172547111b9f] Starting instance... {{(pid=71874) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 16:09:58 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-bfe8f037-e253-49fc-9142-99421ca2e161 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:09:58 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-bfe8f037-e253-49fc-9142-99421ca2e161 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:09:58 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-bfe8f037-e253-49fc-9142-99421ca2e161 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71874) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 16:09:58 user nova-compute[71874]: INFO nova.compute.claims [None req-bfe8f037-e253-49fc-9142-99421ca2e161 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: f2511c44-8365-4e8c-9814-172547111b9f] Claim successful on node user
Apr 12 16:09:58 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-bfe8f037-e253-49fc-9142-99421ca2e161 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Inventory has not changed in ProviderTree for provider: 0e94b4c8-cd49-45e4-9133-d36eb4b2456b {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 16:09:58 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-bfe8f037-e253-49fc-9142-99421ca2e161 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Inventory has not changed for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 16:09:58 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-bfe8f037-e253-49fc-9142-99421ca2e161 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.429s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:09:58 user nova-compute[71874]: DEBUG nova.compute.manager [None req-bfe8f037-e253-49fc-9142-99421ca2e161 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: f2511c44-8365-4e8c-9814-172547111b9f] Start building networks asynchronously for instance. {{(pid=71874) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 16:09:58 user nova-compute[71874]: DEBUG nova.compute.manager [None req-bfe8f037-e253-49fc-9142-99421ca2e161 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: f2511c44-8365-4e8c-9814-172547111b9f] Allocating IP information in the background. {{(pid=71874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 16:09:58 user nova-compute[71874]: DEBUG nova.network.neutron [None req-bfe8f037-e253-49fc-9142-99421ca2e161 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: f2511c44-8365-4e8c-9814-172547111b9f] allocate_for_instance() {{(pid=71874) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 16:09:58 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-bfe8f037-e253-49fc-9142-99421ca2e161 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: f2511c44-8365-4e8c-9814-172547111b9f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 16:09:58 user nova-compute[71874]: DEBUG nova.compute.manager [None req-bfe8f037-e253-49fc-9142-99421ca2e161 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: f2511c44-8365-4e8c-9814-172547111b9f] Start building block device mappings for instance. {{(pid=71874) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 16:09:59 user nova-compute[71874]: DEBUG nova.policy [None req-bfe8f037-e253-49fc-9142-99421ca2e161 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5a514f6d877a4ab0bec597fee13ce9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d940eae5394293b87cfced45911ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71874) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 16:09:59 user nova-compute[71874]: DEBUG nova.compute.manager [None req-bfe8f037-e253-49fc-9142-99421ca2e161 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: f2511c44-8365-4e8c-9814-172547111b9f] Start spawning the instance on the hypervisor. {{(pid=71874) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 16:09:59 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-bfe8f037-e253-49fc-9142-99421ca2e161 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: f2511c44-8365-4e8c-9814-172547111b9f] Creating instance directory {{(pid=71874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 16:09:59 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-bfe8f037-e253-49fc-9142-99421ca2e161 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: f2511c44-8365-4e8c-9814-172547111b9f] Creating image(s)
Apr 12 16:09:59 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-bfe8f037-e253-49fc-9142-99421ca2e161 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "/opt/stack/data/nova/instances/f2511c44-8365-4e8c-9814-172547111b9f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:09:59 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-bfe8f037-e253-49fc-9142-99421ca2e161 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "/opt/stack/data/nova/instances/f2511c44-8365-4e8c-9814-172547111b9f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:09:59 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-bfe8f037-e253-49fc-9142-99421ca2e161 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "/opt/stack/data/nova/instances/f2511c44-8365-4e8c-9814-172547111b9f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:09:59 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-bfe8f037-e253-49fc-9142-99421ca2e161 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:09:59 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-bfe8f037-e253-49fc-9142-99421ca2e161 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json" returned: 0 in 0.143s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:09:59 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-bfe8f037-e253-49fc-9142-99421ca2e161 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "b88df1b37cb431f52bc53b5616015c89b5bec411" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:09:59 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-bfe8f037-e253-49fc-9142-99421ca2e161 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "b88df1b37cb431f52bc53b5616015c89b5bec411" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:09:59 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-bfe8f037-e253-49fc-9142-99421ca2e161 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:09:59 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-bfe8f037-e253-49fc-9142-99421ca2e161 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json" returned: 0 in 0.138s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:09:59 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-bfe8f037-e253-49fc-9142-99421ca2e161 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411,backing_fmt=raw /opt/stack/data/nova/instances/f2511c44-8365-4e8c-9814-172547111b9f/disk 1073741824 {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:09:59 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-bfe8f037-e253-49fc-9142-99421ca2e161 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411,backing_fmt=raw /opt/stack/data/nova/instances/f2511c44-8365-4e8c-9814-172547111b9f/disk 1073741824" returned: 0 in 0.053s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:09:59 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-bfe8f037-e253-49fc-9142-99421ca2e161 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "b88df1b37cb431f52bc53b5616015c89b5bec411" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.197s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:09:59 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-bfe8f037-e253-49fc-9142-99421ca2e161 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:09:59 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-bfe8f037-e253-49fc-9142-99421ca2e161 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json" returned: 0 in 0.143s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:09:59 user nova-compute[71874]: DEBUG nova.virt.disk.api [None req-bfe8f037-e253-49fc-9142-99421ca2e161 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f2511c44-8365-4e8c-9814-172547111b9f/disk. size=1073741824 {{(pid=71874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 16:09:59 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-bfe8f037-e253-49fc-9142-99421ca2e161 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2511c44-8365-4e8c-9814-172547111b9f/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:09:59 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-bfe8f037-e253-49fc-9142-99421ca2e161 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2511c44-8365-4e8c-9814-172547111b9f/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:09:59 user nova-compute[71874]: DEBUG nova.virt.disk.api [None req-bfe8f037-e253-49fc-9142-99421ca2e161 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Cannot resize image /opt/stack/data/nova/instances/f2511c44-8365-4e8c-9814-172547111b9f/disk to a smaller size. {{(pid=71874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 16:09:59 user nova-compute[71874]: DEBUG nova.objects.instance [None req-bfe8f037-e253-49fc-9142-99421ca2e161 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lazy-loading 'migration_context' on Instance uuid f2511c44-8365-4e8c-9814-172547111b9f {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:09:59 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-bfe8f037-e253-49fc-9142-99421ca2e161 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: f2511c44-8365-4e8c-9814-172547111b9f] Created local disks {{(pid=71874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 16:09:59 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-bfe8f037-e253-49fc-9142-99421ca2e161 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: f2511c44-8365-4e8c-9814-172547111b9f] Ensure instance console log exists: /opt/stack/data/nova/instances/f2511c44-8365-4e8c-9814-172547111b9f/console.log {{(pid=71874) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 16:09:59 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-bfe8f037-e253-49fc-9142-99421ca2e161 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:09:59 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-bfe8f037-e253-49fc-9142-99421ca2e161 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:09:59 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-bfe8f037-e253-49fc-9142-99421ca2e161 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:09:59 user nova-compute[71874]: DEBUG nova.network.neutron [None req-bfe8f037-e253-49fc-9142-99421ca2e161 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: f2511c44-8365-4e8c-9814-172547111b9f] Successfully created port: 3d785c5d-4be8-4ade-92dd-d4bf7a16cb37 {{(pid=71874) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 16:10:00 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:10:00 user nova-compute[71874]: DEBUG nova.network.neutron [None req-bfe8f037-e253-49fc-9142-99421ca2e161 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: f2511c44-8365-4e8c-9814-172547111b9f] Successfully updated port: 3d785c5d-4be8-4ade-92dd-d4bf7a16cb37 {{(pid=71874) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 16:10:00 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-bfe8f037-e253-49fc-9142-99421ca2e161 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "refresh_cache-f2511c44-8365-4e8c-9814-172547111b9f" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:10:00 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-bfe8f037-e253-49fc-9142-99421ca2e161 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquired lock "refresh_cache-f2511c44-8365-4e8c-9814-172547111b9f" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:10:00 user nova-compute[71874]: DEBUG nova.network.neutron [None req-bfe8f037-e253-49fc-9142-99421ca2e161 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: f2511c44-8365-4e8c-9814-172547111b9f] Building network info cache for instance {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 16:10:00 user nova-compute[71874]: DEBUG nova.compute.manager [req-a7050b36-42f7-4429-93f0-6efbd00b4fb7 req-12d1e825-a4ab-4aeb-aa37-acca82718b89 service nova] [instance: f2511c44-8365-4e8c-9814-172547111b9f] Received event network-changed-3d785c5d-4be8-4ade-92dd-d4bf7a16cb37 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:10:00 user nova-compute[71874]: DEBUG nova.compute.manager [req-a7050b36-42f7-4429-93f0-6efbd00b4fb7 req-12d1e825-a4ab-4aeb-aa37-acca82718b89 service nova] [instance: f2511c44-8365-4e8c-9814-172547111b9f] Refreshing instance network info cache due to event network-changed-3d785c5d-4be8-4ade-92dd-d4bf7a16cb37. {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 16:10:00 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-a7050b36-42f7-4429-93f0-6efbd00b4fb7 req-12d1e825-a4ab-4aeb-aa37-acca82718b89 service nova] Acquiring lock "refresh_cache-f2511c44-8365-4e8c-9814-172547111b9f" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:10:00 user nova-compute[71874]: DEBUG nova.network.neutron [None req-bfe8f037-e253-49fc-9142-99421ca2e161 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: f2511c44-8365-4e8c-9814-172547111b9f] Instance cache missing network info. {{(pid=71874) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 16:10:01 user nova-compute[71874]: DEBUG nova.network.neutron [None req-bfe8f037-e253-49fc-9142-99421ca2e161 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: f2511c44-8365-4e8c-9814-172547111b9f] Updating instance_info_cache with network_info: [{"id": "3d785c5d-4be8-4ade-92dd-d4bf7a16cb37", "address": "fa:16:3e:4a:64:40", "network": {"id": "e71b9966-9a95-4f66-b3b1-36b05d05853c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-310205564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28d940eae5394293b87cfced45911ab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d785c5d-4b", "ovs_interfaceid": "3d785c5d-4be8-4ade-92dd-d4bf7a16cb37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:10:01 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-bfe8f037-e253-49fc-9142-99421ca2e161 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Releasing lock "refresh_cache-f2511c44-8365-4e8c-9814-172547111b9f" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:10:01 user nova-compute[71874]: DEBUG nova.compute.manager [None req-bfe8f037-e253-49fc-9142-99421ca2e161 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: f2511c44-8365-4e8c-9814-172547111b9f] Instance network_info: |[{"id": "3d785c5d-4be8-4ade-92dd-d4bf7a16cb37", "address": "fa:16:3e:4a:64:40", "network": {"id": "e71b9966-9a95-4f66-b3b1-36b05d05853c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-310205564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28d940eae5394293b87cfced45911ab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d785c5d-4b", "ovs_interfaceid": "3d785c5d-4be8-4ade-92dd-d4bf7a16cb37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 16:10:01 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-a7050b36-42f7-4429-93f0-6efbd00b4fb7 req-12d1e825-a4ab-4aeb-aa37-acca82718b89 service nova] Acquired lock "refresh_cache-f2511c44-8365-4e8c-9814-172547111b9f" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:10:01 user nova-compute[71874]: DEBUG nova.network.neutron [req-a7050b36-42f7-4429-93f0-6efbd00b4fb7 req-12d1e825-a4ab-4aeb-aa37-acca82718b89 service nova] [instance: f2511c44-8365-4e8c-9814-172547111b9f] Refreshing network info cache for port 3d785c5d-4be8-4ade-92dd-d4bf7a16cb37 {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 16:10:01 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-bfe8f037-e253-49fc-9142-99421ca2e161 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: f2511c44-8365-4e8c-9814-172547111b9f] Start _get_guest_xml network_info=[{"id": "3d785c5d-4be8-4ade-92dd-d4bf7a16cb37", "address": "fa:16:3e:4a:64:40", "network": {"id": "e71b9966-9a95-4f66-b3b1-36b05d05853c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-310205564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28d940eae5394293b87cfced45911ab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d785c5d-4b", "ovs_interfaceid": "3d785c5d-4be8-4ade-92dd-d4bf7a16cb37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T15:55:37Z,direct_url=<?>,disk_format='qcow2',id=9dc63f14-8b70-4e72-89f2-13464f2f5c7c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='61a4936d9b7744c0b488d81c9b7746b6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T15:55:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_options': None, 'image_id': '9dc63f14-8b70-4e72-89f2-13464f2f5c7c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 16:10:01 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-bfe8f037-e253-49fc-9142-99421ca2e161 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:10:01 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-bfe8f037-e253-49fc-9142-99421ca2e161 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:10:01 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-bfe8f037-e253-49fc-9142-99421ca2e161 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71874) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 16:10:01 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-bfe8f037-e253-49fc-9142-99421ca2e161 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T15:56:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T15:55:37Z,direct_url=<?>,disk_format='qcow2',id=9dc63f14-8b70-4e72-89f2-13464f2f5c7c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='61a4936d9b7744c0b488d81c9b7746b6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T15:55:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 16:10:01 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-bfe8f037-e253-49fc-9142-99421ca2e161 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Flavor limits 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 16:10:01 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-bfe8f037-e253-49fc-9142-99421ca2e161 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Image limits 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 16:10:01 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-bfe8f037-e253-49fc-9142-99421ca2e161 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Flavor pref 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 16:10:01 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-bfe8f037-e253-49fc-9142-99421ca2e161 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Image pref 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 16:10:01 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-bfe8f037-e253-49fc-9142-99421ca2e161 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 16:10:01 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-bfe8f037-e253-49fc-9142-99421ca2e161 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 16:10:01 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-bfe8f037-e253-49fc-9142-99421ca2e161 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 16:10:01 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-bfe8f037-e253-49fc-9142-99421ca2e161 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Got 1 possible topologies {{(pid=71874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 16:10:01 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-bfe8f037-e253-49fc-9142-99421ca2e161 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 16:10:01 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-bfe8f037-e253-49fc-9142-99421ca2e161 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 16:10:01 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-bfe8f037-e253-49fc-9142-99421ca2e161 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T16:09:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-180716396',display_name='tempest-AttachVolumeNegativeTest-server-180716396',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-180716396',id=28,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMV14aR/BI8YAjSCONdULZvRqXfIdT8RapVzPcFF9r21388G6jXQ3sF9h/frRtTRkPlFihOSvv8T7SIRbtzU0tJmwXvgpK22Hpu/EyKFqKnRb3Q7irg6PNvPxtJ9D47+Bw==',key_name='tempest-keypair-1846852248',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='28d940eae5394293b87cfced45911ab4',ramdisk_id='',reservation_id='r-d3ax1olg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-288610953',owner_user_name='tempest-AttachVolumeNegativeTest-288610953-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T16:09:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5a514f6d877a4ab0bec597fee13ce9db',uuid=f2511c44-8365-4e8c-9814-172547111b9f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3d785c5d-4be8-4ade-92dd-d4bf7a16cb37", "address": "fa:16:3e:4a:64:40", "network": {"id": "e71b9966-9a95-4f66-b3b1-36b05d05853c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-310205564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28d940eae5394293b87cfced45911ab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d785c5d-4b", "ovs_interfaceid": "3d785c5d-4be8-4ade-92dd-d4bf7a16cb37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 16:10:01 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-bfe8f037-e253-49fc-9142-99421ca2e161 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Converting VIF {"id": "3d785c5d-4be8-4ade-92dd-d4bf7a16cb37", "address": "fa:16:3e:4a:64:40", "network": {"id": "e71b9966-9a95-4f66-b3b1-36b05d05853c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-310205564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28d940eae5394293b87cfced45911ab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d785c5d-4b", "ovs_interfaceid": "3d785c5d-4be8-4ade-92dd-d4bf7a16cb37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:10:01 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-bfe8f037-e253-49fc-9142-99421ca2e161 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:64:40,bridge_name='br-int',has_traffic_filtering=True,id=3d785c5d-4be8-4ade-92dd-d4bf7a16cb37,network=Network(e71b9966-9a95-4f66-b3b1-36b05d05853c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d785c5d-4b') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:10:01 user nova-compute[71874]: DEBUG nova.objects.instance [None req-bfe8f037-e253-49fc-9142-99421ca2e161 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lazy-loading 'pci_devices' on Instance uuid f2511c44-8365-4e8c-9814-172547111b9f {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:10:01 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-bfe8f037-e253-49fc-9142-99421ca2e161 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: f2511c44-8365-4e8c-9814-172547111b9f] End _get_guest_xml xml=<domain type="kvm">
Apr 12 16:10:01 user nova-compute[71874]:   <uuid>f2511c44-8365-4e8c-9814-172547111b9f</uuid>
Apr 12 16:10:01 user nova-compute[71874]:   <name>instance-0000001c</name>
Apr 12 16:10:01 user nova-compute[71874]:   <memory>131072</memory>
Apr 12 16:10:01 user nova-compute[71874]:   <vcpu>1</vcpu>
Apr 12 16:10:01 user nova-compute[71874]:   <metadata>
Apr 12 16:10:01 user nova-compute[71874]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 16:10:01 user nova-compute[71874]:       <nova:package version="0.0.0"/>
Apr 12 16:10:01 user nova-compute[71874]:       <nova:name>tempest-AttachVolumeNegativeTest-server-180716396</nova:name>
Apr 12 16:10:01 user nova-compute[71874]:       <nova:creationTime>2023-04-12 16:10:01</nova:creationTime>
Apr 12 16:10:01 user nova-compute[71874]:       <nova:flavor name="m1.nano">
Apr 12 16:10:01 user nova-compute[71874]:         <nova:memory>128</nova:memory>
Apr 12 16:10:01 user nova-compute[71874]:         <nova:disk>1</nova:disk>
Apr 12 16:10:01 user nova-compute[71874]:         <nova:swap>0</nova:swap>
Apr 12 16:10:01 user nova-compute[71874]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 16:10:01 user nova-compute[71874]:         <nova:vcpus>1</nova:vcpus>
Apr 12 16:10:01 user nova-compute[71874]:       </nova:flavor>
Apr 12 16:10:01 user nova-compute[71874]:       <nova:owner>
Apr 12 16:10:01 user nova-compute[71874]:         <nova:user uuid="5a514f6d877a4ab0bec597fee13ce9db">tempest-AttachVolumeNegativeTest-288610953-project-member</nova:user>
Apr 12 16:10:01 user nova-compute[71874]:         <nova:project uuid="28d940eae5394293b87cfced45911ab4">tempest-AttachVolumeNegativeTest-288610953</nova:project>
Apr 12 16:10:01 user nova-compute[71874]:       </nova:owner>
Apr 12 16:10:01 user nova-compute[71874]:       <nova:root type="image" uuid="9dc63f14-8b70-4e72-89f2-13464f2f5c7c"/>
Apr 12 16:10:01 user nova-compute[71874]:       <nova:ports>
Apr 12 16:10:01 user nova-compute[71874]:         <nova:port uuid="3d785c5d-4be8-4ade-92dd-d4bf7a16cb37">
Apr 12 16:10:01 user nova-compute[71874]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 12 16:10:01 user nova-compute[71874]:         </nova:port>
Apr 12 16:10:01 user nova-compute[71874]:       </nova:ports>
Apr 12 16:10:01 user nova-compute[71874]:     </nova:instance>
Apr 12 16:10:01 user nova-compute[71874]:   </metadata>
Apr 12 16:10:01 user nova-compute[71874]:   <sysinfo type="smbios">
Apr 12 16:10:01 user nova-compute[71874]:     <system>
Apr 12 16:10:01 user nova-compute[71874]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 16:10:01 user nova-compute[71874]:       <entry name="product">OpenStack Nova</entry>
Apr 12 16:10:01 user nova-compute[71874]:       <entry name="version">0.0.0</entry>
Apr 12 16:10:01 user nova-compute[71874]:       <entry name="serial">f2511c44-8365-4e8c-9814-172547111b9f</entry>
Apr 12 16:10:01 user nova-compute[71874]:       <entry name="uuid">f2511c44-8365-4e8c-9814-172547111b9f</entry>
Apr 12 16:10:01 user nova-compute[71874]:       <entry name="family">Virtual Machine</entry>
Apr 12 16:10:01 user nova-compute[71874]:     </system>
Apr 12 16:10:01 user nova-compute[71874]:   </sysinfo>
Apr 12 16:10:01 user nova-compute[71874]:   <os>
Apr 12 16:10:01 user nova-compute[71874]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 16:10:01 user nova-compute[71874]:     <boot dev="hd"/>
Apr 12 16:10:01 user nova-compute[71874]:     <smbios mode="sysinfo"/>
Apr 12 16:10:01 user nova-compute[71874]:   </os>
Apr 12 16:10:01 user nova-compute[71874]:   <features>
Apr 12 16:10:01 user nova-compute[71874]:     <acpi/>
Apr 12 16:10:01 user nova-compute[71874]:     <apic/>
Apr 12 16:10:01 user nova-compute[71874]:     <vmcoreinfo/>
Apr 12 16:10:01 user nova-compute[71874]:   </features>
Apr 12 16:10:01 user nova-compute[71874]:   <clock offset="utc">
Apr 12 16:10:01 user nova-compute[71874]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 16:10:01 user nova-compute[71874]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 16:10:01 user nova-compute[71874]:     <timer name="hpet" present="no"/>
Apr 12 16:10:01 user nova-compute[71874]:   </clock>
Apr 12 16:10:01 user nova-compute[71874]:   <cpu mode="custom" match="exact">
Apr 12 16:10:01 user nova-compute[71874]:     <model>Nehalem</model>
Apr 12 16:10:01 user nova-compute[71874]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 16:10:01 user nova-compute[71874]:   </cpu>
Apr 12 16:10:01 user nova-compute[71874]:   <devices>
Apr 12 16:10:01 user nova-compute[71874]:     <disk type="file" device="disk">
Apr 12 16:10:01 user nova-compute[71874]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 16:10:01 user nova-compute[71874]:       <source file="/opt/stack/data/nova/instances/f2511c44-8365-4e8c-9814-172547111b9f/disk"/>
Apr 12 16:10:01 user nova-compute[71874]:       <target dev="vda" bus="virtio"/>
Apr 12 16:10:01 user nova-compute[71874]:     </disk>
Apr 12 16:10:01 user nova-compute[71874]:     <interface type="ethernet">
Apr 12 16:10:01 user nova-compute[71874]:       <mac address="fa:16:3e:4a:64:40"/>
Apr 12 16:10:01 user nova-compute[71874]:       <model type="virtio"/>
Apr 12 16:10:01 user nova-compute[71874]:       <mtu size="1442"/>
Apr 12 16:10:01 user nova-compute[71874]:       <target dev="tap3d785c5d-4b"/>
Apr 12 16:10:01 user nova-compute[71874]:     </interface>
Apr 12 16:10:01 user nova-compute[71874]:     <serial type="pty">
Apr 12 16:10:01 user nova-compute[71874]:       <log file="/opt/stack/data/nova/instances/f2511c44-8365-4e8c-9814-172547111b9f/console.log" append="off"/>
Apr 12 16:10:01 user nova-compute[71874]:     </serial>
Apr 12 16:10:01 user nova-compute[71874]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 16:10:01 user nova-compute[71874]:     <video>
Apr 12 16:10:01 user nova-compute[71874]:       <model type="virtio"/>
Apr 12 16:10:01 user nova-compute[71874]:     </video>
Apr 12 16:10:01 user nova-compute[71874]:     <rng model="virtio">
Apr 12 16:10:01 user nova-compute[71874]:       <backend model="random">/dev/urandom</backend>
Apr 12 16:10:01 user nova-compute[71874]:     </rng>
Apr 12 16:10:01 user nova-compute[71874]:     <controller type="usb" index="0" model="none"/>
Apr 12 16:10:01 user nova-compute[71874]:     <memballoon model="virtio">
Apr 12 16:10:01 user nova-compute[71874]:       <stats period="10"/>
Apr 12 16:10:01 user nova-compute[71874]:     </memballoon>
Apr 12 16:10:01 user nova-compute[71874]:   </devices>
Apr 12 16:10:01 user nova-compute[71874]: </domain>
Apr 12 16:10:01 user nova-compute[71874]:  {{(pid=71874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 16:10:01 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-bfe8f037-e253-49fc-9142-99421ca2e161 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T16:09:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-180716396',display_name='tempest-AttachVolumeNegativeTest-server-180716396',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-180716396',id=28,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMV14aR/BI8YAjSCONdULZvRqXfIdT8RapVzPcFF9r21388G6jXQ3sF9h/frRtTRkPlFihOSvv8T7SIRbtzU0tJmwXvgpK22Hpu/EyKFqKnRb3Q7irg6PNvPxtJ9D47+Bw==',key_name='tempest-keypair-1846852248',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='28d940eae5394293b87cfced45911ab4',ramdisk_id='',reservation_id='r-d3ax1olg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-288610953',owner_user_name='tempest-AttachVolumeNegativeTest-288610953-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T16:09:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5a514f6d877a4ab0bec597fee13ce9db',uuid=f2511c44-8365-4e8c-9814-172547111b9f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3d785c5d-4be8-4ade-92dd-d4bf7a16cb37", "address": "fa:16:3e:4a:64:40", "network": {"id": "e71b9966-9a95-4f66-b3b1-36b05d05853c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-310205564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28d940eae5394293b87cfced45911ab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d785c5d-4b", "ovs_interfaceid": "3d785c5d-4be8-4ade-92dd-d4bf7a16cb37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 16:10:01 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-bfe8f037-e253-49fc-9142-99421ca2e161 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Converting VIF {"id": "3d785c5d-4be8-4ade-92dd-d4bf7a16cb37", "address": "fa:16:3e:4a:64:40", "network": {"id": "e71b9966-9a95-4f66-b3b1-36b05d05853c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-310205564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28d940eae5394293b87cfced45911ab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d785c5d-4b", "ovs_interfaceid": "3d785c5d-4be8-4ade-92dd-d4bf7a16cb37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:10:01 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-bfe8f037-e253-49fc-9142-99421ca2e161 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:64:40,bridge_name='br-int',has_traffic_filtering=True,id=3d785c5d-4be8-4ade-92dd-d4bf7a16cb37,network=Network(e71b9966-9a95-4f66-b3b1-36b05d05853c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d785c5d-4b') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:10:01 user nova-compute[71874]: DEBUG os_vif [None req-bfe8f037-e253-49fc-9142-99421ca2e161 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:64:40,bridge_name='br-int',has_traffic_filtering=True,id=3d785c5d-4be8-4ade-92dd-d4bf7a16cb37,network=Network(e71b9966-9a95-4f66-b3b1-36b05d05853c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d785c5d-4b') {{(pid=71874) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 16:10:01 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:10:01 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:10:01 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 16:10:01 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:10:01 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3d785c5d-4b, may_exist=True) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:10:01 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3d785c5d-4b, col_values=(('external_ids', {'iface-id': '3d785c5d-4be8-4ade-92dd-d4bf7a16cb37', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4a:64:40', 'vm-uuid': 'f2511c44-8365-4e8c-9814-172547111b9f'}),)) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:10:01 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:10:01 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:10:01 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:10:01 user nova-compute[71874]: INFO os_vif [None req-bfe8f037-e253-49fc-9142-99421ca2e161 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:64:40,bridge_name='br-int',has_traffic_filtering=True,id=3d785c5d-4be8-4ade-92dd-d4bf7a16cb37,network=Network(e71b9966-9a95-4f66-b3b1-36b05d05853c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d785c5d-4b')
Apr 12 16:10:01 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-bfe8f037-e253-49fc-9142-99421ca2e161 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] No BDM found with device name vda, not building metadata. {{(pid=71874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 16:10:01 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-bfe8f037-e253-49fc-9142-99421ca2e161 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] No VIF found with MAC fa:16:3e:4a:64:40, not building metadata {{(pid=71874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 16:10:01 user nova-compute[71874]: DEBUG nova.network.neutron [req-a7050b36-42f7-4429-93f0-6efbd00b4fb7 req-12d1e825-a4ab-4aeb-aa37-acca82718b89 service nova] [instance: f2511c44-8365-4e8c-9814-172547111b9f] Updated VIF entry in instance network info cache for port 3d785c5d-4be8-4ade-92dd-d4bf7a16cb37. {{(pid=71874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 16:10:01 user nova-compute[71874]: DEBUG nova.network.neutron [req-a7050b36-42f7-4429-93f0-6efbd00b4fb7 req-12d1e825-a4ab-4aeb-aa37-acca82718b89 service nova] [instance: f2511c44-8365-4e8c-9814-172547111b9f] Updating instance_info_cache with network_info: [{"id": "3d785c5d-4be8-4ade-92dd-d4bf7a16cb37", "address": "fa:16:3e:4a:64:40", "network": {"id": "e71b9966-9a95-4f66-b3b1-36b05d05853c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-310205564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28d940eae5394293b87cfced45911ab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d785c5d-4b", "ovs_interfaceid": "3d785c5d-4be8-4ade-92dd-d4bf7a16cb37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:10:01 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-a7050b36-42f7-4429-93f0-6efbd00b4fb7 req-12d1e825-a4ab-4aeb-aa37-acca82718b89 service nova] Releasing lock "refresh_cache-f2511c44-8365-4e8c-9814-172547111b9f" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:10:02 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:10:02 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:10:02 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:10:02 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:10:03 user nova-compute[71874]: DEBUG nova.compute.manager [req-b2230a81-1fd8-4358-b775-e34115d90593 req-49e794be-b9af-4500-afc8-701f28b52c5f service nova] [instance: f2511c44-8365-4e8c-9814-172547111b9f] Received event network-vif-plugged-3d785c5d-4be8-4ade-92dd-d4bf7a16cb37 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:10:03 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-b2230a81-1fd8-4358-b775-e34115d90593 req-49e794be-b9af-4500-afc8-701f28b52c5f service nova] Acquiring lock "f2511c44-8365-4e8c-9814-172547111b9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:10:03 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-b2230a81-1fd8-4358-b775-e34115d90593 req-49e794be-b9af-4500-afc8-701f28b52c5f service nova] Lock "f2511c44-8365-4e8c-9814-172547111b9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:10:03 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-b2230a81-1fd8-4358-b775-e34115d90593 req-49e794be-b9af-4500-afc8-701f28b52c5f service nova] Lock "f2511c44-8365-4e8c-9814-172547111b9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:10:03 user nova-compute[71874]: DEBUG nova.compute.manager [req-b2230a81-1fd8-4358-b775-e34115d90593 req-49e794be-b9af-4500-afc8-701f28b52c5f service nova] [instance: f2511c44-8365-4e8c-9814-172547111b9f] No waiting events found dispatching network-vif-plugged-3d785c5d-4be8-4ade-92dd-d4bf7a16cb37 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:10:03 user nova-compute[71874]: WARNING nova.compute.manager [req-b2230a81-1fd8-4358-b775-e34115d90593 req-49e794be-b9af-4500-afc8-701f28b52c5f service nova] [instance: f2511c44-8365-4e8c-9814-172547111b9f] Received unexpected event network-vif-plugged-3d785c5d-4be8-4ade-92dd-d4bf7a16cb37 for instance with vm_state building and task_state spawning.
Apr 12 16:10:03 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:10:03 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:10:03 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:10:05 user nova-compute[71874]: DEBUG nova.compute.manager [None req-bfe8f037-e253-49fc-9142-99421ca2e161 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: f2511c44-8365-4e8c-9814-172547111b9f] Instance event wait completed in 0 seconds for  {{(pid=71874) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 16:10:05 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-bfe8f037-e253-49fc-9142-99421ca2e161 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: f2511c44-8365-4e8c-9814-172547111b9f] Guest created on hypervisor {{(pid=71874) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 16:10:05 user nova-compute[71874]: DEBUG nova.virt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Emitting event <LifecycleEvent: 1681315805.0111763, f2511c44-8365-4e8c-9814-172547111b9f => Resumed> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:10:05 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: f2511c44-8365-4e8c-9814-172547111b9f] VM Resumed (Lifecycle Event)
Apr 12 16:10:05 user nova-compute[71874]: INFO nova.virt.libvirt.driver [-] [instance: f2511c44-8365-4e8c-9814-172547111b9f] Instance spawned successfully.
Apr 12 16:10:05 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-bfe8f037-e253-49fc-9142-99421ca2e161 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: f2511c44-8365-4e8c-9814-172547111b9f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 16:10:05 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: f2511c44-8365-4e8c-9814-172547111b9f] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:10:05 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: f2511c44-8365-4e8c-9814-172547111b9f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 16:10:05 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-bfe8f037-e253-49fc-9142-99421ca2e161 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: f2511c44-8365-4e8c-9814-172547111b9f] Found default for hw_cdrom_bus of ide {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:10:05 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-bfe8f037-e253-49fc-9142-99421ca2e161 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: f2511c44-8365-4e8c-9814-172547111b9f] Found default for hw_disk_bus of virtio {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:10:05 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-bfe8f037-e253-49fc-9142-99421ca2e161 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: f2511c44-8365-4e8c-9814-172547111b9f] Found default for hw_input_bus of None {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:10:05 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-bfe8f037-e253-49fc-9142-99421ca2e161 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: f2511c44-8365-4e8c-9814-172547111b9f] Found default for hw_pointer_model of None {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:10:05 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-bfe8f037-e253-49fc-9142-99421ca2e161 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: f2511c44-8365-4e8c-9814-172547111b9f] Found default for hw_video_model of virtio {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:10:05 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-bfe8f037-e253-49fc-9142-99421ca2e161 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: f2511c44-8365-4e8c-9814-172547111b9f] Found default for hw_vif_model of virtio {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:10:05 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: f2511c44-8365-4e8c-9814-172547111b9f] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 16:10:05 user nova-compute[71874]: DEBUG nova.virt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Emitting event <LifecycleEvent: 1681315805.0125222, f2511c44-8365-4e8c-9814-172547111b9f => Started> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:10:05 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: f2511c44-8365-4e8c-9814-172547111b9f] VM Started (Lifecycle Event)
Apr 12 16:10:05 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: f2511c44-8365-4e8c-9814-172547111b9f] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:10:05 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: f2511c44-8365-4e8c-9814-172547111b9f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 16:10:05 user nova-compute[71874]: DEBUG nova.compute.manager [req-7a1c299f-af10-4df8-90f7-d326362999f8 req-5dceb2a4-33e0-4573-9bae-c4d8ced2527b service nova] [instance: f2511c44-8365-4e8c-9814-172547111b9f] Received event network-vif-plugged-3d785c5d-4be8-4ade-92dd-d4bf7a16cb37 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:10:05 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-7a1c299f-af10-4df8-90f7-d326362999f8 req-5dceb2a4-33e0-4573-9bae-c4d8ced2527b service nova] Acquiring lock "f2511c44-8365-4e8c-9814-172547111b9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:10:05 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-7a1c299f-af10-4df8-90f7-d326362999f8 req-5dceb2a4-33e0-4573-9bae-c4d8ced2527b service nova] Lock "f2511c44-8365-4e8c-9814-172547111b9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:10:05 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-7a1c299f-af10-4df8-90f7-d326362999f8 req-5dceb2a4-33e0-4573-9bae-c4d8ced2527b service nova] Lock "f2511c44-8365-4e8c-9814-172547111b9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:10:05 user nova-compute[71874]: DEBUG nova.compute.manager [req-7a1c299f-af10-4df8-90f7-d326362999f8 req-5dceb2a4-33e0-4573-9bae-c4d8ced2527b service nova] [instance: f2511c44-8365-4e8c-9814-172547111b9f] No waiting events found dispatching network-vif-plugged-3d785c5d-4be8-4ade-92dd-d4bf7a16cb37 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:10:05 user nova-compute[71874]: WARNING nova.compute.manager [req-7a1c299f-af10-4df8-90f7-d326362999f8 req-5dceb2a4-33e0-4573-9bae-c4d8ced2527b service nova] [instance: f2511c44-8365-4e8c-9814-172547111b9f] Received unexpected event network-vif-plugged-3d785c5d-4be8-4ade-92dd-d4bf7a16cb37 for instance with vm_state building and task_state spawning.
Apr 12 16:10:05 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: f2511c44-8365-4e8c-9814-172547111b9f] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 16:10:05 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:10:05 user nova-compute[71874]: INFO nova.compute.manager [None req-bfe8f037-e253-49fc-9142-99421ca2e161 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: f2511c44-8365-4e8c-9814-172547111b9f] Took 6.42 seconds to spawn the instance on the hypervisor.
Apr 12 16:10:05 user nova-compute[71874]: DEBUG nova.compute.manager [None req-bfe8f037-e253-49fc-9142-99421ca2e161 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: f2511c44-8365-4e8c-9814-172547111b9f] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:10:05 user nova-compute[71874]: INFO nova.compute.manager [None req-bfe8f037-e253-49fc-9142-99421ca2e161 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: f2511c44-8365-4e8c-9814-172547111b9f] Took 7.17 seconds to build instance.
Apr 12 16:10:05 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-bfe8f037-e253-49fc-9142-99421ca2e161 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "f2511c44-8365-4e8c-9814-172547111b9f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.268s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:10:06 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:10:06 user nova-compute[71874]: DEBUG nova.compute.manager [None req-8d7875a4-26ce-4bd2-b2f6-541189dbd107 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] [instance: 78b6940a-f97a-4535-8973-3c2a5befbbab] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:10:06 user nova-compute[71874]: INFO nova.compute.manager [None req-8d7875a4-26ce-4bd2-b2f6-541189dbd107 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] [instance: 78b6940a-f97a-4535-8973-3c2a5befbbab] instance snapshotting
Apr 12 16:10:06 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-8d7875a4-26ce-4bd2-b2f6-541189dbd107 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] [instance: 78b6940a-f97a-4535-8973-3c2a5befbbab] Beginning live snapshot process
Apr 12 16:10:06 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-8d7875a4-26ce-4bd2-b2f6-541189dbd107 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78b6940a-f97a-4535-8973-3c2a5befbbab/disk --force-share --output=json -f qcow2 {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:10:07 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-8d7875a4-26ce-4bd2-b2f6-541189dbd107 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78b6940a-f97a-4535-8973-3c2a5befbbab/disk --force-share --output=json -f qcow2" returned: 0 in 0.137s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:10:07 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-8d7875a4-26ce-4bd2-b2f6-541189dbd107 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78b6940a-f97a-4535-8973-3c2a5befbbab/disk --force-share --output=json -f qcow2 {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:10:07 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-8d7875a4-26ce-4bd2-b2f6-541189dbd107 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78b6940a-f97a-4535-8973-3c2a5befbbab/disk --force-share --output=json -f qcow2" returned: 0 in 0.198s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:10:07 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-8d7875a4-26ce-4bd2-b2f6-541189dbd107 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:10:07 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-8d7875a4-26ce-4bd2-b2f6-541189dbd107 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json" returned: 0 in 0.140s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:10:07 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-8d7875a4-26ce-4bd2-b2f6-541189dbd107 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpx7bi3jvd/64be4107d6ee47a89d9e12eb726a2778.delta 1073741824 {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:10:07 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-8d7875a4-26ce-4bd2-b2f6-541189dbd107 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpx7bi3jvd/64be4107d6ee47a89d9e12eb726a2778.delta 1073741824" returned: 0 in 0.062s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:10:07 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-8d7875a4-26ce-4bd2-b2f6-541189dbd107 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] [instance: 78b6940a-f97a-4535-8973-3c2a5befbbab] Quiescing instance not available: QEMU guest agent is not enabled.
Apr 12 16:10:07 user nova-compute[71874]: DEBUG nova.network.neutron [None req-5d57ee95-b468-40fc-a118-3ff198e91ba7 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Port 18196ae0-d9c1-4814-8803-c4ba8ad4ab45 binding to destination host user is already ACTIVE {{(pid=71874) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3161}}
Apr 12 16:10:07 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-5d57ee95-b468-40fc-a118-3ff198e91ba7 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "refresh_cache-dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:10:07 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-5d57ee95-b468-40fc-a118-3ff198e91ba7 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquired lock "refresh_cache-dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:10:07 user nova-compute[71874]: DEBUG nova.network.neutron [None req-5d57ee95-b468-40fc-a118-3ff198e91ba7 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Building network info cache for instance {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 16:10:07 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:10:08 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:10:08 user nova-compute[71874]: DEBUG nova.virt.libvirt.guest [None req-8d7875a4-26ce-4bd2-b2f6-541189dbd107 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] COPY block job progress, current cursor: 0 final cursor: 43843584 {{(pid=71874) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 16:10:08 user nova-compute[71874]: DEBUG nova.network.neutron [None req-5d57ee95-b468-40fc-a118-3ff198e91ba7 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Updating instance_info_cache with network_info: [{"id": "18196ae0-d9c1-4814-8803-c4ba8ad4ab45", "address": "fa:16:3e:98:72:fa", "network": {"id": "e6694358-e361-4952-b859-93755c11721e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-667152893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97ea81bd1962466bbe552424973f71a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18196ae0-d9", "ovs_interfaceid": "18196ae0-d9c1-4814-8803-c4ba8ad4ab45", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:10:08 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-5d57ee95-b468-40fc-a118-3ff198e91ba7 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Releasing lock "refresh_cache-dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:10:08 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-5d57ee95-b468-40fc-a118-3ff198e91ba7 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Creating tmpfile /opt/stack/data/nova/instances/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1/tmpk1c0rbwl to verify with other compute node that the instance is on the same shared storage. {{(pid=71874) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9595}}
Apr 12 16:10:08 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:10:08 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:10:08 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:10:08 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:10:08 user nova-compute[71874]: DEBUG nova.virt.libvirt.guest [None req-8d7875a4-26ce-4bd2-b2f6-541189dbd107 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] COPY block job progress, current cursor: 43843584 final cursor: 43843584 {{(pid=71874) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 16:10:08 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-8d7875a4-26ce-4bd2-b2f6-541189dbd107 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] [instance: 78b6940a-f97a-4535-8973-3c2a5befbbab] Skipping quiescing instance: QEMU guest agent is not enabled.
Apr 12 16:10:08 user nova-compute[71874]: DEBUG nova.privsep.utils [None req-8d7875a4-26ce-4bd2-b2f6-541189dbd107 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71874) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 12 16:10:08 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-8d7875a4-26ce-4bd2-b2f6-541189dbd107 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpx7bi3jvd/64be4107d6ee47a89d9e12eb726a2778.delta /opt/stack/data/nova/instances/snapshots/tmpx7bi3jvd/64be4107d6ee47a89d9e12eb726a2778 {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:10:09 user nova-compute[71874]: DEBUG nova.compute.manager [req-dd6708e8-c4ef-49a3-b241-7fc5ba53da22 req-8687a4c1-4f46-442c-a09c-f1ddd3b1eed2 service nova] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Received event network-vif-unplugged-18196ae0-d9c1-4814-8803-c4ba8ad4ab45 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:10:09 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-dd6708e8-c4ef-49a3-b241-7fc5ba53da22 req-8687a4c1-4f46-442c-a09c-f1ddd3b1eed2 service nova] Acquiring lock "dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:10:09 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-dd6708e8-c4ef-49a3-b241-7fc5ba53da22 req-8687a4c1-4f46-442c-a09c-f1ddd3b1eed2 service nova] Lock "dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:10:09 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-dd6708e8-c4ef-49a3-b241-7fc5ba53da22 req-8687a4c1-4f46-442c-a09c-f1ddd3b1eed2 service nova] Lock "dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:10:09 user nova-compute[71874]: DEBUG nova.compute.manager [req-dd6708e8-c4ef-49a3-b241-7fc5ba53da22 req-8687a4c1-4f46-442c-a09c-f1ddd3b1eed2 service nova] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] No waiting events found dispatching network-vif-unplugged-18196ae0-d9c1-4814-8803-c4ba8ad4ab45 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:10:09 user nova-compute[71874]: WARNING nova.compute.manager [req-dd6708e8-c4ef-49a3-b241-7fc5ba53da22 req-8687a4c1-4f46-442c-a09c-f1ddd3b1eed2 service nova] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Received unexpected event network-vif-unplugged-18196ae0-d9c1-4814-8803-c4ba8ad4ab45 for instance with vm_state resized and task_state resize_reverting.
Apr 12 16:10:09 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-8d7875a4-26ce-4bd2-b2f6-541189dbd107 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpx7bi3jvd/64be4107d6ee47a89d9e12eb726a2778.delta /opt/stack/data/nova/instances/snapshots/tmpx7bi3jvd/64be4107d6ee47a89d9e12eb726a2778" returned: 0 in 0.509s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:10:09 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-8d7875a4-26ce-4bd2-b2f6-541189dbd107 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] [instance: 78b6940a-f97a-4535-8973-3c2a5befbbab] Snapshot extracted, beginning image upload
Apr 12 16:10:09 user nova-compute[71874]: INFO nova.virt.libvirt.driver [-] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Instance destroyed successfully.
Apr 12 16:10:09 user nova-compute[71874]: DEBUG nova.objects.instance [None req-5d57ee95-b468-40fc-a118-3ff198e91ba7 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lazy-loading 'resources' on Instance uuid dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:10:09 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-5d57ee95-b468-40fc-a118-3ff198e91ba7 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-12T15:59:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1390712116',display_name='tempest-ServerActionsTestJSON-server-416657090',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1390712116',id=4,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNmXVADjvoPSh3uGCGCTNS/vcfcDtUjn/vZEaV3bCllfz1ZO8VIgFuZhP+mAsa+G/KA4ubi5U9Vj41YtHGsakdPR5VoByhorvfUv/PIWtER2tn1LWX2mlFyT+T8AEJplPw==',key_name='tempest-keypair-1923467613',keypairs=<?>,launch_index=0,launched_at=2023-04-12T16:08:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=<?>,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='97ea81bd1962466bbe552424973f71a8',ramdisk_id='',reservation_id='r-y3c7iw20',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-631887779',owner_user_name='tempest-ServerActionsTestJSON-631887779-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T16:08:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1a699b3ba8304eadb8a53d465ea340cf',uuid=dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "18196ae0-d9c1-4814-8803-c4ba8ad4ab45", "address": "fa:16:3e:98:72:fa", "network": {"id": "e6694358-e361-4952-b859-93755c11721e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-667152893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97ea81bd1962466bbe552424973f71a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18196ae0-d9", "ovs_interfaceid": "18196ae0-d9c1-4814-8803-c4ba8ad4ab45", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 16:10:09 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-5d57ee95-b468-40fc-a118-3ff198e91ba7 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Converting VIF {"id": "18196ae0-d9c1-4814-8803-c4ba8ad4ab45", "address": "fa:16:3e:98:72:fa", "network": {"id": "e6694358-e361-4952-b859-93755c11721e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-667152893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97ea81bd1962466bbe552424973f71a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18196ae0-d9", "ovs_interfaceid": "18196ae0-d9c1-4814-8803-c4ba8ad4ab45", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:10:09 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-5d57ee95-b468-40fc-a118-3ff198e91ba7 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:98:72:fa,bridge_name='br-int',has_traffic_filtering=True,id=18196ae0-d9c1-4814-8803-c4ba8ad4ab45,network=Network(e6694358-e361-4952-b859-93755c11721e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18196ae0-d9') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:10:09 user nova-compute[71874]: DEBUG os_vif [None req-5d57ee95-b468-40fc-a118-3ff198e91ba7 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:98:72:fa,bridge_name='br-int',has_traffic_filtering=True,id=18196ae0-d9c1-4814-8803-c4ba8ad4ab45,network=Network(e6694358-e361-4952-b859-93755c11721e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18196ae0-d9') {{(pid=71874) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 16:10:09 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:10:09 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap18196ae0-d9, bridge=br-int, if_exists=True) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:10:09 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:10:09 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:10:09 user nova-compute[71874]: INFO os_vif [None req-5d57ee95-b468-40fc-a118-3ff198e91ba7 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:98:72:fa,bridge_name='br-int',has_traffic_filtering=True,id=18196ae0-d9c1-4814-8803-c4ba8ad4ab45,network=Network(e6694358-e361-4952-b859-93755c11721e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18196ae0-d9')
Apr 12 16:10:09 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d57ee95-b468-40fc-a118-3ff198e91ba7 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] calling os-brick to detach iSCSI Volume {{(pid=71874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 16:10:09 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d57ee95-b468-40fc-a118-3ff198e91ba7 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3c0216320>, {'target_iqn': 'iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RGWZNvlY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:10:09 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-5d57ee95-b468-40fc-a118-3ff198e91ba7 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:10:09 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-5d57ee95-b468-40fc-a118-3ff198e91ba7 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:10:09 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-5d57ee95-b468-40fc-a118-3ff198e91ba7 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:10:09 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:10:09 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:10:09 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[36678c4d-dbe4-4793-908c-440eeb7160c0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1f27a002-8dfc-4d90-aa35-ba16586d4366\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7cc863d9-b797-4b5b-b8ce-30ebe55b9519\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:10:09 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d57ee95-b468-40fc-a118-3ff198e91ba7 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 16:10:09 user nova-compute[71874]: No targets found.
Apr 12 16:10:09 user nova-compute[71874]: iSNS:
Apr 12 16:10:09 user nova-compute[71874]: No targets found.
Apr 12 16:10:09 user nova-compute[71874]: STATIC:
Apr 12 16:10:09 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:1f27a002-8dfc-4d90-aa35-ba16586d4366
Apr 12 16:10:09 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:10:09 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:10:09 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:7cc863d9-b797-4b5b-b8ce-30ebe55b9519
Apr 12 16:10:09 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:10:09 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:10:09 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297
Apr 12 16:10:09 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:10:09 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:10:09 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2
Apr 12 16:10:09 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:10:09 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:10:09 user nova-compute[71874]: FIRMWARE:
Apr 12 16:10:09 user nova-compute[71874]: No targets found.
Apr 12 16:10:09 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:10:09 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d57ee95-b468-40fc-a118-3ff198e91ba7 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 16:10:09 user nova-compute[71874]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 16:10:09 user nova-compute[71874]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71874) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 16:10:09 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d57ee95-b468-40fc-a118-3ff198e91ba7 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297', 0)] {{(pid=71874) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 16:10:09 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:10:09 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:10:09 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[4220aa55-9824-4358-af27-14bd0bc9c5dc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1f27a002-8dfc-4d90-aa35-ba16586d4366\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7cc863d9-b797-4b5b-b8ce-30ebe55b9519\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:10:09 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:10:09 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:10:09 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[14456f7a-5fdd-4ee2-b0a7-61e989fc9a50]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cc863d9-b797-4b5b-b8ce-30ebe55b9519 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f27a002-8dfc-4d90-aa35-ba16586d4366 (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:10:09 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d57ee95-b468-40fc-a118-3ff198e91ba7 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:10:09 user nova-compute[71874]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cc863d9-b797-4b5b-b8ce-30ebe55b9519 (non-flash)
Apr 12 16:10:09 user nova-compute[71874]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 (non-flash)
Apr 12 16:10:09 user nova-compute[71874]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f27a002-8dfc-4d90-aa35-ba16586d4366 (non-flash)
Apr 12 16:10:09 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:10:09 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d57ee95-b468-40fc-a118-3ff198e91ba7 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:10:09 user nova-compute[71874]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cc863d9-b797-4b5b-b8ce-30ebe55b9519 (non-flash)
Apr 12 16:10:09 user nova-compute[71874]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 (non-flash)
Apr 12 16:10:09 user nova-compute[71874]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f27a002-8dfc-4d90-aa35-ba16586d4366 (non-flash)
Apr 12 16:10:09 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:10:09 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d57ee95-b468-40fc-a118-3ff198e91ba7 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc39c200160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297'): ({'sdd'}, set())}) {{(pid=71874) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 16:10:09 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-5d57ee95-b468-40fc-a118-3ff198e91ba7 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Removing single pathed devices sdd {{(pid=71874) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 16:10:09 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:10:09 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:10:09 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[dec5d854-35bf-4d72-ab94-68199555b547]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:10:09 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:10:09 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:10:09 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[31cff771-615b-4993-a435-03f1442c473a]: (4, ('ok\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:10:09 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-5d57ee95-b468-40fc-a118-3ff198e91ba7 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Flushing IO for device /dev/sdd {{(pid=71874) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 16:10:09 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:10:09 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:10:09 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[d08bbd19-d47f-47ad-9d47-ebf79b833ca3]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:10:09 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-5d57ee95-b468-40fc-a118-3ff198e91ba7 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71874) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 16:10:09 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:10:09 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.051s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:10:09 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4264e67-9a20-4329-84d2-4301a46f2f42]: (4, ('1', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:10:09 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-5d57ee95-b468-40fc-a118-3ff198e91ba7 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71874) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 16:10:09 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-5d57ee95-b468-40fc-a118-3ff198e91ba7 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] SCSI volumes sdd have been removed. {{(pid=71874) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 16:10:09 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d57ee95-b468-40fc-a118-3ff198e91ba7 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297')] {{(pid=71874) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 16:10:09 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:10:09 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:10:09 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[557808fd-5c45-41a8-8278-213edfc4d483]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:10:09 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d57ee95-b468-40fc-a118-3ff198e91ba7 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:10:09 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 -p 172.16.0.220:3260 --logout {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:10:09 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:10:09 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[463410b5-f1dc-4cdc-9359-c5a6e674cd16]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:10:09 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d57ee95-b468-40fc-a118-3ff198e91ba7 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297, portal: 172.16.0.220,3260]
Apr 12 16:10:09 user nova-compute[71874]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297, portal: 172.16.0.220,3260] successful.
Apr 12 16:10:09 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:10:09 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 -p 172.16.0.220:3260 --op delete {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:10:09 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:10:09 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[214522d2-2e4b-454a-b350-5bdf58b31cca]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:10:09 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d57ee95-b468-40fc-a118-3ff198e91ba7 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:10:09 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-5d57ee95-b468-40fc-a118-3ff198e91ba7 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.349s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:10:09 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d57ee95-b468-40fc-a118-3ff198e91ba7 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] <== disconnect_volume: return (350ms) None {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:10:09 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d57ee95-b468-40fc-a118-3ff198e91ba7 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Disconnected iSCSI Volume {{(pid=71874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 16:10:11 user nova-compute[71874]: DEBUG nova.compute.manager [req-76a5ef09-9326-459e-9c2b-e0af3a89734c req-8fd21b7f-2257-4b36-992d-065578491ca0 service nova] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Received event network-vif-plugged-18196ae0-d9c1-4814-8803-c4ba8ad4ab45 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:10:11 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-76a5ef09-9326-459e-9c2b-e0af3a89734c req-8fd21b7f-2257-4b36-992d-065578491ca0 service nova] Acquiring lock "dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:10:11 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-76a5ef09-9326-459e-9c2b-e0af3a89734c req-8fd21b7f-2257-4b36-992d-065578491ca0 service nova] Lock "dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:10:11 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-76a5ef09-9326-459e-9c2b-e0af3a89734c req-8fd21b7f-2257-4b36-992d-065578491ca0 service nova] Lock "dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:10:11 user nova-compute[71874]: DEBUG nova.compute.manager [req-76a5ef09-9326-459e-9c2b-e0af3a89734c req-8fd21b7f-2257-4b36-992d-065578491ca0 service nova] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] No waiting events found dispatching network-vif-plugged-18196ae0-d9c1-4814-8803-c4ba8ad4ab45 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:10:11 user nova-compute[71874]: WARNING nova.compute.manager [req-76a5ef09-9326-459e-9c2b-e0af3a89734c req-8fd21b7f-2257-4b36-992d-065578491ca0 service nova] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Received unexpected event network-vif-plugged-18196ae0-d9c1-4814-8803-c4ba8ad4ab45 for instance with vm_state resized and task_state resize_reverting.
Apr 12 16:10:11 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-5d57ee95-b468-40fc-a118-3ff198e91ba7 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:10:11 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-5d57ee95-b468-40fc-a118-3ff198e91ba7 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:10:11 user nova-compute[71874]: DEBUG nova.objects.instance [None req-5d57ee95-b468-40fc-a118-3ff198e91ba7 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lazy-loading 'migration_context' on Instance uuid dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:10:11 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-5d57ee95-b468-40fc-a118-3ff198e91ba7 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Inventory has not changed in ProviderTree for provider: 0e94b4c8-cd49-45e4-9133-d36eb4b2456b {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 16:10:11 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-5d57ee95-b468-40fc-a118-3ff198e91ba7 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Inventory has not changed for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 16:10:11 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-5d57ee95-b468-40fc-a118-3ff198e91ba7 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.522s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:10:11 user nova-compute[71874]: INFO nova.compute.manager [None req-5d57ee95-b468-40fc-a118-3ff198e91ba7 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Swapping old allocation on dict_keys(['0e94b4c8-cd49-45e4-9133-d36eb4b2456b']) held by migration 1fde283e-efad-42fd-8a25-d8ba63358bb1 for instance
Apr 12 16:10:11 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-5d57ee95-b468-40fc-a118-3ff198e91ba7 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Overwriting current allocation {'allocations': {'0e94b4c8-cd49-45e4-9133-d36eb4b2456b': {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}, 'generation': 34}}, 'project_id': '97ea81bd1962466bbe552424973f71a8', 'user_id': '1a699b3ba8304eadb8a53d465ea340cf', 'consumer_generation': 1} on consumer dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 {{(pid=71874) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Apr 12 16:10:12 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-a9452c71-7de1-4881-9fcb-307f28ce3dae tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Acquiring lock "6caa4977-8333-4171-8825-2c3bfb52f80b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:10:12 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-a9452c71-7de1-4881-9fcb-307f28ce3dae tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Lock "6caa4977-8333-4171-8825-2c3bfb52f80b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:10:12 user nova-compute[71874]: INFO nova.compute.manager [None req-a9452c71-7de1-4881-9fcb-307f28ce3dae tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Detaching volume 7cc863d9-b797-4b5b-b8ce-30ebe55b9519
Apr 12 16:10:12 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-8d7875a4-26ce-4bd2-b2f6-541189dbd107 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] [instance: 78b6940a-f97a-4535-8973-3c2a5befbbab] Snapshot image upload complete
Apr 12 16:10:12 user nova-compute[71874]: INFO nova.compute.manager [None req-8d7875a4-26ce-4bd2-b2f6-541189dbd107 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] [instance: 78b6940a-f97a-4535-8973-3c2a5befbbab] Took 5.37 seconds to snapshot the instance on the hypervisor.
Apr 12 16:10:12 user nova-compute[71874]: INFO nova.virt.block_device [None req-a9452c71-7de1-4881-9fcb-307f28ce3dae tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Attempting to driver detach volume 7cc863d9-b797-4b5b-b8ce-30ebe55b9519 from mountpoint /dev/vdb
Apr 12 16:10:12 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:10:12 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-a9452c71-7de1-4881-9fcb-307f28ce3dae tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Attempting to detach device vdb from instance 6caa4977-8333-4171-8825-2c3bfb52f80b from the persistent domain config. {{(pid=71874) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 16:10:12 user nova-compute[71874]: DEBUG nova.virt.libvirt.guest [None req-a9452c71-7de1-4881-9fcb-307f28ce3dae tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 16:10:12 user nova-compute[71874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 16:10:12 user nova-compute[71874]:   <source dev="/dev/sdc"/>
Apr 12 16:10:12 user nova-compute[71874]:   <target dev="vdb" bus="virtio"/>
Apr 12 16:10:12 user nova-compute[71874]:   <serial>7cc863d9-b797-4b5b-b8ce-30ebe55b9519</serial>
Apr 12 16:10:12 user nova-compute[71874]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 16:10:12 user nova-compute[71874]: </disk>
Apr 12 16:10:12 user nova-compute[71874]:  {{(pid=71874) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 16:10:12 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-a9452c71-7de1-4881-9fcb-307f28ce3dae tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Successfully detached device vdb from instance 6caa4977-8333-4171-8825-2c3bfb52f80b from the persistent domain config.
Apr 12 16:10:12 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-a9452c71-7de1-4881-9fcb-307f28ce3dae tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6caa4977-8333-4171-8825-2c3bfb52f80b from the live domain config. {{(pid=71874) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 16:10:12 user nova-compute[71874]: DEBUG nova.virt.libvirt.guest [None req-a9452c71-7de1-4881-9fcb-307f28ce3dae tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 16:10:12 user nova-compute[71874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 16:10:12 user nova-compute[71874]:   <source dev="/dev/sdc"/>
Apr 12 16:10:12 user nova-compute[71874]:   <target dev="vdb" bus="virtio"/>
Apr 12 16:10:12 user nova-compute[71874]:   <serial>7cc863d9-b797-4b5b-b8ce-30ebe55b9519</serial>
Apr 12 16:10:12 user nova-compute[71874]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 16:10:12 user nova-compute[71874]: </disk>
Apr 12 16:10:12 user nova-compute[71874]:  {{(pid=71874) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 16:10:12 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-5d57ee95-b468-40fc-a118-3ff198e91ba7 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "refresh_cache-dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:10:12 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-5d57ee95-b468-40fc-a118-3ff198e91ba7 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquired lock "refresh_cache-dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:10:12 user nova-compute[71874]: DEBUG nova.network.neutron [None req-5d57ee95-b468-40fc-a118-3ff198e91ba7 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Building network info cache for instance {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 16:10:12 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Received event <DeviceRemovedEvent: 1681315812.571491, 6caa4977-8333-4171-8825-2c3bfb52f80b => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71874) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 16:10:12 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-a9452c71-7de1-4881-9fcb-307f28ce3dae tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6caa4977-8333-4171-8825-2c3bfb52f80b {{(pid=71874) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 16:10:12 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-a9452c71-7de1-4881-9fcb-307f28ce3dae tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Successfully detached device vdb from instance 6caa4977-8333-4171-8825-2c3bfb52f80b from the live domain config.
Apr 12 16:10:12 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a9452c71-7de1-4881-9fcb-307f28ce3dae tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] calling os-brick to detach iSCSI Volume {{(pid=71874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 16:10:12 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9452c71-7de1-4881-9fcb-307f28ce3dae tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3c0216320>, {'target_iqn': 'iqn.2010-10.org.openstack:7cc863d9-b797-4b5b-b8ce-30ebe55b9519', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SQEodxul', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:10:12 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-a9452c71-7de1-4881-9fcb-307f28ce3dae tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:10:12 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-a9452c71-7de1-4881-9fcb-307f28ce3dae tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:10:12 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-a9452c71-7de1-4881-9fcb-307f28ce3dae tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:10:12 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:10:12 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:10:12 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cb9e1c6-382a-4fd8-b464-a2872dd53ac0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1f27a002-8dfc-4d90-aa35-ba16586d4366\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7cc863d9-b797-4b5b-b8ce-30ebe55b9519\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:10:12 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9452c71-7de1-4881-9fcb-307f28ce3dae tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 16:10:12 user nova-compute[71874]: No targets found.
Apr 12 16:10:12 user nova-compute[71874]: iSNS:
Apr 12 16:10:12 user nova-compute[71874]: No targets found.
Apr 12 16:10:12 user nova-compute[71874]: STATIC:
Apr 12 16:10:12 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:1f27a002-8dfc-4d90-aa35-ba16586d4366
Apr 12 16:10:12 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:10:12 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:10:12 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:7cc863d9-b797-4b5b-b8ce-30ebe55b9519
Apr 12 16:10:12 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:10:12 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:10:12 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2
Apr 12 16:10:12 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:10:12 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:10:12 user nova-compute[71874]: FIRMWARE:
Apr 12 16:10:12 user nova-compute[71874]: No targets found.
Apr 12 16:10:12 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:10:12 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9452c71-7de1-4881-9fcb-307f28ce3dae tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 16:10:12 user nova-compute[71874]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 16:10:12 user nova-compute[71874]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71874) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 16:10:12 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9452c71-7de1-4881-9fcb-307f28ce3dae tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7cc863d9-b797-4b5b-b8ce-30ebe55b9519', 0)] {{(pid=71874) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 16:10:12 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:10:12 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:10:12 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[629833e9-95ad-4de4-b422-f3aa84bd741b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1f27a002-8dfc-4d90-aa35-ba16586d4366\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7cc863d9-b797-4b5b-b8ce-30ebe55b9519\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:10:12 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:10:12 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:10:12 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0700ee3-5875-45cd-8d44-b37d40a14762]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cc863d9-b797-4b5b-b8ce-30ebe55b9519 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f27a002-8dfc-4d90-aa35-ba16586d4366 (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:10:12 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9452c71-7de1-4881-9fcb-307f28ce3dae tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:10:12 user nova-compute[71874]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cc863d9-b797-4b5b-b8ce-30ebe55b9519 (non-flash)
Apr 12 16:10:12 user nova-compute[71874]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f27a002-8dfc-4d90-aa35-ba16586d4366 (non-flash)
Apr 12 16:10:12 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:10:12 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9452c71-7de1-4881-9fcb-307f28ce3dae tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:10:12 user nova-compute[71874]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cc863d9-b797-4b5b-b8ce-30ebe55b9519 (non-flash)
Apr 12 16:10:12 user nova-compute[71874]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f27a002-8dfc-4d90-aa35-ba16586d4366 (non-flash)
Apr 12 16:10:12 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:10:12 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9452c71-7de1-4881-9fcb-307f28ce3dae tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc3c02a28c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7cc863d9-b797-4b5b-b8ce-30ebe55b9519'): ({'sdc'}, set())}) {{(pid=71874) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 16:10:12 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-a9452c71-7de1-4881-9fcb-307f28ce3dae tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Removing single pathed devices sdc {{(pid=71874) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 16:10:12 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:10:12 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:10:12 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[75ef3223-288e-417d-bbea-4adee0dd559e]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:10:12 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:10:12 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.028s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:10:12 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[c96da584-8e15-4b4c-888a-9e4a8b56695a]: (4, ('ok\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:10:12 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-a9452c71-7de1-4881-9fcb-307f28ce3dae tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Flushing IO for device /dev/sdc {{(pid=71874) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 16:10:12 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:10:12 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:10:12 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c4ca0ed-5c54-46ee-85b6-04ef01b0dd2d]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:10:12 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-a9452c71-7de1-4881-9fcb-307f28ce3dae tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71874) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 16:10:12 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:10:12 user nova-compute[71874]: DEBUG nova.network.neutron [None req-5d57ee95-b468-40fc-a118-3ff198e91ba7 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Updating instance_info_cache with network_info: [{"id": "18196ae0-d9c1-4814-8803-c4ba8ad4ab45", "address": "fa:16:3e:98:72:fa", "network": {"id": "e6694358-e361-4952-b859-93755c11721e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-667152893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97ea81bd1962466bbe552424973f71a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18196ae0-d9", "ovs_interfaceid": "18196ae0-d9c1-4814-8803-c4ba8ad4ab45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:10:12 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-5d57ee95-b468-40fc-a118-3ff198e91ba7 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Releasing lock "refresh_cache-dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:10:12 user nova-compute[71874]: DEBUG os_brick.utils [None req-5d57ee95-b468-40fc-a118-3ff198e91ba7 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:10:12 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:10:12 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.063s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:10:12 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[a01f02cf-7f48-4823-80f3-a40c49b7706d]: (4, ('1', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:10:12 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-a9452c71-7de1-4881-9fcb-307f28ce3dae tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71874) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 16:10:12 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-a9452c71-7de1-4881-9fcb-307f28ce3dae tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] SCSI volumes sdc have been removed. {{(pid=71874) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 16:10:12 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9452c71-7de1-4881-9fcb-307f28ce3dae tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7cc863d9-b797-4b5b-b8ce-30ebe55b9519')] {{(pid=71874) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 16:10:12 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:10:12 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3550f55-b49e-4528-bfd0-7dd85d5d149c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:61a48d4489d2\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:10:12 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cc863d9-b797-4b5b-b8ce-30ebe55b9519 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:10:12 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:10:12 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:10:12 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[78f5fcfb-8c17-415c-9bc1-fc7d4d408bf4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:10:12 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cc863d9-b797-4b5b-b8ce-30ebe55b9519 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:10:12 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2faf910-7ae6-4e34-a07f-3326ba3a9b76]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:10:12 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9452c71-7de1-4881-9fcb-307f28ce3dae tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:10:12 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:10:12 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cc863d9-b797-4b5b-b8ce-30ebe55b9519 -p 172.16.0.220:3260 --logout {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:10:12 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:10:12 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3b2e541-e86d-4b7e-ae84-4c2bfd8d653c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:10:12 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cf200ee-d4cd-4373-b513-728e097579a9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:10:12 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-5d57ee95-b468-40fc-a118-3ff198e91ba7 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Running cmd (subprocess): nvme version {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:10:12 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-5d57ee95-b468-40fc-a118-3ff198e91ba7 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] 'nvme version' failed. Not Retrying. {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 16:10:12 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5d57ee95-b468-40fc-a118-3ff198e91ba7 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] nvme not present on system {{(pid=71874) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 16:10:12 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:10:12 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cc863d9-b797-4b5b-b8ce-30ebe55b9519 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:10:12 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[8595d24d-4f8a-416c-8f7b-2bafea7369ab]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:7cc863d9-b797-4b5b-b8ce-30ebe55b9519, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:7cc863d9-b797-4b5b-b8ce-30ebe55b9519, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:10:12 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 16:10:12 user nova-compute[71874]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 16:10:12 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[54bfabd9-0754-4122-9a00-4c514f47bbdf]: (4, '') {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:10:12 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9452c71-7de1-4881-9fcb-307f28ce3dae tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:7cc863d9-b797-4b5b-b8ce-30ebe55b9519, portal: 172.16.0.220,3260]
Apr 12 16:10:12 user nova-compute[71874]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:7cc863d9-b797-4b5b-b8ce-30ebe55b9519, portal: 172.16.0.220,3260] successful.
Apr 12 16:10:12 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:10:12 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.lightos [None req-5d57ee95-b468-40fc-a118-3ff198e91ba7 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71874) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 16:10:12 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.lightos [None req-5d57ee95-b468-40fc-a118-3ff198e91ba7 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71874) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 16:10:12 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.lightos [None req-5d57ee95-b468-40fc-a118-3ff198e91ba7 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] LIGHTOS: no hostnqn found. {{(pid=71874) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 16:10:12 user nova-compute[71874]: DEBUG os_brick.utils [None req-5d57ee95-b468-40fc-a118-3ff198e91ba7 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:61a48d4489d2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:10:12 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cc863d9-b797-4b5b-b8ce-30ebe55b9519 -p 172.16.0.220:3260 --op delete {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:10:12 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cc863d9-b797-4b5b-b8ce-30ebe55b9519 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:10:12 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b038843-2c6d-4707-ab5d-f32aff728f06]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:10:12 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9452c71-7de1-4881-9fcb-307f28ce3dae tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:10:12 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-a9452c71-7de1-4881-9fcb-307f28ce3dae tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.378s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:10:12 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9452c71-7de1-4881-9fcb-307f28ce3dae tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] <== disconnect_volume: return (379ms) None {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:10:12 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a9452c71-7de1-4881-9fcb-307f28ce3dae tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Disconnected iSCSI Volume {{(pid=71874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 16:10:12 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:10:13 user nova-compute[71874]: DEBUG nova.objects.instance [None req-a9452c71-7de1-4881-9fcb-307f28ce3dae tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Lazy-loading 'flavor' on Instance uuid 6caa4977-8333-4171-8825-2c3bfb52f80b {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:10:13 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-a9452c71-7de1-4881-9fcb-307f28ce3dae tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Lock "6caa4977-8333-4171-8825-2c3bfb52f80b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.827s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:10:14 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:10:15 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:10:15 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Cleaning up deleted instances {{(pid=71874) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 12 16:10:15 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-3889dbea-d5b4-4da4-882a-1dc2a8c3770b tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Acquiring lock "84683344-2893-4446-90ae-e64cd799eb20" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:10:15 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-3889dbea-d5b4-4da4-882a-1dc2a8c3770b tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "84683344-2893-4446-90ae-e64cd799eb20" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:10:15 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] There are 0 instances to clean {{(pid=71874) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 12 16:10:15 user nova-compute[71874]: DEBUG nova.objects.instance [None req-3889dbea-d5b4-4da4-882a-1dc2a8c3770b tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lazy-loading 'flavor' on Instance uuid 84683344-2893-4446-90ae-e64cd799eb20 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:10:15 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-3889dbea-d5b4-4da4-882a-1dc2a8c3770b tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "84683344-2893-4446-90ae-e64cd799eb20" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:10:16 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-3889dbea-d5b4-4da4-882a-1dc2a8c3770b tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Acquiring lock "84683344-2893-4446-90ae-e64cd799eb20" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:10:16 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-3889dbea-d5b4-4da4-882a-1dc2a8c3770b tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "84683344-2893-4446-90ae-e64cd799eb20" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:10:16 user nova-compute[71874]: INFO nova.compute.manager [None req-3889dbea-d5b4-4da4-882a-1dc2a8c3770b tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: 84683344-2893-4446-90ae-e64cd799eb20] Attaching volume 9c961fcc-0ff0-4275-9163-406662b265f8 to /dev/vdb
Apr 12 16:10:16 user nova-compute[71874]: DEBUG os_brick.utils [None req-3889dbea-d5b4-4da4-882a-1dc2a8c3770b tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:10:16 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:10:16 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:10:16 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[20a1134f-f2d4-41f0-a874-29481b897565]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:61a48d4489d2\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:10:16 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:10:16 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:10:16 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf0d15e9-6b6b-4ae8-854f-82f25402e833]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:10:16 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:10:16 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:10:16 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[505d7146-8972-4d5e-a9ad-d54974bcf0c6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:10:16 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[218f8a64-0d3a-4897-8d63-940700ba2259]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:10:16 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-3889dbea-d5b4-4da4-882a-1dc2a8c3770b tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Running cmd (subprocess): nvme version {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:10:16 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-3889dbea-d5b4-4da4-882a-1dc2a8c3770b tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] 'nvme version' failed. Not Retrying. {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 16:10:16 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3889dbea-d5b4-4da4-882a-1dc2a8c3770b tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] nvme not present on system {{(pid=71874) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 16:10:16 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:10:16 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 16:10:16 user nova-compute[71874]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 16:10:16 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[8546f248-f0bf-49ac-8236-bd3ec7984a05]: (4, '') {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:10:16 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.lightos [None req-3889dbea-d5b4-4da4-882a-1dc2a8c3770b tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71874) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 16:10:16 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.lightos [None req-3889dbea-d5b4-4da4-882a-1dc2a8c3770b tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71874) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 16:10:16 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.lightos [None req-3889dbea-d5b4-4da4-882a-1dc2a8c3770b tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] LIGHTOS: no hostnqn found. {{(pid=71874) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 16:10:16 user nova-compute[71874]: DEBUG os_brick.utils [None req-3889dbea-d5b4-4da4-882a-1dc2a8c3770b tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:61a48d4489d2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:10:16 user nova-compute[71874]: DEBUG nova.virt.block_device [None req-3889dbea-d5b4-4da4-882a-1dc2a8c3770b tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: 84683344-2893-4446-90ae-e64cd799eb20] Updating existing volume attachment record: acf8cf15-ff15-4133-acde-1ef62c7d6674 {{(pid=71874) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 16:10:16 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-1cd91069-e0aa-44a0-9d09-c7f40cd883ab tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Acquiring lock "c307e623-c546-487f-ac16-5eb24d088e8a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:10:16 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-1cd91069-e0aa-44a0-9d09-c7f40cd883ab tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lock "c307e623-c546-487f-ac16-5eb24d088e8a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:10:16 user nova-compute[71874]: DEBUG nova.compute.manager [None req-1cd91069-e0aa-44a0-9d09-c7f40cd883ab tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] [instance: c307e623-c546-487f-ac16-5eb24d088e8a] Starting instance... {{(pid=71874) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 16:10:16 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:10:16 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71874) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 12 16:10:16 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-1cd91069-e0aa-44a0-9d09-c7f40cd883ab tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:10:16 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-1cd91069-e0aa-44a0-9d09-c7f40cd883ab tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:10:16 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-1cd91069-e0aa-44a0-9d09-c7f40cd883ab tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71874) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 16:10:16 user nova-compute[71874]: INFO nova.compute.claims [None req-1cd91069-e0aa-44a0-9d09-c7f40cd883ab tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] [instance: c307e623-c546-487f-ac16-5eb24d088e8a] Claim successful on node user
Apr 12 16:10:17 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-1cd91069-e0aa-44a0-9d09-c7f40cd883ab tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Inventory has not changed in ProviderTree for provider: 0e94b4c8-cd49-45e4-9133-d36eb4b2456b {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 16:10:17 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-1cd91069-e0aa-44a0-9d09-c7f40cd883ab tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Inventory has not changed for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 16:10:17 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-1cd91069-e0aa-44a0-9d09-c7f40cd883ab tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.604s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:10:17 user nova-compute[71874]: DEBUG nova.compute.manager [None req-1cd91069-e0aa-44a0-9d09-c7f40cd883ab tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] [instance: c307e623-c546-487f-ac16-5eb24d088e8a] Start building networks asynchronously for instance. {{(pid=71874) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 16:10:17 user nova-compute[71874]: DEBUG nova.compute.manager [None req-1cd91069-e0aa-44a0-9d09-c7f40cd883ab tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] [instance: c307e623-c546-487f-ac16-5eb24d088e8a] Allocating IP information in the background. {{(pid=71874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 16:10:17 user nova-compute[71874]: DEBUG nova.network.neutron [None req-1cd91069-e0aa-44a0-9d09-c7f40cd883ab tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] [instance: c307e623-c546-487f-ac16-5eb24d088e8a] allocate_for_instance() {{(pid=71874) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 16:10:17 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-1cd91069-e0aa-44a0-9d09-c7f40cd883ab tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] [instance: c307e623-c546-487f-ac16-5eb24d088e8a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 16:10:17 user nova-compute[71874]: DEBUG nova.compute.manager [None req-1cd91069-e0aa-44a0-9d09-c7f40cd883ab tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] [instance: c307e623-c546-487f-ac16-5eb24d088e8a] Start building block device mappings for instance. {{(pid=71874) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 16:10:17 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-5d57ee95-b468-40fc-a118-3ff198e91ba7 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Starting finish_revert_migration {{(pid=71874) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11792}}
Apr 12 16:10:17 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-5d57ee95-b468-40fc-a118-3ff198e91ba7 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Start _get_guest_xml network_info=[{"id": "18196ae0-d9c1-4814-8803-c4ba8ad4ab45", "address": "fa:16:3e:98:72:fa", "network": {"id": "e6694358-e361-4952-b859-93755c11721e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-667152893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97ea81bd1962466bbe552424973f71a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18196ae0-d9", "ovs_interfaceid": "18196ae0-d9c1-4814-8803-c4ba8ad4ab45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=9dc63f14-8b70-4e72-89f2-13464f2f5c7c,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_options': None, 'image_id': '9dc63f14-8b70-4e72-89f2-13464f2f5c7c'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'delete_on_termination': False, 'attachment_id': 'd05532ad-b00e-4a12-a3d9-bd6e4b65812a', 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RGWZNvlY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1', 'attached_at': '2023-04-12T16:10:17.000000', 'detached_at': '', 'volume_id': '9baf883b-de18-43f0-a9d8-fc850bd83297', 'serial': '9baf883b-de18-43f0-a9d8-fc850bd83297'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': None, 'volume_type': None} {{(pid=71874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 16:10:17 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-5d57ee95-b468-40fc-a118-3ff198e91ba7 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:10:17 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-5d57ee95-b468-40fc-a118-3ff198e91ba7 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:10:17 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-5d57ee95-b468-40fc-a118-3ff198e91ba7 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71874) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 16:10:17 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-5d57ee95-b468-40fc-a118-3ff198e91ba7 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T15:56:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=9dc63f14-8b70-4e72-89f2-13464f2f5c7c,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 16:10:17 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-5d57ee95-b468-40fc-a118-3ff198e91ba7 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Flavor limits 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 16:10:17 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-5d57ee95-b468-40fc-a118-3ff198e91ba7 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Image limits 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 16:10:17 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-5d57ee95-b468-40fc-a118-3ff198e91ba7 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Flavor pref 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 16:10:17 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-5d57ee95-b468-40fc-a118-3ff198e91ba7 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Image pref 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 16:10:17 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-5d57ee95-b468-40fc-a118-3ff198e91ba7 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 16:10:17 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-5d57ee95-b468-40fc-a118-3ff198e91ba7 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 16:10:17 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-5d57ee95-b468-40fc-a118-3ff198e91ba7 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 16:10:17 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-5d57ee95-b468-40fc-a118-3ff198e91ba7 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Got 1 possible topologies {{(pid=71874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 16:10:17 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-5d57ee95-b468-40fc-a118-3ff198e91ba7 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 16:10:17 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-5d57ee95-b468-40fc-a118-3ff198e91ba7 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 16:10:17 user nova-compute[71874]: DEBUG nova.objects.instance [None req-5d57ee95-b468-40fc-a118-3ff198e91ba7 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lazy-loading 'vcpu_model' on Instance uuid dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:10:17 user nova-compute[71874]: DEBUG nova.compute.manager [None req-1cd91069-e0aa-44a0-9d09-c7f40cd883ab tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] [instance: c307e623-c546-487f-ac16-5eb24d088e8a] Start spawning the instance on the hypervisor. {{(pid=71874) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 16:10:17 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-1cd91069-e0aa-44a0-9d09-c7f40cd883ab tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] [instance: c307e623-c546-487f-ac16-5eb24d088e8a] Creating instance directory {{(pid=71874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 16:10:17 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-1cd91069-e0aa-44a0-9d09-c7f40cd883ab tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] [instance: c307e623-c546-487f-ac16-5eb24d088e8a] Creating image(s)
Apr 12 16:10:17 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-1cd91069-e0aa-44a0-9d09-c7f40cd883ab tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Acquiring lock "/opt/stack/data/nova/instances/c307e623-c546-487f-ac16-5eb24d088e8a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:10:17 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-1cd91069-e0aa-44a0-9d09-c7f40cd883ab tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lock "/opt/stack/data/nova/instances/c307e623-c546-487f-ac16-5eb24d088e8a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:10:17 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-1cd91069-e0aa-44a0-9d09-c7f40cd883ab tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lock "/opt/stack/data/nova/instances/c307e623-c546-487f-ac16-5eb24d088e8a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:10:17 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-1cd91069-e0aa-44a0-9d09-c7f40cd883ab tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Acquiring lock "a49746f70ad9c5f22617e71a592e4c524f47c2e0" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:10:17 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-1cd91069-e0aa-44a0-9d09-c7f40cd883ab tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lock "a49746f70ad9c5f22617e71a592e4c524f47c2e0" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:10:17 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d57ee95-b468-40fc-a118-3ff198e91ba7 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Calling os-brick to attach iSCSI Volume {{(pid=71874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 16:10:17 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d57ee95-b468-40fc-a118-3ff198e91ba7 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3c0216320>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RGWZNvlY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:10:17 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-5d57ee95-b468-40fc-a118-3ff198e91ba7 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:10:17 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-5d57ee95-b468-40fc-a118-3ff198e91ba7 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:10:17 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-5d57ee95-b468-40fc-a118-3ff198e91ba7 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:10:17 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-5d57ee95-b468-40fc-a118-3ff198e91ba7 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:10:17 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-5d57ee95-b468-40fc-a118-3ff198e91ba7 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:10:17 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-5d57ee95-b468-40fc-a118-3ff198e91ba7 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:10:17 user nova-compute[71874]: INFO os_brick.initiator.connectors.iscsi [None req-5d57ee95-b468-40fc-a118-3ff198e91ba7 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 16:10:17 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 -p 172.16.0.220:3260 {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:10:17 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:10:17 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[20be4cd0-54af-48c8-b625-4b6cd6d5e5e4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:10:17 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d57ee95-b468-40fc-a118-3ff198e91ba7 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 16:10:17 user nova-compute[71874]:  {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:10:17 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 -p 172.16.0.220:3260 --interface default --op new {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:10:17 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:10:17 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[8959201e-aa7e-451d-a5cf-64f9efa2e8c2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297] added\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:10:17 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d57ee95-b468-40fc-a118-3ff198e91ba7 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297] added
Apr 12 16:10:17 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:10:17 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:10:19 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-1cd91069-e0aa-44a0-9d09-c7f40cd883ab tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49746f70ad9c5f22617e71a592e4c524f47c2e0.part --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:10:19 user nova-compute[71874]: DEBUG nova.policy [None req-1cd91069-e0aa-44a0-9d09-c7f40cd883ab tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5e0ffc0972674609b17fe2780751dfc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77372a5e83c4fc882b0a0b0eea46f06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71874) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 16:10:19 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:10:19 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd98bf41-1545-4639-9887-10affcfad846]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:10:19 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:10:19 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d57ee95-b468-40fc-a118-3ff198e91ba7 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:10:19 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:10:19 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:10:19 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[64c04b88-56d6-42a7-9e8d-20a53a2b410d]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:10:19 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d57ee95-b468-40fc-a118-3ff198e91ba7 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:10:19 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RGWZNvlY {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:10:19 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RGWZNvlY" returned: 0 in 0.021s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:10:19 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[d178827e-bb72-4a00-8161-fd239a20540d]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:10:19 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d57ee95-b468-40fc-a118-3ff198e91ba7 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RGWZNvlY'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:10:19 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:10:19 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:10:19 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e3c118e-720a-4faa-a8f5-981282847d08]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:10:19 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d57ee95-b468-40fc-a118-3ff198e91ba7 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:10:19 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:10:19 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-1cd91069-e0aa-44a0-9d09-c7f40cd883ab tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49746f70ad9c5f22617e71a592e4c524f47c2e0.part --force-share --output=json" returned: 0 in 0.149s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:10:19 user nova-compute[71874]: DEBUG nova.virt.images [None req-1cd91069-e0aa-44a0-9d09-c7f40cd883ab tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] 6c9c5a01-7bd3-4f1f-b219-5ed4224fd354 was qcow2, converting to raw {{(pid=71874) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 12 16:10:19 user nova-compute[71874]: DEBUG nova.privsep.utils [None req-1cd91069-e0aa-44a0-9d09-c7f40cd883ab tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71874) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 12 16:10:19 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-1cd91069-e0aa-44a0-9d09-c7f40cd883ab tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a49746f70ad9c5f22617e71a592e4c524f47c2e0.part /opt/stack/data/nova/instances/_base/a49746f70ad9c5f22617e71a592e4c524f47c2e0.converted {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:10:19 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:10:19 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[48342c1d-a150-4a64-885a-6204a9567ea4]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f27a002-8dfc-4d90-aa35-ba16586d4366 (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:10:19 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d57ee95-b468-40fc-a118-3ff198e91ba7 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:10:19 user nova-compute[71874]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f27a002-8dfc-4d90-aa35-ba16586d4366 (non-flash)
Apr 12 16:10:19 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:10:19 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d57ee95-b468-40fc-a118-3ff198e91ba7 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:10:19 user nova-compute[71874]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f27a002-8dfc-4d90-aa35-ba16586d4366 (non-flash)
Apr 12 16:10:19 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:10:19 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 -p 172.16.0.220:3260 --login {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:10:19 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:10:19 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[32f63928-6df2-4497-855b-cb1754964bd4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:10:19 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d57ee95-b468-40fc-a118-3ff198e91ba7 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297, portal: 172.16.0.220,3260]
Apr 12 16:10:19 user nova-compute[71874]: Login to [iface: default, target: iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297, portal: 172.16.0.220,3260] successful.
Apr 12 16:10:19 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:10:19 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:10:19 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:10:19 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b380916-2baf-47c4-9b9c-92cbee3c5966]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:10:19 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d57ee95-b468-40fc-a118-3ff198e91ba7 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:10:19 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:10:19 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:10:19 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fee0e92-181f-4f1a-9e56-2eded20b56f9]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f27a002-8dfc-4d90-aa35-ba16586d4366 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:10:19 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d57ee95-b468-40fc-a118-3ff198e91ba7 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:10:19 user nova-compute[71874]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f27a002-8dfc-4d90-aa35-ba16586d4366 (non-flash)
Apr 12 16:10:19 user nova-compute[71874]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 (non-flash)
Apr 12 16:10:19 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:10:19 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d57ee95-b468-40fc-a118-3ff198e91ba7 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:10:19 user nova-compute[71874]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f27a002-8dfc-4d90-aa35-ba16586d4366 (non-flash)
Apr 12 16:10:19 user nova-compute[71874]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 (non-flash)
Apr 12 16:10:19 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:10:19 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-5d57ee95-b468-40fc-a118-3ff198e91ba7 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.690s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:10:19 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d57ee95-b468-40fc-a118-3ff198e91ba7 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Connected to 172.16.0.220:3260 {{(pid=71874) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 16:10:19 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-5d57ee95-b468-40fc-a118-3ff198e91ba7 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] HCTL ('34', '-', '-', 0) found on session 29 with lun 0 {{(pid=71874) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 16:10:19 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-5d57ee95-b468-40fc-a118-3ff198e91ba7 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71874) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 16:10:19 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:10:19 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:10:19 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b7d507e-4978-4508-8232-7bfe16569591]: (4, ('- - 0', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:10:19 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-5d57ee95-b468-40fc-a118-3ff198e91ba7 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Searching for a device in session 29 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71874) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 16:10:19 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d57ee95-b468-40fc-a118-3ff198e91ba7 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RGWZNvlY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71874) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 16:10:19 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:10:20 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-1cd91069-e0aa-44a0-9d09-c7f40cd883ab tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a49746f70ad9c5f22617e71a592e4c524f47c2e0.part /opt/stack/data/nova/instances/_base/a49746f70ad9c5f22617e71a592e4c524f47c2e0.converted" returned: 0 in 0.698s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:10:20 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-1cd91069-e0aa-44a0-9d09-c7f40cd883ab tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49746f70ad9c5f22617e71a592e4c524f47c2e0.converted --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:10:20 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-1cd91069-e0aa-44a0-9d09-c7f40cd883ab tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49746f70ad9c5f22617e71a592e4c524f47c2e0.converted --force-share --output=json" returned: 0 in 0.143s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:10:20 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-1cd91069-e0aa-44a0-9d09-c7f40cd883ab tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lock "a49746f70ad9c5f22617e71a592e4c524f47c2e0" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.402s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:10:20 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-1cd91069-e0aa-44a0-9d09-c7f40cd883ab tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49746f70ad9c5f22617e71a592e4c524f47c2e0 --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:10:20 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-1cd91069-e0aa-44a0-9d09-c7f40cd883ab tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49746f70ad9c5f22617e71a592e4c524f47c2e0 --force-share --output=json" returned: 0 in 0.186s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:10:20 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-1cd91069-e0aa-44a0-9d09-c7f40cd883ab tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Acquiring lock "a49746f70ad9c5f22617e71a592e4c524f47c2e0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:10:20 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-1cd91069-e0aa-44a0-9d09-c7f40cd883ab tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lock "a49746f70ad9c5f22617e71a592e4c524f47c2e0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:10:20 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-1cd91069-e0aa-44a0-9d09-c7f40cd883ab tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49746f70ad9c5f22617e71a592e4c524f47c2e0 --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:10:20 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-1cd91069-e0aa-44a0-9d09-c7f40cd883ab tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49746f70ad9c5f22617e71a592e4c524f47c2e0 --force-share --output=json" returned: 0 in 0.154s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:10:20 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-1cd91069-e0aa-44a0-9d09-c7f40cd883ab tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a49746f70ad9c5f22617e71a592e4c524f47c2e0,backing_fmt=raw /opt/stack/data/nova/instances/c307e623-c546-487f-ac16-5eb24d088e8a/disk 1073741824 {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:10:20 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-5d57ee95-b468-40fc-a118-3ff198e91ba7 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.760s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:10:20 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d57ee95-b468-40fc-a118-3ff198e91ba7 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] <== connect_volume: return (2762ms) {'type': 'block', 'scsi_wwn': '23761343031333330', 'path': '/dev/sdc'} {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:10:20 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d57ee95-b468-40fc-a118-3ff198e91ba7 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23761343031333330', 'path': '/dev/sdc'} {{(pid=71874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 16:10:20 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-1cd91069-e0aa-44a0-9d09-c7f40cd883ab tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a49746f70ad9c5f22617e71a592e4c524f47c2e0,backing_fmt=raw /opt/stack/data/nova/instances/c307e623-c546-487f-ac16-5eb24d088e8a/disk 1073741824" returned: 0 in 0.066s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:10:20 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-1cd91069-e0aa-44a0-9d09-c7f40cd883ab tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lock "a49746f70ad9c5f22617e71a592e4c524f47c2e0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.225s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:10:20 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-1cd91069-e0aa-44a0-9d09-c7f40cd883ab tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49746f70ad9c5f22617e71a592e4c524f47c2e0 --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:10:20 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-5d57ee95-b468-40fc-a118-3ff198e91ba7 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-12T15:59:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1390712116',display_name='tempest-ServerActionsTestJSON-server-416657090',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1390712116',id=4,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNmXVADjvoPSh3uGCGCTNS/vcfcDtUjn/vZEaV3bCllfz1ZO8VIgFuZhP+mAsa+G/KA4ubi5U9Vj41YtHGsakdPR5VoByhorvfUv/PIWtER2tn1LWX2mlFyT+T8AEJplPw==',key_name='tempest-keypair-1923467613',keypairs=<?>,launch_index=0,launched_at=2023-04-12T16:08:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='97ea81bd1962466bbe552424973f71a8',ramdisk_id='',reservation_id='r-y3c7iw20',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-631887779',owner_user_name='tempest-ServerActionsTestJSON-631887779-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T16:10:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1a699b3ba8304eadb8a53d465ea340cf',uuid=dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "18196ae0-d9c1-4814-8803-c4ba8ad4ab45", "address": "fa:16:3e:98:72:fa", "network": {"id": "e6694358-e361-4952-b859-93755c11721e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-667152893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97ea81bd1962466bbe552424973f71a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18196ae0-d9", "ovs_interfaceid": "18196ae0-d9c1-4814-8803-c4ba8ad4ab45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 16:10:20 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-5d57ee95-b468-40fc-a118-3ff198e91ba7 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Converting VIF {"id": "18196ae0-d9c1-4814-8803-c4ba8ad4ab45", "address": "fa:16:3e:98:72:fa", "network": {"id": "e6694358-e361-4952-b859-93755c11721e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-667152893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97ea81bd1962466bbe552424973f71a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18196ae0-d9", "ovs_interfaceid": "18196ae0-d9c1-4814-8803-c4ba8ad4ab45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:10:20 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-5d57ee95-b468-40fc-a118-3ff198e91ba7 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:72:fa,bridge_name='br-int',has_traffic_filtering=True,id=18196ae0-d9c1-4814-8803-c4ba8ad4ab45,network=Network(e6694358-e361-4952-b859-93755c11721e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18196ae0-d9') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:10:20 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-5d57ee95-b468-40fc-a118-3ff198e91ba7 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] End _get_guest_xml xml=<domain type="kvm">
Apr 12 16:10:20 user nova-compute[71874]:   <uuid>dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1</uuid>
Apr 12 16:10:20 user nova-compute[71874]:   <name>instance-00000004</name>
Apr 12 16:10:20 user nova-compute[71874]:   <memory>131072</memory>
Apr 12 16:10:20 user nova-compute[71874]:   <vcpu>1</vcpu>
Apr 12 16:10:20 user nova-compute[71874]:   <metadata>
Apr 12 16:10:20 user nova-compute[71874]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 16:10:20 user nova-compute[71874]:       <nova:package version="0.0.0"/>
Apr 12 16:10:20 user nova-compute[71874]:       <nova:name>tempest-ServerActionsTestJSON-server-416657090</nova:name>
Apr 12 16:10:20 user nova-compute[71874]:       <nova:creationTime>2023-04-12 16:10:17</nova:creationTime>
Apr 12 16:10:20 user nova-compute[71874]:       <nova:flavor name="m1.nano">
Apr 12 16:10:20 user nova-compute[71874]:         <nova:memory>128</nova:memory>
Apr 12 16:10:20 user nova-compute[71874]:         <nova:disk>1</nova:disk>
Apr 12 16:10:20 user nova-compute[71874]:         <nova:swap>0</nova:swap>
Apr 12 16:10:20 user nova-compute[71874]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 16:10:20 user nova-compute[71874]:         <nova:vcpus>1</nova:vcpus>
Apr 12 16:10:20 user nova-compute[71874]:       </nova:flavor>
Apr 12 16:10:20 user nova-compute[71874]:       <nova:owner>
Apr 12 16:10:20 user nova-compute[71874]:         <nova:user uuid="1a699b3ba8304eadb8a53d465ea340cf">tempest-ServerActionsTestJSON-631887779-project-member</nova:user>
Apr 12 16:10:20 user nova-compute[71874]:         <nova:project uuid="97ea81bd1962466bbe552424973f71a8">tempest-ServerActionsTestJSON-631887779</nova:project>
Apr 12 16:10:20 user nova-compute[71874]:       </nova:owner>
Apr 12 16:10:20 user nova-compute[71874]:       <nova:root type="image" uuid="9dc63f14-8b70-4e72-89f2-13464f2f5c7c"/>
Apr 12 16:10:20 user nova-compute[71874]:       <nova:ports>
Apr 12 16:10:20 user nova-compute[71874]:         <nova:port uuid="18196ae0-d9c1-4814-8803-c4ba8ad4ab45">
Apr 12 16:10:20 user nova-compute[71874]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 12 16:10:20 user nova-compute[71874]:         </nova:port>
Apr 12 16:10:20 user nova-compute[71874]:       </nova:ports>
Apr 12 16:10:20 user nova-compute[71874]:     </nova:instance>
Apr 12 16:10:20 user nova-compute[71874]:   </metadata>
Apr 12 16:10:20 user nova-compute[71874]:   <sysinfo type="smbios">
Apr 12 16:10:20 user nova-compute[71874]:     <system>
Apr 12 16:10:20 user nova-compute[71874]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 16:10:20 user nova-compute[71874]:       <entry name="product">OpenStack Nova</entry>
Apr 12 16:10:20 user nova-compute[71874]:       <entry name="version">0.0.0</entry>
Apr 12 16:10:20 user nova-compute[71874]:       <entry name="serial">dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1</entry>
Apr 12 16:10:20 user nova-compute[71874]:       <entry name="uuid">dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1</entry>
Apr 12 16:10:20 user nova-compute[71874]:       <entry name="family">Virtual Machine</entry>
Apr 12 16:10:20 user nova-compute[71874]:     </system>
Apr 12 16:10:20 user nova-compute[71874]:   </sysinfo>
Apr 12 16:10:20 user nova-compute[71874]:   <os>
Apr 12 16:10:20 user nova-compute[71874]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 16:10:20 user nova-compute[71874]:     <boot dev="hd"/>
Apr 12 16:10:20 user nova-compute[71874]:     <smbios mode="sysinfo"/>
Apr 12 16:10:20 user nova-compute[71874]:   </os>
Apr 12 16:10:20 user nova-compute[71874]:   <features>
Apr 12 16:10:20 user nova-compute[71874]:     <acpi/>
Apr 12 16:10:20 user nova-compute[71874]:     <apic/>
Apr 12 16:10:20 user nova-compute[71874]:     <vmcoreinfo/>
Apr 12 16:10:20 user nova-compute[71874]:   </features>
Apr 12 16:10:20 user nova-compute[71874]:   <clock offset="utc">
Apr 12 16:10:20 user nova-compute[71874]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 16:10:20 user nova-compute[71874]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 16:10:20 user nova-compute[71874]:     <timer name="hpet" present="no"/>
Apr 12 16:10:20 user nova-compute[71874]:   </clock>
Apr 12 16:10:20 user nova-compute[71874]:   <cpu mode="custom" match="exact">
Apr 12 16:10:20 user nova-compute[71874]:     <model>Nehalem</model>
Apr 12 16:10:20 user nova-compute[71874]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 16:10:20 user nova-compute[71874]:   </cpu>
Apr 12 16:10:20 user nova-compute[71874]:   <devices>
Apr 12 16:10:20 user nova-compute[71874]:     <disk type="file" device="disk">
Apr 12 16:10:20 user nova-compute[71874]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 16:10:20 user nova-compute[71874]:       <source file="/opt/stack/data/nova/instances/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1/disk"/>
Apr 12 16:10:20 user nova-compute[71874]:       <target dev="vda" bus="virtio"/>
Apr 12 16:10:20 user nova-compute[71874]:     </disk>
Apr 12 16:10:20 user nova-compute[71874]:     <disk type="block" device="disk">
Apr 12 16:10:20 user nova-compute[71874]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 16:10:20 user nova-compute[71874]:       <source dev="/dev/sdc"/>
Apr 12 16:10:20 user nova-compute[71874]:       <target dev="vdb" bus="virtio"/>
Apr 12 16:10:20 user nova-compute[71874]:       <serial>9baf883b-de18-43f0-a9d8-fc850bd83297</serial>
Apr 12 16:10:20 user nova-compute[71874]:     </disk>
Apr 12 16:10:20 user nova-compute[71874]:     <interface type="ethernet">
Apr 12 16:10:20 user nova-compute[71874]:       <mac address="fa:16:3e:98:72:fa"/>
Apr 12 16:10:20 user nova-compute[71874]:       <model type="virtio"/>
Apr 12 16:10:20 user nova-compute[71874]:       <mtu size="1442"/>
Apr 12 16:10:20 user nova-compute[71874]:       <target dev="tap18196ae0-d9"/>
Apr 12 16:10:20 user nova-compute[71874]:     </interface>
Apr 12 16:10:20 user nova-compute[71874]:     <serial type="pty">
Apr 12 16:10:20 user nova-compute[71874]:       <log file="/opt/stack/data/nova/instances/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1/console.log" append="off"/>
Apr 12 16:10:20 user nova-compute[71874]:     </serial>
Apr 12 16:10:20 user nova-compute[71874]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 16:10:20 user nova-compute[71874]:     <video>
Apr 12 16:10:20 user nova-compute[71874]:       <model type="virtio"/>
Apr 12 16:10:20 user nova-compute[71874]:     </video>
Apr 12 16:10:20 user nova-compute[71874]:     <rng model="virtio">
Apr 12 16:10:20 user nova-compute[71874]:       <backend model="random">/dev/urandom</backend>
Apr 12 16:10:20 user nova-compute[71874]:     </rng>
Apr 12 16:10:20 user nova-compute[71874]:     <controller type="usb" index="0" model="none"/>
Apr 12 16:10:20 user nova-compute[71874]:     <memballoon model="virtio">
Apr 12 16:10:20 user nova-compute[71874]:       <stats period="10"/>
Apr 12 16:10:20 user nova-compute[71874]:     </memballoon>
Apr 12 16:10:20 user nova-compute[71874]:   </devices>
Apr 12 16:10:20 user nova-compute[71874]: </domain>
Apr 12 16:10:20 user nova-compute[71874]:  {{(pid=71874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 16:10:20 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-5d57ee95-b468-40fc-a118-3ff198e91ba7 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-12T15:59:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1390712116',display_name='tempest-ServerActionsTestJSON-server-416657090',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1390712116',id=4,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNmXVADjvoPSh3uGCGCTNS/vcfcDtUjn/vZEaV3bCllfz1ZO8VIgFuZhP+mAsa+G/KA4ubi5U9Vj41YtHGsakdPR5VoByhorvfUv/PIWtER2tn1LWX2mlFyT+T8AEJplPw==',key_name='tempest-keypair-1923467613',keypairs=<?>,launch_index=0,launched_at=2023-04-12T16:08:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='97ea81bd1962466bbe552424973f71a8',ramdisk_id='',reservation_id='r-y3c7iw20',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-631887779',owner_user_name='tempest-ServerActionsTestJSON-631887779-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T16:10:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1a699b3ba8304eadb8a53d465ea340cf',uuid=dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "18196ae0-d9c1-4814-8803-c4ba8ad4ab45", "address": "fa:16:3e:98:72:fa", "network": {"id": "e6694358-e361-4952-b859-93755c11721e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-667152893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97ea81bd1962466bbe552424973f71a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18196ae0-d9", "ovs_interfaceid": "18196ae0-d9c1-4814-8803-c4ba8ad4ab45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 16:10:20 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-5d57ee95-b468-40fc-a118-3ff198e91ba7 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Converting VIF {"id": "18196ae0-d9c1-4814-8803-c4ba8ad4ab45", "address": "fa:16:3e:98:72:fa", "network": {"id": "e6694358-e361-4952-b859-93755c11721e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-667152893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97ea81bd1962466bbe552424973f71a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18196ae0-d9", "ovs_interfaceid": "18196ae0-d9c1-4814-8803-c4ba8ad4ab45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:10:20 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-5d57ee95-b468-40fc-a118-3ff198e91ba7 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:72:fa,bridge_name='br-int',has_traffic_filtering=True,id=18196ae0-d9c1-4814-8803-c4ba8ad4ab45,network=Network(e6694358-e361-4952-b859-93755c11721e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18196ae0-d9') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:10:20 user nova-compute[71874]: DEBUG os_vif [None req-5d57ee95-b468-40fc-a118-3ff198e91ba7 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:72:fa,bridge_name='br-int',has_traffic_filtering=True,id=18196ae0-d9c1-4814-8803-c4ba8ad4ab45,network=Network(e6694358-e361-4952-b859-93755c11721e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18196ae0-d9') {{(pid=71874) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 16:10:20 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:10:20 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:10:20 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 16:10:20 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:10:20 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap18196ae0-d9, may_exist=True) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:10:20 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap18196ae0-d9, col_values=(('external_ids', {'iface-id': '18196ae0-d9c1-4814-8803-c4ba8ad4ab45', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:98:72:fa', 'vm-uuid': 'dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1'}),)) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:10:20 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:10:20 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:10:20 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:10:20 user nova-compute[71874]: INFO os_vif [None req-5d57ee95-b468-40fc-a118-3ff198e91ba7 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:72:fa,bridge_name='br-int',has_traffic_filtering=True,id=18196ae0-d9c1-4814-8803-c4ba8ad4ab45,network=Network(e6694358-e361-4952-b859-93755c11721e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18196ae0-d9')
Apr 12 16:10:20 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-1cd91069-e0aa-44a0-9d09-c7f40cd883ab tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a49746f70ad9c5f22617e71a592e4c524f47c2e0 --force-share --output=json" returned: 0 in 0.139s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:10:20 user nova-compute[71874]: DEBUG nova.objects.instance [None req-1cd91069-e0aa-44a0-9d09-c7f40cd883ab tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lazy-loading 'migration_context' on Instance uuid c307e623-c546-487f-ac16-5eb24d088e8a {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:10:20 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-1cd91069-e0aa-44a0-9d09-c7f40cd883ab tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] [instance: c307e623-c546-487f-ac16-5eb24d088e8a] Created local disks {{(pid=71874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 16:10:20 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-1cd91069-e0aa-44a0-9d09-c7f40cd883ab tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] [instance: c307e623-c546-487f-ac16-5eb24d088e8a] Ensure instance console log exists: /opt/stack/data/nova/instances/c307e623-c546-487f-ac16-5eb24d088e8a/console.log {{(pid=71874) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 16:10:20 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-1cd91069-e0aa-44a0-9d09-c7f40cd883ab tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:10:20 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-1cd91069-e0aa-44a0-9d09-c7f40cd883ab tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:10:20 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-1cd91069-e0aa-44a0-9d09-c7f40cd883ab tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.004s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:10:20 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3889dbea-d5b4-4da4-882a-1dc2a8c3770b tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: 84683344-2893-4446-90ae-e64cd799eb20] Calling os-brick to attach iSCSI Volume {{(pid=71874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 16:10:20 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-3889dbea-d5b4-4da4-882a-1dc2a8c3770b tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3c0216320>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9c961fcc-0ff0-4275-9163-406662b265f8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EHUDIolh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:10:20 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-3889dbea-d5b4-4da4-882a-1dc2a8c3770b tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:10:20 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-3889dbea-d5b4-4da4-882a-1dc2a8c3770b tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:10:20 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-3889dbea-d5b4-4da4-882a-1dc2a8c3770b tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:10:20 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-3889dbea-d5b4-4da4-882a-1dc2a8c3770b tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:10:20 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-3889dbea-d5b4-4da4-882a-1dc2a8c3770b tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9c961fcc-0ff0-4275-9163-406662b265f8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:10:20 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-3889dbea-d5b4-4da4-882a-1dc2a8c3770b tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9c961fcc-0ff0-4275-9163-406662b265f8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:10:20 user nova-compute[71874]: INFO os_brick.initiator.connectors.iscsi [None req-3889dbea-d5b4-4da4-882a-1dc2a8c3770b tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 16:10:20 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c961fcc-0ff0-4275-9163-406662b265f8 -p 172.16.0.220:3260 {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:10:20 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c961fcc-0ff0-4275-9163-406662b265f8 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:10:20 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[d08d49c7-fe70-4ae3-9c5e-14b78ba180c7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:10:20 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-3889dbea-d5b4-4da4-882a-1dc2a8c3770b tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 16:10:20 user nova-compute[71874]:  {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:10:20 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c961fcc-0ff0-4275-9163-406662b265f8 -p 172.16.0.220:3260 --interface default --op new {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:10:20 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c961fcc-0ff0-4275-9163-406662b265f8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:10:20 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0e01900-7dcd-45ca-b45d-27c747dce641]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9c961fcc-0ff0-4275-9163-406662b265f8] added\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:10:20 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-3889dbea-d5b4-4da4-882a-1dc2a8c3770b tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9c961fcc-0ff0-4275-9163-406662b265f8] added
Apr 12 16:10:20 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:10:20 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c961fcc-0ff0-4275-9163-406662b265f8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:10:20 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:10:20 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c961fcc-0ff0-4275-9163-406662b265f8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:10:20 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[de31d20a-978a-4c81-836d-baa7ceb6617f]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:10:20 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-3889dbea-d5b4-4da4-882a-1dc2a8c3770b tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:10:20 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c961fcc-0ff0-4275-9163-406662b265f8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:10:20 user nova-compute[71874]: DEBUG nova.network.neutron [None req-1cd91069-e0aa-44a0-9d09-c7f40cd883ab tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] [instance: c307e623-c546-487f-ac16-5eb24d088e8a] Successfully created port: b6291ae2-bc79-4a35-a160-bff95fae3e8f {{(pid=71874) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 16:10:20 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c961fcc-0ff0-4275-9163-406662b265f8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:10:20 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[11adbd3e-5a8d-4509-9606-0e221a63f122]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:10:20 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-3889dbea-d5b4-4da4-882a-1dc2a8c3770b tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:10:20 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c961fcc-0ff0-4275-9163-406662b265f8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EHUDIolh {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:10:20 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c961fcc-0ff0-4275-9163-406662b265f8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EHUDIolh" returned: 0 in 0.019s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:10:20 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a29a87e-05d7-4e8f-8466-9eed7d2759dc]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:10:20 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-3889dbea-d5b4-4da4-882a-1dc2a8c3770b tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EHUDIolh'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:10:20 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c961fcc-0ff0-4275-9163-406662b265f8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:10:20 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c961fcc-0ff0-4275-9163-406662b265f8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:10:20 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff6ff857-43c1-4a68-98c2-60245691d523]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:10:20 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-3889dbea-d5b4-4da4-882a-1dc2a8c3770b tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:10:20 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:10:20 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:10:20 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[af71f667-11aa-468c-9f9f-aa116a19f540]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f27a002-8dfc-4d90-aa35-ba16586d4366 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:10:20 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-3889dbea-d5b4-4da4-882a-1dc2a8c3770b tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:10:20 user nova-compute[71874]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f27a002-8dfc-4d90-aa35-ba16586d4366 (non-flash)
Apr 12 16:10:20 user nova-compute[71874]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 (non-flash)
Apr 12 16:10:20 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:10:20 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-3889dbea-d5b4-4da4-882a-1dc2a8c3770b tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:10:20 user nova-compute[71874]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f27a002-8dfc-4d90-aa35-ba16586d4366 (non-flash)
Apr 12 16:10:20 user nova-compute[71874]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 (non-flash)
Apr 12 16:10:20 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:10:20 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c961fcc-0ff0-4275-9163-406662b265f8 -p 172.16.0.220:3260 --login {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:10:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c961fcc-0ff0-4275-9163-406662b265f8 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:10:21 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[64aa1bd7-ad28-4d69-8356-5ecfbfe34ff7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9c961fcc-0ff0-4275-9163-406662b265f8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9c961fcc-0ff0-4275-9163-406662b265f8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:10:21 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-3889dbea-d5b4-4da4-882a-1dc2a8c3770b tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9c961fcc-0ff0-4275-9163-406662b265f8, portal: 172.16.0.220,3260]
Apr 12 16:10:21 user nova-compute[71874]: Login to [iface: default, target: iqn.2010-10.org.openstack:9c961fcc-0ff0-4275-9163-406662b265f8, portal: 172.16.0.220,3260] successful.
Apr 12 16:10:21 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:10:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c961fcc-0ff0-4275-9163-406662b265f8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:10:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c961fcc-0ff0-4275-9163-406662b265f8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:10:21 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff1373df-ba30-4b46-bc35-dd7c6471471f]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:10:21 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-3889dbea-d5b4-4da4-882a-1dc2a8c3770b tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:10:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:10:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:10:21 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[54065ada-4c94-4a44-85d6-235ab1220877]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f27a002-8dfc-4d90-aa35-ba16586d4366 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c961fcc-0ff0-4275-9163-406662b265f8 (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:10:21 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-3889dbea-d5b4-4da4-882a-1dc2a8c3770b tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:10:21 user nova-compute[71874]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f27a002-8dfc-4d90-aa35-ba16586d4366 (non-flash)
Apr 12 16:10:21 user nova-compute[71874]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 (non-flash)
Apr 12 16:10:21 user nova-compute[71874]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c961fcc-0ff0-4275-9163-406662b265f8 (non-flash)
Apr 12 16:10:21 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:10:21 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-3889dbea-d5b4-4da4-882a-1dc2a8c3770b tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:10:21 user nova-compute[71874]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f27a002-8dfc-4d90-aa35-ba16586d4366 (non-flash)
Apr 12 16:10:21 user nova-compute[71874]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 (non-flash)
Apr 12 16:10:21 user nova-compute[71874]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c961fcc-0ff0-4275-9163-406662b265f8 (non-flash)
Apr 12 16:10:21 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:10:21 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-3889dbea-d5b4-4da4-882a-1dc2a8c3770b tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9c961fcc-0ff0-4275-9163-406662b265f8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.293s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:10:21 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-3889dbea-d5b4-4da4-882a-1dc2a8c3770b tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Connected to 172.16.0.220:3260 {{(pid=71874) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 16:10:21 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-3889dbea-d5b4-4da4-882a-1dc2a8c3770b tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] HCTL ('35', '-', '-', 0) found on session 30 with lun 0 {{(pid=71874) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 16:10:21 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-3889dbea-d5b4-4da4-882a-1dc2a8c3770b tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71874) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 16:10:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:10:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.025s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:10:21 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa8a30bd-ce8a-4d97-8877-1be67164e200]: (4, ('- - 0', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:10:21 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-3889dbea-d5b4-4da4-882a-1dc2a8c3770b tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Searching for a device in session 30 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71874) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 16:10:21 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-3889dbea-d5b4-4da4-882a-1dc2a8c3770b tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:9c961fcc-0ff0-4275-9163-406662b265f8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EHUDIolh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71874) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 16:10:21 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:10:21 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Starting heal instance info cache {{(pid=71874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 16:10:21 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquiring lock "refresh_cache-6caa4977-8333-4171-8825-2c3bfb52f80b" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:10:21 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquired lock "refresh_cache-6caa4977-8333-4171-8825-2c3bfb52f80b" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:10:21 user nova-compute[71874]: DEBUG nova.network.neutron [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Forcefully refreshing network info cache for instance {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 16:10:22 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:10:22 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:10:22 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:10:22 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:10:22 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-3889dbea-d5b4-4da4-882a-1dc2a8c3770b tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.336s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:10:22 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-3889dbea-d5b4-4da4-882a-1dc2a8c3770b tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] <== connect_volume: return (1337ms) {'type': 'block', 'scsi_wwn': '23636616166333064', 'path': '/dev/sdd'} {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:10:22 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3889dbea-d5b4-4da4-882a-1dc2a8c3770b tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: 84683344-2893-4446-90ae-e64cd799eb20] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23636616166333064', 'path': '/dev/sdd'} {{(pid=71874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 16:10:22 user nova-compute[71874]: DEBUG nova.objects.instance [None req-3889dbea-d5b4-4da4-882a-1dc2a8c3770b tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lazy-loading 'flavor' on Instance uuid 84683344-2893-4446-90ae-e64cd799eb20 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:10:22 user nova-compute[71874]: DEBUG nova.virt.libvirt.guest [None req-3889dbea-d5b4-4da4-882a-1dc2a8c3770b tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 16:10:22 user nova-compute[71874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 16:10:22 user nova-compute[71874]:   <source dev="/dev/sdd"/>
Apr 12 16:10:22 user nova-compute[71874]:   <target dev="vdb" bus="virtio"/>
Apr 12 16:10:22 user nova-compute[71874]:   <serial>9c961fcc-0ff0-4275-9163-406662b265f8</serial>
Apr 12 16:10:22 user nova-compute[71874]: </disk>
Apr 12 16:10:22 user nova-compute[71874]:  {{(pid=71874) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 16:10:22 user nova-compute[71874]: DEBUG nova.compute.manager [req-44ea0049-b1e1-4103-bbe5-f263fa5a7ba4 req-b57aa18b-0a84-4b2a-92f4-472eb6e3638e service nova] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Received event network-vif-plugged-18196ae0-d9c1-4814-8803-c4ba8ad4ab45 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:10:22 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-44ea0049-b1e1-4103-bbe5-f263fa5a7ba4 req-b57aa18b-0a84-4b2a-92f4-472eb6e3638e service nova] Acquiring lock "dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:10:22 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-44ea0049-b1e1-4103-bbe5-f263fa5a7ba4 req-b57aa18b-0a84-4b2a-92f4-472eb6e3638e service nova] Lock "dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:10:22 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-44ea0049-b1e1-4103-bbe5-f263fa5a7ba4 req-b57aa18b-0a84-4b2a-92f4-472eb6e3638e service nova] Lock "dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:10:22 user nova-compute[71874]: DEBUG nova.compute.manager [req-44ea0049-b1e1-4103-bbe5-f263fa5a7ba4 req-b57aa18b-0a84-4b2a-92f4-472eb6e3638e service nova] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] No waiting events found dispatching network-vif-plugged-18196ae0-d9c1-4814-8803-c4ba8ad4ab45 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:10:22 user nova-compute[71874]: WARNING nova.compute.manager [req-44ea0049-b1e1-4103-bbe5-f263fa5a7ba4 req-b57aa18b-0a84-4b2a-92f4-472eb6e3638e service nova] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Received unexpected event network-vif-plugged-18196ae0-d9c1-4814-8803-c4ba8ad4ab45 for instance with vm_state resized and task_state resize_reverting.
Apr 12 16:10:22 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:10:22 user nova-compute[71874]: DEBUG nova.network.neutron [None req-1cd91069-e0aa-44a0-9d09-c7f40cd883ab tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] [instance: c307e623-c546-487f-ac16-5eb24d088e8a] Successfully updated port: b6291ae2-bc79-4a35-a160-bff95fae3e8f {{(pid=71874) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 16:10:22 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-1cd91069-e0aa-44a0-9d09-c7f40cd883ab tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Acquiring lock "refresh_cache-c307e623-c546-487f-ac16-5eb24d088e8a" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:10:22 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-1cd91069-e0aa-44a0-9d09-c7f40cd883ab tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Acquired lock "refresh_cache-c307e623-c546-487f-ac16-5eb24d088e8a" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:10:22 user nova-compute[71874]: DEBUG nova.network.neutron [None req-1cd91069-e0aa-44a0-9d09-c7f40cd883ab tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] [instance: c307e623-c546-487f-ac16-5eb24d088e8a] Building network info cache for instance {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 16:10:22 user nova-compute[71874]: DEBUG nova.compute.manager [req-dce6d134-9408-487f-b8a2-8683a76d8504 req-15e8fbdd-1dd5-4455-9ff7-415b841f7ea2 service nova] [instance: c307e623-c546-487f-ac16-5eb24d088e8a] Received event network-changed-b6291ae2-bc79-4a35-a160-bff95fae3e8f {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:10:22 user nova-compute[71874]: DEBUG nova.compute.manager [req-dce6d134-9408-487f-b8a2-8683a76d8504 req-15e8fbdd-1dd5-4455-9ff7-415b841f7ea2 service nova] [instance: c307e623-c546-487f-ac16-5eb24d088e8a] Refreshing instance network info cache due to event network-changed-b6291ae2-bc79-4a35-a160-bff95fae3e8f. {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 16:10:22 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-dce6d134-9408-487f-b8a2-8683a76d8504 req-15e8fbdd-1dd5-4455-9ff7-415b841f7ea2 service nova] Acquiring lock "refresh_cache-c307e623-c546-487f-ac16-5eb24d088e8a" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:10:22 user nova-compute[71874]: DEBUG nova.network.neutron [None req-1cd91069-e0aa-44a0-9d09-c7f40cd883ab tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] [instance: c307e623-c546-487f-ac16-5eb24d088e8a] Instance cache missing network info. {{(pid=71874) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 16:10:22 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:10:22 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:10:22 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:10:22 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:10:22 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:10:22 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-3889dbea-d5b4-4da4-882a-1dc2a8c3770b tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] No BDM found with device name vda, not building metadata. {{(pid=71874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 16:10:22 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-3889dbea-d5b4-4da4-882a-1dc2a8c3770b tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 16:10:22 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-3889dbea-d5b4-4da4-882a-1dc2a8c3770b tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] No VIF found with MAC fa:16:3e:71:77:df, not building metadata {{(pid=71874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 16:10:22 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-3889dbea-d5b4-4da4-882a-1dc2a8c3770b tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "84683344-2893-4446-90ae-e64cd799eb20" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.915s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:10:22 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:10:23 user nova-compute[71874]: DEBUG nova.network.neutron [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Updating instance_info_cache with network_info: [{"id": "c42ace22-d91b-4e4b-909e-19aaa428515a", "address": "fa:16:3e:3e:cd:0b", "network": {"id": "0e139ef7-ae53-4cce-9063-218ac1a19c0c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2058204483-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3deffbb4769b4985b038b4adcd82b018", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc42ace22-d9", "ovs_interfaceid": "c42ace22-d91b-4e4b-909e-19aaa428515a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:10:23 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Releasing lock "refresh_cache-6caa4977-8333-4171-8825-2c3bfb52f80b" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:10:23 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Updated the network info_cache for instance {{(pid=71874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 16:10:23 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:10:23 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:10:23 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:10:23 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:10:23 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Auditing locally available compute resources for user (node: user) {{(pid=71874) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 16:10:23 user nova-compute[71874]: DEBUG nova.network.neutron [None req-1cd91069-e0aa-44a0-9d09-c7f40cd883ab tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] [instance: c307e623-c546-487f-ac16-5eb24d088e8a] Updating instance_info_cache with network_info: [{"id": "b6291ae2-bc79-4a35-a160-bff95fae3e8f", "address": "fa:16:3e:9c:67:25", "network": {"id": "1c560b5e-bb6f-42eb-b9b2-6b3f2eaed0f8", "bridge": "br-int", "label": "tempest-TestStampPattern-1356757354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a77372a5e83c4fc882b0a0b0eea46f06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6291ae2-bc", "ovs_interfaceid": "b6291ae2-bc79-4a35-a160-bff95fae3e8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:10:23 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-1cd91069-e0aa-44a0-9d09-c7f40cd883ab tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Releasing lock "refresh_cache-c307e623-c546-487f-ac16-5eb24d088e8a" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:10:23 user nova-compute[71874]: DEBUG nova.compute.manager [None req-1cd91069-e0aa-44a0-9d09-c7f40cd883ab tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] [instance: c307e623-c546-487f-ac16-5eb24d088e8a] Instance network_info: |[{"id": "b6291ae2-bc79-4a35-a160-bff95fae3e8f", "address": "fa:16:3e:9c:67:25", "network": {"id": "1c560b5e-bb6f-42eb-b9b2-6b3f2eaed0f8", "bridge": "br-int", "label": "tempest-TestStampPattern-1356757354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a77372a5e83c4fc882b0a0b0eea46f06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6291ae2-bc", "ovs_interfaceid": "b6291ae2-bc79-4a35-a160-bff95fae3e8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 16:10:23 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-dce6d134-9408-487f-b8a2-8683a76d8504 req-15e8fbdd-1dd5-4455-9ff7-415b841f7ea2 service nova] Acquired lock "refresh_cache-c307e623-c546-487f-ac16-5eb24d088e8a" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:10:23 user nova-compute[71874]: DEBUG nova.network.neutron [req-dce6d134-9408-487f-b8a2-8683a76d8504 req-15e8fbdd-1dd5-4455-9ff7-415b841f7ea2 service nova] [instance: c307e623-c546-487f-ac16-5eb24d088e8a] Refreshing network info cache for port b6291ae2-bc79-4a35-a160-bff95fae3e8f {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 16:10:23 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-1cd91069-e0aa-44a0-9d09-c7f40cd883ab tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] [instance: c307e623-c546-487f-ac16-5eb24d088e8a] Start _get_guest_xml network_info=[{"id": "b6291ae2-bc79-4a35-a160-bff95fae3e8f", "address": "fa:16:3e:9c:67:25", "network": {"id": "1c560b5e-bb6f-42eb-b9b2-6b3f2eaed0f8", "bridge": "br-int", "label": "tempest-TestStampPattern-1356757354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a77372a5e83c4fc882b0a0b0eea46f06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6291ae2-bc", "ovs_interfaceid": "b6291ae2-bc79-4a35-a160-bff95fae3e8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='f4fc696cb8383c9281b17b2aa872a1b2',container_format='bare',created_at=2023-04-12T16:10:06Z,direct_url=<?>,disk_format='qcow2',id=6c9c5a01-7bd3-4f1f-b219-5ed4224fd354,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-677236483',owner='a77372a5e83c4fc882b0a0b0eea46f06',properties=ImageMetaProps,protected=<?>,size=38666240,status='active',tags=<?>,updated_at=2023-04-12T16:10:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_options': None, 'image_id': '6c9c5a01-7bd3-4f1f-b219-5ed4224fd354'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 16:10:23 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-1cd91069-e0aa-44a0-9d09-c7f40cd883ab tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:10:23 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-1cd91069-e0aa-44a0-9d09-c7f40cd883ab tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:10:23 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-1cd91069-e0aa-44a0-9d09-c7f40cd883ab tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71874) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 16:10:23 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-1cd91069-e0aa-44a0-9d09-c7f40cd883ab tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T15:56:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='f4fc696cb8383c9281b17b2aa872a1b2',container_format='bare',created_at=2023-04-12T16:10:06Z,direct_url=<?>,disk_format='qcow2',id=6c9c5a01-7bd3-4f1f-b219-5ed4224fd354,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-677236483',owner='a77372a5e83c4fc882b0a0b0eea46f06',properties=ImageMetaProps,protected=<?>,size=38666240,status='active',tags=<?>,updated_at=2023-04-12T16:10:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 16:10:23 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-1cd91069-e0aa-44a0-9d09-c7f40cd883ab tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Flavor limits 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 16:10:23 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-1cd91069-e0aa-44a0-9d09-c7f40cd883ab tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Image limits 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 16:10:23 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-1cd91069-e0aa-44a0-9d09-c7f40cd883ab tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Flavor pref 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 16:10:23 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-1cd91069-e0aa-44a0-9d09-c7f40cd883ab tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Image pref 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 16:10:23 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-1cd91069-e0aa-44a0-9d09-c7f40cd883ab tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 16:10:23 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-1cd91069-e0aa-44a0-9d09-c7f40cd883ab tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 16:10:23 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-1cd91069-e0aa-44a0-9d09-c7f40cd883ab tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 16:10:23 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-1cd91069-e0aa-44a0-9d09-c7f40cd883ab tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Got 1 possible topologies {{(pid=71874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 16:10:23 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-1cd91069-e0aa-44a0-9d09-c7f40cd883ab tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 16:10:23 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-1cd91069-e0aa-44a0-9d09-c7f40cd883ab tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 16:10:23 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-1cd91069-e0aa-44a0-9d09-c7f40cd883ab tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T16:10:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-996381593',display_name='tempest-TestStampPattern-server-996381593',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-996381593',id=29,image_ref='6c9c5a01-7bd3-4f1f-b219-5ed4224fd354',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM9rCdORWoFaEzbUsNhuoBFSyjDv4K5w82ZJzoi+0Rba6d3tv8xkR5nGe+5wcm9lUrYy4FRmQCBzLyX7FSGTRKcYmN9F41l7pVMhhHvTYmD+PQt4JX5BTIQ1nRCFqJvvxg==',key_name='tempest-TestStampPattern-1321754823',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a77372a5e83c4fc882b0a0b0eea46f06',ramdisk_id='',reservation_id='r-pe7g4nqp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='78b6940a-f97a-4535-8973-3c2a5befbbab',image_min_disk='1',image_min_ram='0',image_owner_id='a77372a5e83c4fc882b0a0b0eea46f06',image_owner_project_name='tempest-TestStampPattern-1256589700',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1256589700-project-member',image_user_id='5e0ffc0972674609b17fe2780751dfc5',network_allocated='True',owner_project_name='tempest-TestStampPattern-1256589700',owner_user_name='tempest-TestStampPattern-1256589700-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T16:10:18Z,user_data=None,user_id='5e0ffc0972674609b17fe2780751dfc5',uuid=c307e623-c546-487f-ac16-5eb24d088e8a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b6291ae2-bc79-4a35-a160-bff95fae3e8f", "address": "fa:16:3e:9c:67:25", "network": {"id": "1c560b5e-bb6f-42eb-b9b2-6b3f2eaed0f8", "bridge": "br-int", "label": "tempest-TestStampPattern-1356757354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a77372a5e83c4fc882b0a0b0eea46f06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6291ae2-bc", "ovs_interfaceid": "b6291ae2-bc79-4a35-a160-bff95fae3e8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 16:10:23 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-1cd91069-e0aa-44a0-9d09-c7f40cd883ab tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Converting VIF {"id": "b6291ae2-bc79-4a35-a160-bff95fae3e8f", "address": "fa:16:3e:9c:67:25", "network": {"id": "1c560b5e-bb6f-42eb-b9b2-6b3f2eaed0f8", "bridge": "br-int", "label": "tempest-TestStampPattern-1356757354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a77372a5e83c4fc882b0a0b0eea46f06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6291ae2-bc", "ovs_interfaceid": "b6291ae2-bc79-4a35-a160-bff95fae3e8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:10:23 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-1cd91069-e0aa-44a0-9d09-c7f40cd883ab tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:67:25,bridge_name='br-int',has_traffic_filtering=True,id=b6291ae2-bc79-4a35-a160-bff95fae3e8f,network=Network(1c560b5e-bb6f-42eb-b9b2-6b3f2eaed0f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6291ae2-bc') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:10:23 user nova-compute[71874]: DEBUG nova.objects.instance [None req-1cd91069-e0aa-44a0-9d09-c7f40cd883ab tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lazy-loading 'pci_devices' on Instance uuid c307e623-c546-487f-ac16-5eb24d088e8a {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:10:23 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-1cd91069-e0aa-44a0-9d09-c7f40cd883ab tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] [instance: c307e623-c546-487f-ac16-5eb24d088e8a] End _get_guest_xml xml=<domain type="kvm">
Apr 12 16:10:23 user nova-compute[71874]:   <uuid>c307e623-c546-487f-ac16-5eb24d088e8a</uuid>
Apr 12 16:10:23 user nova-compute[71874]:   <name>instance-0000001d</name>
Apr 12 16:10:23 user nova-compute[71874]:   <memory>131072</memory>
Apr 12 16:10:23 user nova-compute[71874]:   <vcpu>1</vcpu>
Apr 12 16:10:23 user nova-compute[71874]:   <metadata>
Apr 12 16:10:23 user nova-compute[71874]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 16:10:23 user nova-compute[71874]:       <nova:package version="0.0.0"/>
Apr 12 16:10:23 user nova-compute[71874]:       <nova:name>tempest-TestStampPattern-server-996381593</nova:name>
Apr 12 16:10:23 user nova-compute[71874]:       <nova:creationTime>2023-04-12 16:10:23</nova:creationTime>
Apr 12 16:10:23 user nova-compute[71874]:       <nova:flavor name="m1.nano">
Apr 12 16:10:23 user nova-compute[71874]:         <nova:memory>128</nova:memory>
Apr 12 16:10:23 user nova-compute[71874]:         <nova:disk>1</nova:disk>
Apr 12 16:10:23 user nova-compute[71874]:         <nova:swap>0</nova:swap>
Apr 12 16:10:23 user nova-compute[71874]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 16:10:23 user nova-compute[71874]:         <nova:vcpus>1</nova:vcpus>
Apr 12 16:10:23 user nova-compute[71874]:       </nova:flavor>
Apr 12 16:10:23 user nova-compute[71874]:       <nova:owner>
Apr 12 16:10:23 user nova-compute[71874]:         <nova:user uuid="5e0ffc0972674609b17fe2780751dfc5">tempest-TestStampPattern-1256589700-project-member</nova:user>
Apr 12 16:10:23 user nova-compute[71874]:         <nova:project uuid="a77372a5e83c4fc882b0a0b0eea46f06">tempest-TestStampPattern-1256589700</nova:project>
Apr 12 16:10:23 user nova-compute[71874]:       </nova:owner>
Apr 12 16:10:23 user nova-compute[71874]:       <nova:root type="image" uuid="6c9c5a01-7bd3-4f1f-b219-5ed4224fd354"/>
Apr 12 16:10:23 user nova-compute[71874]:       <nova:ports>
Apr 12 16:10:23 user nova-compute[71874]:         <nova:port uuid="b6291ae2-bc79-4a35-a160-bff95fae3e8f">
Apr 12 16:10:23 user nova-compute[71874]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 12 16:10:23 user nova-compute[71874]:         </nova:port>
Apr 12 16:10:23 user nova-compute[71874]:       </nova:ports>
Apr 12 16:10:23 user nova-compute[71874]:     </nova:instance>
Apr 12 16:10:23 user nova-compute[71874]:   </metadata>
Apr 12 16:10:23 user nova-compute[71874]:   <sysinfo type="smbios">
Apr 12 16:10:23 user nova-compute[71874]:     <system>
Apr 12 16:10:23 user nova-compute[71874]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 16:10:23 user nova-compute[71874]:       <entry name="product">OpenStack Nova</entry>
Apr 12 16:10:23 user nova-compute[71874]:       <entry name="version">0.0.0</entry>
Apr 12 16:10:23 user nova-compute[71874]:       <entry name="serial">c307e623-c546-487f-ac16-5eb24d088e8a</entry>
Apr 12 16:10:23 user nova-compute[71874]:       <entry name="uuid">c307e623-c546-487f-ac16-5eb24d088e8a</entry>
Apr 12 16:10:23 user nova-compute[71874]:       <entry name="family">Virtual Machine</entry>
Apr 12 16:10:23 user nova-compute[71874]:     </system>
Apr 12 16:10:23 user nova-compute[71874]:   </sysinfo>
Apr 12 16:10:23 user nova-compute[71874]:   <os>
Apr 12 16:10:23 user nova-compute[71874]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 16:10:23 user nova-compute[71874]:     <boot dev="hd"/>
Apr 12 16:10:23 user nova-compute[71874]:     <smbios mode="sysinfo"/>
Apr 12 16:10:23 user nova-compute[71874]:   </os>
Apr 12 16:10:23 user nova-compute[71874]:   <features>
Apr 12 16:10:23 user nova-compute[71874]:     <acpi/>
Apr 12 16:10:23 user nova-compute[71874]:     <apic/>
Apr 12 16:10:23 user nova-compute[71874]:     <vmcoreinfo/>
Apr 12 16:10:23 user nova-compute[71874]:   </features>
Apr 12 16:10:23 user nova-compute[71874]:   <clock offset="utc">
Apr 12 16:10:23 user nova-compute[71874]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 16:10:23 user nova-compute[71874]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 16:10:23 user nova-compute[71874]:     <timer name="hpet" present="no"/>
Apr 12 16:10:23 user nova-compute[71874]:   </clock>
Apr 12 16:10:23 user nova-compute[71874]:   <cpu mode="custom" match="exact">
Apr 12 16:10:23 user nova-compute[71874]:     <model>Nehalem</model>
Apr 12 16:10:23 user nova-compute[71874]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 16:10:23 user nova-compute[71874]:   </cpu>
Apr 12 16:10:23 user nova-compute[71874]:   <devices>
Apr 12 16:10:23 user nova-compute[71874]:     <disk type="file" device="disk">
Apr 12 16:10:23 user nova-compute[71874]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 16:10:23 user nova-compute[71874]:       <source file="/opt/stack/data/nova/instances/c307e623-c546-487f-ac16-5eb24d088e8a/disk"/>
Apr 12 16:10:23 user nova-compute[71874]:       <target dev="vda" bus="virtio"/>
Apr 12 16:10:23 user nova-compute[71874]:     </disk>
Apr 12 16:10:23 user nova-compute[71874]:     <interface type="ethernet">
Apr 12 16:10:23 user nova-compute[71874]:       <mac address="fa:16:3e:9c:67:25"/>
Apr 12 16:10:23 user nova-compute[71874]:       <model type="virtio"/>
Apr 12 16:10:23 user nova-compute[71874]:       <mtu size="1442"/>
Apr 12 16:10:23 user nova-compute[71874]:       <target dev="tapb6291ae2-bc"/>
Apr 12 16:10:23 user nova-compute[71874]:     </interface>
Apr 12 16:10:23 user nova-compute[71874]:     <serial type="pty">
Apr 12 16:10:23 user nova-compute[71874]:       <log file="/opt/stack/data/nova/instances/c307e623-c546-487f-ac16-5eb24d088e8a/console.log" append="off"/>
Apr 12 16:10:23 user nova-compute[71874]:     </serial>
Apr 12 16:10:23 user nova-compute[71874]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 16:10:23 user nova-compute[71874]:     <video>
Apr 12 16:10:23 user nova-compute[71874]:       <model type="virtio"/>
Apr 12 16:10:23 user nova-compute[71874]:     </video>
Apr 12 16:10:23 user nova-compute[71874]:     <rng model="virtio">
Apr 12 16:10:23 user nova-compute[71874]:       <backend model="random">/dev/urandom</backend>
Apr 12 16:10:23 user nova-compute[71874]:     </rng>
Apr 12 16:10:23 user nova-compute[71874]:     <controller type="usb" index="0" model="none"/>
Apr 12 16:10:23 user nova-compute[71874]:     <memballoon model="virtio">
Apr 12 16:10:23 user nova-compute[71874]:       <stats period="10"/>
Apr 12 16:10:23 user nova-compute[71874]:     </memballoon>
Apr 12 16:10:23 user nova-compute[71874]:   </devices>
Apr 12 16:10:23 user nova-compute[71874]: </domain>
Apr 12 16:10:23 user nova-compute[71874]:  {{(pid=71874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 16:10:23 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-1cd91069-e0aa-44a0-9d09-c7f40cd883ab tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T16:10:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-996381593',display_name='tempest-TestStampPattern-server-996381593',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-996381593',id=29,image_ref='6c9c5a01-7bd3-4f1f-b219-5ed4224fd354',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM9rCdORWoFaEzbUsNhuoBFSyjDv4K5w82ZJzoi+0Rba6d3tv8xkR5nGe+5wcm9lUrYy4FRmQCBzLyX7FSGTRKcYmN9F41l7pVMhhHvTYmD+PQt4JX5BTIQ1nRCFqJvvxg==',key_name='tempest-TestStampPattern-1321754823',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a77372a5e83c4fc882b0a0b0eea46f06',ramdisk_id='',reservation_id='r-pe7g4nqp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='78b6940a-f97a-4535-8973-3c2a5befbbab',image_min_disk='1',image_min_ram='0',image_owner_id='a77372a5e83c4fc882b0a0b0eea46f06',image_owner_project_name='tempest-TestStampPattern-1256589700',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1256589700-project-member',image_user_id='5e0ffc0972674609b17fe2780751dfc5',network_allocated='True',owner_project_name='tempest-TestStampPattern-1256589700',owner_user_name='tempest-TestStampPattern-1256589700-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T16:10:18Z,user_data=None,user_id='5e0ffc0972674609b17fe2780751dfc5',uuid=c307e623-c546-487f-ac16-5eb24d088e8a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b6291ae2-bc79-4a35-a160-bff95fae3e8f", "address": "fa:16:3e:9c:67:25", "network": {"id": "1c560b5e-bb6f-42eb-b9b2-6b3f2eaed0f8", "bridge": "br-int", "label": "tempest-TestStampPattern-1356757354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a77372a5e83c4fc882b0a0b0eea46f06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6291ae2-bc", "ovs_interfaceid": "b6291ae2-bc79-4a35-a160-bff95fae3e8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 16:10:23 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-1cd91069-e0aa-44a0-9d09-c7f40cd883ab tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Converting VIF {"id": "b6291ae2-bc79-4a35-a160-bff95fae3e8f", "address": "fa:16:3e:9c:67:25", "network": {"id": "1c560b5e-bb6f-42eb-b9b2-6b3f2eaed0f8", "bridge": "br-int", "label": "tempest-TestStampPattern-1356757354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a77372a5e83c4fc882b0a0b0eea46f06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6291ae2-bc", "ovs_interfaceid": "b6291ae2-bc79-4a35-a160-bff95fae3e8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:10:23 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-1cd91069-e0aa-44a0-9d09-c7f40cd883ab tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:67:25,bridge_name='br-int',has_traffic_filtering=True,id=b6291ae2-bc79-4a35-a160-bff95fae3e8f,network=Network(1c560b5e-bb6f-42eb-b9b2-6b3f2eaed0f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6291ae2-bc') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:10:23 user nova-compute[71874]: DEBUG os_vif [None req-1cd91069-e0aa-44a0-9d09-c7f40cd883ab tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:67:25,bridge_name='br-int',has_traffic_filtering=True,id=b6291ae2-bc79-4a35-a160-bff95fae3e8f,network=Network(1c560b5e-bb6f-42eb-b9b2-6b3f2eaed0f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6291ae2-bc') {{(pid=71874) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 16:10:23 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:10:23 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:10:23 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 16:10:23 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:10:23 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb6291ae2-bc, may_exist=True) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:10:23 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb6291ae2-bc, col_values=(('external_ids', {'iface-id': 'b6291ae2-bc79-4a35-a160-bff95fae3e8f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9c:67:25', 'vm-uuid': 'c307e623-c546-487f-ac16-5eb24d088e8a'}),)) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:10:23 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:10:23 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:10:23 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:10:23 user nova-compute[71874]: INFO os_vif [None req-1cd91069-e0aa-44a0-9d09-c7f40cd883ab tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:67:25,bridge_name='br-int',has_traffic_filtering=True,id=b6291ae2-bc79-4a35-a160-bff95fae3e8f,network=Network(1c560b5e-bb6f-42eb-b9b2-6b3f2eaed0f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6291ae2-bc')
Apr 12 16:10:23 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-1cd91069-e0aa-44a0-9d09-c7f40cd883ab tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] No BDM found with device name vda, not building metadata. {{(pid=71874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 16:10:23 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-1cd91069-e0aa-44a0-9d09-c7f40cd883ab tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] No VIF found with MAC fa:16:3e:9c:67:25, not building metadata {{(pid=71874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 16:10:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f641c6b-b508-42a7-ae98-c2bfb841d798/disk.rescue --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:10:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f641c6b-b508-42a7-ae98-c2bfb841d798/disk.rescue --force-share --output=json" returned: 0 in 0.147s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:10:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f641c6b-b508-42a7-ae98-c2bfb841d798/disk.rescue --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:10:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f641c6b-b508-42a7-ae98-c2bfb841d798/disk.rescue --force-share --output=json" returned: 0 in 0.148s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:10:23 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] skipping disk /opt/stack/data/nova/instances/7f641c6b-b508-42a7-ae98-c2bfb841d798/disk (vdb) as it is a volume {{(pid=71874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 16:10:23 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 16:10:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473a30c4-5aa4-481c-8859-fda815d14872/disk.rescue --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:10:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473a30c4-5aa4-481c-8859-fda815d14872/disk.rescue --force-share --output=json" returned: 0 in 0.163s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:10:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473a30c4-5aa4-481c-8859-fda815d14872/disk.rescue --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:10:24 user nova-compute[71874]: DEBUG nova.network.neutron [req-dce6d134-9408-487f-b8a2-8683a76d8504 req-15e8fbdd-1dd5-4455-9ff7-415b841f7ea2 service nova] [instance: c307e623-c546-487f-ac16-5eb24d088e8a] Updated VIF entry in instance network info cache for port b6291ae2-bc79-4a35-a160-bff95fae3e8f. {{(pid=71874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 16:10:24 user nova-compute[71874]: DEBUG nova.network.neutron [req-dce6d134-9408-487f-b8a2-8683a76d8504 req-15e8fbdd-1dd5-4455-9ff7-415b841f7ea2 service nova] [instance: c307e623-c546-487f-ac16-5eb24d088e8a] Updating instance_info_cache with network_info: [{"id": "b6291ae2-bc79-4a35-a160-bff95fae3e8f", "address": "fa:16:3e:9c:67:25", "network": {"id": "1c560b5e-bb6f-42eb-b9b2-6b3f2eaed0f8", "bridge": "br-int", "label": "tempest-TestStampPattern-1356757354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a77372a5e83c4fc882b0a0b0eea46f06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6291ae2-bc", "ovs_interfaceid": "b6291ae2-bc79-4a35-a160-bff95fae3e8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:10:24 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-dce6d134-9408-487f-b8a2-8683a76d8504 req-15e8fbdd-1dd5-4455-9ff7-415b841f7ea2 service nova] Releasing lock "refresh_cache-c307e623-c546-487f-ac16-5eb24d088e8a" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:10:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473a30c4-5aa4-481c-8859-fda815d14872/disk.rescue --force-share --output=json" returned: 0 in 0.163s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:10:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473a30c4-5aa4-481c-8859-fda815d14872/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:10:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473a30c4-5aa4-481c-8859-fda815d14872/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:10:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473a30c4-5aa4-481c-8859-fda815d14872/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:10:24 user nova-compute[71874]: DEBUG nova.compute.manager [req-ee635625-5346-4b53-adda-8fb1c2b54ac1 req-e1893802-697d-47ab-aaa5-e68d8b157d9a service nova] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Received event network-vif-plugged-18196ae0-d9c1-4814-8803-c4ba8ad4ab45 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:10:24 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-ee635625-5346-4b53-adda-8fb1c2b54ac1 req-e1893802-697d-47ab-aaa5-e68d8b157d9a service nova] Acquiring lock "dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:10:24 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-ee635625-5346-4b53-adda-8fb1c2b54ac1 req-e1893802-697d-47ab-aaa5-e68d8b157d9a service nova] Lock "dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:10:24 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-ee635625-5346-4b53-adda-8fb1c2b54ac1 req-e1893802-697d-47ab-aaa5-e68d8b157d9a service nova] Lock "dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:10:24 user nova-compute[71874]: DEBUG nova.compute.manager [req-ee635625-5346-4b53-adda-8fb1c2b54ac1 req-e1893802-697d-47ab-aaa5-e68d8b157d9a service nova] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] No waiting events found dispatching network-vif-plugged-18196ae0-d9c1-4814-8803-c4ba8ad4ab45 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:10:24 user nova-compute[71874]: WARNING nova.compute.manager [req-ee635625-5346-4b53-adda-8fb1c2b54ac1 req-e1893802-697d-47ab-aaa5-e68d8b157d9a service nova] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Received unexpected event network-vif-plugged-18196ae0-d9c1-4814-8803-c4ba8ad4ab45 for instance with vm_state resized and task_state resize_reverting.
Apr 12 16:10:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473a30c4-5aa4-481c-8859-fda815d14872/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:10:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:10:24 user nova-compute[71874]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681315809.508006, dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 => Stopped> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:10:24 user nova-compute[71874]: INFO nova.compute.manager [-] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] VM Stopped (Lifecycle Event)
Apr 12 16:10:24 user nova-compute[71874]: DEBUG nova.compute.manager [None req-1b759bce-4400-4bb7-acd3-f55d7216fa82 None None] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:10:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:10:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:10:24 user nova-compute[71874]: DEBUG nova.virt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Emitting event <LifecycleEvent: 1681315824.6922698, dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 => Resumed> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:10:24 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] VM Resumed (Lifecycle Event)
Apr 12 16:10:24 user nova-compute[71874]: DEBUG nova.compute.manager [None req-5d57ee95-b468-40fc-a118-3ff198e91ba7 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Instance event wait completed in 0 seconds for  {{(pid=71874) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 16:10:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:10:24 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 16:10:24 user nova-compute[71874]: INFO nova.virt.libvirt.driver [-] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Instance running successfully.
Apr 12 16:10:24 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:10:24 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-5d57ee95-b468-40fc-a118-3ff198e91ba7 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] finish_revert_migration finished successfully. {{(pid=71874) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11836}}
Apr 12 16:10:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/016ae41d-b098-4126-ace7-3da00b40cb9c/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:10:24 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:10:24 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=71874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 16:10:24 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:10:24 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Apr 12 16:10:24 user nova-compute[71874]: DEBUG nova.virt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Emitting event <LifecycleEvent: 1681315824.701454, dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 => Started> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:10:24 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] VM Started (Lifecycle Event)
Apr 12 16:10:24 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:10:24 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:10:24 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=71874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 16:10:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/016ae41d-b098-4126-ace7-3da00b40cb9c/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:10:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/016ae41d-b098-4126-ace7-3da00b40cb9c/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:10:24 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Apr 12 16:10:24 user nova-compute[71874]: INFO nova.compute.manager [None req-5d57ee95-b468-40fc-a118-3ff198e91ba7 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Updating instance to original state: 'active'
Apr 12 16:10:25 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/016ae41d-b098-4126-ace7-3da00b40cb9c/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:10:25 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/608fbea2-b42b-4bb9-94a7-2b76dcdc2001/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:10:25 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:10:25 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/608fbea2-b42b-4bb9-94a7-2b76dcdc2001/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:10:25 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/608fbea2-b42b-4bb9-94a7-2b76dcdc2001/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:10:25 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/608fbea2-b42b-4bb9-94a7-2b76dcdc2001/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:10:25 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6caa4977-8333-4171-8825-2c3bfb52f80b/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:10:25 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6caa4977-8333-4171-8825-2c3bfb52f80b/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:10:25 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6caa4977-8333-4171-8825-2c3bfb52f80b/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:10:25 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6caa4977-8333-4171-8825-2c3bfb52f80b/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:10:25 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2511c44-8365-4e8c-9814-172547111b9f/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:10:26 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2511c44-8365-4e8c-9814-172547111b9f/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:10:26 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2511c44-8365-4e8c-9814-172547111b9f/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:10:26 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:10:26 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2511c44-8365-4e8c-9814-172547111b9f/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:10:26 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84683344-2893-4446-90ae-e64cd799eb20/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:10:26 user nova-compute[71874]: DEBUG nova.compute.manager [req-f9506aa5-cbf1-4d2a-8304-d7f9e39d93da req-b90ce637-10c9-4331-87b3-d1ffd9298b80 service nova] [instance: c307e623-c546-487f-ac16-5eb24d088e8a] Received event network-vif-plugged-b6291ae2-bc79-4a35-a160-bff95fae3e8f {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:10:26 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-f9506aa5-cbf1-4d2a-8304-d7f9e39d93da req-b90ce637-10c9-4331-87b3-d1ffd9298b80 service nova] Acquiring lock "c307e623-c546-487f-ac16-5eb24d088e8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:10:26 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-f9506aa5-cbf1-4d2a-8304-d7f9e39d93da req-b90ce637-10c9-4331-87b3-d1ffd9298b80 service nova] Lock "c307e623-c546-487f-ac16-5eb24d088e8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:10:26 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-f9506aa5-cbf1-4d2a-8304-d7f9e39d93da req-b90ce637-10c9-4331-87b3-d1ffd9298b80 service nova] Lock "c307e623-c546-487f-ac16-5eb24d088e8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:10:26 user nova-compute[71874]: DEBUG nova.compute.manager [req-f9506aa5-cbf1-4d2a-8304-d7f9e39d93da req-b90ce637-10c9-4331-87b3-d1ffd9298b80 service nova] [instance: c307e623-c546-487f-ac16-5eb24d088e8a] No waiting events found dispatching network-vif-plugged-b6291ae2-bc79-4a35-a160-bff95fae3e8f {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:10:26 user nova-compute[71874]: WARNING nova.compute.manager [req-f9506aa5-cbf1-4d2a-8304-d7f9e39d93da req-b90ce637-10c9-4331-87b3-d1ffd9298b80 service nova] [instance: c307e623-c546-487f-ac16-5eb24d088e8a] Received unexpected event network-vif-plugged-b6291ae2-bc79-4a35-a160-bff95fae3e8f for instance with vm_state building and task_state spawning.
Apr 12 16:10:26 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84683344-2893-4446-90ae-e64cd799eb20/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:10:26 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84683344-2893-4446-90ae-e64cd799eb20/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:10:26 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84683344-2893-4446-90ae-e64cd799eb20/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:10:26 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 16:10:26 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afebffae-dbf6-4876-8c9f-0364f0fde49c/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:10:26 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afebffae-dbf6-4876-8c9f-0364f0fde49c/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:10:26 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afebffae-dbf6-4876-8c9f-0364f0fde49c/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:10:27 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afebffae-dbf6-4876-8c9f-0364f0fde49c/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:10:27 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78b6940a-f97a-4535-8973-3c2a5befbbab/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:10:27 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78b6940a-f97a-4535-8973-3c2a5befbbab/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:10:27 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78b6940a-f97a-4535-8973-3c2a5befbbab/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:10:27 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78b6940a-f97a-4535-8973-3c2a5befbbab/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:10:27 user nova-compute[71874]: DEBUG nova.compute.manager [None req-1cd91069-e0aa-44a0-9d09-c7f40cd883ab tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] [instance: c307e623-c546-487f-ac16-5eb24d088e8a] Instance event wait completed in 0 seconds for  {{(pid=71874) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 16:10:27 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-1cd91069-e0aa-44a0-9d09-c7f40cd883ab tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] [instance: c307e623-c546-487f-ac16-5eb24d088e8a] Guest created on hypervisor {{(pid=71874) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 16:10:28 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:10:28 user nova-compute[71874]: DEBUG nova.virt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Emitting event <LifecycleEvent: 1681315827.5608432, c307e623-c546-487f-ac16-5eb24d088e8a => Resumed> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:10:28 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: c307e623-c546-487f-ac16-5eb24d088e8a] VM Resumed (Lifecycle Event)
Apr 12 16:10:28 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:10:28 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:10:28 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Hypervisor/Node resource view: name=user free_ram=7530MB free_disk=25.673572540283203GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71874) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 16:10:28 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:10:28 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:10:28 user nova-compute[71874]: INFO nova.virt.libvirt.driver [-] [instance: c307e623-c546-487f-ac16-5eb24d088e8a] Instance spawned successfully.
Apr 12 16:10:28 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-1cd91069-e0aa-44a0-9d09-c7f40cd883ab tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] [instance: c307e623-c546-487f-ac16-5eb24d088e8a] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 16:10:28 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: c307e623-c546-487f-ac16-5eb24d088e8a] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:10:28 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-1cd91069-e0aa-44a0-9d09-c7f40cd883ab tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] [instance: c307e623-c546-487f-ac16-5eb24d088e8a] Found default for hw_input_bus of None {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:10:28 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-1cd91069-e0aa-44a0-9d09-c7f40cd883ab tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] [instance: c307e623-c546-487f-ac16-5eb24d088e8a] Found default for hw_pointer_model of None {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:10:28 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: c307e623-c546-487f-ac16-5eb24d088e8a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 16:10:28 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: c307e623-c546-487f-ac16-5eb24d088e8a] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 16:10:28 user nova-compute[71874]: DEBUG nova.virt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Emitting event <LifecycleEvent: 1681315827.5612006, c307e623-c546-487f-ac16-5eb24d088e8a => Started> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:10:28 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: c307e623-c546-487f-ac16-5eb24d088e8a] VM Started (Lifecycle Event)
Apr 12 16:10:28 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:10:28 user nova-compute[71874]: INFO nova.compute.manager [None req-1cd91069-e0aa-44a0-9d09-c7f40cd883ab tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] [instance: c307e623-c546-487f-ac16-5eb24d088e8a] Took 10.59 seconds to spawn the instance on the hypervisor.
Apr 12 16:10:28 user nova-compute[71874]: DEBUG nova.compute.manager [None req-1cd91069-e0aa-44a0-9d09-c7f40cd883ab tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] [instance: c307e623-c546-487f-ac16-5eb24d088e8a] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:10:28 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: c307e623-c546-487f-ac16-5eb24d088e8a] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:10:28 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: c307e623-c546-487f-ac16-5eb24d088e8a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 16:10:28 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: c307e623-c546-487f-ac16-5eb24d088e8a] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 16:10:28 user nova-compute[71874]: INFO nova.compute.manager [None req-1cd91069-e0aa-44a0-9d09-c7f40cd883ab tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] [instance: c307e623-c546-487f-ac16-5eb24d088e8a] Took 11.55 seconds to build instance.
Apr 12 16:10:28 user nova-compute[71874]: DEBUG nova.compute.manager [req-45bd3ba3-4907-40a9-838e-32c58a6a2d05 req-140f0621-b45d-427e-a4f6-61ce01a67da1 service nova] [instance: c307e623-c546-487f-ac16-5eb24d088e8a] Received event network-vif-plugged-b6291ae2-bc79-4a35-a160-bff95fae3e8f {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:10:28 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-45bd3ba3-4907-40a9-838e-32c58a6a2d05 req-140f0621-b45d-427e-a4f6-61ce01a67da1 service nova] Acquiring lock "c307e623-c546-487f-ac16-5eb24d088e8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:10:28 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-45bd3ba3-4907-40a9-838e-32c58a6a2d05 req-140f0621-b45d-427e-a4f6-61ce01a67da1 service nova] Lock "c307e623-c546-487f-ac16-5eb24d088e8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:10:28 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-45bd3ba3-4907-40a9-838e-32c58a6a2d05 req-140f0621-b45d-427e-a4f6-61ce01a67da1 service nova] Lock "c307e623-c546-487f-ac16-5eb24d088e8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:10:28 user nova-compute[71874]: DEBUG nova.compute.manager [req-45bd3ba3-4907-40a9-838e-32c58a6a2d05 req-140f0621-b45d-427e-a4f6-61ce01a67da1 service nova] [instance: c307e623-c546-487f-ac16-5eb24d088e8a] No waiting events found dispatching network-vif-plugged-b6291ae2-bc79-4a35-a160-bff95fae3e8f {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:10:28 user nova-compute[71874]: WARNING nova.compute.manager [req-45bd3ba3-4907-40a9-838e-32c58a6a2d05 req-140f0621-b45d-427e-a4f6-61ce01a67da1 service nova] [instance: c307e623-c546-487f-ac16-5eb24d088e8a] Received unexpected event network-vif-plugged-b6291ae2-bc79-4a35-a160-bff95fae3e8f for instance with vm_state active and task_state None.
Apr 12 16:10:28 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-1cd91069-e0aa-44a0-9d09-c7f40cd883ab tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lock "c307e623-c546-487f-ac16-5eb24d088e8a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.702s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:10:28 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance afebffae-dbf6-4876-8c9f-0364f0fde49c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:10:28 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 473a30c4-5aa4-481c-8859-fda815d14872 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:10:28 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 608fbea2-b42b-4bb9-94a7-2b76dcdc2001 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:10:28 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance f52ee906-c8fd-4cd5-842e-de98a5099c4f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:10:28 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 6caa4977-8333-4171-8825-2c3bfb52f80b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:10:28 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 78b6940a-f97a-4535-8973-3c2a5befbbab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:10:28 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 7f641c6b-b508-42a7-ae98-c2bfb841d798 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:10:28 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 016ae41d-b098-4126-ace7-3da00b40cb9c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:10:28 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:10:28 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 84683344-2893-4446-90ae-e64cd799eb20 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:10:28 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance f2511c44-8365-4e8c-9814-172547111b9f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:10:28 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance c307e623-c546-487f-ac16-5eb24d088e8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:10:28 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=71874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 16:10:28 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Final resource view: name=user phys_ram=16023MB used_ram=2048MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=71874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 16:10:28 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Refreshing inventories for resource provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b {{(pid=71874) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 12 16:10:28 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Updating ProviderTree inventory for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 12 16:10:28 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Updating inventory in ProviderTree for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 12 16:10:28 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Refreshing aggregate associations for resource provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b, aggregates: None {{(pid=71874) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 12 16:10:28 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Refreshing trait associations for resource provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b, traits: COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_ACCELERATORS,HW_CPU_X86_MMX,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE2,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_FDC,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE {{(pid=71874) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 12 16:10:29 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Inventory has not changed in ProviderTree for provider: 0e94b4c8-cd49-45e4-9133-d36eb4b2456b {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 16:10:29 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Inventory has not changed for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 16:10:29 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Compute_service record updated for user:user {{(pid=71874) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 16:10:29 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.163s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:10:29 user nova-compute[71874]: DEBUG nova.compute.manager [req-aee17291-0180-4abc-8e81-35570982c992 req-400b051d-99ed-4779-981d-cc5ddb5a7621 service nova] [instance: 84683344-2893-4446-90ae-e64cd799eb20] Received event network-changed-a8837af3-03f7-4b3d-8a2a-746f2d8038ad {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:10:29 user nova-compute[71874]: DEBUG nova.compute.manager [req-aee17291-0180-4abc-8e81-35570982c992 req-400b051d-99ed-4779-981d-cc5ddb5a7621 service nova] [instance: 84683344-2893-4446-90ae-e64cd799eb20] Refreshing instance network info cache due to event network-changed-a8837af3-03f7-4b3d-8a2a-746f2d8038ad. {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 16:10:29 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-aee17291-0180-4abc-8e81-35570982c992 req-400b051d-99ed-4779-981d-cc5ddb5a7621 service nova] Acquiring lock "refresh_cache-84683344-2893-4446-90ae-e64cd799eb20" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:10:29 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-aee17291-0180-4abc-8e81-35570982c992 req-400b051d-99ed-4779-981d-cc5ddb5a7621 service nova] Acquired lock "refresh_cache-84683344-2893-4446-90ae-e64cd799eb20" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:10:29 user nova-compute[71874]: DEBUG nova.network.neutron [req-aee17291-0180-4abc-8e81-35570982c992 req-400b051d-99ed-4779-981d-cc5ddb5a7621 service nova] [instance: 84683344-2893-4446-90ae-e64cd799eb20] Refreshing network info cache for port a8837af3-03f7-4b3d-8a2a-746f2d8038ad {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 16:10:30 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:10:30 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:10:30 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:10:30 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:10:30 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:10:30 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:10:30 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71874) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 16:10:30 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-14a0d391-29f5-4dcf-8400-67fd399d7e1f tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Acquiring lock "4190e244-84b1-47b6-813d-9cadb7c65975" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:10:30 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-14a0d391-29f5-4dcf-8400-67fd399d7e1f tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "4190e244-84b1-47b6-813d-9cadb7c65975" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:10:30 user nova-compute[71874]: DEBUG nova.compute.manager [None req-14a0d391-29f5-4dcf-8400-67fd399d7e1f tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Starting instance... {{(pid=71874) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 16:10:30 user nova-compute[71874]: DEBUG nova.network.neutron [req-aee17291-0180-4abc-8e81-35570982c992 req-400b051d-99ed-4779-981d-cc5ddb5a7621 service nova] [instance: 84683344-2893-4446-90ae-e64cd799eb20] Updated VIF entry in instance network info cache for port a8837af3-03f7-4b3d-8a2a-746f2d8038ad. {{(pid=71874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 16:10:30 user nova-compute[71874]: DEBUG nova.network.neutron [req-aee17291-0180-4abc-8e81-35570982c992 req-400b051d-99ed-4779-981d-cc5ddb5a7621 service nova] [instance: 84683344-2893-4446-90ae-e64cd799eb20] Updating instance_info_cache with network_info: [{"id": "a8837af3-03f7-4b3d-8a2a-746f2d8038ad", "address": "fa:16:3e:71:77:df", "network": {"id": "58f92787-e3b6-4fd3-bd75-7169f1a36651", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-614349033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "236b9e609eb44071bc88971bff96931e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8837af3-03", "ovs_interfaceid": "a8837af3-03f7-4b3d-8a2a-746f2d8038ad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:10:30 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-aee17291-0180-4abc-8e81-35570982c992 req-400b051d-99ed-4779-981d-cc5ddb5a7621 service nova] Releasing lock "refresh_cache-84683344-2893-4446-90ae-e64cd799eb20" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:10:30 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-14a0d391-29f5-4dcf-8400-67fd399d7e1f tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:10:30 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-14a0d391-29f5-4dcf-8400-67fd399d7e1f tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:10:30 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-14a0d391-29f5-4dcf-8400-67fd399d7e1f tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71874) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 16:10:30 user nova-compute[71874]: INFO nova.compute.claims [None req-14a0d391-29f5-4dcf-8400-67fd399d7e1f tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Claim successful on node user
Apr 12 16:10:30 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-14a0d391-29f5-4dcf-8400-67fd399d7e1f tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Inventory has not changed in ProviderTree for provider: 0e94b4c8-cd49-45e4-9133-d36eb4b2456b {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 16:10:30 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-14a0d391-29f5-4dcf-8400-67fd399d7e1f tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Inventory has not changed for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 16:10:30 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-14a0d391-29f5-4dcf-8400-67fd399d7e1f tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.537s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:10:30 user nova-compute[71874]: DEBUG nova.compute.manager [None req-14a0d391-29f5-4dcf-8400-67fd399d7e1f tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Start building networks asynchronously for instance. {{(pid=71874) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 16:10:30 user nova-compute[71874]: DEBUG nova.compute.manager [None req-14a0d391-29f5-4dcf-8400-67fd399d7e1f tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Allocating IP information in the background. {{(pid=71874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 16:10:30 user nova-compute[71874]: DEBUG nova.network.neutron [None req-14a0d391-29f5-4dcf-8400-67fd399d7e1f tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] allocate_for_instance() {{(pid=71874) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 16:10:31 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-14a0d391-29f5-4dcf-8400-67fd399d7e1f tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 16:10:31 user nova-compute[71874]: DEBUG nova.compute.manager [None req-14a0d391-29f5-4dcf-8400-67fd399d7e1f tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Start building block device mappings for instance. {{(pid=71874) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 16:10:31 user nova-compute[71874]: DEBUG nova.policy [None req-14a0d391-29f5-4dcf-8400-67fd399d7e1f tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2996f6997bb14fc3aec9c3736cc65b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf4334df004490ba51b4d92ce5408ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71874) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 16:10:31 user nova-compute[71874]: DEBUG nova.compute.manager [None req-14a0d391-29f5-4dcf-8400-67fd399d7e1f tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Start spawning the instance on the hypervisor. {{(pid=71874) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 16:10:31 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-14a0d391-29f5-4dcf-8400-67fd399d7e1f tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Creating instance directory {{(pid=71874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 16:10:31 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-14a0d391-29f5-4dcf-8400-67fd399d7e1f tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Creating image(s)
Apr 12 16:10:31 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-14a0d391-29f5-4dcf-8400-67fd399d7e1f tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Acquiring lock "/opt/stack/data/nova/instances/4190e244-84b1-47b6-813d-9cadb7c65975/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:10:31 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-14a0d391-29f5-4dcf-8400-67fd399d7e1f tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "/opt/stack/data/nova/instances/4190e244-84b1-47b6-813d-9cadb7c65975/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:10:31 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-14a0d391-29f5-4dcf-8400-67fd399d7e1f tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "/opt/stack/data/nova/instances/4190e244-84b1-47b6-813d-9cadb7c65975/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:10:31 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-14a0d391-29f5-4dcf-8400-67fd399d7e1f tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:10:31 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-14a0d391-29f5-4dcf-8400-67fd399d7e1f tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json" returned: 0 in 0.153s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:10:31 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-14a0d391-29f5-4dcf-8400-67fd399d7e1f tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Acquiring lock "b88df1b37cb431f52bc53b5616015c89b5bec411" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:10:31 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-14a0d391-29f5-4dcf-8400-67fd399d7e1f tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "b88df1b37cb431f52bc53b5616015c89b5bec411" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:10:31 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-14a0d391-29f5-4dcf-8400-67fd399d7e1f tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:10:31 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-14a0d391-29f5-4dcf-8400-67fd399d7e1f tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json" returned: 0 in 0.161s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:10:31 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-14a0d391-29f5-4dcf-8400-67fd399d7e1f tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411,backing_fmt=raw /opt/stack/data/nova/instances/4190e244-84b1-47b6-813d-9cadb7c65975/disk 1073741824 {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:10:31 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-14a0d391-29f5-4dcf-8400-67fd399d7e1f tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411,backing_fmt=raw /opt/stack/data/nova/instances/4190e244-84b1-47b6-813d-9cadb7c65975/disk 1073741824" returned: 0 in 0.158s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:10:31 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-14a0d391-29f5-4dcf-8400-67fd399d7e1f tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "b88df1b37cb431f52bc53b5616015c89b5bec411" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.329s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:10:31 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-14a0d391-29f5-4dcf-8400-67fd399d7e1f tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:10:31 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-14a0d391-29f5-4dcf-8400-67fd399d7e1f tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json" returned: 0 in 0.147s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:10:31 user nova-compute[71874]: DEBUG nova.virt.disk.api [None req-14a0d391-29f5-4dcf-8400-67fd399d7e1f tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4190e244-84b1-47b6-813d-9cadb7c65975/disk. size=1073741824 {{(pid=71874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 16:10:31 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-14a0d391-29f5-4dcf-8400-67fd399d7e1f tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4190e244-84b1-47b6-813d-9cadb7c65975/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:10:32 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-14a0d391-29f5-4dcf-8400-67fd399d7e1f tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4190e244-84b1-47b6-813d-9cadb7c65975/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:10:32 user nova-compute[71874]: DEBUG nova.virt.disk.api [None req-14a0d391-29f5-4dcf-8400-67fd399d7e1f tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Cannot resize image /opt/stack/data/nova/instances/4190e244-84b1-47b6-813d-9cadb7c65975/disk to a smaller size. {{(pid=71874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 16:10:32 user nova-compute[71874]: DEBUG nova.objects.instance [None req-14a0d391-29f5-4dcf-8400-67fd399d7e1f tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lazy-loading 'migration_context' on Instance uuid 4190e244-84b1-47b6-813d-9cadb7c65975 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:10:32 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-14a0d391-29f5-4dcf-8400-67fd399d7e1f tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Created local disks {{(pid=71874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 16:10:32 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-14a0d391-29f5-4dcf-8400-67fd399d7e1f tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Ensure instance console log exists: /opt/stack/data/nova/instances/4190e244-84b1-47b6-813d-9cadb7c65975/console.log {{(pid=71874) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 16:10:32 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-14a0d391-29f5-4dcf-8400-67fd399d7e1f tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:10:32 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-14a0d391-29f5-4dcf-8400-67fd399d7e1f tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:10:32 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-14a0d391-29f5-4dcf-8400-67fd399d7e1f tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:10:32 user nova-compute[71874]: DEBUG nova.network.neutron [None req-14a0d391-29f5-4dcf-8400-67fd399d7e1f tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Successfully created port: eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c {{(pid=71874) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 16:10:32 user nova-compute[71874]: DEBUG nova.compute.manager [req-30bb45e3-aee3-4458-9843-b6bfc5f7c7d8 req-e1d55deb-6bd2-41be-b1b3-c43b5d13cd46 service nova] [instance: 84683344-2893-4446-90ae-e64cd799eb20] Received event network-changed-a8837af3-03f7-4b3d-8a2a-746f2d8038ad {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:10:32 user nova-compute[71874]: DEBUG nova.compute.manager [req-30bb45e3-aee3-4458-9843-b6bfc5f7c7d8 req-e1d55deb-6bd2-41be-b1b3-c43b5d13cd46 service nova] [instance: 84683344-2893-4446-90ae-e64cd799eb20] Refreshing instance network info cache due to event network-changed-a8837af3-03f7-4b3d-8a2a-746f2d8038ad. {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 16:10:32 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-30bb45e3-aee3-4458-9843-b6bfc5f7c7d8 req-e1d55deb-6bd2-41be-b1b3-c43b5d13cd46 service nova] Acquiring lock "refresh_cache-84683344-2893-4446-90ae-e64cd799eb20" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:10:32 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-30bb45e3-aee3-4458-9843-b6bfc5f7c7d8 req-e1d55deb-6bd2-41be-b1b3-c43b5d13cd46 service nova] Acquired lock "refresh_cache-84683344-2893-4446-90ae-e64cd799eb20" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:10:32 user nova-compute[71874]: DEBUG nova.network.neutron [req-30bb45e3-aee3-4458-9843-b6bfc5f7c7d8 req-e1d55deb-6bd2-41be-b1b3-c43b5d13cd46 service nova] [instance: 84683344-2893-4446-90ae-e64cd799eb20] Refreshing network info cache for port a8837af3-03f7-4b3d-8a2a-746f2d8038ad {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 16:10:33 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:10:33 user nova-compute[71874]: DEBUG nova.network.neutron [req-30bb45e3-aee3-4458-9843-b6bfc5f7c7d8 req-e1d55deb-6bd2-41be-b1b3-c43b5d13cd46 service nova] [instance: 84683344-2893-4446-90ae-e64cd799eb20] Updated VIF entry in instance network info cache for port a8837af3-03f7-4b3d-8a2a-746f2d8038ad. {{(pid=71874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 16:10:33 user nova-compute[71874]: DEBUG nova.network.neutron [req-30bb45e3-aee3-4458-9843-b6bfc5f7c7d8 req-e1d55deb-6bd2-41be-b1b3-c43b5d13cd46 service nova] [instance: 84683344-2893-4446-90ae-e64cd799eb20] Updating instance_info_cache with network_info: [{"id": "a8837af3-03f7-4b3d-8a2a-746f2d8038ad", "address": "fa:16:3e:71:77:df", "network": {"id": "58f92787-e3b6-4fd3-bd75-7169f1a36651", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-614349033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "236b9e609eb44071bc88971bff96931e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8837af3-03", "ovs_interfaceid": "a8837af3-03f7-4b3d-8a2a-746f2d8038ad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:10:33 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-30bb45e3-aee3-4458-9843-b6bfc5f7c7d8 req-e1d55deb-6bd2-41be-b1b3-c43b5d13cd46 service nova] Releasing lock "refresh_cache-84683344-2893-4446-90ae-e64cd799eb20" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:10:33 user nova-compute[71874]: DEBUG nova.network.neutron [None req-14a0d391-29f5-4dcf-8400-67fd399d7e1f tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Successfully updated port: eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c {{(pid=71874) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 16:10:33 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-14a0d391-29f5-4dcf-8400-67fd399d7e1f tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Acquiring lock "refresh_cache-4190e244-84b1-47b6-813d-9cadb7c65975" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:10:33 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-14a0d391-29f5-4dcf-8400-67fd399d7e1f tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Acquired lock "refresh_cache-4190e244-84b1-47b6-813d-9cadb7c65975" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:10:33 user nova-compute[71874]: DEBUG nova.network.neutron [None req-14a0d391-29f5-4dcf-8400-67fd399d7e1f tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Building network info cache for instance {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 16:10:33 user nova-compute[71874]: DEBUG nova.network.neutron [None req-14a0d391-29f5-4dcf-8400-67fd399d7e1f tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Instance cache missing network info. {{(pid=71874) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 16:10:33 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:10:33 user nova-compute[71874]: DEBUG nova.network.neutron [None req-14a0d391-29f5-4dcf-8400-67fd399d7e1f tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Updating instance_info_cache with network_info: [{"id": "eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c", "address": "fa:16:3e:d0:b5:d4", "network": {"id": "1ef428ff-90e5-4abd-93d0-b7c2c581cb26", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-425924095-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf4334df004490ba51b4d92ce5408ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeab1ea0c-8a", "ovs_interfaceid": "eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:10:33 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-14a0d391-29f5-4dcf-8400-67fd399d7e1f tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Releasing lock "refresh_cache-4190e244-84b1-47b6-813d-9cadb7c65975" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:10:33 user nova-compute[71874]: DEBUG nova.compute.manager [None req-14a0d391-29f5-4dcf-8400-67fd399d7e1f tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Instance network_info: |[{"id": "eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c", "address": "fa:16:3e:d0:b5:d4", "network": {"id": "1ef428ff-90e5-4abd-93d0-b7c2c581cb26", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-425924095-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf4334df004490ba51b4d92ce5408ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeab1ea0c-8a", "ovs_interfaceid": "eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 16:10:33 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-14a0d391-29f5-4dcf-8400-67fd399d7e1f tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Start _get_guest_xml network_info=[{"id": "eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c", "address": "fa:16:3e:d0:b5:d4", "network": {"id": "1ef428ff-90e5-4abd-93d0-b7c2c581cb26", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-425924095-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf4334df004490ba51b4d92ce5408ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeab1ea0c-8a", "ovs_interfaceid": "eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T15:55:37Z,direct_url=<?>,disk_format='qcow2',id=9dc63f14-8b70-4e72-89f2-13464f2f5c7c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='61a4936d9b7744c0b488d81c9b7746b6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T15:55:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_options': None, 'image_id': '9dc63f14-8b70-4e72-89f2-13464f2f5c7c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 16:10:33 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-14a0d391-29f5-4dcf-8400-67fd399d7e1f tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:10:33 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-14a0d391-29f5-4dcf-8400-67fd399d7e1f tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:10:33 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-14a0d391-29f5-4dcf-8400-67fd399d7e1f tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71874) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 16:10:33 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-14a0d391-29f5-4dcf-8400-67fd399d7e1f tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T15:56:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T15:55:37Z,direct_url=<?>,disk_format='qcow2',id=9dc63f14-8b70-4e72-89f2-13464f2f5c7c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='61a4936d9b7744c0b488d81c9b7746b6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T15:55:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 16:10:33 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-14a0d391-29f5-4dcf-8400-67fd399d7e1f tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Flavor limits 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 16:10:33 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-14a0d391-29f5-4dcf-8400-67fd399d7e1f tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Image limits 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 16:10:33 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-14a0d391-29f5-4dcf-8400-67fd399d7e1f tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Flavor pref 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 16:10:33 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-14a0d391-29f5-4dcf-8400-67fd399d7e1f tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Image pref 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 16:10:33 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-14a0d391-29f5-4dcf-8400-67fd399d7e1f tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 16:10:33 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-14a0d391-29f5-4dcf-8400-67fd399d7e1f tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 16:10:33 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-14a0d391-29f5-4dcf-8400-67fd399d7e1f tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 16:10:33 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-14a0d391-29f5-4dcf-8400-67fd399d7e1f tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Got 1 possible topologies {{(pid=71874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 16:10:33 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-14a0d391-29f5-4dcf-8400-67fd399d7e1f tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 16:10:33 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-14a0d391-29f5-4dcf-8400-67fd399d7e1f tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 16:10:33 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-14a0d391-29f5-4dcf-8400-67fd399d7e1f tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T16:10:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1671411109',display_name='tempest-AttachVolumeTestJSON-server-1671411109',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1671411109',id=30,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFG81tsYAjuSLmCBJX5Oy53u6RydBq93WUwqVYUMtou9Wro9aHLYlkjtVGeLCCkr0S7Y24E90tPBrxAk1jNQ+AbkSKQBVRm7+VgL4Rx9C6hm1o9gCqXWuOVCyPnDpz3Eig==',key_name='tempest-keypair-1295229303',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7cf4334df004490ba51b4d92ce5408ae',ramdisk_id='',reservation_id='r-sfgohvil',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-178648074',owner_user_name='tempest-AttachVolumeTestJSON-178648074-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T16:10:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2996f6997bb14fc3aec9c3736cc65b8a',uuid=4190e244-84b1-47b6-813d-9cadb7c65975,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c", "address": "fa:16:3e:d0:b5:d4", "network": {"id": "1ef428ff-90e5-4abd-93d0-b7c2c581cb26", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-425924095-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf4334df004490ba51b4d92ce5408ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeab1ea0c-8a", "ovs_interfaceid": "eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 16:10:33 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-14a0d391-29f5-4dcf-8400-67fd399d7e1f tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Converting VIF {"id": "eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c", "address": "fa:16:3e:d0:b5:d4", "network": {"id": "1ef428ff-90e5-4abd-93d0-b7c2c581cb26", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-425924095-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf4334df004490ba51b4d92ce5408ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeab1ea0c-8a", "ovs_interfaceid": "eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:10:33 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-14a0d391-29f5-4dcf-8400-67fd399d7e1f tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:b5:d4,bridge_name='br-int',has_traffic_filtering=True,id=eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c,network=Network(1ef428ff-90e5-4abd-93d0-b7c2c581cb26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeab1ea0c-8a') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:10:33 user nova-compute[71874]: DEBUG nova.objects.instance [None req-14a0d391-29f5-4dcf-8400-67fd399d7e1f tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lazy-loading 'pci_devices' on Instance uuid 4190e244-84b1-47b6-813d-9cadb7c65975 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:10:33 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-14a0d391-29f5-4dcf-8400-67fd399d7e1f tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] End _get_guest_xml xml=<domain type="kvm">
Apr 12 16:10:33 user nova-compute[71874]:   <uuid>4190e244-84b1-47b6-813d-9cadb7c65975</uuid>
Apr 12 16:10:33 user nova-compute[71874]:   <name>instance-0000001e</name>
Apr 12 16:10:33 user nova-compute[71874]:   <memory>131072</memory>
Apr 12 16:10:33 user nova-compute[71874]:   <vcpu>1</vcpu>
Apr 12 16:10:33 user nova-compute[71874]:   <metadata>
Apr 12 16:10:33 user nova-compute[71874]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 16:10:33 user nova-compute[71874]:       <nova:package version="0.0.0"/>
Apr 12 16:10:33 user nova-compute[71874]:       <nova:name>tempest-AttachVolumeTestJSON-server-1671411109</nova:name>
Apr 12 16:10:33 user nova-compute[71874]:       <nova:creationTime>2023-04-12 16:10:33</nova:creationTime>
Apr 12 16:10:33 user nova-compute[71874]:       <nova:flavor name="m1.nano">
Apr 12 16:10:33 user nova-compute[71874]:         <nova:memory>128</nova:memory>
Apr 12 16:10:33 user nova-compute[71874]:         <nova:disk>1</nova:disk>
Apr 12 16:10:33 user nova-compute[71874]:         <nova:swap>0</nova:swap>
Apr 12 16:10:33 user nova-compute[71874]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 16:10:33 user nova-compute[71874]:         <nova:vcpus>1</nova:vcpus>
Apr 12 16:10:33 user nova-compute[71874]:       </nova:flavor>
Apr 12 16:10:33 user nova-compute[71874]:       <nova:owner>
Apr 12 16:10:33 user nova-compute[71874]:         <nova:user uuid="2996f6997bb14fc3aec9c3736cc65b8a">tempest-AttachVolumeTestJSON-178648074-project-member</nova:user>
Apr 12 16:10:33 user nova-compute[71874]:         <nova:project uuid="7cf4334df004490ba51b4d92ce5408ae">tempest-AttachVolumeTestJSON-178648074</nova:project>
Apr 12 16:10:33 user nova-compute[71874]:       </nova:owner>
Apr 12 16:10:33 user nova-compute[71874]:       <nova:root type="image" uuid="9dc63f14-8b70-4e72-89f2-13464f2f5c7c"/>
Apr 12 16:10:33 user nova-compute[71874]:       <nova:ports>
Apr 12 16:10:33 user nova-compute[71874]:         <nova:port uuid="eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c">
Apr 12 16:10:33 user nova-compute[71874]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 12 16:10:33 user nova-compute[71874]:         </nova:port>
Apr 12 16:10:33 user nova-compute[71874]:       </nova:ports>
Apr 12 16:10:33 user nova-compute[71874]:     </nova:instance>
Apr 12 16:10:33 user nova-compute[71874]:   </metadata>
Apr 12 16:10:33 user nova-compute[71874]:   <sysinfo type="smbios">
Apr 12 16:10:33 user nova-compute[71874]:     <system>
Apr 12 16:10:33 user nova-compute[71874]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 16:10:33 user nova-compute[71874]:       <entry name="product">OpenStack Nova</entry>
Apr 12 16:10:33 user nova-compute[71874]:       <entry name="version">0.0.0</entry>
Apr 12 16:10:33 user nova-compute[71874]:       <entry name="serial">4190e244-84b1-47b6-813d-9cadb7c65975</entry>
Apr 12 16:10:33 user nova-compute[71874]:       <entry name="uuid">4190e244-84b1-47b6-813d-9cadb7c65975</entry>
Apr 12 16:10:33 user nova-compute[71874]:       <entry name="family">Virtual Machine</entry>
Apr 12 16:10:33 user nova-compute[71874]:     </system>
Apr 12 16:10:33 user nova-compute[71874]:   </sysinfo>
Apr 12 16:10:33 user nova-compute[71874]:   <os>
Apr 12 16:10:33 user nova-compute[71874]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 16:10:33 user nova-compute[71874]:     <boot dev="hd"/>
Apr 12 16:10:33 user nova-compute[71874]:     <smbios mode="sysinfo"/>
Apr 12 16:10:33 user nova-compute[71874]:   </os>
Apr 12 16:10:33 user nova-compute[71874]:   <features>
Apr 12 16:10:33 user nova-compute[71874]:     <acpi/>
Apr 12 16:10:33 user nova-compute[71874]:     <apic/>
Apr 12 16:10:33 user nova-compute[71874]:     <vmcoreinfo/>
Apr 12 16:10:33 user nova-compute[71874]:   </features>
Apr 12 16:10:33 user nova-compute[71874]:   <clock offset="utc">
Apr 12 16:10:33 user nova-compute[71874]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 16:10:33 user nova-compute[71874]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 16:10:33 user nova-compute[71874]:     <timer name="hpet" present="no"/>
Apr 12 16:10:33 user nova-compute[71874]:   </clock>
Apr 12 16:10:33 user nova-compute[71874]:   <cpu mode="custom" match="exact">
Apr 12 16:10:33 user nova-compute[71874]:     <model>Nehalem</model>
Apr 12 16:10:33 user nova-compute[71874]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 16:10:33 user nova-compute[71874]:   </cpu>
Apr 12 16:10:33 user nova-compute[71874]:   <devices>
Apr 12 16:10:33 user nova-compute[71874]:     <disk type="file" device="disk">
Apr 12 16:10:33 user nova-compute[71874]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 16:10:33 user nova-compute[71874]:       <source file="/opt/stack/data/nova/instances/4190e244-84b1-47b6-813d-9cadb7c65975/disk"/>
Apr 12 16:10:33 user nova-compute[71874]:       <target dev="vda" bus="virtio"/>
Apr 12 16:10:33 user nova-compute[71874]:     </disk>
Apr 12 16:10:33 user nova-compute[71874]:     <interface type="ethernet">
Apr 12 16:10:33 user nova-compute[71874]:       <mac address="fa:16:3e:d0:b5:d4"/>
Apr 12 16:10:33 user nova-compute[71874]:       <model type="virtio"/>
Apr 12 16:10:33 user nova-compute[71874]:       <mtu size="1442"/>
Apr 12 16:10:33 user nova-compute[71874]:       <target dev="tapeab1ea0c-8a"/>
Apr 12 16:10:33 user nova-compute[71874]:     </interface>
Apr 12 16:10:33 user nova-compute[71874]:     <serial type="pty">
Apr 12 16:10:33 user nova-compute[71874]:       <log file="/opt/stack/data/nova/instances/4190e244-84b1-47b6-813d-9cadb7c65975/console.log" append="off"/>
Apr 12 16:10:33 user nova-compute[71874]:     </serial>
Apr 12 16:10:33 user nova-compute[71874]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 16:10:33 user nova-compute[71874]:     <video>
Apr 12 16:10:33 user nova-compute[71874]:       <model type="virtio"/>
Apr 12 16:10:33 user nova-compute[71874]:     </video>
Apr 12 16:10:33 user nova-compute[71874]:     <rng model="virtio">
Apr 12 16:10:33 user nova-compute[71874]:       <backend model="random">/dev/urandom</backend>
Apr 12 16:10:33 user nova-compute[71874]:     </rng>
Apr 12 16:10:33 user nova-compute[71874]:     <controller type="usb" index="0" model="none"/>
Apr 12 16:10:33 user nova-compute[71874]:     <memballoon model="virtio">
Apr 12 16:10:33 user nova-compute[71874]:       <stats period="10"/>
Apr 12 16:10:33 user nova-compute[71874]:     </memballoon>
Apr 12 16:10:33 user nova-compute[71874]:   </devices>
Apr 12 16:10:33 user nova-compute[71874]: </domain>
Apr 12 16:10:33 user nova-compute[71874]:  {{(pid=71874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 16:10:33 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-14a0d391-29f5-4dcf-8400-67fd399d7e1f tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T16:10:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1671411109',display_name='tempest-AttachVolumeTestJSON-server-1671411109',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1671411109',id=30,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFG81tsYAjuSLmCBJX5Oy53u6RydBq93WUwqVYUMtou9Wro9aHLYlkjtVGeLCCkr0S7Y24E90tPBrxAk1jNQ+AbkSKQBVRm7+VgL4Rx9C6hm1o9gCqXWuOVCyPnDpz3Eig==',key_name='tempest-keypair-1295229303',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7cf4334df004490ba51b4d92ce5408ae',ramdisk_id='',reservation_id='r-sfgohvil',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-178648074',owner_user_name='tempest-AttachVolumeTestJSON-178648074-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T16:10:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2996f6997bb14fc3aec9c3736cc65b8a',uuid=4190e244-84b1-47b6-813d-9cadb7c65975,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c", "address": "fa:16:3e:d0:b5:d4", "network": {"id": "1ef428ff-90e5-4abd-93d0-b7c2c581cb26", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-425924095-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf4334df004490ba51b4d92ce5408ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeab1ea0c-8a", "ovs_interfaceid": "eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 16:10:33 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-14a0d391-29f5-4dcf-8400-67fd399d7e1f tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Converting VIF {"id": "eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c", "address": "fa:16:3e:d0:b5:d4", "network": {"id": "1ef428ff-90e5-4abd-93d0-b7c2c581cb26", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-425924095-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf4334df004490ba51b4d92ce5408ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeab1ea0c-8a", "ovs_interfaceid": "eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:10:33 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-14a0d391-29f5-4dcf-8400-67fd399d7e1f tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:b5:d4,bridge_name='br-int',has_traffic_filtering=True,id=eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c,network=Network(1ef428ff-90e5-4abd-93d0-b7c2c581cb26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeab1ea0c-8a') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:10:33 user nova-compute[71874]: DEBUG os_vif [None req-14a0d391-29f5-4dcf-8400-67fd399d7e1f tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:b5:d4,bridge_name='br-int',has_traffic_filtering=True,id=eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c,network=Network(1ef428ff-90e5-4abd-93d0-b7c2c581cb26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeab1ea0c-8a') {{(pid=71874) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 16:10:33 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:10:33 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:10:33 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 16:10:33 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:10:33 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeab1ea0c-8a, may_exist=True) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:10:33 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapeab1ea0c-8a, col_values=(('external_ids', {'iface-id': 'eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d0:b5:d4', 'vm-uuid': '4190e244-84b1-47b6-813d-9cadb7c65975'}),)) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:10:33 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:10:33 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:10:33 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:10:33 user nova-compute[71874]: INFO os_vif [None req-14a0d391-29f5-4dcf-8400-67fd399d7e1f tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:b5:d4,bridge_name='br-int',has_traffic_filtering=True,id=eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c,network=Network(1ef428ff-90e5-4abd-93d0-b7c2c581cb26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeab1ea0c-8a')
Apr 12 16:10:33 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-14a0d391-29f5-4dcf-8400-67fd399d7e1f tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] No BDM found with device name vda, not building metadata. {{(pid=71874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 16:10:33 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-14a0d391-29f5-4dcf-8400-67fd399d7e1f tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] No VIF found with MAC fa:16:3e:d0:b5:d4, not building metadata {{(pid=71874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 16:10:34 user nova-compute[71874]: DEBUG nova.compute.manager [req-f13c9384-5e32-4414-885d-fd45587668be req-36e6d991-6df6-4372-80a0-4ecb8849afa7 service nova] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Received event network-changed-eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:10:34 user nova-compute[71874]: DEBUG nova.compute.manager [req-f13c9384-5e32-4414-885d-fd45587668be req-36e6d991-6df6-4372-80a0-4ecb8849afa7 service nova] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Refreshing instance network info cache due to event network-changed-eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c. {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 16:10:34 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-f13c9384-5e32-4414-885d-fd45587668be req-36e6d991-6df6-4372-80a0-4ecb8849afa7 service nova] Acquiring lock "refresh_cache-4190e244-84b1-47b6-813d-9cadb7c65975" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:10:34 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-f13c9384-5e32-4414-885d-fd45587668be req-36e6d991-6df6-4372-80a0-4ecb8849afa7 service nova] Acquired lock "refresh_cache-4190e244-84b1-47b6-813d-9cadb7c65975" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:10:34 user nova-compute[71874]: DEBUG nova.network.neutron [req-f13c9384-5e32-4414-885d-fd45587668be req-36e6d991-6df6-4372-80a0-4ecb8849afa7 service nova] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Refreshing network info cache for port eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 16:10:35 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:10:35 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:10:35 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:10:35 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:10:35 user nova-compute[71874]: DEBUG nova.network.neutron [req-f13c9384-5e32-4414-885d-fd45587668be req-36e6d991-6df6-4372-80a0-4ecb8849afa7 service nova] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Updated VIF entry in instance network info cache for port eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c. {{(pid=71874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 16:10:35 user nova-compute[71874]: DEBUG nova.network.neutron [req-f13c9384-5e32-4414-885d-fd45587668be req-36e6d991-6df6-4372-80a0-4ecb8849afa7 service nova] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Updating instance_info_cache with network_info: [{"id": "eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c", "address": "fa:16:3e:d0:b5:d4", "network": {"id": "1ef428ff-90e5-4abd-93d0-b7c2c581cb26", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-425924095-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf4334df004490ba51b4d92ce5408ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeab1ea0c-8a", "ovs_interfaceid": "eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:10:35 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-f13c9384-5e32-4414-885d-fd45587668be req-36e6d991-6df6-4372-80a0-4ecb8849afa7 service nova] Releasing lock "refresh_cache-4190e244-84b1-47b6-813d-9cadb7c65975" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:10:35 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-312b101d-47ea-4dd8-ab0c-ce03e37780bf tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Acquiring lock "84683344-2893-4446-90ae-e64cd799eb20" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:10:35 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-312b101d-47ea-4dd8-ab0c-ce03e37780bf tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "84683344-2893-4446-90ae-e64cd799eb20" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:10:35 user nova-compute[71874]: INFO nova.compute.manager [None req-312b101d-47ea-4dd8-ab0c-ce03e37780bf tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: 84683344-2893-4446-90ae-e64cd799eb20] Rebooting instance
Apr 12 16:10:35 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-312b101d-47ea-4dd8-ab0c-ce03e37780bf tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Acquiring lock "refresh_cache-84683344-2893-4446-90ae-e64cd799eb20" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:10:35 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-312b101d-47ea-4dd8-ab0c-ce03e37780bf tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Acquired lock "refresh_cache-84683344-2893-4446-90ae-e64cd799eb20" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:10:35 user nova-compute[71874]: DEBUG nova.network.neutron [None req-312b101d-47ea-4dd8-ab0c-ce03e37780bf tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: 84683344-2893-4446-90ae-e64cd799eb20] Building network info cache for instance {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 16:10:35 user nova-compute[71874]: DEBUG nova.compute.manager [req-e20573b6-cfcd-48a7-a125-38859805dffc req-9bd3d1fb-8b68-4e98-85d5-35defeb2fbad service nova] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Received event network-vif-plugged-eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:10:35 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-e20573b6-cfcd-48a7-a125-38859805dffc req-9bd3d1fb-8b68-4e98-85d5-35defeb2fbad service nova] Acquiring lock "4190e244-84b1-47b6-813d-9cadb7c65975-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:10:35 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-e20573b6-cfcd-48a7-a125-38859805dffc req-9bd3d1fb-8b68-4e98-85d5-35defeb2fbad service nova] Lock "4190e244-84b1-47b6-813d-9cadb7c65975-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:10:35 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-e20573b6-cfcd-48a7-a125-38859805dffc req-9bd3d1fb-8b68-4e98-85d5-35defeb2fbad service nova] Lock "4190e244-84b1-47b6-813d-9cadb7c65975-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:10:35 user nova-compute[71874]: DEBUG nova.compute.manager [req-e20573b6-cfcd-48a7-a125-38859805dffc req-9bd3d1fb-8b68-4e98-85d5-35defeb2fbad service nova] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] No waiting events found dispatching network-vif-plugged-eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:10:35 user nova-compute[71874]: WARNING nova.compute.manager [req-e20573b6-cfcd-48a7-a125-38859805dffc req-9bd3d1fb-8b68-4e98-85d5-35defeb2fbad service nova] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Received unexpected event network-vif-plugged-eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c for instance with vm_state building and task_state spawning.
Apr 12 16:10:35 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:10:35 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:10:35 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:10:35 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:10:35 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:10:35 user nova-compute[71874]: DEBUG nova.network.neutron [None req-312b101d-47ea-4dd8-ab0c-ce03e37780bf tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: 84683344-2893-4446-90ae-e64cd799eb20] Updating instance_info_cache with network_info: [{"id": "a8837af3-03f7-4b3d-8a2a-746f2d8038ad", "address": "fa:16:3e:71:77:df", "network": {"id": "58f92787-e3b6-4fd3-bd75-7169f1a36651", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-614349033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "236b9e609eb44071bc88971bff96931e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8837af3-03", "ovs_interfaceid": "a8837af3-03f7-4b3d-8a2a-746f2d8038ad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:10:36 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-312b101d-47ea-4dd8-ab0c-ce03e37780bf tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Releasing lock "refresh_cache-84683344-2893-4446-90ae-e64cd799eb20" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:10:36 user nova-compute[71874]: DEBUG nova.compute.manager [None req-312b101d-47ea-4dd8-ab0c-ce03e37780bf tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: 84683344-2893-4446-90ae-e64cd799eb20] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:10:36 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:10:36 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:10:36 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:10:36 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:10:36 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:10:36 user nova-compute[71874]: INFO nova.virt.libvirt.driver [-] [instance: 84683344-2893-4446-90ae-e64cd799eb20] Instance destroyed successfully.
Apr 12 16:10:36 user nova-compute[71874]: DEBUG nova.objects.instance [None req-312b101d-47ea-4dd8-ab0c-ce03e37780bf tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lazy-loading 'resources' on Instance uuid 84683344-2893-4446-90ae-e64cd799eb20 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:10:36 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-312b101d-47ea-4dd8-ab0c-ce03e37780bf tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T16:08:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-305874148',display_name='tempest-TestMinimumBasicScenario-server-305874148',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-305874148',id=27,image_ref='ca200f21-67f7-4581-9bfc-75465abff368',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP7vpIGcBykOJPr4ws0YtRwaxvjbKaTb5FQPV2F4kO1x9IPpUHiVmLwjEQx1FAApeD4swefMBOlg2jRi0dXdP+/5EMUIcDTR0iUGAbkMPwCdxqyQhFvFmsSM0dq+TS03mg==',key_name='tempest-TestMinimumBasicScenario-1145355827',keypairs=<?>,launch_index=0,launched_at=2023-04-12T16:08:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='236b9e609eb44071bc88971bff96931e',ramdisk_id='',reservation_id='r-i04av21o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca200f21-67f7-4581-9bfc-75465abff368',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1374695003',owner_user_name='tempest-TestMinimumBasicScenario-1374695003-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T16:10:36Z,user_data=None,user_id='16a68fa3490940ebaebc8d4ca5746f6e',uuid=84683344-2893-4446-90ae-e64cd799eb20,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a8837af3-03f7-4b3d-8a2a-746f2d8038ad", "address": "fa:16:3e:71:77:df", "network": {"id": "58f92787-e3b6-4fd3-bd75-7169f1a36651", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-614349033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "236b9e609eb44071bc88971bff96931e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8837af3-03", "ovs_interfaceid": "a8837af3-03f7-4b3d-8a2a-746f2d8038ad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 16:10:36 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-312b101d-47ea-4dd8-ab0c-ce03e37780bf tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Converting VIF {"id": "a8837af3-03f7-4b3d-8a2a-746f2d8038ad", "address": "fa:16:3e:71:77:df", "network": {"id": "58f92787-e3b6-4fd3-bd75-7169f1a36651", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-614349033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "236b9e609eb44071bc88971bff96931e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8837af3-03", "ovs_interfaceid": "a8837af3-03f7-4b3d-8a2a-746f2d8038ad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:10:36 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-312b101d-47ea-4dd8-ab0c-ce03e37780bf tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:71:77:df,bridge_name='br-int',has_traffic_filtering=True,id=a8837af3-03f7-4b3d-8a2a-746f2d8038ad,network=Network(58f92787-e3b6-4fd3-bd75-7169f1a36651),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8837af3-03') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:10:36 user nova-compute[71874]: DEBUG os_vif [None req-312b101d-47ea-4dd8-ab0c-ce03e37780bf tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:71:77:df,bridge_name='br-int',has_traffic_filtering=True,id=a8837af3-03f7-4b3d-8a2a-746f2d8038ad,network=Network(58f92787-e3b6-4fd3-bd75-7169f1a36651),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8837af3-03') {{(pid=71874) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 16:10:36 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:10:36 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa8837af3-03, bridge=br-int, if_exists=True) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:10:36 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:10:36 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:10:36 user nova-compute[71874]: INFO os_vif [None req-312b101d-47ea-4dd8-ab0c-ce03e37780bf tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:71:77:df,bridge_name='br-int',has_traffic_filtering=True,id=a8837af3-03f7-4b3d-8a2a-746f2d8038ad,network=Network(58f92787-e3b6-4fd3-bd75-7169f1a36651),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8837af3-03')
Apr 12 16:10:36 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-312b101d-47ea-4dd8-ab0c-ce03e37780bf tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: 84683344-2893-4446-90ae-e64cd799eb20] calling os-brick to detach iSCSI Volume {{(pid=71874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 16:10:36 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-312b101d-47ea-4dd8-ab0c-ce03e37780bf tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3c0216320>, {'target_iqn': 'iqn.2010-10.org.openstack:9c961fcc-0ff0-4275-9163-406662b265f8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EHUDIolh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:10:36 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-312b101d-47ea-4dd8-ab0c-ce03e37780bf tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:10:36 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-312b101d-47ea-4dd8-ab0c-ce03e37780bf tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:10:36 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-312b101d-47ea-4dd8-ab0c-ce03e37780bf tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:10:37 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:10:37 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:10:37 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[742692e0-48f3-4770-a364-b66448e145b4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1f27a002-8dfc-4d90-aa35-ba16586d4366\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9c961fcc-0ff0-4275-9163-406662b265f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:10:37 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-312b101d-47ea-4dd8-ab0c-ce03e37780bf tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 16:10:37 user nova-compute[71874]: No targets found.
Apr 12 16:10:37 user nova-compute[71874]: iSNS:
Apr 12 16:10:37 user nova-compute[71874]: No targets found.
Apr 12 16:10:37 user nova-compute[71874]: STATIC:
Apr 12 16:10:37 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:1f27a002-8dfc-4d90-aa35-ba16586d4366
Apr 12 16:10:37 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:10:37 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:10:37 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:9c961fcc-0ff0-4275-9163-406662b265f8
Apr 12 16:10:37 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:10:37 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:10:37 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297
Apr 12 16:10:37 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:10:37 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:10:37 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2
Apr 12 16:10:37 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:10:37 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:10:37 user nova-compute[71874]: FIRMWARE:
Apr 12 16:10:37 user nova-compute[71874]: No targets found.
Apr 12 16:10:37 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:10:37 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-312b101d-47ea-4dd8-ab0c-ce03e37780bf tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 16:10:37 user nova-compute[71874]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 16:10:37 user nova-compute[71874]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71874) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 16:10:37 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-312b101d-47ea-4dd8-ab0c-ce03e37780bf tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9c961fcc-0ff0-4275-9163-406662b265f8', 0)] {{(pid=71874) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 16:10:37 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:10:37 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:10:37 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[a03fca55-19f2-40d8-bb21-e1215b21905a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1f27a002-8dfc-4d90-aa35-ba16586d4366\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c961fcc-0ff0-4275-9163-406662b265f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:10:37 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:10:37 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:10:37 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[0948d905-8c1c-47cc-b3ab-83dd9a49a680]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f27a002-8dfc-4d90-aa35-ba16586d4366 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c961fcc-0ff0-4275-9163-406662b265f8 (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:10:37 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-312b101d-47ea-4dd8-ab0c-ce03e37780bf tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:10:37 user nova-compute[71874]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f27a002-8dfc-4d90-aa35-ba16586d4366 (non-flash)
Apr 12 16:10:37 user nova-compute[71874]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 (non-flash)
Apr 12 16:10:37 user nova-compute[71874]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c961fcc-0ff0-4275-9163-406662b265f8 (non-flash)
Apr 12 16:10:37 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:10:37 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-312b101d-47ea-4dd8-ab0c-ce03e37780bf tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:10:37 user nova-compute[71874]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f27a002-8dfc-4d90-aa35-ba16586d4366 (non-flash)
Apr 12 16:10:37 user nova-compute[71874]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 (non-flash)
Apr 12 16:10:37 user nova-compute[71874]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c961fcc-0ff0-4275-9163-406662b265f8 (non-flash)
Apr 12 16:10:37 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:10:37 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-312b101d-47ea-4dd8-ab0c-ce03e37780bf tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc39c2a0700>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9c961fcc-0ff0-4275-9163-406662b265f8'): ({'sdd'}, set())}) {{(pid=71874) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 16:10:37 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-312b101d-47ea-4dd8-ab0c-ce03e37780bf tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Removing single pathed devices sdd {{(pid=71874) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 16:10:37 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:10:37 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:10:37 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c5e25c9-90bc-4095-8be7-fd3d4dfaa627]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:10:37 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:10:37 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:10:37 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[06e7bd05-d984-432b-bb85-b1e2c3919552]: (4, ('ok\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:10:37 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-312b101d-47ea-4dd8-ab0c-ce03e37780bf tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Flushing IO for device /dev/sdd {{(pid=71874) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 16:10:37 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:10:37 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:10:37 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[183c29d0-1854-4d14-9d37-e54e5ffa6c7c]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:10:37 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-312b101d-47ea-4dd8-ab0c-ce03e37780bf tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71874) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 16:10:37 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:10:37 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.041s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:10:37 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[31a9bde9-b202-4111-9bda-d67a0422406d]: (4, ('1', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:10:37 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-312b101d-47ea-4dd8-ab0c-ce03e37780bf tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71874) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 16:10:37 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-312b101d-47ea-4dd8-ab0c-ce03e37780bf tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] SCSI volumes sdd have been removed. {{(pid=71874) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 16:10:37 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-312b101d-47ea-4dd8-ab0c-ce03e37780bf tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9c961fcc-0ff0-4275-9163-406662b265f8')] {{(pid=71874) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 16:10:37 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c961fcc-0ff0-4275-9163-406662b265f8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:10:37 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c961fcc-0ff0-4275-9163-406662b265f8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:10:37 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[09eb042e-4fa4-4f2a-9b12-87087d2716bf]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:10:37 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-312b101d-47ea-4dd8-ab0c-ce03e37780bf tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:10:37 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c961fcc-0ff0-4275-9163-406662b265f8 -p 172.16.0.220:3260 --logout {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:10:37 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c961fcc-0ff0-4275-9163-406662b265f8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:10:37 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[a64bb8b3-4a4a-4b3c-95b0-f9781ec90ffa]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:9c961fcc-0ff0-4275-9163-406662b265f8, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:9c961fcc-0ff0-4275-9163-406662b265f8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:10:37 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-312b101d-47ea-4dd8-ab0c-ce03e37780bf tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:9c961fcc-0ff0-4275-9163-406662b265f8, portal: 172.16.0.220,3260]
Apr 12 16:10:37 user nova-compute[71874]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:9c961fcc-0ff0-4275-9163-406662b265f8, portal: 172.16.0.220,3260] successful.
Apr 12 16:10:37 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:10:37 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c961fcc-0ff0-4275-9163-406662b265f8 -p 172.16.0.220:3260 --op delete {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:10:37 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c961fcc-0ff0-4275-9163-406662b265f8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:10:37 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7e48ce1-fd37-4c14-bb6a-1a842abfadc4]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:10:37 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-312b101d-47ea-4dd8-ab0c-ce03e37780bf tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:10:37 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-312b101d-47ea-4dd8-ab0c-ce03e37780bf tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.367s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:10:37 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-312b101d-47ea-4dd8-ab0c-ce03e37780bf tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] <== disconnect_volume: return (369ms) None {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:10:37 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-312b101d-47ea-4dd8-ab0c-ce03e37780bf tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: 84683344-2893-4446-90ae-e64cd799eb20] Disconnected iSCSI Volume {{(pid=71874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 16:10:37 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-312b101d-47ea-4dd8-ab0c-ce03e37780bf tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: 84683344-2893-4446-90ae-e64cd799eb20] Start _get_guest_xml network_info=[{"id": "a8837af3-03f7-4b3d-8a2a-746f2d8038ad", "address": "fa:16:3e:71:77:df", "network": {"id": "58f92787-e3b6-4fd3-bd75-7169f1a36651", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-614349033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "236b9e609eb44071bc88971bff96931e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8837af3-03", "ovs_interfaceid": "a8837af3-03f7-4b3d-8a2a-746f2d8038ad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=ca200f21-67f7-4581-9bfc-75465abff368,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_options': None, 'image_id': 'ca200f21-67f7-4581-9bfc-75465abff368'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'delete_on_termination': False, 'attachment_id': 'acf8cf15-ff15-4133-acde-1ef62c7d6674', 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9c961fcc-0ff0-4275-9163-406662b265f8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EHUDIolh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '84683344-2893-4446-90ae-e64cd799eb20', 'attached_at': '', 'detached_at': '', 'volume_id': '9c961fcc-0ff0-4275-9163-406662b265f8', 'serial': '9c961fcc-0ff0-4275-9163-406662b265f8'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': None, 'volume_type': None} {{(pid=71874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 16:10:37 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-312b101d-47ea-4dd8-ab0c-ce03e37780bf tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:10:37 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-312b101d-47ea-4dd8-ab0c-ce03e37780bf tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:10:37 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-312b101d-47ea-4dd8-ab0c-ce03e37780bf tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71874) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 16:10:37 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-312b101d-47ea-4dd8-ab0c-ce03e37780bf tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T15:56:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=ca200f21-67f7-4581-9bfc-75465abff368,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 16:10:37 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-312b101d-47ea-4dd8-ab0c-ce03e37780bf tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Flavor limits 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 16:10:37 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-312b101d-47ea-4dd8-ab0c-ce03e37780bf tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Image limits 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 16:10:37 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-312b101d-47ea-4dd8-ab0c-ce03e37780bf tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Flavor pref 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 16:10:37 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-312b101d-47ea-4dd8-ab0c-ce03e37780bf tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Image pref 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 16:10:37 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-312b101d-47ea-4dd8-ab0c-ce03e37780bf tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 16:10:37 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-312b101d-47ea-4dd8-ab0c-ce03e37780bf tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 16:10:37 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-312b101d-47ea-4dd8-ab0c-ce03e37780bf tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 16:10:37 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-312b101d-47ea-4dd8-ab0c-ce03e37780bf tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Got 1 possible topologies {{(pid=71874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 16:10:37 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-312b101d-47ea-4dd8-ab0c-ce03e37780bf tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 16:10:37 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-312b101d-47ea-4dd8-ab0c-ce03e37780bf tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 16:10:37 user nova-compute[71874]: DEBUG nova.objects.instance [None req-312b101d-47ea-4dd8-ab0c-ce03e37780bf tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lazy-loading 'vcpu_model' on Instance uuid 84683344-2893-4446-90ae-e64cd799eb20 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:10:37 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-312b101d-47ea-4dd8-ab0c-ce03e37780bf tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: 84683344-2893-4446-90ae-e64cd799eb20] Calling os-brick to attach iSCSI Volume {{(pid=71874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 16:10:37 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-312b101d-47ea-4dd8-ab0c-ce03e37780bf tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3c0216320>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9c961fcc-0ff0-4275-9163-406662b265f8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EHUDIolh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:10:37 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-312b101d-47ea-4dd8-ab0c-ce03e37780bf tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:10:37 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-312b101d-47ea-4dd8-ab0c-ce03e37780bf tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:10:37 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-312b101d-47ea-4dd8-ab0c-ce03e37780bf tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:10:37 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-312b101d-47ea-4dd8-ab0c-ce03e37780bf tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:10:37 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-312b101d-47ea-4dd8-ab0c-ce03e37780bf tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9c961fcc-0ff0-4275-9163-406662b265f8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:10:37 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-312b101d-47ea-4dd8-ab0c-ce03e37780bf tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9c961fcc-0ff0-4275-9163-406662b265f8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:10:37 user nova-compute[71874]: INFO os_brick.initiator.connectors.iscsi [None req-312b101d-47ea-4dd8-ab0c-ce03e37780bf tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 16:10:37 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c961fcc-0ff0-4275-9163-406662b265f8 -p 172.16.0.220:3260 {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:10:37 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c961fcc-0ff0-4275-9163-406662b265f8 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:10:37 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b0042da-0f17-4dc1-9a28-3919f60bf4f1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:10:37 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-312b101d-47ea-4dd8-ab0c-ce03e37780bf tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 16:10:37 user nova-compute[71874]:  {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:10:37 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c961fcc-0ff0-4275-9163-406662b265f8 -p 172.16.0.220:3260 --interface default --op new {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:10:37 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c961fcc-0ff0-4275-9163-406662b265f8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:10:37 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[5daa41fa-a6ed-4e97-aa99-3fd84c86817b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9c961fcc-0ff0-4275-9163-406662b265f8] added\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:10:37 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-312b101d-47ea-4dd8-ab0c-ce03e37780bf tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9c961fcc-0ff0-4275-9163-406662b265f8] added
Apr 12 16:10:37 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:10:37 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c961fcc-0ff0-4275-9163-406662b265f8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:10:37 user nova-compute[71874]: DEBUG nova.compute.manager [req-c3868d41-f57a-4e9b-bc7b-84f7a5c721d2 req-104cc2ca-b427-48d2-8438-9ae4fac0c106 service nova] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Received event network-vif-plugged-eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:10:37 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-c3868d41-f57a-4e9b-bc7b-84f7a5c721d2 req-104cc2ca-b427-48d2-8438-9ae4fac0c106 service nova] Acquiring lock "4190e244-84b1-47b6-813d-9cadb7c65975-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:10:37 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-c3868d41-f57a-4e9b-bc7b-84f7a5c721d2 req-104cc2ca-b427-48d2-8438-9ae4fac0c106 service nova] Lock "4190e244-84b1-47b6-813d-9cadb7c65975-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:10:37 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-c3868d41-f57a-4e9b-bc7b-84f7a5c721d2 req-104cc2ca-b427-48d2-8438-9ae4fac0c106 service nova] Lock "4190e244-84b1-47b6-813d-9cadb7c65975-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:10:37 user nova-compute[71874]: DEBUG nova.compute.manager [req-c3868d41-f57a-4e9b-bc7b-84f7a5c721d2 req-104cc2ca-b427-48d2-8438-9ae4fac0c106 service nova] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] No waiting events found dispatching network-vif-plugged-eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:10:37 user nova-compute[71874]: WARNING nova.compute.manager [req-c3868d41-f57a-4e9b-bc7b-84f7a5c721d2 req-104cc2ca-b427-48d2-8438-9ae4fac0c106 service nova] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Received unexpected event network-vif-plugged-eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c for instance with vm_state building and task_state spawning.
Apr 12 16:10:37 user nova-compute[71874]: DEBUG nova.compute.manager [req-c3868d41-f57a-4e9b-bc7b-84f7a5c721d2 req-104cc2ca-b427-48d2-8438-9ae4fac0c106 service nova] [instance: 84683344-2893-4446-90ae-e64cd799eb20] Received event network-vif-unplugged-a8837af3-03f7-4b3d-8a2a-746f2d8038ad {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:10:37 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-c3868d41-f57a-4e9b-bc7b-84f7a5c721d2 req-104cc2ca-b427-48d2-8438-9ae4fac0c106 service nova] Acquiring lock "84683344-2893-4446-90ae-e64cd799eb20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:10:37 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-c3868d41-f57a-4e9b-bc7b-84f7a5c721d2 req-104cc2ca-b427-48d2-8438-9ae4fac0c106 service nova] Lock "84683344-2893-4446-90ae-e64cd799eb20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:10:37 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-c3868d41-f57a-4e9b-bc7b-84f7a5c721d2 req-104cc2ca-b427-48d2-8438-9ae4fac0c106 service nova] Lock "84683344-2893-4446-90ae-e64cd799eb20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:10:37 user nova-compute[71874]: DEBUG nova.compute.manager [req-c3868d41-f57a-4e9b-bc7b-84f7a5c721d2 req-104cc2ca-b427-48d2-8438-9ae4fac0c106 service nova] [instance: 84683344-2893-4446-90ae-e64cd799eb20] No waiting events found dispatching network-vif-unplugged-a8837af3-03f7-4b3d-8a2a-746f2d8038ad {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:10:37 user nova-compute[71874]: WARNING nova.compute.manager [req-c3868d41-f57a-4e9b-bc7b-84f7a5c721d2 req-104cc2ca-b427-48d2-8438-9ae4fac0c106 service nova] [instance: 84683344-2893-4446-90ae-e64cd799eb20] Received unexpected event network-vif-unplugged-a8837af3-03f7-4b3d-8a2a-746f2d8038ad for instance with vm_state active and task_state reboot_started_hard.
Apr 12 16:10:37 user nova-compute[71874]: DEBUG nova.compute.manager [req-c3868d41-f57a-4e9b-bc7b-84f7a5c721d2 req-104cc2ca-b427-48d2-8438-9ae4fac0c106 service nova] [instance: 84683344-2893-4446-90ae-e64cd799eb20] Received event network-vif-plugged-a8837af3-03f7-4b3d-8a2a-746f2d8038ad {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:10:37 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-c3868d41-f57a-4e9b-bc7b-84f7a5c721d2 req-104cc2ca-b427-48d2-8438-9ae4fac0c106 service nova] Acquiring lock "84683344-2893-4446-90ae-e64cd799eb20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:10:37 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-c3868d41-f57a-4e9b-bc7b-84f7a5c721d2 req-104cc2ca-b427-48d2-8438-9ae4fac0c106 service nova] Lock "84683344-2893-4446-90ae-e64cd799eb20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:10:37 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-c3868d41-f57a-4e9b-bc7b-84f7a5c721d2 req-104cc2ca-b427-48d2-8438-9ae4fac0c106 service nova] Lock "84683344-2893-4446-90ae-e64cd799eb20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:10:37 user nova-compute[71874]: DEBUG nova.compute.manager [req-c3868d41-f57a-4e9b-bc7b-84f7a5c721d2 req-104cc2ca-b427-48d2-8438-9ae4fac0c106 service nova] [instance: 84683344-2893-4446-90ae-e64cd799eb20] No waiting events found dispatching network-vif-plugged-a8837af3-03f7-4b3d-8a2a-746f2d8038ad {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:10:37 user nova-compute[71874]: WARNING nova.compute.manager [req-c3868d41-f57a-4e9b-bc7b-84f7a5c721d2 req-104cc2ca-b427-48d2-8438-9ae4fac0c106 service nova] [instance: 84683344-2893-4446-90ae-e64cd799eb20] Received unexpected event network-vif-plugged-a8837af3-03f7-4b3d-8a2a-746f2d8038ad for instance with vm_state active and task_state reboot_started_hard.
Apr 12 16:10:37 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c961fcc-0ff0-4275-9163-406662b265f8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:10:37 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[8488493c-4ae3-49f8-b449-f53edc81b9c0]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:10:37 user nova-compute[71874]: DEBUG nova.virt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Emitting event <LifecycleEvent: 1681315837.4963539, 4190e244-84b1-47b6-813d-9cadb7c65975 => Resumed> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:10:37 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] VM Resumed (Lifecycle Event)
Apr 12 16:10:37 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-312b101d-47ea-4dd8-ab0c-ce03e37780bf tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:10:37 user nova-compute[71874]: DEBUG nova.compute.manager [None req-14a0d391-29f5-4dcf-8400-67fd399d7e1f tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Instance event wait completed in 0 seconds for  {{(pid=71874) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 16:10:37 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-14a0d391-29f5-4dcf-8400-67fd399d7e1f tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Guest created on hypervisor {{(pid=71874) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 16:10:37 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c961fcc-0ff0-4275-9163-406662b265f8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:10:37 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:10:37 user nova-compute[71874]: INFO nova.virt.libvirt.driver [-] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Instance spawned successfully.
Apr 12 16:10:37 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-14a0d391-29f5-4dcf-8400-67fd399d7e1f tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 16:10:37 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c961fcc-0ff0-4275-9163-406662b265f8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:10:37 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[035dedc2-5ade-4eb7-98dd-7026b9fb2a97]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:10:37 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-312b101d-47ea-4dd8-ab0c-ce03e37780bf tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:10:37 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 16:10:37 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c961fcc-0ff0-4275-9163-406662b265f8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EHUDIolh {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:10:37 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-14a0d391-29f5-4dcf-8400-67fd399d7e1f tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Found default for hw_cdrom_bus of ide {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:10:37 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-14a0d391-29f5-4dcf-8400-67fd399d7e1f tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Found default for hw_disk_bus of virtio {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:10:37 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-14a0d391-29f5-4dcf-8400-67fd399d7e1f tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Found default for hw_input_bus of None {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:10:37 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-14a0d391-29f5-4dcf-8400-67fd399d7e1f tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Found default for hw_pointer_model of None {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:10:37 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-14a0d391-29f5-4dcf-8400-67fd399d7e1f tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Found default for hw_video_model of virtio {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:10:37 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-14a0d391-29f5-4dcf-8400-67fd399d7e1f tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Found default for hw_vif_model of virtio {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:10:37 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 16:10:37 user nova-compute[71874]: DEBUG nova.virt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Emitting event <LifecycleEvent: 1681315837.5024948, 4190e244-84b1-47b6-813d-9cadb7c65975 => Started> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:10:37 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] VM Started (Lifecycle Event)
Apr 12 16:10:37 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c961fcc-0ff0-4275-9163-406662b265f8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EHUDIolh" returned: 0 in 0.027s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:10:37 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f34da08-515a-4d48-8245-6ef5c8f450b3]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:10:37 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-312b101d-47ea-4dd8-ab0c-ce03e37780bf tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EHUDIolh'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:10:37 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c961fcc-0ff0-4275-9163-406662b265f8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:10:37 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:10:37 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c961fcc-0ff0-4275-9163-406662b265f8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:10:37 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b3d4de2-bc3a-4e28-99a3-b4ae41d4da3b]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:10:37 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-312b101d-47ea-4dd8-ab0c-ce03e37780bf tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:10:37 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:10:37 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 16:10:37 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:10:37 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c9d624f-d2a9-4fcf-b561-9d0a39eef919]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f27a002-8dfc-4d90-aa35-ba16586d4366 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:10:37 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-312b101d-47ea-4dd8-ab0c-ce03e37780bf tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:10:37 user nova-compute[71874]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f27a002-8dfc-4d90-aa35-ba16586d4366 (non-flash)
Apr 12 16:10:37 user nova-compute[71874]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 (non-flash)
Apr 12 16:10:37 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:10:37 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-312b101d-47ea-4dd8-ab0c-ce03e37780bf tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:10:37 user nova-compute[71874]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f27a002-8dfc-4d90-aa35-ba16586d4366 (non-flash)
Apr 12 16:10:37 user nova-compute[71874]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 (non-flash)
Apr 12 16:10:37 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:10:37 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c961fcc-0ff0-4275-9163-406662b265f8 -p 172.16.0.220:3260 --login {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:10:37 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 16:10:37 user nova-compute[71874]: INFO nova.compute.manager [None req-14a0d391-29f5-4dcf-8400-67fd399d7e1f tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Took 6.51 seconds to spawn the instance on the hypervisor.
Apr 12 16:10:37 user nova-compute[71874]: DEBUG nova.compute.manager [None req-14a0d391-29f5-4dcf-8400-67fd399d7e1f tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:10:37 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c961fcc-0ff0-4275-9163-406662b265f8 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:10:37 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[28a9e599-6c67-4639-a4d4-73eeb824f059]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9c961fcc-0ff0-4275-9163-406662b265f8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9c961fcc-0ff0-4275-9163-406662b265f8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:10:37 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-312b101d-47ea-4dd8-ab0c-ce03e37780bf tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9c961fcc-0ff0-4275-9163-406662b265f8, portal: 172.16.0.220,3260]
Apr 12 16:10:37 user nova-compute[71874]: Login to [iface: default, target: iqn.2010-10.org.openstack:9c961fcc-0ff0-4275-9163-406662b265f8, portal: 172.16.0.220,3260] successful.
Apr 12 16:10:37 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:10:37 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c961fcc-0ff0-4275-9163-406662b265f8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:10:37 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c961fcc-0ff0-4275-9163-406662b265f8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:10:37 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[b503c567-6eff-4bb5-b95e-70fec36dd7f9]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:10:37 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-312b101d-47ea-4dd8-ab0c-ce03e37780bf tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:10:37 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:10:37 user nova-compute[71874]: INFO nova.compute.manager [None req-14a0d391-29f5-4dcf-8400-67fd399d7e1f tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Took 7.45 seconds to build instance.
Apr 12 16:10:37 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:10:37 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[c220ac3a-7c20-4eb9-ace0-bec72c94cf56]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f27a002-8dfc-4d90-aa35-ba16586d4366 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c961fcc-0ff0-4275-9163-406662b265f8 (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:10:37 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-312b101d-47ea-4dd8-ab0c-ce03e37780bf tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:10:37 user nova-compute[71874]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f27a002-8dfc-4d90-aa35-ba16586d4366 (non-flash)
Apr 12 16:10:37 user nova-compute[71874]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 (non-flash)
Apr 12 16:10:37 user nova-compute[71874]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c961fcc-0ff0-4275-9163-406662b265f8 (non-flash)
Apr 12 16:10:37 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:10:37 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-312b101d-47ea-4dd8-ab0c-ce03e37780bf tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:10:37 user nova-compute[71874]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f27a002-8dfc-4d90-aa35-ba16586d4366 (non-flash)
Apr 12 16:10:37 user nova-compute[71874]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 (non-flash)
Apr 12 16:10:37 user nova-compute[71874]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c961fcc-0ff0-4275-9163-406662b265f8 (non-flash)
Apr 12 16:10:37 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:10:37 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-312b101d-47ea-4dd8-ab0c-ce03e37780bf tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9c961fcc-0ff0-4275-9163-406662b265f8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.367s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:10:37 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-312b101d-47ea-4dd8-ab0c-ce03e37780bf tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Connected to 172.16.0.220:3260 {{(pid=71874) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 16:10:37 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-312b101d-47ea-4dd8-ab0c-ce03e37780bf tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] HCTL ('35', '-', '-', 0) found on session 31 with lun 0 {{(pid=71874) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 16:10:37 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-312b101d-47ea-4dd8-ab0c-ce03e37780bf tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71874) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 16:10:37 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:10:37 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-14a0d391-29f5-4dcf-8400-67fd399d7e1f tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "4190e244-84b1-47b6-813d-9cadb7c65975" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.591s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:10:37 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.026s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:10:37 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[48c61ee7-5720-478e-bded-2288eb42d642]: (4, ('- - 0', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:10:37 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-312b101d-47ea-4dd8-ab0c-ce03e37780bf tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Searching for a device in session 31 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71874) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 16:10:37 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-312b101d-47ea-4dd8-ab0c-ce03e37780bf tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:9c961fcc-0ff0-4275-9163-406662b265f8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EHUDIolh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=71874) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 16:10:38 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:10:38 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-312b101d-47ea-4dd8-ab0c-ce03e37780bf tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.408s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:10:38 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-312b101d-47ea-4dd8-ab0c-ce03e37780bf tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] <== connect_volume: return (1409ms) {'type': 'block', 'scsi_wwn': '23636616166333064', 'path': '/dev/sdd'} {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:10:38 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-312b101d-47ea-4dd8-ab0c-ce03e37780bf tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: 84683344-2893-4446-90ae-e64cd799eb20] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23636616166333064', 'path': '/dev/sdd'} {{(pid=71874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 16:10:38 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-312b101d-47ea-4dd8-ab0c-ce03e37780bf tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T16:08:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-305874148',display_name='tempest-TestMinimumBasicScenario-server-305874148',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-305874148',id=27,image_ref='ca200f21-67f7-4581-9bfc-75465abff368',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP7vpIGcBykOJPr4ws0YtRwaxvjbKaTb5FQPV2F4kO1x9IPpUHiVmLwjEQx1FAApeD4swefMBOlg2jRi0dXdP+/5EMUIcDTR0iUGAbkMPwCdxqyQhFvFmsSM0dq+TS03mg==',key_name='tempest-TestMinimumBasicScenario-1145355827',keypairs=<?>,launch_index=0,launched_at=2023-04-12T16:08:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='236b9e609eb44071bc88971bff96931e',ramdisk_id='',reservation_id='r-i04av21o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca200f21-67f7-4581-9bfc-75465abff368',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1374695003',owner_user_name='tempest-TestMinimumBasicScenario-1374695003-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T16:10:36Z,user_data=None,user_id='16a68fa3490940ebaebc8d4ca5746f6e',uuid=84683344-2893-4446-90ae-e64cd799eb20,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a8837af3-03f7-4b3d-8a2a-746f2d8038ad", "address": "fa:16:3e:71:77:df", "network": {"id": "58f92787-e3b6-4fd3-bd75-7169f1a36651", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-614349033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "236b9e609eb44071bc88971bff96931e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8837af3-03", "ovs_interfaceid": "a8837af3-03f7-4b3d-8a2a-746f2d8038ad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 16:10:38 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-312b101d-47ea-4dd8-ab0c-ce03e37780bf tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Converting VIF {"id": "a8837af3-03f7-4b3d-8a2a-746f2d8038ad", "address": "fa:16:3e:71:77:df", "network": {"id": "58f92787-e3b6-4fd3-bd75-7169f1a36651", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-614349033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "236b9e609eb44071bc88971bff96931e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8837af3-03", "ovs_interfaceid": "a8837af3-03f7-4b3d-8a2a-746f2d8038ad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:10:38 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-312b101d-47ea-4dd8-ab0c-ce03e37780bf tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:71:77:df,bridge_name='br-int',has_traffic_filtering=True,id=a8837af3-03f7-4b3d-8a2a-746f2d8038ad,network=Network(58f92787-e3b6-4fd3-bd75-7169f1a36651),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8837af3-03') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:10:38 user nova-compute[71874]: DEBUG nova.objects.instance [None req-312b101d-47ea-4dd8-ab0c-ce03e37780bf tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lazy-loading 'pci_devices' on Instance uuid 84683344-2893-4446-90ae-e64cd799eb20 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:10:38 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-312b101d-47ea-4dd8-ab0c-ce03e37780bf tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: 84683344-2893-4446-90ae-e64cd799eb20] End _get_guest_xml xml=<domain type="kvm">
Apr 12 16:10:38 user nova-compute[71874]:   <uuid>84683344-2893-4446-90ae-e64cd799eb20</uuid>
Apr 12 16:10:38 user nova-compute[71874]:   <name>instance-0000001b</name>
Apr 12 16:10:38 user nova-compute[71874]:   <memory>131072</memory>
Apr 12 16:10:38 user nova-compute[71874]:   <vcpu>1</vcpu>
Apr 12 16:10:38 user nova-compute[71874]:   <metadata>
Apr 12 16:10:38 user nova-compute[71874]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 16:10:38 user nova-compute[71874]:       <nova:package version="0.0.0"/>
Apr 12 16:10:38 user nova-compute[71874]:       <nova:name>tempest-TestMinimumBasicScenario-server-305874148</nova:name>
Apr 12 16:10:38 user nova-compute[71874]:       <nova:creationTime>2023-04-12 16:10:37</nova:creationTime>
Apr 12 16:10:38 user nova-compute[71874]:       <nova:flavor name="m1.nano">
Apr 12 16:10:38 user nova-compute[71874]:         <nova:memory>128</nova:memory>
Apr 12 16:10:38 user nova-compute[71874]:         <nova:disk>1</nova:disk>
Apr 12 16:10:38 user nova-compute[71874]:         <nova:swap>0</nova:swap>
Apr 12 16:10:38 user nova-compute[71874]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 16:10:38 user nova-compute[71874]:         <nova:vcpus>1</nova:vcpus>
Apr 12 16:10:38 user nova-compute[71874]:       </nova:flavor>
Apr 12 16:10:38 user nova-compute[71874]:       <nova:owner>
Apr 12 16:10:38 user nova-compute[71874]:         <nova:user uuid="16a68fa3490940ebaebc8d4ca5746f6e">tempest-TestMinimumBasicScenario-1374695003-project-member</nova:user>
Apr 12 16:10:38 user nova-compute[71874]:         <nova:project uuid="236b9e609eb44071bc88971bff96931e">tempest-TestMinimumBasicScenario-1374695003</nova:project>
Apr 12 16:10:38 user nova-compute[71874]:       </nova:owner>
Apr 12 16:10:38 user nova-compute[71874]:       <nova:root type="image" uuid="ca200f21-67f7-4581-9bfc-75465abff368"/>
Apr 12 16:10:38 user nova-compute[71874]:       <nova:ports>
Apr 12 16:10:38 user nova-compute[71874]:         <nova:port uuid="a8837af3-03f7-4b3d-8a2a-746f2d8038ad">
Apr 12 16:10:38 user nova-compute[71874]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 12 16:10:38 user nova-compute[71874]:         </nova:port>
Apr 12 16:10:38 user nova-compute[71874]:       </nova:ports>
Apr 12 16:10:38 user nova-compute[71874]:     </nova:instance>
Apr 12 16:10:38 user nova-compute[71874]:   </metadata>
Apr 12 16:10:38 user nova-compute[71874]:   <sysinfo type="smbios">
Apr 12 16:10:38 user nova-compute[71874]:     <system>
Apr 12 16:10:38 user nova-compute[71874]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 16:10:38 user nova-compute[71874]:       <entry name="product">OpenStack Nova</entry>
Apr 12 16:10:38 user nova-compute[71874]:       <entry name="version">0.0.0</entry>
Apr 12 16:10:38 user nova-compute[71874]:       <entry name="serial">84683344-2893-4446-90ae-e64cd799eb20</entry>
Apr 12 16:10:38 user nova-compute[71874]:       <entry name="uuid">84683344-2893-4446-90ae-e64cd799eb20</entry>
Apr 12 16:10:38 user nova-compute[71874]:       <entry name="family">Virtual Machine</entry>
Apr 12 16:10:38 user nova-compute[71874]:     </system>
Apr 12 16:10:38 user nova-compute[71874]:   </sysinfo>
Apr 12 16:10:38 user nova-compute[71874]:   <os>
Apr 12 16:10:38 user nova-compute[71874]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 16:10:38 user nova-compute[71874]:     <boot dev="hd"/>
Apr 12 16:10:38 user nova-compute[71874]:     <smbios mode="sysinfo"/>
Apr 12 16:10:38 user nova-compute[71874]:   </os>
Apr 12 16:10:38 user nova-compute[71874]:   <features>
Apr 12 16:10:38 user nova-compute[71874]:     <acpi/>
Apr 12 16:10:38 user nova-compute[71874]:     <apic/>
Apr 12 16:10:38 user nova-compute[71874]:     <vmcoreinfo/>
Apr 12 16:10:38 user nova-compute[71874]:   </features>
Apr 12 16:10:38 user nova-compute[71874]:   <clock offset="utc">
Apr 12 16:10:38 user nova-compute[71874]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 16:10:38 user nova-compute[71874]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 16:10:38 user nova-compute[71874]:     <timer name="hpet" present="no"/>
Apr 12 16:10:38 user nova-compute[71874]:   </clock>
Apr 12 16:10:38 user nova-compute[71874]:   <cpu mode="custom" match="exact">
Apr 12 16:10:38 user nova-compute[71874]:     <model>Nehalem</model>
Apr 12 16:10:38 user nova-compute[71874]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 16:10:38 user nova-compute[71874]:   </cpu>
Apr 12 16:10:38 user nova-compute[71874]:   <devices>
Apr 12 16:10:38 user nova-compute[71874]:     <disk type="file" device="disk">
Apr 12 16:10:38 user nova-compute[71874]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 16:10:38 user nova-compute[71874]:       <source file="/opt/stack/data/nova/instances/84683344-2893-4446-90ae-e64cd799eb20/disk"/>
Apr 12 16:10:38 user nova-compute[71874]:       <target dev="vda" bus="virtio"/>
Apr 12 16:10:38 user nova-compute[71874]:     </disk>
Apr 12 16:10:38 user nova-compute[71874]:     <disk type="block" device="disk">
Apr 12 16:10:38 user nova-compute[71874]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 16:10:38 user nova-compute[71874]:       <source dev="/dev/sdd"/>
Apr 12 16:10:38 user nova-compute[71874]:       <target dev="vdb" bus="virtio"/>
Apr 12 16:10:38 user nova-compute[71874]:       <serial>9c961fcc-0ff0-4275-9163-406662b265f8</serial>
Apr 12 16:10:38 user nova-compute[71874]:     </disk>
Apr 12 16:10:38 user nova-compute[71874]:     <interface type="ethernet">
Apr 12 16:10:38 user nova-compute[71874]:       <mac address="fa:16:3e:71:77:df"/>
Apr 12 16:10:38 user nova-compute[71874]:       <model type="virtio"/>
Apr 12 16:10:38 user nova-compute[71874]:       <mtu size="1442"/>
Apr 12 16:10:38 user nova-compute[71874]:       <target dev="tapa8837af3-03"/>
Apr 12 16:10:38 user nova-compute[71874]:     </interface>
Apr 12 16:10:38 user nova-compute[71874]:     <serial type="pty">
Apr 12 16:10:38 user nova-compute[71874]:       <log file="/opt/stack/data/nova/instances/84683344-2893-4446-90ae-e64cd799eb20/console.log" append="off"/>
Apr 12 16:10:38 user nova-compute[71874]:     </serial>
Apr 12 16:10:38 user nova-compute[71874]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 16:10:38 user nova-compute[71874]:     <video>
Apr 12 16:10:38 user nova-compute[71874]:       <model type="virtio"/>
Apr 12 16:10:38 user nova-compute[71874]:     </video>
Apr 12 16:10:38 user nova-compute[71874]:     <rng model="virtio">
Apr 12 16:10:38 user nova-compute[71874]:       <backend model="random">/dev/urandom</backend>
Apr 12 16:10:38 user nova-compute[71874]:     </rng>
Apr 12 16:10:38 user nova-compute[71874]:     <controller type="usb" index="0" model="none"/>
Apr 12 16:10:38 user nova-compute[71874]:     <memballoon model="virtio">
Apr 12 16:10:38 user nova-compute[71874]:       <stats period="10"/>
Apr 12 16:10:38 user nova-compute[71874]:     </memballoon>
Apr 12 16:10:38 user nova-compute[71874]:   </devices>
Apr 12 16:10:38 user nova-compute[71874]: </domain>
Apr 12 16:10:38 user nova-compute[71874]:  {{(pid=71874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 16:10:38 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-312b101d-47ea-4dd8-ab0c-ce03e37780bf tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84683344-2893-4446-90ae-e64cd799eb20/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:10:39 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-312b101d-47ea-4dd8-ab0c-ce03e37780bf tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84683344-2893-4446-90ae-e64cd799eb20/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:10:39 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-312b101d-47ea-4dd8-ab0c-ce03e37780bf tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84683344-2893-4446-90ae-e64cd799eb20/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:10:39 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-312b101d-47ea-4dd8-ab0c-ce03e37780bf tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84683344-2893-4446-90ae-e64cd799eb20/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:10:39 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-312b101d-47ea-4dd8-ab0c-ce03e37780bf tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 16:10:39 user nova-compute[71874]: DEBUG nova.objects.instance [None req-312b101d-47ea-4dd8-ab0c-ce03e37780bf tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lazy-loading 'trusted_certs' on Instance uuid 84683344-2893-4446-90ae-e64cd799eb20 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:10:39 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-312b101d-47ea-4dd8-ab0c-ce03e37780bf tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2f94a73a1a770bd66922be1f3394655a4b9500c6 --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:10:39 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-312b101d-47ea-4dd8-ab0c-ce03e37780bf tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2f94a73a1a770bd66922be1f3394655a4b9500c6 --force-share --output=json" returned: 0 in 0.162s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:10:39 user nova-compute[71874]: DEBUG nova.virt.disk.api [None req-312b101d-47ea-4dd8-ab0c-ce03e37780bf tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Checking if we can resize image /opt/stack/data/nova/instances/84683344-2893-4446-90ae-e64cd799eb20/disk. size=1073741824 {{(pid=71874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 16:10:39 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-312b101d-47ea-4dd8-ab0c-ce03e37780bf tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84683344-2893-4446-90ae-e64cd799eb20/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:10:39 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-312b101d-47ea-4dd8-ab0c-ce03e37780bf tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84683344-2893-4446-90ae-e64cd799eb20/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:10:39 user nova-compute[71874]: DEBUG nova.virt.disk.api [None req-312b101d-47ea-4dd8-ab0c-ce03e37780bf tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Cannot resize image /opt/stack/data/nova/instances/84683344-2893-4446-90ae-e64cd799eb20/disk to a smaller size. {{(pid=71874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 16:10:39 user nova-compute[71874]: DEBUG nova.objects.instance [None req-312b101d-47ea-4dd8-ab0c-ce03e37780bf tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lazy-loading 'migration_context' on Instance uuid 84683344-2893-4446-90ae-e64cd799eb20 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:10:39 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-312b101d-47ea-4dd8-ab0c-ce03e37780bf tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T16:08:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-305874148',display_name='tempest-TestMinimumBasicScenario-server-305874148',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-305874148',id=27,image_ref='ca200f21-67f7-4581-9bfc-75465abff368',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP7vpIGcBykOJPr4ws0YtRwaxvjbKaTb5FQPV2F4kO1x9IPpUHiVmLwjEQx1FAApeD4swefMBOlg2jRi0dXdP+/5EMUIcDTR0iUGAbkMPwCdxqyQhFvFmsSM0dq+TS03mg==',key_name='tempest-TestMinimumBasicScenario-1145355827',keypairs=<?>,launch_index=0,launched_at=2023-04-12T16:08:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='236b9e609eb44071bc88971bff96931e',ramdisk_id='',reservation_id='r-i04av21o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca200f21-67f7-4581-9bfc-75465abff368',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1374695003',owner_user_name='tempest-TestMinimumBasicScenario-1374695003-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T16:10:36Z,user_data=None,user_id='16a68fa3490940ebaebc8d4ca5746f6e',uuid=84683344-2893-4446-90ae-e64cd799eb20,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a8837af3-03f7-4b3d-8a2a-746f2d8038ad", "address": "fa:16:3e:71:77:df", "network": {"id": "58f92787-e3b6-4fd3-bd75-7169f1a36651", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-614349033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "236b9e609eb44071bc88971bff96931e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8837af3-03", "ovs_interfaceid": "a8837af3-03f7-4b3d-8a2a-746f2d8038ad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 16:10:39 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-312b101d-47ea-4dd8-ab0c-ce03e37780bf tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Converting VIF {"id": "a8837af3-03f7-4b3d-8a2a-746f2d8038ad", "address": "fa:16:3e:71:77:df", "network": {"id": "58f92787-e3b6-4fd3-bd75-7169f1a36651", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-614349033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "236b9e609eb44071bc88971bff96931e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8837af3-03", "ovs_interfaceid": "a8837af3-03f7-4b3d-8a2a-746f2d8038ad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:10:39 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-312b101d-47ea-4dd8-ab0c-ce03e37780bf tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:71:77:df,bridge_name='br-int',has_traffic_filtering=True,id=a8837af3-03f7-4b3d-8a2a-746f2d8038ad,network=Network(58f92787-e3b6-4fd3-bd75-7169f1a36651),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8837af3-03') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:10:39 user nova-compute[71874]: DEBUG os_vif [None req-312b101d-47ea-4dd8-ab0c-ce03e37780bf tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:71:77:df,bridge_name='br-int',has_traffic_filtering=True,id=a8837af3-03f7-4b3d-8a2a-746f2d8038ad,network=Network(58f92787-e3b6-4fd3-bd75-7169f1a36651),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8837af3-03') {{(pid=71874) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 16:10:39 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:10:39 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:10:39 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 16:10:39 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:10:39 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa8837af3-03, may_exist=True) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:10:39 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa8837af3-03, col_values=(('external_ids', {'iface-id': 'a8837af3-03f7-4b3d-8a2a-746f2d8038ad', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:71:77:df', 'vm-uuid': '84683344-2893-4446-90ae-e64cd799eb20'}),)) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:10:39 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:10:39 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:10:39 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:10:39 user nova-compute[71874]: INFO os_vif [None req-312b101d-47ea-4dd8-ab0c-ce03e37780bf tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:71:77:df,bridge_name='br-int',has_traffic_filtering=True,id=a8837af3-03f7-4b3d-8a2a-746f2d8038ad,network=Network(58f92787-e3b6-4fd3-bd75-7169f1a36651),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8837af3-03')
Apr 12 16:10:39 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-6ddf74af-68b6-4a88-bcea-396d74baf9e0 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Acquiring lock "d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:10:39 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-6ddf74af-68b6-4a88-bcea-396d74baf9e0 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:10:39 user nova-compute[71874]: INFO nova.compute.manager [None req-6ddf74af-68b6-4a88-bcea-396d74baf9e0 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] Unshelving
Apr 12 16:10:40 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-6ddf74af-68b6-4a88-bcea-396d74baf9e0 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:10:40 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-6ddf74af-68b6-4a88-bcea-396d74baf9e0 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:10:40 user nova-compute[71874]: DEBUG nova.objects.instance [None req-6ddf74af-68b6-4a88-bcea-396d74baf9e0 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lazy-loading 'pci_requests' on Instance uuid d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:10:40 user nova-compute[71874]: DEBUG nova.objects.instance [None req-6ddf74af-68b6-4a88-bcea-396d74baf9e0 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lazy-loading 'numa_topology' on Instance uuid d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:10:40 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-6ddf74af-68b6-4a88-bcea-396d74baf9e0 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71874) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 16:10:40 user nova-compute[71874]: INFO nova.compute.claims [None req-6ddf74af-68b6-4a88-bcea-396d74baf9e0 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] Claim successful on node user
Apr 12 16:10:40 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-6ddf74af-68b6-4a88-bcea-396d74baf9e0 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Inventory has not changed in ProviderTree for provider: 0e94b4c8-cd49-45e4-9133-d36eb4b2456b {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 16:10:40 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-6ddf74af-68b6-4a88-bcea-396d74baf9e0 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Inventory has not changed for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 16:10:40 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-6ddf74af-68b6-4a88-bcea-396d74baf9e0 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.619s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:10:40 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:10:41 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:10:41 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:10:41 user nova-compute[71874]: INFO nova.network.neutron [None req-6ddf74af-68b6-4a88-bcea-396d74baf9e0 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] Updating port e2e566dd-85b6-43a5-b007-15d987e2af56 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Apr 12 16:10:41 user nova-compute[71874]: DEBUG nova.compute.manager [req-c31de41e-1447-4c98-8d38-2c5ae41cc413 req-42ef0863-b29e-4b6a-adac-999426a33962 service nova] [instance: 84683344-2893-4446-90ae-e64cd799eb20] Received event network-vif-plugged-a8837af3-03f7-4b3d-8a2a-746f2d8038ad {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:10:41 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-c31de41e-1447-4c98-8d38-2c5ae41cc413 req-42ef0863-b29e-4b6a-adac-999426a33962 service nova] Acquiring lock "84683344-2893-4446-90ae-e64cd799eb20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:10:41 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-c31de41e-1447-4c98-8d38-2c5ae41cc413 req-42ef0863-b29e-4b6a-adac-999426a33962 service nova] Lock "84683344-2893-4446-90ae-e64cd799eb20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:10:41 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-c31de41e-1447-4c98-8d38-2c5ae41cc413 req-42ef0863-b29e-4b6a-adac-999426a33962 service nova] Lock "84683344-2893-4446-90ae-e64cd799eb20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:10:41 user nova-compute[71874]: DEBUG nova.compute.manager [req-c31de41e-1447-4c98-8d38-2c5ae41cc413 req-42ef0863-b29e-4b6a-adac-999426a33962 service nova] [instance: 84683344-2893-4446-90ae-e64cd799eb20] No waiting events found dispatching network-vif-plugged-a8837af3-03f7-4b3d-8a2a-746f2d8038ad {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:10:41 user nova-compute[71874]: WARNING nova.compute.manager [req-c31de41e-1447-4c98-8d38-2c5ae41cc413 req-42ef0863-b29e-4b6a-adac-999426a33962 service nova] [instance: 84683344-2893-4446-90ae-e64cd799eb20] Received unexpected event network-vif-plugged-a8837af3-03f7-4b3d-8a2a-746f2d8038ad for instance with vm_state active and task_state reboot_started_hard.
Apr 12 16:10:41 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:10:41 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:10:41 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:10:41 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:10:41 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:10:42 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-6ddf74af-68b6-4a88-bcea-396d74baf9e0 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Acquiring lock "refresh_cache-d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:10:42 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-6ddf74af-68b6-4a88-bcea-396d74baf9e0 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Acquired lock "refresh_cache-d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:10:42 user nova-compute[71874]: DEBUG nova.network.neutron [None req-6ddf74af-68b6-4a88-bcea-396d74baf9e0 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] Building network info cache for instance {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 16:10:42 user nova-compute[71874]: DEBUG nova.compute.manager [req-01b34c89-47b8-44d6-936a-a3a02134af1c req-88be46c7-f1ba-4b8c-934e-93da3ccb3b45 service nova] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] Received event network-changed-e2e566dd-85b6-43a5-b007-15d987e2af56 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:10:42 user nova-compute[71874]: DEBUG nova.compute.manager [req-01b34c89-47b8-44d6-936a-a3a02134af1c req-88be46c7-f1ba-4b8c-934e-93da3ccb3b45 service nova] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] Refreshing instance network info cache due to event network-changed-e2e566dd-85b6-43a5-b007-15d987e2af56. {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 16:10:42 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-01b34c89-47b8-44d6-936a-a3a02134af1c req-88be46c7-f1ba-4b8c-934e-93da3ccb3b45 service nova] Acquiring lock "refresh_cache-d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:10:42 user nova-compute[71874]: DEBUG nova.network.neutron [None req-6ddf74af-68b6-4a88-bcea-396d74baf9e0 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] Updating instance_info_cache with network_info: [{"id": "e2e566dd-85b6-43a5-b007-15d987e2af56", "address": "fa:16:3e:88:85:6b", "network": {"id": "eb4dd4b5-96d4-4b53-b510-d41e2775b92f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-596111273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fa122cbabe94c6f93c862b4daf31e50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2e566dd-85", "ovs_interfaceid": "e2e566dd-85b6-43a5-b007-15d987e2af56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:10:42 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-6ddf74af-68b6-4a88-bcea-396d74baf9e0 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Releasing lock "refresh_cache-d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:10:42 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-6ddf74af-68b6-4a88-bcea-396d74baf9e0 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] Creating instance directory {{(pid=71874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 16:10:42 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-6ddf74af-68b6-4a88-bcea-396d74baf9e0 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] Creating image(s)
Apr 12 16:10:42 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-6ddf74af-68b6-4a88-bcea-396d74baf9e0 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Acquiring lock "/opt/stack/data/nova/instances/d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:10:42 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-6ddf74af-68b6-4a88-bcea-396d74baf9e0 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "/opt/stack/data/nova/instances/d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:10:42 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-6ddf74af-68b6-4a88-bcea-396d74baf9e0 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "/opt/stack/data/nova/instances/d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:10:42 user nova-compute[71874]: DEBUG nova.objects.instance [None req-6ddf74af-68b6-4a88-bcea-396d74baf9e0 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lazy-loading 'trusted_certs' on Instance uuid d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:10:42 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-01b34c89-47b8-44d6-936a-a3a02134af1c req-88be46c7-f1ba-4b8c-934e-93da3ccb3b45 service nova] Acquired lock "refresh_cache-d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:10:42 user nova-compute[71874]: DEBUG nova.network.neutron [req-01b34c89-47b8-44d6-936a-a3a02134af1c req-88be46c7-f1ba-4b8c-934e-93da3ccb3b45 service nova] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] Refreshing network info cache for port e2e566dd-85b6-43a5-b007-15d987e2af56 {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 16:10:42 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-6ddf74af-68b6-4a88-bcea-396d74baf9e0 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Acquiring lock "e1263652b2e40c28f34ba7707e7eff23de41f956" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:10:42 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-6ddf74af-68b6-4a88-bcea-396d74baf9e0 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "e1263652b2e40c28f34ba7707e7eff23de41f956" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:10:43 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-6ddf74af-68b6-4a88-bcea-396d74baf9e0 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e1263652b2e40c28f34ba7707e7eff23de41f956.part --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:10:43 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:10:43 user nova-compute[71874]: DEBUG nova.compute.manager [req-21730c62-1b65-4517-af42-01bacfc209e8 req-ac840b1e-0920-4170-81b2-aaf19d48fbe3 service nova] [instance: 84683344-2893-4446-90ae-e64cd799eb20] Received event network-vif-plugged-a8837af3-03f7-4b3d-8a2a-746f2d8038ad {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:10:43 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-21730c62-1b65-4517-af42-01bacfc209e8 req-ac840b1e-0920-4170-81b2-aaf19d48fbe3 service nova] Acquiring lock "84683344-2893-4446-90ae-e64cd799eb20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:10:43 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-21730c62-1b65-4517-af42-01bacfc209e8 req-ac840b1e-0920-4170-81b2-aaf19d48fbe3 service nova] Lock "84683344-2893-4446-90ae-e64cd799eb20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:10:43 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-21730c62-1b65-4517-af42-01bacfc209e8 req-ac840b1e-0920-4170-81b2-aaf19d48fbe3 service nova] Lock "84683344-2893-4446-90ae-e64cd799eb20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:10:43 user nova-compute[71874]: DEBUG nova.compute.manager [req-21730c62-1b65-4517-af42-01bacfc209e8 req-ac840b1e-0920-4170-81b2-aaf19d48fbe3 service nova] [instance: 84683344-2893-4446-90ae-e64cd799eb20] No waiting events found dispatching network-vif-plugged-a8837af3-03f7-4b3d-8a2a-746f2d8038ad {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:10:43 user nova-compute[71874]: WARNING nova.compute.manager [req-21730c62-1b65-4517-af42-01bacfc209e8 req-ac840b1e-0920-4170-81b2-aaf19d48fbe3 service nova] [instance: 84683344-2893-4446-90ae-e64cd799eb20] Received unexpected event network-vif-plugged-a8837af3-03f7-4b3d-8a2a-746f2d8038ad for instance with vm_state active and task_state reboot_started_hard.
Apr 12 16:10:43 user nova-compute[71874]: DEBUG nova.virt.libvirt.host [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Removed pending event for 84683344-2893-4446-90ae-e64cd799eb20 due to event {{(pid=71874) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 12 16:10:43 user nova-compute[71874]: DEBUG nova.virt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Emitting event <LifecycleEvent: 1681315843.6472845, 84683344-2893-4446-90ae-e64cd799eb20 => Resumed> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:10:43 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 84683344-2893-4446-90ae-e64cd799eb20] VM Resumed (Lifecycle Event)
Apr 12 16:10:43 user nova-compute[71874]: DEBUG nova.compute.manager [None req-312b101d-47ea-4dd8-ab0c-ce03e37780bf tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: 84683344-2893-4446-90ae-e64cd799eb20] Instance event wait completed in 0 seconds for  {{(pid=71874) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 16:10:43 user nova-compute[71874]: INFO nova.virt.libvirt.driver [-] [instance: 84683344-2893-4446-90ae-e64cd799eb20] Instance rebooted successfully.
Apr 12 16:10:43 user nova-compute[71874]: DEBUG nova.compute.manager [None req-312b101d-47ea-4dd8-ab0c-ce03e37780bf tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: 84683344-2893-4446-90ae-e64cd799eb20] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:10:43 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 84683344-2893-4446-90ae-e64cd799eb20] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:10:43 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 84683344-2893-4446-90ae-e64cd799eb20] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=71874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 16:10:43 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 84683344-2893-4446-90ae-e64cd799eb20] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
Apr 12 16:10:43 user nova-compute[71874]: DEBUG nova.virt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Emitting event <LifecycleEvent: 1681315843.6489985, 84683344-2893-4446-90ae-e64cd799eb20 => Started> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:10:43 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 84683344-2893-4446-90ae-e64cd799eb20] VM Started (Lifecycle Event)
Apr 12 16:10:43 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-6ddf74af-68b6-4a88-bcea-396d74baf9e0 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e1263652b2e40c28f34ba7707e7eff23de41f956.part --force-share --output=json" returned: 0 in 0.144s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:10:43 user nova-compute[71874]: DEBUG nova.virt.images [None req-6ddf74af-68b6-4a88-bcea-396d74baf9e0 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] 96eb17ec-ea38-4427-980a-a887b607266b was qcow2, converting to raw {{(pid=71874) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 12 16:10:43 user nova-compute[71874]: DEBUG nova.privsep.utils [None req-6ddf74af-68b6-4a88-bcea-396d74baf9e0 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71874) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 12 16:10:43 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-6ddf74af-68b6-4a88-bcea-396d74baf9e0 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e1263652b2e40c28f34ba7707e7eff23de41f956.part /opt/stack/data/nova/instances/_base/e1263652b2e40c28f34ba7707e7eff23de41f956.converted {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:10:43 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 84683344-2893-4446-90ae-e64cd799eb20] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:10:43 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-312b101d-47ea-4dd8-ab0c-ce03e37780bf tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "84683344-2893-4446-90ae-e64cd799eb20" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.443s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:10:43 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 84683344-2893-4446-90ae-e64cd799eb20] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 16:10:44 user nova-compute[71874]: DEBUG nova.network.neutron [req-01b34c89-47b8-44d6-936a-a3a02134af1c req-88be46c7-f1ba-4b8c-934e-93da3ccb3b45 service nova] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] Updated VIF entry in instance network info cache for port e2e566dd-85b6-43a5-b007-15d987e2af56. {{(pid=71874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 16:10:44 user nova-compute[71874]: DEBUG nova.network.neutron [req-01b34c89-47b8-44d6-936a-a3a02134af1c req-88be46c7-f1ba-4b8c-934e-93da3ccb3b45 service nova] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] Updating instance_info_cache with network_info: [{"id": "e2e566dd-85b6-43a5-b007-15d987e2af56", "address": "fa:16:3e:88:85:6b", "network": {"id": "eb4dd4b5-96d4-4b53-b510-d41e2775b92f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-596111273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fa122cbabe94c6f93c862b4daf31e50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2e566dd-85", "ovs_interfaceid": "e2e566dd-85b6-43a5-b007-15d987e2af56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:10:44 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-01b34c89-47b8-44d6-936a-a3a02134af1c req-88be46c7-f1ba-4b8c-934e-93da3ccb3b45 service nova] Releasing lock "refresh_cache-d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:10:44 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:10:44 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-6ddf74af-68b6-4a88-bcea-396d74baf9e0 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e1263652b2e40c28f34ba7707e7eff23de41f956.part /opt/stack/data/nova/instances/_base/e1263652b2e40c28f34ba7707e7eff23de41f956.converted" returned: 0 in 0.968s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:10:44 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-6ddf74af-68b6-4a88-bcea-396d74baf9e0 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e1263652b2e40c28f34ba7707e7eff23de41f956.converted --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:10:44 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-6ddf74af-68b6-4a88-bcea-396d74baf9e0 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e1263652b2e40c28f34ba7707e7eff23de41f956.converted --force-share --output=json" returned: 0 in 0.143s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:10:44 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-6ddf74af-68b6-4a88-bcea-396d74baf9e0 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "e1263652b2e40c28f34ba7707e7eff23de41f956" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.208s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:10:44 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-6ddf74af-68b6-4a88-bcea-396d74baf9e0 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e1263652b2e40c28f34ba7707e7eff23de41f956 --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:10:45 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-6ddf74af-68b6-4a88-bcea-396d74baf9e0 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e1263652b2e40c28f34ba7707e7eff23de41f956 --force-share --output=json" returned: 0 in 0.140s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:10:45 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-6ddf74af-68b6-4a88-bcea-396d74baf9e0 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Acquiring lock "e1263652b2e40c28f34ba7707e7eff23de41f956" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:10:45 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-6ddf74af-68b6-4a88-bcea-396d74baf9e0 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "e1263652b2e40c28f34ba7707e7eff23de41f956" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:10:45 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-6ddf74af-68b6-4a88-bcea-396d74baf9e0 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e1263652b2e40c28f34ba7707e7eff23de41f956 --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:10:45 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-6ddf74af-68b6-4a88-bcea-396d74baf9e0 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e1263652b2e40c28f34ba7707e7eff23de41f956 --force-share --output=json" returned: 0 in 0.138s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:10:45 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-6ddf74af-68b6-4a88-bcea-396d74baf9e0 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e1263652b2e40c28f34ba7707e7eff23de41f956,backing_fmt=raw /opt/stack/data/nova/instances/d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e/disk 1073741824 {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:10:45 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-6ddf74af-68b6-4a88-bcea-396d74baf9e0 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e1263652b2e40c28f34ba7707e7eff23de41f956,backing_fmt=raw /opt/stack/data/nova/instances/d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e/disk 1073741824" returned: 0 in 0.064s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:10:45 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-6ddf74af-68b6-4a88-bcea-396d74baf9e0 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "e1263652b2e40c28f34ba7707e7eff23de41f956" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.207s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:10:45 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-6ddf74af-68b6-4a88-bcea-396d74baf9e0 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e1263652b2e40c28f34ba7707e7eff23de41f956 --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:10:45 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-6ddf74af-68b6-4a88-bcea-396d74baf9e0 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e1263652b2e40c28f34ba7707e7eff23de41f956 --force-share --output=json" returned: 0 in 0.169s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:10:45 user nova-compute[71874]: DEBUG nova.objects.instance [None req-6ddf74af-68b6-4a88-bcea-396d74baf9e0 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lazy-loading 'migration_context' on Instance uuid d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:10:45 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-6ddf74af-68b6-4a88-bcea-396d74baf9e0 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] Rebasing disk image.
Apr 12 16:10:45 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-6ddf74af-68b6-4a88-bcea-396d74baf9e0 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:10:45 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-6ddf74af-68b6-4a88-bcea-396d74baf9e0 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json" returned: 0 in 0.138s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:10:45 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-6ddf74af-68b6-4a88-bcea-396d74baf9e0 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 -F raw /opt/stack/data/nova/instances/d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e/disk {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:10:47 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-6ddf74af-68b6-4a88-bcea-396d74baf9e0 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 -F raw /opt/stack/data/nova/instances/d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e/disk" returned: 0 in 2.309s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:10:47 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-6ddf74af-68b6-4a88-bcea-396d74baf9e0 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] Created local disks {{(pid=71874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 16:10:47 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-6ddf74af-68b6-4a88-bcea-396d74baf9e0 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] Ensure instance console log exists: /opt/stack/data/nova/instances/d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e/console.log {{(pid=71874) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 16:10:47 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-6ddf74af-68b6-4a88-bcea-396d74baf9e0 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:10:47 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-6ddf74af-68b6-4a88-bcea-396d74baf9e0 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:10:47 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-6ddf74af-68b6-4a88-bcea-396d74baf9e0 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:10:47 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-6ddf74af-68b6-4a88-bcea-396d74baf9e0 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] Start _get_guest_xml network_info=[{"id": "e2e566dd-85b6-43a5-b007-15d987e2af56", "address": "fa:16:3e:88:85:6b", "network": {"id": "eb4dd4b5-96d4-4b53-b510-d41e2775b92f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-596111273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fa122cbabe94c6f93c862b4daf31e50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2e566dd-85", "ovs_interfaceid": "e2e566dd-85b6-43a5-b007-15d987e2af56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='100ed980750e91961bff043f23179b12',container_format='bare',created_at=2023-04-12T16:08:47Z,direct_url=<?>,disk_format='qcow2',id=96eb17ec-ea38-4427-980a-a887b607266b,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-555700697-shelved',owner='1fa122cbabe94c6f93c862b4daf31e50',properties=ImageMetaProps,protected=<?>,size=38600704,status='active',tags=<?>,updated_at=2023-04-12T16:08:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_options': None, 'image_id': '9dc63f14-8b70-4e72-89f2-13464f2f5c7c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 16:10:47 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-6ddf74af-68b6-4a88-bcea-396d74baf9e0 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:10:47 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-6ddf74af-68b6-4a88-bcea-396d74baf9e0 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:10:47 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-6ddf74af-68b6-4a88-bcea-396d74baf9e0 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71874) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 16:10:47 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-6ddf74af-68b6-4a88-bcea-396d74baf9e0 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T15:56:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='100ed980750e91961bff043f23179b12',container_format='bare',created_at=2023-04-12T16:08:47Z,direct_url=<?>,disk_format='qcow2',id=96eb17ec-ea38-4427-980a-a887b607266b,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-555700697-shelved',owner='1fa122cbabe94c6f93c862b4daf31e50',properties=ImageMetaProps,protected=<?>,size=38600704,status='active',tags=<?>,updated_at=2023-04-12T16:08:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 16:10:47 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-6ddf74af-68b6-4a88-bcea-396d74baf9e0 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Flavor limits 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 16:10:47 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-6ddf74af-68b6-4a88-bcea-396d74baf9e0 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Image limits 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 16:10:47 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-6ddf74af-68b6-4a88-bcea-396d74baf9e0 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Flavor pref 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 16:10:47 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-6ddf74af-68b6-4a88-bcea-396d74baf9e0 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Image pref 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 16:10:47 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-6ddf74af-68b6-4a88-bcea-396d74baf9e0 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 16:10:47 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-6ddf74af-68b6-4a88-bcea-396d74baf9e0 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 16:10:47 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-6ddf74af-68b6-4a88-bcea-396d74baf9e0 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 16:10:47 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-6ddf74af-68b6-4a88-bcea-396d74baf9e0 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Got 1 possible topologies {{(pid=71874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 16:10:47 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-6ddf74af-68b6-4a88-bcea-396d74baf9e0 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 16:10:47 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-6ddf74af-68b6-4a88-bcea-396d74baf9e0 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 16:10:47 user nova-compute[71874]: DEBUG nova.objects.instance [None req-6ddf74af-68b6-4a88-bcea-396d74baf9e0 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lazy-loading 'vcpu_model' on Instance uuid d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:10:47 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-6ddf74af-68b6-4a88-bcea-396d74baf9e0 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-12T16:06:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-555700697',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-555700697',id=23,image_ref='96eb17ec-ea38-4427-980a-a887b607266b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-746668212',keypairs=<?>,launch_index=0,launched_at=2023-04-12T16:07:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='1fa122cbabe94c6f93c862b4daf31e50',ramdisk_id='',reservation_id='r-pdzop9wc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-292107264',owner_user_name='tempest-AttachVolumeShelveTestJSON-292107264-project-member',shelved_at='2023-04-12T16:08:50.856428',shelved_host='user',shelved_image_id='96eb17ec-ea38-4427-980a-a887b607266b'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T16:10:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c1abec24caf74dc8a27b64c21a9d4a59',uuid=d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "e2e566dd-85b6-43a5-b007-15d987e2af56", "address": "fa:16:3e:88:85:6b", "network": {"id": "eb4dd4b5-96d4-4b53-b510-d41e2775b92f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-596111273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fa122cbabe94c6f93c862b4daf31e50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2e566dd-85", "ovs_interfaceid": "e2e566dd-85b6-43a5-b007-15d987e2af56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 16:10:47 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-6ddf74af-68b6-4a88-bcea-396d74baf9e0 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Converting VIF {"id": "e2e566dd-85b6-43a5-b007-15d987e2af56", "address": "fa:16:3e:88:85:6b", "network": {"id": "eb4dd4b5-96d4-4b53-b510-d41e2775b92f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-596111273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fa122cbabe94c6f93c862b4daf31e50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2e566dd-85", "ovs_interfaceid": "e2e566dd-85b6-43a5-b007-15d987e2af56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:10:47 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-6ddf74af-68b6-4a88-bcea-396d74baf9e0 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:85:6b,bridge_name='br-int',has_traffic_filtering=True,id=e2e566dd-85b6-43a5-b007-15d987e2af56,network=Network(eb4dd4b5-96d4-4b53-b510-d41e2775b92f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2e566dd-85') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:10:47 user nova-compute[71874]: DEBUG nova.objects.instance [None req-6ddf74af-68b6-4a88-bcea-396d74baf9e0 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lazy-loading 'pci_devices' on Instance uuid d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:10:47 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-6ddf74af-68b6-4a88-bcea-396d74baf9e0 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] End _get_guest_xml xml=<domain type="kvm">
Apr 12 16:10:47 user nova-compute[71874]:   <uuid>d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e</uuid>
Apr 12 16:10:47 user nova-compute[71874]:   <name>instance-00000017</name>
Apr 12 16:10:47 user nova-compute[71874]:   <memory>131072</memory>
Apr 12 16:10:47 user nova-compute[71874]:   <vcpu>1</vcpu>
Apr 12 16:10:47 user nova-compute[71874]:   <metadata>
Apr 12 16:10:47 user nova-compute[71874]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 16:10:47 user nova-compute[71874]:       <nova:package version="0.0.0"/>
Apr 12 16:10:47 user nova-compute[71874]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-555700697</nova:name>
Apr 12 16:10:47 user nova-compute[71874]:       <nova:creationTime>2023-04-12 16:10:47</nova:creationTime>
Apr 12 16:10:47 user nova-compute[71874]:       <nova:flavor name="m1.nano">
Apr 12 16:10:47 user nova-compute[71874]:         <nova:memory>128</nova:memory>
Apr 12 16:10:47 user nova-compute[71874]:         <nova:disk>1</nova:disk>
Apr 12 16:10:47 user nova-compute[71874]:         <nova:swap>0</nova:swap>
Apr 12 16:10:47 user nova-compute[71874]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 16:10:47 user nova-compute[71874]:         <nova:vcpus>1</nova:vcpus>
Apr 12 16:10:47 user nova-compute[71874]:       </nova:flavor>
Apr 12 16:10:47 user nova-compute[71874]:       <nova:owner>
Apr 12 16:10:47 user nova-compute[71874]:         <nova:user uuid="c1abec24caf74dc8a27b64c21a9d4a59">tempest-AttachVolumeShelveTestJSON-292107264-project-member</nova:user>
Apr 12 16:10:47 user nova-compute[71874]:         <nova:project uuid="1fa122cbabe94c6f93c862b4daf31e50">tempest-AttachVolumeShelveTestJSON-292107264</nova:project>
Apr 12 16:10:47 user nova-compute[71874]:       </nova:owner>
Apr 12 16:10:47 user nova-compute[71874]:       <nova:root type="image" uuid="96eb17ec-ea38-4427-980a-a887b607266b"/>
Apr 12 16:10:47 user nova-compute[71874]:       <nova:ports>
Apr 12 16:10:47 user nova-compute[71874]:         <nova:port uuid="e2e566dd-85b6-43a5-b007-15d987e2af56">
Apr 12 16:10:47 user nova-compute[71874]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 12 16:10:47 user nova-compute[71874]:         </nova:port>
Apr 12 16:10:47 user nova-compute[71874]:       </nova:ports>
Apr 12 16:10:47 user nova-compute[71874]:     </nova:instance>
Apr 12 16:10:47 user nova-compute[71874]:   </metadata>
Apr 12 16:10:47 user nova-compute[71874]:   <sysinfo type="smbios">
Apr 12 16:10:47 user nova-compute[71874]:     <system>
Apr 12 16:10:47 user nova-compute[71874]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 16:10:47 user nova-compute[71874]:       <entry name="product">OpenStack Nova</entry>
Apr 12 16:10:47 user nova-compute[71874]:       <entry name="version">0.0.0</entry>
Apr 12 16:10:47 user nova-compute[71874]:       <entry name="serial">d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e</entry>
Apr 12 16:10:47 user nova-compute[71874]:       <entry name="uuid">d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e</entry>
Apr 12 16:10:47 user nova-compute[71874]:       <entry name="family">Virtual Machine</entry>
Apr 12 16:10:47 user nova-compute[71874]:     </system>
Apr 12 16:10:47 user nova-compute[71874]:   </sysinfo>
Apr 12 16:10:47 user nova-compute[71874]:   <os>
Apr 12 16:10:47 user nova-compute[71874]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 16:10:47 user nova-compute[71874]:     <boot dev="hd"/>
Apr 12 16:10:47 user nova-compute[71874]:     <smbios mode="sysinfo"/>
Apr 12 16:10:47 user nova-compute[71874]:   </os>
Apr 12 16:10:47 user nova-compute[71874]:   <features>
Apr 12 16:10:47 user nova-compute[71874]:     <acpi/>
Apr 12 16:10:47 user nova-compute[71874]:     <apic/>
Apr 12 16:10:47 user nova-compute[71874]:     <vmcoreinfo/>
Apr 12 16:10:47 user nova-compute[71874]:   </features>
Apr 12 16:10:47 user nova-compute[71874]:   <clock offset="utc">
Apr 12 16:10:47 user nova-compute[71874]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 16:10:47 user nova-compute[71874]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 16:10:47 user nova-compute[71874]:     <timer name="hpet" present="no"/>
Apr 12 16:10:47 user nova-compute[71874]:   </clock>
Apr 12 16:10:47 user nova-compute[71874]:   <cpu mode="custom" match="exact">
Apr 12 16:10:47 user nova-compute[71874]:     <model>Nehalem</model>
Apr 12 16:10:47 user nova-compute[71874]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 16:10:47 user nova-compute[71874]:   </cpu>
Apr 12 16:10:47 user nova-compute[71874]:   <devices>
Apr 12 16:10:47 user nova-compute[71874]:     <disk type="file" device="disk">
Apr 12 16:10:47 user nova-compute[71874]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 16:10:47 user nova-compute[71874]:       <source file="/opt/stack/data/nova/instances/d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e/disk"/>
Apr 12 16:10:47 user nova-compute[71874]:       <target dev="vda" bus="virtio"/>
Apr 12 16:10:47 user nova-compute[71874]:     </disk>
Apr 12 16:10:47 user nova-compute[71874]:     <interface type="ethernet">
Apr 12 16:10:47 user nova-compute[71874]:       <mac address="fa:16:3e:88:85:6b"/>
Apr 12 16:10:47 user nova-compute[71874]:       <model type="virtio"/>
Apr 12 16:10:47 user nova-compute[71874]:       <mtu size="1442"/>
Apr 12 16:10:47 user nova-compute[71874]:       <target dev="tape2e566dd-85"/>
Apr 12 16:10:47 user nova-compute[71874]:     </interface>
Apr 12 16:10:47 user nova-compute[71874]:     <serial type="pty">
Apr 12 16:10:47 user nova-compute[71874]:       <log file="/opt/stack/data/nova/instances/d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e/console.log" append="off"/>
Apr 12 16:10:47 user nova-compute[71874]:     </serial>
Apr 12 16:10:47 user nova-compute[71874]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 16:10:47 user nova-compute[71874]:     <video>
Apr 12 16:10:47 user nova-compute[71874]:       <model type="virtio"/>
Apr 12 16:10:47 user nova-compute[71874]:     </video>
Apr 12 16:10:47 user nova-compute[71874]:     <rng model="virtio">
Apr 12 16:10:47 user nova-compute[71874]:       <backend model="random">/dev/urandom</backend>
Apr 12 16:10:47 user nova-compute[71874]:     </rng>
Apr 12 16:10:47 user nova-compute[71874]:     <controller type="usb" index="0" model="none"/>
Apr 12 16:10:47 user nova-compute[71874]:     <memballoon model="virtio">
Apr 12 16:10:47 user nova-compute[71874]:       <stats period="10"/>
Apr 12 16:10:47 user nova-compute[71874]:     </memballoon>
Apr 12 16:10:47 user nova-compute[71874]:   </devices>
Apr 12 16:10:47 user nova-compute[71874]: </domain>
Apr 12 16:10:47 user nova-compute[71874]:  {{(pid=71874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 16:10:47 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-6ddf74af-68b6-4a88-bcea-396d74baf9e0 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-12T16:06:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-555700697',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-555700697',id=23,image_ref='96eb17ec-ea38-4427-980a-a887b607266b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-746668212',keypairs=<?>,launch_index=0,launched_at=2023-04-12T16:07:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='1fa122cbabe94c6f93c862b4daf31e50',ramdisk_id='',reservation_id='r-pdzop9wc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-292107264',owner_user_name='tempest-AttachVolumeShelveTestJSON-292107264-project-member',shelved_at='2023-04-12T16:08:50.856428',shelved_host='user',shelved_image_id='96eb17ec-ea38-4427-980a-a887b607266b'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T16:10:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c1abec24caf74dc8a27b64c21a9d4a59',uuid=d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "e2e566dd-85b6-43a5-b007-15d987e2af56", "address": "fa:16:3e:88:85:6b", "network": {"id": "eb4dd4b5-96d4-4b53-b510-d41e2775b92f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-596111273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fa122cbabe94c6f93c862b4daf31e50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2e566dd-85", "ovs_interfaceid": "e2e566dd-85b6-43a5-b007-15d987e2af56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 16:10:47 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-6ddf74af-68b6-4a88-bcea-396d74baf9e0 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Converting VIF {"id": "e2e566dd-85b6-43a5-b007-15d987e2af56", "address": "fa:16:3e:88:85:6b", "network": {"id": "eb4dd4b5-96d4-4b53-b510-d41e2775b92f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-596111273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fa122cbabe94c6f93c862b4daf31e50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2e566dd-85", "ovs_interfaceid": "e2e566dd-85b6-43a5-b007-15d987e2af56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:10:47 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-6ddf74af-68b6-4a88-bcea-396d74baf9e0 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:85:6b,bridge_name='br-int',has_traffic_filtering=True,id=e2e566dd-85b6-43a5-b007-15d987e2af56,network=Network(eb4dd4b5-96d4-4b53-b510-d41e2775b92f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2e566dd-85') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:10:47 user nova-compute[71874]: DEBUG os_vif [None req-6ddf74af-68b6-4a88-bcea-396d74baf9e0 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:85:6b,bridge_name='br-int',has_traffic_filtering=True,id=e2e566dd-85b6-43a5-b007-15d987e2af56,network=Network(eb4dd4b5-96d4-4b53-b510-d41e2775b92f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2e566dd-85') {{(pid=71874) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 16:10:47 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:10:47 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:10:47 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 16:10:47 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:10:47 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape2e566dd-85, may_exist=True) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:10:47 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape2e566dd-85, col_values=(('external_ids', {'iface-id': 'e2e566dd-85b6-43a5-b007-15d987e2af56', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:88:85:6b', 'vm-uuid': 'd9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e'}),)) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:10:47 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:10:47 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:10:47 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:10:47 user nova-compute[71874]: INFO os_vif [None req-6ddf74af-68b6-4a88-bcea-396d74baf9e0 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:85:6b,bridge_name='br-int',has_traffic_filtering=True,id=e2e566dd-85b6-43a5-b007-15d987e2af56,network=Network(eb4dd4b5-96d4-4b53-b510-d41e2775b92f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2e566dd-85')
Apr 12 16:10:48 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:10:48 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-6ddf74af-68b6-4a88-bcea-396d74baf9e0 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] No BDM found with device name vda, not building metadata. {{(pid=71874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 16:10:48 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-6ddf74af-68b6-4a88-bcea-396d74baf9e0 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] No VIF found with MAC fa:16:3e:88:85:6b, not building metadata {{(pid=71874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 16:10:49 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:10:49 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:10:49 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:10:49 user nova-compute[71874]: DEBUG nova.compute.manager [req-741ac562-e5e7-4411-b374-886207d33650 req-9d3965d5-d3e9-45cf-9cc7-d462a1224e8f service nova] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] Received event network-vif-plugged-e2e566dd-85b6-43a5-b007-15d987e2af56 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:10:49 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-741ac562-e5e7-4411-b374-886207d33650 req-9d3965d5-d3e9-45cf-9cc7-d462a1224e8f service nova] Acquiring lock "d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:10:49 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-741ac562-e5e7-4411-b374-886207d33650 req-9d3965d5-d3e9-45cf-9cc7-d462a1224e8f service nova] Lock "d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:10:49 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-741ac562-e5e7-4411-b374-886207d33650 req-9d3965d5-d3e9-45cf-9cc7-d462a1224e8f service nova] Lock "d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:10:49 user nova-compute[71874]: DEBUG nova.compute.manager [req-741ac562-e5e7-4411-b374-886207d33650 req-9d3965d5-d3e9-45cf-9cc7-d462a1224e8f service nova] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] No waiting events found dispatching network-vif-plugged-e2e566dd-85b6-43a5-b007-15d987e2af56 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:10:49 user nova-compute[71874]: WARNING nova.compute.manager [req-741ac562-e5e7-4411-b374-886207d33650 req-9d3965d5-d3e9-45cf-9cc7-d462a1224e8f service nova] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] Received unexpected event network-vif-plugged-e2e566dd-85b6-43a5-b007-15d987e2af56 for instance with vm_state shelved_offloaded and task_state spawning.
Apr 12 16:10:50 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:10:50 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:10:50 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:10:50 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:10:51 user nova-compute[71874]: DEBUG nova.virt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Emitting event <LifecycleEvent: 1681315851.759455, d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e => Resumed> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:10:51 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] VM Resumed (Lifecycle Event)
Apr 12 16:10:51 user nova-compute[71874]: DEBUG nova.compute.manager [None req-6ddf74af-68b6-4a88-bcea-396d74baf9e0 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] Instance event wait completed in 0 seconds for  {{(pid=71874) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 16:10:51 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-6ddf74af-68b6-4a88-bcea-396d74baf9e0 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] Guest created on hypervisor {{(pid=71874) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 16:10:51 user nova-compute[71874]: INFO nova.virt.libvirt.driver [-] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] Instance spawned successfully.
Apr 12 16:10:51 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:10:51 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 16:10:51 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 16:10:51 user nova-compute[71874]: DEBUG nova.virt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Emitting event <LifecycleEvent: 1681315851.7610734, d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e => Started> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:10:51 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] VM Started (Lifecycle Event)
Apr 12 16:10:51 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:10:51 user nova-compute[71874]: DEBUG nova.compute.manager [req-af696299-1076-49a0-bff3-cf9b6c0587d7 req-844f0135-c6f3-4604-8037-2bf41b880e25 service nova] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] Received event network-vif-plugged-e2e566dd-85b6-43a5-b007-15d987e2af56 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:10:51 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-af696299-1076-49a0-bff3-cf9b6c0587d7 req-844f0135-c6f3-4604-8037-2bf41b880e25 service nova] Acquiring lock "d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:10:51 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-af696299-1076-49a0-bff3-cf9b6c0587d7 req-844f0135-c6f3-4604-8037-2bf41b880e25 service nova] Lock "d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:10:51 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-af696299-1076-49a0-bff3-cf9b6c0587d7 req-844f0135-c6f3-4604-8037-2bf41b880e25 service nova] Lock "d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:10:51 user nova-compute[71874]: DEBUG nova.compute.manager [req-af696299-1076-49a0-bff3-cf9b6c0587d7 req-844f0135-c6f3-4604-8037-2bf41b880e25 service nova] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] No waiting events found dispatching network-vif-plugged-e2e566dd-85b6-43a5-b007-15d987e2af56 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:10:51 user nova-compute[71874]: WARNING nova.compute.manager [req-af696299-1076-49a0-bff3-cf9b6c0587d7 req-844f0135-c6f3-4604-8037-2bf41b880e25 service nova] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] Received unexpected event network-vif-plugged-e2e566dd-85b6-43a5-b007-15d987e2af56 for instance with vm_state shelved_offloaded and task_state spawning.
Apr 12 16:10:51 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 16:10:51 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 16:10:51 user nova-compute[71874]: DEBUG nova.compute.manager [None req-6ddf74af-68b6-4a88-bcea-396d74baf9e0 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:10:52 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-6ddf74af-68b6-4a88-bcea-396d74baf9e0 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 12.111s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:10:52 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:10:53 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:10:55 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-8a140bfb-f600-452b-8b01-6480f945f20b tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Acquiring lock "0e8a977c-aa84-47c4-a838-b5f90820de1a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:10:55 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-8a140bfb-f600-452b-8b01-6480f945f20b tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "0e8a977c-aa84-47c4-a838-b5f90820de1a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:10:55 user nova-compute[71874]: DEBUG nova.compute.manager [None req-8a140bfb-f600-452b-8b01-6480f945f20b tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 0e8a977c-aa84-47c4-a838-b5f90820de1a] Starting instance... {{(pid=71874) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 16:10:55 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-8a140bfb-f600-452b-8b01-6480f945f20b tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:10:55 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-8a140bfb-f600-452b-8b01-6480f945f20b tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:10:55 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-8a140bfb-f600-452b-8b01-6480f945f20b tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71874) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 16:10:55 user nova-compute[71874]: INFO nova.compute.claims [None req-8a140bfb-f600-452b-8b01-6480f945f20b tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 0e8a977c-aa84-47c4-a838-b5f90820de1a] Claim successful on node user
Apr 12 16:10:55 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-8a140bfb-f600-452b-8b01-6480f945f20b tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Inventory has not changed in ProviderTree for provider: 0e94b4c8-cd49-45e4-9133-d36eb4b2456b {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 16:10:55 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-8a140bfb-f600-452b-8b01-6480f945f20b tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Inventory has not changed for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 16:10:55 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-8a140bfb-f600-452b-8b01-6480f945f20b tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.516s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:10:55 user nova-compute[71874]: DEBUG nova.compute.manager [None req-8a140bfb-f600-452b-8b01-6480f945f20b tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 0e8a977c-aa84-47c4-a838-b5f90820de1a] Start building networks asynchronously for instance. {{(pid=71874) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 16:10:55 user nova-compute[71874]: DEBUG nova.compute.manager [None req-8a140bfb-f600-452b-8b01-6480f945f20b tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 0e8a977c-aa84-47c4-a838-b5f90820de1a] Allocating IP information in the background. {{(pid=71874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 16:10:55 user nova-compute[71874]: DEBUG nova.network.neutron [None req-8a140bfb-f600-452b-8b01-6480f945f20b tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 0e8a977c-aa84-47c4-a838-b5f90820de1a] allocate_for_instance() {{(pid=71874) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 16:10:55 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-8a140bfb-f600-452b-8b01-6480f945f20b tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 0e8a977c-aa84-47c4-a838-b5f90820de1a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 16:10:55 user nova-compute[71874]: DEBUG nova.compute.manager [None req-8a140bfb-f600-452b-8b01-6480f945f20b tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 0e8a977c-aa84-47c4-a838-b5f90820de1a] Start building block device mappings for instance. {{(pid=71874) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 16:10:55 user nova-compute[71874]: INFO nova.virt.block_device [None req-8a140bfb-f600-452b-8b01-6480f945f20b tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 0e8a977c-aa84-47c4-a838-b5f90820de1a] Booting with volume-backed-image 9dc63f14-8b70-4e72-89f2-13464f2f5c7c at /dev/vda
Apr 12 16:10:55 user nova-compute[71874]: DEBUG nova.policy [None req-8a140bfb-f600-452b-8b01-6480f945f20b tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '73f9fa5bc22a4824b3cdcb8cf7bb380c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9210f81232304e179d3e09914a492442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71874) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 16:10:56 user nova-compute[71874]: DEBUG nova.network.neutron [None req-8a140bfb-f600-452b-8b01-6480f945f20b tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 0e8a977c-aa84-47c4-a838-b5f90820de1a] Successfully created port: 40e16d3f-2e2e-45df-be16-ef3622bfde2e {{(pid=71874) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 16:10:57 user nova-compute[71874]: DEBUG nova.network.neutron [None req-8a140bfb-f600-452b-8b01-6480f945f20b tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 0e8a977c-aa84-47c4-a838-b5f90820de1a] Successfully updated port: 40e16d3f-2e2e-45df-be16-ef3622bfde2e {{(pid=71874) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 16:10:57 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-8a140bfb-f600-452b-8b01-6480f945f20b tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Acquiring lock "refresh_cache-0e8a977c-aa84-47c4-a838-b5f90820de1a" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:10:57 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-8a140bfb-f600-452b-8b01-6480f945f20b tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Acquired lock "refresh_cache-0e8a977c-aa84-47c4-a838-b5f90820de1a" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:10:57 user nova-compute[71874]: DEBUG nova.network.neutron [None req-8a140bfb-f600-452b-8b01-6480f945f20b tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 0e8a977c-aa84-47c4-a838-b5f90820de1a] Building network info cache for instance {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 16:10:57 user nova-compute[71874]: DEBUG nova.compute.manager [req-193b7f93-49e1-4130-a557-a1e72507b058 req-25238a38-e933-4310-b806-f3b7b63380bc service nova] [instance: 0e8a977c-aa84-47c4-a838-b5f90820de1a] Received event network-changed-40e16d3f-2e2e-45df-be16-ef3622bfde2e {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:10:57 user nova-compute[71874]: DEBUG nova.compute.manager [req-193b7f93-49e1-4130-a557-a1e72507b058 req-25238a38-e933-4310-b806-f3b7b63380bc service nova] [instance: 0e8a977c-aa84-47c4-a838-b5f90820de1a] Refreshing instance network info cache due to event network-changed-40e16d3f-2e2e-45df-be16-ef3622bfde2e. {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 16:10:57 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-193b7f93-49e1-4130-a557-a1e72507b058 req-25238a38-e933-4310-b806-f3b7b63380bc service nova] Acquiring lock "refresh_cache-0e8a977c-aa84-47c4-a838-b5f90820de1a" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:10:57 user nova-compute[71874]: DEBUG nova.network.neutron [None req-8a140bfb-f600-452b-8b01-6480f945f20b tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 0e8a977c-aa84-47c4-a838-b5f90820de1a] Instance cache missing network info. {{(pid=71874) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 16:10:57 user nova-compute[71874]: DEBUG nova.network.neutron [None req-8a140bfb-f600-452b-8b01-6480f945f20b tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 0e8a977c-aa84-47c4-a838-b5f90820de1a] Updating instance_info_cache with network_info: [{"id": "40e16d3f-2e2e-45df-be16-ef3622bfde2e", "address": "fa:16:3e:4d:9c:b1", "network": {"id": "b36306e0-04c5-4b1b-8022-05ff121c4e43", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1503204786-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9210f81232304e179d3e09914a492442", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40e16d3f-2e", "ovs_interfaceid": "40e16d3f-2e2e-45df-be16-ef3622bfde2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:10:57 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-8a140bfb-f600-452b-8b01-6480f945f20b tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Releasing lock "refresh_cache-0e8a977c-aa84-47c4-a838-b5f90820de1a" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:10:57 user nova-compute[71874]: DEBUG nova.compute.manager [None req-8a140bfb-f600-452b-8b01-6480f945f20b tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 0e8a977c-aa84-47c4-a838-b5f90820de1a] Instance network_info: |[{"id": "40e16d3f-2e2e-45df-be16-ef3622bfde2e", "address": "fa:16:3e:4d:9c:b1", "network": {"id": "b36306e0-04c5-4b1b-8022-05ff121c4e43", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1503204786-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9210f81232304e179d3e09914a492442", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40e16d3f-2e", "ovs_interfaceid": "40e16d3f-2e2e-45df-be16-ef3622bfde2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 16:10:57 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-193b7f93-49e1-4130-a557-a1e72507b058 req-25238a38-e933-4310-b806-f3b7b63380bc service nova] Acquired lock "refresh_cache-0e8a977c-aa84-47c4-a838-b5f90820de1a" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:10:57 user nova-compute[71874]: DEBUG nova.network.neutron [req-193b7f93-49e1-4130-a557-a1e72507b058 req-25238a38-e933-4310-b806-f3b7b63380bc service nova] [instance: 0e8a977c-aa84-47c4-a838-b5f90820de1a] Refreshing network info cache for port 40e16d3f-2e2e-45df-be16-ef3622bfde2e {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 16:10:57 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:10:58 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:10:58 user nova-compute[71874]: DEBUG nova.network.neutron [req-193b7f93-49e1-4130-a557-a1e72507b058 req-25238a38-e933-4310-b806-f3b7b63380bc service nova] [instance: 0e8a977c-aa84-47c4-a838-b5f90820de1a] Updated VIF entry in instance network info cache for port 40e16d3f-2e2e-45df-be16-ef3622bfde2e. {{(pid=71874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 16:10:58 user nova-compute[71874]: DEBUG nova.network.neutron [req-193b7f93-49e1-4130-a557-a1e72507b058 req-25238a38-e933-4310-b806-f3b7b63380bc service nova] [instance: 0e8a977c-aa84-47c4-a838-b5f90820de1a] Updating instance_info_cache with network_info: [{"id": "40e16d3f-2e2e-45df-be16-ef3622bfde2e", "address": "fa:16:3e:4d:9c:b1", "network": {"id": "b36306e0-04c5-4b1b-8022-05ff121c4e43", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1503204786-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9210f81232304e179d3e09914a492442", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40e16d3f-2e", "ovs_interfaceid": "40e16d3f-2e2e-45df-be16-ef3622bfde2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:10:58 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-193b7f93-49e1-4130-a557-a1e72507b058 req-25238a38-e933-4310-b806-f3b7b63380bc service nova] Releasing lock "refresh_cache-0e8a977c-aa84-47c4-a838-b5f90820de1a" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:11:01 user nova-compute[71874]: DEBUG os_brick.utils [None req-8a140bfb-f600-452b-8b01-6480f945f20b tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:11:01 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:11:01 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:11:01 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[31350447-fba2-4c30-af50-e32f3c58ca38]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:61a48d4489d2\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:11:01 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:11:01 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.032s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:11:01 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6ce5914-497c-43d1-987a-114f0ed07359]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:11:01 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:11:01 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.031s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:11:01 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[66870224-34e2-4f53-99cc-2b5a2949d89a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:11:01 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa0048cd-6ddc-4b74-9e34-5174395f668a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:11:01 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-8a140bfb-f600-452b-8b01-6480f945f20b tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Running cmd (subprocess): nvme version {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:11:01 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-8a140bfb-f600-452b-8b01-6480f945f20b tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] 'nvme version' failed. Not Retrying. {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 16:11:01 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8a140bfb-f600-452b-8b01-6480f945f20b tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] nvme not present on system {{(pid=71874) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 16:11:01 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:11:01 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 16:11:01 user nova-compute[71874]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 16:11:01 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[d14fff01-3ba8-49ea-920f-47f924f1390c]: (4, '') {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:11:01 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.lightos [None req-8a140bfb-f600-452b-8b01-6480f945f20b tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71874) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 16:11:01 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.lightos [None req-8a140bfb-f600-452b-8b01-6480f945f20b tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71874) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 16:11:01 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.lightos [None req-8a140bfb-f600-452b-8b01-6480f945f20b tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] LIGHTOS: no hostnqn found. {{(pid=71874) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 16:11:01 user nova-compute[71874]: DEBUG os_brick.utils [None req-8a140bfb-f600-452b-8b01-6480f945f20b tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] <== get_connector_properties: return (157ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:61a48d4489d2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:11:01 user nova-compute[71874]: DEBUG nova.virt.block_device [None req-8a140bfb-f600-452b-8b01-6480f945f20b tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 0e8a977c-aa84-47c4-a838-b5f90820de1a] Updating existing volume attachment record: d88609d1-a4cf-423e-84be-9a7a0cab6e3d {{(pid=71874) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 16:11:02 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:11:03 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:11:05 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-431119d3-1cb2-4ccc-8dc9-d707251ee375 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Acquiring lock "6caa4977-8333-4171-8825-2c3bfb52f80b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:11:05 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-431119d3-1cb2-4ccc-8dc9-d707251ee375 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Lock "6caa4977-8333-4171-8825-2c3bfb52f80b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:11:05 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-431119d3-1cb2-4ccc-8dc9-d707251ee375 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Acquiring lock "6caa4977-8333-4171-8825-2c3bfb52f80b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:11:05 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-431119d3-1cb2-4ccc-8dc9-d707251ee375 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Lock "6caa4977-8333-4171-8825-2c3bfb52f80b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:11:05 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-431119d3-1cb2-4ccc-8dc9-d707251ee375 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Lock "6caa4977-8333-4171-8825-2c3bfb52f80b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:11:05 user nova-compute[71874]: INFO nova.compute.manager [None req-431119d3-1cb2-4ccc-8dc9-d707251ee375 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Terminating instance
Apr 12 16:11:05 user nova-compute[71874]: DEBUG nova.compute.manager [None req-431119d3-1cb2-4ccc-8dc9-d707251ee375 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Start destroying the instance on the hypervisor. {{(pid=71874) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 16:11:05 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:11:05 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:11:05 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:11:05 user nova-compute[71874]: DEBUG nova.compute.manager [req-a7c92fad-1bbb-4e07-97bf-41d8009b57d6 req-e875b023-14db-4bd6-bae9-ce40a9dd8079 service nova] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Received event network-vif-unplugged-c42ace22-d91b-4e4b-909e-19aaa428515a {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:11:05 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-a7c92fad-1bbb-4e07-97bf-41d8009b57d6 req-e875b023-14db-4bd6-bae9-ce40a9dd8079 service nova] Acquiring lock "6caa4977-8333-4171-8825-2c3bfb52f80b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:11:05 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-a7c92fad-1bbb-4e07-97bf-41d8009b57d6 req-e875b023-14db-4bd6-bae9-ce40a9dd8079 service nova] Lock "6caa4977-8333-4171-8825-2c3bfb52f80b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:11:05 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-a7c92fad-1bbb-4e07-97bf-41d8009b57d6 req-e875b023-14db-4bd6-bae9-ce40a9dd8079 service nova] Lock "6caa4977-8333-4171-8825-2c3bfb52f80b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:11:05 user nova-compute[71874]: DEBUG nova.compute.manager [req-a7c92fad-1bbb-4e07-97bf-41d8009b57d6 req-e875b023-14db-4bd6-bae9-ce40a9dd8079 service nova] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] No waiting events found dispatching network-vif-unplugged-c42ace22-d91b-4e4b-909e-19aaa428515a {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:11:05 user nova-compute[71874]: DEBUG nova.compute.manager [req-a7c92fad-1bbb-4e07-97bf-41d8009b57d6 req-e875b023-14db-4bd6-bae9-ce40a9dd8079 service nova] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Received event network-vif-unplugged-c42ace22-d91b-4e4b-909e-19aaa428515a for instance with task_state deleting. {{(pid=71874) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 16:11:05 user nova-compute[71874]: INFO nova.virt.libvirt.driver [-] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Instance destroyed successfully.
Apr 12 16:11:05 user nova-compute[71874]: DEBUG nova.objects.instance [None req-431119d3-1cb2-4ccc-8dc9-d707251ee375 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Lazy-loading 'resources' on Instance uuid 6caa4977-8333-4171-8825-2c3bfb52f80b {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:11:05 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-431119d3-1cb2-4ccc-8dc9-d707251ee375 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T16:03:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-689097339',display_name='tempest-ServerStableDeviceRescueTest-server-689097339',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-689097339',id=18,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAam8LYyB+LjNdQE4JBvTI3p3CIYJWs7/MCfiZUy9Xd8eIW/jYHvtZuhkG/lsvTL9zeSBHrSduF7W+pN/Bj80hUnONEMW2bSoSjFErg09RBlgz7o7NI0zfHfHDu88Z99bg==',key_name='tempest-keypair-1356498122',keypairs=<?>,launch_index=0,launched_at=2023-04-12T16:07:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3deffbb4769b4985b038b4adcd82b018',ramdisk_id='',reservation_id='r-vjrj0b0t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-692889073',owner_user_name='tempest-ServerStableDeviceRescueTest-692889073-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T16:09:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f76e286bd75a4cbaad7a7b735014f3d7',uuid=6caa4977-8333-4171-8825-2c3bfb52f80b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c42ace22-d91b-4e4b-909e-19aaa428515a", "address": "fa:16:3e:3e:cd:0b", "network": {"id": "0e139ef7-ae53-4cce-9063-218ac1a19c0c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2058204483-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3deffbb4769b4985b038b4adcd82b018", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc42ace22-d9", "ovs_interfaceid": "c42ace22-d91b-4e4b-909e-19aaa428515a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 16:11:05 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-431119d3-1cb2-4ccc-8dc9-d707251ee375 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Converting VIF {"id": "c42ace22-d91b-4e4b-909e-19aaa428515a", "address": "fa:16:3e:3e:cd:0b", "network": {"id": "0e139ef7-ae53-4cce-9063-218ac1a19c0c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2058204483-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3deffbb4769b4985b038b4adcd82b018", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc42ace22-d9", "ovs_interfaceid": "c42ace22-d91b-4e4b-909e-19aaa428515a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:11:05 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-431119d3-1cb2-4ccc-8dc9-d707251ee375 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3e:cd:0b,bridge_name='br-int',has_traffic_filtering=True,id=c42ace22-d91b-4e4b-909e-19aaa428515a,network=Network(0e139ef7-ae53-4cce-9063-218ac1a19c0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc42ace22-d9') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:11:05 user nova-compute[71874]: DEBUG os_vif [None req-431119d3-1cb2-4ccc-8dc9-d707251ee375 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3e:cd:0b,bridge_name='br-int',has_traffic_filtering=True,id=c42ace22-d91b-4e4b-909e-19aaa428515a,network=Network(0e139ef7-ae53-4cce-9063-218ac1a19c0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc42ace22-d9') {{(pid=71874) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 16:11:05 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:11:05 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc42ace22-d9, bridge=br-int, if_exists=True) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:11:05 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:11:05 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:11:05 user nova-compute[71874]: INFO os_vif [None req-431119d3-1cb2-4ccc-8dc9-d707251ee375 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3e:cd:0b,bridge_name='br-int',has_traffic_filtering=True,id=c42ace22-d91b-4e4b-909e-19aaa428515a,network=Network(0e139ef7-ae53-4cce-9063-218ac1a19c0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc42ace22-d9')
Apr 12 16:11:05 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-431119d3-1cb2-4ccc-8dc9-d707251ee375 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Deleting instance files /opt/stack/data/nova/instances/6caa4977-8333-4171-8825-2c3bfb52f80b_del
Apr 12 16:11:05 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-431119d3-1cb2-4ccc-8dc9-d707251ee375 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Deletion of /opt/stack/data/nova/instances/6caa4977-8333-4171-8825-2c3bfb52f80b_del complete
Apr 12 16:11:06 user nova-compute[71874]: INFO nova.compute.manager [None req-431119d3-1cb2-4ccc-8dc9-d707251ee375 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Took 0.88 seconds to destroy the instance on the hypervisor.
Apr 12 16:11:06 user nova-compute[71874]: DEBUG oslo.service.loopingcall [None req-431119d3-1cb2-4ccc-8dc9-d707251ee375 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71874) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 16:11:06 user nova-compute[71874]: DEBUG nova.compute.manager [-] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Deallocating network for instance {{(pid=71874) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 16:11:06 user nova-compute[71874]: DEBUG nova.network.neutron [-] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] deallocate_for_instance() {{(pid=71874) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 16:11:06 user nova-compute[71874]: DEBUG nova.compute.manager [None req-8a140bfb-f600-452b-8b01-6480f945f20b tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 0e8a977c-aa84-47c4-a838-b5f90820de1a] Start spawning the instance on the hypervisor. {{(pid=71874) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 16:11:06 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-8a140bfb-f600-452b-8b01-6480f945f20b tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 0e8a977c-aa84-47c4-a838-b5f90820de1a] Creating instance directory {{(pid=71874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 16:11:06 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-8a140bfb-f600-452b-8b01-6480f945f20b tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 0e8a977c-aa84-47c4-a838-b5f90820de1a] Creating image(s)
Apr 12 16:11:06 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-8a140bfb-f600-452b-8b01-6480f945f20b tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 0e8a977c-aa84-47c4-a838-b5f90820de1a] Did not create local disks {{(pid=71874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 12 16:11:06 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-8a140bfb-f600-452b-8b01-6480f945f20b tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 0e8a977c-aa84-47c4-a838-b5f90820de1a] Ensure instance console log exists: /opt/stack/data/nova/instances/0e8a977c-aa84-47c4-a838-b5f90820de1a/console.log {{(pid=71874) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 16:11:06 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-8a140bfb-f600-452b-8b01-6480f945f20b tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:11:06 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-8a140bfb-f600-452b-8b01-6480f945f20b tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:11:06 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-8a140bfb-f600-452b-8b01-6480f945f20b tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:11:06 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-8a140bfb-f600-452b-8b01-6480f945f20b tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 0e8a977c-aa84-47c4-a838-b5f90820de1a] Start _get_guest_xml network_info=[{"id": "40e16d3f-2e2e-45df-be16-ef3622bfde2e", "address": "fa:16:3e:4d:9c:b1", "network": {"id": "b36306e0-04c5-4b1b-8022-05ff121c4e43", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1503204786-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9210f81232304e179d3e09914a492442", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40e16d3f-2e", "ovs_interfaceid": "40e16d3f-2e2e-45df-be16-ef3622bfde2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T15:55:37Z,direct_url=<?>,disk_format='qcow2',id=9dc63f14-8b70-4e72-89f2-13464f2f5c7c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='61a4936d9b7744c0b488d81c9b7746b6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T15:55:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'delete_on_termination': False, 'attachment_id': 'd88609d1-a4cf-423e-84be-9a7a0cab6e3d', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IwmgRBMr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0e8a977c-aa84-47c4-a838-b5f90820de1a', 'attached_at': '', 'detached_at': '', 'volume_id': '5c31b819-b8c1-4c22-b9c6-d276f2c03304', 'serial': '5c31b819-b8c1-4c22-b9c6-d276f2c03304'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'volume_type': None} {{(pid=71874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 16:11:06 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-8a140bfb-f600-452b-8b01-6480f945f20b tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:11:06 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-8a140bfb-f600-452b-8b01-6480f945f20b tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:11:06 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-8a140bfb-f600-452b-8b01-6480f945f20b tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71874) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 16:11:06 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-8a140bfb-f600-452b-8b01-6480f945f20b tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T15:56:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T15:55:37Z,direct_url=<?>,disk_format='qcow2',id=9dc63f14-8b70-4e72-89f2-13464f2f5c7c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='61a4936d9b7744c0b488d81c9b7746b6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T15:55:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 16:11:06 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-8a140bfb-f600-452b-8b01-6480f945f20b tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Flavor limits 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 16:11:06 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-8a140bfb-f600-452b-8b01-6480f945f20b tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Image limits 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 16:11:06 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-8a140bfb-f600-452b-8b01-6480f945f20b tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Flavor pref 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 16:11:06 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-8a140bfb-f600-452b-8b01-6480f945f20b tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Image pref 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 16:11:06 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-8a140bfb-f600-452b-8b01-6480f945f20b tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 16:11:06 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-8a140bfb-f600-452b-8b01-6480f945f20b tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 16:11:06 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-8a140bfb-f600-452b-8b01-6480f945f20b tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 16:11:06 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-8a140bfb-f600-452b-8b01-6480f945f20b tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Got 1 possible topologies {{(pid=71874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 16:11:06 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-8a140bfb-f600-452b-8b01-6480f945f20b tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 16:11:06 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-8a140bfb-f600-452b-8b01-6480f945f20b tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 16:11:06 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a140bfb-f600-452b-8b01-6480f945f20b tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 0e8a977c-aa84-47c4-a838-b5f90820de1a] Calling os-brick to attach iSCSI Volume {{(pid=71874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 16:11:06 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a140bfb-f600-452b-8b01-6480f945f20b tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3c0216320>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IwmgRBMr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:11:06 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-8a140bfb-f600-452b-8b01-6480f945f20b tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:11:06 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-8a140bfb-f600-452b-8b01-6480f945f20b tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:11:06 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-8a140bfb-f600-452b-8b01-6480f945f20b tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:11:06 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-8a140bfb-f600-452b-8b01-6480f945f20b tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:11:06 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-8a140bfb-f600-452b-8b01-6480f945f20b tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:11:06 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-8a140bfb-f600-452b-8b01-6480f945f20b tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:11:06 user nova-compute[71874]: INFO os_brick.initiator.connectors.iscsi [None req-8a140bfb-f600-452b-8b01-6480f945f20b tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 16:11:06 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304 -p 172.16.0.220:3260 {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:11:06 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:11:06 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e0d39b5-f094-4546-96cb-c4a0c44738b1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:11:06 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a140bfb-f600-452b-8b01-6480f945f20b tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 16:11:06 user nova-compute[71874]:  {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:11:06 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304 -p 172.16.0.220:3260 --interface default --op new {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:11:06 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:11:06 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b611d45-87f6-48c6-a934-37e041799ba5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304] added\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:11:06 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a140bfb-f600-452b-8b01-6480f945f20b tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304] added
Apr 12 16:11:06 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:11:06 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:11:06 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:11:06 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[efa4f236-4ddf-46dd-87f6-5baec109d6cd]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:11:06 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a140bfb-f600-452b-8b01-6480f945f20b tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:11:06 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:11:06 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:11:06 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[91ef4497-f229-4302-83b0-7434a5476996]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:11:06 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a140bfb-f600-452b-8b01-6480f945f20b tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:11:06 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IwmgRBMr {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:11:06 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IwmgRBMr" returned: 0 in 0.024s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:11:06 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4df5b1c-5404-4a22-b451-d8661424e47a]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:11:06 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a140bfb-f600-452b-8b01-6480f945f20b tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IwmgRBMr'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:11:06 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:11:06 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:11:06 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbd74f62-5454-4ed0-bb57-5c3e709b9dd1]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:11:06 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a140bfb-f600-452b-8b01-6480f945f20b tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:11:06 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:11:06 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:11:06 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf02c0a2-2753-4807-86bd-63d3d7c16a88]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f27a002-8dfc-4d90-aa35-ba16586d4366 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c961fcc-0ff0-4275-9163-406662b265f8 (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:11:06 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a140bfb-f600-452b-8b01-6480f945f20b tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:11:06 user nova-compute[71874]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f27a002-8dfc-4d90-aa35-ba16586d4366 (non-flash)
Apr 12 16:11:06 user nova-compute[71874]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 (non-flash)
Apr 12 16:11:06 user nova-compute[71874]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c961fcc-0ff0-4275-9163-406662b265f8 (non-flash)
Apr 12 16:11:06 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:11:06 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a140bfb-f600-452b-8b01-6480f945f20b tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:11:06 user nova-compute[71874]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f27a002-8dfc-4d90-aa35-ba16586d4366 (non-flash)
Apr 12 16:11:06 user nova-compute[71874]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 (non-flash)
Apr 12 16:11:06 user nova-compute[71874]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c961fcc-0ff0-4275-9163-406662b265f8 (non-flash)
Apr 12 16:11:06 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:11:06 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304 -p 172.16.0.220:3260 --login {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:11:06 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:11:06 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[962cfadc-2f0e-497f-bc19-f5669f19e4a7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:11:06 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a140bfb-f600-452b-8b01-6480f945f20b tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304, portal: 172.16.0.220,3260]
Apr 12 16:11:06 user nova-compute[71874]: Login to [iface: default, target: iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304, portal: 172.16.0.220,3260] successful.
Apr 12 16:11:06 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:11:06 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:11:06 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:11:06 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5e3d9d3-5997-415a-a13b-f0b7f376e5bf]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:11:06 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a140bfb-f600-452b-8b01-6480f945f20b tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:11:06 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:11:06 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:11:06 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[18ee9cdb-d008-4849-9684-99d6eef1a31d]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f27a002-8dfc-4d90-aa35-ba16586d4366 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c961fcc-0ff0-4275-9163-406662b265f8 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304 (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:11:06 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a140bfb-f600-452b-8b01-6480f945f20b tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:11:06 user nova-compute[71874]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f27a002-8dfc-4d90-aa35-ba16586d4366 (non-flash)
Apr 12 16:11:06 user nova-compute[71874]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 (non-flash)
Apr 12 16:11:06 user nova-compute[71874]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c961fcc-0ff0-4275-9163-406662b265f8 (non-flash)
Apr 12 16:11:06 user nova-compute[71874]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304 (non-flash)
Apr 12 16:11:06 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:11:06 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a140bfb-f600-452b-8b01-6480f945f20b tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:11:06 user nova-compute[71874]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f27a002-8dfc-4d90-aa35-ba16586d4366 (non-flash)
Apr 12 16:11:06 user nova-compute[71874]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 (non-flash)
Apr 12 16:11:06 user nova-compute[71874]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c961fcc-0ff0-4275-9163-406662b265f8 (non-flash)
Apr 12 16:11:06 user nova-compute[71874]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304 (non-flash)
Apr 12 16:11:06 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:11:06 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-8a140bfb-f600-452b-8b01-6480f945f20b tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.301s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:11:06 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a140bfb-f600-452b-8b01-6480f945f20b tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Connected to 172.16.0.220:3260 {{(pid=71874) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 16:11:06 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-8a140bfb-f600-452b-8b01-6480f945f20b tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] HCTL ('37', '-', '-', 0) found on session 32 with lun 0 {{(pid=71874) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 16:11:06 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-8a140bfb-f600-452b-8b01-6480f945f20b tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=71874) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 16:11:06 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:11:06 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.021s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:11:06 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[93c0154f-4f1a-41fd-88b5-e86b9ca13bd2]: (4, ('- - 0', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:11:06 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-8a140bfb-f600-452b-8b01-6480f945f20b tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Searching for a device in session 32 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=71874) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 16:11:06 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a140bfb-f600-452b-8b01-6480f945f20b tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IwmgRBMr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71874) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 16:11:06 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:11:06 user nova-compute[71874]: DEBUG nova.network.neutron [-] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Updating instance_info_cache with network_info: [] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:11:06 user nova-compute[71874]: INFO nova.compute.manager [-] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Took 0.82 seconds to deallocate network for instance.
Apr 12 16:11:06 user nova-compute[71874]: DEBUG nova.compute.manager [req-15b53b85-81ca-4c28-886b-1c7b23ed33db req-dda8debb-3d6d-496a-a765-5d2272427d6f service nova] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Received event network-vif-deleted-c42ace22-d91b-4e4b-909e-19aaa428515a {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:11:06 user nova-compute[71874]: INFO nova.compute.manager [req-15b53b85-81ca-4c28-886b-1c7b23ed33db req-dda8debb-3d6d-496a-a765-5d2272427d6f service nova] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Neutron deleted interface c42ace22-d91b-4e4b-909e-19aaa428515a; detaching it from the instance and deleting it from the info cache
Apr 12 16:11:06 user nova-compute[71874]: DEBUG nova.network.neutron [req-15b53b85-81ca-4c28-886b-1c7b23ed33db req-dda8debb-3d6d-496a-a765-5d2272427d6f service nova] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Updating instance_info_cache with network_info: [] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:11:06 user nova-compute[71874]: DEBUG nova.compute.manager [req-15b53b85-81ca-4c28-886b-1c7b23ed33db req-dda8debb-3d6d-496a-a765-5d2272427d6f service nova] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Detach interface failed, port_id=c42ace22-d91b-4e4b-909e-19aaa428515a, reason: Instance 6caa4977-8333-4171-8825-2c3bfb52f80b could not be found. {{(pid=71874) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 12 16:11:06 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-431119d3-1cb2-4ccc-8dc9-d707251ee375 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:11:06 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-431119d3-1cb2-4ccc-8dc9-d707251ee375 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:11:07 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-431119d3-1cb2-4ccc-8dc9-d707251ee375 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Inventory has not changed in ProviderTree for provider: 0e94b4c8-cd49-45e4-9133-d36eb4b2456b {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 16:11:07 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-431119d3-1cb2-4ccc-8dc9-d707251ee375 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Inventory has not changed for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 16:11:07 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-431119d3-1cb2-4ccc-8dc9-d707251ee375 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.432s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:11:07 user nova-compute[71874]: INFO nova.scheduler.client.report [None req-431119d3-1cb2-4ccc-8dc9-d707251ee375 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Deleted allocations for instance 6caa4977-8333-4171-8825-2c3bfb52f80b
Apr 12 16:11:07 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-431119d3-1cb2-4ccc-8dc9-d707251ee375 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Lock "6caa4977-8333-4171-8825-2c3bfb52f80b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.325s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:11:07 user nova-compute[71874]: DEBUG nova.compute.manager [req-35059430-15b5-45da-ab79-1cd748426db4 req-836ba7e7-4a98-4de6-80f7-ee34d5c4789a service nova] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Received event network-vif-plugged-c42ace22-d91b-4e4b-909e-19aaa428515a {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:11:07 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-35059430-15b5-45da-ab79-1cd748426db4 req-836ba7e7-4a98-4de6-80f7-ee34d5c4789a service nova] Acquiring lock "6caa4977-8333-4171-8825-2c3bfb52f80b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:11:07 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-35059430-15b5-45da-ab79-1cd748426db4 req-836ba7e7-4a98-4de6-80f7-ee34d5c4789a service nova] Lock "6caa4977-8333-4171-8825-2c3bfb52f80b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:11:07 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-35059430-15b5-45da-ab79-1cd748426db4 req-836ba7e7-4a98-4de6-80f7-ee34d5c4789a service nova] Lock "6caa4977-8333-4171-8825-2c3bfb52f80b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:11:07 user nova-compute[71874]: DEBUG nova.compute.manager [req-35059430-15b5-45da-ab79-1cd748426db4 req-836ba7e7-4a98-4de6-80f7-ee34d5c4789a service nova] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] No waiting events found dispatching network-vif-plugged-c42ace22-d91b-4e4b-909e-19aaa428515a {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:11:07 user nova-compute[71874]: WARNING nova.compute.manager [req-35059430-15b5-45da-ab79-1cd748426db4 req-836ba7e7-4a98-4de6-80f7-ee34d5c4789a service nova] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Received unexpected event network-vif-plugged-c42ace22-d91b-4e4b-909e-19aaa428515a for instance with vm_state deleted and task_state None.
Apr 12 16:11:07 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-8a140bfb-f600-452b-8b01-6480f945f20b tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.345s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:11:07 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a140bfb-f600-452b-8b01-6480f945f20b tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] <== connect_volume: return (1347ms) {'type': 'block', 'scsi_wwn': '23736366233343638', 'path': '/dev/sdf'} {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:11:07 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a140bfb-f600-452b-8b01-6480f945f20b tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 0e8a977c-aa84-47c4-a838-b5f90820de1a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23736366233343638', 'path': '/dev/sdf'} {{(pid=71874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 16:11:07 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-8a140bfb-f600-452b-8b01-6480f945f20b tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T16:10:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1308581862',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1308581862',id=31,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9210f81232304e179d3e09914a492442',ramdisk_id='',reservation_id='r-ji74zs90',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1443944578',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T16:10:56Z,user_data=None,user_id='73f9fa5bc22a4824b3cdcb8cf7bb380c',uuid=0e8a977c-aa84-47c4-a838-b5f90820de1a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "40e16d3f-2e2e-45df-be16-ef3622bfde2e", "address": "fa:16:3e:4d:9c:b1", "network": {"id": "b36306e0-04c5-4b1b-8022-05ff121c4e43", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1503204786-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9210f81232304e179d3e09914a492442", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40e16d3f-2e", "ovs_interfaceid": "40e16d3f-2e2e-45df-be16-ef3622bfde2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 16:11:07 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-8a140bfb-f600-452b-8b01-6480f945f20b tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Converting VIF {"id": "40e16d3f-2e2e-45df-be16-ef3622bfde2e", "address": "fa:16:3e:4d:9c:b1", "network": {"id": "b36306e0-04c5-4b1b-8022-05ff121c4e43", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1503204786-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9210f81232304e179d3e09914a492442", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40e16d3f-2e", "ovs_interfaceid": "40e16d3f-2e2e-45df-be16-ef3622bfde2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:11:07 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-8a140bfb-f600-452b-8b01-6480f945f20b tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:9c:b1,bridge_name='br-int',has_traffic_filtering=True,id=40e16d3f-2e2e-45df-be16-ef3622bfde2e,network=Network(b36306e0-04c5-4b1b-8022-05ff121c4e43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40e16d3f-2e') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:11:07 user nova-compute[71874]: DEBUG nova.objects.instance [None req-8a140bfb-f600-452b-8b01-6480f945f20b tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lazy-loading 'pci_devices' on Instance uuid 0e8a977c-aa84-47c4-a838-b5f90820de1a {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:11:07 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-8a140bfb-f600-452b-8b01-6480f945f20b tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 0e8a977c-aa84-47c4-a838-b5f90820de1a] End _get_guest_xml xml=<domain type="kvm">
Apr 12 16:11:07 user nova-compute[71874]:   <uuid>0e8a977c-aa84-47c4-a838-b5f90820de1a</uuid>
Apr 12 16:11:07 user nova-compute[71874]:   <name>instance-0000001f</name>
Apr 12 16:11:07 user nova-compute[71874]:   <memory>131072</memory>
Apr 12 16:11:07 user nova-compute[71874]:   <vcpu>1</vcpu>
Apr 12 16:11:07 user nova-compute[71874]:   <metadata>
Apr 12 16:11:07 user nova-compute[71874]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 16:11:07 user nova-compute[71874]:       <nova:package version="0.0.0"/>
Apr 12 16:11:07 user nova-compute[71874]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1308581862</nova:name>
Apr 12 16:11:07 user nova-compute[71874]:       <nova:creationTime>2023-04-12 16:11:06</nova:creationTime>
Apr 12 16:11:07 user nova-compute[71874]:       <nova:flavor name="m1.nano">
Apr 12 16:11:07 user nova-compute[71874]:         <nova:memory>128</nova:memory>
Apr 12 16:11:07 user nova-compute[71874]:         <nova:disk>1</nova:disk>
Apr 12 16:11:07 user nova-compute[71874]:         <nova:swap>0</nova:swap>
Apr 12 16:11:07 user nova-compute[71874]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 16:11:07 user nova-compute[71874]:         <nova:vcpus>1</nova:vcpus>
Apr 12 16:11:07 user nova-compute[71874]:       </nova:flavor>
Apr 12 16:11:07 user nova-compute[71874]:       <nova:owner>
Apr 12 16:11:07 user nova-compute[71874]:         <nova:user uuid="73f9fa5bc22a4824b3cdcb8cf7bb380c">tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member</nova:user>
Apr 12 16:11:07 user nova-compute[71874]:         <nova:project uuid="9210f81232304e179d3e09914a492442">tempest-ServerBootFromVolumeStableRescueTest-1443944578</nova:project>
Apr 12 16:11:07 user nova-compute[71874]:       </nova:owner>
Apr 12 16:11:07 user nova-compute[71874]:       <nova:root type="image" uuid="9dc63f14-8b70-4e72-89f2-13464f2f5c7c"/>
Apr 12 16:11:07 user nova-compute[71874]:       <nova:ports>
Apr 12 16:11:07 user nova-compute[71874]:         <nova:port uuid="40e16d3f-2e2e-45df-be16-ef3622bfde2e">
Apr 12 16:11:07 user nova-compute[71874]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 12 16:11:07 user nova-compute[71874]:         </nova:port>
Apr 12 16:11:07 user nova-compute[71874]:       </nova:ports>
Apr 12 16:11:07 user nova-compute[71874]:     </nova:instance>
Apr 12 16:11:07 user nova-compute[71874]:   </metadata>
Apr 12 16:11:07 user nova-compute[71874]:   <sysinfo type="smbios">
Apr 12 16:11:07 user nova-compute[71874]:     <system>
Apr 12 16:11:07 user nova-compute[71874]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 16:11:07 user nova-compute[71874]:       <entry name="product">OpenStack Nova</entry>
Apr 12 16:11:07 user nova-compute[71874]:       <entry name="version">0.0.0</entry>
Apr 12 16:11:07 user nova-compute[71874]:       <entry name="serial">0e8a977c-aa84-47c4-a838-b5f90820de1a</entry>
Apr 12 16:11:07 user nova-compute[71874]:       <entry name="uuid">0e8a977c-aa84-47c4-a838-b5f90820de1a</entry>
Apr 12 16:11:07 user nova-compute[71874]:       <entry name="family">Virtual Machine</entry>
Apr 12 16:11:07 user nova-compute[71874]:     </system>
Apr 12 16:11:07 user nova-compute[71874]:   </sysinfo>
Apr 12 16:11:07 user nova-compute[71874]:   <os>
Apr 12 16:11:07 user nova-compute[71874]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 16:11:07 user nova-compute[71874]:     <boot dev="hd"/>
Apr 12 16:11:07 user nova-compute[71874]:     <smbios mode="sysinfo"/>
Apr 12 16:11:07 user nova-compute[71874]:   </os>
Apr 12 16:11:07 user nova-compute[71874]:   <features>
Apr 12 16:11:07 user nova-compute[71874]:     <acpi/>
Apr 12 16:11:07 user nova-compute[71874]:     <apic/>
Apr 12 16:11:07 user nova-compute[71874]:     <vmcoreinfo/>
Apr 12 16:11:07 user nova-compute[71874]:   </features>
Apr 12 16:11:07 user nova-compute[71874]:   <clock offset="utc">
Apr 12 16:11:07 user nova-compute[71874]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 16:11:07 user nova-compute[71874]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 16:11:07 user nova-compute[71874]:     <timer name="hpet" present="no"/>
Apr 12 16:11:07 user nova-compute[71874]:   </clock>
Apr 12 16:11:07 user nova-compute[71874]:   <cpu mode="custom" match="exact">
Apr 12 16:11:07 user nova-compute[71874]:     <model>Nehalem</model>
Apr 12 16:11:07 user nova-compute[71874]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 16:11:07 user nova-compute[71874]:   </cpu>
Apr 12 16:11:07 user nova-compute[71874]:   <devices>
Apr 12 16:11:07 user nova-compute[71874]:     <disk type="block" device="disk">
Apr 12 16:11:07 user nova-compute[71874]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 16:11:07 user nova-compute[71874]:       <source dev="/dev/sdf"/>
Apr 12 16:11:07 user nova-compute[71874]:       <target dev="vda" bus="virtio"/>
Apr 12 16:11:07 user nova-compute[71874]:       <serial>5c31b819-b8c1-4c22-b9c6-d276f2c03304</serial>
Apr 12 16:11:07 user nova-compute[71874]:     </disk>
Apr 12 16:11:07 user nova-compute[71874]:     <interface type="ethernet">
Apr 12 16:11:07 user nova-compute[71874]:       <mac address="fa:16:3e:4d:9c:b1"/>
Apr 12 16:11:07 user nova-compute[71874]:       <model type="virtio"/>
Apr 12 16:11:07 user nova-compute[71874]:       <mtu size="1442"/>
Apr 12 16:11:07 user nova-compute[71874]:       <target dev="tap40e16d3f-2e"/>
Apr 12 16:11:07 user nova-compute[71874]:     </interface>
Apr 12 16:11:07 user nova-compute[71874]:     <serial type="pty">
Apr 12 16:11:07 user nova-compute[71874]:       <log file="/opt/stack/data/nova/instances/0e8a977c-aa84-47c4-a838-b5f90820de1a/console.log" append="off"/>
Apr 12 16:11:07 user nova-compute[71874]:     </serial>
Apr 12 16:11:07 user nova-compute[71874]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 16:11:07 user nova-compute[71874]:     <video>
Apr 12 16:11:07 user nova-compute[71874]:       <model type="virtio"/>
Apr 12 16:11:07 user nova-compute[71874]:     </video>
Apr 12 16:11:07 user nova-compute[71874]:     <rng model="virtio">
Apr 12 16:11:07 user nova-compute[71874]:       <backend model="random">/dev/urandom</backend>
Apr 12 16:11:07 user nova-compute[71874]:     </rng>
Apr 12 16:11:07 user nova-compute[71874]:     <controller type="usb" index="0" model="none"/>
Apr 12 16:11:07 user nova-compute[71874]:     <memballoon model="virtio">
Apr 12 16:11:07 user nova-compute[71874]:       <stats period="10"/>
Apr 12 16:11:07 user nova-compute[71874]:     </memballoon>
Apr 12 16:11:07 user nova-compute[71874]:   </devices>
Apr 12 16:11:07 user nova-compute[71874]: </domain>
Apr 12 16:11:07 user nova-compute[71874]:  {{(pid=71874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 16:11:07 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-8a140bfb-f600-452b-8b01-6480f945f20b tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T16:10:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1308581862',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1308581862',id=31,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9210f81232304e179d3e09914a492442',ramdisk_id='',reservation_id='r-ji74zs90',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1443944578',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T16:10:56Z,user_data=None,user_id='73f9fa5bc22a4824b3cdcb8cf7bb380c',uuid=0e8a977c-aa84-47c4-a838-b5f90820de1a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "40e16d3f-2e2e-45df-be16-ef3622bfde2e", "address": "fa:16:3e:4d:9c:b1", "network": {"id": "b36306e0-04c5-4b1b-8022-05ff121c4e43", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1503204786-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9210f81232304e179d3e09914a492442", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40e16d3f-2e", "ovs_interfaceid": "40e16d3f-2e2e-45df-be16-ef3622bfde2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 16:11:07 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-8a140bfb-f600-452b-8b01-6480f945f20b tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Converting VIF {"id": "40e16d3f-2e2e-45df-be16-ef3622bfde2e", "address": "fa:16:3e:4d:9c:b1", "network": {"id": "b36306e0-04c5-4b1b-8022-05ff121c4e43", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1503204786-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9210f81232304e179d3e09914a492442", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40e16d3f-2e", "ovs_interfaceid": "40e16d3f-2e2e-45df-be16-ef3622bfde2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:11:07 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-8a140bfb-f600-452b-8b01-6480f945f20b tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:9c:b1,bridge_name='br-int',has_traffic_filtering=True,id=40e16d3f-2e2e-45df-be16-ef3622bfde2e,network=Network(b36306e0-04c5-4b1b-8022-05ff121c4e43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40e16d3f-2e') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:11:07 user nova-compute[71874]: DEBUG os_vif [None req-8a140bfb-f600-452b-8b01-6480f945f20b tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:9c:b1,bridge_name='br-int',has_traffic_filtering=True,id=40e16d3f-2e2e-45df-be16-ef3622bfde2e,network=Network(b36306e0-04c5-4b1b-8022-05ff121c4e43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40e16d3f-2e') {{(pid=71874) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 16:11:07 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:11:07 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:11:07 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 16:11:07 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:11:07 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap40e16d3f-2e, may_exist=True) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:11:07 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap40e16d3f-2e, col_values=(('external_ids', {'iface-id': '40e16d3f-2e2e-45df-be16-ef3622bfde2e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4d:9c:b1', 'vm-uuid': '0e8a977c-aa84-47c4-a838-b5f90820de1a'}),)) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:11:07 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:11:07 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:11:07 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:11:07 user nova-compute[71874]: INFO os_vif [None req-8a140bfb-f600-452b-8b01-6480f945f20b tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:9c:b1,bridge_name='br-int',has_traffic_filtering=True,id=40e16d3f-2e2e-45df-be16-ef3622bfde2e,network=Network(b36306e0-04c5-4b1b-8022-05ff121c4e43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40e16d3f-2e')
Apr 12 16:11:07 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-8a140bfb-f600-452b-8b01-6480f945f20b tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] No BDM found with device name vda, not building metadata. {{(pid=71874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 16:11:07 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-8a140bfb-f600-452b-8b01-6480f945f20b tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] No VIF found with MAC fa:16:3e:4d:9c:b1, not building metadata {{(pid=71874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 16:11:08 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:11:09 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:11:09 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:11:09 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:11:09 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:11:09 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:11:09 user nova-compute[71874]: DEBUG nova.compute.manager [req-02478d16-2237-47d1-b9cf-5e99a17c6144 req-01e9574a-11a7-42f2-ba45-2c4d80fd145b service nova] [instance: 0e8a977c-aa84-47c4-a838-b5f90820de1a] Received event network-vif-plugged-40e16d3f-2e2e-45df-be16-ef3622bfde2e {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:11:09 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-02478d16-2237-47d1-b9cf-5e99a17c6144 req-01e9574a-11a7-42f2-ba45-2c4d80fd145b service nova] Acquiring lock "0e8a977c-aa84-47c4-a838-b5f90820de1a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:11:09 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-02478d16-2237-47d1-b9cf-5e99a17c6144 req-01e9574a-11a7-42f2-ba45-2c4d80fd145b service nova] Lock "0e8a977c-aa84-47c4-a838-b5f90820de1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:11:09 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-02478d16-2237-47d1-b9cf-5e99a17c6144 req-01e9574a-11a7-42f2-ba45-2c4d80fd145b service nova] Lock "0e8a977c-aa84-47c4-a838-b5f90820de1a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:11:09 user nova-compute[71874]: DEBUG nova.compute.manager [req-02478d16-2237-47d1-b9cf-5e99a17c6144 req-01e9574a-11a7-42f2-ba45-2c4d80fd145b service nova] [instance: 0e8a977c-aa84-47c4-a838-b5f90820de1a] No waiting events found dispatching network-vif-plugged-40e16d3f-2e2e-45df-be16-ef3622bfde2e {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:11:09 user nova-compute[71874]: WARNING nova.compute.manager [req-02478d16-2237-47d1-b9cf-5e99a17c6144 req-01e9574a-11a7-42f2-ba45-2c4d80fd145b service nova] [instance: 0e8a977c-aa84-47c4-a838-b5f90820de1a] Received unexpected event network-vif-plugged-40e16d3f-2e2e-45df-be16-ef3622bfde2e for instance with vm_state building and task_state spawning.
Apr 12 16:11:11 user nova-compute[71874]: DEBUG nova.virt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Emitting event <LifecycleEvent: 1681315871.2969718, 0e8a977c-aa84-47c4-a838-b5f90820de1a => Resumed> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:11:11 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 0e8a977c-aa84-47c4-a838-b5f90820de1a] VM Resumed (Lifecycle Event)
Apr 12 16:11:11 user nova-compute[71874]: DEBUG nova.compute.manager [None req-8a140bfb-f600-452b-8b01-6480f945f20b tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 0e8a977c-aa84-47c4-a838-b5f90820de1a] Instance event wait completed in 0 seconds for  {{(pid=71874) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 16:11:11 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-8a140bfb-f600-452b-8b01-6480f945f20b tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 0e8a977c-aa84-47c4-a838-b5f90820de1a] Guest created on hypervisor {{(pid=71874) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 16:11:11 user nova-compute[71874]: INFO nova.virt.libvirt.driver [-] [instance: 0e8a977c-aa84-47c4-a838-b5f90820de1a] Instance spawned successfully.
Apr 12 16:11:11 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-8a140bfb-f600-452b-8b01-6480f945f20b tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 0e8a977c-aa84-47c4-a838-b5f90820de1a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 16:11:11 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 0e8a977c-aa84-47c4-a838-b5f90820de1a] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:11:11 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 0e8a977c-aa84-47c4-a838-b5f90820de1a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 16:11:11 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-8a140bfb-f600-452b-8b01-6480f945f20b tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 0e8a977c-aa84-47c4-a838-b5f90820de1a] Found default for hw_cdrom_bus of ide {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:11:11 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-8a140bfb-f600-452b-8b01-6480f945f20b tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 0e8a977c-aa84-47c4-a838-b5f90820de1a] Found default for hw_disk_bus of virtio {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:11:11 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-8a140bfb-f600-452b-8b01-6480f945f20b tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 0e8a977c-aa84-47c4-a838-b5f90820de1a] Found default for hw_input_bus of None {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:11:11 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-8a140bfb-f600-452b-8b01-6480f945f20b tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 0e8a977c-aa84-47c4-a838-b5f90820de1a] Found default for hw_pointer_model of None {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:11:11 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-8a140bfb-f600-452b-8b01-6480f945f20b tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 0e8a977c-aa84-47c4-a838-b5f90820de1a] Found default for hw_video_model of virtio {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:11:11 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-8a140bfb-f600-452b-8b01-6480f945f20b tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 0e8a977c-aa84-47c4-a838-b5f90820de1a] Found default for hw_vif_model of virtio {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:11:11 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 0e8a977c-aa84-47c4-a838-b5f90820de1a] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 16:11:11 user nova-compute[71874]: DEBUG nova.virt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Emitting event <LifecycleEvent: 1681315871.2998855, 0e8a977c-aa84-47c4-a838-b5f90820de1a => Started> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:11:11 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 0e8a977c-aa84-47c4-a838-b5f90820de1a] VM Started (Lifecycle Event)
Apr 12 16:11:11 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 0e8a977c-aa84-47c4-a838-b5f90820de1a] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:11:11 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 0e8a977c-aa84-47c4-a838-b5f90820de1a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 16:11:11 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 0e8a977c-aa84-47c4-a838-b5f90820de1a] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 16:11:11 user nova-compute[71874]: INFO nova.compute.manager [None req-8a140bfb-f600-452b-8b01-6480f945f20b tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 0e8a977c-aa84-47c4-a838-b5f90820de1a] Took 5.02 seconds to spawn the instance on the hypervisor.
Apr 12 16:11:11 user nova-compute[71874]: DEBUG nova.compute.manager [None req-8a140bfb-f600-452b-8b01-6480f945f20b tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 0e8a977c-aa84-47c4-a838-b5f90820de1a] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:11:11 user nova-compute[71874]: INFO nova.compute.manager [None req-8a140bfb-f600-452b-8b01-6480f945f20b tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 0e8a977c-aa84-47c4-a838-b5f90820de1a] Took 16.27 seconds to build instance.
Apr 12 16:11:11 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-8a140bfb-f600-452b-8b01-6480f945f20b tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "0e8a977c-aa84-47c4-a838-b5f90820de1a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.358s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:11:11 user nova-compute[71874]: DEBUG nova.compute.manager [req-3e217fb3-0044-4a58-bbae-354463b99f17 req-ea24bf76-5579-4058-883c-36bf5a4f9420 service nova] [instance: 0e8a977c-aa84-47c4-a838-b5f90820de1a] Received event network-vif-plugged-40e16d3f-2e2e-45df-be16-ef3622bfde2e {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:11:11 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-3e217fb3-0044-4a58-bbae-354463b99f17 req-ea24bf76-5579-4058-883c-36bf5a4f9420 service nova] Acquiring lock "0e8a977c-aa84-47c4-a838-b5f90820de1a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:11:11 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-3e217fb3-0044-4a58-bbae-354463b99f17 req-ea24bf76-5579-4058-883c-36bf5a4f9420 service nova] Lock "0e8a977c-aa84-47c4-a838-b5f90820de1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:11:11 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-3e217fb3-0044-4a58-bbae-354463b99f17 req-ea24bf76-5579-4058-883c-36bf5a4f9420 service nova] Lock "0e8a977c-aa84-47c4-a838-b5f90820de1a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:11:11 user nova-compute[71874]: DEBUG nova.compute.manager [req-3e217fb3-0044-4a58-bbae-354463b99f17 req-ea24bf76-5579-4058-883c-36bf5a4f9420 service nova] [instance: 0e8a977c-aa84-47c4-a838-b5f90820de1a] No waiting events found dispatching network-vif-plugged-40e16d3f-2e2e-45df-be16-ef3622bfde2e {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:11:11 user nova-compute[71874]: WARNING nova.compute.manager [req-3e217fb3-0044-4a58-bbae-354463b99f17 req-ea24bf76-5579-4058-883c-36bf5a4f9420 service nova] [instance: 0e8a977c-aa84-47c4-a838-b5f90820de1a] Received unexpected event network-vif-plugged-40e16d3f-2e2e-45df-be16-ef3622bfde2e for instance with vm_state active and task_state None.
Apr 12 16:11:12 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:11:13 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:11:17 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:11:20 user nova-compute[71874]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681315865.8986537, 6caa4977-8333-4171-8825-2c3bfb52f80b => Stopped> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:11:20 user nova-compute[71874]: INFO nova.compute.manager [-] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] VM Stopped (Lifecycle Event)
Apr 12 16:11:20 user nova-compute[71874]: DEBUG nova.compute.manager [None req-4dbfa676-73a9-484b-90e4-7de101c7ede7 None None] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:11:21 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:11:21 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:11:21 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:11:21 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:11:21 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:11:21 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Auditing locally available compute resources for user (node: user) {{(pid=71874) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 16:11:22 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f641c6b-b508-42a7-ae98-c2bfb841d798/disk.rescue --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:11:22 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f641c6b-b508-42a7-ae98-c2bfb841d798/disk.rescue --force-share --output=json" returned: 0 in 0.133s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:11:22 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f641c6b-b508-42a7-ae98-c2bfb841d798/disk.rescue --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:11:22 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f641c6b-b508-42a7-ae98-c2bfb841d798/disk.rescue --force-share --output=json" returned: 0 in 0.133s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:11:22 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] skipping disk /opt/stack/data/nova/instances/7f641c6b-b508-42a7-ae98-c2bfb841d798/disk (vdb) as it is a volume {{(pid=71874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 16:11:22 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 16:11:22 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473a30c4-5aa4-481c-8859-fda815d14872/disk.rescue --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:11:22 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473a30c4-5aa4-481c-8859-fda815d14872/disk.rescue --force-share --output=json" returned: 0 in 0.133s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:11:22 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473a30c4-5aa4-481c-8859-fda815d14872/disk.rescue --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:11:22 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473a30c4-5aa4-481c-8859-fda815d14872/disk.rescue --force-share --output=json" returned: 0 in 0.133s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:11:22 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473a30c4-5aa4-481c-8859-fda815d14872/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:11:22 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473a30c4-5aa4-481c-8859-fda815d14872/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:11:22 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473a30c4-5aa4-481c-8859-fda815d14872/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:11:22 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:11:22 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473a30c4-5aa4-481c-8859-fda815d14872/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:11:22 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4190e244-84b1-47b6-813d-9cadb7c65975/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:11:23 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:11:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4190e244-84b1-47b6-813d-9cadb7c65975/disk --force-share --output=json" returned: 0 in 0.337s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:11:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4190e244-84b1-47b6-813d-9cadb7c65975/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:11:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4190e244-84b1-47b6-813d-9cadb7c65975/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:11:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:11:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:11:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:11:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:11:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:11:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:11:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:11:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:11:24 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 16:11:24 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=71874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 16:11:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/016ae41d-b098-4126-ace7-3da00b40cb9c/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:11:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/016ae41d-b098-4126-ace7-3da00b40cb9c/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:11:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/016ae41d-b098-4126-ace7-3da00b40cb9c/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:11:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/016ae41d-b098-4126-ace7-3da00b40cb9c/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:11:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/608fbea2-b42b-4bb9-94a7-2b76dcdc2001/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:11:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/608fbea2-b42b-4bb9-94a7-2b76dcdc2001/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:11:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/608fbea2-b42b-4bb9-94a7-2b76dcdc2001/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:11:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/608fbea2-b42b-4bb9-94a7-2b76dcdc2001/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:11:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2511c44-8365-4e8c-9814-172547111b9f/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:11:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2511c44-8365-4e8c-9814-172547111b9f/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:11:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2511c44-8365-4e8c-9814-172547111b9f/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:11:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2511c44-8365-4e8c-9814-172547111b9f/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:11:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84683344-2893-4446-90ae-e64cd799eb20/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:11:25 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84683344-2893-4446-90ae-e64cd799eb20/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:11:25 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84683344-2893-4446-90ae-e64cd799eb20/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:11:25 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84683344-2893-4446-90ae-e64cd799eb20/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:11:25 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 16:11:25 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afebffae-dbf6-4876-8c9f-0364f0fde49c/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:11:25 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afebffae-dbf6-4876-8c9f-0364f0fde49c/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:11:25 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afebffae-dbf6-4876-8c9f-0364f0fde49c/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:11:25 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afebffae-dbf6-4876-8c9f-0364f0fde49c/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:11:25 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c307e623-c546-487f-ac16-5eb24d088e8a/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:11:25 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c307e623-c546-487f-ac16-5eb24d088e8a/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:11:25 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c307e623-c546-487f-ac16-5eb24d088e8a/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:11:25 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c307e623-c546-487f-ac16-5eb24d088e8a/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:11:25 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78b6940a-f97a-4535-8973-3c2a5befbbab/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:11:25 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78b6940a-f97a-4535-8973-3c2a5befbbab/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:11:25 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78b6940a-f97a-4535-8973-3c2a5befbbab/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:11:26 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78b6940a-f97a-4535-8973-3c2a5befbbab/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:11:26 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:11:26 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:11:26 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Hypervisor/Node resource view: name=user free_ram=7209MB free_disk=25.712997436523438GB free_vcpus=-2 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71874) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 16:11:26 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:11:26 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:11:26 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance afebffae-dbf6-4876-8c9f-0364f0fde49c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:11:26 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 473a30c4-5aa4-481c-8859-fda815d14872 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:11:26 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 608fbea2-b42b-4bb9-94a7-2b76dcdc2001 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:11:26 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance f52ee906-c8fd-4cd5-842e-de98a5099c4f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:11:26 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 78b6940a-f97a-4535-8973-3c2a5befbbab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:11:26 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 7f641c6b-b508-42a7-ae98-c2bfb841d798 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:11:26 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 016ae41d-b098-4126-ace7-3da00b40cb9c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:11:26 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:11:26 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 84683344-2893-4446-90ae-e64cd799eb20 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:11:26 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance f2511c44-8365-4e8c-9814-172547111b9f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:11:26 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance c307e623-c546-487f-ac16-5eb24d088e8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:11:26 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 4190e244-84b1-47b6-813d-9cadb7c65975 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:11:26 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:11:26 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 0e8a977c-aa84-47c4-a838-b5f90820de1a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:11:26 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=71874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 16:11:26 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Final resource view: name=user phys_ram=16023MB used_ram=2304MB phys_disk=40GB used_disk=12GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=71874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 16:11:27 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Inventory has not changed in ProviderTree for provider: 0e94b4c8-cd49-45e4-9133-d36eb4b2456b {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 16:11:27 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Inventory has not changed for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 16:11:27 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Compute_service record updated for user:user {{(pid=71874) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 16:11:27 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.799s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:11:27 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:11:28 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:11:28 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:11:28 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:11:28 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:11:28 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Starting heal instance info cache {{(pid=71874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 16:11:28 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquiring lock "refresh_cache-dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:11:28 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquired lock "refresh_cache-dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:11:28 user nova-compute[71874]: DEBUG nova.network.neutron [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Forcefully refreshing network info cache for instance {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 16:11:29 user nova-compute[71874]: DEBUG nova.network.neutron [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Updating instance_info_cache with network_info: [{"id": "18196ae0-d9c1-4814-8803-c4ba8ad4ab45", "address": "fa:16:3e:98:72:fa", "network": {"id": "e6694358-e361-4952-b859-93755c11721e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-667152893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97ea81bd1962466bbe552424973f71a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18196ae0-d9", "ovs_interfaceid": "18196ae0-d9c1-4814-8803-c4ba8ad4ab45", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:11:29 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Releasing lock "refresh_cache-dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:11:29 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Updated the network info_cache for instance {{(pid=71874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 16:11:29 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:11:29 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:11:29 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:11:29 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:11:29 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:11:29 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71874) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 16:11:32 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:11:33 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:11:37 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:11:38 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:11:42 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:11:42 user nova-compute[71874]: INFO nova.compute.manager [None req-d00c56ec-20bd-4efd-84d7-ec65914ee73e tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] Unrescuing
Apr 12 16:11:42 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d00c56ec-20bd-4efd-84d7-ec65914ee73e tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Acquiring lock "refresh_cache-7f641c6b-b508-42a7-ae98-c2bfb841d798" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:11:42 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d00c56ec-20bd-4efd-84d7-ec65914ee73e tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Acquired lock "refresh_cache-7f641c6b-b508-42a7-ae98-c2bfb841d798" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:11:42 user nova-compute[71874]: DEBUG nova.network.neutron [None req-d00c56ec-20bd-4efd-84d7-ec65914ee73e tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] Building network info cache for instance {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 16:11:43 user nova-compute[71874]: DEBUG nova.network.neutron [None req-d00c56ec-20bd-4efd-84d7-ec65914ee73e tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] Updating instance_info_cache with network_info: [{"id": "746786a9-c889-4ece-bc5e-a905bf8deb5c", "address": "fa:16:3e:aa:23:e3", "network": {"id": "06fae0be-02dd-4962-a1ac-fd0413772758", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1493924857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3fe48a3b7d846a195f1e47cc7f69695", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap746786a9-c8", "ovs_interfaceid": "746786a9-c889-4ece-bc5e-a905bf8deb5c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:11:43 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d00c56ec-20bd-4efd-84d7-ec65914ee73e tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Releasing lock "refresh_cache-7f641c6b-b508-42a7-ae98-c2bfb841d798" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:11:43 user nova-compute[71874]: DEBUG nova.objects.instance [None req-d00c56ec-20bd-4efd-84d7-ec65914ee73e tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lazy-loading 'flavor' on Instance uuid 7f641c6b-b508-42a7-ae98-c2bfb841d798 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:11:43 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:11:43 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:11:43 user nova-compute[71874]: DEBUG nova.compute.manager [req-b589e4d8-12ca-4432-ba8c-a305ac5f1a56 req-0ab2f373-8ee6-471e-8d66-c2c4fb7e6f0c service nova] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] Received event network-vif-unplugged-746786a9-c889-4ece-bc5e-a905bf8deb5c {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:11:43 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-b589e4d8-12ca-4432-ba8c-a305ac5f1a56 req-0ab2f373-8ee6-471e-8d66-c2c4fb7e6f0c service nova] Acquiring lock "7f641c6b-b508-42a7-ae98-c2bfb841d798-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:11:43 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-b589e4d8-12ca-4432-ba8c-a305ac5f1a56 req-0ab2f373-8ee6-471e-8d66-c2c4fb7e6f0c service nova] Lock "7f641c6b-b508-42a7-ae98-c2bfb841d798-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:11:43 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-b589e4d8-12ca-4432-ba8c-a305ac5f1a56 req-0ab2f373-8ee6-471e-8d66-c2c4fb7e6f0c service nova] Lock "7f641c6b-b508-42a7-ae98-c2bfb841d798-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:11:43 user nova-compute[71874]: DEBUG nova.compute.manager [req-b589e4d8-12ca-4432-ba8c-a305ac5f1a56 req-0ab2f373-8ee6-471e-8d66-c2c4fb7e6f0c service nova] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] No waiting events found dispatching network-vif-unplugged-746786a9-c889-4ece-bc5e-a905bf8deb5c {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:11:43 user nova-compute[71874]: WARNING nova.compute.manager [req-b589e4d8-12ca-4432-ba8c-a305ac5f1a56 req-0ab2f373-8ee6-471e-8d66-c2c4fb7e6f0c service nova] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] Received unexpected event network-vif-unplugged-746786a9-c889-4ece-bc5e-a905bf8deb5c for instance with vm_state rescued and task_state unrescuing.
Apr 12 16:11:43 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:11:43 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:11:44 user nova-compute[71874]: INFO nova.virt.libvirt.driver [-] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] Instance destroyed successfully.
Apr 12 16:11:45 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:11:45 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:11:45 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:11:45 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:11:45 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:11:45 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:11:45 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:11:45 user nova-compute[71874]: DEBUG nova.compute.manager [req-0ad73b2f-7aa4-45fc-81c9-6fcb7860e7c8 req-f34824fc-35d3-4d6d-8b33-52150f4e2501 service nova] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] Received event network-vif-plugged-746786a9-c889-4ece-bc5e-a905bf8deb5c {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:11:45 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-0ad73b2f-7aa4-45fc-81c9-6fcb7860e7c8 req-f34824fc-35d3-4d6d-8b33-52150f4e2501 service nova] Acquiring lock "7f641c6b-b508-42a7-ae98-c2bfb841d798-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:11:45 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-0ad73b2f-7aa4-45fc-81c9-6fcb7860e7c8 req-f34824fc-35d3-4d6d-8b33-52150f4e2501 service nova] Lock "7f641c6b-b508-42a7-ae98-c2bfb841d798-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:11:45 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-0ad73b2f-7aa4-45fc-81c9-6fcb7860e7c8 req-f34824fc-35d3-4d6d-8b33-52150f4e2501 service nova] Lock "7f641c6b-b508-42a7-ae98-c2bfb841d798-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:11:45 user nova-compute[71874]: DEBUG nova.compute.manager [req-0ad73b2f-7aa4-45fc-81c9-6fcb7860e7c8 req-f34824fc-35d3-4d6d-8b33-52150f4e2501 service nova] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] No waiting events found dispatching network-vif-plugged-746786a9-c889-4ece-bc5e-a905bf8deb5c {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:11:45 user nova-compute[71874]: WARNING nova.compute.manager [req-0ad73b2f-7aa4-45fc-81c9-6fcb7860e7c8 req-f34824fc-35d3-4d6d-8b33-52150f4e2501 service nova] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] Received unexpected event network-vif-plugged-746786a9-c889-4ece-bc5e-a905bf8deb5c for instance with vm_state rescued and task_state unrescuing.
Apr 12 16:11:45 user nova-compute[71874]: DEBUG nova.compute.manager [req-0ad73b2f-7aa4-45fc-81c9-6fcb7860e7c8 req-f34824fc-35d3-4d6d-8b33-52150f4e2501 service nova] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] Received event network-vif-plugged-746786a9-c889-4ece-bc5e-a905bf8deb5c {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:11:45 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-0ad73b2f-7aa4-45fc-81c9-6fcb7860e7c8 req-f34824fc-35d3-4d6d-8b33-52150f4e2501 service nova] Acquiring lock "7f641c6b-b508-42a7-ae98-c2bfb841d798-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:11:45 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-0ad73b2f-7aa4-45fc-81c9-6fcb7860e7c8 req-f34824fc-35d3-4d6d-8b33-52150f4e2501 service nova] Lock "7f641c6b-b508-42a7-ae98-c2bfb841d798-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:11:45 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-0ad73b2f-7aa4-45fc-81c9-6fcb7860e7c8 req-f34824fc-35d3-4d6d-8b33-52150f4e2501 service nova] Lock "7f641c6b-b508-42a7-ae98-c2bfb841d798-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:11:45 user nova-compute[71874]: DEBUG nova.compute.manager [req-0ad73b2f-7aa4-45fc-81c9-6fcb7860e7c8 req-f34824fc-35d3-4d6d-8b33-52150f4e2501 service nova] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] No waiting events found dispatching network-vif-plugged-746786a9-c889-4ece-bc5e-a905bf8deb5c {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:11:45 user nova-compute[71874]: WARNING nova.compute.manager [req-0ad73b2f-7aa4-45fc-81c9-6fcb7860e7c8 req-f34824fc-35d3-4d6d-8b33-52150f4e2501 service nova] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] Received unexpected event network-vif-plugged-746786a9-c889-4ece-bc5e-a905bf8deb5c for instance with vm_state rescued and task_state unrescuing.
Apr 12 16:11:45 user nova-compute[71874]: DEBUG nova.compute.manager [req-0ad73b2f-7aa4-45fc-81c9-6fcb7860e7c8 req-f34824fc-35d3-4d6d-8b33-52150f4e2501 service nova] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] Received event network-vif-plugged-746786a9-c889-4ece-bc5e-a905bf8deb5c {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:11:45 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-0ad73b2f-7aa4-45fc-81c9-6fcb7860e7c8 req-f34824fc-35d3-4d6d-8b33-52150f4e2501 service nova] Acquiring lock "7f641c6b-b508-42a7-ae98-c2bfb841d798-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:11:45 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-0ad73b2f-7aa4-45fc-81c9-6fcb7860e7c8 req-f34824fc-35d3-4d6d-8b33-52150f4e2501 service nova] Lock "7f641c6b-b508-42a7-ae98-c2bfb841d798-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:11:45 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-0ad73b2f-7aa4-45fc-81c9-6fcb7860e7c8 req-f34824fc-35d3-4d6d-8b33-52150f4e2501 service nova] Lock "7f641c6b-b508-42a7-ae98-c2bfb841d798-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:11:45 user nova-compute[71874]: DEBUG nova.compute.manager [req-0ad73b2f-7aa4-45fc-81c9-6fcb7860e7c8 req-f34824fc-35d3-4d6d-8b33-52150f4e2501 service nova] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] No waiting events found dispatching network-vif-plugged-746786a9-c889-4ece-bc5e-a905bf8deb5c {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:11:45 user nova-compute[71874]: WARNING nova.compute.manager [req-0ad73b2f-7aa4-45fc-81c9-6fcb7860e7c8 req-f34824fc-35d3-4d6d-8b33-52150f4e2501 service nova] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] Received unexpected event network-vif-plugged-746786a9-c889-4ece-bc5e-a905bf8deb5c for instance with vm_state rescued and task_state unrescuing.
Apr 12 16:11:47 user nova-compute[71874]: DEBUG nova.virt.libvirt.host [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Removed pending event for 7f641c6b-b508-42a7-ae98-c2bfb841d798 due to event {{(pid=71874) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 12 16:11:47 user nova-compute[71874]: DEBUG nova.virt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Emitting event <LifecycleEvent: 1681315907.4554465, 7f641c6b-b508-42a7-ae98-c2bfb841d798 => Resumed> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:11:47 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] VM Resumed (Lifecycle Event)
Apr 12 16:11:47 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d00c56ec-20bd-4efd-84d7-ec65914ee73e tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:11:47 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:11:47 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 16:11:47 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 12 16:11:47 user nova-compute[71874]: DEBUG nova.virt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Emitting event <LifecycleEvent: 1681315907.4566276, 7f641c6b-b508-42a7-ae98-c2bfb841d798 => Started> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:11:47 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] VM Started (Lifecycle Event)
Apr 12 16:11:47 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:11:47 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 16:11:47 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:11:48 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:11:49 user nova-compute[71874]: DEBUG nova.compute.manager [req-4d05fda9-bd19-410c-8730-e5c8dce9f779 req-18adb444-a241-4fb9-b9af-206fa773b3a1 service nova] [instance: f2511c44-8365-4e8c-9814-172547111b9f] Received event network-changed-3d785c5d-4be8-4ade-92dd-d4bf7a16cb37 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:11:49 user nova-compute[71874]: DEBUG nova.compute.manager [req-4d05fda9-bd19-410c-8730-e5c8dce9f779 req-18adb444-a241-4fb9-b9af-206fa773b3a1 service nova] [instance: f2511c44-8365-4e8c-9814-172547111b9f] Refreshing instance network info cache due to event network-changed-3d785c5d-4be8-4ade-92dd-d4bf7a16cb37. {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 16:11:49 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-4d05fda9-bd19-410c-8730-e5c8dce9f779 req-18adb444-a241-4fb9-b9af-206fa773b3a1 service nova] Acquiring lock "refresh_cache-f2511c44-8365-4e8c-9814-172547111b9f" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:11:49 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-4d05fda9-bd19-410c-8730-e5c8dce9f779 req-18adb444-a241-4fb9-b9af-206fa773b3a1 service nova] Acquired lock "refresh_cache-f2511c44-8365-4e8c-9814-172547111b9f" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:11:49 user nova-compute[71874]: DEBUG nova.network.neutron [req-4d05fda9-bd19-410c-8730-e5c8dce9f779 req-18adb444-a241-4fb9-b9af-206fa773b3a1 service nova] [instance: f2511c44-8365-4e8c-9814-172547111b9f] Refreshing network info cache for port 3d785c5d-4be8-4ade-92dd-d4bf7a16cb37 {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 16:11:49 user nova-compute[71874]: DEBUG nova.network.neutron [req-4d05fda9-bd19-410c-8730-e5c8dce9f779 req-18adb444-a241-4fb9-b9af-206fa773b3a1 service nova] [instance: f2511c44-8365-4e8c-9814-172547111b9f] Updated VIF entry in instance network info cache for port 3d785c5d-4be8-4ade-92dd-d4bf7a16cb37. {{(pid=71874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 16:11:49 user nova-compute[71874]: DEBUG nova.network.neutron [req-4d05fda9-bd19-410c-8730-e5c8dce9f779 req-18adb444-a241-4fb9-b9af-206fa773b3a1 service nova] [instance: f2511c44-8365-4e8c-9814-172547111b9f] Updating instance_info_cache with network_info: [{"id": "3d785c5d-4be8-4ade-92dd-d4bf7a16cb37", "address": "fa:16:3e:4a:64:40", "network": {"id": "e71b9966-9a95-4f66-b3b1-36b05d05853c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-310205564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28d940eae5394293b87cfced45911ab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d785c5d-4b", "ovs_interfaceid": "3d785c5d-4be8-4ade-92dd-d4bf7a16cb37", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:11:49 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-4d05fda9-bd19-410c-8730-e5c8dce9f779 req-18adb444-a241-4fb9-b9af-206fa773b3a1 service nova] Releasing lock "refresh_cache-f2511c44-8365-4e8c-9814-172547111b9f" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:11:50 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-3e64ea3d-247a-4d15-b7de-95ee917a1345 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "f2511c44-8365-4e8c-9814-172547111b9f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:11:50 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-3e64ea3d-247a-4d15-b7de-95ee917a1345 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "f2511c44-8365-4e8c-9814-172547111b9f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:11:50 user nova-compute[71874]: DEBUG nova.objects.instance [None req-3e64ea3d-247a-4d15-b7de-95ee917a1345 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lazy-loading 'flavor' on Instance uuid f2511c44-8365-4e8c-9814-172547111b9f {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:11:50 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-3e64ea3d-247a-4d15-b7de-95ee917a1345 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "f2511c44-8365-4e8c-9814-172547111b9f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:11:51 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-3e64ea3d-247a-4d15-b7de-95ee917a1345 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "f2511c44-8365-4e8c-9814-172547111b9f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:11:51 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-3e64ea3d-247a-4d15-b7de-95ee917a1345 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "f2511c44-8365-4e8c-9814-172547111b9f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:11:51 user nova-compute[71874]: INFO nova.compute.manager [None req-3e64ea3d-247a-4d15-b7de-95ee917a1345 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: f2511c44-8365-4e8c-9814-172547111b9f] Attaching volume e8075886-2ccb-4609-9a35-e32f86fb14f9 to /dev/vdb
Apr 12 16:11:51 user nova-compute[71874]: DEBUG os_brick.utils [None req-3e64ea3d-247a-4d15-b7de-95ee917a1345 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:11:51 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:11:51 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:11:51 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9dd6d19-3a8a-43eb-aa6d-59b49a2fa5a2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:61a48d4489d2\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:11:51 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:11:51 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:11:51 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[305f5176-51a9-4f29-a380-948387eca49a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:11:51 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:11:51 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:11:51 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[86685c62-e83f-4d33-a9a4-0457b578fb0a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:11:51 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f8a5134-e2e1-4b87-ab08-b577955b2789]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:11:51 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-3e64ea3d-247a-4d15-b7de-95ee917a1345 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Running cmd (subprocess): nvme version {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:11:51 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-3e64ea3d-247a-4d15-b7de-95ee917a1345 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] 'nvme version' failed. Not Retrying. {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 16:11:51 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3e64ea3d-247a-4d15-b7de-95ee917a1345 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] nvme not present on system {{(pid=71874) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 16:11:51 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:11:51 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 16:11:51 user nova-compute[71874]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 16:11:51 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1018cc7-2789-406c-9963-67322775e481]: (4, '') {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:11:51 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.lightos [None req-3e64ea3d-247a-4d15-b7de-95ee917a1345 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71874) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 16:11:51 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.lightos [None req-3e64ea3d-247a-4d15-b7de-95ee917a1345 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71874) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 16:11:51 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.lightos [None req-3e64ea3d-247a-4d15-b7de-95ee917a1345 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] LIGHTOS: no hostnqn found. {{(pid=71874) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 16:11:51 user nova-compute[71874]: DEBUG os_brick.utils [None req-3e64ea3d-247a-4d15-b7de-95ee917a1345 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:61a48d4489d2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:11:51 user nova-compute[71874]: DEBUG nova.virt.block_device [None req-3e64ea3d-247a-4d15-b7de-95ee917a1345 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: f2511c44-8365-4e8c-9814-172547111b9f] Updating existing volume attachment record: 0936f2a5-f33c-4637-93e7-1d7bbd2ff3df {{(pid=71874) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 16:11:52 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:11:53 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:11:55 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:11:55 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e64ea3d-247a-4d15-b7de-95ee917a1345 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: f2511c44-8365-4e8c-9814-172547111b9f] Calling os-brick to attach iSCSI Volume {{(pid=71874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 16:11:55 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e64ea3d-247a-4d15-b7de-95ee917a1345 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3c0216320>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e8075886-2ccb-4609-9a35-e32f86fb14f9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UxXGfwBt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:11:55 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-3e64ea3d-247a-4d15-b7de-95ee917a1345 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:11:55 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-3e64ea3d-247a-4d15-b7de-95ee917a1345 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:11:55 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-3e64ea3d-247a-4d15-b7de-95ee917a1345 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:11:55 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-3e64ea3d-247a-4d15-b7de-95ee917a1345 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:11:55 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-3e64ea3d-247a-4d15-b7de-95ee917a1345 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e8075886-2ccb-4609-9a35-e32f86fb14f9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:11:55 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-3e64ea3d-247a-4d15-b7de-95ee917a1345 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e8075886-2ccb-4609-9a35-e32f86fb14f9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:11:55 user nova-compute[71874]: INFO os_brick.initiator.connectors.iscsi [None req-3e64ea3d-247a-4d15-b7de-95ee917a1345 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 16:11:55 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8075886-2ccb-4609-9a35-e32f86fb14f9 -p 172.16.0.220:3260 {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:11:55 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8075886-2ccb-4609-9a35-e32f86fb14f9 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:11:55 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb87684b-796d-4e16-94c6-5a0cba2591f5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:11:55 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e64ea3d-247a-4d15-b7de-95ee917a1345 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 16:11:55 user nova-compute[71874]:  {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:11:55 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8075886-2ccb-4609-9a35-e32f86fb14f9 -p 172.16.0.220:3260 --interface default --op new {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:11:55 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8075886-2ccb-4609-9a35-e32f86fb14f9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:11:55 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[148b2ddb-cb7f-4a08-9766-134189b5802c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e8075886-2ccb-4609-9a35-e32f86fb14f9] added\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:11:55 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e64ea3d-247a-4d15-b7de-95ee917a1345 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e8075886-2ccb-4609-9a35-e32f86fb14f9] added
Apr 12 16:11:55 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:11:55 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8075886-2ccb-4609-9a35-e32f86fb14f9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:11:55 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8075886-2ccb-4609-9a35-e32f86fb14f9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:11:55 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9c59e0c-8f3d-4583-afa5-57711a8fe5b3]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:11:55 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e64ea3d-247a-4d15-b7de-95ee917a1345 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:11:55 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8075886-2ccb-4609-9a35-e32f86fb14f9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:11:55 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8075886-2ccb-4609-9a35-e32f86fb14f9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:11:55 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c3d071b-966f-4f33-98dd-1ec5af4d4c3d]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:11:55 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e64ea3d-247a-4d15-b7de-95ee917a1345 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:11:55 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8075886-2ccb-4609-9a35-e32f86fb14f9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UxXGfwBt {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:11:55 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8075886-2ccb-4609-9a35-e32f86fb14f9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UxXGfwBt" returned: 0 in 0.023s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:11:55 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3683f1d-3d73-4afc-b022-3e013a9bf86d]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:11:55 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e64ea3d-247a-4d15-b7de-95ee917a1345 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UxXGfwBt'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:11:55 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8075886-2ccb-4609-9a35-e32f86fb14f9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:11:55 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8075886-2ccb-4609-9a35-e32f86fb14f9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:11:55 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f2da455-da4e-4ceb-9b7c-0eee44e7ae20]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:11:55 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e64ea3d-247a-4d15-b7de-95ee917a1345 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:11:55 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:11:56 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:11:56 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cc26fce-b1e1-4a86-8b41-66dff316bfcd]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f27a002-8dfc-4d90-aa35-ba16586d4366 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c961fcc-0ff0-4275-9163-406662b265f8 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304 (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:11:56 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e64ea3d-247a-4d15-b7de-95ee917a1345 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:11:56 user nova-compute[71874]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f27a002-8dfc-4d90-aa35-ba16586d4366 (non-flash)
Apr 12 16:11:56 user nova-compute[71874]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 (non-flash)
Apr 12 16:11:56 user nova-compute[71874]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c961fcc-0ff0-4275-9163-406662b265f8 (non-flash)
Apr 12 16:11:56 user nova-compute[71874]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304 (non-flash)
Apr 12 16:11:56 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:11:56 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e64ea3d-247a-4d15-b7de-95ee917a1345 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:11:56 user nova-compute[71874]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f27a002-8dfc-4d90-aa35-ba16586d4366 (non-flash)
Apr 12 16:11:56 user nova-compute[71874]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 (non-flash)
Apr 12 16:11:56 user nova-compute[71874]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c961fcc-0ff0-4275-9163-406662b265f8 (non-flash)
Apr 12 16:11:56 user nova-compute[71874]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304 (non-flash)
Apr 12 16:11:56 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:11:56 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8075886-2ccb-4609-9a35-e32f86fb14f9 -p 172.16.0.220:3260 --login {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:11:56 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8075886-2ccb-4609-9a35-e32f86fb14f9 -p 172.16.0.220:3260 --login" returned: 0 in 0.086s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:11:56 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[04f8120d-7fa2-4929-ba95-12f19ac84ffb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e8075886-2ccb-4609-9a35-e32f86fb14f9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e8075886-2ccb-4609-9a35-e32f86fb14f9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:11:56 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e64ea3d-247a-4d15-b7de-95ee917a1345 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e8075886-2ccb-4609-9a35-e32f86fb14f9, portal: 172.16.0.220,3260]
Apr 12 16:11:56 user nova-compute[71874]: Login to [iface: default, target: iqn.2010-10.org.openstack:e8075886-2ccb-4609-9a35-e32f86fb14f9, portal: 172.16.0.220,3260] successful.
Apr 12 16:11:56 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:11:56 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8075886-2ccb-4609-9a35-e32f86fb14f9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:11:56 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8075886-2ccb-4609-9a35-e32f86fb14f9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:11:56 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[519cb577-b081-4048-a0c4-41f835a5b5bf]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:11:56 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e64ea3d-247a-4d15-b7de-95ee917a1345 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:11:56 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:11:56 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:11:56 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[87e7c757-6d92-43d1-a8e5-ae218147485f]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f27a002-8dfc-4d90-aa35-ba16586d4366 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c961fcc-0ff0-4275-9163-406662b265f8 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8075886-2ccb-4609-9a35-e32f86fb14f9 (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:11:56 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e64ea3d-247a-4d15-b7de-95ee917a1345 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:11:56 user nova-compute[71874]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f27a002-8dfc-4d90-aa35-ba16586d4366 (non-flash)
Apr 12 16:11:56 user nova-compute[71874]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 (non-flash)
Apr 12 16:11:56 user nova-compute[71874]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c961fcc-0ff0-4275-9163-406662b265f8 (non-flash)
Apr 12 16:11:56 user nova-compute[71874]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304 (non-flash)
Apr 12 16:11:56 user nova-compute[71874]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8075886-2ccb-4609-9a35-e32f86fb14f9 (non-flash)
Apr 12 16:11:56 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:11:56 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e64ea3d-247a-4d15-b7de-95ee917a1345 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:11:56 user nova-compute[71874]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f27a002-8dfc-4d90-aa35-ba16586d4366 (non-flash)
Apr 12 16:11:56 user nova-compute[71874]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 (non-flash)
Apr 12 16:11:56 user nova-compute[71874]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c961fcc-0ff0-4275-9163-406662b265f8 (non-flash)
Apr 12 16:11:56 user nova-compute[71874]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304 (non-flash)
Apr 12 16:11:56 user nova-compute[71874]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8075886-2ccb-4609-9a35-e32f86fb14f9 (non-flash)
Apr 12 16:11:56 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:11:56 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-3e64ea3d-247a-4d15-b7de-95ee917a1345 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e8075886-2ccb-4609-9a35-e32f86fb14f9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.339s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:11:56 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e64ea3d-247a-4d15-b7de-95ee917a1345 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Connected to 172.16.0.220:3260 {{(pid=71874) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 16:11:56 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-3e64ea3d-247a-4d15-b7de-95ee917a1345 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] HCTL ('38', '-', '-', 0) found on session 33 with lun 0 {{(pid=71874) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 16:11:56 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-3e64ea3d-247a-4d15-b7de-95ee917a1345 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=71874) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 16:11:56 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:11:56 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.023s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:11:56 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3777715-132f-4974-aee9-054a32375e60]: (4, ('- - 0', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:11:56 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-3e64ea3d-247a-4d15-b7de-95ee917a1345 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Searching for a device in session 33 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=71874) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 16:11:56 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e64ea3d-247a-4d15-b7de-95ee917a1345 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:e8075886-2ccb-4609-9a35-e32f86fb14f9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UxXGfwBt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71874) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 16:11:57 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-3e64ea3d-247a-4d15-b7de-95ee917a1345 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.397s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:11:57 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e64ea3d-247a-4d15-b7de-95ee917a1345 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] <== connect_volume: return (1399ms) {'type': 'block', 'scsi_wwn': '26233333037646333', 'path': '/dev/sdg'} {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:11:57 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e64ea3d-247a-4d15-b7de-95ee917a1345 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: f2511c44-8365-4e8c-9814-172547111b9f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26233333037646333', 'path': '/dev/sdg'} {{(pid=71874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 16:11:57 user nova-compute[71874]: DEBUG nova.objects.instance [None req-3e64ea3d-247a-4d15-b7de-95ee917a1345 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lazy-loading 'flavor' on Instance uuid f2511c44-8365-4e8c-9814-172547111b9f {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:11:57 user nova-compute[71874]: DEBUG nova.virt.libvirt.guest [None req-3e64ea3d-247a-4d15-b7de-95ee917a1345 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 16:11:57 user nova-compute[71874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 16:11:57 user nova-compute[71874]:   <source dev="/dev/sdg"/>
Apr 12 16:11:57 user nova-compute[71874]:   <target dev="vdb" bus="virtio"/>
Apr 12 16:11:57 user nova-compute[71874]:   <serial>e8075886-2ccb-4609-9a35-e32f86fb14f9</serial>
Apr 12 16:11:57 user nova-compute[71874]: </disk>
Apr 12 16:11:57 user nova-compute[71874]:  {{(pid=71874) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 16:11:57 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-3e64ea3d-247a-4d15-b7de-95ee917a1345 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] No BDM found with device name vda, not building metadata. {{(pid=71874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 16:11:57 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-3e64ea3d-247a-4d15-b7de-95ee917a1345 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 16:11:57 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-3e64ea3d-247a-4d15-b7de-95ee917a1345 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] No VIF found with MAC fa:16:3e:4a:64:40, not building metadata {{(pid=71874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 16:11:57 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-3e64ea3d-247a-4d15-b7de-95ee917a1345 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "f2511c44-8365-4e8c-9814-172547111b9f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.785s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:11:57 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:11:58 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:11:58 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:11:59 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-1a72c446-9c34-484a-8043-ba47e8125ea6 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "f2511c44-8365-4e8c-9814-172547111b9f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:11:59 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-1a72c446-9c34-484a-8043-ba47e8125ea6 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "f2511c44-8365-4e8c-9814-172547111b9f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:11:59 user nova-compute[71874]: INFO nova.compute.manager [None req-1a72c446-9c34-484a-8043-ba47e8125ea6 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: f2511c44-8365-4e8c-9814-172547111b9f] Detaching volume e8075886-2ccb-4609-9a35-e32f86fb14f9
Apr 12 16:11:59 user nova-compute[71874]: INFO nova.virt.block_device [None req-1a72c446-9c34-484a-8043-ba47e8125ea6 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: f2511c44-8365-4e8c-9814-172547111b9f] Attempting to driver detach volume e8075886-2ccb-4609-9a35-e32f86fb14f9 from mountpoint /dev/vdb
Apr 12 16:11:59 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-1a72c446-9c34-484a-8043-ba47e8125ea6 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Attempting to detach device vdb from instance f2511c44-8365-4e8c-9814-172547111b9f from the persistent domain config. {{(pid=71874) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 16:11:59 user nova-compute[71874]: DEBUG nova.virt.libvirt.guest [None req-1a72c446-9c34-484a-8043-ba47e8125ea6 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 16:11:59 user nova-compute[71874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 16:11:59 user nova-compute[71874]:   <source dev="/dev/sdg"/>
Apr 12 16:11:59 user nova-compute[71874]:   <target dev="vdb" bus="virtio"/>
Apr 12 16:11:59 user nova-compute[71874]:   <serial>e8075886-2ccb-4609-9a35-e32f86fb14f9</serial>
Apr 12 16:11:59 user nova-compute[71874]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 16:11:59 user nova-compute[71874]: </disk>
Apr 12 16:11:59 user nova-compute[71874]:  {{(pid=71874) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 16:11:59 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-1a72c446-9c34-484a-8043-ba47e8125ea6 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Successfully detached device vdb from instance f2511c44-8365-4e8c-9814-172547111b9f from the persistent domain config.
Apr 12 16:11:59 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-1a72c446-9c34-484a-8043-ba47e8125ea6 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f2511c44-8365-4e8c-9814-172547111b9f from the live domain config. {{(pid=71874) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 16:11:59 user nova-compute[71874]: DEBUG nova.virt.libvirt.guest [None req-1a72c446-9c34-484a-8043-ba47e8125ea6 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 16:11:59 user nova-compute[71874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 16:11:59 user nova-compute[71874]:   <source dev="/dev/sdg"/>
Apr 12 16:11:59 user nova-compute[71874]:   <target dev="vdb" bus="virtio"/>
Apr 12 16:11:59 user nova-compute[71874]:   <serial>e8075886-2ccb-4609-9a35-e32f86fb14f9</serial>
Apr 12 16:11:59 user nova-compute[71874]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 16:11:59 user nova-compute[71874]: </disk>
Apr 12 16:11:59 user nova-compute[71874]:  {{(pid=71874) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 16:11:59 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Received event <DeviceRemovedEvent: 1681315919.6168401, f2511c44-8365-4e8c-9814-172547111b9f => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71874) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 16:11:59 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-1a72c446-9c34-484a-8043-ba47e8125ea6 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f2511c44-8365-4e8c-9814-172547111b9f {{(pid=71874) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 16:11:59 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-1a72c446-9c34-484a-8043-ba47e8125ea6 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Successfully detached device vdb from instance f2511c44-8365-4e8c-9814-172547111b9f from the live domain config.
Apr 12 16:11:59 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a72c446-9c34-484a-8043-ba47e8125ea6 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: f2511c44-8365-4e8c-9814-172547111b9f] calling os-brick to detach iSCSI Volume {{(pid=71874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 16:11:59 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a72c446-9c34-484a-8043-ba47e8125ea6 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3c0216320>, {'target_iqn': 'iqn.2010-10.org.openstack:e8075886-2ccb-4609-9a35-e32f86fb14f9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UxXGfwBt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg': {}}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:11:59 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-1a72c446-9c34-484a-8043-ba47e8125ea6 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:11:59 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-1a72c446-9c34-484a-8043-ba47e8125ea6 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:11:59 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-1a72c446-9c34-484a-8043-ba47e8125ea6 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:11:59 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:11:59 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:11:59 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2ea3c4f-048f-497e-a3f3-f3842f09f948]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1f27a002-8dfc-4d90-aa35-ba16586d4366\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e8075886-2ccb-4609-9a35-e32f86fb14f9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9c961fcc-0ff0-4275-9163-406662b265f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:11:59 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a72c446-9c34-484a-8043-ba47e8125ea6 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 16:11:59 user nova-compute[71874]: No targets found.
Apr 12 16:11:59 user nova-compute[71874]: iSNS:
Apr 12 16:11:59 user nova-compute[71874]: No targets found.
Apr 12 16:11:59 user nova-compute[71874]: STATIC:
Apr 12 16:11:59 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:1f27a002-8dfc-4d90-aa35-ba16586d4366
Apr 12 16:11:59 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:11:59 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:11:59 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:e8075886-2ccb-4609-9a35-e32f86fb14f9
Apr 12 16:11:59 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:11:59 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:11:59 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:9c961fcc-0ff0-4275-9163-406662b265f8
Apr 12 16:11:59 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:11:59 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:11:59 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304
Apr 12 16:11:59 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:11:59 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:11:59 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297
Apr 12 16:11:59 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:11:59 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:11:59 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2
Apr 12 16:11:59 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:11:59 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:11:59 user nova-compute[71874]: FIRMWARE:
Apr 12 16:11:59 user nova-compute[71874]: No targets found.
Apr 12 16:11:59 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:11:59 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a72c446-9c34-484a-8043-ba47e8125ea6 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 16:11:59 user nova-compute[71874]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 16:11:59 user nova-compute[71874]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71874) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 16:11:59 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a72c446-9c34-484a-8043-ba47e8125ea6 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e8075886-2ccb-4609-9a35-e32f86fb14f9', 0)] {{(pid=71874) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 16:11:59 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:11:59 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:11:59 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[3226d154-ccf2-4397-8090-5f2b116fab53]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1f27a002-8dfc-4d90-aa35-ba16586d4366\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c961fcc-0ff0-4275-9163-406662b265f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e8075886-2ccb-4609-9a35-e32f86fb14f9\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:11:59 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:11:59 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:11:59 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[5420a53a-aba0-44e1-8155-b6d350158ef8]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f27a002-8dfc-4d90-aa35-ba16586d4366 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c961fcc-0ff0-4275-9163-406662b265f8 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8075886-2ccb-4609-9a35-e32f86fb14f9 (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:11:59 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a72c446-9c34-484a-8043-ba47e8125ea6 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:11:59 user nova-compute[71874]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f27a002-8dfc-4d90-aa35-ba16586d4366 (non-flash)
Apr 12 16:11:59 user nova-compute[71874]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 (non-flash)
Apr 12 16:11:59 user nova-compute[71874]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c961fcc-0ff0-4275-9163-406662b265f8 (non-flash)
Apr 12 16:11:59 user nova-compute[71874]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304 (non-flash)
Apr 12 16:11:59 user nova-compute[71874]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8075886-2ccb-4609-9a35-e32f86fb14f9 (non-flash)
Apr 12 16:11:59 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:11:59 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a72c446-9c34-484a-8043-ba47e8125ea6 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:11:59 user nova-compute[71874]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f27a002-8dfc-4d90-aa35-ba16586d4366 (non-flash)
Apr 12 16:11:59 user nova-compute[71874]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 (non-flash)
Apr 12 16:11:59 user nova-compute[71874]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c961fcc-0ff0-4275-9163-406662b265f8 (non-flash)
Apr 12 16:11:59 user nova-compute[71874]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304 (non-flash)
Apr 12 16:11:59 user nova-compute[71874]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8075886-2ccb-4609-9a35-e32f86fb14f9 (non-flash)
Apr 12 16:11:59 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:11:59 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a72c446-9c34-484a-8043-ba47e8125ea6 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc39c2036d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e8075886-2ccb-4609-9a35-e32f86fb14f9'): ({'sdg'}, set())}) {{(pid=71874) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 16:11:59 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-1a72c446-9c34-484a-8043-ba47e8125ea6 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Removing single pathed devices sdg {{(pid=71874) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 16:11:59 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:11:59 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:11:59 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac25ead3-c52a-4428-9903-a088ee2636e7]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:11:59 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:11:59 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.023s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:11:59 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[86c192e7-4129-4634-bcc5-51e060eddfcd]: (4, ('ok\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:11:59 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-1a72c446-9c34-484a-8043-ba47e8125ea6 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Flushing IO for device /dev/sdg {{(pid=71874) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 16:11:59 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:11:59 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:11:59 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[12d1bcd7-82a9-43ab-8aea-277de42f9c25]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:11:59 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-1a72c446-9c34-484a-8043-ba47e8125ea6 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=71874) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 16:11:59 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:11:59 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.047s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:11:59 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[2498304e-1d06-466b-8452-e4c6c6d80d17]: (4, ('1', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:11:59 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-1a72c446-9c34-484a-8043-ba47e8125ea6 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=71874) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 16:11:59 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-1a72c446-9c34-484a-8043-ba47e8125ea6 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] SCSI volumes sdg have been removed. {{(pid=71874) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 16:11:59 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a72c446-9c34-484a-8043-ba47e8125ea6 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e8075886-2ccb-4609-9a35-e32f86fb14f9')] {{(pid=71874) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 16:11:59 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8075886-2ccb-4609-9a35-e32f86fb14f9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:11:59 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8075886-2ccb-4609-9a35-e32f86fb14f9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:11:59 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f9e55b3-2f9d-4218-95d8-681ad6534c75]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:11:59 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a72c446-9c34-484a-8043-ba47e8125ea6 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:11:59 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8075886-2ccb-4609-9a35-e32f86fb14f9 -p 172.16.0.220:3260 --logout {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:11:59 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8075886-2ccb-4609-9a35-e32f86fb14f9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:11:59 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf8aaf19-b2ab-46fa-80a3-61838a4faac0]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:e8075886-2ccb-4609-9a35-e32f86fb14f9, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:e8075886-2ccb-4609-9a35-e32f86fb14f9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:11:59 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a72c446-9c34-484a-8043-ba47e8125ea6 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:e8075886-2ccb-4609-9a35-e32f86fb14f9, portal: 172.16.0.220,3260]
Apr 12 16:11:59 user nova-compute[71874]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:e8075886-2ccb-4609-9a35-e32f86fb14f9, portal: 172.16.0.220,3260] successful.
Apr 12 16:11:59 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:11:59 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8075886-2ccb-4609-9a35-e32f86fb14f9 -p 172.16.0.220:3260 --op delete {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:12:00 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8075886-2ccb-4609-9a35-e32f86fb14f9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:12:00 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[3df3605e-8181-4363-beea-0ce8aa9c6f19]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:12:00 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a72c446-9c34-484a-8043-ba47e8125ea6 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:12:00 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-1a72c446-9c34-484a-8043-ba47e8125ea6 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.374s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:12:00 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a72c446-9c34-484a-8043-ba47e8125ea6 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] <== disconnect_volume: return (375ms) None {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:12:00 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a72c446-9c34-484a-8043-ba47e8125ea6 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: f2511c44-8365-4e8c-9814-172547111b9f] Disconnected iSCSI Volume {{(pid=71874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 16:12:00 user nova-compute[71874]: DEBUG nova.objects.instance [None req-1a72c446-9c34-484a-8043-ba47e8125ea6 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lazy-loading 'flavor' on Instance uuid f2511c44-8365-4e8c-9814-172547111b9f {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:12:00 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-1a72c446-9c34-484a-8043-ba47e8125ea6 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "f2511c44-8365-4e8c-9814-172547111b9f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.830s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:12:02 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:12:03 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:12:04 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:12:07 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:12:07 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:12:08 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:12:08 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-096c329e-8b19-4941-9a88-ea4ed411824a tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Acquiring lock "1b613235-a905-466f-b9cc-a21a321a6313" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:12:08 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-096c329e-8b19-4941-9a88-ea4ed411824a tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Lock "1b613235-a905-466f-b9cc-a21a321a6313" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:12:08 user nova-compute[71874]: DEBUG nova.compute.manager [None req-096c329e-8b19-4941-9a88-ea4ed411824a tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] [instance: 1b613235-a905-466f-b9cc-a21a321a6313] Starting instance... {{(pid=71874) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 16:12:08 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-096c329e-8b19-4941-9a88-ea4ed411824a tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:12:08 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-096c329e-8b19-4941-9a88-ea4ed411824a tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:12:08 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-096c329e-8b19-4941-9a88-ea4ed411824a tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71874) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 16:12:08 user nova-compute[71874]: INFO nova.compute.claims [None req-096c329e-8b19-4941-9a88-ea4ed411824a tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] [instance: 1b613235-a905-466f-b9cc-a21a321a6313] Claim successful on node user
Apr 12 16:12:09 user nova-compute[71874]: DEBUG nova.compute.manager [req-2a2648d4-c480-4ec1-adfa-68ebb343fc5b req-97ce1508-c515-47b0-9a1e-93454b131688 service nova] [instance: c307e623-c546-487f-ac16-5eb24d088e8a] Received event network-changed-b6291ae2-bc79-4a35-a160-bff95fae3e8f {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:12:09 user nova-compute[71874]: DEBUG nova.compute.manager [req-2a2648d4-c480-4ec1-adfa-68ebb343fc5b req-97ce1508-c515-47b0-9a1e-93454b131688 service nova] [instance: c307e623-c546-487f-ac16-5eb24d088e8a] Refreshing instance network info cache due to event network-changed-b6291ae2-bc79-4a35-a160-bff95fae3e8f. {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 16:12:09 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-2a2648d4-c480-4ec1-adfa-68ebb343fc5b req-97ce1508-c515-47b0-9a1e-93454b131688 service nova] Acquiring lock "refresh_cache-c307e623-c546-487f-ac16-5eb24d088e8a" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:12:09 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-2a2648d4-c480-4ec1-adfa-68ebb343fc5b req-97ce1508-c515-47b0-9a1e-93454b131688 service nova] Acquired lock "refresh_cache-c307e623-c546-487f-ac16-5eb24d088e8a" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:12:09 user nova-compute[71874]: DEBUG nova.network.neutron [req-2a2648d4-c480-4ec1-adfa-68ebb343fc5b req-97ce1508-c515-47b0-9a1e-93454b131688 service nova] [instance: c307e623-c546-487f-ac16-5eb24d088e8a] Refreshing network info cache for port b6291ae2-bc79-4a35-a160-bff95fae3e8f {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 16:12:09 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-096c329e-8b19-4941-9a88-ea4ed411824a tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Inventory has not changed in ProviderTree for provider: 0e94b4c8-cd49-45e4-9133-d36eb4b2456b {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 16:12:09 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-9677477c-3cc7-4314-81a9-a9a9ec2f0786 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Acquiring lock "c307e623-c546-487f-ac16-5eb24d088e8a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:12:09 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-9677477c-3cc7-4314-81a9-a9a9ec2f0786 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lock "c307e623-c546-487f-ac16-5eb24d088e8a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:12:09 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-096c329e-8b19-4941-9a88-ea4ed411824a tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Inventory has not changed for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 16:12:09 user nova-compute[71874]: DEBUG nova.objects.instance [None req-9677477c-3cc7-4314-81a9-a9a9ec2f0786 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lazy-loading 'flavor' on Instance uuid c307e623-c546-487f-ac16-5eb24d088e8a {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:12:09 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-096c329e-8b19-4941-9a88-ea4ed411824a tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.566s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:12:09 user nova-compute[71874]: DEBUG nova.compute.manager [None req-096c329e-8b19-4941-9a88-ea4ed411824a tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] [instance: 1b613235-a905-466f-b9cc-a21a321a6313] Start building networks asynchronously for instance. {{(pid=71874) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 16:12:09 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-9677477c-3cc7-4314-81a9-a9a9ec2f0786 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lock "c307e623-c546-487f-ac16-5eb24d088e8a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.081s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:12:09 user nova-compute[71874]: DEBUG nova.compute.manager [None req-096c329e-8b19-4941-9a88-ea4ed411824a tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] [instance: 1b613235-a905-466f-b9cc-a21a321a6313] Allocating IP information in the background. {{(pid=71874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 16:12:09 user nova-compute[71874]: DEBUG nova.network.neutron [None req-096c329e-8b19-4941-9a88-ea4ed411824a tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] [instance: 1b613235-a905-466f-b9cc-a21a321a6313] allocate_for_instance() {{(pid=71874) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 16:12:09 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-096c329e-8b19-4941-9a88-ea4ed411824a tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] [instance: 1b613235-a905-466f-b9cc-a21a321a6313] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 16:12:09 user nova-compute[71874]: DEBUG nova.compute.manager [None req-096c329e-8b19-4941-9a88-ea4ed411824a tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] [instance: 1b613235-a905-466f-b9cc-a21a321a6313] Start building block device mappings for instance. {{(pid=71874) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 16:12:09 user nova-compute[71874]: DEBUG nova.network.neutron [req-2a2648d4-c480-4ec1-adfa-68ebb343fc5b req-97ce1508-c515-47b0-9a1e-93454b131688 service nova] [instance: c307e623-c546-487f-ac16-5eb24d088e8a] Updated VIF entry in instance network info cache for port b6291ae2-bc79-4a35-a160-bff95fae3e8f. {{(pid=71874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 16:12:09 user nova-compute[71874]: DEBUG nova.network.neutron [req-2a2648d4-c480-4ec1-adfa-68ebb343fc5b req-97ce1508-c515-47b0-9a1e-93454b131688 service nova] [instance: c307e623-c546-487f-ac16-5eb24d088e8a] Updating instance_info_cache with network_info: [{"id": "b6291ae2-bc79-4a35-a160-bff95fae3e8f", "address": "fa:16:3e:9c:67:25", "network": {"id": "1c560b5e-bb6f-42eb-b9b2-6b3f2eaed0f8", "bridge": "br-int", "label": "tempest-TestStampPattern-1356757354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a77372a5e83c4fc882b0a0b0eea46f06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6291ae2-bc", "ovs_interfaceid": "b6291ae2-bc79-4a35-a160-bff95fae3e8f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:12:09 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-2a2648d4-c480-4ec1-adfa-68ebb343fc5b req-97ce1508-c515-47b0-9a1e-93454b131688 service nova] Releasing lock "refresh_cache-c307e623-c546-487f-ac16-5eb24d088e8a" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:12:09 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-9677477c-3cc7-4314-81a9-a9a9ec2f0786 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Acquiring lock "c307e623-c546-487f-ac16-5eb24d088e8a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:12:09 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-9677477c-3cc7-4314-81a9-a9a9ec2f0786 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lock "c307e623-c546-487f-ac16-5eb24d088e8a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:12:09 user nova-compute[71874]: INFO nova.compute.manager [None req-9677477c-3cc7-4314-81a9-a9a9ec2f0786 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] [instance: c307e623-c546-487f-ac16-5eb24d088e8a] Attaching volume c7faa4f7-bc66-4311-92a9-c69ee614aa9c to /dev/vdb
Apr 12 16:12:09 user nova-compute[71874]: DEBUG nova.compute.manager [None req-096c329e-8b19-4941-9a88-ea4ed411824a tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] [instance: 1b613235-a905-466f-b9cc-a21a321a6313] Start spawning the instance on the hypervisor. {{(pid=71874) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 16:12:09 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-096c329e-8b19-4941-9a88-ea4ed411824a tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] [instance: 1b613235-a905-466f-b9cc-a21a321a6313] Creating instance directory {{(pid=71874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 16:12:09 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-096c329e-8b19-4941-9a88-ea4ed411824a tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] [instance: 1b613235-a905-466f-b9cc-a21a321a6313] Creating image(s)
Apr 12 16:12:09 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-096c329e-8b19-4941-9a88-ea4ed411824a tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Acquiring lock "/opt/stack/data/nova/instances/1b613235-a905-466f-b9cc-a21a321a6313/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:12:09 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-096c329e-8b19-4941-9a88-ea4ed411824a tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Lock "/opt/stack/data/nova/instances/1b613235-a905-466f-b9cc-a21a321a6313/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:12:09 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-096c329e-8b19-4941-9a88-ea4ed411824a tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Lock "/opt/stack/data/nova/instances/1b613235-a905-466f-b9cc-a21a321a6313/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:12:09 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-096c329e-8b19-4941-9a88-ea4ed411824a tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:12:09 user nova-compute[71874]: DEBUG nova.policy [None req-096c329e-8b19-4941-9a88-ea4ed411824a tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '38c60e84c47047e2886220f2ef54391d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280a9a56afca4ce591faca7a94eca4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71874) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 16:12:09 user nova-compute[71874]: DEBUG os_brick.utils [None req-9677477c-3cc7-4314-81a9-a9a9ec2f0786 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:12:09 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:12:09 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:12:09 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae25949f-af5e-4788-bfb1-30aea667f38c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:61a48d4489d2\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:12:09 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:12:09 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:12:09 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d91bf24-abcb-42df-8fe0-06e6a80d8827]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:12:09 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:12:09 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:12:09 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[47105cf6-2413-42b5-b34e-c58f1029bb96]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:12:09 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[48150423-541e-4bc2-b381-798e243a4f04]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:12:09 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-9677477c-3cc7-4314-81a9-a9a9ec2f0786 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Running cmd (subprocess): nvme version {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:12:09 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-9677477c-3cc7-4314-81a9-a9a9ec2f0786 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] 'nvme version' failed. Not Retrying. {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 16:12:09 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9677477c-3cc7-4314-81a9-a9a9ec2f0786 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] nvme not present on system {{(pid=71874) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 16:12:09 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-096c329e-8b19-4941-9a88-ea4ed411824a tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json" returned: 0 in 0.152s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:12:09 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-096c329e-8b19-4941-9a88-ea4ed411824a tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Acquiring lock "b88df1b37cb431f52bc53b5616015c89b5bec411" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:12:09 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-096c329e-8b19-4941-9a88-ea4ed411824a tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Lock "b88df1b37cb431f52bc53b5616015c89b5bec411" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:12:09 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-096c329e-8b19-4941-9a88-ea4ed411824a tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:12:09 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:12:09 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 16:12:09 user nova-compute[71874]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 16:12:09 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[13a5d2a1-22d2-4735-af77-863419ea2a00]: (4, '') {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:12:09 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.lightos [None req-9677477c-3cc7-4314-81a9-a9a9ec2f0786 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71874) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 16:12:09 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.lightos [None req-9677477c-3cc7-4314-81a9-a9a9ec2f0786 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71874) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 16:12:09 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.lightos [None req-9677477c-3cc7-4314-81a9-a9a9ec2f0786 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] LIGHTOS: no hostnqn found. {{(pid=71874) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 16:12:09 user nova-compute[71874]: DEBUG os_brick.utils [None req-9677477c-3cc7-4314-81a9-a9a9ec2f0786 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] <== get_connector_properties: return (147ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:61a48d4489d2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:12:09 user nova-compute[71874]: DEBUG nova.virt.block_device [None req-9677477c-3cc7-4314-81a9-a9a9ec2f0786 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] [instance: c307e623-c546-487f-ac16-5eb24d088e8a] Updating existing volume attachment record: 240b2e3b-aaa8-4204-8837-48758f18e533 {{(pid=71874) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 16:12:09 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-096c329e-8b19-4941-9a88-ea4ed411824a tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json" returned: 0 in 0.137s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:12:09 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-096c329e-8b19-4941-9a88-ea4ed411824a tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411,backing_fmt=raw /opt/stack/data/nova/instances/1b613235-a905-466f-b9cc-a21a321a6313/disk 1073741824 {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:12:09 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-096c329e-8b19-4941-9a88-ea4ed411824a tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411,backing_fmt=raw /opt/stack/data/nova/instances/1b613235-a905-466f-b9cc-a21a321a6313/disk 1073741824" returned: 0 in 0.051s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:12:10 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-096c329e-8b19-4941-9a88-ea4ed411824a tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Lock "b88df1b37cb431f52bc53b5616015c89b5bec411" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.196s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:12:10 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-096c329e-8b19-4941-9a88-ea4ed411824a tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:12:10 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-096c329e-8b19-4941-9a88-ea4ed411824a tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json" returned: 0 in 0.139s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:12:10 user nova-compute[71874]: DEBUG nova.virt.disk.api [None req-096c329e-8b19-4941-9a88-ea4ed411824a tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1b613235-a905-466f-b9cc-a21a321a6313/disk. size=1073741824 {{(pid=71874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 16:12:10 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-096c329e-8b19-4941-9a88-ea4ed411824a tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b613235-a905-466f-b9cc-a21a321a6313/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:12:10 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-096c329e-8b19-4941-9a88-ea4ed411824a tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b613235-a905-466f-b9cc-a21a321a6313/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:12:10 user nova-compute[71874]: DEBUG nova.virt.disk.api [None req-096c329e-8b19-4941-9a88-ea4ed411824a tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Cannot resize image /opt/stack/data/nova/instances/1b613235-a905-466f-b9cc-a21a321a6313/disk to a smaller size. {{(pid=71874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 16:12:10 user nova-compute[71874]: DEBUG nova.objects.instance [None req-096c329e-8b19-4941-9a88-ea4ed411824a tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Lazy-loading 'migration_context' on Instance uuid 1b613235-a905-466f-b9cc-a21a321a6313 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:12:10 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-096c329e-8b19-4941-9a88-ea4ed411824a tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] [instance: 1b613235-a905-466f-b9cc-a21a321a6313] Created local disks {{(pid=71874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 16:12:10 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-096c329e-8b19-4941-9a88-ea4ed411824a tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] [instance: 1b613235-a905-466f-b9cc-a21a321a6313] Ensure instance console log exists: /opt/stack/data/nova/instances/1b613235-a905-466f-b9cc-a21a321a6313/console.log {{(pid=71874) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 16:12:10 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-096c329e-8b19-4941-9a88-ea4ed411824a tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:12:10 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-096c329e-8b19-4941-9a88-ea4ed411824a tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:12:10 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-096c329e-8b19-4941-9a88-ea4ed411824a tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:12:10 user nova-compute[71874]: DEBUG nova.network.neutron [None req-096c329e-8b19-4941-9a88-ea4ed411824a tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] [instance: 1b613235-a905-466f-b9cc-a21a321a6313] Successfully created port: 8a0b8df5-77c2-4888-b715-9f4bafba36b9 {{(pid=71874) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 16:12:11 user nova-compute[71874]: DEBUG nova.network.neutron [None req-096c329e-8b19-4941-9a88-ea4ed411824a tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] [instance: 1b613235-a905-466f-b9cc-a21a321a6313] Successfully updated port: 8a0b8df5-77c2-4888-b715-9f4bafba36b9 {{(pid=71874) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 16:12:11 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-096c329e-8b19-4941-9a88-ea4ed411824a tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Acquiring lock "refresh_cache-1b613235-a905-466f-b9cc-a21a321a6313" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:12:11 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-096c329e-8b19-4941-9a88-ea4ed411824a tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Acquired lock "refresh_cache-1b613235-a905-466f-b9cc-a21a321a6313" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:12:11 user nova-compute[71874]: DEBUG nova.network.neutron [None req-096c329e-8b19-4941-9a88-ea4ed411824a tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] [instance: 1b613235-a905-466f-b9cc-a21a321a6313] Building network info cache for instance {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 16:12:11 user nova-compute[71874]: DEBUG nova.compute.manager [req-d5027c8d-0030-4255-9b28-cf0ac8968a77 req-c119940f-24c5-48b0-8f9b-62496ed56308 service nova] [instance: 1b613235-a905-466f-b9cc-a21a321a6313] Received event network-changed-8a0b8df5-77c2-4888-b715-9f4bafba36b9 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:12:11 user nova-compute[71874]: DEBUG nova.compute.manager [req-d5027c8d-0030-4255-9b28-cf0ac8968a77 req-c119940f-24c5-48b0-8f9b-62496ed56308 service nova] [instance: 1b613235-a905-466f-b9cc-a21a321a6313] Refreshing instance network info cache due to event network-changed-8a0b8df5-77c2-4888-b715-9f4bafba36b9. {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 16:12:11 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-d5027c8d-0030-4255-9b28-cf0ac8968a77 req-c119940f-24c5-48b0-8f9b-62496ed56308 service nova] Acquiring lock "refresh_cache-1b613235-a905-466f-b9cc-a21a321a6313" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:12:11 user nova-compute[71874]: DEBUG nova.network.neutron [None req-096c329e-8b19-4941-9a88-ea4ed411824a tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] [instance: 1b613235-a905-466f-b9cc-a21a321a6313] Instance cache missing network info. {{(pid=71874) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 16:12:11 user nova-compute[71874]: DEBUG nova.network.neutron [None req-096c329e-8b19-4941-9a88-ea4ed411824a tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] [instance: 1b613235-a905-466f-b9cc-a21a321a6313] Updating instance_info_cache with network_info: [{"id": "8a0b8df5-77c2-4888-b715-9f4bafba36b9", "address": "fa:16:3e:a4:ea:da", "network": {"id": "89a33fcd-81e9-4815-8644-d9b33ceb236b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-241667694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "280a9a56afca4ce591faca7a94eca4b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a0b8df5-77", "ovs_interfaceid": "8a0b8df5-77c2-4888-b715-9f4bafba36b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:12:11 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-096c329e-8b19-4941-9a88-ea4ed411824a tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Releasing lock "refresh_cache-1b613235-a905-466f-b9cc-a21a321a6313" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:12:11 user nova-compute[71874]: DEBUG nova.compute.manager [None req-096c329e-8b19-4941-9a88-ea4ed411824a tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] [instance: 1b613235-a905-466f-b9cc-a21a321a6313] Instance network_info: |[{"id": "8a0b8df5-77c2-4888-b715-9f4bafba36b9", "address": "fa:16:3e:a4:ea:da", "network": {"id": "89a33fcd-81e9-4815-8644-d9b33ceb236b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-241667694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "280a9a56afca4ce591faca7a94eca4b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a0b8df5-77", "ovs_interfaceid": "8a0b8df5-77c2-4888-b715-9f4bafba36b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 16:12:11 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-d5027c8d-0030-4255-9b28-cf0ac8968a77 req-c119940f-24c5-48b0-8f9b-62496ed56308 service nova] Acquired lock "refresh_cache-1b613235-a905-466f-b9cc-a21a321a6313" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:12:11 user nova-compute[71874]: DEBUG nova.network.neutron [req-d5027c8d-0030-4255-9b28-cf0ac8968a77 req-c119940f-24c5-48b0-8f9b-62496ed56308 service nova] [instance: 1b613235-a905-466f-b9cc-a21a321a6313] Refreshing network info cache for port 8a0b8df5-77c2-4888-b715-9f4bafba36b9 {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 16:12:11 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-096c329e-8b19-4941-9a88-ea4ed411824a tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] [instance: 1b613235-a905-466f-b9cc-a21a321a6313] Start _get_guest_xml network_info=[{"id": "8a0b8df5-77c2-4888-b715-9f4bafba36b9", "address": "fa:16:3e:a4:ea:da", "network": {"id": "89a33fcd-81e9-4815-8644-d9b33ceb236b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-241667694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "280a9a56afca4ce591faca7a94eca4b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a0b8df5-77", "ovs_interfaceid": "8a0b8df5-77c2-4888-b715-9f4bafba36b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T15:55:37Z,direct_url=<?>,disk_format='qcow2',id=9dc63f14-8b70-4e72-89f2-13464f2f5c7c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='61a4936d9b7744c0b488d81c9b7746b6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T15:55:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_options': None, 'image_id': '9dc63f14-8b70-4e72-89f2-13464f2f5c7c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 16:12:11 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-096c329e-8b19-4941-9a88-ea4ed411824a tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:12:11 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-096c329e-8b19-4941-9a88-ea4ed411824a tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:12:11 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-096c329e-8b19-4941-9a88-ea4ed411824a tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71874) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 16:12:11 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-096c329e-8b19-4941-9a88-ea4ed411824a tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T15:56:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T15:55:37Z,direct_url=<?>,disk_format='qcow2',id=9dc63f14-8b70-4e72-89f2-13464f2f5c7c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='61a4936d9b7744c0b488d81c9b7746b6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T15:55:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 16:12:11 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-096c329e-8b19-4941-9a88-ea4ed411824a tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Flavor limits 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 16:12:11 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-096c329e-8b19-4941-9a88-ea4ed411824a tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Image limits 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 16:12:11 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-096c329e-8b19-4941-9a88-ea4ed411824a tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Flavor pref 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 16:12:11 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-096c329e-8b19-4941-9a88-ea4ed411824a tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Image pref 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 16:12:11 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-096c329e-8b19-4941-9a88-ea4ed411824a tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 16:12:11 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-096c329e-8b19-4941-9a88-ea4ed411824a tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 16:12:11 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-096c329e-8b19-4941-9a88-ea4ed411824a tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 16:12:11 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-096c329e-8b19-4941-9a88-ea4ed411824a tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Got 1 possible topologies {{(pid=71874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 16:12:11 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-096c329e-8b19-4941-9a88-ea4ed411824a tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 16:12:11 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-096c329e-8b19-4941-9a88-ea4ed411824a tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 16:12:11 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-096c329e-8b19-4941-9a88-ea4ed411824a tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T16:12:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-598591302',display_name='tempest-ServersNegativeTestJSON-server-598591302',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-598591302',id=32,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='280a9a56afca4ce591faca7a94eca4b2',ramdisk_id='',reservation_id='r-tcsvpe92',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-2057017930',owner_user_name='tempest-ServersNegativeTestJSON-2057017930-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T16:12:10Z,user_data=None,user_id='38c60e84c47047e2886220f2ef54391d',uuid=1b613235-a905-466f-b9cc-a21a321a6313,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8a0b8df5-77c2-4888-b715-9f4bafba36b9", "address": "fa:16:3e:a4:ea:da", "network": {"id": "89a33fcd-81e9-4815-8644-d9b33ceb236b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-241667694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "280a9a56afca4ce591faca7a94eca4b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a0b8df5-77", "ovs_interfaceid": "8a0b8df5-77c2-4888-b715-9f4bafba36b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 16:12:11 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-096c329e-8b19-4941-9a88-ea4ed411824a tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Converting VIF {"id": "8a0b8df5-77c2-4888-b715-9f4bafba36b9", "address": "fa:16:3e:a4:ea:da", "network": {"id": "89a33fcd-81e9-4815-8644-d9b33ceb236b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-241667694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "280a9a56afca4ce591faca7a94eca4b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a0b8df5-77", "ovs_interfaceid": "8a0b8df5-77c2-4888-b715-9f4bafba36b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:12:11 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-096c329e-8b19-4941-9a88-ea4ed411824a tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:ea:da,bridge_name='br-int',has_traffic_filtering=True,id=8a0b8df5-77c2-4888-b715-9f4bafba36b9,network=Network(89a33fcd-81e9-4815-8644-d9b33ceb236b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a0b8df5-77') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:12:11 user nova-compute[71874]: DEBUG nova.objects.instance [None req-096c329e-8b19-4941-9a88-ea4ed411824a tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Lazy-loading 'pci_devices' on Instance uuid 1b613235-a905-466f-b9cc-a21a321a6313 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:12:11 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-096c329e-8b19-4941-9a88-ea4ed411824a tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] [instance: 1b613235-a905-466f-b9cc-a21a321a6313] End _get_guest_xml xml=<domain type="kvm">
Apr 12 16:12:11 user nova-compute[71874]:   <uuid>1b613235-a905-466f-b9cc-a21a321a6313</uuid>
Apr 12 16:12:11 user nova-compute[71874]:   <name>instance-00000020</name>
Apr 12 16:12:11 user nova-compute[71874]:   <memory>131072</memory>
Apr 12 16:12:11 user nova-compute[71874]:   <vcpu>1</vcpu>
Apr 12 16:12:11 user nova-compute[71874]:   <metadata>
Apr 12 16:12:11 user nova-compute[71874]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 16:12:11 user nova-compute[71874]:       <nova:package version="0.0.0"/>
Apr 12 16:12:11 user nova-compute[71874]:       <nova:name>tempest-ServersNegativeTestJSON-server-598591302</nova:name>
Apr 12 16:12:11 user nova-compute[71874]:       <nova:creationTime>2023-04-12 16:12:11</nova:creationTime>
Apr 12 16:12:11 user nova-compute[71874]:       <nova:flavor name="m1.nano">
Apr 12 16:12:11 user nova-compute[71874]:         <nova:memory>128</nova:memory>
Apr 12 16:12:11 user nova-compute[71874]:         <nova:disk>1</nova:disk>
Apr 12 16:12:11 user nova-compute[71874]:         <nova:swap>0</nova:swap>
Apr 12 16:12:11 user nova-compute[71874]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 16:12:11 user nova-compute[71874]:         <nova:vcpus>1</nova:vcpus>
Apr 12 16:12:11 user nova-compute[71874]:       </nova:flavor>
Apr 12 16:12:11 user nova-compute[71874]:       <nova:owner>
Apr 12 16:12:11 user nova-compute[71874]:         <nova:user uuid="38c60e84c47047e2886220f2ef54391d">tempest-ServersNegativeTestJSON-2057017930-project-member</nova:user>
Apr 12 16:12:11 user nova-compute[71874]:         <nova:project uuid="280a9a56afca4ce591faca7a94eca4b2">tempest-ServersNegativeTestJSON-2057017930</nova:project>
Apr 12 16:12:11 user nova-compute[71874]:       </nova:owner>
Apr 12 16:12:11 user nova-compute[71874]:       <nova:root type="image" uuid="9dc63f14-8b70-4e72-89f2-13464f2f5c7c"/>
Apr 12 16:12:11 user nova-compute[71874]:       <nova:ports>
Apr 12 16:12:11 user nova-compute[71874]:         <nova:port uuid="8a0b8df5-77c2-4888-b715-9f4bafba36b9">
Apr 12 16:12:11 user nova-compute[71874]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 12 16:12:11 user nova-compute[71874]:         </nova:port>
Apr 12 16:12:11 user nova-compute[71874]:       </nova:ports>
Apr 12 16:12:11 user nova-compute[71874]:     </nova:instance>
Apr 12 16:12:11 user nova-compute[71874]:   </metadata>
Apr 12 16:12:11 user nova-compute[71874]:   <sysinfo type="smbios">
Apr 12 16:12:11 user nova-compute[71874]:     <system>
Apr 12 16:12:11 user nova-compute[71874]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 16:12:11 user nova-compute[71874]:       <entry name="product">OpenStack Nova</entry>
Apr 12 16:12:11 user nova-compute[71874]:       <entry name="version">0.0.0</entry>
Apr 12 16:12:11 user nova-compute[71874]:       <entry name="serial">1b613235-a905-466f-b9cc-a21a321a6313</entry>
Apr 12 16:12:11 user nova-compute[71874]:       <entry name="uuid">1b613235-a905-466f-b9cc-a21a321a6313</entry>
Apr 12 16:12:11 user nova-compute[71874]:       <entry name="family">Virtual Machine</entry>
Apr 12 16:12:11 user nova-compute[71874]:     </system>
Apr 12 16:12:11 user nova-compute[71874]:   </sysinfo>
Apr 12 16:12:11 user nova-compute[71874]:   <os>
Apr 12 16:12:11 user nova-compute[71874]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 16:12:11 user nova-compute[71874]:     <boot dev="hd"/>
Apr 12 16:12:11 user nova-compute[71874]:     <smbios mode="sysinfo"/>
Apr 12 16:12:11 user nova-compute[71874]:   </os>
Apr 12 16:12:11 user nova-compute[71874]:   <features>
Apr 12 16:12:11 user nova-compute[71874]:     <acpi/>
Apr 12 16:12:11 user nova-compute[71874]:     <apic/>
Apr 12 16:12:11 user nova-compute[71874]:     <vmcoreinfo/>
Apr 12 16:12:11 user nova-compute[71874]:   </features>
Apr 12 16:12:11 user nova-compute[71874]:   <clock offset="utc">
Apr 12 16:12:11 user nova-compute[71874]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 16:12:11 user nova-compute[71874]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 16:12:11 user nova-compute[71874]:     <timer name="hpet" present="no"/>
Apr 12 16:12:11 user nova-compute[71874]:   </clock>
Apr 12 16:12:11 user nova-compute[71874]:   <cpu mode="custom" match="exact">
Apr 12 16:12:11 user nova-compute[71874]:     <model>Nehalem</model>
Apr 12 16:12:11 user nova-compute[71874]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 16:12:11 user nova-compute[71874]:   </cpu>
Apr 12 16:12:11 user nova-compute[71874]:   <devices>
Apr 12 16:12:11 user nova-compute[71874]:     <disk type="file" device="disk">
Apr 12 16:12:11 user nova-compute[71874]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 16:12:11 user nova-compute[71874]:       <source file="/opt/stack/data/nova/instances/1b613235-a905-466f-b9cc-a21a321a6313/disk"/>
Apr 12 16:12:11 user nova-compute[71874]:       <target dev="vda" bus="virtio"/>
Apr 12 16:12:11 user nova-compute[71874]:     </disk>
Apr 12 16:12:11 user nova-compute[71874]:     <interface type="ethernet">
Apr 12 16:12:11 user nova-compute[71874]:       <mac address="fa:16:3e:a4:ea:da"/>
Apr 12 16:12:11 user nova-compute[71874]:       <model type="virtio"/>
Apr 12 16:12:11 user nova-compute[71874]:       <mtu size="1442"/>
Apr 12 16:12:11 user nova-compute[71874]:       <target dev="tap8a0b8df5-77"/>
Apr 12 16:12:11 user nova-compute[71874]:     </interface>
Apr 12 16:12:11 user nova-compute[71874]:     <serial type="pty">
Apr 12 16:12:11 user nova-compute[71874]:       <log file="/opt/stack/data/nova/instances/1b613235-a905-466f-b9cc-a21a321a6313/console.log" append="off"/>
Apr 12 16:12:11 user nova-compute[71874]:     </serial>
Apr 12 16:12:11 user nova-compute[71874]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 16:12:11 user nova-compute[71874]:     <video>
Apr 12 16:12:11 user nova-compute[71874]:       <model type="virtio"/>
Apr 12 16:12:11 user nova-compute[71874]:     </video>
Apr 12 16:12:11 user nova-compute[71874]:     <rng model="virtio">
Apr 12 16:12:11 user nova-compute[71874]:       <backend model="random">/dev/urandom</backend>
Apr 12 16:12:11 user nova-compute[71874]:     </rng>
Apr 12 16:12:11 user nova-compute[71874]:     <controller type="usb" index="0" model="none"/>
Apr 12 16:12:11 user nova-compute[71874]:     <memballoon model="virtio">
Apr 12 16:12:11 user nova-compute[71874]:       <stats period="10"/>
Apr 12 16:12:11 user nova-compute[71874]:     </memballoon>
Apr 12 16:12:11 user nova-compute[71874]:   </devices>
Apr 12 16:12:11 user nova-compute[71874]: </domain>
Apr 12 16:12:11 user nova-compute[71874]:  {{(pid=71874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 16:12:11 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-096c329e-8b19-4941-9a88-ea4ed411824a tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T16:12:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-598591302',display_name='tempest-ServersNegativeTestJSON-server-598591302',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-598591302',id=32,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='280a9a56afca4ce591faca7a94eca4b2',ramdisk_id='',reservation_id='r-tcsvpe92',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-2057017930',owner_user_name='tempest-ServersNegativeTestJSON-2057017930-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T16:12:10Z,user_data=None,user_id='38c60e84c47047e2886220f2ef54391d',uuid=1b613235-a905-466f-b9cc-a21a321a6313,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8a0b8df5-77c2-4888-b715-9f4bafba36b9", "address": "fa:16:3e:a4:ea:da", "network": {"id": "89a33fcd-81e9-4815-8644-d9b33ceb236b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-241667694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "280a9a56afca4ce591faca7a94eca4b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a0b8df5-77", "ovs_interfaceid": "8a0b8df5-77c2-4888-b715-9f4bafba36b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 16:12:11 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-096c329e-8b19-4941-9a88-ea4ed411824a tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Converting VIF {"id": "8a0b8df5-77c2-4888-b715-9f4bafba36b9", "address": "fa:16:3e:a4:ea:da", "network": {"id": "89a33fcd-81e9-4815-8644-d9b33ceb236b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-241667694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "280a9a56afca4ce591faca7a94eca4b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a0b8df5-77", "ovs_interfaceid": "8a0b8df5-77c2-4888-b715-9f4bafba36b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:12:11 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-096c329e-8b19-4941-9a88-ea4ed411824a tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:ea:da,bridge_name='br-int',has_traffic_filtering=True,id=8a0b8df5-77c2-4888-b715-9f4bafba36b9,network=Network(89a33fcd-81e9-4815-8644-d9b33ceb236b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a0b8df5-77') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:12:11 user nova-compute[71874]: DEBUG os_vif [None req-096c329e-8b19-4941-9a88-ea4ed411824a tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:ea:da,bridge_name='br-int',has_traffic_filtering=True,id=8a0b8df5-77c2-4888-b715-9f4bafba36b9,network=Network(89a33fcd-81e9-4815-8644-d9b33ceb236b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a0b8df5-77') {{(pid=71874) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 16:12:11 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:12:11 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:12:11 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 16:12:11 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:12:11 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8a0b8df5-77, may_exist=True) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:12:11 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8a0b8df5-77, col_values=(('external_ids', {'iface-id': '8a0b8df5-77c2-4888-b715-9f4bafba36b9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a4:ea:da', 'vm-uuid': '1b613235-a905-466f-b9cc-a21a321a6313'}),)) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:12:11 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:12:11 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:12:11 user nova-compute[71874]: INFO os_vif [None req-096c329e-8b19-4941-9a88-ea4ed411824a tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:ea:da,bridge_name='br-int',has_traffic_filtering=True,id=8a0b8df5-77c2-4888-b715-9f4bafba36b9,network=Network(89a33fcd-81e9-4815-8644-d9b33ceb236b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a0b8df5-77')
Apr 12 16:12:11 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-096c329e-8b19-4941-9a88-ea4ed411824a tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] No BDM found with device name vda, not building metadata. {{(pid=71874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 16:12:11 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-096c329e-8b19-4941-9a88-ea4ed411824a tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] No VIF found with MAC fa:16:3e:a4:ea:da, not building metadata {{(pid=71874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 16:12:12 user nova-compute[71874]: DEBUG nova.network.neutron [req-d5027c8d-0030-4255-9b28-cf0ac8968a77 req-c119940f-24c5-48b0-8f9b-62496ed56308 service nova] [instance: 1b613235-a905-466f-b9cc-a21a321a6313] Updated VIF entry in instance network info cache for port 8a0b8df5-77c2-4888-b715-9f4bafba36b9. {{(pid=71874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 16:12:12 user nova-compute[71874]: DEBUG nova.network.neutron [req-d5027c8d-0030-4255-9b28-cf0ac8968a77 req-c119940f-24c5-48b0-8f9b-62496ed56308 service nova] [instance: 1b613235-a905-466f-b9cc-a21a321a6313] Updating instance_info_cache with network_info: [{"id": "8a0b8df5-77c2-4888-b715-9f4bafba36b9", "address": "fa:16:3e:a4:ea:da", "network": {"id": "89a33fcd-81e9-4815-8644-d9b33ceb236b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-241667694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "280a9a56afca4ce591faca7a94eca4b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a0b8df5-77", "ovs_interfaceid": "8a0b8df5-77c2-4888-b715-9f4bafba36b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:12:12 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-d5027c8d-0030-4255-9b28-cf0ac8968a77 req-c119940f-24c5-48b0-8f9b-62496ed56308 service nova] Releasing lock "refresh_cache-1b613235-a905-466f-b9cc-a21a321a6313" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:12:13 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:12:13 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:12:13 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:12:13 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:12:13 user nova-compute[71874]: DEBUG nova.compute.manager [req-424bf9a7-6e87-459d-8b8d-5a524cd07254 req-458a8876-fc27-41d6-922b-47f496331659 service nova] [instance: 1b613235-a905-466f-b9cc-a21a321a6313] Received event network-vif-plugged-8a0b8df5-77c2-4888-b715-9f4bafba36b9 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:12:13 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-424bf9a7-6e87-459d-8b8d-5a524cd07254 req-458a8876-fc27-41d6-922b-47f496331659 service nova] Acquiring lock "1b613235-a905-466f-b9cc-a21a321a6313-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:12:13 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-424bf9a7-6e87-459d-8b8d-5a524cd07254 req-458a8876-fc27-41d6-922b-47f496331659 service nova] Lock "1b613235-a905-466f-b9cc-a21a321a6313-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:12:13 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-424bf9a7-6e87-459d-8b8d-5a524cd07254 req-458a8876-fc27-41d6-922b-47f496331659 service nova] Lock "1b613235-a905-466f-b9cc-a21a321a6313-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:12:13 user nova-compute[71874]: DEBUG nova.compute.manager [req-424bf9a7-6e87-459d-8b8d-5a524cd07254 req-458a8876-fc27-41d6-922b-47f496331659 service nova] [instance: 1b613235-a905-466f-b9cc-a21a321a6313] No waiting events found dispatching network-vif-plugged-8a0b8df5-77c2-4888-b715-9f4bafba36b9 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:12:13 user nova-compute[71874]: WARNING nova.compute.manager [req-424bf9a7-6e87-459d-8b8d-5a524cd07254 req-458a8876-fc27-41d6-922b-47f496331659 service nova] [instance: 1b613235-a905-466f-b9cc-a21a321a6313] Received unexpected event network-vif-plugged-8a0b8df5-77c2-4888-b715-9f4bafba36b9 for instance with vm_state building and task_state spawning.
Apr 12 16:12:13 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:12:13 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:12:13 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:12:13 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:12:14 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9677477c-3cc7-4314-81a9-a9a9ec2f0786 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] [instance: c307e623-c546-487f-ac16-5eb24d088e8a] Calling os-brick to attach iSCSI Volume {{(pid=71874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 16:12:14 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-9677477c-3cc7-4314-81a9-a9a9ec2f0786 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3c0216320>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c7faa4f7-bc66-4311-92a9-c69ee614aa9c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vECobxkT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:12:14 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-9677477c-3cc7-4314-81a9-a9a9ec2f0786 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:12:14 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-9677477c-3cc7-4314-81a9-a9a9ec2f0786 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:12:14 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-9677477c-3cc7-4314-81a9-a9a9ec2f0786 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:12:14 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-9677477c-3cc7-4314-81a9-a9a9ec2f0786 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:12:14 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-9677477c-3cc7-4314-81a9-a9a9ec2f0786 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c7faa4f7-bc66-4311-92a9-c69ee614aa9c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:12:14 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-9677477c-3cc7-4314-81a9-a9a9ec2f0786 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c7faa4f7-bc66-4311-92a9-c69ee614aa9c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:12:14 user nova-compute[71874]: INFO os_brick.initiator.connectors.iscsi [None req-9677477c-3cc7-4314-81a9-a9a9ec2f0786 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 16:12:14 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7faa4f7-bc66-4311-92a9-c69ee614aa9c -p 172.16.0.220:3260 {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:12:14 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7faa4f7-bc66-4311-92a9-c69ee614aa9c -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:12:14 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eb59e96-9965-4ad5-844b-9f82c233c884]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:12:14 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-9677477c-3cc7-4314-81a9-a9a9ec2f0786 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 16:12:14 user nova-compute[71874]:  {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:12:14 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7faa4f7-bc66-4311-92a9-c69ee614aa9c -p 172.16.0.220:3260 --interface default --op new {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:12:14 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7faa4f7-bc66-4311-92a9-c69ee614aa9c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:12:14 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6608e9c-bd10-4116-bda4-06265d0f0e98]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c7faa4f7-bc66-4311-92a9-c69ee614aa9c] added\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:12:14 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-9677477c-3cc7-4314-81a9-a9a9ec2f0786 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c7faa4f7-bc66-4311-92a9-c69ee614aa9c] added
Apr 12 16:12:14 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:12:14 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7faa4f7-bc66-4311-92a9-c69ee614aa9c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:12:14 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7faa4f7-bc66-4311-92a9-c69ee614aa9c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:12:14 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[35a03d5a-653b-420a-b253-313fb3e04dee]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:12:14 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-9677477c-3cc7-4314-81a9-a9a9ec2f0786 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:12:14 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7faa4f7-bc66-4311-92a9-c69ee614aa9c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:12:14 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7faa4f7-bc66-4311-92a9-c69ee614aa9c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:12:14 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f0ec9ac-2b92-4a0f-b980-9336e031b4f3]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:12:14 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-9677477c-3cc7-4314-81a9-a9a9ec2f0786 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:12:14 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7faa4f7-bc66-4311-92a9-c69ee614aa9c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vECobxkT {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:12:14 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7faa4f7-bc66-4311-92a9-c69ee614aa9c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vECobxkT" returned: 0 in 0.020s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:12:14 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[302d6410-a2e6-492f-91a2-c361d5e6d43d]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:12:14 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-9677477c-3cc7-4314-81a9-a9a9ec2f0786 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vECobxkT'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:12:14 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7faa4f7-bc66-4311-92a9-c69ee614aa9c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:12:14 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7faa4f7-bc66-4311-92a9-c69ee614aa9c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:12:14 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4abc47f-6899-4352-b015-f9d7e9dbe2ff]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:12:14 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-9677477c-3cc7-4314-81a9-a9a9ec2f0786 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:12:14 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:12:14 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:12:14 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[18d6c5b3-8f5d-41d9-8bfa-36d260b23860]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f27a002-8dfc-4d90-aa35-ba16586d4366 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c961fcc-0ff0-4275-9163-406662b265f8 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304 (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:12:14 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-9677477c-3cc7-4314-81a9-a9a9ec2f0786 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:12:14 user nova-compute[71874]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f27a002-8dfc-4d90-aa35-ba16586d4366 (non-flash)
Apr 12 16:12:14 user nova-compute[71874]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 (non-flash)
Apr 12 16:12:14 user nova-compute[71874]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c961fcc-0ff0-4275-9163-406662b265f8 (non-flash)
Apr 12 16:12:14 user nova-compute[71874]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304 (non-flash)
Apr 12 16:12:14 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:12:14 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-9677477c-3cc7-4314-81a9-a9a9ec2f0786 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:12:14 user nova-compute[71874]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f27a002-8dfc-4d90-aa35-ba16586d4366 (non-flash)
Apr 12 16:12:14 user nova-compute[71874]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 (non-flash)
Apr 12 16:12:14 user nova-compute[71874]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c961fcc-0ff0-4275-9163-406662b265f8 (non-flash)
Apr 12 16:12:14 user nova-compute[71874]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304 (non-flash)
Apr 12 16:12:14 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:12:14 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7faa4f7-bc66-4311-92a9-c69ee614aa9c -p 172.16.0.220:3260 --login {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:12:14 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7faa4f7-bc66-4311-92a9-c69ee614aa9c -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:12:14 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[da2c3a10-7da4-4c55-9a2b-b75cea163092]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c7faa4f7-bc66-4311-92a9-c69ee614aa9c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c7faa4f7-bc66-4311-92a9-c69ee614aa9c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:12:14 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-9677477c-3cc7-4314-81a9-a9a9ec2f0786 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c7faa4f7-bc66-4311-92a9-c69ee614aa9c, portal: 172.16.0.220,3260]
Apr 12 16:12:14 user nova-compute[71874]: Login to [iface: default, target: iqn.2010-10.org.openstack:c7faa4f7-bc66-4311-92a9-c69ee614aa9c, portal: 172.16.0.220,3260] successful.
Apr 12 16:12:14 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:12:14 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7faa4f7-bc66-4311-92a9-c69ee614aa9c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:12:14 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7faa4f7-bc66-4311-92a9-c69ee614aa9c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:12:14 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[eec0c1a0-4ddb-4e07-ae1e-ce4b11ebdf43]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:12:14 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-9677477c-3cc7-4314-81a9-a9a9ec2f0786 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:12:14 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:12:14 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:12:14 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4152673-273a-4de4-9a28-f748bca3af42]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f27a002-8dfc-4d90-aa35-ba16586d4366 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c961fcc-0ff0-4275-9163-406662b265f8 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7faa4f7-bc66-4311-92a9-c69ee614aa9c (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:12:14 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-9677477c-3cc7-4314-81a9-a9a9ec2f0786 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:12:14 user nova-compute[71874]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f27a002-8dfc-4d90-aa35-ba16586d4366 (non-flash)
Apr 12 16:12:14 user nova-compute[71874]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 (non-flash)
Apr 12 16:12:14 user nova-compute[71874]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c961fcc-0ff0-4275-9163-406662b265f8 (non-flash)
Apr 12 16:12:14 user nova-compute[71874]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304 (non-flash)
Apr 12 16:12:14 user nova-compute[71874]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7faa4f7-bc66-4311-92a9-c69ee614aa9c (non-flash)
Apr 12 16:12:14 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:12:14 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-9677477c-3cc7-4314-81a9-a9a9ec2f0786 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:12:14 user nova-compute[71874]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f27a002-8dfc-4d90-aa35-ba16586d4366 (non-flash)
Apr 12 16:12:14 user nova-compute[71874]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 (non-flash)
Apr 12 16:12:14 user nova-compute[71874]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c961fcc-0ff0-4275-9163-406662b265f8 (non-flash)
Apr 12 16:12:14 user nova-compute[71874]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304 (non-flash)
Apr 12 16:12:14 user nova-compute[71874]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7faa4f7-bc66-4311-92a9-c69ee614aa9c (non-flash)
Apr 12 16:12:14 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:12:14 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-9677477c-3cc7-4314-81a9-a9a9ec2f0786 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c7faa4f7-bc66-4311-92a9-c69ee614aa9c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.299s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:12:14 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-9677477c-3cc7-4314-81a9-a9a9ec2f0786 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Connected to 172.16.0.220:3260 {{(pid=71874) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 16:12:14 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-9677477c-3cc7-4314-81a9-a9a9ec2f0786 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] HCTL ('38', '-', '-', 0) found on session 34 with lun 0 {{(pid=71874) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 16:12:14 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-9677477c-3cc7-4314-81a9-a9a9ec2f0786 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=71874) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 16:12:14 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:12:14 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.020s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:12:14 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3559fd5-fc24-461b-9fee-c317c824b3de]: (4, ('- - 0', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:12:14 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-9677477c-3cc7-4314-81a9-a9a9ec2f0786 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Searching for a device in session 34 and hctl ['38', '*', '*', 0] yield: None {{(pid=71874) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 16:12:15 user nova-compute[71874]: DEBUG nova.virt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Emitting event <LifecycleEvent: 1681315935.4023738, 1b613235-a905-466f-b9cc-a21a321a6313 => Resumed> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:12:15 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 1b613235-a905-466f-b9cc-a21a321a6313] VM Resumed (Lifecycle Event)
Apr 12 16:12:15 user nova-compute[71874]: DEBUG nova.compute.manager [None req-096c329e-8b19-4941-9a88-ea4ed411824a tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] [instance: 1b613235-a905-466f-b9cc-a21a321a6313] Instance event wait completed in 0 seconds for  {{(pid=71874) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 16:12:15 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-096c329e-8b19-4941-9a88-ea4ed411824a tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] [instance: 1b613235-a905-466f-b9cc-a21a321a6313] Guest created on hypervisor {{(pid=71874) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 16:12:15 user nova-compute[71874]: INFO nova.virt.libvirt.driver [-] [instance: 1b613235-a905-466f-b9cc-a21a321a6313] Instance spawned successfully.
Apr 12 16:12:15 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-096c329e-8b19-4941-9a88-ea4ed411824a tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] [instance: 1b613235-a905-466f-b9cc-a21a321a6313] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 16:12:15 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 1b613235-a905-466f-b9cc-a21a321a6313] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:12:15 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 1b613235-a905-466f-b9cc-a21a321a6313] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 16:12:15 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-096c329e-8b19-4941-9a88-ea4ed411824a tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] [instance: 1b613235-a905-466f-b9cc-a21a321a6313] Found default for hw_cdrom_bus of ide {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:12:15 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-096c329e-8b19-4941-9a88-ea4ed411824a tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] [instance: 1b613235-a905-466f-b9cc-a21a321a6313] Found default for hw_disk_bus of virtio {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:12:15 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-096c329e-8b19-4941-9a88-ea4ed411824a tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] [instance: 1b613235-a905-466f-b9cc-a21a321a6313] Found default for hw_input_bus of None {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:12:15 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-096c329e-8b19-4941-9a88-ea4ed411824a tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] [instance: 1b613235-a905-466f-b9cc-a21a321a6313] Found default for hw_pointer_model of None {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:12:15 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-096c329e-8b19-4941-9a88-ea4ed411824a tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] [instance: 1b613235-a905-466f-b9cc-a21a321a6313] Found default for hw_video_model of virtio {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:12:15 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-096c329e-8b19-4941-9a88-ea4ed411824a tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] [instance: 1b613235-a905-466f-b9cc-a21a321a6313] Found default for hw_vif_model of virtio {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:12:15 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 1b613235-a905-466f-b9cc-a21a321a6313] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 16:12:15 user nova-compute[71874]: DEBUG nova.virt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Emitting event <LifecycleEvent: 1681315935.4053676, 1b613235-a905-466f-b9cc-a21a321a6313 => Started> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:12:15 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 1b613235-a905-466f-b9cc-a21a321a6313] VM Started (Lifecycle Event)
Apr 12 16:12:15 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 1b613235-a905-466f-b9cc-a21a321a6313] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:12:15 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 1b613235-a905-466f-b9cc-a21a321a6313] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 16:12:15 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 1b613235-a905-466f-b9cc-a21a321a6313] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 16:12:15 user nova-compute[71874]: INFO nova.compute.manager [None req-096c329e-8b19-4941-9a88-ea4ed411824a tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] [instance: 1b613235-a905-466f-b9cc-a21a321a6313] Took 5.89 seconds to spawn the instance on the hypervisor.
Apr 12 16:12:15 user nova-compute[71874]: DEBUG nova.compute.manager [None req-096c329e-8b19-4941-9a88-ea4ed411824a tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] [instance: 1b613235-a905-466f-b9cc-a21a321a6313] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:12:15 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-9677477c-3cc7-4314-81a9-a9a9ec2f0786 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Searching for a device in session 34 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=71874) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 16:12:15 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-9677477c-3cc7-4314-81a9-a9a9ec2f0786 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:c7faa4f7-bc66-4311-92a9-c69ee614aa9c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vECobxkT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71874) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 16:12:15 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-9677477c-3cc7-4314-81a9-a9a9ec2f0786 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.333s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:12:15 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-9677477c-3cc7-4314-81a9-a9a9ec2f0786 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] <== connect_volume: return (1334ms) {'type': 'block', 'scsi_wwn': '23064626430373631', 'path': '/dev/sdg'} {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:12:15 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9677477c-3cc7-4314-81a9-a9a9ec2f0786 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] [instance: c307e623-c546-487f-ac16-5eb24d088e8a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23064626430373631', 'path': '/dev/sdg'} {{(pid=71874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 16:12:15 user nova-compute[71874]: DEBUG nova.compute.manager [req-0dcdca9f-0c30-4518-9054-a9f368c5edf3 req-a5cc8b6f-a69e-4d99-a8d9-ead97de8c591 service nova] [instance: 1b613235-a905-466f-b9cc-a21a321a6313] Received event network-vif-plugged-8a0b8df5-77c2-4888-b715-9f4bafba36b9 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:12:15 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-0dcdca9f-0c30-4518-9054-a9f368c5edf3 req-a5cc8b6f-a69e-4d99-a8d9-ead97de8c591 service nova] Acquiring lock "1b613235-a905-466f-b9cc-a21a321a6313-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:12:15 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-0dcdca9f-0c30-4518-9054-a9f368c5edf3 req-a5cc8b6f-a69e-4d99-a8d9-ead97de8c591 service nova] Lock "1b613235-a905-466f-b9cc-a21a321a6313-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:12:15 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-0dcdca9f-0c30-4518-9054-a9f368c5edf3 req-a5cc8b6f-a69e-4d99-a8d9-ead97de8c591 service nova] Lock "1b613235-a905-466f-b9cc-a21a321a6313-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:12:15 user nova-compute[71874]: DEBUG nova.compute.manager [req-0dcdca9f-0c30-4518-9054-a9f368c5edf3 req-a5cc8b6f-a69e-4d99-a8d9-ead97de8c591 service nova] [instance: 1b613235-a905-466f-b9cc-a21a321a6313] No waiting events found dispatching network-vif-plugged-8a0b8df5-77c2-4888-b715-9f4bafba36b9 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:12:15 user nova-compute[71874]: WARNING nova.compute.manager [req-0dcdca9f-0c30-4518-9054-a9f368c5edf3 req-a5cc8b6f-a69e-4d99-a8d9-ead97de8c591 service nova] [instance: 1b613235-a905-466f-b9cc-a21a321a6313] Received unexpected event network-vif-plugged-8a0b8df5-77c2-4888-b715-9f4bafba36b9 for instance with vm_state building and task_state spawning.
Apr 12 16:12:15 user nova-compute[71874]: DEBUG nova.objects.instance [None req-9677477c-3cc7-4314-81a9-a9a9ec2f0786 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lazy-loading 'flavor' on Instance uuid c307e623-c546-487f-ac16-5eb24d088e8a {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:12:15 user nova-compute[71874]: DEBUG nova.virt.libvirt.guest [None req-9677477c-3cc7-4314-81a9-a9a9ec2f0786 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 16:12:15 user nova-compute[71874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 16:12:15 user nova-compute[71874]:   <source dev="/dev/sdg"/>
Apr 12 16:12:15 user nova-compute[71874]:   <target dev="vdb" bus="virtio"/>
Apr 12 16:12:15 user nova-compute[71874]:   <serial>c7faa4f7-bc66-4311-92a9-c69ee614aa9c</serial>
Apr 12 16:12:15 user nova-compute[71874]: </disk>
Apr 12 16:12:15 user nova-compute[71874]:  {{(pid=71874) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 16:12:15 user nova-compute[71874]: INFO nova.compute.manager [None req-096c329e-8b19-4941-9a88-ea4ed411824a tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] [instance: 1b613235-a905-466f-b9cc-a21a321a6313] Took 6.83 seconds to build instance.
Apr 12 16:12:15 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-096c329e-8b19-4941-9a88-ea4ed411824a tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Lock "1b613235-a905-466f-b9cc-a21a321a6313" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.943s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:12:15 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-9677477c-3cc7-4314-81a9-a9a9ec2f0786 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] No BDM found with device name vda, not building metadata. {{(pid=71874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 16:12:15 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-9677477c-3cc7-4314-81a9-a9a9ec2f0786 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 16:12:15 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-9677477c-3cc7-4314-81a9-a9a9ec2f0786 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] No VIF found with MAC fa:16:3e:9c:67:25, not building metadata {{(pid=71874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 16:12:16 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-9677477c-3cc7-4314-81a9-a9a9ec2f0786 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lock "c307e623-c546-487f-ac16-5eb24d088e8a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.536s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:12:16 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:12:17 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-3e48c2b7-49a9-4da9-8f18-2193f3820a6d tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Acquiring lock "c307e623-c546-487f-ac16-5eb24d088e8a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:12:17 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-3e48c2b7-49a9-4da9-8f18-2193f3820a6d tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lock "c307e623-c546-487f-ac16-5eb24d088e8a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:12:17 user nova-compute[71874]: INFO nova.compute.manager [None req-3e48c2b7-49a9-4da9-8f18-2193f3820a6d tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] [instance: c307e623-c546-487f-ac16-5eb24d088e8a] Detaching volume c7faa4f7-bc66-4311-92a9-c69ee614aa9c
Apr 12 16:12:17 user nova-compute[71874]: INFO nova.virt.block_device [None req-3e48c2b7-49a9-4da9-8f18-2193f3820a6d tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] [instance: c307e623-c546-487f-ac16-5eb24d088e8a] Attempting to driver detach volume c7faa4f7-bc66-4311-92a9-c69ee614aa9c from mountpoint /dev/vdb
Apr 12 16:12:18 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-3e48c2b7-49a9-4da9-8f18-2193f3820a6d tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Attempting to detach device vdb from instance c307e623-c546-487f-ac16-5eb24d088e8a from the persistent domain config. {{(pid=71874) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 16:12:18 user nova-compute[71874]: DEBUG nova.virt.libvirt.guest [None req-3e48c2b7-49a9-4da9-8f18-2193f3820a6d tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 16:12:18 user nova-compute[71874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 16:12:18 user nova-compute[71874]:   <source dev="/dev/sdg"/>
Apr 12 16:12:18 user nova-compute[71874]:   <target dev="vdb" bus="virtio"/>
Apr 12 16:12:18 user nova-compute[71874]:   <serial>c7faa4f7-bc66-4311-92a9-c69ee614aa9c</serial>
Apr 12 16:12:18 user nova-compute[71874]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 16:12:18 user nova-compute[71874]: </disk>
Apr 12 16:12:18 user nova-compute[71874]:  {{(pid=71874) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 16:12:18 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-3e48c2b7-49a9-4da9-8f18-2193f3820a6d tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Successfully detached device vdb from instance c307e623-c546-487f-ac16-5eb24d088e8a from the persistent domain config.
Apr 12 16:12:18 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-3e48c2b7-49a9-4da9-8f18-2193f3820a6d tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c307e623-c546-487f-ac16-5eb24d088e8a from the live domain config. {{(pid=71874) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 16:12:18 user nova-compute[71874]: DEBUG nova.virt.libvirt.guest [None req-3e48c2b7-49a9-4da9-8f18-2193f3820a6d tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 16:12:18 user nova-compute[71874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 16:12:18 user nova-compute[71874]:   <source dev="/dev/sdg"/>
Apr 12 16:12:18 user nova-compute[71874]:   <target dev="vdb" bus="virtio"/>
Apr 12 16:12:18 user nova-compute[71874]:   <serial>c7faa4f7-bc66-4311-92a9-c69ee614aa9c</serial>
Apr 12 16:12:18 user nova-compute[71874]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 16:12:18 user nova-compute[71874]: </disk>
Apr 12 16:12:18 user nova-compute[71874]:  {{(pid=71874) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 16:12:18 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:12:18 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Received event <DeviceRemovedEvent: 1681315938.52484, c307e623-c546-487f-ac16-5eb24d088e8a => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71874) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 16:12:18 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-3e48c2b7-49a9-4da9-8f18-2193f3820a6d tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c307e623-c546-487f-ac16-5eb24d088e8a {{(pid=71874) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 16:12:18 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-3e48c2b7-49a9-4da9-8f18-2193f3820a6d tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Successfully detached device vdb from instance c307e623-c546-487f-ac16-5eb24d088e8a from the live domain config.
Apr 12 16:12:18 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e48c2b7-49a9-4da9-8f18-2193f3820a6d tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] [instance: c307e623-c546-487f-ac16-5eb24d088e8a] calling os-brick to detach iSCSI Volume {{(pid=71874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 16:12:18 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e48c2b7-49a9-4da9-8f18-2193f3820a6d tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3c0216320>, {'target_iqn': 'iqn.2010-10.org.openstack:c7faa4f7-bc66-4311-92a9-c69ee614aa9c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vECobxkT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg': {}}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:12:18 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-3e48c2b7-49a9-4da9-8f18-2193f3820a6d tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:12:18 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-3e48c2b7-49a9-4da9-8f18-2193f3820a6d tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:12:18 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-3e48c2b7-49a9-4da9-8f18-2193f3820a6d tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:12:18 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:12:18 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:12:18 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[60a18635-f95d-4642-a630-9fc722cb511f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1f27a002-8dfc-4d90-aa35-ba16586d4366\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9c961fcc-0ff0-4275-9163-406662b265f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c7faa4f7-bc66-4311-92a9-c69ee614aa9c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:12:18 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e48c2b7-49a9-4da9-8f18-2193f3820a6d tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 16:12:18 user nova-compute[71874]: No targets found.
Apr 12 16:12:18 user nova-compute[71874]: iSNS:
Apr 12 16:12:18 user nova-compute[71874]: No targets found.
Apr 12 16:12:18 user nova-compute[71874]: STATIC:
Apr 12 16:12:18 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:1f27a002-8dfc-4d90-aa35-ba16586d4366
Apr 12 16:12:18 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:12:18 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:12:18 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:9c961fcc-0ff0-4275-9163-406662b265f8
Apr 12 16:12:18 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:12:18 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:12:18 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:c7faa4f7-bc66-4311-92a9-c69ee614aa9c
Apr 12 16:12:18 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:12:18 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:12:18 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304
Apr 12 16:12:18 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:12:18 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:12:18 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297
Apr 12 16:12:18 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:12:18 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:12:18 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2
Apr 12 16:12:18 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:12:18 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:12:18 user nova-compute[71874]: FIRMWARE:
Apr 12 16:12:18 user nova-compute[71874]: No targets found.
Apr 12 16:12:18 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:12:18 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e48c2b7-49a9-4da9-8f18-2193f3820a6d tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 16:12:18 user nova-compute[71874]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 16:12:18 user nova-compute[71874]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71874) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 16:12:18 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e48c2b7-49a9-4da9-8f18-2193f3820a6d tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c7faa4f7-bc66-4311-92a9-c69ee614aa9c', 0)] {{(pid=71874) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 16:12:18 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:12:18 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:12:18 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae1ed8ec-714d-491b-b81e-3e9b629582a6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1f27a002-8dfc-4d90-aa35-ba16586d4366\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c961fcc-0ff0-4275-9163-406662b265f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7faa4f7-bc66-4311-92a9-c69ee614aa9c\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:12:18 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:12:18 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:12:18 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[864c5856-2140-4755-92df-ea9601742fd4]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f27a002-8dfc-4d90-aa35-ba16586d4366 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c961fcc-0ff0-4275-9163-406662b265f8 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7faa4f7-bc66-4311-92a9-c69ee614aa9c (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:12:18 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e48c2b7-49a9-4da9-8f18-2193f3820a6d tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:12:18 user nova-compute[71874]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f27a002-8dfc-4d90-aa35-ba16586d4366 (non-flash)
Apr 12 16:12:18 user nova-compute[71874]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 (non-flash)
Apr 12 16:12:18 user nova-compute[71874]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c961fcc-0ff0-4275-9163-406662b265f8 (non-flash)
Apr 12 16:12:18 user nova-compute[71874]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304 (non-flash)
Apr 12 16:12:18 user nova-compute[71874]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7faa4f7-bc66-4311-92a9-c69ee614aa9c (non-flash)
Apr 12 16:12:18 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:12:18 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e48c2b7-49a9-4da9-8f18-2193f3820a6d tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:12:18 user nova-compute[71874]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f27a002-8dfc-4d90-aa35-ba16586d4366 (non-flash)
Apr 12 16:12:18 user nova-compute[71874]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 (non-flash)
Apr 12 16:12:18 user nova-compute[71874]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c961fcc-0ff0-4275-9163-406662b265f8 (non-flash)
Apr 12 16:12:18 user nova-compute[71874]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304 (non-flash)
Apr 12 16:12:18 user nova-compute[71874]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7faa4f7-bc66-4311-92a9-c69ee614aa9c (non-flash)
Apr 12 16:12:18 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:12:18 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e48c2b7-49a9-4da9-8f18-2193f3820a6d tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc3d45fa4d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c7faa4f7-bc66-4311-92a9-c69ee614aa9c'): ({'sdg'}, set())}) {{(pid=71874) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 16:12:18 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-3e48c2b7-49a9-4da9-8f18-2193f3820a6d tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Removing single pathed devices sdg {{(pid=71874) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 16:12:18 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:12:18 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:12:18 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[f25c3afc-28fc-40dc-ae1d-95be3bb7d225]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:12:18 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:12:18 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.018s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:12:18 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[30106489-ab8f-4696-abeb-55798ccc2fc0]: (4, ('ok\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:12:18 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-3e48c2b7-49a9-4da9-8f18-2193f3820a6d tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Flushing IO for device /dev/sdg {{(pid=71874) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 16:12:18 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:12:18 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:12:18 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a17a5ff-df1b-474a-bb2f-5800bda51124]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:12:18 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-3e48c2b7-49a9-4da9-8f18-2193f3820a6d tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=71874) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 16:12:18 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:12:18 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.047s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:12:18 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f102dae-2e7e-444d-b278-51c784c13040]: (4, ('1', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:12:18 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-3e48c2b7-49a9-4da9-8f18-2193f3820a6d tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=71874) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 16:12:18 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-3e48c2b7-49a9-4da9-8f18-2193f3820a6d tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] SCSI volumes sdg have been removed. {{(pid=71874) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 16:12:18 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e48c2b7-49a9-4da9-8f18-2193f3820a6d tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c7faa4f7-bc66-4311-92a9-c69ee614aa9c')] {{(pid=71874) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 16:12:18 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7faa4f7-bc66-4311-92a9-c69ee614aa9c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:12:18 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7faa4f7-bc66-4311-92a9-c69ee614aa9c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:12:18 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[55388a25-7f5b-46e2-8154-8c6468e0d37e]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:12:18 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e48c2b7-49a9-4da9-8f18-2193f3820a6d tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:12:18 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7faa4f7-bc66-4311-92a9-c69ee614aa9c -p 172.16.0.220:3260 --logout {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:12:18 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7faa4f7-bc66-4311-92a9-c69ee614aa9c -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:12:18 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f9d18f0-7908-4ff9-a574-f0e5a7d40784]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:c7faa4f7-bc66-4311-92a9-c69ee614aa9c, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:c7faa4f7-bc66-4311-92a9-c69ee614aa9c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:12:18 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e48c2b7-49a9-4da9-8f18-2193f3820a6d tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:c7faa4f7-bc66-4311-92a9-c69ee614aa9c, portal: 172.16.0.220,3260]
Apr 12 16:12:18 user nova-compute[71874]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:c7faa4f7-bc66-4311-92a9-c69ee614aa9c, portal: 172.16.0.220,3260] successful.
Apr 12 16:12:18 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:12:18 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7faa4f7-bc66-4311-92a9-c69ee614aa9c -p 172.16.0.220:3260 --op delete {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:12:18 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7faa4f7-bc66-4311-92a9-c69ee614aa9c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:12:18 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[079a7763-f4bf-4f09-9a50-18abb7f6d356]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:12:18 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e48c2b7-49a9-4da9-8f18-2193f3820a6d tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:12:18 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-3e48c2b7-49a9-4da9-8f18-2193f3820a6d tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.347s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:12:18 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e48c2b7-49a9-4da9-8f18-2193f3820a6d tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] <== disconnect_volume: return (348ms) None {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:12:18 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e48c2b7-49a9-4da9-8f18-2193f3820a6d tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] [instance: c307e623-c546-487f-ac16-5eb24d088e8a] Disconnected iSCSI Volume {{(pid=71874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 16:12:19 user nova-compute[71874]: DEBUG nova.objects.instance [None req-3e48c2b7-49a9-4da9-8f18-2193f3820a6d tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lazy-loading 'flavor' on Instance uuid c307e623-c546-487f-ac16-5eb24d088e8a {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:12:19 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-3e48c2b7-49a9-4da9-8f18-2193f3820a6d tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lock "c307e623-c546-487f-ac16-5eb24d088e8a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.810s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:12:21 user nova-compute[71874]: DEBUG nova.compute.manager [req-8b233ec1-cecb-4c17-8276-632237add106 req-b7745c8e-ea52-4e62-939b-ecfc21a0a24d service nova] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Received event network-changed-eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:12:21 user nova-compute[71874]: DEBUG nova.compute.manager [req-8b233ec1-cecb-4c17-8276-632237add106 req-b7745c8e-ea52-4e62-939b-ecfc21a0a24d service nova] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Refreshing instance network info cache due to event network-changed-eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c. {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 16:12:21 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-8b233ec1-cecb-4c17-8276-632237add106 req-b7745c8e-ea52-4e62-939b-ecfc21a0a24d service nova] Acquiring lock "refresh_cache-4190e244-84b1-47b6-813d-9cadb7c65975" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:12:21 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-8b233ec1-cecb-4c17-8276-632237add106 req-b7745c8e-ea52-4e62-939b-ecfc21a0a24d service nova] Acquired lock "refresh_cache-4190e244-84b1-47b6-813d-9cadb7c65975" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:12:21 user nova-compute[71874]: DEBUG nova.network.neutron [req-8b233ec1-cecb-4c17-8276-632237add106 req-b7745c8e-ea52-4e62-939b-ecfc21a0a24d service nova] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Refreshing network info cache for port eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 16:12:21 user nova-compute[71874]: DEBUG nova.network.neutron [req-8b233ec1-cecb-4c17-8276-632237add106 req-b7745c8e-ea52-4e62-939b-ecfc21a0a24d service nova] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Updated VIF entry in instance network info cache for port eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c. {{(pid=71874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 16:12:21 user nova-compute[71874]: DEBUG nova.network.neutron [req-8b233ec1-cecb-4c17-8276-632237add106 req-b7745c8e-ea52-4e62-939b-ecfc21a0a24d service nova] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Updating instance_info_cache with network_info: [{"id": "eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c", "address": "fa:16:3e:d0:b5:d4", "network": {"id": "1ef428ff-90e5-4abd-93d0-b7c2c581cb26", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-425924095-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf4334df004490ba51b4d92ce5408ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeab1ea0c-8a", "ovs_interfaceid": "eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:12:21 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-8b233ec1-cecb-4c17-8276-632237add106 req-b7745c8e-ea52-4e62-939b-ecfc21a0a24d service nova] Releasing lock "refresh_cache-4190e244-84b1-47b6-813d-9cadb7c65975" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:12:21 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:12:21 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:12:22 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-af45d26c-85d6-4f16-9df9-b2f77112e5fe tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Acquiring lock "4190e244-84b1-47b6-813d-9cadb7c65975" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:12:22 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-af45d26c-85d6-4f16-9df9-b2f77112e5fe tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "4190e244-84b1-47b6-813d-9cadb7c65975" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:12:22 user nova-compute[71874]: DEBUG nova.objects.instance [None req-af45d26c-85d6-4f16-9df9-b2f77112e5fe tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lazy-loading 'flavor' on Instance uuid 4190e244-84b1-47b6-813d-9cadb7c65975 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:12:22 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-af45d26c-85d6-4f16-9df9-b2f77112e5fe tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "4190e244-84b1-47b6-813d-9cadb7c65975" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:12:22 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:12:22 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:12:22 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:12:22 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:12:22 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Auditing locally available compute resources for user (node: user) {{(pid=71874) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 16:12:23 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-af45d26c-85d6-4f16-9df9-b2f77112e5fe tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Acquiring lock "4190e244-84b1-47b6-813d-9cadb7c65975" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:12:23 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-af45d26c-85d6-4f16-9df9-b2f77112e5fe tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "4190e244-84b1-47b6-813d-9cadb7c65975" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:12:23 user nova-compute[71874]: INFO nova.compute.manager [None req-af45d26c-85d6-4f16-9df9-b2f77112e5fe tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Attaching volume ce38c1b3-35b0-48cc-9b83-e9a676997784 to /dev/vdb
Apr 12 16:12:23 user nova-compute[71874]: DEBUG os_brick.utils [None req-af45d26c-85d6-4f16-9df9-b2f77112e5fe tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:12:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:12:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f641c6b-b508-42a7-ae98-c2bfb841d798/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:12:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:12:23 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f7230c2-44fe-4e10-8887-f169b7cb9f2d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:61a48d4489d2\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:12:23 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:12:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:12:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:12:23 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[59aac0db-980f-47be-8cda-5793ea83f933]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:12:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:12:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:12:23 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f7cf038-baaf-479a-9fe3-8409ee085e1e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:12:23 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[690e7626-6e05-40c8-a93a-7ba3e9157a8a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:12:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-af45d26c-85d6-4f16-9df9-b2f77112e5fe tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Running cmd (subprocess): nvme version {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:12:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-af45d26c-85d6-4f16-9df9-b2f77112e5fe tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] 'nvme version' failed. Not Retrying. {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 16:12:23 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.nvmeof [None req-af45d26c-85d6-4f16-9df9-b2f77112e5fe tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] nvme not present on system {{(pid=71874) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 16:12:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:12:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f641c6b-b508-42a7-ae98-c2bfb841d798/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:12:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f641c6b-b508-42a7-ae98-c2bfb841d798/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:12:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 16:12:23 user nova-compute[71874]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 16:12:23 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc120c46-9b6f-4044-b9c5-37b56f074e04]: (4, '') {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:12:23 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.lightos [None req-af45d26c-85d6-4f16-9df9-b2f77112e5fe tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71874) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 16:12:23 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.lightos [None req-af45d26c-85d6-4f16-9df9-b2f77112e5fe tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71874) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 16:12:23 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.lightos [None req-af45d26c-85d6-4f16-9df9-b2f77112e5fe tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] LIGHTOS: no hostnqn found. {{(pid=71874) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 16:12:23 user nova-compute[71874]: DEBUG os_brick.utils [None req-af45d26c-85d6-4f16-9df9-b2f77112e5fe tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] <== get_connector_properties: return (209ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:61a48d4489d2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:12:23 user nova-compute[71874]: DEBUG nova.virt.block_device [None req-af45d26c-85d6-4f16-9df9-b2f77112e5fe tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Updating existing volume attachment record: 8f84a503-70fb-4a7f-b518-394a270ae17e {{(pid=71874) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 16:12:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f641c6b-b508-42a7-ae98-c2bfb841d798/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:12:23 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=71874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 16:12:23 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 16:12:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473a30c4-5aa4-481c-8859-fda815d14872/disk.rescue --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:12:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473a30c4-5aa4-481c-8859-fda815d14872/disk.rescue --force-share --output=json" returned: 0 in 0.155s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:12:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473a30c4-5aa4-481c-8859-fda815d14872/disk.rescue --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:12:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473a30c4-5aa4-481c-8859-fda815d14872/disk.rescue --force-share --output=json" returned: 0 in 0.147s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:12:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473a30c4-5aa4-481c-8859-fda815d14872/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:12:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473a30c4-5aa4-481c-8859-fda815d14872/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:12:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473a30c4-5aa4-481c-8859-fda815d14872/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:12:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473a30c4-5aa4-481c-8859-fda815d14872/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:12:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4190e244-84b1-47b6-813d-9cadb7c65975/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:12:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4190e244-84b1-47b6-813d-9cadb7c65975/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:12:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4190e244-84b1-47b6-813d-9cadb7c65975/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:12:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4190e244-84b1-47b6-813d-9cadb7c65975/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:12:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:12:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:12:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:12:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:12:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:12:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:12:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:12:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:12:24 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 16:12:24 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=71874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 16:12:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/016ae41d-b098-4126-ace7-3da00b40cb9c/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:12:25 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/016ae41d-b098-4126-ace7-3da00b40cb9c/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:12:25 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/016ae41d-b098-4126-ace7-3da00b40cb9c/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:12:25 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/016ae41d-b098-4126-ace7-3da00b40cb9c/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:12:25 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/608fbea2-b42b-4bb9-94a7-2b76dcdc2001/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:12:25 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/608fbea2-b42b-4bb9-94a7-2b76dcdc2001/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:12:25 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/608fbea2-b42b-4bb9-94a7-2b76dcdc2001/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:12:25 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/608fbea2-b42b-4bb9-94a7-2b76dcdc2001/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:12:25 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b613235-a905-466f-b9cc-a21a321a6313/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:12:25 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b613235-a905-466f-b9cc-a21a321a6313/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:12:25 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b613235-a905-466f-b9cc-a21a321a6313/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:12:25 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b613235-a905-466f-b9cc-a21a321a6313/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:12:25 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2511c44-8365-4e8c-9814-172547111b9f/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:12:25 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2511c44-8365-4e8c-9814-172547111b9f/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:12:25 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2511c44-8365-4e8c-9814-172547111b9f/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:12:26 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2511c44-8365-4e8c-9814-172547111b9f/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:12:26 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84683344-2893-4446-90ae-e64cd799eb20/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:12:26 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84683344-2893-4446-90ae-e64cd799eb20/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:12:26 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84683344-2893-4446-90ae-e64cd799eb20/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:12:26 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84683344-2893-4446-90ae-e64cd799eb20/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:12:26 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 16:12:26 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afebffae-dbf6-4876-8c9f-0364f0fde49c/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:12:26 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afebffae-dbf6-4876-8c9f-0364f0fde49c/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:12:26 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afebffae-dbf6-4876-8c9f-0364f0fde49c/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:12:26 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afebffae-dbf6-4876-8c9f-0364f0fde49c/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:12:26 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c307e623-c546-487f-ac16-5eb24d088e8a/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:12:26 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:12:26 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c307e623-c546-487f-ac16-5eb24d088e8a/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:12:26 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c307e623-c546-487f-ac16-5eb24d088e8a/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:12:27 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c307e623-c546-487f-ac16-5eb24d088e8a/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:12:27 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78b6940a-f97a-4535-8973-3c2a5befbbab/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:12:27 user nova-compute[71874]: DEBUG nova.compute.manager [req-bc1cebc5-df37-4872-86b9-3c43ed28e571 req-54eeefb7-124a-43e4-96a8-5baf30fede9f service nova] [instance: 84683344-2893-4446-90ae-e64cd799eb20] Received event network-changed-a8837af3-03f7-4b3d-8a2a-746f2d8038ad {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:12:27 user nova-compute[71874]: DEBUG nova.compute.manager [req-bc1cebc5-df37-4872-86b9-3c43ed28e571 req-54eeefb7-124a-43e4-96a8-5baf30fede9f service nova] [instance: 84683344-2893-4446-90ae-e64cd799eb20] Refreshing instance network info cache due to event network-changed-a8837af3-03f7-4b3d-8a2a-746f2d8038ad. {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 16:12:27 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-bc1cebc5-df37-4872-86b9-3c43ed28e571 req-54eeefb7-124a-43e4-96a8-5baf30fede9f service nova] Acquiring lock "refresh_cache-84683344-2893-4446-90ae-e64cd799eb20" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:12:27 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-bc1cebc5-df37-4872-86b9-3c43ed28e571 req-54eeefb7-124a-43e4-96a8-5baf30fede9f service nova] Acquired lock "refresh_cache-84683344-2893-4446-90ae-e64cd799eb20" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:12:27 user nova-compute[71874]: DEBUG nova.network.neutron [req-bc1cebc5-df37-4872-86b9-3c43ed28e571 req-54eeefb7-124a-43e4-96a8-5baf30fede9f service nova] [instance: 84683344-2893-4446-90ae-e64cd799eb20] Refreshing network info cache for port a8837af3-03f7-4b3d-8a2a-746f2d8038ad {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 16:12:27 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78b6940a-f97a-4535-8973-3c2a5befbbab/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:12:27 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78b6940a-f97a-4535-8973-3c2a5befbbab/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:12:27 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78b6940a-f97a-4535-8973-3c2a5befbbab/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:12:28 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:12:28 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af45d26c-85d6-4f16-9df9-b2f77112e5fe tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Calling os-brick to attach iSCSI Volume {{(pid=71874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 16:12:28 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-af45d26c-85d6-4f16-9df9-b2f77112e5fe tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3c0216320>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ce38c1b3-35b0-48cc-9b83-e9a676997784', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'APVXFMTJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:12:28 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-af45d26c-85d6-4f16-9df9-b2f77112e5fe tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:12:28 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-af45d26c-85d6-4f16-9df9-b2f77112e5fe tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:12:28 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-af45d26c-85d6-4f16-9df9-b2f77112e5fe tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:12:28 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-af45d26c-85d6-4f16-9df9-b2f77112e5fe tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:12:28 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-af45d26c-85d6-4f16-9df9-b2f77112e5fe tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ce38c1b3-35b0-48cc-9b83-e9a676997784" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:12:28 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-af45d26c-85d6-4f16-9df9-b2f77112e5fe tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ce38c1b3-35b0-48cc-9b83-e9a676997784" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:12:28 user nova-compute[71874]: INFO os_brick.initiator.connectors.iscsi [None req-af45d26c-85d6-4f16-9df9-b2f77112e5fe tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 16:12:28 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce38c1b3-35b0-48cc-9b83-e9a676997784 -p 172.16.0.220:3260 {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:12:28 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:12:28 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:12:28 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Hypervisor/Node resource view: name=user free_ram=7188MB free_disk=25.72732925415039GB free_vcpus=-3 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71874) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 16:12:28 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:12:28 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:12:28 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce38c1b3-35b0-48cc-9b83-e9a676997784 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:12:28 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[069049b5-8baf-4180-9997-435283cf3f61]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:12:28 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-af45d26c-85d6-4f16-9df9-b2f77112e5fe tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 16:12:28 user nova-compute[71874]:  {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:12:28 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce38c1b3-35b0-48cc-9b83-e9a676997784 -p 172.16.0.220:3260 --interface default --op new {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:12:28 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce38c1b3-35b0-48cc-9b83-e9a676997784 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:12:28 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[43e839da-9d46-428c-b37a-019fc0c77858]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ce38c1b3-35b0-48cc-9b83-e9a676997784] added\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:12:28 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-af45d26c-85d6-4f16-9df9-b2f77112e5fe tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ce38c1b3-35b0-48cc-9b83-e9a676997784] added
Apr 12 16:12:28 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:12:28 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce38c1b3-35b0-48cc-9b83-e9a676997784 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:12:28 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce38c1b3-35b0-48cc-9b83-e9a676997784 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:12:28 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef160f7d-2f40-4a4f-b47b-4d4293e705fa]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:12:28 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-af45d26c-85d6-4f16-9df9-b2f77112e5fe tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:12:28 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce38c1b3-35b0-48cc-9b83-e9a676997784 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:12:28 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce38c1b3-35b0-48cc-9b83-e9a676997784 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:12:28 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba026f0b-3bc0-4969-8b35-191ded31d61b]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:12:28 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-af45d26c-85d6-4f16-9df9-b2f77112e5fe tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:12:28 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce38c1b3-35b0-48cc-9b83-e9a676997784 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v APVXFMTJ {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:12:28 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce38c1b3-35b0-48cc-9b83-e9a676997784 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v APVXFMTJ" returned: 0 in 0.036s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:12:28 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[617a3c84-7843-449d-996e-625cd4be599a]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:12:28 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-af45d26c-85d6-4f16-9df9-b2f77112e5fe tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'APVXFMTJ'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:12:28 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce38c1b3-35b0-48cc-9b83-e9a676997784 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:12:28 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance afebffae-dbf6-4876-8c9f-0364f0fde49c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:12:28 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 473a30c4-5aa4-481c-8859-fda815d14872 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:12:28 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 608fbea2-b42b-4bb9-94a7-2b76dcdc2001 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:12:28 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance f52ee906-c8fd-4cd5-842e-de98a5099c4f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:12:28 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 78b6940a-f97a-4535-8973-3c2a5befbbab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:12:28 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 7f641c6b-b508-42a7-ae98-c2bfb841d798 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:12:28 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 016ae41d-b098-4126-ace7-3da00b40cb9c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:12:28 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:12:28 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 84683344-2893-4446-90ae-e64cd799eb20 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:12:28 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance f2511c44-8365-4e8c-9814-172547111b9f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:12:28 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance c307e623-c546-487f-ac16-5eb24d088e8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:12:28 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 4190e244-84b1-47b6-813d-9cadb7c65975 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:12:28 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:12:28 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 0e8a977c-aa84-47c4-a838-b5f90820de1a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:12:28 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 1b613235-a905-466f-b9cc-a21a321a6313 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:12:28 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Total usable vcpus: 12, total allocated vcpus: 15 {{(pid=71874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 16:12:28 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Final resource view: name=user phys_ram=16023MB used_ram=2432MB phys_disk=40GB used_disk=13GB total_vcpus=12 used_vcpus=15 pci_stats=[] {{(pid=71874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 16:12:28 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce38c1b3-35b0-48cc-9b83-e9a676997784 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.034s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:12:28 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[21571a4f-3106-452c-98d9-2fba8738bfef]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:12:28 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-af45d26c-85d6-4f16-9df9-b2f77112e5fe tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:12:28 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:12:28 user nova-compute[71874]: DEBUG nova.compute.manager [req-bf51c2ad-4c24-4b30-bfbc-45922594646d req-8fcf8965-9bae-4646-a8e0-83dfa8c8606c service nova] [instance: 84683344-2893-4446-90ae-e64cd799eb20] Received event network-changed-a8837af3-03f7-4b3d-8a2a-746f2d8038ad {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:12:28 user nova-compute[71874]: DEBUG nova.compute.manager [req-bf51c2ad-4c24-4b30-bfbc-45922594646d req-8fcf8965-9bae-4646-a8e0-83dfa8c8606c service nova] [instance: 84683344-2893-4446-90ae-e64cd799eb20] Refreshing instance network info cache due to event network-changed-a8837af3-03f7-4b3d-8a2a-746f2d8038ad. {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 16:12:28 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-bf51c2ad-4c24-4b30-bfbc-45922594646d req-8fcf8965-9bae-4646-a8e0-83dfa8c8606c service nova] Acquiring lock "refresh_cache-84683344-2893-4446-90ae-e64cd799eb20" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:12:28 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:12:28 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[763faaef-768c-4960-9940-905c26644890]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f27a002-8dfc-4d90-aa35-ba16586d4366 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c961fcc-0ff0-4275-9163-406662b265f8 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304 (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:12:28 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-af45d26c-85d6-4f16-9df9-b2f77112e5fe tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:12:28 user nova-compute[71874]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f27a002-8dfc-4d90-aa35-ba16586d4366 (non-flash)
Apr 12 16:12:28 user nova-compute[71874]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 (non-flash)
Apr 12 16:12:28 user nova-compute[71874]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c961fcc-0ff0-4275-9163-406662b265f8 (non-flash)
Apr 12 16:12:28 user nova-compute[71874]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304 (non-flash)
Apr 12 16:12:28 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:12:28 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-af45d26c-85d6-4f16-9df9-b2f77112e5fe tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:12:28 user nova-compute[71874]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f27a002-8dfc-4d90-aa35-ba16586d4366 (non-flash)
Apr 12 16:12:28 user nova-compute[71874]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 (non-flash)
Apr 12 16:12:28 user nova-compute[71874]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c961fcc-0ff0-4275-9163-406662b265f8 (non-flash)
Apr 12 16:12:28 user nova-compute[71874]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304 (non-flash)
Apr 12 16:12:28 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:12:28 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce38c1b3-35b0-48cc-9b83-e9a676997784 -p 172.16.0.220:3260 --login {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:12:28 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce38c1b3-35b0-48cc-9b83-e9a676997784 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:12:28 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[249a6c0d-9181-4109-b512-045c70a9404f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ce38c1b3-35b0-48cc-9b83-e9a676997784, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ce38c1b3-35b0-48cc-9b83-e9a676997784, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:12:28 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-af45d26c-85d6-4f16-9df9-b2f77112e5fe tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ce38c1b3-35b0-48cc-9b83-e9a676997784, portal: 172.16.0.220,3260]
Apr 12 16:12:28 user nova-compute[71874]: Login to [iface: default, target: iqn.2010-10.org.openstack:ce38c1b3-35b0-48cc-9b83-e9a676997784, portal: 172.16.0.220,3260] successful.
Apr 12 16:12:28 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:12:28 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce38c1b3-35b0-48cc-9b83-e9a676997784 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:12:28 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce38c1b3-35b0-48cc-9b83-e9a676997784 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:12:28 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ad0fb21-88b8-47f6-98c5-b28747edf273]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:12:28 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-af45d26c-85d6-4f16-9df9-b2f77112e5fe tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:12:28 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:12:28 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:12:28 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcd34abd-c3f1-4387-a8f8-23b76ee3fc6b]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f27a002-8dfc-4d90-aa35-ba16586d4366 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c961fcc-0ff0-4275-9163-406662b265f8 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce38c1b3-35b0-48cc-9b83-e9a676997784 (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:12:28 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-af45d26c-85d6-4f16-9df9-b2f77112e5fe tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:12:28 user nova-compute[71874]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f27a002-8dfc-4d90-aa35-ba16586d4366 (non-flash)
Apr 12 16:12:28 user nova-compute[71874]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 (non-flash)
Apr 12 16:12:28 user nova-compute[71874]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c961fcc-0ff0-4275-9163-406662b265f8 (non-flash)
Apr 12 16:12:28 user nova-compute[71874]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304 (non-flash)
Apr 12 16:12:28 user nova-compute[71874]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce38c1b3-35b0-48cc-9b83-e9a676997784 (non-flash)
Apr 12 16:12:28 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:12:28 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-af45d26c-85d6-4f16-9df9-b2f77112e5fe tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:12:28 user nova-compute[71874]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f27a002-8dfc-4d90-aa35-ba16586d4366 (non-flash)
Apr 12 16:12:28 user nova-compute[71874]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 (non-flash)
Apr 12 16:12:28 user nova-compute[71874]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c961fcc-0ff0-4275-9163-406662b265f8 (non-flash)
Apr 12 16:12:28 user nova-compute[71874]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304 (non-flash)
Apr 12 16:12:28 user nova-compute[71874]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce38c1b3-35b0-48cc-9b83-e9a676997784 (non-flash)
Apr 12 16:12:28 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:12:28 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-af45d26c-85d6-4f16-9df9-b2f77112e5fe tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ce38c1b3-35b0-48cc-9b83-e9a676997784" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.426s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:12:28 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-af45d26c-85d6-4f16-9df9-b2f77112e5fe tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Connected to 172.16.0.220:3260 {{(pid=71874) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 16:12:28 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-af45d26c-85d6-4f16-9df9-b2f77112e5fe tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] HCTL ('38', '-', '-', 0) found on session 35 with lun 0 {{(pid=71874) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 16:12:28 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-af45d26c-85d6-4f16-9df9-b2f77112e5fe tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=71874) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 16:12:28 user nova-compute[71874]: DEBUG nova.network.neutron [req-bc1cebc5-df37-4872-86b9-3c43ed28e571 req-54eeefb7-124a-43e4-96a8-5baf30fede9f service nova] [instance: 84683344-2893-4446-90ae-e64cd799eb20] Updated VIF entry in instance network info cache for port a8837af3-03f7-4b3d-8a2a-746f2d8038ad. {{(pid=71874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 16:12:28 user nova-compute[71874]: DEBUG nova.network.neutron [req-bc1cebc5-df37-4872-86b9-3c43ed28e571 req-54eeefb7-124a-43e4-96a8-5baf30fede9f service nova] [instance: 84683344-2893-4446-90ae-e64cd799eb20] Updating instance_info_cache with network_info: [{"id": "a8837af3-03f7-4b3d-8a2a-746f2d8038ad", "address": "fa:16:3e:71:77:df", "network": {"id": "58f92787-e3b6-4fd3-bd75-7169f1a36651", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-614349033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "236b9e609eb44071bc88971bff96931e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8837af3-03", "ovs_interfaceid": "a8837af3-03f7-4b3d-8a2a-746f2d8038ad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:12:28 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:12:28 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-bc1cebc5-df37-4872-86b9-3c43ed28e571 req-54eeefb7-124a-43e4-96a8-5baf30fede9f service nova] Releasing lock "refresh_cache-84683344-2893-4446-90ae-e64cd799eb20" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:12:28 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-bf51c2ad-4c24-4b30-bfbc-45922594646d req-8fcf8965-9bae-4646-a8e0-83dfa8c8606c service nova] Acquired lock "refresh_cache-84683344-2893-4446-90ae-e64cd799eb20" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:12:28 user nova-compute[71874]: DEBUG nova.network.neutron [req-bf51c2ad-4c24-4b30-bfbc-45922594646d req-8fcf8965-9bae-4646-a8e0-83dfa8c8606c service nova] [instance: 84683344-2893-4446-90ae-e64cd799eb20] Refreshing network info cache for port a8837af3-03f7-4b3d-8a2a-746f2d8038ad {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 16:12:28 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.025s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:12:28 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[112b05bc-1bc3-42e8-b4d6-a5643d78a49b]: (4, ('- - 0', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:12:28 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-af45d26c-85d6-4f16-9df9-b2f77112e5fe tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Searching for a device in session 35 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=71874) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 16:12:28 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-af45d26c-85d6-4f16-9df9-b2f77112e5fe tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:ce38c1b3-35b0-48cc-9b83-e9a676997784', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'APVXFMTJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71874) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 16:12:28 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-a6e0a12f-a41c-4add-8510-bcf140fa96a7 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Acquiring lock "84683344-2893-4446-90ae-e64cd799eb20" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:12:28 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-a6e0a12f-a41c-4add-8510-bcf140fa96a7 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "84683344-2893-4446-90ae-e64cd799eb20" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:12:28 user nova-compute[71874]: INFO nova.compute.manager [None req-a6e0a12f-a41c-4add-8510-bcf140fa96a7 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: 84683344-2893-4446-90ae-e64cd799eb20] Detaching volume 9c961fcc-0ff0-4275-9163-406662b265f8
Apr 12 16:12:28 user nova-compute[71874]: INFO nova.virt.block_device [None req-a6e0a12f-a41c-4add-8510-bcf140fa96a7 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: 84683344-2893-4446-90ae-e64cd799eb20] Attempting to driver detach volume 9c961fcc-0ff0-4275-9163-406662b265f8 from mountpoint /dev/vdb
Apr 12 16:12:28 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-a6e0a12f-a41c-4add-8510-bcf140fa96a7 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Attempting to detach device vdb from instance 84683344-2893-4446-90ae-e64cd799eb20 from the persistent domain config. {{(pid=71874) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 16:12:28 user nova-compute[71874]: DEBUG nova.virt.libvirt.guest [None req-a6e0a12f-a41c-4add-8510-bcf140fa96a7 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 16:12:28 user nova-compute[71874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 16:12:28 user nova-compute[71874]:   <source dev="/dev/sdd"/>
Apr 12 16:12:28 user nova-compute[71874]:   <target dev="vdb" bus="virtio"/>
Apr 12 16:12:28 user nova-compute[71874]:   <serial>9c961fcc-0ff0-4275-9163-406662b265f8</serial>
Apr 12 16:12:28 user nova-compute[71874]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 12 16:12:28 user nova-compute[71874]: </disk>
Apr 12 16:12:28 user nova-compute[71874]:  {{(pid=71874) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 16:12:28 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-a6e0a12f-a41c-4add-8510-bcf140fa96a7 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Successfully detached device vdb from instance 84683344-2893-4446-90ae-e64cd799eb20 from the persistent domain config.
Apr 12 16:12:28 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-a6e0a12f-a41c-4add-8510-bcf140fa96a7 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 84683344-2893-4446-90ae-e64cd799eb20 from the live domain config. {{(pid=71874) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 16:12:28 user nova-compute[71874]: DEBUG nova.virt.libvirt.guest [None req-a6e0a12f-a41c-4add-8510-bcf140fa96a7 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 16:12:28 user nova-compute[71874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 16:12:28 user nova-compute[71874]:   <source dev="/dev/sdd"/>
Apr 12 16:12:28 user nova-compute[71874]:   <target dev="vdb" bus="virtio"/>
Apr 12 16:12:28 user nova-compute[71874]:   <serial>9c961fcc-0ff0-4275-9163-406662b265f8</serial>
Apr 12 16:12:28 user nova-compute[71874]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 12 16:12:28 user nova-compute[71874]: </disk>
Apr 12 16:12:28 user nova-compute[71874]:  {{(pid=71874) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 16:12:28 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Inventory has not changed in ProviderTree for provider: 0e94b4c8-cd49-45e4-9133-d36eb4b2456b {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 16:12:28 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Inventory has not changed for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 16:12:28 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Compute_service record updated for user:user {{(pid=71874) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 16:12:28 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.790s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:12:29 user nova-compute[71874]: DEBUG nova.network.neutron [req-bf51c2ad-4c24-4b30-bfbc-45922594646d req-8fcf8965-9bae-4646-a8e0-83dfa8c8606c service nova] [instance: 84683344-2893-4446-90ae-e64cd799eb20] Updated VIF entry in instance network info cache for port a8837af3-03f7-4b3d-8a2a-746f2d8038ad. {{(pid=71874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 16:12:29 user nova-compute[71874]: DEBUG nova.network.neutron [req-bf51c2ad-4c24-4b30-bfbc-45922594646d req-8fcf8965-9bae-4646-a8e0-83dfa8c8606c service nova] [instance: 84683344-2893-4446-90ae-e64cd799eb20] Updating instance_info_cache with network_info: [{"id": "a8837af3-03f7-4b3d-8a2a-746f2d8038ad", "address": "fa:16:3e:71:77:df", "network": {"id": "58f92787-e3b6-4fd3-bd75-7169f1a36651", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-614349033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "236b9e609eb44071bc88971bff96931e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8837af3-03", "ovs_interfaceid": "a8837af3-03f7-4b3d-8a2a-746f2d8038ad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:12:29 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-bf51c2ad-4c24-4b30-bfbc-45922594646d req-8fcf8965-9bae-4646-a8e0-83dfa8c8606c service nova] Releasing lock "refresh_cache-84683344-2893-4446-90ae-e64cd799eb20" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:12:29 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Received event <DeviceRemovedEvent: 1681315949.2787893, 84683344-2893-4446-90ae-e64cd799eb20 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71874) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 16:12:29 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-a6e0a12f-a41c-4add-8510-bcf140fa96a7 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 84683344-2893-4446-90ae-e64cd799eb20 {{(pid=71874) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 16:12:29 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-a6e0a12f-a41c-4add-8510-bcf140fa96a7 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Successfully detached device vdb from instance 84683344-2893-4446-90ae-e64cd799eb20 from the live domain config.
Apr 12 16:12:29 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a6e0a12f-a41c-4add-8510-bcf140fa96a7 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: 84683344-2893-4446-90ae-e64cd799eb20] calling os-brick to detach iSCSI Volume {{(pid=71874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 16:12:29 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6e0a12f-a41c-4add-8510-bcf140fa96a7 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3c0216320>, {'target_iqn': 'iqn.2010-10.org.openstack:9c961fcc-0ff0-4275-9163-406662b265f8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EHUDIolh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:12:29 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-a6e0a12f-a41c-4add-8510-bcf140fa96a7 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:12:29 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-a6e0a12f-a41c-4add-8510-bcf140fa96a7 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:12:29 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-af45d26c-85d6-4f16-9df9-b2f77112e5fe tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.482s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:12:29 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-af45d26c-85d6-4f16-9df9-b2f77112e5fe tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] <== connect_volume: return (1486ms) {'type': 'block', 'scsi_wwn': '26461393839613265', 'path': '/dev/sdg'} {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:12:29 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af45d26c-85d6-4f16-9df9-b2f77112e5fe tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26461393839613265', 'path': '/dev/sdg'} {{(pid=71874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 16:12:29 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-a6e0a12f-a41c-4add-8510-bcf140fa96a7 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.353s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:12:29 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:12:29 user nova-compute[71874]: DEBUG nova.objects.instance [None req-af45d26c-85d6-4f16-9df9-b2f77112e5fe tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lazy-loading 'flavor' on Instance uuid 4190e244-84b1-47b6-813d-9cadb7c65975 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:12:29 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:12:29 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[59fc0d04-9862-4b1f-9f88-142b42a371d6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1f27a002-8dfc-4d90-aa35-ba16586d4366\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9c961fcc-0ff0-4275-9163-406662b265f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ce38c1b3-35b0-48cc-9b83-e9a676997784\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:12:29 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6e0a12f-a41c-4add-8510-bcf140fa96a7 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 16:12:29 user nova-compute[71874]: No targets found.
Apr 12 16:12:29 user nova-compute[71874]: iSNS:
Apr 12 16:12:29 user nova-compute[71874]: No targets found.
Apr 12 16:12:29 user nova-compute[71874]: STATIC:
Apr 12 16:12:29 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:1f27a002-8dfc-4d90-aa35-ba16586d4366
Apr 12 16:12:29 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:12:29 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:12:29 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:9c961fcc-0ff0-4275-9163-406662b265f8
Apr 12 16:12:29 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:12:29 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:12:29 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:ce38c1b3-35b0-48cc-9b83-e9a676997784
Apr 12 16:12:29 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:12:29 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:12:29 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304
Apr 12 16:12:29 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:12:29 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:12:29 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297
Apr 12 16:12:29 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:12:29 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:12:29 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2
Apr 12 16:12:29 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:12:29 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:12:29 user nova-compute[71874]: FIRMWARE:
Apr 12 16:12:29 user nova-compute[71874]: No targets found.
Apr 12 16:12:29 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:12:29 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6e0a12f-a41c-4add-8510-bcf140fa96a7 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 16:12:29 user nova-compute[71874]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 16:12:29 user nova-compute[71874]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71874) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 16:12:29 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6e0a12f-a41c-4add-8510-bcf140fa96a7 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9c961fcc-0ff0-4275-9163-406662b265f8', 0)] {{(pid=71874) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 16:12:29 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:12:29 user nova-compute[71874]: DEBUG nova.virt.libvirt.guest [None req-af45d26c-85d6-4f16-9df9-b2f77112e5fe tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 16:12:29 user nova-compute[71874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 16:12:29 user nova-compute[71874]:   <source dev="/dev/sdg"/>
Apr 12 16:12:29 user nova-compute[71874]:   <target dev="vdb" bus="virtio"/>
Apr 12 16:12:29 user nova-compute[71874]:   <serial>ce38c1b3-35b0-48cc-9b83-e9a676997784</serial>
Apr 12 16:12:29 user nova-compute[71874]: </disk>
Apr 12 16:12:29 user nova-compute[71874]:  {{(pid=71874) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 16:12:29 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:12:29 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[a231c826-b720-41e4-b334-ab2eb8770d84]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1f27a002-8dfc-4d90-aa35-ba16586d4366\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c961fcc-0ff0-4275-9163-406662b265f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ce38c1b3-35b0-48cc-9b83-e9a676997784\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:12:29 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:12:29 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:12:29 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[f83cd069-7ae4-4bda-b557-2e2fd4d2b332]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f27a002-8dfc-4d90-aa35-ba16586d4366 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c961fcc-0ff0-4275-9163-406662b265f8 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce38c1b3-35b0-48cc-9b83-e9a676997784 (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:12:29 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6e0a12f-a41c-4add-8510-bcf140fa96a7 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:12:29 user nova-compute[71874]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f27a002-8dfc-4d90-aa35-ba16586d4366 (non-flash)
Apr 12 16:12:29 user nova-compute[71874]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 (non-flash)
Apr 12 16:12:29 user nova-compute[71874]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c961fcc-0ff0-4275-9163-406662b265f8 (non-flash)
Apr 12 16:12:29 user nova-compute[71874]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304 (non-flash)
Apr 12 16:12:29 user nova-compute[71874]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce38c1b3-35b0-48cc-9b83-e9a676997784 (non-flash)
Apr 12 16:12:29 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:12:29 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6e0a12f-a41c-4add-8510-bcf140fa96a7 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:12:29 user nova-compute[71874]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f27a002-8dfc-4d90-aa35-ba16586d4366 (non-flash)
Apr 12 16:12:29 user nova-compute[71874]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 (non-flash)
Apr 12 16:12:29 user nova-compute[71874]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c961fcc-0ff0-4275-9163-406662b265f8 (non-flash)
Apr 12 16:12:29 user nova-compute[71874]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304 (non-flash)
Apr 12 16:12:29 user nova-compute[71874]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce38c1b3-35b0-48cc-9b83-e9a676997784 (non-flash)
Apr 12 16:12:29 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:12:29 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6e0a12f-a41c-4add-8510-bcf140fa96a7 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc39c2037f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9c961fcc-0ff0-4275-9163-406662b265f8'): ({'sdd'}, set())}) {{(pid=71874) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 16:12:29 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-a6e0a12f-a41c-4add-8510-bcf140fa96a7 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Removing single pathed devices sdd {{(pid=71874) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 16:12:29 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:12:29 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:12:29 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fd6297d-48bb-4e3a-93d8-b2ecf0bc32ed]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:12:29 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:12:29 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:12:29 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e2adb45-4c83-4fd8-8e36-c5a2537b8c8e]: (4, ('ok\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:12:29 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-a6e0a12f-a41c-4add-8510-bcf140fa96a7 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Flushing IO for device /dev/sdd {{(pid=71874) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 16:12:29 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:12:29 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.018s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:12:29 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[61d2e51f-df06-483f-a9ca-8aa1fefb49bd]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:12:29 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-a6e0a12f-a41c-4add-8510-bcf140fa96a7 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71874) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 16:12:29 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:12:29 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.056s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:12:29 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fd8835b-2273-4721-a16e-23069eea3376]: (4, ('1', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:12:29 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-a6e0a12f-a41c-4add-8510-bcf140fa96a7 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71874) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 16:12:29 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-a6e0a12f-a41c-4add-8510-bcf140fa96a7 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] SCSI volumes sdd have been removed. {{(pid=71874) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 16:12:29 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6e0a12f-a41c-4add-8510-bcf140fa96a7 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9c961fcc-0ff0-4275-9163-406662b265f8')] {{(pid=71874) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 16:12:29 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c961fcc-0ff0-4275-9163-406662b265f8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:12:29 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c961fcc-0ff0-4275-9163-406662b265f8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:12:29 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[749a94a7-8a58-4f96-bc59-26f50527b845]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:12:29 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6e0a12f-a41c-4add-8510-bcf140fa96a7 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:12:29 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c961fcc-0ff0-4275-9163-406662b265f8 -p 172.16.0.220:3260 --logout {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:12:29 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-275e919c-2667-4c83-855e-37bcac4e1dfb tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Acquiring lock "d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:12:29 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-275e919c-2667-4c83-855e-37bcac4e1dfb tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:12:29 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-275e919c-2667-4c83-855e-37bcac4e1dfb tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Acquiring lock "d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:12:29 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-275e919c-2667-4c83-855e-37bcac4e1dfb tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:12:29 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-275e919c-2667-4c83-855e-37bcac4e1dfb tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:12:29 user nova-compute[71874]: INFO nova.compute.manager [None req-275e919c-2667-4c83-855e-37bcac4e1dfb tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] Terminating instance
Apr 12 16:12:29 user nova-compute[71874]: DEBUG nova.compute.manager [None req-275e919c-2667-4c83-855e-37bcac4e1dfb tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] Start destroying the instance on the hypervisor. {{(pid=71874) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 16:12:29 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c961fcc-0ff0-4275-9163-406662b265f8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.093s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:12:29 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4ed7ffe-e95e-404e-b9d3-c13feee5cb25]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:9c961fcc-0ff0-4275-9163-406662b265f8, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:9c961fcc-0ff0-4275-9163-406662b265f8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:12:30 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6e0a12f-a41c-4add-8510-bcf140fa96a7 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:9c961fcc-0ff0-4275-9163-406662b265f8, portal: 172.16.0.220,3260]
Apr 12 16:12:30 user nova-compute[71874]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:9c961fcc-0ff0-4275-9163-406662b265f8, portal: 172.16.0.220,3260] successful.
Apr 12 16:12:30 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:12:30 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c961fcc-0ff0-4275-9163-406662b265f8 -p 172.16.0.220:3260 --op delete {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:12:30 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c961fcc-0ff0-4275-9163-406662b265f8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:12:30 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c17bb98-861d-44e0-920f-85bae597d8f4]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:12:30 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6e0a12f-a41c-4add-8510-bcf140fa96a7 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:12:30 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-a6e0a12f-a41c-4add-8510-bcf140fa96a7 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.400s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:12:30 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6e0a12f-a41c-4add-8510-bcf140fa96a7 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] <== disconnect_volume: return (753ms) None {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:12:30 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a6e0a12f-a41c-4add-8510-bcf140fa96a7 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: 84683344-2893-4446-90ae-e64cd799eb20] Disconnected iSCSI Volume {{(pid=71874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 16:12:30 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:12:30 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:12:30 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:12:30 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-af45d26c-85d6-4f16-9df9-b2f77112e5fe tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] No BDM found with device name vda, not building metadata. {{(pid=71874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 16:12:30 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-af45d26c-85d6-4f16-9df9-b2f77112e5fe tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 16:12:30 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-af45d26c-85d6-4f16-9df9-b2f77112e5fe tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] No VIF found with MAC fa:16:3e:d0:b5:d4, not building metadata {{(pid=71874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 16:12:30 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-af45d26c-85d6-4f16-9df9-b2f77112e5fe tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "4190e244-84b1-47b6-813d-9cadb7c65975" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.283s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:12:30 user nova-compute[71874]: DEBUG nova.compute.manager [req-5f7492a8-09be-476e-adce-250fa6bd1c09 req-24ac38e0-5edb-4df6-b1e0-ef4eb4fdb176 service nova] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] Received event network-vif-unplugged-e2e566dd-85b6-43a5-b007-15d987e2af56 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:12:30 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-5f7492a8-09be-476e-adce-250fa6bd1c09 req-24ac38e0-5edb-4df6-b1e0-ef4eb4fdb176 service nova] Acquiring lock "d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:12:30 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-5f7492a8-09be-476e-adce-250fa6bd1c09 req-24ac38e0-5edb-4df6-b1e0-ef4eb4fdb176 service nova] Lock "d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:12:30 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-5f7492a8-09be-476e-adce-250fa6bd1c09 req-24ac38e0-5edb-4df6-b1e0-ef4eb4fdb176 service nova] Lock "d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:12:30 user nova-compute[71874]: DEBUG nova.compute.manager [req-5f7492a8-09be-476e-adce-250fa6bd1c09 req-24ac38e0-5edb-4df6-b1e0-ef4eb4fdb176 service nova] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] No waiting events found dispatching network-vif-unplugged-e2e566dd-85b6-43a5-b007-15d987e2af56 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:12:30 user nova-compute[71874]: DEBUG nova.compute.manager [req-5f7492a8-09be-476e-adce-250fa6bd1c09 req-24ac38e0-5edb-4df6-b1e0-ef4eb4fdb176 service nova] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] Received event network-vif-unplugged-e2e566dd-85b6-43a5-b007-15d987e2af56 for instance with task_state deleting. {{(pid=71874) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 16:12:30 user nova-compute[71874]: INFO nova.virt.libvirt.driver [-] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] Instance destroyed successfully.
Apr 12 16:12:30 user nova-compute[71874]: DEBUG nova.objects.instance [None req-275e919c-2667-4c83-855e-37bcac4e1dfb tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lazy-loading 'resources' on Instance uuid d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:12:30 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-275e919c-2667-4c83-855e-37bcac4e1dfb tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-12T16:06:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-555700697',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-555700697',id=23,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBqm4X1GPAEsvdMh1GO761bXVv1VUyRSugyouG8rhVils1/hHVrIYx63R3qDcmpgztzn8AC8dxMFAH78ymrOF6BZDB1CDRnw9cjgtplakD6t2lDEw7VFcHyaQTdxPCChxA==',key_name='tempest-keypair-746668212',keypairs=<?>,launch_index=0,launched_at=2023-04-12T16:10:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1fa122cbabe94c6f93c862b4daf31e50',ramdisk_id='',reservation_id='r-pdzop9wc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-292107264',owner_user_name='tempest-AttachVolumeShelveTestJSON-292107264-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T16:10:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c1abec24caf74dc8a27b64c21a9d4a59',uuid=d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e2e566dd-85b6-43a5-b007-15d987e2af56", "address": "fa:16:3e:88:85:6b", "network": {"id": "eb4dd4b5-96d4-4b53-b510-d41e2775b92f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-596111273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fa122cbabe94c6f93c862b4daf31e50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2e566dd-85", "ovs_interfaceid": "e2e566dd-85b6-43a5-b007-15d987e2af56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 16:12:30 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-275e919c-2667-4c83-855e-37bcac4e1dfb tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Converting VIF {"id": "e2e566dd-85b6-43a5-b007-15d987e2af56", "address": "fa:16:3e:88:85:6b", "network": {"id": "eb4dd4b5-96d4-4b53-b510-d41e2775b92f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-596111273-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fa122cbabe94c6f93c862b4daf31e50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2e566dd-85", "ovs_interfaceid": "e2e566dd-85b6-43a5-b007-15d987e2af56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:12:30 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-275e919c-2667-4c83-855e-37bcac4e1dfb tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:85:6b,bridge_name='br-int',has_traffic_filtering=True,id=e2e566dd-85b6-43a5-b007-15d987e2af56,network=Network(eb4dd4b5-96d4-4b53-b510-d41e2775b92f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2e566dd-85') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:12:30 user nova-compute[71874]: DEBUG os_vif [None req-275e919c-2667-4c83-855e-37bcac4e1dfb tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:85:6b,bridge_name='br-int',has_traffic_filtering=True,id=e2e566dd-85b6-43a5-b007-15d987e2af56,network=Network(eb4dd4b5-96d4-4b53-b510-d41e2775b92f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2e566dd-85') {{(pid=71874) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 16:12:30 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:12:30 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape2e566dd-85, bridge=br-int, if_exists=True) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:12:30 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:12:30 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:12:30 user nova-compute[71874]: INFO os_vif [None req-275e919c-2667-4c83-855e-37bcac4e1dfb tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:85:6b,bridge_name='br-int',has_traffic_filtering=True,id=e2e566dd-85b6-43a5-b007-15d987e2af56,network=Network(eb4dd4b5-96d4-4b53-b510-d41e2775b92f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2e566dd-85')
Apr 12 16:12:30 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-275e919c-2667-4c83-855e-37bcac4e1dfb tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] Deleting instance files /opt/stack/data/nova/instances/d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e_del
Apr 12 16:12:30 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-275e919c-2667-4c83-855e-37bcac4e1dfb tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] Deletion of /opt/stack/data/nova/instances/d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e_del complete
Apr 12 16:12:30 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-18eb31b6-3286-4f4d-a32e-a9dfaface1ae tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Acquiring lock "4190e244-84b1-47b6-813d-9cadb7c65975" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:12:30 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-18eb31b6-3286-4f4d-a32e-a9dfaface1ae tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "4190e244-84b1-47b6-813d-9cadb7c65975" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:12:30 user nova-compute[71874]: DEBUG nova.compute.manager [None req-18eb31b6-3286-4f4d-a32e-a9dfaface1ae tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:12:30 user nova-compute[71874]: DEBUG nova.compute.manager [None req-18eb31b6-3286-4f4d-a32e-a9dfaface1ae tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=71874) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3323}}
Apr 12 16:12:30 user nova-compute[71874]: DEBUG nova.objects.instance [None req-18eb31b6-3286-4f4d-a32e-a9dfaface1ae tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lazy-loading 'flavor' on Instance uuid 4190e244-84b1-47b6-813d-9cadb7c65975 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:12:30 user nova-compute[71874]: INFO nova.compute.manager [None req-275e919c-2667-4c83-855e-37bcac4e1dfb tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] Took 0.88 seconds to destroy the instance on the hypervisor.
Apr 12 16:12:30 user nova-compute[71874]: DEBUG oslo.service.loopingcall [None req-275e919c-2667-4c83-855e-37bcac4e1dfb tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71874) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 16:12:30 user nova-compute[71874]: DEBUG nova.compute.manager [-] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] Deallocating network for instance {{(pid=71874) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 16:12:30 user nova-compute[71874]: DEBUG nova.network.neutron [-] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] deallocate_for_instance() {{(pid=71874) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 16:12:30 user nova-compute[71874]: DEBUG nova.objects.instance [None req-a6e0a12f-a41c-4add-8510-bcf140fa96a7 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lazy-loading 'flavor' on Instance uuid 84683344-2893-4446-90ae-e64cd799eb20 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:12:30 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:12:30 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:12:30 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-a6e0a12f-a41c-4add-8510-bcf140fa96a7 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "84683344-2893-4446-90ae-e64cd799eb20" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.256s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:12:30 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:12:30 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:12:30 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Starting heal instance info cache {{(pid=71874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 16:12:30 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Rebuilding the list of instances to heal {{(pid=71874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 16:12:30 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:12:30 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:12:30 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:12:31 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] Skipping network cache update for instance because it is being deleted. {{(pid=71874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9809}}
Apr 12 16:12:31 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquiring lock "refresh_cache-afebffae-dbf6-4876-8c9f-0364f0fde49c" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:12:31 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquired lock "refresh_cache-afebffae-dbf6-4876-8c9f-0364f0fde49c" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:12:31 user nova-compute[71874]: DEBUG nova.network.neutron [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] Forcefully refreshing network info cache for instance {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 16:12:31 user nova-compute[71874]: DEBUG nova.objects.instance [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lazy-loading 'info_cache' on Instance uuid afebffae-dbf6-4876-8c9f-0364f0fde49c {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:12:31 user nova-compute[71874]: DEBUG nova.compute.manager [req-0c2b27e5-8b11-481f-908d-e9dc7fd08d5e req-1014a380-bca4-4733-9773-4cef48027554 service nova] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Received event network-vif-unplugged-eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:12:31 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-0c2b27e5-8b11-481f-908d-e9dc7fd08d5e req-1014a380-bca4-4733-9773-4cef48027554 service nova] Acquiring lock "4190e244-84b1-47b6-813d-9cadb7c65975-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:12:31 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-0c2b27e5-8b11-481f-908d-e9dc7fd08d5e req-1014a380-bca4-4733-9773-4cef48027554 service nova] Lock "4190e244-84b1-47b6-813d-9cadb7c65975-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:12:31 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-0c2b27e5-8b11-481f-908d-e9dc7fd08d5e req-1014a380-bca4-4733-9773-4cef48027554 service nova] Lock "4190e244-84b1-47b6-813d-9cadb7c65975-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:12:31 user nova-compute[71874]: DEBUG nova.compute.manager [req-0c2b27e5-8b11-481f-908d-e9dc7fd08d5e req-1014a380-bca4-4733-9773-4cef48027554 service nova] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] No waiting events found dispatching network-vif-unplugged-eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:12:31 user nova-compute[71874]: WARNING nova.compute.manager [req-0c2b27e5-8b11-481f-908d-e9dc7fd08d5e req-1014a380-bca4-4733-9773-4cef48027554 service nova] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Received unexpected event network-vif-unplugged-eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c for instance with vm_state active and task_state powering-off.
Apr 12 16:12:31 user nova-compute[71874]: DEBUG nova.network.neutron [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] Updating instance_info_cache with network_info: [{"id": "c4b29e0b-0ad8-4897-acf3-76004ac0338b", "address": "fa:16:3e:b8:23:a7", "network": {"id": "06fae0be-02dd-4962-a1ac-fd0413772758", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1493924857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3fe48a3b7d846a195f1e47cc7f69695", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4b29e0b-0a", "ovs_interfaceid": "c4b29e0b-0ad8-4897-acf3-76004ac0338b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:12:31 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Releasing lock "refresh_cache-afebffae-dbf6-4876-8c9f-0364f0fde49c" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:12:31 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] Updated the network info_cache for instance {{(pid=71874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 16:12:31 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:12:31 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:12:31 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:12:31 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:12:31 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:12:31 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71874) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 16:12:31 user nova-compute[71874]: INFO nova.virt.libvirt.driver [-] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Instance destroyed successfully.
Apr 12 16:12:31 user nova-compute[71874]: DEBUG nova.compute.manager [None req-18eb31b6-3286-4f4d-a32e-a9dfaface1ae tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:12:31 user nova-compute[71874]: DEBUG nova.network.neutron [-] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] Updating instance_info_cache with network_info: [] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:12:31 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-18eb31b6-3286-4f4d-a32e-a9dfaface1ae tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "4190e244-84b1-47b6-813d-9cadb7c65975" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.895s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:12:31 user nova-compute[71874]: INFO nova.compute.manager [-] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] Took 0.89 seconds to deallocate network for instance.
Apr 12 16:12:31 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-275e919c-2667-4c83-855e-37bcac4e1dfb tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:12:31 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-275e919c-2667-4c83-855e-37bcac4e1dfb tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:12:32 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-275e919c-2667-4c83-855e-37bcac4e1dfb tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Inventory has not changed in ProviderTree for provider: 0e94b4c8-cd49-45e4-9133-d36eb4b2456b {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 16:12:32 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-275e919c-2667-4c83-855e-37bcac4e1dfb tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Inventory has not changed for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 16:12:32 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-275e919c-2667-4c83-855e-37bcac4e1dfb tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.413s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:12:32 user nova-compute[71874]: INFO nova.scheduler.client.report [None req-275e919c-2667-4c83-855e-37bcac4e1dfb tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Deleted allocations for instance d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e
Apr 12 16:12:32 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-275e919c-2667-4c83-855e-37bcac4e1dfb tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.359s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:12:32 user nova-compute[71874]: DEBUG nova.compute.manager [req-4afea9f5-d475-4f46-b3f9-6208b5e7ec5b req-e93c1b18-18ee-46e8-bbf4-f7637aff4591 service nova] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] Received event network-vif-plugged-e2e566dd-85b6-43a5-b007-15d987e2af56 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:12:32 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-4afea9f5-d475-4f46-b3f9-6208b5e7ec5b req-e93c1b18-18ee-46e8-bbf4-f7637aff4591 service nova] Acquiring lock "d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:12:32 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-4afea9f5-d475-4f46-b3f9-6208b5e7ec5b req-e93c1b18-18ee-46e8-bbf4-f7637aff4591 service nova] Lock "d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:12:32 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-4afea9f5-d475-4f46-b3f9-6208b5e7ec5b req-e93c1b18-18ee-46e8-bbf4-f7637aff4591 service nova] Lock "d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:12:32 user nova-compute[71874]: DEBUG nova.compute.manager [req-4afea9f5-d475-4f46-b3f9-6208b5e7ec5b req-e93c1b18-18ee-46e8-bbf4-f7637aff4591 service nova] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] No waiting events found dispatching network-vif-plugged-e2e566dd-85b6-43a5-b007-15d987e2af56 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:12:32 user nova-compute[71874]: WARNING nova.compute.manager [req-4afea9f5-d475-4f46-b3f9-6208b5e7ec5b req-e93c1b18-18ee-46e8-bbf4-f7637aff4591 service nova] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] Received unexpected event network-vif-plugged-e2e566dd-85b6-43a5-b007-15d987e2af56 for instance with vm_state deleted and task_state None.
Apr 12 16:12:32 user nova-compute[71874]: DEBUG nova.compute.manager [req-4afea9f5-d475-4f46-b3f9-6208b5e7ec5b req-e93c1b18-18ee-46e8-bbf4-f7637aff4591 service nova] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] Received event network-vif-deleted-e2e566dd-85b6-43a5-b007-15d987e2af56 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:12:33 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:12:33 user nova-compute[71874]: DEBUG nova.compute.manager [req-465c7700-c1a0-4b7e-bc32-60895ea33d0f req-5e89e90a-dac0-4721-bb57-182c7466694f service nova] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Received event network-vif-plugged-eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:12:33 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-465c7700-c1a0-4b7e-bc32-60895ea33d0f req-5e89e90a-dac0-4721-bb57-182c7466694f service nova] Acquiring lock "4190e244-84b1-47b6-813d-9cadb7c65975-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:12:33 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-465c7700-c1a0-4b7e-bc32-60895ea33d0f req-5e89e90a-dac0-4721-bb57-182c7466694f service nova] Lock "4190e244-84b1-47b6-813d-9cadb7c65975-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:12:33 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-465c7700-c1a0-4b7e-bc32-60895ea33d0f req-5e89e90a-dac0-4721-bb57-182c7466694f service nova] Lock "4190e244-84b1-47b6-813d-9cadb7c65975-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:12:33 user nova-compute[71874]: DEBUG nova.compute.manager [req-465c7700-c1a0-4b7e-bc32-60895ea33d0f req-5e89e90a-dac0-4721-bb57-182c7466694f service nova] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] No waiting events found dispatching network-vif-plugged-eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:12:33 user nova-compute[71874]: WARNING nova.compute.manager [req-465c7700-c1a0-4b7e-bc32-60895ea33d0f req-5e89e90a-dac0-4721-bb57-182c7466694f service nova] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Received unexpected event network-vif-plugged-eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c for instance with vm_state stopped and task_state None.
Apr 12 16:12:35 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:12:38 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:12:40 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:12:43 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:12:45 user nova-compute[71874]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681315950.6945558, d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e => Stopped> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:12:45 user nova-compute[71874]: INFO nova.compute.manager [-] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] VM Stopped (Lifecycle Event)
Apr 12 16:12:45 user nova-compute[71874]: DEBUG nova.compute.manager [None req-b465f642-75f9-430d-b4c7-98cccbfef982 None None] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:12:45 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:12:46 user nova-compute[71874]: INFO nova.compute.manager [None req-83b90f89-2813-41d0-b4a0-2b09a8d1ef5d tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 0e8a977c-aa84-47c4-a838-b5f90820de1a] Rescuing
Apr 12 16:12:46 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-83b90f89-2813-41d0-b4a0-2b09a8d1ef5d tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Acquiring lock "refresh_cache-0e8a977c-aa84-47c4-a838-b5f90820de1a" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:12:46 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-83b90f89-2813-41d0-b4a0-2b09a8d1ef5d tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Acquired lock "refresh_cache-0e8a977c-aa84-47c4-a838-b5f90820de1a" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:12:46 user nova-compute[71874]: DEBUG nova.network.neutron [None req-83b90f89-2813-41d0-b4a0-2b09a8d1ef5d tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 0e8a977c-aa84-47c4-a838-b5f90820de1a] Building network info cache for instance {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 16:12:46 user nova-compute[71874]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681315951.620675, 4190e244-84b1-47b6-813d-9cadb7c65975 => Stopped> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:12:46 user nova-compute[71874]: INFO nova.compute.manager [-] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] VM Stopped (Lifecycle Event)
Apr 12 16:12:46 user nova-compute[71874]: DEBUG nova.compute.manager [None req-59aa8ad9-768c-4d40-9154-60847a31fb98 None None] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:12:46 user nova-compute[71874]: DEBUG nova.compute.manager [None req-59aa8ad9-768c-4d40-9154-60847a31fb98 None None] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=71874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 16:12:46 user nova-compute[71874]: DEBUG nova.network.neutron [None req-83b90f89-2813-41d0-b4a0-2b09a8d1ef5d tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 0e8a977c-aa84-47c4-a838-b5f90820de1a] Updating instance_info_cache with network_info: [{"id": "40e16d3f-2e2e-45df-be16-ef3622bfde2e", "address": "fa:16:3e:4d:9c:b1", "network": {"id": "b36306e0-04c5-4b1b-8022-05ff121c4e43", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1503204786-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9210f81232304e179d3e09914a492442", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40e16d3f-2e", "ovs_interfaceid": "40e16d3f-2e2e-45df-be16-ef3622bfde2e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:12:46 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-83b90f89-2813-41d0-b4a0-2b09a8d1ef5d tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Releasing lock "refresh_cache-0e8a977c-aa84-47c4-a838-b5f90820de1a" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:12:47 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:12:47 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:12:47 user nova-compute[71874]: DEBUG nova.compute.manager [req-d1ee3322-5123-413c-ae31-3f2fd54fe891 req-ff29a523-ed7e-4c2e-9dd0-4a361812b2b6 service nova] [instance: 0e8a977c-aa84-47c4-a838-b5f90820de1a] Received event network-vif-unplugged-40e16d3f-2e2e-45df-be16-ef3622bfde2e {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:12:47 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-d1ee3322-5123-413c-ae31-3f2fd54fe891 req-ff29a523-ed7e-4c2e-9dd0-4a361812b2b6 service nova] Acquiring lock "0e8a977c-aa84-47c4-a838-b5f90820de1a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:12:47 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-d1ee3322-5123-413c-ae31-3f2fd54fe891 req-ff29a523-ed7e-4c2e-9dd0-4a361812b2b6 service nova] Lock "0e8a977c-aa84-47c4-a838-b5f90820de1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:12:47 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-d1ee3322-5123-413c-ae31-3f2fd54fe891 req-ff29a523-ed7e-4c2e-9dd0-4a361812b2b6 service nova] Lock "0e8a977c-aa84-47c4-a838-b5f90820de1a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:12:47 user nova-compute[71874]: DEBUG nova.compute.manager [req-d1ee3322-5123-413c-ae31-3f2fd54fe891 req-ff29a523-ed7e-4c2e-9dd0-4a361812b2b6 service nova] [instance: 0e8a977c-aa84-47c4-a838-b5f90820de1a] No waiting events found dispatching network-vif-unplugged-40e16d3f-2e2e-45df-be16-ef3622bfde2e {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:12:47 user nova-compute[71874]: WARNING nova.compute.manager [req-d1ee3322-5123-413c-ae31-3f2fd54fe891 req-ff29a523-ed7e-4c2e-9dd0-4a361812b2b6 service nova] [instance: 0e8a977c-aa84-47c4-a838-b5f90820de1a] Received unexpected event network-vif-unplugged-40e16d3f-2e2e-45df-be16-ef3622bfde2e for instance with vm_state active and task_state rescuing.
Apr 12 16:12:47 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:12:47 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:12:47 user nova-compute[71874]: INFO nova.virt.libvirt.driver [-] [instance: 0e8a977c-aa84-47c4-a838-b5f90820de1a] Instance destroyed successfully.
Apr 12 16:12:47 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-83b90f89-2813-41d0-b4a0-2b09a8d1ef5d tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 0e8a977c-aa84-47c4-a838-b5f90820de1a] Attempting a stable device rescue
Apr 12 16:12:47 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-83b90f89-2813-41d0-b4a0-2b09a8d1ef5d tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=71874) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 12 16:12:47 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-83b90f89-2813-41d0-b4a0-2b09a8d1ef5d tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 0e8a977c-aa84-47c4-a838-b5f90820de1a] Instance directory exists: not creating {{(pid=71874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 12 16:12:47 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-83b90f89-2813-41d0-b4a0-2b09a8d1ef5d tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 0e8a977c-aa84-47c4-a838-b5f90820de1a] Creating image(s)
Apr 12 16:12:47 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-83b90f89-2813-41d0-b4a0-2b09a8d1ef5d tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Acquiring lock "/opt/stack/data/nova/instances/0e8a977c-aa84-47c4-a838-b5f90820de1a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:12:47 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-83b90f89-2813-41d0-b4a0-2b09a8d1ef5d tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "/opt/stack/data/nova/instances/0e8a977c-aa84-47c4-a838-b5f90820de1a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:12:47 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-83b90f89-2813-41d0-b4a0-2b09a8d1ef5d tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "/opt/stack/data/nova/instances/0e8a977c-aa84-47c4-a838-b5f90820de1a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:12:47 user nova-compute[71874]: DEBUG nova.objects.instance [None req-83b90f89-2813-41d0-b4a0-2b09a8d1ef5d tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lazy-loading 'trusted_certs' on Instance uuid 0e8a977c-aa84-47c4-a838-b5f90820de1a {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:12:47 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-83b90f89-2813-41d0-b4a0-2b09a8d1ef5d tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Acquiring lock "aead21c0919ab1c43fd2da49f432fa78d2e3909c" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:12:47 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-83b90f89-2813-41d0-b4a0-2b09a8d1ef5d tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "aead21c0919ab1c43fd2da49f432fa78d2e3909c" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:12:48 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-83b90f89-2813-41d0-b4a0-2b09a8d1ef5d tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aead21c0919ab1c43fd2da49f432fa78d2e3909c.part --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:12:48 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-83b90f89-2813-41d0-b4a0-2b09a8d1ef5d tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aead21c0919ab1c43fd2da49f432fa78d2e3909c.part --force-share --output=json" returned: 0 in 0.139s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:12:48 user nova-compute[71874]: DEBUG nova.virt.images [None req-83b90f89-2813-41d0-b4a0-2b09a8d1ef5d tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] 16e6d04f-cd10-4e2b-ac3f-107c78071bfa was qcow2, converting to raw {{(pid=71874) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 12 16:12:48 user nova-compute[71874]: DEBUG nova.privsep.utils [None req-83b90f89-2813-41d0-b4a0-2b09a8d1ef5d tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71874) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 12 16:12:48 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-83b90f89-2813-41d0-b4a0-2b09a8d1ef5d tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/aead21c0919ab1c43fd2da49f432fa78d2e3909c.part /opt/stack/data/nova/instances/_base/aead21c0919ab1c43fd2da49f432fa78d2e3909c.converted {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:12:49 user nova-compute[71874]: DEBUG nova.compute.manager [req-4f1083a5-c885-4cbf-8b4a-5ec92f94671f req-c0621212-220e-4ae7-9458-7005e92e4d42 service nova] [instance: 0e8a977c-aa84-47c4-a838-b5f90820de1a] Received event network-vif-plugged-40e16d3f-2e2e-45df-be16-ef3622bfde2e {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:12:49 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-4f1083a5-c885-4cbf-8b4a-5ec92f94671f req-c0621212-220e-4ae7-9458-7005e92e4d42 service nova] Acquiring lock "0e8a977c-aa84-47c4-a838-b5f90820de1a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:12:49 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-4f1083a5-c885-4cbf-8b4a-5ec92f94671f req-c0621212-220e-4ae7-9458-7005e92e4d42 service nova] Lock "0e8a977c-aa84-47c4-a838-b5f90820de1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:12:49 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-4f1083a5-c885-4cbf-8b4a-5ec92f94671f req-c0621212-220e-4ae7-9458-7005e92e4d42 service nova] Lock "0e8a977c-aa84-47c4-a838-b5f90820de1a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:12:49 user nova-compute[71874]: DEBUG nova.compute.manager [req-4f1083a5-c885-4cbf-8b4a-5ec92f94671f req-c0621212-220e-4ae7-9458-7005e92e4d42 service nova] [instance: 0e8a977c-aa84-47c4-a838-b5f90820de1a] No waiting events found dispatching network-vif-plugged-40e16d3f-2e2e-45df-be16-ef3622bfde2e {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:12:49 user nova-compute[71874]: WARNING nova.compute.manager [req-4f1083a5-c885-4cbf-8b4a-5ec92f94671f req-c0621212-220e-4ae7-9458-7005e92e4d42 service nova] [instance: 0e8a977c-aa84-47c4-a838-b5f90820de1a] Received unexpected event network-vif-plugged-40e16d3f-2e2e-45df-be16-ef3622bfde2e for instance with vm_state active and task_state rescuing.
Apr 12 16:12:49 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-7cb78c4c-3708-42ce-9b40-b7eda9188dc2 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "f2511c44-8365-4e8c-9814-172547111b9f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:12:49 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-7cb78c4c-3708-42ce-9b40-b7eda9188dc2 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "f2511c44-8365-4e8c-9814-172547111b9f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:12:49 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-7cb78c4c-3708-42ce-9b40-b7eda9188dc2 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "f2511c44-8365-4e8c-9814-172547111b9f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:12:49 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-7cb78c4c-3708-42ce-9b40-b7eda9188dc2 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "f2511c44-8365-4e8c-9814-172547111b9f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:12:49 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-7cb78c4c-3708-42ce-9b40-b7eda9188dc2 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "f2511c44-8365-4e8c-9814-172547111b9f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:12:49 user nova-compute[71874]: INFO nova.compute.manager [None req-7cb78c4c-3708-42ce-9b40-b7eda9188dc2 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: f2511c44-8365-4e8c-9814-172547111b9f] Terminating instance
Apr 12 16:12:49 user nova-compute[71874]: DEBUG nova.compute.manager [None req-7cb78c4c-3708-42ce-9b40-b7eda9188dc2 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: f2511c44-8365-4e8c-9814-172547111b9f] Start destroying the instance on the hypervisor. {{(pid=71874) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 16:12:49 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-83b90f89-2813-41d0-b4a0-2b09a8d1ef5d tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/aead21c0919ab1c43fd2da49f432fa78d2e3909c.part /opt/stack/data/nova/instances/_base/aead21c0919ab1c43fd2da49f432fa78d2e3909c.converted" returned: 0 in 0.597s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:12:49 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-83b90f89-2813-41d0-b4a0-2b09a8d1ef5d tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aead21c0919ab1c43fd2da49f432fa78d2e3909c.converted --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:12:49 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-83b90f89-2813-41d0-b4a0-2b09a8d1ef5d tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aead21c0919ab1c43fd2da49f432fa78d2e3909c.converted --force-share --output=json" returned: 0 in 0.141s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:12:49 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-83b90f89-2813-41d0-b4a0-2b09a8d1ef5d tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "aead21c0919ab1c43fd2da49f432fa78d2e3909c" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.826s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:12:49 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-83b90f89-2813-41d0-b4a0-2b09a8d1ef5d tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Acquiring lock "aead21c0919ab1c43fd2da49f432fa78d2e3909c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:12:49 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-83b90f89-2813-41d0-b4a0-2b09a8d1ef5d tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "aead21c0919ab1c43fd2da49f432fa78d2e3909c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:12:49 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-83b90f89-2813-41d0-b4a0-2b09a8d1ef5d tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aead21c0919ab1c43fd2da49f432fa78d2e3909c --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:12:49 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:12:49 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:12:49 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:12:49 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-83b90f89-2813-41d0-b4a0-2b09a8d1ef5d tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aead21c0919ab1c43fd2da49f432fa78d2e3909c --force-share --output=json" returned: 0 in 0.144s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:12:49 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-83b90f89-2813-41d0-b4a0-2b09a8d1ef5d tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aead21c0919ab1c43fd2da49f432fa78d2e3909c,backing_fmt=raw /opt/stack/data/nova/instances/0e8a977c-aa84-47c4-a838-b5f90820de1a/disk.rescue {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:12:49 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-83b90f89-2813-41d0-b4a0-2b09a8d1ef5d tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aead21c0919ab1c43fd2da49f432fa78d2e3909c,backing_fmt=raw /opt/stack/data/nova/instances/0e8a977c-aa84-47c4-a838-b5f90820de1a/disk.rescue" returned: 0 in 0.068s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:12:49 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-83b90f89-2813-41d0-b4a0-2b09a8d1ef5d tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "aead21c0919ab1c43fd2da49f432fa78d2e3909c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.217s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:12:49 user nova-compute[71874]: DEBUG nova.objects.instance [None req-83b90f89-2813-41d0-b4a0-2b09a8d1ef5d tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lazy-loading 'migration_context' on Instance uuid 0e8a977c-aa84-47c4-a838-b5f90820de1a {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:12:49 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-83b90f89-2813-41d0-b4a0-2b09a8d1ef5d tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 0e8a977c-aa84-47c4-a838-b5f90820de1a] Created local disks {{(pid=71874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 16:12:49 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-83b90f89-2813-41d0-b4a0-2b09a8d1ef5d tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 0e8a977c-aa84-47c4-a838-b5f90820de1a] Start _get_guest_xml network_info=[{"id": "40e16d3f-2e2e-45df-be16-ef3622bfde2e", "address": "fa:16:3e:4d:9c:b1", "network": {"id": "b36306e0-04c5-4b1b-8022-05ff121c4e43", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1503204786-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1503204786-network", "vif_mac": "fa:16:3e:4d:9c:b1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9210f81232304e179d3e09914a492442", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40e16d3f-2e", "ovs_interfaceid": "40e16d3f-2e2e-45df-be16-ef3622bfde2e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T15:55:37Z,direct_url=<?>,disk_format='qcow2',id=9dc63f14-8b70-4e72-89f2-13464f2f5c7c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='61a4936d9b7744c0b488d81c9b7746b6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T15:55:39Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '16e6d04f-cd10-4e2b-ac3f-107c78071bfa', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'delete_on_termination': False, 'attachment_id': 'd88609d1-a4cf-423e-84be-9a7a0cab6e3d', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IwmgRBMr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': '0e8a977c-aa84-47c4-a838-b5f90820de1a', 'attached_at': '', 'detached_at': '', 'volume_id': '5c31b819-b8c1-4c22-b9c6-d276f2c03304', 'serial': '5c31b819-b8c1-4c22-b9c6-d276f2c03304'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'volume_type': None} {{(pid=71874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 16:12:49 user nova-compute[71874]: DEBUG nova.objects.instance [None req-83b90f89-2813-41d0-b4a0-2b09a8d1ef5d tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lazy-loading 'resources' on Instance uuid 0e8a977c-aa84-47c4-a838-b5f90820de1a {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:12:49 user nova-compute[71874]: DEBUG nova.objects.instance [None req-83b90f89-2813-41d0-b4a0-2b09a8d1ef5d tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lazy-loading 'numa_topology' on Instance uuid 0e8a977c-aa84-47c4-a838-b5f90820de1a {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:12:49 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-83b90f89-2813-41d0-b4a0-2b09a8d1ef5d tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:12:49 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-83b90f89-2813-41d0-b4a0-2b09a8d1ef5d tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:12:50 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-83b90f89-2813-41d0-b4a0-2b09a8d1ef5d tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71874) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 16:12:50 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-83b90f89-2813-41d0-b4a0-2b09a8d1ef5d tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T15:56:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T15:55:37Z,direct_url=<?>,disk_format='qcow2',id=9dc63f14-8b70-4e72-89f2-13464f2f5c7c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='61a4936d9b7744c0b488d81c9b7746b6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T15:55:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 16:12:50 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-83b90f89-2813-41d0-b4a0-2b09a8d1ef5d tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Flavor limits 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 16:12:50 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-83b90f89-2813-41d0-b4a0-2b09a8d1ef5d tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Image limits 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 16:12:50 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-83b90f89-2813-41d0-b4a0-2b09a8d1ef5d tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Flavor pref 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 16:12:50 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-83b90f89-2813-41d0-b4a0-2b09a8d1ef5d tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Image pref 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 16:12:50 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-83b90f89-2813-41d0-b4a0-2b09a8d1ef5d tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 16:12:50 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-83b90f89-2813-41d0-b4a0-2b09a8d1ef5d tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 16:12:50 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-83b90f89-2813-41d0-b4a0-2b09a8d1ef5d tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 16:12:50 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-83b90f89-2813-41d0-b4a0-2b09a8d1ef5d tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Got 1 possible topologies {{(pid=71874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 16:12:50 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-83b90f89-2813-41d0-b4a0-2b09a8d1ef5d tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 16:12:50 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-83b90f89-2813-41d0-b4a0-2b09a8d1ef5d tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 16:12:50 user nova-compute[71874]: DEBUG nova.objects.instance [None req-83b90f89-2813-41d0-b4a0-2b09a8d1ef5d tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lazy-loading 'vcpu_model' on Instance uuid 0e8a977c-aa84-47c4-a838-b5f90820de1a {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:12:50 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-83b90f89-2813-41d0-b4a0-2b09a8d1ef5d tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 0e8a977c-aa84-47c4-a838-b5f90820de1a] Calling os-brick to attach iSCSI Volume {{(pid=71874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 16:12:50 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-83b90f89-2813-41d0-b4a0-2b09a8d1ef5d tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3c0216320>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IwmgRBMr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:12:50 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-83b90f89-2813-41d0-b4a0-2b09a8d1ef5d tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:12:50 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-83b90f89-2813-41d0-b4a0-2b09a8d1ef5d tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:12:50 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-83b90f89-2813-41d0-b4a0-2b09a8d1ef5d tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:12:50 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-83b90f89-2813-41d0-b4a0-2b09a8d1ef5d tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:12:50 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-83b90f89-2813-41d0-b4a0-2b09a8d1ef5d tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:12:50 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-83b90f89-2813-41d0-b4a0-2b09a8d1ef5d tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:12:50 user nova-compute[71874]: INFO os_brick.initiator.connectors.iscsi [None req-83b90f89-2813-41d0-b4a0-2b09a8d1ef5d tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 16:12:50 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304 -p 172.16.0.220:3260 {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:12:50 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304 -p 172.16.0.220:3260" returned: 0 in 0.020s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:12:50 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f692a3a-d5f4-4e0b-8642-55cbfe771824]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = IwmgRBMr\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:12:50 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-83b90f89-2813-41d0-b4a0-2b09a8d1ef5d tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Apr 12 16:12:50 user nova-compute[71874]: node.name = iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304
Apr 12 16:12:50 user nova-compute[71874]: node.tpgt = -1
Apr 12 16:12:50 user nova-compute[71874]: node.startup = automatic
Apr 12 16:12:50 user nova-compute[71874]: node.leading_login = No
Apr 12 16:12:50 user nova-compute[71874]: iface.iscsi_ifacename = default
Apr 12 16:12:50 user nova-compute[71874]: iface.net_ifacename = <empty>
Apr 12 16:12:50 user nova-compute[71874]: iface.ipaddress = <empty>
Apr 12 16:12:50 user nova-compute[71874]: iface.prefix_len = 0
Apr 12 16:12:50 user nova-compute[71874]: iface.hwaddress = <empty>
Apr 12 16:12:50 user nova-compute[71874]: iface.transport_name = tcp
Apr 12 16:12:50 user nova-compute[71874]: iface.initiatorname = <empty>
Apr 12 16:12:50 user nova-compute[71874]: iface.state = <empty>
Apr 12 16:12:50 user nova-compute[71874]: iface.vlan_id = 0
Apr 12 16:12:50 user nova-compute[71874]: iface.vlan_priority = 0
Apr 12 16:12:50 user nova-compute[71874]: iface.vlan_state = <empty>
Apr 12 16:12:50 user nova-compute[71874]: iface.iface_num = 0
Apr 12 16:12:50 user nova-compute[71874]: iface.mtu = 0
Apr 12 16:12:50 user nova-compute[71874]: iface.port = 0
Apr 12 16:12:50 user nova-compute[71874]: iface.bootproto = <empty>
Apr 12 16:12:50 user nova-compute[71874]: iface.subnet_mask = <empty>
Apr 12 16:12:50 user nova-compute[71874]: iface.gateway = <empty>
Apr 12 16:12:50 user nova-compute[71874]: iface.dhcp_alt_client_id_state = <empty>
Apr 12 16:12:50 user nova-compute[71874]: iface.dhcp_alt_client_id = <empty>
Apr 12 16:12:50 user nova-compute[71874]: iface.dhcp_dns = <empty>
Apr 12 16:12:50 user nova-compute[71874]: iface.dhcp_learn_iqn = <empty>
Apr 12 16:12:50 user nova-compute[71874]: iface.dhcp_req_vendor_id_state = <empty>
Apr 12 16:12:50 user nova-compute[71874]: iface.dhcp_vendor_id_state = <empty>
Apr 12 16:12:50 user nova-compute[71874]: iface.dhcp_vendor_id = <empty>
Apr 12 16:12:50 user nova-compute[71874]: iface.dhcp_slp_da = <empty>
Apr 12 16:12:50 user nova-compute[71874]: iface.fragmentation = <empty>
Apr 12 16:12:50 user nova-compute[71874]: iface.gratuitous_arp = <empty>
Apr 12 16:12:50 user nova-compute[71874]: iface.incoming_forwarding = <empty>
Apr 12 16:12:50 user nova-compute[71874]: iface.tos_state = <empty>
Apr 12 16:12:50 user nova-compute[71874]: iface.tos = 0
Apr 12 16:12:50 user nova-compute[71874]: iface.ttl = 0
Apr 12 16:12:50 user nova-compute[71874]: iface.delayed_ack = <empty>
Apr 12 16:12:50 user nova-compute[71874]: iface.tcp_nagle = <empty>
Apr 12 16:12:50 user nova-compute[71874]: iface.tcp_wsf_state = <empty>
Apr 12 16:12:50 user nova-compute[71874]: iface.tcp_wsf = 0
Apr 12 16:12:50 user nova-compute[71874]: iface.tcp_timer_scale = 0
Apr 12 16:12:50 user nova-compute[71874]: iface.tcp_timestamp = <empty>
Apr 12 16:12:50 user nova-compute[71874]: iface.redirect = <empty>
Apr 12 16:12:50 user nova-compute[71874]: iface.def_task_mgmt_timeout = 0
Apr 12 16:12:50 user nova-compute[71874]: iface.header_digest = <empty>
Apr 12 16:12:50 user nova-compute[71874]: iface.data_digest = <empty>
Apr 12 16:12:50 user nova-compute[71874]: iface.immediate_data = <empty>
Apr 12 16:12:50 user nova-compute[71874]: iface.initial_r2t = <empty>
Apr 12 16:12:50 user nova-compute[71874]: iface.data_seq_inorder = <empty>
Apr 12 16:12:50 user nova-compute[71874]: iface.data_pdu_inorder = <empty>
Apr 12 16:12:50 user nova-compute[71874]: iface.erl = 0
Apr 12 16:12:50 user nova-compute[71874]: iface.max_receive_data_len = 0
Apr 12 16:12:50 user nova-compute[71874]: iface.first_burst_len = 0
Apr 12 16:12:50 user nova-compute[71874]: iface.max_outstanding_r2t = 0
Apr 12 16:12:50 user nova-compute[71874]: iface.max_burst_len = 0
Apr 12 16:12:50 user nova-compute[71874]: iface.chap_auth = <empty>
Apr 12 16:12:50 user nova-compute[71874]: iface.bidi_chap = <empty>
Apr 12 16:12:50 user nova-compute[71874]: iface.strict_login_compliance = <empty>
Apr 12 16:12:50 user nova-compute[71874]: iface.discovery_auth = <empty>
Apr 12 16:12:50 user nova-compute[71874]: iface.discovery_logout = <empty>
Apr 12 16:12:50 user nova-compute[71874]: node.discovery_address = <empty>
Apr 12 16:12:50 user nova-compute[71874]: node.discovery_port = 0
Apr 12 16:12:50 user nova-compute[71874]: node.discovery_type = static
Apr 12 16:12:50 user nova-compute[71874]: node.session.initial_cmdsn = 0
Apr 12 16:12:50 user nova-compute[71874]: node.session.initial_login_retry_max = 8
Apr 12 16:12:50 user nova-compute[71874]: node.session.xmit_thread_priority = -20
Apr 12 16:12:50 user nova-compute[71874]: node.session.cmds_max = 128
Apr 12 16:12:50 user nova-compute[71874]: node.session.queue_depth = 32
Apr 12 16:12:50 user nova-compute[71874]: node.session.nr_sessions = 1
Apr 12 16:12:50 user nova-compute[71874]: node.session.auth.authmethod = CHAP
Apr 12 16:12:50 user nova-compute[71874]: node.session.auth.username = IwmgRBMr
Apr 12 16:12:50 user nova-compute[71874]: node.session.auth.password = ***
Apr 12 16:12:50 user nova-compute[71874]: node.session.auth.username_in = <empty>
Apr 12 16:12:50 user nova-compute[71874]: node.session.auth.password_in = <empty>
Apr 12 16:12:50 user nova-compute[71874]: node.session.auth.chap_algs = MD5
Apr 12 16:12:50 user nova-compute[71874]: node.session.timeo.replacement_timeout = 120
Apr 12 16:12:50 user nova-compute[71874]: node.session.err_timeo.abort_timeout = 15
Apr 12 16:12:50 user nova-compute[71874]: node.session.err_timeo.lu_reset_timeout = 30
Apr 12 16:12:50 user nova-compute[71874]: node.session.err_timeo.tgt_reset_timeout = 30
Apr 12 16:12:50 user nova-compute[71874]: node.session.err_timeo.host_reset_timeout = 60
Apr 12 16:12:50 user nova-compute[71874]: node.session.iscsi.FastAbort = Yes
Apr 12 16:12:50 user nova-compute[71874]: node.session.iscsi.InitialR2T = No
Apr 12 16:12:50 user nova-compute[71874]: node.session.iscsi.ImmediateData = Yes
Apr 12 16:12:50 user nova-compute[71874]: node.session.iscsi.FirstBurstLength = 262144
Apr 12 16:12:50 user nova-compute[71874]: node.session.iscsi.MaxBurstLength = 16776192
Apr 12 16:12:50 user nova-compute[71874]: node.session.iscsi.DefaultTime2Retain = 0
Apr 12 16:12:50 user nova-compute[71874]: node.session.iscsi.DefaultTime2Wait = 2
Apr 12 16:12:50 user nova-compute[71874]: node.session.iscsi.MaxConnections = 1
Apr 12 16:12:50 user nova-compute[71874]: node.session.iscsi.MaxOutstandingR2T = 1
Apr 12 16:12:50 user nova-compute[71874]: node.session.iscsi.ERL = 0
Apr 12 16:12:50 user nova-compute[71874]: node.session.scan = manual
Apr 12 16:12:50 user nova-compute[71874]: node.session.reopen_max = 0
Apr 12 16:12:50 user nova-compute[71874]: node.conn[0].address = 172.16.0.220
Apr 12 16:12:50 user nova-compute[71874]: node.conn[0].port = 3260
Apr 12 16:12:50 user nova-compute[71874]: node.conn[0].startup = manual
Apr 12 16:12:50 user nova-compute[71874]: node.conn[0].tcp.window_size = 524288
Apr 12 16:12:50 user nova-compute[71874]: node.conn[0].tcp.type_of_service = 0
Apr 12 16:12:50 user nova-compute[71874]: node.conn[0].timeo.logout_timeout = 15
Apr 12 16:12:50 user nova-compute[71874]: node.conn[0].timeo.login_timeout = 15
Apr 12 16:12:50 user nova-compute[71874]: node.conn[0].timeo.auth_timeout = 45
Apr 12 16:12:50 user nova-compute[71874]: node.conn[0].timeo.noop_out_interval = 5
Apr 12 16:12:50 user nova-compute[71874]: node.conn[0].timeo.noop_out_timeout = 5
Apr 12 16:12:50 user nova-compute[71874]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Apr 12 16:12:50 user nova-compute[71874]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Apr 12 16:12:50 user nova-compute[71874]: node.conn[0].iscsi.HeaderDigest = None
Apr 12 16:12:50 user nova-compute[71874]: node.conn[0].iscsi.DataDigest = None
Apr 12 16:12:50 user nova-compute[71874]: node.conn[0].iscsi.IFMarker = No
Apr 12 16:12:50 user nova-compute[71874]: node.conn[0].iscsi.OFMarker = No
Apr 12 16:12:50 user nova-compute[71874]: # END RECORD
Apr 12 16:12:50 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:12:50 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:12:50 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:12:50 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e756636-9849-4748-ab6d-e8c1da233aec]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:12:50 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-83b90f89-2813-41d0-b4a0-2b09a8d1ef5d tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:12:50 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:12:50 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:12:50 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[08f6ac4e-128f-4b38-af33-ea0f0be46091]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:12:50 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-83b90f89-2813-41d0-b4a0-2b09a8d1ef5d tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:12:50 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IwmgRBMr {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:12:50 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IwmgRBMr" returned: 0 in 0.021s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:12:50 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[35e025d5-15ec-420c-8a9c-5d2e5097800d]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:12:50 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-83b90f89-2813-41d0-b4a0-2b09a8d1ef5d tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IwmgRBMr'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:12:50 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:12:50 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:12:50 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbb18ec3-5751-4794-8f6d-a55c539ccd45]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:12:50 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-83b90f89-2813-41d0-b4a0-2b09a8d1ef5d tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:12:50 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:12:50 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:12:50 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ba8e311-f179-404e-8b53-c7f0ac1c9650]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f27a002-8dfc-4d90-aa35-ba16586d4366 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce38c1b3-35b0-48cc-9b83-e9a676997784 (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:12:50 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-83b90f89-2813-41d0-b4a0-2b09a8d1ef5d tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:12:50 user nova-compute[71874]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f27a002-8dfc-4d90-aa35-ba16586d4366 (non-flash)
Apr 12 16:12:50 user nova-compute[71874]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 (non-flash)
Apr 12 16:12:50 user nova-compute[71874]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304 (non-flash)
Apr 12 16:12:50 user nova-compute[71874]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce38c1b3-35b0-48cc-9b83-e9a676997784 (non-flash)
Apr 12 16:12:50 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:12:50 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-83b90f89-2813-41d0-b4a0-2b09a8d1ef5d tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:12:50 user nova-compute[71874]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f27a002-8dfc-4d90-aa35-ba16586d4366 (non-flash)
Apr 12 16:12:50 user nova-compute[71874]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 (non-flash)
Apr 12 16:12:50 user nova-compute[71874]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304 (non-flash)
Apr 12 16:12:50 user nova-compute[71874]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce38c1b3-35b0-48cc-9b83-e9a676997784 (non-flash)
Apr 12 16:12:50 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:12:50 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-83b90f89-2813-41d0-b4a0-2b09a8d1ef5d tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.154s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:12:50 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-83b90f89-2813-41d0-b4a0-2b09a8d1ef5d tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Connected to 172.16.0.220:3260 {{(pid=71874) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 16:12:50 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-83b90f89-2813-41d0-b4a0-2b09a8d1ef5d tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] HCTL ('37', '0', '0', 0) found on session 32 with lun 0 {{(pid=71874) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 16:12:50 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-83b90f89-2813-41d0-b4a0-2b09a8d1ef5d tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Scanning host 37 c: 0, t: 0, l: 0) {{(pid=71874) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 16:12:50 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:12:50 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.015s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:12:50 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d9dc7fa-192e-4b61-bca3-82e6be78c5cc]: (4, ('0 0 0', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:12:50 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-83b90f89-2813-41d0-b4a0-2b09a8d1ef5d tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Searching for a device in session 32 and hctl ('37', '0', '0', 0) yield: sdf {{(pid=71874) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 16:12:50 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-83b90f89-2813-41d0-b4a0-2b09a8d1ef5d tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IwmgRBMr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=71874) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 16:12:50 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-83b90f89-2813-41d0-b4a0-2b09a8d1ef5d tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.181s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:12:50 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-83b90f89-2813-41d0-b4a0-2b09a8d1ef5d tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] <== connect_volume: return (183ms) {'type': 'block', 'scsi_wwn': '23736366233343638', 'path': '/dev/sdf'} {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:12:50 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-83b90f89-2813-41d0-b4a0-2b09a8d1ef5d tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 0e8a977c-aa84-47c4-a838-b5f90820de1a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23736366233343638', 'path': '/dev/sdf'} {{(pid=71874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 16:12:50 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-83b90f89-2813-41d0-b4a0-2b09a8d1ef5d tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T16:10:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1308581862',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1308581862',id=31,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T16:11:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9210f81232304e179d3e09914a492442',ramdisk_id='',reservation_id='r-ji74zs90',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1443944578',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T16:11:11Z,user_data=None,user_id='73f9fa5bc22a4824b3cdcb8cf7bb380c',uuid=0e8a977c-aa84-47c4-a838-b5f90820de1a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "40e16d3f-2e2e-45df-be16-ef3622bfde2e", "address": "fa:16:3e:4d:9c:b1", "network": {"id": "b36306e0-04c5-4b1b-8022-05ff121c4e43", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1503204786-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1503204786-network", "vif_mac": "fa:16:3e:4d:9c:b1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9210f81232304e179d3e09914a492442", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40e16d3f-2e", "ovs_interfaceid": "40e16d3f-2e2e-45df-be16-ef3622bfde2e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 16:12:50 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-83b90f89-2813-41d0-b4a0-2b09a8d1ef5d tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Converting VIF {"id": "40e16d3f-2e2e-45df-be16-ef3622bfde2e", "address": "fa:16:3e:4d:9c:b1", "network": {"id": "b36306e0-04c5-4b1b-8022-05ff121c4e43", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1503204786-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1503204786-network", "vif_mac": "fa:16:3e:4d:9c:b1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9210f81232304e179d3e09914a492442", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40e16d3f-2e", "ovs_interfaceid": "40e16d3f-2e2e-45df-be16-ef3622bfde2e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:12:50 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-83b90f89-2813-41d0-b4a0-2b09a8d1ef5d tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4d:9c:b1,bridge_name='br-int',has_traffic_filtering=True,id=40e16d3f-2e2e-45df-be16-ef3622bfde2e,network=Network(b36306e0-04c5-4b1b-8022-05ff121c4e43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40e16d3f-2e') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:12:50 user nova-compute[71874]: DEBUG nova.objects.instance [None req-83b90f89-2813-41d0-b4a0-2b09a8d1ef5d tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lazy-loading 'pci_devices' on Instance uuid 0e8a977c-aa84-47c4-a838-b5f90820de1a {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:12:50 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-83b90f89-2813-41d0-b4a0-2b09a8d1ef5d tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 0e8a977c-aa84-47c4-a838-b5f90820de1a] End _get_guest_xml xml=<domain type="kvm">
Apr 12 16:12:50 user nova-compute[71874]:   <uuid>0e8a977c-aa84-47c4-a838-b5f90820de1a</uuid>
Apr 12 16:12:50 user nova-compute[71874]:   <name>instance-0000001f</name>
Apr 12 16:12:50 user nova-compute[71874]:   <memory>131072</memory>
Apr 12 16:12:50 user nova-compute[71874]:   <vcpu>1</vcpu>
Apr 12 16:12:50 user nova-compute[71874]:   <metadata>
Apr 12 16:12:50 user nova-compute[71874]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 16:12:50 user nova-compute[71874]:       <nova:package version="0.0.0"/>
Apr 12 16:12:50 user nova-compute[71874]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1308581862</nova:name>
Apr 12 16:12:50 user nova-compute[71874]:       <nova:creationTime>2023-04-12 16:12:49</nova:creationTime>
Apr 12 16:12:50 user nova-compute[71874]:       <nova:flavor name="m1.nano">
Apr 12 16:12:50 user nova-compute[71874]:         <nova:memory>128</nova:memory>
Apr 12 16:12:50 user nova-compute[71874]:         <nova:disk>1</nova:disk>
Apr 12 16:12:50 user nova-compute[71874]:         <nova:swap>0</nova:swap>
Apr 12 16:12:50 user nova-compute[71874]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 16:12:50 user nova-compute[71874]:         <nova:vcpus>1</nova:vcpus>
Apr 12 16:12:50 user nova-compute[71874]:       </nova:flavor>
Apr 12 16:12:50 user nova-compute[71874]:       <nova:owner>
Apr 12 16:12:50 user nova-compute[71874]:         <nova:user uuid="73f9fa5bc22a4824b3cdcb8cf7bb380c">tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member</nova:user>
Apr 12 16:12:50 user nova-compute[71874]:         <nova:project uuid="9210f81232304e179d3e09914a492442">tempest-ServerBootFromVolumeStableRescueTest-1443944578</nova:project>
Apr 12 16:12:50 user nova-compute[71874]:       </nova:owner>
Apr 12 16:12:50 user nova-compute[71874]:       <nova:root type="image" uuid="9dc63f14-8b70-4e72-89f2-13464f2f5c7c"/>
Apr 12 16:12:50 user nova-compute[71874]:       <nova:ports>
Apr 12 16:12:50 user nova-compute[71874]:         <nova:port uuid="40e16d3f-2e2e-45df-be16-ef3622bfde2e">
Apr 12 16:12:50 user nova-compute[71874]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 12 16:12:50 user nova-compute[71874]:         </nova:port>
Apr 12 16:12:50 user nova-compute[71874]:       </nova:ports>
Apr 12 16:12:50 user nova-compute[71874]:     </nova:instance>
Apr 12 16:12:50 user nova-compute[71874]:   </metadata>
Apr 12 16:12:50 user nova-compute[71874]:   <sysinfo type="smbios">
Apr 12 16:12:50 user nova-compute[71874]:     <system>
Apr 12 16:12:50 user nova-compute[71874]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 16:12:50 user nova-compute[71874]:       <entry name="product">OpenStack Nova</entry>
Apr 12 16:12:50 user nova-compute[71874]:       <entry name="version">0.0.0</entry>
Apr 12 16:12:50 user nova-compute[71874]:       <entry name="serial">0e8a977c-aa84-47c4-a838-b5f90820de1a</entry>
Apr 12 16:12:50 user nova-compute[71874]:       <entry name="uuid">0e8a977c-aa84-47c4-a838-b5f90820de1a</entry>
Apr 12 16:12:50 user nova-compute[71874]:       <entry name="family">Virtual Machine</entry>
Apr 12 16:12:50 user nova-compute[71874]:     </system>
Apr 12 16:12:50 user nova-compute[71874]:   </sysinfo>
Apr 12 16:12:50 user nova-compute[71874]:   <os>
Apr 12 16:12:50 user nova-compute[71874]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 16:12:50 user nova-compute[71874]:     <smbios mode="sysinfo"/>
Apr 12 16:12:50 user nova-compute[71874]:   </os>
Apr 12 16:12:50 user nova-compute[71874]:   <features>
Apr 12 16:12:50 user nova-compute[71874]:     <acpi/>
Apr 12 16:12:50 user nova-compute[71874]:     <apic/>
Apr 12 16:12:50 user nova-compute[71874]:     <vmcoreinfo/>
Apr 12 16:12:50 user nova-compute[71874]:   </features>
Apr 12 16:12:50 user nova-compute[71874]:   <clock offset="utc">
Apr 12 16:12:50 user nova-compute[71874]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 16:12:50 user nova-compute[71874]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 16:12:50 user nova-compute[71874]:     <timer name="hpet" present="no"/>
Apr 12 16:12:50 user nova-compute[71874]:   </clock>
Apr 12 16:12:50 user nova-compute[71874]:   <cpu mode="custom" match="exact">
Apr 12 16:12:50 user nova-compute[71874]:     <model>Nehalem</model>
Apr 12 16:12:50 user nova-compute[71874]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 16:12:50 user nova-compute[71874]:   </cpu>
Apr 12 16:12:50 user nova-compute[71874]:   <devices>
Apr 12 16:12:50 user nova-compute[71874]:     <disk type="block" device="disk">
Apr 12 16:12:50 user nova-compute[71874]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 16:12:50 user nova-compute[71874]:       <source dev="/dev/sdf"/>
Apr 12 16:12:50 user nova-compute[71874]:       <target dev="vda" bus="virtio"/>
Apr 12 16:12:50 user nova-compute[71874]:       <serial>5c31b819-b8c1-4c22-b9c6-d276f2c03304</serial>
Apr 12 16:12:50 user nova-compute[71874]:     </disk>
Apr 12 16:12:50 user nova-compute[71874]:     <disk type="file" device="disk">
Apr 12 16:12:50 user nova-compute[71874]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 16:12:50 user nova-compute[71874]:       <source file="/opt/stack/data/nova/instances/0e8a977c-aa84-47c4-a838-b5f90820de1a/disk.rescue"/>
Apr 12 16:12:50 user nova-compute[71874]:       <target dev="vdb" bus="virtio"/>
Apr 12 16:12:50 user nova-compute[71874]:       <boot order="1"/>
Apr 12 16:12:50 user nova-compute[71874]:     </disk>
Apr 12 16:12:50 user nova-compute[71874]:     <interface type="ethernet">
Apr 12 16:12:50 user nova-compute[71874]:       <mac address="fa:16:3e:4d:9c:b1"/>
Apr 12 16:12:50 user nova-compute[71874]:       <model type="virtio"/>
Apr 12 16:12:50 user nova-compute[71874]:       <mtu size="1442"/>
Apr 12 16:12:50 user nova-compute[71874]:       <target dev="tap40e16d3f-2e"/>
Apr 12 16:12:50 user nova-compute[71874]:     </interface>
Apr 12 16:12:50 user nova-compute[71874]:     <serial type="pty">
Apr 12 16:12:50 user nova-compute[71874]:       <log file="/opt/stack/data/nova/instances/0e8a977c-aa84-47c4-a838-b5f90820de1a/console.log" append="off"/>
Apr 12 16:12:50 user nova-compute[71874]:     </serial>
Apr 12 16:12:50 user nova-compute[71874]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 16:12:50 user nova-compute[71874]:     <video>
Apr 12 16:12:50 user nova-compute[71874]:       <model type="virtio"/>
Apr 12 16:12:50 user nova-compute[71874]:     </video>
Apr 12 16:12:50 user nova-compute[71874]:     <rng model="virtio">
Apr 12 16:12:50 user nova-compute[71874]:       <backend model="random">/dev/urandom</backend>
Apr 12 16:12:50 user nova-compute[71874]:     </rng>
Apr 12 16:12:50 user nova-compute[71874]:     <controller type="usb" index="0" model="none"/>
Apr 12 16:12:50 user nova-compute[71874]:     <memballoon model="virtio">
Apr 12 16:12:50 user nova-compute[71874]:       <stats period="10"/>
Apr 12 16:12:50 user nova-compute[71874]:     </memballoon>
Apr 12 16:12:50 user nova-compute[71874]:   </devices>
Apr 12 16:12:50 user nova-compute[71874]: </domain>
Apr 12 16:12:50 user nova-compute[71874]:  {{(pid=71874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 16:12:50 user nova-compute[71874]: INFO nova.virt.libvirt.driver [-] [instance: 0e8a977c-aa84-47c4-a838-b5f90820de1a] Instance destroyed successfully.
Apr 12 16:12:50 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-83b90f89-2813-41d0-b4a0-2b09a8d1ef5d tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] No BDM found with device name vda, not building metadata. {{(pid=71874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 16:12:50 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-83b90f89-2813-41d0-b4a0-2b09a8d1ef5d tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 16:12:50 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-83b90f89-2813-41d0-b4a0-2b09a8d1ef5d tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] No VIF found with MAC fa:16:3e:4d:9c:b1, not building metadata {{(pid=71874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 16:12:50 user nova-compute[71874]: INFO nova.virt.libvirt.driver [-] [instance: f2511c44-8365-4e8c-9814-172547111b9f] Instance destroyed successfully.
Apr 12 16:12:50 user nova-compute[71874]: DEBUG nova.objects.instance [None req-7cb78c4c-3708-42ce-9b40-b7eda9188dc2 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lazy-loading 'resources' on Instance uuid f2511c44-8365-4e8c-9814-172547111b9f {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:12:50 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-7cb78c4c-3708-42ce-9b40-b7eda9188dc2 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T16:09:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-180716396',display_name='tempest-AttachVolumeNegativeTest-server-180716396',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-180716396',id=28,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMV14aR/BI8YAjSCONdULZvRqXfIdT8RapVzPcFF9r21388G6jXQ3sF9h/frRtTRkPlFihOSvv8T7SIRbtzU0tJmwXvgpK22Hpu/EyKFqKnRb3Q7irg6PNvPxtJ9D47+Bw==',key_name='tempest-keypair-1846852248',keypairs=<?>,launch_index=0,launched_at=2023-04-12T16:10:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='28d940eae5394293b87cfced45911ab4',ramdisk_id='',reservation_id='r-d3ax1olg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-288610953',owner_user_name='tempest-AttachVolumeNegativeTest-288610953-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T16:10:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5a514f6d877a4ab0bec597fee13ce9db',uuid=f2511c44-8365-4e8c-9814-172547111b9f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3d785c5d-4be8-4ade-92dd-d4bf7a16cb37", "address": "fa:16:3e:4a:64:40", "network": {"id": "e71b9966-9a95-4f66-b3b1-36b05d05853c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-310205564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28d940eae5394293b87cfced45911ab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d785c5d-4b", "ovs_interfaceid": "3d785c5d-4be8-4ade-92dd-d4bf7a16cb37", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 16:12:50 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-7cb78c4c-3708-42ce-9b40-b7eda9188dc2 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Converting VIF {"id": "3d785c5d-4be8-4ade-92dd-d4bf7a16cb37", "address": "fa:16:3e:4a:64:40", "network": {"id": "e71b9966-9a95-4f66-b3b1-36b05d05853c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-310205564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28d940eae5394293b87cfced45911ab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d785c5d-4b", "ovs_interfaceid": "3d785c5d-4be8-4ade-92dd-d4bf7a16cb37", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:12:50 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-7cb78c4c-3708-42ce-9b40-b7eda9188dc2 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4a:64:40,bridge_name='br-int',has_traffic_filtering=True,id=3d785c5d-4be8-4ade-92dd-d4bf7a16cb37,network=Network(e71b9966-9a95-4f66-b3b1-36b05d05853c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d785c5d-4b') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:12:50 user nova-compute[71874]: DEBUG os_vif [None req-7cb78c4c-3708-42ce-9b40-b7eda9188dc2 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4a:64:40,bridge_name='br-int',has_traffic_filtering=True,id=3d785c5d-4be8-4ade-92dd-d4bf7a16cb37,network=Network(e71b9966-9a95-4f66-b3b1-36b05d05853c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d785c5d-4b') {{(pid=71874) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 16:12:50 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:12:50 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3d785c5d-4b, bridge=br-int, if_exists=True) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:12:50 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:12:50 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:12:50 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:12:50 user nova-compute[71874]: INFO os_vif [None req-7cb78c4c-3708-42ce-9b40-b7eda9188dc2 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4a:64:40,bridge_name='br-int',has_traffic_filtering=True,id=3d785c5d-4be8-4ade-92dd-d4bf7a16cb37,network=Network(e71b9966-9a95-4f66-b3b1-36b05d05853c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d785c5d-4b')
Apr 12 16:12:50 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-7cb78c4c-3708-42ce-9b40-b7eda9188dc2 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: f2511c44-8365-4e8c-9814-172547111b9f] Deleting instance files /opt/stack/data/nova/instances/f2511c44-8365-4e8c-9814-172547111b9f_del
Apr 12 16:12:50 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-7cb78c4c-3708-42ce-9b40-b7eda9188dc2 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: f2511c44-8365-4e8c-9814-172547111b9f] Deletion of /opt/stack/data/nova/instances/f2511c44-8365-4e8c-9814-172547111b9f_del complete
Apr 12 16:12:50 user nova-compute[71874]: INFO nova.compute.manager [None req-7cb78c4c-3708-42ce-9b40-b7eda9188dc2 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: f2511c44-8365-4e8c-9814-172547111b9f] Took 0.95 seconds to destroy the instance on the hypervisor.
Apr 12 16:12:50 user nova-compute[71874]: DEBUG oslo.service.loopingcall [None req-7cb78c4c-3708-42ce-9b40-b7eda9188dc2 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71874) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 16:12:50 user nova-compute[71874]: DEBUG nova.compute.manager [-] [instance: f2511c44-8365-4e8c-9814-172547111b9f] Deallocating network for instance {{(pid=71874) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 16:12:50 user nova-compute[71874]: DEBUG nova.network.neutron [-] [instance: f2511c44-8365-4e8c-9814-172547111b9f] deallocate_for_instance() {{(pid=71874) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 16:12:51 user nova-compute[71874]: DEBUG nova.network.neutron [-] [instance: f2511c44-8365-4e8c-9814-172547111b9f] Updating instance_info_cache with network_info: [] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:12:51 user nova-compute[71874]: INFO nova.compute.manager [-] [instance: f2511c44-8365-4e8c-9814-172547111b9f] Took 0.86 seconds to deallocate network for instance.
Apr 12 16:12:51 user nova-compute[71874]: DEBUG nova.compute.manager [req-1a2a1177-50cb-4297-a86c-3e059139cc0d req-995d602d-59d7-47c9-ac8b-d047adf6080d service nova] [instance: f2511c44-8365-4e8c-9814-172547111b9f] Received event network-vif-deleted-3d785c5d-4be8-4ade-92dd-d4bf7a16cb37 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:12:51 user nova-compute[71874]: DEBUG nova.compute.manager [req-4b186f6d-9684-497f-81bf-a96cb65c1894 req-89b8f2c0-80ef-419f-9ac0-c897556597a1 service nova] [instance: f2511c44-8365-4e8c-9814-172547111b9f] Received event network-vif-unplugged-3d785c5d-4be8-4ade-92dd-d4bf7a16cb37 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:12:51 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-4b186f6d-9684-497f-81bf-a96cb65c1894 req-89b8f2c0-80ef-419f-9ac0-c897556597a1 service nova] Acquiring lock "f2511c44-8365-4e8c-9814-172547111b9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:12:51 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-4b186f6d-9684-497f-81bf-a96cb65c1894 req-89b8f2c0-80ef-419f-9ac0-c897556597a1 service nova] Lock "f2511c44-8365-4e8c-9814-172547111b9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:12:51 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-4b186f6d-9684-497f-81bf-a96cb65c1894 req-89b8f2c0-80ef-419f-9ac0-c897556597a1 service nova] Lock "f2511c44-8365-4e8c-9814-172547111b9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:12:51 user nova-compute[71874]: DEBUG nova.compute.manager [req-4b186f6d-9684-497f-81bf-a96cb65c1894 req-89b8f2c0-80ef-419f-9ac0-c897556597a1 service nova] [instance: f2511c44-8365-4e8c-9814-172547111b9f] No waiting events found dispatching network-vif-unplugged-3d785c5d-4be8-4ade-92dd-d4bf7a16cb37 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:12:51 user nova-compute[71874]: DEBUG nova.compute.manager [req-4b186f6d-9684-497f-81bf-a96cb65c1894 req-89b8f2c0-80ef-419f-9ac0-c897556597a1 service nova] [instance: f2511c44-8365-4e8c-9814-172547111b9f] Received event network-vif-unplugged-3d785c5d-4be8-4ade-92dd-d4bf7a16cb37 for instance with task_state deleting. {{(pid=71874) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 16:12:51 user nova-compute[71874]: DEBUG nova.compute.manager [req-4b186f6d-9684-497f-81bf-a96cb65c1894 req-89b8f2c0-80ef-419f-9ac0-c897556597a1 service nova] [instance: f2511c44-8365-4e8c-9814-172547111b9f] Received event network-vif-plugged-3d785c5d-4be8-4ade-92dd-d4bf7a16cb37 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:12:51 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-4b186f6d-9684-497f-81bf-a96cb65c1894 req-89b8f2c0-80ef-419f-9ac0-c897556597a1 service nova] Acquiring lock "f2511c44-8365-4e8c-9814-172547111b9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:12:51 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-4b186f6d-9684-497f-81bf-a96cb65c1894 req-89b8f2c0-80ef-419f-9ac0-c897556597a1 service nova] Lock "f2511c44-8365-4e8c-9814-172547111b9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:12:51 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-4b186f6d-9684-497f-81bf-a96cb65c1894 req-89b8f2c0-80ef-419f-9ac0-c897556597a1 service nova] Lock "f2511c44-8365-4e8c-9814-172547111b9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:12:51 user nova-compute[71874]: DEBUG nova.compute.manager [req-4b186f6d-9684-497f-81bf-a96cb65c1894 req-89b8f2c0-80ef-419f-9ac0-c897556597a1 service nova] [instance: f2511c44-8365-4e8c-9814-172547111b9f] No waiting events found dispatching network-vif-plugged-3d785c5d-4be8-4ade-92dd-d4bf7a16cb37 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:12:51 user nova-compute[71874]: WARNING nova.compute.manager [req-4b186f6d-9684-497f-81bf-a96cb65c1894 req-89b8f2c0-80ef-419f-9ac0-c897556597a1 service nova] [instance: f2511c44-8365-4e8c-9814-172547111b9f] Received unexpected event network-vif-plugged-3d785c5d-4be8-4ade-92dd-d4bf7a16cb37 for instance with vm_state active and task_state deleting.
Apr 12 16:12:51 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-7cb78c4c-3708-42ce-9b40-b7eda9188dc2 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:12:51 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-7cb78c4c-3708-42ce-9b40-b7eda9188dc2 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:12:51 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:12:51 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:12:51 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:12:51 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:12:51 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-7cb78c4c-3708-42ce-9b40-b7eda9188dc2 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Inventory has not changed in ProviderTree for provider: 0e94b4c8-cd49-45e4-9133-d36eb4b2456b {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 16:12:51 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-7cb78c4c-3708-42ce-9b40-b7eda9188dc2 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Inventory has not changed for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 16:12:51 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-7cb78c4c-3708-42ce-9b40-b7eda9188dc2 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.435s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:12:51 user nova-compute[71874]: INFO nova.scheduler.client.report [None req-7cb78c4c-3708-42ce-9b40-b7eda9188dc2 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Deleted allocations for instance f2511c44-8365-4e8c-9814-172547111b9f
Apr 12 16:12:51 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-7cb78c4c-3708-42ce-9b40-b7eda9188dc2 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "f2511c44-8365-4e8c-9814-172547111b9f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.439s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:12:52 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:12:52 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:12:53 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:12:53 user nova-compute[71874]: DEBUG nova.compute.manager [req-01329ff9-df0f-499a-86cc-2ab4596a9a42 req-38680ebc-fa0d-437e-9a95-8c1bb6c2856d service nova] [instance: 0e8a977c-aa84-47c4-a838-b5f90820de1a] Received event network-vif-plugged-40e16d3f-2e2e-45df-be16-ef3622bfde2e {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:12:53 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-01329ff9-df0f-499a-86cc-2ab4596a9a42 req-38680ebc-fa0d-437e-9a95-8c1bb6c2856d service nova] Acquiring lock "0e8a977c-aa84-47c4-a838-b5f90820de1a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:12:53 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-01329ff9-df0f-499a-86cc-2ab4596a9a42 req-38680ebc-fa0d-437e-9a95-8c1bb6c2856d service nova] Lock "0e8a977c-aa84-47c4-a838-b5f90820de1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:12:53 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-01329ff9-df0f-499a-86cc-2ab4596a9a42 req-38680ebc-fa0d-437e-9a95-8c1bb6c2856d service nova] Lock "0e8a977c-aa84-47c4-a838-b5f90820de1a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:12:53 user nova-compute[71874]: DEBUG nova.compute.manager [req-01329ff9-df0f-499a-86cc-2ab4596a9a42 req-38680ebc-fa0d-437e-9a95-8c1bb6c2856d service nova] [instance: 0e8a977c-aa84-47c4-a838-b5f90820de1a] No waiting events found dispatching network-vif-plugged-40e16d3f-2e2e-45df-be16-ef3622bfde2e {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:12:53 user nova-compute[71874]: WARNING nova.compute.manager [req-01329ff9-df0f-499a-86cc-2ab4596a9a42 req-38680ebc-fa0d-437e-9a95-8c1bb6c2856d service nova] [instance: 0e8a977c-aa84-47c4-a838-b5f90820de1a] Received unexpected event network-vif-plugged-40e16d3f-2e2e-45df-be16-ef3622bfde2e for instance with vm_state active and task_state rescuing.
Apr 12 16:12:53 user nova-compute[71874]: DEBUG nova.compute.manager [req-01329ff9-df0f-499a-86cc-2ab4596a9a42 req-38680ebc-fa0d-437e-9a95-8c1bb6c2856d service nova] [instance: 0e8a977c-aa84-47c4-a838-b5f90820de1a] Received event network-vif-plugged-40e16d3f-2e2e-45df-be16-ef3622bfde2e {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:12:53 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-01329ff9-df0f-499a-86cc-2ab4596a9a42 req-38680ebc-fa0d-437e-9a95-8c1bb6c2856d service nova] Acquiring lock "0e8a977c-aa84-47c4-a838-b5f90820de1a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:12:53 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-01329ff9-df0f-499a-86cc-2ab4596a9a42 req-38680ebc-fa0d-437e-9a95-8c1bb6c2856d service nova] Lock "0e8a977c-aa84-47c4-a838-b5f90820de1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:12:53 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-01329ff9-df0f-499a-86cc-2ab4596a9a42 req-38680ebc-fa0d-437e-9a95-8c1bb6c2856d service nova] Lock "0e8a977c-aa84-47c4-a838-b5f90820de1a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:12:53 user nova-compute[71874]: DEBUG nova.compute.manager [req-01329ff9-df0f-499a-86cc-2ab4596a9a42 req-38680ebc-fa0d-437e-9a95-8c1bb6c2856d service nova] [instance: 0e8a977c-aa84-47c4-a838-b5f90820de1a] No waiting events found dispatching network-vif-plugged-40e16d3f-2e2e-45df-be16-ef3622bfde2e {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:12:53 user nova-compute[71874]: WARNING nova.compute.manager [req-01329ff9-df0f-499a-86cc-2ab4596a9a42 req-38680ebc-fa0d-437e-9a95-8c1bb6c2856d service nova] [instance: 0e8a977c-aa84-47c4-a838-b5f90820de1a] Received unexpected event network-vif-plugged-40e16d3f-2e2e-45df-be16-ef3622bfde2e for instance with vm_state active and task_state rescuing.
Apr 12 16:12:53 user nova-compute[71874]: DEBUG nova.virt.libvirt.host [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Removed pending event for 0e8a977c-aa84-47c4-a838-b5f90820de1a due to event {{(pid=71874) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 12 16:12:53 user nova-compute[71874]: DEBUG nova.virt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Emitting event <LifecycleEvent: 1681315973.8859353, 0e8a977c-aa84-47c4-a838-b5f90820de1a => Resumed> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:12:53 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 0e8a977c-aa84-47c4-a838-b5f90820de1a] VM Resumed (Lifecycle Event)
Apr 12 16:12:53 user nova-compute[71874]: DEBUG nova.compute.manager [None req-83b90f89-2813-41d0-b4a0-2b09a8d1ef5d tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 0e8a977c-aa84-47c4-a838-b5f90820de1a] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:12:53 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 0e8a977c-aa84-47c4-a838-b5f90820de1a] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:12:53 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 0e8a977c-aa84-47c4-a838-b5f90820de1a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 16:12:53 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 0e8a977c-aa84-47c4-a838-b5f90820de1a] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 12 16:12:53 user nova-compute[71874]: DEBUG nova.virt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Emitting event <LifecycleEvent: 1681315973.8869567, 0e8a977c-aa84-47c4-a838-b5f90820de1a => Started> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:12:53 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 0e8a977c-aa84-47c4-a838-b5f90820de1a] VM Started (Lifecycle Event)
Apr 12 16:12:53 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 0e8a977c-aa84-47c4-a838-b5f90820de1a] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:12:53 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 0e8a977c-aa84-47c4-a838-b5f90820de1a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 16:12:55 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:12:58 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:12:59 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-7538ec02-09d8-4587-842b-2fdd5e6106fc tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:12:59 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-7538ec02-09d8-4587-842b-2fdd5e6106fc tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:12:59 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-7538ec02-09d8-4587-842b-2fdd5e6106fc tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:12:59 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-7538ec02-09d8-4587-842b-2fdd5e6106fc tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:12:59 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-7538ec02-09d8-4587-842b-2fdd5e6106fc tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:12:59 user nova-compute[71874]: INFO nova.compute.manager [None req-7538ec02-09d8-4587-842b-2fdd5e6106fc tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Terminating instance
Apr 12 16:12:59 user nova-compute[71874]: DEBUG nova.compute.manager [None req-7538ec02-09d8-4587-842b-2fdd5e6106fc tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Start destroying the instance on the hypervisor. {{(pid=71874) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 16:12:59 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:12:59 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:12:59 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:12:59 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:12:59 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:12:59 user nova-compute[71874]: DEBUG nova.compute.manager [req-ff55be40-d8da-4028-96cf-9b77a8e587d8 req-b02ee4b3-22ef-4c5c-b5ee-c0aef5b6687a service nova] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Received event network-vif-unplugged-18196ae0-d9c1-4814-8803-c4ba8ad4ab45 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:12:59 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-ff55be40-d8da-4028-96cf-9b77a8e587d8 req-b02ee4b3-22ef-4c5c-b5ee-c0aef5b6687a service nova] Acquiring lock "dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:12:59 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-ff55be40-d8da-4028-96cf-9b77a8e587d8 req-b02ee4b3-22ef-4c5c-b5ee-c0aef5b6687a service nova] Lock "dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:12:59 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-ff55be40-d8da-4028-96cf-9b77a8e587d8 req-b02ee4b3-22ef-4c5c-b5ee-c0aef5b6687a service nova] Lock "dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:12:59 user nova-compute[71874]: DEBUG nova.compute.manager [req-ff55be40-d8da-4028-96cf-9b77a8e587d8 req-b02ee4b3-22ef-4c5c-b5ee-c0aef5b6687a service nova] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] No waiting events found dispatching network-vif-unplugged-18196ae0-d9c1-4814-8803-c4ba8ad4ab45 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:12:59 user nova-compute[71874]: DEBUG nova.compute.manager [req-ff55be40-d8da-4028-96cf-9b77a8e587d8 req-b02ee4b3-22ef-4c5c-b5ee-c0aef5b6687a service nova] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Received event network-vif-unplugged-18196ae0-d9c1-4814-8803-c4ba8ad4ab45 for instance with task_state deleting. {{(pid=71874) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 16:12:59 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:13:00 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:13:00 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:13:00 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:13:00 user nova-compute[71874]: INFO nova.virt.libvirt.driver [-] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Instance destroyed successfully.
Apr 12 16:13:00 user nova-compute[71874]: DEBUG nova.objects.instance [None req-7538ec02-09d8-4587-842b-2fdd5e6106fc tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lazy-loading 'resources' on Instance uuid dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:13:00 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-7538ec02-09d8-4587-842b-2fdd5e6106fc tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-12T15:59:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1390712116',display_name='tempest-ServerActionsTestJSON-server-416657090',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1390712116',id=4,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNmXVADjvoPSh3uGCGCTNS/vcfcDtUjn/vZEaV3bCllfz1ZO8VIgFuZhP+mAsa+G/KA4ubi5U9Vj41YtHGsakdPR5VoByhorvfUv/PIWtER2tn1LWX2mlFyT+T8AEJplPw==',key_name='tempest-keypair-1923467613',keypairs=<?>,launch_index=0,launched_at=2023-04-12T16:10:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='97ea81bd1962466bbe552424973f71a8',ramdisk_id='',reservation_id='r-y3c7iw20',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-631887779',owner_user_name='tempest-ServerActionsTestJSON-631887779-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T16:10:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1a699b3ba8304eadb8a53d465ea340cf',uuid=dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "18196ae0-d9c1-4814-8803-c4ba8ad4ab45", "address": "fa:16:3e:98:72:fa", "network": {"id": "e6694358-e361-4952-b859-93755c11721e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-667152893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97ea81bd1962466bbe552424973f71a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18196ae0-d9", "ovs_interfaceid": "18196ae0-d9c1-4814-8803-c4ba8ad4ab45", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 16:13:00 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-7538ec02-09d8-4587-842b-2fdd5e6106fc tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Converting VIF {"id": "18196ae0-d9c1-4814-8803-c4ba8ad4ab45", "address": "fa:16:3e:98:72:fa", "network": {"id": "e6694358-e361-4952-b859-93755c11721e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-667152893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97ea81bd1962466bbe552424973f71a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18196ae0-d9", "ovs_interfaceid": "18196ae0-d9c1-4814-8803-c4ba8ad4ab45", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:13:00 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-7538ec02-09d8-4587-842b-2fdd5e6106fc tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:98:72:fa,bridge_name='br-int',has_traffic_filtering=True,id=18196ae0-d9c1-4814-8803-c4ba8ad4ab45,network=Network(e6694358-e361-4952-b859-93755c11721e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18196ae0-d9') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:13:00 user nova-compute[71874]: DEBUG os_vif [None req-7538ec02-09d8-4587-842b-2fdd5e6106fc tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:98:72:fa,bridge_name='br-int',has_traffic_filtering=True,id=18196ae0-d9c1-4814-8803-c4ba8ad4ab45,network=Network(e6694358-e361-4952-b859-93755c11721e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18196ae0-d9') {{(pid=71874) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 16:13:00 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:13:00 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap18196ae0-d9, bridge=br-int, if_exists=True) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:13:00 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:13:00 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:13:00 user nova-compute[71874]: INFO os_vif [None req-7538ec02-09d8-4587-842b-2fdd5e6106fc tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:98:72:fa,bridge_name='br-int',has_traffic_filtering=True,id=18196ae0-d9c1-4814-8803-c4ba8ad4ab45,network=Network(e6694358-e361-4952-b859-93755c11721e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18196ae0-d9')
Apr 12 16:13:00 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7538ec02-09d8-4587-842b-2fdd5e6106fc tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] calling os-brick to detach iSCSI Volume {{(pid=71874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 16:13:00 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-7538ec02-09d8-4587-842b-2fdd5e6106fc tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3c0216320>, {'target_iqn': 'iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RGWZNvlY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:13:00 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-7538ec02-09d8-4587-842b-2fdd5e6106fc tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:13:00 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-7538ec02-09d8-4587-842b-2fdd5e6106fc tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:13:00 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-7538ec02-09d8-4587-842b-2fdd5e6106fc tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:13:00 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:13:00 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:13:00 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[26745873-4e50-4d6d-ba92-741798b37f00]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1f27a002-8dfc-4d90-aa35-ba16586d4366\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ce38c1b3-35b0-48cc-9b83-e9a676997784\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:13:00 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-7538ec02-09d8-4587-842b-2fdd5e6106fc tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 16:13:00 user nova-compute[71874]: No targets found.
Apr 12 16:13:00 user nova-compute[71874]: iSNS:
Apr 12 16:13:00 user nova-compute[71874]: No targets found.
Apr 12 16:13:00 user nova-compute[71874]: STATIC:
Apr 12 16:13:00 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:1f27a002-8dfc-4d90-aa35-ba16586d4366
Apr 12 16:13:00 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:13:00 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:13:00 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:ce38c1b3-35b0-48cc-9b83-e9a676997784
Apr 12 16:13:00 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:13:00 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:13:00 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304
Apr 12 16:13:00 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:13:00 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:13:00 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297
Apr 12 16:13:00 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:13:00 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:13:00 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2
Apr 12 16:13:00 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:13:00 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:13:00 user nova-compute[71874]: FIRMWARE:
Apr 12 16:13:00 user nova-compute[71874]: No targets found.
Apr 12 16:13:00 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:13:00 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-7538ec02-09d8-4587-842b-2fdd5e6106fc tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 16:13:00 user nova-compute[71874]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 16:13:00 user nova-compute[71874]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71874) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 16:13:00 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-7538ec02-09d8-4587-842b-2fdd5e6106fc tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297', 0)] {{(pid=71874) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 16:13:00 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:13:00 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.038s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:13:00 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[85275778-213d-4fe1-8d07-c2fea148e4cf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1f27a002-8dfc-4d90-aa35-ba16586d4366\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ce38c1b3-35b0-48cc-9b83-e9a676997784\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:13:00 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:13:00 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:13:00 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[29f92af4-0c92-4e7a-aea7-27edbcf71cc9]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f27a002-8dfc-4d90-aa35-ba16586d4366 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce38c1b3-35b0-48cc-9b83-e9a676997784 (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:13:00 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-7538ec02-09d8-4587-842b-2fdd5e6106fc tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:13:00 user nova-compute[71874]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f27a002-8dfc-4d90-aa35-ba16586d4366 (non-flash)
Apr 12 16:13:00 user nova-compute[71874]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 (non-flash)
Apr 12 16:13:00 user nova-compute[71874]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304 (non-flash)
Apr 12 16:13:00 user nova-compute[71874]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce38c1b3-35b0-48cc-9b83-e9a676997784 (non-flash)
Apr 12 16:13:00 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:13:00 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-7538ec02-09d8-4587-842b-2fdd5e6106fc tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:13:00 user nova-compute[71874]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f27a002-8dfc-4d90-aa35-ba16586d4366 (non-flash)
Apr 12 16:13:00 user nova-compute[71874]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 (non-flash)
Apr 12 16:13:00 user nova-compute[71874]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304 (non-flash)
Apr 12 16:13:00 user nova-compute[71874]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce38c1b3-35b0-48cc-9b83-e9a676997784 (non-flash)
Apr 12 16:13:00 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:13:00 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-7538ec02-09d8-4587-842b-2fdd5e6106fc tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc39c202170>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297'): ({'sdc'}, set())}) {{(pid=71874) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 16:13:00 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-7538ec02-09d8-4587-842b-2fdd5e6106fc tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Removing single pathed devices sdc {{(pid=71874) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 16:13:00 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:13:00 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:13:00 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[87c61297-eaf6-411e-8bbc-f03dcbdcbb8f]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:13:00 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:13:00 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:13:00 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[36b9585f-6b2b-47e2-8a81-e80fb5248de5]: (4, ('ok\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:13:00 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-7538ec02-09d8-4587-842b-2fdd5e6106fc tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Flushing IO for device /dev/sdc {{(pid=71874) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 16:13:00 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:13:00 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:13:00 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc9ad8ab-4f88-4e51-bc22-a7b1ce8454fd]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:13:00 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-7538ec02-09d8-4587-842b-2fdd5e6106fc tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71874) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 16:13:00 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:13:00 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:13:00 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3a21795-da7e-4a0d-8406-688b515ea923]: (4, ('1', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:13:00 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-7538ec02-09d8-4587-842b-2fdd5e6106fc tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71874) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 16:13:00 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-7538ec02-09d8-4587-842b-2fdd5e6106fc tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] SCSI volumes sdc have been removed. {{(pid=71874) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 16:13:00 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-7538ec02-09d8-4587-842b-2fdd5e6106fc tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297')] {{(pid=71874) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 16:13:00 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:13:00 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:13:00 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[32d1dde5-e6a0-4d53-94ab-d195a17a204b]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:13:00 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-7538ec02-09d8-4587-842b-2fdd5e6106fc tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:13:00 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 -p 172.16.0.220:3260 --logout {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:13:00 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:13:00 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[0093c4ff-abe4-42b7-ac55-c309107ad25c]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:13:00 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-7538ec02-09d8-4587-842b-2fdd5e6106fc tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297, portal: 172.16.0.220,3260]
Apr 12 16:13:00 user nova-compute[71874]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297, portal: 172.16.0.220,3260] successful.
Apr 12 16:13:00 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:13:00 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 -p 172.16.0.220:3260 --op delete {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:13:00 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9baf883b-de18-43f0-a9d8-fc850bd83297 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:13:00 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[35455e87-fe5f-47f0-8298-9bce3e67fb73]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:13:00 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-7538ec02-09d8-4587-842b-2fdd5e6106fc tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:13:00 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-7538ec02-09d8-4587-842b-2fdd5e6106fc tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.365s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:13:00 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-7538ec02-09d8-4587-842b-2fdd5e6106fc tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] <== disconnect_volume: return (366ms) None {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:13:00 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7538ec02-09d8-4587-842b-2fdd5e6106fc tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Disconnected iSCSI Volume {{(pid=71874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 16:13:00 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-7538ec02-09d8-4587-842b-2fdd5e6106fc tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Deleting instance files /opt/stack/data/nova/instances/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1_del
Apr 12 16:13:00 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-7538ec02-09d8-4587-842b-2fdd5e6106fc tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Deletion of /opt/stack/data/nova/instances/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1_del complete
Apr 12 16:13:00 user nova-compute[71874]: INFO nova.compute.manager [None req-7538ec02-09d8-4587-842b-2fdd5e6106fc tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Took 1.33 seconds to destroy the instance on the hypervisor.
Apr 12 16:13:00 user nova-compute[71874]: DEBUG oslo.service.loopingcall [None req-7538ec02-09d8-4587-842b-2fdd5e6106fc tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71874) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 16:13:00 user nova-compute[71874]: DEBUG nova.compute.manager [-] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Deallocating network for instance {{(pid=71874) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 16:13:00 user nova-compute[71874]: DEBUG nova.network.neutron [-] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] deallocate_for_instance() {{(pid=71874) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 16:13:00 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:13:00 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:13:00 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:13:00 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:13:00 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:13:00 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:13:00 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:13:01 user nova-compute[71874]: DEBUG nova.network.neutron [-] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Updating instance_info_cache with network_info: [] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:13:01 user nova-compute[71874]: INFO nova.compute.manager [-] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Took 0.72 seconds to deallocate network for instance.
Apr 12 16:13:01 user nova-compute[71874]: DEBUG nova.compute.manager [req-64432aa4-123b-40af-9686-5e6a2c576e7c req-cdb44396-5e73-492a-ac31-f853b05d3d22 service nova] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Received event network-vif-deleted-18196ae0-d9c1-4814-8803-c4ba8ad4ab45 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:13:01 user nova-compute[71874]: INFO nova.compute.manager [req-64432aa4-123b-40af-9686-5e6a2c576e7c req-cdb44396-5e73-492a-ac31-f853b05d3d22 service nova] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Neutron deleted interface 18196ae0-d9c1-4814-8803-c4ba8ad4ab45; detaching it from the instance and deleting it from the info cache
Apr 12 16:13:01 user nova-compute[71874]: DEBUG nova.network.neutron [req-64432aa4-123b-40af-9686-5e6a2c576e7c req-cdb44396-5e73-492a-ac31-f853b05d3d22 service nova] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Updating instance_info_cache with network_info: [] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:13:01 user nova-compute[71874]: DEBUG nova.compute.manager [req-64432aa4-123b-40af-9686-5e6a2c576e7c req-cdb44396-5e73-492a-ac31-f853b05d3d22 service nova] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Detach interface failed, port_id=18196ae0-d9c1-4814-8803-c4ba8ad4ab45, reason: Instance dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 could not be found. {{(pid=71874) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 12 16:13:01 user nova-compute[71874]: DEBUG nova.compute.manager [req-202a8beb-3bdb-474f-8b6a-07959dc46cdc req-82744182-fcf3-4cf1-b505-14dbf4a90d1c service nova] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Received event network-vif-plugged-18196ae0-d9c1-4814-8803-c4ba8ad4ab45 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:13:01 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-202a8beb-3bdb-474f-8b6a-07959dc46cdc req-82744182-fcf3-4cf1-b505-14dbf4a90d1c service nova] Acquiring lock "dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:13:01 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-202a8beb-3bdb-474f-8b6a-07959dc46cdc req-82744182-fcf3-4cf1-b505-14dbf4a90d1c service nova] Lock "dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:13:01 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-202a8beb-3bdb-474f-8b6a-07959dc46cdc req-82744182-fcf3-4cf1-b505-14dbf4a90d1c service nova] Lock "dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:13:01 user nova-compute[71874]: DEBUG nova.compute.manager [req-202a8beb-3bdb-474f-8b6a-07959dc46cdc req-82744182-fcf3-4cf1-b505-14dbf4a90d1c service nova] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] No waiting events found dispatching network-vif-plugged-18196ae0-d9c1-4814-8803-c4ba8ad4ab45 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:13:01 user nova-compute[71874]: WARNING nova.compute.manager [req-202a8beb-3bdb-474f-8b6a-07959dc46cdc req-82744182-fcf3-4cf1-b505-14dbf4a90d1c service nova] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Received unexpected event network-vif-plugged-18196ae0-d9c1-4814-8803-c4ba8ad4ab45 for instance with vm_state active and task_state deleting.
Apr 12 16:13:01 user nova-compute[71874]: DEBUG nova.compute.manager [req-202a8beb-3bdb-474f-8b6a-07959dc46cdc req-82744182-fcf3-4cf1-b505-14dbf4a90d1c service nova] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Received event network-vif-plugged-18196ae0-d9c1-4814-8803-c4ba8ad4ab45 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:13:01 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-202a8beb-3bdb-474f-8b6a-07959dc46cdc req-82744182-fcf3-4cf1-b505-14dbf4a90d1c service nova] Acquiring lock "dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:13:01 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-202a8beb-3bdb-474f-8b6a-07959dc46cdc req-82744182-fcf3-4cf1-b505-14dbf4a90d1c service nova] Lock "dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:13:01 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-202a8beb-3bdb-474f-8b6a-07959dc46cdc req-82744182-fcf3-4cf1-b505-14dbf4a90d1c service nova] Lock "dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:13:01 user nova-compute[71874]: DEBUG nova.compute.manager [req-202a8beb-3bdb-474f-8b6a-07959dc46cdc req-82744182-fcf3-4cf1-b505-14dbf4a90d1c service nova] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] No waiting events found dispatching network-vif-plugged-18196ae0-d9c1-4814-8803-c4ba8ad4ab45 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:13:01 user nova-compute[71874]: WARNING nova.compute.manager [req-202a8beb-3bdb-474f-8b6a-07959dc46cdc req-82744182-fcf3-4cf1-b505-14dbf4a90d1c service nova] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Received unexpected event network-vif-plugged-18196ae0-d9c1-4814-8803-c4ba8ad4ab45 for instance with vm_state active and task_state deleting.
Apr 12 16:13:01 user nova-compute[71874]: DEBUG nova.compute.manager [req-202a8beb-3bdb-474f-8b6a-07959dc46cdc req-82744182-fcf3-4cf1-b505-14dbf4a90d1c service nova] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Received event network-vif-plugged-18196ae0-d9c1-4814-8803-c4ba8ad4ab45 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:13:01 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-202a8beb-3bdb-474f-8b6a-07959dc46cdc req-82744182-fcf3-4cf1-b505-14dbf4a90d1c service nova] Acquiring lock "dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:13:01 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-202a8beb-3bdb-474f-8b6a-07959dc46cdc req-82744182-fcf3-4cf1-b505-14dbf4a90d1c service nova] Lock "dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:13:01 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-202a8beb-3bdb-474f-8b6a-07959dc46cdc req-82744182-fcf3-4cf1-b505-14dbf4a90d1c service nova] Lock "dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:13:01 user nova-compute[71874]: DEBUG nova.compute.manager [req-202a8beb-3bdb-474f-8b6a-07959dc46cdc req-82744182-fcf3-4cf1-b505-14dbf4a90d1c service nova] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] No waiting events found dispatching network-vif-plugged-18196ae0-d9c1-4814-8803-c4ba8ad4ab45 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:13:01 user nova-compute[71874]: WARNING nova.compute.manager [req-202a8beb-3bdb-474f-8b6a-07959dc46cdc req-82744182-fcf3-4cf1-b505-14dbf4a90d1c service nova] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Received unexpected event network-vif-plugged-18196ae0-d9c1-4814-8803-c4ba8ad4ab45 for instance with vm_state active and task_state deleting.
Apr 12 16:13:01 user nova-compute[71874]: DEBUG nova.compute.manager [req-202a8beb-3bdb-474f-8b6a-07959dc46cdc req-82744182-fcf3-4cf1-b505-14dbf4a90d1c service nova] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Received event network-vif-unplugged-18196ae0-d9c1-4814-8803-c4ba8ad4ab45 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:13:01 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-202a8beb-3bdb-474f-8b6a-07959dc46cdc req-82744182-fcf3-4cf1-b505-14dbf4a90d1c service nova] Acquiring lock "dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:13:01 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-202a8beb-3bdb-474f-8b6a-07959dc46cdc req-82744182-fcf3-4cf1-b505-14dbf4a90d1c service nova] Lock "dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:13:01 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-202a8beb-3bdb-474f-8b6a-07959dc46cdc req-82744182-fcf3-4cf1-b505-14dbf4a90d1c service nova] Lock "dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:13:01 user nova-compute[71874]: DEBUG nova.compute.manager [req-202a8beb-3bdb-474f-8b6a-07959dc46cdc req-82744182-fcf3-4cf1-b505-14dbf4a90d1c service nova] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] No waiting events found dispatching network-vif-unplugged-18196ae0-d9c1-4814-8803-c4ba8ad4ab45 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:13:01 user nova-compute[71874]: DEBUG nova.compute.manager [req-202a8beb-3bdb-474f-8b6a-07959dc46cdc req-82744182-fcf3-4cf1-b505-14dbf4a90d1c service nova] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Received event network-vif-unplugged-18196ae0-d9c1-4814-8803-c4ba8ad4ab45 for instance with task_state deleting. {{(pid=71874) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 16:13:01 user nova-compute[71874]: DEBUG nova.compute.manager [req-202a8beb-3bdb-474f-8b6a-07959dc46cdc req-82744182-fcf3-4cf1-b505-14dbf4a90d1c service nova] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Received event network-vif-plugged-18196ae0-d9c1-4814-8803-c4ba8ad4ab45 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:13:01 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-202a8beb-3bdb-474f-8b6a-07959dc46cdc req-82744182-fcf3-4cf1-b505-14dbf4a90d1c service nova] Acquiring lock "dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:13:01 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-202a8beb-3bdb-474f-8b6a-07959dc46cdc req-82744182-fcf3-4cf1-b505-14dbf4a90d1c service nova] Lock "dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:13:01 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-202a8beb-3bdb-474f-8b6a-07959dc46cdc req-82744182-fcf3-4cf1-b505-14dbf4a90d1c service nova] Lock "dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:13:01 user nova-compute[71874]: DEBUG nova.compute.manager [req-202a8beb-3bdb-474f-8b6a-07959dc46cdc req-82744182-fcf3-4cf1-b505-14dbf4a90d1c service nova] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] No waiting events found dispatching network-vif-plugged-18196ae0-d9c1-4814-8803-c4ba8ad4ab45 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:13:01 user nova-compute[71874]: WARNING nova.compute.manager [req-202a8beb-3bdb-474f-8b6a-07959dc46cdc req-82744182-fcf3-4cf1-b505-14dbf4a90d1c service nova] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Received unexpected event network-vif-plugged-18196ae0-d9c1-4814-8803-c4ba8ad4ab45 for instance with vm_state active and task_state deleting.
Apr 12 16:13:02 user nova-compute[71874]: INFO nova.compute.manager [None req-7538ec02-09d8-4587-842b-2fdd5e6106fc tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Took 0.77 seconds to detach 1 volumes for instance.
Apr 12 16:13:02 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-7538ec02-09d8-4587-842b-2fdd5e6106fc tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:13:02 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-7538ec02-09d8-4587-842b-2fdd5e6106fc tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:13:02 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-7538ec02-09d8-4587-842b-2fdd5e6106fc tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Inventory has not changed in ProviderTree for provider: 0e94b4c8-cd49-45e4-9133-d36eb4b2456b {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 16:13:02 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-7538ec02-09d8-4587-842b-2fdd5e6106fc tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Inventory has not changed for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 16:13:02 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-7538ec02-09d8-4587-842b-2fdd5e6106fc tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.395s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:13:02 user nova-compute[71874]: INFO nova.scheduler.client.report [None req-7538ec02-09d8-4587-842b-2fdd5e6106fc tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Deleted allocations for instance dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1
Apr 12 16:13:02 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-7538ec02-09d8-4587-842b-2fdd5e6106fc tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.463s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:13:03 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:13:05 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:13:05 user nova-compute[71874]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681315970.3735542, f2511c44-8365-4e8c-9814-172547111b9f => Stopped> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:13:05 user nova-compute[71874]: INFO nova.compute.manager [-] [instance: f2511c44-8365-4e8c-9814-172547111b9f] VM Stopped (Lifecycle Event)
Apr 12 16:13:05 user nova-compute[71874]: DEBUG nova.compute.manager [None req-b61bbdc7-4239-45a8-8ce1-e1c0032cee80 None None] [instance: f2511c44-8365-4e8c-9814-172547111b9f] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:13:08 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:13:08 user nova-compute[71874]: DEBUG nova.compute.manager [req-ed8c5228-d87b-4eda-891b-654e4f7e6ac5 req-18a1e90a-c7a5-4bd1-b0cb-12ad4884afd4 service nova] [instance: c307e623-c546-487f-ac16-5eb24d088e8a] Received event network-changed-b6291ae2-bc79-4a35-a160-bff95fae3e8f {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:13:08 user nova-compute[71874]: DEBUG nova.compute.manager [req-ed8c5228-d87b-4eda-891b-654e4f7e6ac5 req-18a1e90a-c7a5-4bd1-b0cb-12ad4884afd4 service nova] [instance: c307e623-c546-487f-ac16-5eb24d088e8a] Refreshing instance network info cache due to event network-changed-b6291ae2-bc79-4a35-a160-bff95fae3e8f. {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 16:13:08 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-ed8c5228-d87b-4eda-891b-654e4f7e6ac5 req-18a1e90a-c7a5-4bd1-b0cb-12ad4884afd4 service nova] Acquiring lock "refresh_cache-c307e623-c546-487f-ac16-5eb24d088e8a" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:13:08 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-ed8c5228-d87b-4eda-891b-654e4f7e6ac5 req-18a1e90a-c7a5-4bd1-b0cb-12ad4884afd4 service nova] Acquired lock "refresh_cache-c307e623-c546-487f-ac16-5eb24d088e8a" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:13:08 user nova-compute[71874]: DEBUG nova.network.neutron [req-ed8c5228-d87b-4eda-891b-654e4f7e6ac5 req-18a1e90a-c7a5-4bd1-b0cb-12ad4884afd4 service nova] [instance: c307e623-c546-487f-ac16-5eb24d088e8a] Refreshing network info cache for port b6291ae2-bc79-4a35-a160-bff95fae3e8f {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 16:13:08 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-6445f194-85c4-4bc0-b5b0-5424e4bb413b tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Acquiring lock "c307e623-c546-487f-ac16-5eb24d088e8a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:13:08 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-6445f194-85c4-4bc0-b5b0-5424e4bb413b tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lock "c307e623-c546-487f-ac16-5eb24d088e8a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:13:08 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-6445f194-85c4-4bc0-b5b0-5424e4bb413b tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Acquiring lock "c307e623-c546-487f-ac16-5eb24d088e8a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:13:08 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-6445f194-85c4-4bc0-b5b0-5424e4bb413b tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lock "c307e623-c546-487f-ac16-5eb24d088e8a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:13:08 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-6445f194-85c4-4bc0-b5b0-5424e4bb413b tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lock "c307e623-c546-487f-ac16-5eb24d088e8a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:13:08 user nova-compute[71874]: INFO nova.compute.manager [None req-6445f194-85c4-4bc0-b5b0-5424e4bb413b tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] [instance: c307e623-c546-487f-ac16-5eb24d088e8a] Terminating instance
Apr 12 16:13:08 user nova-compute[71874]: DEBUG nova.compute.manager [None req-6445f194-85c4-4bc0-b5b0-5424e4bb413b tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] [instance: c307e623-c546-487f-ac16-5eb24d088e8a] Start destroying the instance on the hypervisor. {{(pid=71874) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 16:13:08 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:13:08 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:13:09 user nova-compute[71874]: DEBUG nova.compute.manager [req-7a1aa90e-eaae-475f-9622-f4224fadcd97 req-87fee70a-ee4e-402d-9fa8-b06055cf2f30 service nova] [instance: c307e623-c546-487f-ac16-5eb24d088e8a] Received event network-vif-unplugged-b6291ae2-bc79-4a35-a160-bff95fae3e8f {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:13:09 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-7a1aa90e-eaae-475f-9622-f4224fadcd97 req-87fee70a-ee4e-402d-9fa8-b06055cf2f30 service nova] Acquiring lock "c307e623-c546-487f-ac16-5eb24d088e8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:13:09 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-7a1aa90e-eaae-475f-9622-f4224fadcd97 req-87fee70a-ee4e-402d-9fa8-b06055cf2f30 service nova] Lock "c307e623-c546-487f-ac16-5eb24d088e8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:13:09 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-7a1aa90e-eaae-475f-9622-f4224fadcd97 req-87fee70a-ee4e-402d-9fa8-b06055cf2f30 service nova] Lock "c307e623-c546-487f-ac16-5eb24d088e8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:13:09 user nova-compute[71874]: DEBUG nova.compute.manager [req-7a1aa90e-eaae-475f-9622-f4224fadcd97 req-87fee70a-ee4e-402d-9fa8-b06055cf2f30 service nova] [instance: c307e623-c546-487f-ac16-5eb24d088e8a] No waiting events found dispatching network-vif-unplugged-b6291ae2-bc79-4a35-a160-bff95fae3e8f {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:13:09 user nova-compute[71874]: DEBUG nova.compute.manager [req-7a1aa90e-eaae-475f-9622-f4224fadcd97 req-87fee70a-ee4e-402d-9fa8-b06055cf2f30 service nova] [instance: c307e623-c546-487f-ac16-5eb24d088e8a] Received event network-vif-unplugged-b6291ae2-bc79-4a35-a160-bff95fae3e8f for instance with task_state deleting. {{(pid=71874) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 16:13:09 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:13:09 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:13:09 user nova-compute[71874]: DEBUG nova.network.neutron [req-ed8c5228-d87b-4eda-891b-654e4f7e6ac5 req-18a1e90a-c7a5-4bd1-b0cb-12ad4884afd4 service nova] [instance: c307e623-c546-487f-ac16-5eb24d088e8a] Updated VIF entry in instance network info cache for port b6291ae2-bc79-4a35-a160-bff95fae3e8f. {{(pid=71874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 16:13:09 user nova-compute[71874]: DEBUG nova.network.neutron [req-ed8c5228-d87b-4eda-891b-654e4f7e6ac5 req-18a1e90a-c7a5-4bd1-b0cb-12ad4884afd4 service nova] [instance: c307e623-c546-487f-ac16-5eb24d088e8a] Updating instance_info_cache with network_info: [{"id": "b6291ae2-bc79-4a35-a160-bff95fae3e8f", "address": "fa:16:3e:9c:67:25", "network": {"id": "1c560b5e-bb6f-42eb-b9b2-6b3f2eaed0f8", "bridge": "br-int", "label": "tempest-TestStampPattern-1356757354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a77372a5e83c4fc882b0a0b0eea46f06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6291ae2-bc", "ovs_interfaceid": "b6291ae2-bc79-4a35-a160-bff95fae3e8f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:13:09 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-ed8c5228-d87b-4eda-891b-654e4f7e6ac5 req-18a1e90a-c7a5-4bd1-b0cb-12ad4884afd4 service nova] Releasing lock "refresh_cache-c307e623-c546-487f-ac16-5eb24d088e8a" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:13:09 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:13:09 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:13:09 user nova-compute[71874]: INFO nova.virt.libvirt.driver [-] [instance: c307e623-c546-487f-ac16-5eb24d088e8a] Instance destroyed successfully.
Apr 12 16:13:09 user nova-compute[71874]: DEBUG nova.objects.instance [None req-6445f194-85c4-4bc0-b5b0-5424e4bb413b tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lazy-loading 'resources' on Instance uuid c307e623-c546-487f-ac16-5eb24d088e8a {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:13:09 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-6445f194-85c4-4bc0-b5b0-5424e4bb413b tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T16:10:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-996381593',display_name='tempest-TestStampPattern-server-996381593',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-996381593',id=29,image_ref='6c9c5a01-7bd3-4f1f-b219-5ed4224fd354',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM9rCdORWoFaEzbUsNhuoBFSyjDv4K5w82ZJzoi+0Rba6d3tv8xkR5nGe+5wcm9lUrYy4FRmQCBzLyX7FSGTRKcYmN9F41l7pVMhhHvTYmD+PQt4JX5BTIQ1nRCFqJvvxg==',key_name='tempest-TestStampPattern-1321754823',keypairs=<?>,launch_index=0,launched_at=2023-04-12T16:10:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a77372a5e83c4fc882b0a0b0eea46f06',ramdisk_id='',reservation_id='r-pe7g4nqp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='78b6940a-f97a-4535-8973-3c2a5befbbab',image_min_disk='1',image_min_ram='0',image_owner_id='a77372a5e83c4fc882b0a0b0eea46f06',image_owner_project_name='tempest-TestStampPattern-1256589700',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1256589700-project-member',image_user_id='5e0ffc0972674609b17fe2780751dfc5',owner_project_name='tempest-TestStampPattern-1256589700',owner_user_name='tempest-TestStampPattern-1256589700-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T16:10:28Z,user_data=None,user_id='5e0ffc0972674609b17fe2780751dfc5',uuid=c307e623-c546-487f-ac16-5eb24d088e8a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b6291ae2-bc79-4a35-a160-bff95fae3e8f", "address": "fa:16:3e:9c:67:25", "network": {"id": "1c560b5e-bb6f-42eb-b9b2-6b3f2eaed0f8", "bridge": "br-int", "label": "tempest-TestStampPattern-1356757354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a77372a5e83c4fc882b0a0b0eea46f06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6291ae2-bc", "ovs_interfaceid": "b6291ae2-bc79-4a35-a160-bff95fae3e8f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 16:13:09 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-6445f194-85c4-4bc0-b5b0-5424e4bb413b tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Converting VIF {"id": "b6291ae2-bc79-4a35-a160-bff95fae3e8f", "address": "fa:16:3e:9c:67:25", "network": {"id": "1c560b5e-bb6f-42eb-b9b2-6b3f2eaed0f8", "bridge": "br-int", "label": "tempest-TestStampPattern-1356757354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a77372a5e83c4fc882b0a0b0eea46f06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6291ae2-bc", "ovs_interfaceid": "b6291ae2-bc79-4a35-a160-bff95fae3e8f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:13:09 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-6445f194-85c4-4bc0-b5b0-5424e4bb413b tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9c:67:25,bridge_name='br-int',has_traffic_filtering=True,id=b6291ae2-bc79-4a35-a160-bff95fae3e8f,network=Network(1c560b5e-bb6f-42eb-b9b2-6b3f2eaed0f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6291ae2-bc') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:13:09 user nova-compute[71874]: DEBUG os_vif [None req-6445f194-85c4-4bc0-b5b0-5424e4bb413b tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9c:67:25,bridge_name='br-int',has_traffic_filtering=True,id=b6291ae2-bc79-4a35-a160-bff95fae3e8f,network=Network(1c560b5e-bb6f-42eb-b9b2-6b3f2eaed0f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6291ae2-bc') {{(pid=71874) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 16:13:09 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:13:09 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb6291ae2-bc, bridge=br-int, if_exists=True) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:13:09 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:13:09 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:13:09 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:13:09 user nova-compute[71874]: INFO os_vif [None req-6445f194-85c4-4bc0-b5b0-5424e4bb413b tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9c:67:25,bridge_name='br-int',has_traffic_filtering=True,id=b6291ae2-bc79-4a35-a160-bff95fae3e8f,network=Network(1c560b5e-bb6f-42eb-b9b2-6b3f2eaed0f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6291ae2-bc')
Apr 12 16:13:09 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-6445f194-85c4-4bc0-b5b0-5424e4bb413b tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] [instance: c307e623-c546-487f-ac16-5eb24d088e8a] Deleting instance files /opt/stack/data/nova/instances/c307e623-c546-487f-ac16-5eb24d088e8a_del
Apr 12 16:13:09 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-6445f194-85c4-4bc0-b5b0-5424e4bb413b tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] [instance: c307e623-c546-487f-ac16-5eb24d088e8a] Deletion of /opt/stack/data/nova/instances/c307e623-c546-487f-ac16-5eb24d088e8a_del complete
Apr 12 16:13:09 user nova-compute[71874]: INFO nova.compute.manager [None req-6445f194-85c4-4bc0-b5b0-5424e4bb413b tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] [instance: c307e623-c546-487f-ac16-5eb24d088e8a] Took 0.88 seconds to destroy the instance on the hypervisor.
Apr 12 16:13:09 user nova-compute[71874]: DEBUG oslo.service.loopingcall [None req-6445f194-85c4-4bc0-b5b0-5424e4bb413b tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71874) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 16:13:09 user nova-compute[71874]: DEBUG nova.compute.manager [-] [instance: c307e623-c546-487f-ac16-5eb24d088e8a] Deallocating network for instance {{(pid=71874) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 16:13:09 user nova-compute[71874]: DEBUG nova.network.neutron [-] [instance: c307e623-c546-487f-ac16-5eb24d088e8a] deallocate_for_instance() {{(pid=71874) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 16:13:10 user nova-compute[71874]: DEBUG nova.network.neutron [-] [instance: c307e623-c546-487f-ac16-5eb24d088e8a] Updating instance_info_cache with network_info: [] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:13:10 user nova-compute[71874]: INFO nova.compute.manager [-] [instance: c307e623-c546-487f-ac16-5eb24d088e8a] Took 0.49 seconds to deallocate network for instance.
Apr 12 16:13:10 user nova-compute[71874]: DEBUG nova.compute.manager [req-6f01df38-86b3-4d4e-9480-52c68da1f96c req-ace276d6-bd6f-475a-8389-c5f8cdf6fab9 service nova] [instance: c307e623-c546-487f-ac16-5eb24d088e8a] Received event network-vif-deleted-b6291ae2-bc79-4a35-a160-bff95fae3e8f {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:13:10 user nova-compute[71874]: INFO nova.compute.manager [req-6f01df38-86b3-4d4e-9480-52c68da1f96c req-ace276d6-bd6f-475a-8389-c5f8cdf6fab9 service nova] [instance: c307e623-c546-487f-ac16-5eb24d088e8a] Neutron deleted interface b6291ae2-bc79-4a35-a160-bff95fae3e8f; detaching it from the instance and deleting it from the info cache
Apr 12 16:13:10 user nova-compute[71874]: DEBUG nova.network.neutron [req-6f01df38-86b3-4d4e-9480-52c68da1f96c req-ace276d6-bd6f-475a-8389-c5f8cdf6fab9 service nova] [instance: c307e623-c546-487f-ac16-5eb24d088e8a] Updating instance_info_cache with network_info: [] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:13:10 user nova-compute[71874]: DEBUG nova.compute.manager [req-6f01df38-86b3-4d4e-9480-52c68da1f96c req-ace276d6-bd6f-475a-8389-c5f8cdf6fab9 service nova] [instance: c307e623-c546-487f-ac16-5eb24d088e8a] Detach interface failed, port_id=b6291ae2-bc79-4a35-a160-bff95fae3e8f, reason: Instance c307e623-c546-487f-ac16-5eb24d088e8a could not be found. {{(pid=71874) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 12 16:13:10 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-6445f194-85c4-4bc0-b5b0-5424e4bb413b tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:13:10 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-6445f194-85c4-4bc0-b5b0-5424e4bb413b tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:13:10 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-6445f194-85c4-4bc0-b5b0-5424e4bb413b tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Inventory has not changed in ProviderTree for provider: 0e94b4c8-cd49-45e4-9133-d36eb4b2456b {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 16:13:10 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-6445f194-85c4-4bc0-b5b0-5424e4bb413b tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Inventory has not changed for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 16:13:10 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-6445f194-85c4-4bc0-b5b0-5424e4bb413b tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.363s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:13:10 user nova-compute[71874]: INFO nova.scheduler.client.report [None req-6445f194-85c4-4bc0-b5b0-5424e4bb413b tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Deleted allocations for instance c307e623-c546-487f-ac16-5eb24d088e8a
Apr 12 16:13:10 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-6445f194-85c4-4bc0-b5b0-5424e4bb413b tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lock "c307e623-c546-487f-ac16-5eb24d088e8a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.911s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:13:11 user nova-compute[71874]: DEBUG nova.compute.manager [req-0e61e53d-c0dc-4763-9390-d4546cb6bc62 req-fcad05f7-4496-4a0d-82a4-2939d78c2341 service nova] [instance: c307e623-c546-487f-ac16-5eb24d088e8a] Received event network-vif-plugged-b6291ae2-bc79-4a35-a160-bff95fae3e8f {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:13:11 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-0e61e53d-c0dc-4763-9390-d4546cb6bc62 req-fcad05f7-4496-4a0d-82a4-2939d78c2341 service nova] Acquiring lock "c307e623-c546-487f-ac16-5eb24d088e8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:13:11 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-0e61e53d-c0dc-4763-9390-d4546cb6bc62 req-fcad05f7-4496-4a0d-82a4-2939d78c2341 service nova] Lock "c307e623-c546-487f-ac16-5eb24d088e8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:13:11 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-0e61e53d-c0dc-4763-9390-d4546cb6bc62 req-fcad05f7-4496-4a0d-82a4-2939d78c2341 service nova] Lock "c307e623-c546-487f-ac16-5eb24d088e8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:13:11 user nova-compute[71874]: DEBUG nova.compute.manager [req-0e61e53d-c0dc-4763-9390-d4546cb6bc62 req-fcad05f7-4496-4a0d-82a4-2939d78c2341 service nova] [instance: c307e623-c546-487f-ac16-5eb24d088e8a] No waiting events found dispatching network-vif-plugged-b6291ae2-bc79-4a35-a160-bff95fae3e8f {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:13:11 user nova-compute[71874]: WARNING nova.compute.manager [req-0e61e53d-c0dc-4763-9390-d4546cb6bc62 req-fcad05f7-4496-4a0d-82a4-2939d78c2341 service nova] [instance: c307e623-c546-487f-ac16-5eb24d088e8a] Received unexpected event network-vif-plugged-b6291ae2-bc79-4a35-a160-bff95fae3e8f for instance with vm_state deleted and task_state None.
Apr 12 16:13:13 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:13:14 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:13:15 user nova-compute[71874]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681315980.0850995, dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 => Stopped> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:13:15 user nova-compute[71874]: INFO nova.compute.manager [-] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] VM Stopped (Lifecycle Event)
Apr 12 16:13:15 user nova-compute[71874]: DEBUG nova.compute.manager [None req-5ddb47ba-d996-459f-9c3f-ae61914cfd3f None None] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:13:18 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:13:19 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:13:21 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-3d51ac07-efb0-40ea-9d1b-f6176c72d1c5 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Acquiring lock "84683344-2893-4446-90ae-e64cd799eb20" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:13:21 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-3d51ac07-efb0-40ea-9d1b-f6176c72d1c5 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "84683344-2893-4446-90ae-e64cd799eb20" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:13:21 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-3d51ac07-efb0-40ea-9d1b-f6176c72d1c5 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Acquiring lock "84683344-2893-4446-90ae-e64cd799eb20-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:13:21 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-3d51ac07-efb0-40ea-9d1b-f6176c72d1c5 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "84683344-2893-4446-90ae-e64cd799eb20-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:13:21 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-3d51ac07-efb0-40ea-9d1b-f6176c72d1c5 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "84683344-2893-4446-90ae-e64cd799eb20-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:13:21 user nova-compute[71874]: INFO nova.compute.manager [None req-3d51ac07-efb0-40ea-9d1b-f6176c72d1c5 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: 84683344-2893-4446-90ae-e64cd799eb20] Terminating instance
Apr 12 16:13:21 user nova-compute[71874]: DEBUG nova.compute.manager [None req-3d51ac07-efb0-40ea-9d1b-f6176c72d1c5 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: 84683344-2893-4446-90ae-e64cd799eb20] Start destroying the instance on the hypervisor. {{(pid=71874) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 16:13:21 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:13:21 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:13:21 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:13:21 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:13:21 user nova-compute[71874]: DEBUG nova.compute.manager [req-6d4a4e42-d365-4109-be8d-cb9e793e81cd req-4ef65673-85df-449d-8675-48140d8b806c service nova] [instance: 84683344-2893-4446-90ae-e64cd799eb20] Received event network-vif-unplugged-a8837af3-03f7-4b3d-8a2a-746f2d8038ad {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:13:21 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-6d4a4e42-d365-4109-be8d-cb9e793e81cd req-4ef65673-85df-449d-8675-48140d8b806c service nova] Acquiring lock "84683344-2893-4446-90ae-e64cd799eb20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:13:21 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-6d4a4e42-d365-4109-be8d-cb9e793e81cd req-4ef65673-85df-449d-8675-48140d8b806c service nova] Lock "84683344-2893-4446-90ae-e64cd799eb20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:13:21 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-6d4a4e42-d365-4109-be8d-cb9e793e81cd req-4ef65673-85df-449d-8675-48140d8b806c service nova] Lock "84683344-2893-4446-90ae-e64cd799eb20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:13:21 user nova-compute[71874]: DEBUG nova.compute.manager [req-6d4a4e42-d365-4109-be8d-cb9e793e81cd req-4ef65673-85df-449d-8675-48140d8b806c service nova] [instance: 84683344-2893-4446-90ae-e64cd799eb20] No waiting events found dispatching network-vif-unplugged-a8837af3-03f7-4b3d-8a2a-746f2d8038ad {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:13:21 user nova-compute[71874]: DEBUG nova.compute.manager [req-6d4a4e42-d365-4109-be8d-cb9e793e81cd req-4ef65673-85df-449d-8675-48140d8b806c service nova] [instance: 84683344-2893-4446-90ae-e64cd799eb20] Received event network-vif-unplugged-a8837af3-03f7-4b3d-8a2a-746f2d8038ad for instance with task_state deleting. {{(pid=71874) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 16:13:22 user nova-compute[71874]: INFO nova.virt.libvirt.driver [-] [instance: 84683344-2893-4446-90ae-e64cd799eb20] Instance destroyed successfully.
Apr 12 16:13:22 user nova-compute[71874]: DEBUG nova.objects.instance [None req-3d51ac07-efb0-40ea-9d1b-f6176c72d1c5 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lazy-loading 'resources' on Instance uuid 84683344-2893-4446-90ae-e64cd799eb20 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:13:22 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-3d51ac07-efb0-40ea-9d1b-f6176c72d1c5 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T16:08:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-305874148',display_name='tempest-TestMinimumBasicScenario-server-305874148',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-305874148',id=27,image_ref='ca200f21-67f7-4581-9bfc-75465abff368',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP7vpIGcBykOJPr4ws0YtRwaxvjbKaTb5FQPV2F4kO1x9IPpUHiVmLwjEQx1FAApeD4swefMBOlg2jRi0dXdP+/5EMUIcDTR0iUGAbkMPwCdxqyQhFvFmsSM0dq+TS03mg==',key_name='tempest-TestMinimumBasicScenario-1145355827',keypairs=<?>,launch_index=0,launched_at=2023-04-12T16:08:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='236b9e609eb44071bc88971bff96931e',ramdisk_id='',reservation_id='r-i04av21o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca200f21-67f7-4581-9bfc-75465abff368',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1374695003',owner_user_name='tempest-TestMinimumBasicScenario-1374695003-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T16:10:44Z,user_data=None,user_id='16a68fa3490940ebaebc8d4ca5746f6e',uuid=84683344-2893-4446-90ae-e64cd799eb20,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a8837af3-03f7-4b3d-8a2a-746f2d8038ad", "address": "fa:16:3e:71:77:df", "network": {"id": "58f92787-e3b6-4fd3-bd75-7169f1a36651", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-614349033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "236b9e609eb44071bc88971bff96931e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8837af3-03", "ovs_interfaceid": "a8837af3-03f7-4b3d-8a2a-746f2d8038ad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 16:13:22 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-3d51ac07-efb0-40ea-9d1b-f6176c72d1c5 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Converting VIF {"id": "a8837af3-03f7-4b3d-8a2a-746f2d8038ad", "address": "fa:16:3e:71:77:df", "network": {"id": "58f92787-e3b6-4fd3-bd75-7169f1a36651", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-614349033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "236b9e609eb44071bc88971bff96931e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8837af3-03", "ovs_interfaceid": "a8837af3-03f7-4b3d-8a2a-746f2d8038ad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:13:22 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-3d51ac07-efb0-40ea-9d1b-f6176c72d1c5 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:71:77:df,bridge_name='br-int',has_traffic_filtering=True,id=a8837af3-03f7-4b3d-8a2a-746f2d8038ad,network=Network(58f92787-e3b6-4fd3-bd75-7169f1a36651),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8837af3-03') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:13:22 user nova-compute[71874]: DEBUG os_vif [None req-3d51ac07-efb0-40ea-9d1b-f6176c72d1c5 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:71:77:df,bridge_name='br-int',has_traffic_filtering=True,id=a8837af3-03f7-4b3d-8a2a-746f2d8038ad,network=Network(58f92787-e3b6-4fd3-bd75-7169f1a36651),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8837af3-03') {{(pid=71874) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 16:13:22 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:13:22 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa8837af3-03, bridge=br-int, if_exists=True) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:13:22 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:13:22 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:13:22 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:13:22 user nova-compute[71874]: INFO os_vif [None req-3d51ac07-efb0-40ea-9d1b-f6176c72d1c5 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:71:77:df,bridge_name='br-int',has_traffic_filtering=True,id=a8837af3-03f7-4b3d-8a2a-746f2d8038ad,network=Network(58f92787-e3b6-4fd3-bd75-7169f1a36651),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8837af3-03')
Apr 12 16:13:22 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-3d51ac07-efb0-40ea-9d1b-f6176c72d1c5 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: 84683344-2893-4446-90ae-e64cd799eb20] Deleting instance files /opt/stack/data/nova/instances/84683344-2893-4446-90ae-e64cd799eb20_del
Apr 12 16:13:22 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-3d51ac07-efb0-40ea-9d1b-f6176c72d1c5 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: 84683344-2893-4446-90ae-e64cd799eb20] Deletion of /opt/stack/data/nova/instances/84683344-2893-4446-90ae-e64cd799eb20_del complete
Apr 12 16:13:22 user nova-compute[71874]: INFO nova.compute.manager [None req-3d51ac07-efb0-40ea-9d1b-f6176c72d1c5 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: 84683344-2893-4446-90ae-e64cd799eb20] Took 0.92 seconds to destroy the instance on the hypervisor.
Apr 12 16:13:22 user nova-compute[71874]: DEBUG oslo.service.loopingcall [None req-3d51ac07-efb0-40ea-9d1b-f6176c72d1c5 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71874) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 16:13:22 user nova-compute[71874]: DEBUG nova.compute.manager [-] [instance: 84683344-2893-4446-90ae-e64cd799eb20] Deallocating network for instance {{(pid=71874) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 16:13:22 user nova-compute[71874]: DEBUG nova.network.neutron [-] [instance: 84683344-2893-4446-90ae-e64cd799eb20] deallocate_for_instance() {{(pid=71874) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 16:13:22 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:13:22 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:13:22 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:13:22 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:13:22 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:13:22 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Auditing locally available compute resources for user (node: user) {{(pid=71874) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 16:13:22 user nova-compute[71874]: DEBUG nova.network.neutron [-] [instance: 84683344-2893-4446-90ae-e64cd799eb20] Updating instance_info_cache with network_info: [] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:13:22 user nova-compute[71874]: INFO nova.compute.manager [-] [instance: 84683344-2893-4446-90ae-e64cd799eb20] Took 0.51 seconds to deallocate network for instance.
Apr 12 16:13:23 user nova-compute[71874]: DEBUG nova.compute.manager [req-05432f59-1d28-437a-a05c-04820a345b2b req-2473d0aa-d41a-4838-9dd2-4fde9db218fa service nova] [instance: 84683344-2893-4446-90ae-e64cd799eb20] Received event network-vif-deleted-a8837af3-03f7-4b3d-8a2a-746f2d8038ad {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:13:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f641c6b-b508-42a7-ae98-c2bfb841d798/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:13:23 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-3d51ac07-efb0-40ea-9d1b-f6176c72d1c5 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:13:23 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-3d51ac07-efb0-40ea-9d1b-f6176c72d1c5 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:13:23 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:13:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f641c6b-b508-42a7-ae98-c2bfb841d798/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:13:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f641c6b-b508-42a7-ae98-c2bfb841d798/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:13:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f641c6b-b508-42a7-ae98-c2bfb841d798/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:13:23 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=71874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 16:13:23 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 16:13:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473a30c4-5aa4-481c-8859-fda815d14872/disk.rescue --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:13:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473a30c4-5aa4-481c-8859-fda815d14872/disk.rescue --force-share --output=json" returned: 0 in 0.156s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:13:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473a30c4-5aa4-481c-8859-fda815d14872/disk.rescue --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:13:23 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-3d51ac07-efb0-40ea-9d1b-f6176c72d1c5 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Inventory has not changed in ProviderTree for provider: 0e94b4c8-cd49-45e4-9133-d36eb4b2456b {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 16:13:23 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-3d51ac07-efb0-40ea-9d1b-f6176c72d1c5 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Inventory has not changed for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 16:13:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473a30c4-5aa4-481c-8859-fda815d14872/disk.rescue --force-share --output=json" returned: 0 in 0.144s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:13:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473a30c4-5aa4-481c-8859-fda815d14872/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:13:23 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-3d51ac07-efb0-40ea-9d1b-f6176c72d1c5 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.637s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:13:23 user nova-compute[71874]: INFO nova.scheduler.client.report [None req-3d51ac07-efb0-40ea-9d1b-f6176c72d1c5 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Deleted allocations for instance 84683344-2893-4446-90ae-e64cd799eb20
Apr 12 16:13:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473a30c4-5aa4-481c-8859-fda815d14872/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:13:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473a30c4-5aa4-481c-8859-fda815d14872/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:13:23 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-3d51ac07-efb0-40ea-9d1b-f6176c72d1c5 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "84683344-2893-4446-90ae-e64cd799eb20" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.359s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:13:23 user nova-compute[71874]: DEBUG nova.compute.manager [req-30f2da90-7523-4a0d-b6a5-2c0b88c1592b req-dd0c9ae6-e7b6-4144-a344-3c2fb93beaca service nova] [instance: 84683344-2893-4446-90ae-e64cd799eb20] Received event network-vif-plugged-a8837af3-03f7-4b3d-8a2a-746f2d8038ad {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:13:23 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-30f2da90-7523-4a0d-b6a5-2c0b88c1592b req-dd0c9ae6-e7b6-4144-a344-3c2fb93beaca service nova] Acquiring lock "84683344-2893-4446-90ae-e64cd799eb20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:13:23 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-30f2da90-7523-4a0d-b6a5-2c0b88c1592b req-dd0c9ae6-e7b6-4144-a344-3c2fb93beaca service nova] Lock "84683344-2893-4446-90ae-e64cd799eb20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:13:23 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-30f2da90-7523-4a0d-b6a5-2c0b88c1592b req-dd0c9ae6-e7b6-4144-a344-3c2fb93beaca service nova] Lock "84683344-2893-4446-90ae-e64cd799eb20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:13:23 user nova-compute[71874]: DEBUG nova.compute.manager [req-30f2da90-7523-4a0d-b6a5-2c0b88c1592b req-dd0c9ae6-e7b6-4144-a344-3c2fb93beaca service nova] [instance: 84683344-2893-4446-90ae-e64cd799eb20] No waiting events found dispatching network-vif-plugged-a8837af3-03f7-4b3d-8a2a-746f2d8038ad {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:13:23 user nova-compute[71874]: WARNING nova.compute.manager [req-30f2da90-7523-4a0d-b6a5-2c0b88c1592b req-dd0c9ae6-e7b6-4144-a344-3c2fb93beaca service nova] [instance: 84683344-2893-4446-90ae-e64cd799eb20] Received unexpected event network-vif-plugged-a8837af3-03f7-4b3d-8a2a-746f2d8038ad for instance with vm_state deleted and task_state None.
Apr 12 16:13:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473a30c4-5aa4-481c-8859-fda815d14872/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:13:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4190e244-84b1-47b6-813d-9cadb7c65975/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:13:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4190e244-84b1-47b6-813d-9cadb7c65975/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:13:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4190e244-84b1-47b6-813d-9cadb7c65975/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:13:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4190e244-84b1-47b6-813d-9cadb7c65975/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:13:24 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=71874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 16:13:24 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=71874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 16:13:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e8a977c-aa84-47c4-a838-b5f90820de1a/disk.rescue --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:13:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e8a977c-aa84-47c4-a838-b5f90820de1a/disk.rescue --force-share --output=json" returned: 0 in 0.159s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:13:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e8a977c-aa84-47c4-a838-b5f90820de1a/disk.rescue --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:13:24 user nova-compute[71874]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681315989.5913236, c307e623-c546-487f-ac16-5eb24d088e8a => Stopped> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:13:24 user nova-compute[71874]: INFO nova.compute.manager [-] [instance: c307e623-c546-487f-ac16-5eb24d088e8a] VM Stopped (Lifecycle Event)
Apr 12 16:13:24 user nova-compute[71874]: DEBUG nova.compute.manager [None req-8047e187-5a18-4c6b-9ea0-49c03e83dbbf None None] [instance: c307e623-c546-487f-ac16-5eb24d088e8a] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:13:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e8a977c-aa84-47c4-a838-b5f90820de1a/disk.rescue --force-share --output=json" returned: 0 in 0.144s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:13:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/016ae41d-b098-4126-ace7-3da00b40cb9c/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:13:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/016ae41d-b098-4126-ace7-3da00b40cb9c/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:13:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/016ae41d-b098-4126-ace7-3da00b40cb9c/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:13:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/016ae41d-b098-4126-ace7-3da00b40cb9c/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:13:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/608fbea2-b42b-4bb9-94a7-2b76dcdc2001/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:13:25 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/608fbea2-b42b-4bb9-94a7-2b76dcdc2001/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:13:25 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/608fbea2-b42b-4bb9-94a7-2b76dcdc2001/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:13:25 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/608fbea2-b42b-4bb9-94a7-2b76dcdc2001/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:13:25 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b613235-a905-466f-b9cc-a21a321a6313/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:13:25 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b613235-a905-466f-b9cc-a21a321a6313/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:13:25 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b613235-a905-466f-b9cc-a21a321a6313/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:13:25 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b613235-a905-466f-b9cc-a21a321a6313/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:13:25 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afebffae-dbf6-4876-8c9f-0364f0fde49c/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:13:25 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afebffae-dbf6-4876-8c9f-0364f0fde49c/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:13:25 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afebffae-dbf6-4876-8c9f-0364f0fde49c/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:13:25 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afebffae-dbf6-4876-8c9f-0364f0fde49c/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:13:25 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78b6940a-f97a-4535-8973-3c2a5befbbab/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:13:25 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78b6940a-f97a-4535-8973-3c2a5befbbab/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:13:26 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78b6940a-f97a-4535-8973-3c2a5befbbab/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:13:26 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78b6940a-f97a-4535-8973-3c2a5befbbab/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:13:26 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:13:26 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:13:26 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Hypervisor/Node resource view: name=user free_ram=7738MB free_disk=25.708023071289062GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71874) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 16:13:26 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:13:26 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:13:26 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance afebffae-dbf6-4876-8c9f-0364f0fde49c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:13:26 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 473a30c4-5aa4-481c-8859-fda815d14872 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:13:26 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 608fbea2-b42b-4bb9-94a7-2b76dcdc2001 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:13:26 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance f52ee906-c8fd-4cd5-842e-de98a5099c4f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:13:26 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 78b6940a-f97a-4535-8973-3c2a5befbbab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:13:26 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 7f641c6b-b508-42a7-ae98-c2bfb841d798 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:13:26 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 016ae41d-b098-4126-ace7-3da00b40cb9c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:13:26 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 4190e244-84b1-47b6-813d-9cadb7c65975 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:13:26 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 0e8a977c-aa84-47c4-a838-b5f90820de1a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:13:26 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 1b613235-a905-466f-b9cc-a21a321a6313 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:13:27 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=71874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 16:13:27 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Final resource view: name=user phys_ram=16023MB used_ram=1792MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=71874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 16:13:27 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Inventory has not changed in ProviderTree for provider: 0e94b4c8-cd49-45e4-9133-d36eb4b2456b {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 16:13:27 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:13:27 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Inventory has not changed for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 16:13:27 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Compute_service record updated for user:user {{(pid=71874) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 16:13:27 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.589s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:13:28 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:13:29 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:13:29 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:13:29 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:13:29 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Starting heal instance info cache {{(pid=71874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 16:13:29 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquiring lock "refresh_cache-473a30c4-5aa4-481c-8859-fda815d14872" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:13:29 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquired lock "refresh_cache-473a30c4-5aa4-481c-8859-fda815d14872" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:13:29 user nova-compute[71874]: DEBUG nova.network.neutron [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] [instance: 473a30c4-5aa4-481c-8859-fda815d14872] Forcefully refreshing network info cache for instance {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 16:13:29 user nova-compute[71874]: DEBUG nova.network.neutron [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] [instance: 473a30c4-5aa4-481c-8859-fda815d14872] Updating instance_info_cache with network_info: [{"id": "556d7c96-2d40-43fc-83fe-2059479a5265", "address": "fa:16:3e:f3:a2:9e", "network": {"id": "06fae0be-02dd-4962-a1ac-fd0413772758", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1493924857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3fe48a3b7d846a195f1e47cc7f69695", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap556d7c96-2d", "ovs_interfaceid": "556d7c96-2d40-43fc-83fe-2059479a5265", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:13:30 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Releasing lock "refresh_cache-473a30c4-5aa4-481c-8859-fda815d14872" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:13:30 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] [instance: 473a30c4-5aa4-481c-8859-fda815d14872] Updated the network info_cache for instance {{(pid=71874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 16:13:30 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:13:30 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:13:30 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:13:30 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:13:30 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:13:30 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71874) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 16:13:32 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:13:33 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:13:34 user nova-compute[71874]: DEBUG nova.compute.manager [req-d84d178b-0e31-485c-8ae9-75fd5aa2b2be req-75062546-afd9-411e-b850-e410033eab8f service nova] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] Received event network-changed-746786a9-c889-4ece-bc5e-a905bf8deb5c {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:13:34 user nova-compute[71874]: DEBUG nova.compute.manager [req-d84d178b-0e31-485c-8ae9-75fd5aa2b2be req-75062546-afd9-411e-b850-e410033eab8f service nova] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] Refreshing instance network info cache due to event network-changed-746786a9-c889-4ece-bc5e-a905bf8deb5c. {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 16:13:34 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-d84d178b-0e31-485c-8ae9-75fd5aa2b2be req-75062546-afd9-411e-b850-e410033eab8f service nova] Acquiring lock "refresh_cache-7f641c6b-b508-42a7-ae98-c2bfb841d798" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:13:34 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-d84d178b-0e31-485c-8ae9-75fd5aa2b2be req-75062546-afd9-411e-b850-e410033eab8f service nova] Acquired lock "refresh_cache-7f641c6b-b508-42a7-ae98-c2bfb841d798" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:13:34 user nova-compute[71874]: DEBUG nova.network.neutron [req-d84d178b-0e31-485c-8ae9-75fd5aa2b2be req-75062546-afd9-411e-b850-e410033eab8f service nova] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] Refreshing network info cache for port 746786a9-c889-4ece-bc5e-a905bf8deb5c {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 16:13:35 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-2bc13b33-4c81-4680-b8c3-65792e219b16 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Acquiring lock "7f641c6b-b508-42a7-ae98-c2bfb841d798" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:13:35 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-2bc13b33-4c81-4680-b8c3-65792e219b16 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "7f641c6b-b508-42a7-ae98-c2bfb841d798" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:13:35 user nova-compute[71874]: INFO nova.compute.manager [None req-2bc13b33-4c81-4680-b8c3-65792e219b16 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] Detaching volume 1f27a002-8dfc-4d90-aa35-ba16586d4366
Apr 12 16:13:35 user nova-compute[71874]: INFO nova.virt.block_device [None req-2bc13b33-4c81-4680-b8c3-65792e219b16 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] Attempting to driver detach volume 1f27a002-8dfc-4d90-aa35-ba16586d4366 from mountpoint /dev/vdb
Apr 12 16:13:35 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-2bc13b33-4c81-4680-b8c3-65792e219b16 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Attempting to detach device vdb from instance 7f641c6b-b508-42a7-ae98-c2bfb841d798 from the persistent domain config. {{(pid=71874) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 16:13:35 user nova-compute[71874]: DEBUG nova.virt.libvirt.guest [None req-2bc13b33-4c81-4680-b8c3-65792e219b16 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 16:13:35 user nova-compute[71874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 16:13:35 user nova-compute[71874]:   <source dev="/dev/sde"/>
Apr 12 16:13:35 user nova-compute[71874]:   <target dev="vdb" bus="virtio"/>
Apr 12 16:13:35 user nova-compute[71874]:   <serial>1f27a002-8dfc-4d90-aa35-ba16586d4366</serial>
Apr 12 16:13:35 user nova-compute[71874]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 16:13:35 user nova-compute[71874]: </disk>
Apr 12 16:13:35 user nova-compute[71874]:  {{(pid=71874) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 16:13:35 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-2bc13b33-4c81-4680-b8c3-65792e219b16 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Successfully detached device vdb from instance 7f641c6b-b508-42a7-ae98-c2bfb841d798 from the persistent domain config.
Apr 12 16:13:35 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-2bc13b33-4c81-4680-b8c3-65792e219b16 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7f641c6b-b508-42a7-ae98-c2bfb841d798 from the live domain config. {{(pid=71874) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 16:13:35 user nova-compute[71874]: DEBUG nova.virt.libvirt.guest [None req-2bc13b33-4c81-4680-b8c3-65792e219b16 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 16:13:35 user nova-compute[71874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 16:13:35 user nova-compute[71874]:   <source dev="/dev/sde"/>
Apr 12 16:13:35 user nova-compute[71874]:   <target dev="vdb" bus="virtio"/>
Apr 12 16:13:35 user nova-compute[71874]:   <serial>1f27a002-8dfc-4d90-aa35-ba16586d4366</serial>
Apr 12 16:13:35 user nova-compute[71874]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 16:13:35 user nova-compute[71874]: </disk>
Apr 12 16:13:35 user nova-compute[71874]:  {{(pid=71874) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 16:13:35 user nova-compute[71874]: DEBUG nova.network.neutron [req-d84d178b-0e31-485c-8ae9-75fd5aa2b2be req-75062546-afd9-411e-b850-e410033eab8f service nova] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] Updated VIF entry in instance network info cache for port 746786a9-c889-4ece-bc5e-a905bf8deb5c. {{(pid=71874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 16:13:35 user nova-compute[71874]: DEBUG nova.network.neutron [req-d84d178b-0e31-485c-8ae9-75fd5aa2b2be req-75062546-afd9-411e-b850-e410033eab8f service nova] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] Updating instance_info_cache with network_info: [{"id": "746786a9-c889-4ece-bc5e-a905bf8deb5c", "address": "fa:16:3e:aa:23:e3", "network": {"id": "06fae0be-02dd-4962-a1ac-fd0413772758", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1493924857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3fe48a3b7d846a195f1e47cc7f69695", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap746786a9-c8", "ovs_interfaceid": "746786a9-c889-4ece-bc5e-a905bf8deb5c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:13:35 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-d84d178b-0e31-485c-8ae9-75fd5aa2b2be req-75062546-afd9-411e-b850-e410033eab8f service nova] Releasing lock "refresh_cache-7f641c6b-b508-42a7-ae98-c2bfb841d798" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:13:36 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Received event <DeviceRemovedEvent: 1681316016.071048, 7f641c6b-b508-42a7-ae98-c2bfb841d798 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71874) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 16:13:36 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-2bc13b33-4c81-4680-b8c3-65792e219b16 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7f641c6b-b508-42a7-ae98-c2bfb841d798 {{(pid=71874) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 16:13:36 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-2bc13b33-4c81-4680-b8c3-65792e219b16 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Successfully detached device vdb from instance 7f641c6b-b508-42a7-ae98-c2bfb841d798 from the live domain config.
Apr 12 16:13:36 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2bc13b33-4c81-4680-b8c3-65792e219b16 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] calling os-brick to detach iSCSI Volume {{(pid=71874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 16:13:36 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bc13b33-4c81-4680-b8c3-65792e219b16 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3c0216320>, {'target_iqn': 'iqn.2010-10.org.openstack:1f27a002-8dfc-4d90-aa35-ba16586d4366', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vyOugRUC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:13:36 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-2bc13b33-4c81-4680-b8c3-65792e219b16 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:13:36 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-2bc13b33-4c81-4680-b8c3-65792e219b16 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:13:36 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-2bc13b33-4c81-4680-b8c3-65792e219b16 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:13:36 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:13:36 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:13:36 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b8dd2ca-33a0-4c0c-9b02-c977408aa786]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1f27a002-8dfc-4d90-aa35-ba16586d4366\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ce38c1b3-35b0-48cc-9b83-e9a676997784\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:13:36 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bc13b33-4c81-4680-b8c3-65792e219b16 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 16:13:36 user nova-compute[71874]: No targets found.
Apr 12 16:13:36 user nova-compute[71874]: iSNS:
Apr 12 16:13:36 user nova-compute[71874]: No targets found.
Apr 12 16:13:36 user nova-compute[71874]: STATIC:
Apr 12 16:13:36 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:1f27a002-8dfc-4d90-aa35-ba16586d4366
Apr 12 16:13:36 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:13:36 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:13:36 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:ce38c1b3-35b0-48cc-9b83-e9a676997784
Apr 12 16:13:36 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:13:36 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:13:36 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304
Apr 12 16:13:36 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:13:36 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:13:36 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2
Apr 12 16:13:36 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:13:36 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:13:36 user nova-compute[71874]: FIRMWARE:
Apr 12 16:13:36 user nova-compute[71874]: No targets found.
Apr 12 16:13:36 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:13:36 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bc13b33-4c81-4680-b8c3-65792e219b16 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 16:13:36 user nova-compute[71874]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 16:13:36 user nova-compute[71874]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71874) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 16:13:36 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bc13b33-4c81-4680-b8c3-65792e219b16 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1f27a002-8dfc-4d90-aa35-ba16586d4366', 0)] {{(pid=71874) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 16:13:36 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:13:36 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:13:36 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[335fbead-7083-4a9f-b87a-3a71fb34a74d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1f27a002-8dfc-4d90-aa35-ba16586d4366\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ce38c1b3-35b0-48cc-9b83-e9a676997784\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:13:36 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:13:36 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:13:36 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f3d69d5-f37a-41c6-93e2-054d875a765c]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f27a002-8dfc-4d90-aa35-ba16586d4366 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce38c1b3-35b0-48cc-9b83-e9a676997784 (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:13:36 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bc13b33-4c81-4680-b8c3-65792e219b16 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:13:36 user nova-compute[71874]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f27a002-8dfc-4d90-aa35-ba16586d4366 (non-flash)
Apr 12 16:13:36 user nova-compute[71874]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304 (non-flash)
Apr 12 16:13:36 user nova-compute[71874]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce38c1b3-35b0-48cc-9b83-e9a676997784 (non-flash)
Apr 12 16:13:36 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:13:36 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bc13b33-4c81-4680-b8c3-65792e219b16 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:13:36 user nova-compute[71874]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f27a002-8dfc-4d90-aa35-ba16586d4366 (non-flash)
Apr 12 16:13:36 user nova-compute[71874]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304 (non-flash)
Apr 12 16:13:36 user nova-compute[71874]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce38c1b3-35b0-48cc-9b83-e9a676997784 (non-flash)
Apr 12 16:13:36 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:13:36 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bc13b33-4c81-4680-b8c3-65792e219b16 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc3c07c8040>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1f27a002-8dfc-4d90-aa35-ba16586d4366'): ({'sde'}, set())}) {{(pid=71874) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 16:13:36 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-2bc13b33-4c81-4680-b8c3-65792e219b16 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Removing single pathed devices sde {{(pid=71874) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 16:13:36 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:13:36 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:13:36 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[50cbb98f-357b-486e-8c7e-f5fb53f32d43]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:13:36 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:13:36 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.023s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:13:36 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[b362364b-653c-4a01-b390-f74e0975ab44]: (4, ('ok\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:13:36 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-2bc13b33-4c81-4680-b8c3-65792e219b16 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Flushing IO for device /dev/sde {{(pid=71874) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 16:13:36 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:13:36 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:13:36 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[c765ff6f-451d-4311-bc83-d1fad071de6f]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:13:36 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-2bc13b33-4c81-4680-b8c3-65792e219b16 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71874) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 16:13:36 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:13:36 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.058s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:13:36 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[0271e3a6-a634-4220-b0e2-77694d1463f7]: (4, ('1', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:13:36 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-2bc13b33-4c81-4680-b8c3-65792e219b16 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71874) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 16:13:36 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-2bc13b33-4c81-4680-b8c3-65792e219b16 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] SCSI volumes sde have been removed. {{(pid=71874) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 16:13:36 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bc13b33-4c81-4680-b8c3-65792e219b16 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1f27a002-8dfc-4d90-aa35-ba16586d4366')] {{(pid=71874) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 16:13:36 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f27a002-8dfc-4d90-aa35-ba16586d4366 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:13:36 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f27a002-8dfc-4d90-aa35-ba16586d4366 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:13:36 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[08ff5225-790b-45f8-a826-e008892b8b57]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:13:36 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bc13b33-4c81-4680-b8c3-65792e219b16 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:13:36 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f27a002-8dfc-4d90-aa35-ba16586d4366 -p 172.16.0.220:3260 --logout {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:13:36 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f27a002-8dfc-4d90-aa35-ba16586d4366 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:13:36 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3f213b3-a5da-4cdb-bf28-b3a0abd0da20]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:1f27a002-8dfc-4d90-aa35-ba16586d4366, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:1f27a002-8dfc-4d90-aa35-ba16586d4366, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:13:36 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bc13b33-4c81-4680-b8c3-65792e219b16 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:1f27a002-8dfc-4d90-aa35-ba16586d4366, portal: 172.16.0.220,3260]
Apr 12 16:13:36 user nova-compute[71874]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:1f27a002-8dfc-4d90-aa35-ba16586d4366, portal: 172.16.0.220,3260] successful.
Apr 12 16:13:36 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:13:36 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f27a002-8dfc-4d90-aa35-ba16586d4366 -p 172.16.0.220:3260 --op delete {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:13:36 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f27a002-8dfc-4d90-aa35-ba16586d4366 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:13:36 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f74160b-7470-415a-bddd-5d12f2749af4]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:13:36 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bc13b33-4c81-4680-b8c3-65792e219b16 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:13:36 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-2bc13b33-4c81-4680-b8c3-65792e219b16 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.350s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:13:36 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bc13b33-4c81-4680-b8c3-65792e219b16 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] <== disconnect_volume: return (353ms) None {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:13:36 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2bc13b33-4c81-4680-b8c3-65792e219b16 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] Disconnected iSCSI Volume {{(pid=71874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 16:13:36 user nova-compute[71874]: DEBUG nova.compute.manager [req-e5c2824b-80ea-48b2-b8ce-1f6899264ebf req-66308a0c-a562-4757-bbe9-4e56de3e8d73 service nova] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] Received event network-changed-746786a9-c889-4ece-bc5e-a905bf8deb5c {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:13:36 user nova-compute[71874]: DEBUG nova.compute.manager [req-e5c2824b-80ea-48b2-b8ce-1f6899264ebf req-66308a0c-a562-4757-bbe9-4e56de3e8d73 service nova] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] Refreshing instance network info cache due to event network-changed-746786a9-c889-4ece-bc5e-a905bf8deb5c. {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 16:13:36 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-e5c2824b-80ea-48b2-b8ce-1f6899264ebf req-66308a0c-a562-4757-bbe9-4e56de3e8d73 service nova] Acquiring lock "refresh_cache-7f641c6b-b508-42a7-ae98-c2bfb841d798" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:13:36 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-e5c2824b-80ea-48b2-b8ce-1f6899264ebf req-66308a0c-a562-4757-bbe9-4e56de3e8d73 service nova] Acquired lock "refresh_cache-7f641c6b-b508-42a7-ae98-c2bfb841d798" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:13:36 user nova-compute[71874]: DEBUG nova.network.neutron [req-e5c2824b-80ea-48b2-b8ce-1f6899264ebf req-66308a0c-a562-4757-bbe9-4e56de3e8d73 service nova] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] Refreshing network info cache for port 746786a9-c889-4ece-bc5e-a905bf8deb5c {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 16:13:37 user nova-compute[71874]: DEBUG nova.objects.instance [None req-2bc13b33-4c81-4680-b8c3-65792e219b16 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lazy-loading 'flavor' on Instance uuid 7f641c6b-b508-42a7-ae98-c2bfb841d798 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:13:37 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-2bc13b33-4c81-4680-b8c3-65792e219b16 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "7f641c6b-b508-42a7-ae98-c2bfb841d798" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.790s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:13:37 user nova-compute[71874]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681316002.326577, 84683344-2893-4446-90ae-e64cd799eb20 => Stopped> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:13:37 user nova-compute[71874]: INFO nova.compute.manager [-] [instance: 84683344-2893-4446-90ae-e64cd799eb20] VM Stopped (Lifecycle Event)
Apr 12 16:13:37 user nova-compute[71874]: DEBUG nova.compute.manager [None req-13e12fa2-11fb-4baf-b4e4-fd79a4a4a324 None None] [instance: 84683344-2893-4446-90ae-e64cd799eb20] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:13:37 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:13:37 user nova-compute[71874]: DEBUG nova.network.neutron [req-e5c2824b-80ea-48b2-b8ce-1f6899264ebf req-66308a0c-a562-4757-bbe9-4e56de3e8d73 service nova] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] Updated VIF entry in instance network info cache for port 746786a9-c889-4ece-bc5e-a905bf8deb5c. {{(pid=71874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 16:13:37 user nova-compute[71874]: DEBUG nova.network.neutron [req-e5c2824b-80ea-48b2-b8ce-1f6899264ebf req-66308a0c-a562-4757-bbe9-4e56de3e8d73 service nova] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] Updating instance_info_cache with network_info: [{"id": "746786a9-c889-4ece-bc5e-a905bf8deb5c", "address": "fa:16:3e:aa:23:e3", "network": {"id": "06fae0be-02dd-4962-a1ac-fd0413772758", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1493924857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3fe48a3b7d846a195f1e47cc7f69695", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap746786a9-c8", "ovs_interfaceid": "746786a9-c889-4ece-bc5e-a905bf8deb5c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:13:37 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-e5c2824b-80ea-48b2-b8ce-1f6899264ebf req-66308a0c-a562-4757-bbe9-4e56de3e8d73 service nova] Releasing lock "refresh_cache-7f641c6b-b508-42a7-ae98-c2bfb841d798" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:13:38 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:13:42 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:13:47 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:13:47 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:13:47 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71874) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 16:13:47 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71874) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 16:13:47 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71874) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 16:13:47 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:13:49 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:13:51 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-112e533a-ce9a-48eb-b86a-b00508431578 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "32471bee-e77e-4a1b-8e00-d938a1373976" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:13:51 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-112e533a-ce9a-48eb-b86a-b00508431578 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "32471bee-e77e-4a1b-8e00-d938a1373976" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:13:51 user nova-compute[71874]: DEBUG nova.compute.manager [None req-112e533a-ce9a-48eb-b86a-b00508431578 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: 32471bee-e77e-4a1b-8e00-d938a1373976] Starting instance... {{(pid=71874) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 16:13:51 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-112e533a-ce9a-48eb-b86a-b00508431578 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:13:51 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-112e533a-ce9a-48eb-b86a-b00508431578 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:13:51 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-112e533a-ce9a-48eb-b86a-b00508431578 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71874) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 16:13:51 user nova-compute[71874]: INFO nova.compute.claims [None req-112e533a-ce9a-48eb-b86a-b00508431578 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: 32471bee-e77e-4a1b-8e00-d938a1373976] Claim successful on node user
Apr 12 16:13:51 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-112e533a-ce9a-48eb-b86a-b00508431578 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Inventory has not changed in ProviderTree for provider: 0e94b4c8-cd49-45e4-9133-d36eb4b2456b {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 16:13:51 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-112e533a-ce9a-48eb-b86a-b00508431578 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Inventory has not changed for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 16:13:51 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-112e533a-ce9a-48eb-b86a-b00508431578 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.463s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:13:51 user nova-compute[71874]: DEBUG nova.compute.manager [None req-112e533a-ce9a-48eb-b86a-b00508431578 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: 32471bee-e77e-4a1b-8e00-d938a1373976] Start building networks asynchronously for instance. {{(pid=71874) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 16:13:51 user nova-compute[71874]: DEBUG nova.compute.manager [None req-112e533a-ce9a-48eb-b86a-b00508431578 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: 32471bee-e77e-4a1b-8e00-d938a1373976] Allocating IP information in the background. {{(pid=71874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 16:13:51 user nova-compute[71874]: DEBUG nova.network.neutron [None req-112e533a-ce9a-48eb-b86a-b00508431578 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: 32471bee-e77e-4a1b-8e00-d938a1373976] allocate_for_instance() {{(pid=71874) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 16:13:51 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-112e533a-ce9a-48eb-b86a-b00508431578 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: 32471bee-e77e-4a1b-8e00-d938a1373976] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 16:13:51 user nova-compute[71874]: DEBUG nova.compute.manager [None req-112e533a-ce9a-48eb-b86a-b00508431578 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: 32471bee-e77e-4a1b-8e00-d938a1373976] Start building block device mappings for instance. {{(pid=71874) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 16:13:51 user nova-compute[71874]: DEBUG nova.policy [None req-112e533a-ce9a-48eb-b86a-b00508431578 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1a699b3ba8304eadb8a53d465ea340cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ea81bd1962466bbe552424973f71a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71874) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 16:13:51 user nova-compute[71874]: DEBUG nova.compute.manager [None req-112e533a-ce9a-48eb-b86a-b00508431578 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: 32471bee-e77e-4a1b-8e00-d938a1373976] Start spawning the instance on the hypervisor. {{(pid=71874) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 16:13:51 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-112e533a-ce9a-48eb-b86a-b00508431578 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: 32471bee-e77e-4a1b-8e00-d938a1373976] Creating instance directory {{(pid=71874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 16:13:51 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-112e533a-ce9a-48eb-b86a-b00508431578 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: 32471bee-e77e-4a1b-8e00-d938a1373976] Creating image(s)
Apr 12 16:13:51 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-112e533a-ce9a-48eb-b86a-b00508431578 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "/opt/stack/data/nova/instances/32471bee-e77e-4a1b-8e00-d938a1373976/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:13:51 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-112e533a-ce9a-48eb-b86a-b00508431578 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "/opt/stack/data/nova/instances/32471bee-e77e-4a1b-8e00-d938a1373976/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:13:51 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-112e533a-ce9a-48eb-b86a-b00508431578 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "/opt/stack/data/nova/instances/32471bee-e77e-4a1b-8e00-d938a1373976/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:13:51 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-112e533a-ce9a-48eb-b86a-b00508431578 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:13:52 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-112e533a-ce9a-48eb-b86a-b00508431578 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json" returned: 0 in 0.130s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:13:52 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-112e533a-ce9a-48eb-b86a-b00508431578 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "b88df1b37cb431f52bc53b5616015c89b5bec411" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:13:52 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-112e533a-ce9a-48eb-b86a-b00508431578 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "b88df1b37cb431f52bc53b5616015c89b5bec411" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:13:52 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-112e533a-ce9a-48eb-b86a-b00508431578 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:13:52 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-112e533a-ce9a-48eb-b86a-b00508431578 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json" returned: 0 in 0.151s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:13:52 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-112e533a-ce9a-48eb-b86a-b00508431578 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411,backing_fmt=raw /opt/stack/data/nova/instances/32471bee-e77e-4a1b-8e00-d938a1373976/disk 1073741824 {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:13:52 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-112e533a-ce9a-48eb-b86a-b00508431578 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411,backing_fmt=raw /opt/stack/data/nova/instances/32471bee-e77e-4a1b-8e00-d938a1373976/disk 1073741824" returned: 0 in 0.071s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:13:52 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-112e533a-ce9a-48eb-b86a-b00508431578 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "b88df1b37cb431f52bc53b5616015c89b5bec411" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.229s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:13:52 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-112e533a-ce9a-48eb-b86a-b00508431578 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:13:52 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:13:52 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-112e533a-ce9a-48eb-b86a-b00508431578 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json" returned: 0 in 0.144s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:13:52 user nova-compute[71874]: DEBUG nova.virt.disk.api [None req-112e533a-ce9a-48eb-b86a-b00508431578 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Checking if we can resize image /opt/stack/data/nova/instances/32471bee-e77e-4a1b-8e00-d938a1373976/disk. size=1073741824 {{(pid=71874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 16:13:52 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-112e533a-ce9a-48eb-b86a-b00508431578 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32471bee-e77e-4a1b-8e00-d938a1373976/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:13:52 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-112e533a-ce9a-48eb-b86a-b00508431578 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32471bee-e77e-4a1b-8e00-d938a1373976/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:13:52 user nova-compute[71874]: DEBUG nova.virt.disk.api [None req-112e533a-ce9a-48eb-b86a-b00508431578 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Cannot resize image /opt/stack/data/nova/instances/32471bee-e77e-4a1b-8e00-d938a1373976/disk to a smaller size. {{(pid=71874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 16:13:52 user nova-compute[71874]: DEBUG nova.objects.instance [None req-112e533a-ce9a-48eb-b86a-b00508431578 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lazy-loading 'migration_context' on Instance uuid 32471bee-e77e-4a1b-8e00-d938a1373976 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:13:52 user nova-compute[71874]: DEBUG nova.network.neutron [None req-112e533a-ce9a-48eb-b86a-b00508431578 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: 32471bee-e77e-4a1b-8e00-d938a1373976] Successfully created port: 69029e57-b138-43c1-b31f-59bc7957994d {{(pid=71874) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 16:13:52 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-112e533a-ce9a-48eb-b86a-b00508431578 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: 32471bee-e77e-4a1b-8e00-d938a1373976] Created local disks {{(pid=71874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 16:13:52 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-112e533a-ce9a-48eb-b86a-b00508431578 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: 32471bee-e77e-4a1b-8e00-d938a1373976] Ensure instance console log exists: /opt/stack/data/nova/instances/32471bee-e77e-4a1b-8e00-d938a1373976/console.log {{(pid=71874) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 16:13:52 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-112e533a-ce9a-48eb-b86a-b00508431578 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:13:52 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-112e533a-ce9a-48eb-b86a-b00508431578 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:13:52 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-112e533a-ce9a-48eb-b86a-b00508431578 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:13:53 user nova-compute[71874]: DEBUG nova.network.neutron [None req-112e533a-ce9a-48eb-b86a-b00508431578 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: 32471bee-e77e-4a1b-8e00-d938a1373976] Successfully updated port: 69029e57-b138-43c1-b31f-59bc7957994d {{(pid=71874) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 16:13:53 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-112e533a-ce9a-48eb-b86a-b00508431578 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "refresh_cache-32471bee-e77e-4a1b-8e00-d938a1373976" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:13:53 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-112e533a-ce9a-48eb-b86a-b00508431578 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquired lock "refresh_cache-32471bee-e77e-4a1b-8e00-d938a1373976" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:13:53 user nova-compute[71874]: DEBUG nova.network.neutron [None req-112e533a-ce9a-48eb-b86a-b00508431578 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: 32471bee-e77e-4a1b-8e00-d938a1373976] Building network info cache for instance {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 16:13:53 user nova-compute[71874]: DEBUG nova.compute.manager [req-c3c72a4b-f224-421a-8aa0-0072f3736da4 req-2516a175-a045-4ec3-ade4-cfedf21267ad service nova] [instance: 32471bee-e77e-4a1b-8e00-d938a1373976] Received event network-changed-69029e57-b138-43c1-b31f-59bc7957994d {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:13:53 user nova-compute[71874]: DEBUG nova.compute.manager [req-c3c72a4b-f224-421a-8aa0-0072f3736da4 req-2516a175-a045-4ec3-ade4-cfedf21267ad service nova] [instance: 32471bee-e77e-4a1b-8e00-d938a1373976] Refreshing instance network info cache due to event network-changed-69029e57-b138-43c1-b31f-59bc7957994d. {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 16:13:53 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-c3c72a4b-f224-421a-8aa0-0072f3736da4 req-2516a175-a045-4ec3-ade4-cfedf21267ad service nova] Acquiring lock "refresh_cache-32471bee-e77e-4a1b-8e00-d938a1373976" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:13:53 user nova-compute[71874]: DEBUG nova.network.neutron [None req-112e533a-ce9a-48eb-b86a-b00508431578 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: 32471bee-e77e-4a1b-8e00-d938a1373976] Instance cache missing network info. {{(pid=71874) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 16:13:53 user nova-compute[71874]: DEBUG nova.network.neutron [None req-112e533a-ce9a-48eb-b86a-b00508431578 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: 32471bee-e77e-4a1b-8e00-d938a1373976] Updating instance_info_cache with network_info: [{"id": "69029e57-b138-43c1-b31f-59bc7957994d", "address": "fa:16:3e:04:8e:ce", "network": {"id": "e6694358-e361-4952-b859-93755c11721e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-667152893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97ea81bd1962466bbe552424973f71a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69029e57-b1", "ovs_interfaceid": "69029e57-b138-43c1-b31f-59bc7957994d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:13:53 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-112e533a-ce9a-48eb-b86a-b00508431578 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Releasing lock "refresh_cache-32471bee-e77e-4a1b-8e00-d938a1373976" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:13:53 user nova-compute[71874]: DEBUG nova.compute.manager [None req-112e533a-ce9a-48eb-b86a-b00508431578 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: 32471bee-e77e-4a1b-8e00-d938a1373976] Instance network_info: |[{"id": "69029e57-b138-43c1-b31f-59bc7957994d", "address": "fa:16:3e:04:8e:ce", "network": {"id": "e6694358-e361-4952-b859-93755c11721e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-667152893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97ea81bd1962466bbe552424973f71a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69029e57-b1", "ovs_interfaceid": "69029e57-b138-43c1-b31f-59bc7957994d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 16:13:53 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-c3c72a4b-f224-421a-8aa0-0072f3736da4 req-2516a175-a045-4ec3-ade4-cfedf21267ad service nova] Acquired lock "refresh_cache-32471bee-e77e-4a1b-8e00-d938a1373976" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:13:53 user nova-compute[71874]: DEBUG nova.network.neutron [req-c3c72a4b-f224-421a-8aa0-0072f3736da4 req-2516a175-a045-4ec3-ade4-cfedf21267ad service nova] [instance: 32471bee-e77e-4a1b-8e00-d938a1373976] Refreshing network info cache for port 69029e57-b138-43c1-b31f-59bc7957994d {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 16:13:53 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-112e533a-ce9a-48eb-b86a-b00508431578 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: 32471bee-e77e-4a1b-8e00-d938a1373976] Start _get_guest_xml network_info=[{"id": "69029e57-b138-43c1-b31f-59bc7957994d", "address": "fa:16:3e:04:8e:ce", "network": {"id": "e6694358-e361-4952-b859-93755c11721e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-667152893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97ea81bd1962466bbe552424973f71a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69029e57-b1", "ovs_interfaceid": "69029e57-b138-43c1-b31f-59bc7957994d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T15:55:37Z,direct_url=<?>,disk_format='qcow2',id=9dc63f14-8b70-4e72-89f2-13464f2f5c7c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='61a4936d9b7744c0b488d81c9b7746b6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T15:55:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_options': None, 'image_id': '9dc63f14-8b70-4e72-89f2-13464f2f5c7c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 16:13:53 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-112e533a-ce9a-48eb-b86a-b00508431578 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:13:53 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-112e533a-ce9a-48eb-b86a-b00508431578 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:13:53 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-112e533a-ce9a-48eb-b86a-b00508431578 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71874) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 16:13:53 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-112e533a-ce9a-48eb-b86a-b00508431578 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T15:56:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T15:55:37Z,direct_url=<?>,disk_format='qcow2',id=9dc63f14-8b70-4e72-89f2-13464f2f5c7c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='61a4936d9b7744c0b488d81c9b7746b6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T15:55:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 16:13:53 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-112e533a-ce9a-48eb-b86a-b00508431578 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Flavor limits 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 16:13:53 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-112e533a-ce9a-48eb-b86a-b00508431578 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Image limits 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 16:13:53 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-112e533a-ce9a-48eb-b86a-b00508431578 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Flavor pref 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 16:13:53 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-112e533a-ce9a-48eb-b86a-b00508431578 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Image pref 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 16:13:53 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-112e533a-ce9a-48eb-b86a-b00508431578 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 16:13:53 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-112e533a-ce9a-48eb-b86a-b00508431578 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 16:13:53 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-112e533a-ce9a-48eb-b86a-b00508431578 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 16:13:53 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-112e533a-ce9a-48eb-b86a-b00508431578 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Got 1 possible topologies {{(pid=71874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 16:13:53 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-112e533a-ce9a-48eb-b86a-b00508431578 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 16:13:53 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-112e533a-ce9a-48eb-b86a-b00508431578 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 16:13:53 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-112e533a-ce9a-48eb-b86a-b00508431578 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T16:13:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1551944182',display_name='tempest-ServerActionsTestJSON-server-1551944182',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1551944182',id=33,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNmXVADjvoPSh3uGCGCTNS/vcfcDtUjn/vZEaV3bCllfz1ZO8VIgFuZhP+mAsa+G/KA4ubi5U9Vj41YtHGsakdPR5VoByhorvfUv/PIWtER2tn1LWX2mlFyT+T8AEJplPw==',key_name='tempest-keypair-1923467613',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='97ea81bd1962466bbe552424973f71a8',ramdisk_id='',reservation_id='r-mxg9p0v0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-631887779',owner_user_name='tempest-ServerActionsTestJSON-631887779-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T16:13:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1a699b3ba8304eadb8a53d465ea340cf',uuid=32471bee-e77e-4a1b-8e00-d938a1373976,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "69029e57-b138-43c1-b31f-59bc7957994d", "address": "fa:16:3e:04:8e:ce", "network": {"id": "e6694358-e361-4952-b859-93755c11721e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-667152893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97ea81bd1962466bbe552424973f71a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69029e57-b1", "ovs_interfaceid": "69029e57-b138-43c1-b31f-59bc7957994d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 16:13:53 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-112e533a-ce9a-48eb-b86a-b00508431578 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Converting VIF {"id": "69029e57-b138-43c1-b31f-59bc7957994d", "address": "fa:16:3e:04:8e:ce", "network": {"id": "e6694358-e361-4952-b859-93755c11721e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-667152893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97ea81bd1962466bbe552424973f71a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69029e57-b1", "ovs_interfaceid": "69029e57-b138-43c1-b31f-59bc7957994d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:13:53 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-112e533a-ce9a-48eb-b86a-b00508431578 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:8e:ce,bridge_name='br-int',has_traffic_filtering=True,id=69029e57-b138-43c1-b31f-59bc7957994d,network=Network(e6694358-e361-4952-b859-93755c11721e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69029e57-b1') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:13:53 user nova-compute[71874]: DEBUG nova.objects.instance [None req-112e533a-ce9a-48eb-b86a-b00508431578 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lazy-loading 'pci_devices' on Instance uuid 32471bee-e77e-4a1b-8e00-d938a1373976 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:13:53 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-112e533a-ce9a-48eb-b86a-b00508431578 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: 32471bee-e77e-4a1b-8e00-d938a1373976] End _get_guest_xml xml=<domain type="kvm">
Apr 12 16:13:53 user nova-compute[71874]:   <uuid>32471bee-e77e-4a1b-8e00-d938a1373976</uuid>
Apr 12 16:13:53 user nova-compute[71874]:   <name>instance-00000021</name>
Apr 12 16:13:53 user nova-compute[71874]:   <memory>131072</memory>
Apr 12 16:13:53 user nova-compute[71874]:   <vcpu>1</vcpu>
Apr 12 16:13:53 user nova-compute[71874]:   <metadata>
Apr 12 16:13:53 user nova-compute[71874]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 16:13:53 user nova-compute[71874]:       <nova:package version="0.0.0"/>
Apr 12 16:13:53 user nova-compute[71874]:       <nova:name>tempest-ServerActionsTestJSON-server-1551944182</nova:name>
Apr 12 16:13:53 user nova-compute[71874]:       <nova:creationTime>2023-04-12 16:13:53</nova:creationTime>
Apr 12 16:13:53 user nova-compute[71874]:       <nova:flavor name="m1.nano">
Apr 12 16:13:53 user nova-compute[71874]:         <nova:memory>128</nova:memory>
Apr 12 16:13:53 user nova-compute[71874]:         <nova:disk>1</nova:disk>
Apr 12 16:13:53 user nova-compute[71874]:         <nova:swap>0</nova:swap>
Apr 12 16:13:53 user nova-compute[71874]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 16:13:53 user nova-compute[71874]:         <nova:vcpus>1</nova:vcpus>
Apr 12 16:13:53 user nova-compute[71874]:       </nova:flavor>
Apr 12 16:13:53 user nova-compute[71874]:       <nova:owner>
Apr 12 16:13:53 user nova-compute[71874]:         <nova:user uuid="1a699b3ba8304eadb8a53d465ea340cf">tempest-ServerActionsTestJSON-631887779-project-member</nova:user>
Apr 12 16:13:53 user nova-compute[71874]:         <nova:project uuid="97ea81bd1962466bbe552424973f71a8">tempest-ServerActionsTestJSON-631887779</nova:project>
Apr 12 16:13:53 user nova-compute[71874]:       </nova:owner>
Apr 12 16:13:53 user nova-compute[71874]:       <nova:root type="image" uuid="9dc63f14-8b70-4e72-89f2-13464f2f5c7c"/>
Apr 12 16:13:53 user nova-compute[71874]:       <nova:ports>
Apr 12 16:13:53 user nova-compute[71874]:         <nova:port uuid="69029e57-b138-43c1-b31f-59bc7957994d">
Apr 12 16:13:53 user nova-compute[71874]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 12 16:13:53 user nova-compute[71874]:         </nova:port>
Apr 12 16:13:53 user nova-compute[71874]:       </nova:ports>
Apr 12 16:13:53 user nova-compute[71874]:     </nova:instance>
Apr 12 16:13:53 user nova-compute[71874]:   </metadata>
Apr 12 16:13:53 user nova-compute[71874]:   <sysinfo type="smbios">
Apr 12 16:13:53 user nova-compute[71874]:     <system>
Apr 12 16:13:53 user nova-compute[71874]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 16:13:53 user nova-compute[71874]:       <entry name="product">OpenStack Nova</entry>
Apr 12 16:13:53 user nova-compute[71874]:       <entry name="version">0.0.0</entry>
Apr 12 16:13:53 user nova-compute[71874]:       <entry name="serial">32471bee-e77e-4a1b-8e00-d938a1373976</entry>
Apr 12 16:13:53 user nova-compute[71874]:       <entry name="uuid">32471bee-e77e-4a1b-8e00-d938a1373976</entry>
Apr 12 16:13:53 user nova-compute[71874]:       <entry name="family">Virtual Machine</entry>
Apr 12 16:13:53 user nova-compute[71874]:     </system>
Apr 12 16:13:53 user nova-compute[71874]:   </sysinfo>
Apr 12 16:13:53 user nova-compute[71874]:   <os>
Apr 12 16:13:53 user nova-compute[71874]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 16:13:53 user nova-compute[71874]:     <boot dev="hd"/>
Apr 12 16:13:53 user nova-compute[71874]:     <smbios mode="sysinfo"/>
Apr 12 16:13:53 user nova-compute[71874]:   </os>
Apr 12 16:13:53 user nova-compute[71874]:   <features>
Apr 12 16:13:53 user nova-compute[71874]:     <acpi/>
Apr 12 16:13:53 user nova-compute[71874]:     <apic/>
Apr 12 16:13:53 user nova-compute[71874]:     <vmcoreinfo/>
Apr 12 16:13:53 user nova-compute[71874]:   </features>
Apr 12 16:13:53 user nova-compute[71874]:   <clock offset="utc">
Apr 12 16:13:53 user nova-compute[71874]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 16:13:53 user nova-compute[71874]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 16:13:53 user nova-compute[71874]:     <timer name="hpet" present="no"/>
Apr 12 16:13:53 user nova-compute[71874]:   </clock>
Apr 12 16:13:53 user nova-compute[71874]:   <cpu mode="custom" match="exact">
Apr 12 16:13:53 user nova-compute[71874]:     <model>Nehalem</model>
Apr 12 16:13:53 user nova-compute[71874]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 16:13:53 user nova-compute[71874]:   </cpu>
Apr 12 16:13:53 user nova-compute[71874]:   <devices>
Apr 12 16:13:53 user nova-compute[71874]:     <disk type="file" device="disk">
Apr 12 16:13:53 user nova-compute[71874]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 16:13:53 user nova-compute[71874]:       <source file="/opt/stack/data/nova/instances/32471bee-e77e-4a1b-8e00-d938a1373976/disk"/>
Apr 12 16:13:53 user nova-compute[71874]:       <target dev="vda" bus="virtio"/>
Apr 12 16:13:53 user nova-compute[71874]:     </disk>
Apr 12 16:13:53 user nova-compute[71874]:     <interface type="ethernet">
Apr 12 16:13:53 user nova-compute[71874]:       <mac address="fa:16:3e:04:8e:ce"/>
Apr 12 16:13:53 user nova-compute[71874]:       <model type="virtio"/>
Apr 12 16:13:53 user nova-compute[71874]:       <mtu size="1442"/>
Apr 12 16:13:53 user nova-compute[71874]:       <target dev="tap69029e57-b1"/>
Apr 12 16:13:53 user nova-compute[71874]:     </interface>
Apr 12 16:13:53 user nova-compute[71874]:     <serial type="pty">
Apr 12 16:13:53 user nova-compute[71874]:       <log file="/opt/stack/data/nova/instances/32471bee-e77e-4a1b-8e00-d938a1373976/console.log" append="off"/>
Apr 12 16:13:53 user nova-compute[71874]:     </serial>
Apr 12 16:13:53 user nova-compute[71874]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 16:13:53 user nova-compute[71874]:     <video>
Apr 12 16:13:53 user nova-compute[71874]:       <model type="virtio"/>
Apr 12 16:13:53 user nova-compute[71874]:     </video>
Apr 12 16:13:53 user nova-compute[71874]:     <rng model="virtio">
Apr 12 16:13:53 user nova-compute[71874]:       <backend model="random">/dev/urandom</backend>
Apr 12 16:13:53 user nova-compute[71874]:     </rng>
Apr 12 16:13:53 user nova-compute[71874]:     <controller type="usb" index="0" model="none"/>
Apr 12 16:13:53 user nova-compute[71874]:     <memballoon model="virtio">
Apr 12 16:13:53 user nova-compute[71874]:       <stats period="10"/>
Apr 12 16:13:53 user nova-compute[71874]:     </memballoon>
Apr 12 16:13:53 user nova-compute[71874]:   </devices>
Apr 12 16:13:53 user nova-compute[71874]: </domain>
Apr 12 16:13:53 user nova-compute[71874]:  {{(pid=71874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 16:13:54 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-112e533a-ce9a-48eb-b86a-b00508431578 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T16:13:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1551944182',display_name='tempest-ServerActionsTestJSON-server-1551944182',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1551944182',id=33,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNmXVADjvoPSh3uGCGCTNS/vcfcDtUjn/vZEaV3bCllfz1ZO8VIgFuZhP+mAsa+G/KA4ubi5U9Vj41YtHGsakdPR5VoByhorvfUv/PIWtER2tn1LWX2mlFyT+T8AEJplPw==',key_name='tempest-keypair-1923467613',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='97ea81bd1962466bbe552424973f71a8',ramdisk_id='',reservation_id='r-mxg9p0v0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-631887779',owner_user_name='tempest-ServerActionsTestJSON-631887779-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T16:13:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1a699b3ba8304eadb8a53d465ea340cf',uuid=32471bee-e77e-4a1b-8e00-d938a1373976,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "69029e57-b138-43c1-b31f-59bc7957994d", "address": "fa:16:3e:04:8e:ce", "network": {"id": "e6694358-e361-4952-b859-93755c11721e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-667152893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97ea81bd1962466bbe552424973f71a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69029e57-b1", "ovs_interfaceid": "69029e57-b138-43c1-b31f-59bc7957994d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 16:13:54 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-112e533a-ce9a-48eb-b86a-b00508431578 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Converting VIF {"id": "69029e57-b138-43c1-b31f-59bc7957994d", "address": "fa:16:3e:04:8e:ce", "network": {"id": "e6694358-e361-4952-b859-93755c11721e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-667152893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97ea81bd1962466bbe552424973f71a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69029e57-b1", "ovs_interfaceid": "69029e57-b138-43c1-b31f-59bc7957994d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:13:54 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-112e533a-ce9a-48eb-b86a-b00508431578 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:8e:ce,bridge_name='br-int',has_traffic_filtering=True,id=69029e57-b138-43c1-b31f-59bc7957994d,network=Network(e6694358-e361-4952-b859-93755c11721e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69029e57-b1') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:13:54 user nova-compute[71874]: DEBUG os_vif [None req-112e533a-ce9a-48eb-b86a-b00508431578 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:8e:ce,bridge_name='br-int',has_traffic_filtering=True,id=69029e57-b138-43c1-b31f-59bc7957994d,network=Network(e6694358-e361-4952-b859-93755c11721e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69029e57-b1') {{(pid=71874) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 16:13:54 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:13:54 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:13:54 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 16:13:54 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:13:54 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap69029e57-b1, may_exist=True) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:13:54 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap69029e57-b1, col_values=(('external_ids', {'iface-id': '69029e57-b138-43c1-b31f-59bc7957994d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:04:8e:ce', 'vm-uuid': '32471bee-e77e-4a1b-8e00-d938a1373976'}),)) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:13:54 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:13:54 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:13:54 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:13:54 user nova-compute[71874]: INFO os_vif [None req-112e533a-ce9a-48eb-b86a-b00508431578 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:8e:ce,bridge_name='br-int',has_traffic_filtering=True,id=69029e57-b138-43c1-b31f-59bc7957994d,network=Network(e6694358-e361-4952-b859-93755c11721e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69029e57-b1')
Apr 12 16:13:54 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-112e533a-ce9a-48eb-b86a-b00508431578 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] No BDM found with device name vda, not building metadata. {{(pid=71874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 16:13:54 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-112e533a-ce9a-48eb-b86a-b00508431578 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] No VIF found with MAC fa:16:3e:04:8e:ce, not building metadata {{(pid=71874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 16:13:54 user nova-compute[71874]: DEBUG nova.network.neutron [req-c3c72a4b-f224-421a-8aa0-0072f3736da4 req-2516a175-a045-4ec3-ade4-cfedf21267ad service nova] [instance: 32471bee-e77e-4a1b-8e00-d938a1373976] Updated VIF entry in instance network info cache for port 69029e57-b138-43c1-b31f-59bc7957994d. {{(pid=71874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 16:13:54 user nova-compute[71874]: DEBUG nova.network.neutron [req-c3c72a4b-f224-421a-8aa0-0072f3736da4 req-2516a175-a045-4ec3-ade4-cfedf21267ad service nova] [instance: 32471bee-e77e-4a1b-8e00-d938a1373976] Updating instance_info_cache with network_info: [{"id": "69029e57-b138-43c1-b31f-59bc7957994d", "address": "fa:16:3e:04:8e:ce", "network": {"id": "e6694358-e361-4952-b859-93755c11721e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-667152893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97ea81bd1962466bbe552424973f71a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69029e57-b1", "ovs_interfaceid": "69029e57-b138-43c1-b31f-59bc7957994d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:13:54 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-c3c72a4b-f224-421a-8aa0-0072f3736da4 req-2516a175-a045-4ec3-ade4-cfedf21267ad service nova] Releasing lock "refresh_cache-32471bee-e77e-4a1b-8e00-d938a1373976" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:13:55 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:13:55 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:13:55 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:13:55 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:13:55 user nova-compute[71874]: DEBUG nova.compute.manager [req-a265d8e7-955b-4f5b-9061-6950ab6e39fc req-ff6e4803-66f8-40c6-adff-28c15584b732 service nova] [instance: 32471bee-e77e-4a1b-8e00-d938a1373976] Received event network-vif-plugged-69029e57-b138-43c1-b31f-59bc7957994d {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:13:55 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-a265d8e7-955b-4f5b-9061-6950ab6e39fc req-ff6e4803-66f8-40c6-adff-28c15584b732 service nova] Acquiring lock "32471bee-e77e-4a1b-8e00-d938a1373976-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:13:55 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-a265d8e7-955b-4f5b-9061-6950ab6e39fc req-ff6e4803-66f8-40c6-adff-28c15584b732 service nova] Lock "32471bee-e77e-4a1b-8e00-d938a1373976-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:13:55 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-a265d8e7-955b-4f5b-9061-6950ab6e39fc req-ff6e4803-66f8-40c6-adff-28c15584b732 service nova] Lock "32471bee-e77e-4a1b-8e00-d938a1373976-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:13:55 user nova-compute[71874]: DEBUG nova.compute.manager [req-a265d8e7-955b-4f5b-9061-6950ab6e39fc req-ff6e4803-66f8-40c6-adff-28c15584b732 service nova] [instance: 32471bee-e77e-4a1b-8e00-d938a1373976] No waiting events found dispatching network-vif-plugged-69029e57-b138-43c1-b31f-59bc7957994d {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:13:55 user nova-compute[71874]: WARNING nova.compute.manager [req-a265d8e7-955b-4f5b-9061-6950ab6e39fc req-ff6e4803-66f8-40c6-adff-28c15584b732 service nova] [instance: 32471bee-e77e-4a1b-8e00-d938a1373976] Received unexpected event network-vif-plugged-69029e57-b138-43c1-b31f-59bc7957994d for instance with vm_state building and task_state spawning.
Apr 12 16:13:56 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:13:56 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:13:56 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:13:56 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:13:56 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:13:57 user nova-compute[71874]: DEBUG nova.virt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Emitting event <LifecycleEvent: 1681316037.5873127, 32471bee-e77e-4a1b-8e00-d938a1373976 => Resumed> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:13:57 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 32471bee-e77e-4a1b-8e00-d938a1373976] VM Resumed (Lifecycle Event)
Apr 12 16:13:57 user nova-compute[71874]: DEBUG nova.compute.manager [None req-112e533a-ce9a-48eb-b86a-b00508431578 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: 32471bee-e77e-4a1b-8e00-d938a1373976] Instance event wait completed in 0 seconds for  {{(pid=71874) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 16:13:57 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-112e533a-ce9a-48eb-b86a-b00508431578 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: 32471bee-e77e-4a1b-8e00-d938a1373976] Guest created on hypervisor {{(pid=71874) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 16:13:57 user nova-compute[71874]: INFO nova.virt.libvirt.driver [-] [instance: 32471bee-e77e-4a1b-8e00-d938a1373976] Instance spawned successfully.
Apr 12 16:13:57 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-112e533a-ce9a-48eb-b86a-b00508431578 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: 32471bee-e77e-4a1b-8e00-d938a1373976] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 16:13:57 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 32471bee-e77e-4a1b-8e00-d938a1373976] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:13:57 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 32471bee-e77e-4a1b-8e00-d938a1373976] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 16:13:57 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-112e533a-ce9a-48eb-b86a-b00508431578 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: 32471bee-e77e-4a1b-8e00-d938a1373976] Found default for hw_cdrom_bus of ide {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:13:57 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-112e533a-ce9a-48eb-b86a-b00508431578 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: 32471bee-e77e-4a1b-8e00-d938a1373976] Found default for hw_disk_bus of virtio {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:13:57 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-112e533a-ce9a-48eb-b86a-b00508431578 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: 32471bee-e77e-4a1b-8e00-d938a1373976] Found default for hw_input_bus of None {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:13:57 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-112e533a-ce9a-48eb-b86a-b00508431578 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: 32471bee-e77e-4a1b-8e00-d938a1373976] Found default for hw_pointer_model of None {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:13:57 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-112e533a-ce9a-48eb-b86a-b00508431578 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: 32471bee-e77e-4a1b-8e00-d938a1373976] Found default for hw_video_model of virtio {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:13:57 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-112e533a-ce9a-48eb-b86a-b00508431578 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: 32471bee-e77e-4a1b-8e00-d938a1373976] Found default for hw_vif_model of virtio {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:13:57 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 32471bee-e77e-4a1b-8e00-d938a1373976] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 16:13:57 user nova-compute[71874]: DEBUG nova.virt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Emitting event <LifecycleEvent: 1681316037.588785, 32471bee-e77e-4a1b-8e00-d938a1373976 => Started> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:13:57 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 32471bee-e77e-4a1b-8e00-d938a1373976] VM Started (Lifecycle Event)
Apr 12 16:13:57 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 32471bee-e77e-4a1b-8e00-d938a1373976] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:13:57 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 32471bee-e77e-4a1b-8e00-d938a1373976] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 16:13:57 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 32471bee-e77e-4a1b-8e00-d938a1373976] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 16:13:57 user nova-compute[71874]: INFO nova.compute.manager [None req-112e533a-ce9a-48eb-b86a-b00508431578 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: 32471bee-e77e-4a1b-8e00-d938a1373976] Took 5.75 seconds to spawn the instance on the hypervisor.
Apr 12 16:13:57 user nova-compute[71874]: DEBUG nova.compute.manager [None req-112e533a-ce9a-48eb-b86a-b00508431578 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: 32471bee-e77e-4a1b-8e00-d938a1373976] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:13:57 user nova-compute[71874]: DEBUG nova.compute.manager [req-59e4a30b-3590-4a9d-8b4c-cc10e9af19cf req-d860d009-205f-412b-a87e-5784199fb109 service nova] [instance: 32471bee-e77e-4a1b-8e00-d938a1373976] Received event network-vif-plugged-69029e57-b138-43c1-b31f-59bc7957994d {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:13:57 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-59e4a30b-3590-4a9d-8b4c-cc10e9af19cf req-d860d009-205f-412b-a87e-5784199fb109 service nova] Acquiring lock "32471bee-e77e-4a1b-8e00-d938a1373976-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:13:57 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-59e4a30b-3590-4a9d-8b4c-cc10e9af19cf req-d860d009-205f-412b-a87e-5784199fb109 service nova] Lock "32471bee-e77e-4a1b-8e00-d938a1373976-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:13:57 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-59e4a30b-3590-4a9d-8b4c-cc10e9af19cf req-d860d009-205f-412b-a87e-5784199fb109 service nova] Lock "32471bee-e77e-4a1b-8e00-d938a1373976-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:13:57 user nova-compute[71874]: DEBUG nova.compute.manager [req-59e4a30b-3590-4a9d-8b4c-cc10e9af19cf req-d860d009-205f-412b-a87e-5784199fb109 service nova] [instance: 32471bee-e77e-4a1b-8e00-d938a1373976] No waiting events found dispatching network-vif-plugged-69029e57-b138-43c1-b31f-59bc7957994d {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:13:57 user nova-compute[71874]: WARNING nova.compute.manager [req-59e4a30b-3590-4a9d-8b4c-cc10e9af19cf req-d860d009-205f-412b-a87e-5784199fb109 service nova] [instance: 32471bee-e77e-4a1b-8e00-d938a1373976] Received unexpected event network-vif-plugged-69029e57-b138-43c1-b31f-59bc7957994d for instance with vm_state building and task_state spawning.
Apr 12 16:13:57 user nova-compute[71874]: INFO nova.compute.manager [None req-112e533a-ce9a-48eb-b86a-b00508431578 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: 32471bee-e77e-4a1b-8e00-d938a1373976] Took 6.54 seconds to build instance.
Apr 12 16:13:57 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-112e533a-ce9a-48eb-b86a-b00508431578 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "32471bee-e77e-4a1b-8e00-d938a1373976" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.640s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:13:58 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:13:59 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:14:00 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-f07e1b0d-e740-46eb-af87-8d455c4c9b84 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Acquiring lock "947c2ca9-fd67-4e8d-b0dc-90c5c827a59e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:14:00 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-f07e1b0d-e740-46eb-af87-8d455c4c9b84 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Lock "947c2ca9-fd67-4e8d-b0dc-90c5c827a59e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:14:00 user nova-compute[71874]: DEBUG nova.compute.manager [None req-f07e1b0d-e740-46eb-af87-8d455c4c9b84 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] [instance: 947c2ca9-fd67-4e8d-b0dc-90c5c827a59e] Starting instance... {{(pid=71874) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 16:14:00 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-f07e1b0d-e740-46eb-af87-8d455c4c9b84 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:14:00 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-f07e1b0d-e740-46eb-af87-8d455c4c9b84 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:14:00 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-f07e1b0d-e740-46eb-af87-8d455c4c9b84 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71874) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 16:14:00 user nova-compute[71874]: INFO nova.compute.claims [None req-f07e1b0d-e740-46eb-af87-8d455c4c9b84 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] [instance: 947c2ca9-fd67-4e8d-b0dc-90c5c827a59e] Claim successful on node user
Apr 12 16:14:00 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-f07e1b0d-e740-46eb-af87-8d455c4c9b84 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Inventory has not changed in ProviderTree for provider: 0e94b4c8-cd49-45e4-9133-d36eb4b2456b {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 16:14:00 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-f07e1b0d-e740-46eb-af87-8d455c4c9b84 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Inventory has not changed for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 16:14:00 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-f07e1b0d-e740-46eb-af87-8d455c4c9b84 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.672s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:14:00 user nova-compute[71874]: DEBUG nova.compute.manager [None req-f07e1b0d-e740-46eb-af87-8d455c4c9b84 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] [instance: 947c2ca9-fd67-4e8d-b0dc-90c5c827a59e] Start building networks asynchronously for instance. {{(pid=71874) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 16:14:00 user nova-compute[71874]: DEBUG nova.compute.manager [None req-f07e1b0d-e740-46eb-af87-8d455c4c9b84 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] [instance: 947c2ca9-fd67-4e8d-b0dc-90c5c827a59e] Allocating IP information in the background. {{(pid=71874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 16:14:00 user nova-compute[71874]: DEBUG nova.network.neutron [None req-f07e1b0d-e740-46eb-af87-8d455c4c9b84 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] [instance: 947c2ca9-fd67-4e8d-b0dc-90c5c827a59e] allocate_for_instance() {{(pid=71874) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 16:14:00 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-f07e1b0d-e740-46eb-af87-8d455c4c9b84 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] [instance: 947c2ca9-fd67-4e8d-b0dc-90c5c827a59e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 16:14:00 user nova-compute[71874]: DEBUG nova.compute.manager [None req-f07e1b0d-e740-46eb-af87-8d455c4c9b84 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] [instance: 947c2ca9-fd67-4e8d-b0dc-90c5c827a59e] Start building block device mappings for instance. {{(pid=71874) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 16:14:01 user nova-compute[71874]: DEBUG nova.policy [None req-f07e1b0d-e740-46eb-af87-8d455c4c9b84 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '38c60e84c47047e2886220f2ef54391d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280a9a56afca4ce591faca7a94eca4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71874) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 16:14:01 user nova-compute[71874]: DEBUG nova.compute.manager [None req-f07e1b0d-e740-46eb-af87-8d455c4c9b84 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] [instance: 947c2ca9-fd67-4e8d-b0dc-90c5c827a59e] Start spawning the instance on the hypervisor. {{(pid=71874) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 16:14:01 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-f07e1b0d-e740-46eb-af87-8d455c4c9b84 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] [instance: 947c2ca9-fd67-4e8d-b0dc-90c5c827a59e] Creating instance directory {{(pid=71874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 16:14:01 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-f07e1b0d-e740-46eb-af87-8d455c4c9b84 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] [instance: 947c2ca9-fd67-4e8d-b0dc-90c5c827a59e] Creating image(s)
Apr 12 16:14:01 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-f07e1b0d-e740-46eb-af87-8d455c4c9b84 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Acquiring lock "/opt/stack/data/nova/instances/947c2ca9-fd67-4e8d-b0dc-90c5c827a59e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:14:01 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-f07e1b0d-e740-46eb-af87-8d455c4c9b84 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Lock "/opt/stack/data/nova/instances/947c2ca9-fd67-4e8d-b0dc-90c5c827a59e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:14:01 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-f07e1b0d-e740-46eb-af87-8d455c4c9b84 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Lock "/opt/stack/data/nova/instances/947c2ca9-fd67-4e8d-b0dc-90c5c827a59e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:14:01 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-f07e1b0d-e740-46eb-af87-8d455c4c9b84 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:14:01 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-f07e1b0d-e740-46eb-af87-8d455c4c9b84 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json" returned: 0 in 0.171s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:14:01 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-f07e1b0d-e740-46eb-af87-8d455c4c9b84 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Acquiring lock "b88df1b37cb431f52bc53b5616015c89b5bec411" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:14:01 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-f07e1b0d-e740-46eb-af87-8d455c4c9b84 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Lock "b88df1b37cb431f52bc53b5616015c89b5bec411" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:14:01 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-f07e1b0d-e740-46eb-af87-8d455c4c9b84 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:14:01 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-f07e1b0d-e740-46eb-af87-8d455c4c9b84 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json" returned: 0 in 0.184s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:14:01 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-f07e1b0d-e740-46eb-af87-8d455c4c9b84 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411,backing_fmt=raw /opt/stack/data/nova/instances/947c2ca9-fd67-4e8d-b0dc-90c5c827a59e/disk 1073741824 {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:14:01 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-f07e1b0d-e740-46eb-af87-8d455c4c9b84 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411,backing_fmt=raw /opt/stack/data/nova/instances/947c2ca9-fd67-4e8d-b0dc-90c5c827a59e/disk 1073741824" returned: 0 in 0.084s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:14:01 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-f07e1b0d-e740-46eb-af87-8d455c4c9b84 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Lock "b88df1b37cb431f52bc53b5616015c89b5bec411" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.276s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:14:01 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-f07e1b0d-e740-46eb-af87-8d455c4c9b84 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:14:01 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-f07e1b0d-e740-46eb-af87-8d455c4c9b84 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json" returned: 0 in 0.157s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:14:01 user nova-compute[71874]: DEBUG nova.virt.disk.api [None req-f07e1b0d-e740-46eb-af87-8d455c4c9b84 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Checking if we can resize image /opt/stack/data/nova/instances/947c2ca9-fd67-4e8d-b0dc-90c5c827a59e/disk. size=1073741824 {{(pid=71874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 16:14:01 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-f07e1b0d-e740-46eb-af87-8d455c4c9b84 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/947c2ca9-fd67-4e8d-b0dc-90c5c827a59e/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:14:01 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:14:01 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-f07e1b0d-e740-46eb-af87-8d455c4c9b84 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/947c2ca9-fd67-4e8d-b0dc-90c5c827a59e/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:14:01 user nova-compute[71874]: DEBUG nova.virt.disk.api [None req-f07e1b0d-e740-46eb-af87-8d455c4c9b84 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Cannot resize image /opt/stack/data/nova/instances/947c2ca9-fd67-4e8d-b0dc-90c5c827a59e/disk to a smaller size. {{(pid=71874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 16:14:01 user nova-compute[71874]: DEBUG nova.objects.instance [None req-f07e1b0d-e740-46eb-af87-8d455c4c9b84 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Lazy-loading 'migration_context' on Instance uuid 947c2ca9-fd67-4e8d-b0dc-90c5c827a59e {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:14:01 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-f07e1b0d-e740-46eb-af87-8d455c4c9b84 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] [instance: 947c2ca9-fd67-4e8d-b0dc-90c5c827a59e] Created local disks {{(pid=71874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 16:14:01 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-f07e1b0d-e740-46eb-af87-8d455c4c9b84 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] [instance: 947c2ca9-fd67-4e8d-b0dc-90c5c827a59e] Ensure instance console log exists: /opt/stack/data/nova/instances/947c2ca9-fd67-4e8d-b0dc-90c5c827a59e/console.log {{(pid=71874) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 16:14:01 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-f07e1b0d-e740-46eb-af87-8d455c4c9b84 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:14:01 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-f07e1b0d-e740-46eb-af87-8d455c4c9b84 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:14:01 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-f07e1b0d-e740-46eb-af87-8d455c4c9b84 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:14:02 user nova-compute[71874]: DEBUG nova.network.neutron [None req-f07e1b0d-e740-46eb-af87-8d455c4c9b84 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] [instance: 947c2ca9-fd67-4e8d-b0dc-90c5c827a59e] Successfully created port: adb08d3a-a6bb-4c1d-8b23-fbe49e6ff7de {{(pid=71874) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 16:14:03 user nova-compute[71874]: DEBUG nova.network.neutron [None req-f07e1b0d-e740-46eb-af87-8d455c4c9b84 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] [instance: 947c2ca9-fd67-4e8d-b0dc-90c5c827a59e] Successfully updated port: adb08d3a-a6bb-4c1d-8b23-fbe49e6ff7de {{(pid=71874) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 16:14:03 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:14:03 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-f07e1b0d-e740-46eb-af87-8d455c4c9b84 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Acquiring lock "refresh_cache-947c2ca9-fd67-4e8d-b0dc-90c5c827a59e" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:14:03 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-f07e1b0d-e740-46eb-af87-8d455c4c9b84 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Acquired lock "refresh_cache-947c2ca9-fd67-4e8d-b0dc-90c5c827a59e" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:14:03 user nova-compute[71874]: DEBUG nova.network.neutron [None req-f07e1b0d-e740-46eb-af87-8d455c4c9b84 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] [instance: 947c2ca9-fd67-4e8d-b0dc-90c5c827a59e] Building network info cache for instance {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 16:14:03 user nova-compute[71874]: DEBUG nova.compute.manager [req-aa2f0061-e87e-457c-945d-70e0c2d39cd5 req-ce197e99-a35d-4350-ad6c-254e9f457f38 service nova] [instance: 947c2ca9-fd67-4e8d-b0dc-90c5c827a59e] Received event network-changed-adb08d3a-a6bb-4c1d-8b23-fbe49e6ff7de {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:14:03 user nova-compute[71874]: DEBUG nova.compute.manager [req-aa2f0061-e87e-457c-945d-70e0c2d39cd5 req-ce197e99-a35d-4350-ad6c-254e9f457f38 service nova] [instance: 947c2ca9-fd67-4e8d-b0dc-90c5c827a59e] Refreshing instance network info cache due to event network-changed-adb08d3a-a6bb-4c1d-8b23-fbe49e6ff7de. {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 16:14:03 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-aa2f0061-e87e-457c-945d-70e0c2d39cd5 req-ce197e99-a35d-4350-ad6c-254e9f457f38 service nova] Acquiring lock "refresh_cache-947c2ca9-fd67-4e8d-b0dc-90c5c827a59e" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:14:03 user nova-compute[71874]: DEBUG nova.network.neutron [None req-f07e1b0d-e740-46eb-af87-8d455c4c9b84 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] [instance: 947c2ca9-fd67-4e8d-b0dc-90c5c827a59e] Instance cache missing network info. {{(pid=71874) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 16:14:03 user nova-compute[71874]: DEBUG nova.network.neutron [None req-f07e1b0d-e740-46eb-af87-8d455c4c9b84 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] [instance: 947c2ca9-fd67-4e8d-b0dc-90c5c827a59e] Updating instance_info_cache with network_info: [{"id": "adb08d3a-a6bb-4c1d-8b23-fbe49e6ff7de", "address": "fa:16:3e:f0:f9:71", "network": {"id": "89a33fcd-81e9-4815-8644-d9b33ceb236b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-241667694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "280a9a56afca4ce591faca7a94eca4b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadb08d3a-a6", "ovs_interfaceid": "adb08d3a-a6bb-4c1d-8b23-fbe49e6ff7de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:14:03 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-f07e1b0d-e740-46eb-af87-8d455c4c9b84 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Releasing lock "refresh_cache-947c2ca9-fd67-4e8d-b0dc-90c5c827a59e" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:14:03 user nova-compute[71874]: DEBUG nova.compute.manager [None req-f07e1b0d-e740-46eb-af87-8d455c4c9b84 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] [instance: 947c2ca9-fd67-4e8d-b0dc-90c5c827a59e] Instance network_info: |[{"id": "adb08d3a-a6bb-4c1d-8b23-fbe49e6ff7de", "address": "fa:16:3e:f0:f9:71", "network": {"id": "89a33fcd-81e9-4815-8644-d9b33ceb236b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-241667694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "280a9a56afca4ce591faca7a94eca4b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadb08d3a-a6", "ovs_interfaceid": "adb08d3a-a6bb-4c1d-8b23-fbe49e6ff7de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 16:14:03 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-aa2f0061-e87e-457c-945d-70e0c2d39cd5 req-ce197e99-a35d-4350-ad6c-254e9f457f38 service nova] Acquired lock "refresh_cache-947c2ca9-fd67-4e8d-b0dc-90c5c827a59e" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:14:03 user nova-compute[71874]: DEBUG nova.network.neutron [req-aa2f0061-e87e-457c-945d-70e0c2d39cd5 req-ce197e99-a35d-4350-ad6c-254e9f457f38 service nova] [instance: 947c2ca9-fd67-4e8d-b0dc-90c5c827a59e] Refreshing network info cache for port adb08d3a-a6bb-4c1d-8b23-fbe49e6ff7de {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 16:14:03 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-f07e1b0d-e740-46eb-af87-8d455c4c9b84 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] [instance: 947c2ca9-fd67-4e8d-b0dc-90c5c827a59e] Start _get_guest_xml network_info=[{"id": "adb08d3a-a6bb-4c1d-8b23-fbe49e6ff7de", "address": "fa:16:3e:f0:f9:71", "network": {"id": "89a33fcd-81e9-4815-8644-d9b33ceb236b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-241667694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "280a9a56afca4ce591faca7a94eca4b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadb08d3a-a6", "ovs_interfaceid": "adb08d3a-a6bb-4c1d-8b23-fbe49e6ff7de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T15:55:37Z,direct_url=<?>,disk_format='qcow2',id=9dc63f14-8b70-4e72-89f2-13464f2f5c7c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='61a4936d9b7744c0b488d81c9b7746b6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T15:55:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_options': None, 'image_id': '9dc63f14-8b70-4e72-89f2-13464f2f5c7c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 16:14:03 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-f07e1b0d-e740-46eb-af87-8d455c4c9b84 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:14:03 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-f07e1b0d-e740-46eb-af87-8d455c4c9b84 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:14:03 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-f07e1b0d-e740-46eb-af87-8d455c4c9b84 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71874) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 16:14:03 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-f07e1b0d-e740-46eb-af87-8d455c4c9b84 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T15:56:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T15:55:37Z,direct_url=<?>,disk_format='qcow2',id=9dc63f14-8b70-4e72-89f2-13464f2f5c7c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='61a4936d9b7744c0b488d81c9b7746b6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T15:55:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 16:14:03 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-f07e1b0d-e740-46eb-af87-8d455c4c9b84 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Flavor limits 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 16:14:03 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-f07e1b0d-e740-46eb-af87-8d455c4c9b84 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Image limits 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 16:14:03 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-f07e1b0d-e740-46eb-af87-8d455c4c9b84 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Flavor pref 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 16:14:03 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-f07e1b0d-e740-46eb-af87-8d455c4c9b84 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Image pref 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 16:14:03 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-f07e1b0d-e740-46eb-af87-8d455c4c9b84 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 16:14:03 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-f07e1b0d-e740-46eb-af87-8d455c4c9b84 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 16:14:03 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-f07e1b0d-e740-46eb-af87-8d455c4c9b84 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 16:14:03 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-f07e1b0d-e740-46eb-af87-8d455c4c9b84 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Got 1 possible topologies {{(pid=71874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 16:14:03 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-f07e1b0d-e740-46eb-af87-8d455c4c9b84 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 16:14:03 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-f07e1b0d-e740-46eb-af87-8d455c4c9b84 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 16:14:03 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-f07e1b0d-e740-46eb-af87-8d455c4c9b84 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T16:13:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1326442338',display_name='tempest-ServersNegativeTestJSON-server-1326442338',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1326442338',id=34,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='280a9a56afca4ce591faca7a94eca4b2',ramdisk_id='',reservation_id='r-is3ttqvp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-2057017930',owner_user_name='tempest-ServersNegativeTestJSON-2057017930-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T16:14:01Z,user_data=None,user_id='38c60e84c47047e2886220f2ef54391d',uuid=947c2ca9-fd67-4e8d-b0dc-90c5c827a59e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "adb08d3a-a6bb-4c1d-8b23-fbe49e6ff7de", "address": "fa:16:3e:f0:f9:71", "network": {"id": "89a33fcd-81e9-4815-8644-d9b33ceb236b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-241667694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "280a9a56afca4ce591faca7a94eca4b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadb08d3a-a6", "ovs_interfaceid": "adb08d3a-a6bb-4c1d-8b23-fbe49e6ff7de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 16:14:03 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-f07e1b0d-e740-46eb-af87-8d455c4c9b84 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Converting VIF {"id": "adb08d3a-a6bb-4c1d-8b23-fbe49e6ff7de", "address": "fa:16:3e:f0:f9:71", "network": {"id": "89a33fcd-81e9-4815-8644-d9b33ceb236b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-241667694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "280a9a56afca4ce591faca7a94eca4b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadb08d3a-a6", "ovs_interfaceid": "adb08d3a-a6bb-4c1d-8b23-fbe49e6ff7de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:14:03 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-f07e1b0d-e740-46eb-af87-8d455c4c9b84 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:f9:71,bridge_name='br-int',has_traffic_filtering=True,id=adb08d3a-a6bb-4c1d-8b23-fbe49e6ff7de,network=Network(89a33fcd-81e9-4815-8644-d9b33ceb236b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadb08d3a-a6') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:14:03 user nova-compute[71874]: DEBUG nova.objects.instance [None req-f07e1b0d-e740-46eb-af87-8d455c4c9b84 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Lazy-loading 'pci_devices' on Instance uuid 947c2ca9-fd67-4e8d-b0dc-90c5c827a59e {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:14:03 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-f07e1b0d-e740-46eb-af87-8d455c4c9b84 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] [instance: 947c2ca9-fd67-4e8d-b0dc-90c5c827a59e] End _get_guest_xml xml=<domain type="kvm">
Apr 12 16:14:03 user nova-compute[71874]:   <uuid>947c2ca9-fd67-4e8d-b0dc-90c5c827a59e</uuid>
Apr 12 16:14:03 user nova-compute[71874]:   <name>instance-00000022</name>
Apr 12 16:14:03 user nova-compute[71874]:   <memory>131072</memory>
Apr 12 16:14:03 user nova-compute[71874]:   <vcpu>1</vcpu>
Apr 12 16:14:03 user nova-compute[71874]:   <metadata>
Apr 12 16:14:03 user nova-compute[71874]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 16:14:03 user nova-compute[71874]:       <nova:package version="0.0.0"/>
Apr 12 16:14:03 user nova-compute[71874]:       <nova:name>tempest-ServersNegativeTestJSON-server-1326442338</nova:name>
Apr 12 16:14:03 user nova-compute[71874]:       <nova:creationTime>2023-04-12 16:14:03</nova:creationTime>
Apr 12 16:14:03 user nova-compute[71874]:       <nova:flavor name="m1.nano">
Apr 12 16:14:03 user nova-compute[71874]:         <nova:memory>128</nova:memory>
Apr 12 16:14:03 user nova-compute[71874]:         <nova:disk>1</nova:disk>
Apr 12 16:14:03 user nova-compute[71874]:         <nova:swap>0</nova:swap>
Apr 12 16:14:03 user nova-compute[71874]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 16:14:03 user nova-compute[71874]:         <nova:vcpus>1</nova:vcpus>
Apr 12 16:14:03 user nova-compute[71874]:       </nova:flavor>
Apr 12 16:14:03 user nova-compute[71874]:       <nova:owner>
Apr 12 16:14:03 user nova-compute[71874]:         <nova:user uuid="38c60e84c47047e2886220f2ef54391d">tempest-ServersNegativeTestJSON-2057017930-project-member</nova:user>
Apr 12 16:14:03 user nova-compute[71874]:         <nova:project uuid="280a9a56afca4ce591faca7a94eca4b2">tempest-ServersNegativeTestJSON-2057017930</nova:project>
Apr 12 16:14:03 user nova-compute[71874]:       </nova:owner>
Apr 12 16:14:03 user nova-compute[71874]:       <nova:root type="image" uuid="9dc63f14-8b70-4e72-89f2-13464f2f5c7c"/>
Apr 12 16:14:03 user nova-compute[71874]:       <nova:ports>
Apr 12 16:14:03 user nova-compute[71874]:         <nova:port uuid="adb08d3a-a6bb-4c1d-8b23-fbe49e6ff7de">
Apr 12 16:14:03 user nova-compute[71874]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 12 16:14:03 user nova-compute[71874]:         </nova:port>
Apr 12 16:14:03 user nova-compute[71874]:       </nova:ports>
Apr 12 16:14:03 user nova-compute[71874]:     </nova:instance>
Apr 12 16:14:03 user nova-compute[71874]:   </metadata>
Apr 12 16:14:03 user nova-compute[71874]:   <sysinfo type="smbios">
Apr 12 16:14:03 user nova-compute[71874]:     <system>
Apr 12 16:14:03 user nova-compute[71874]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 16:14:03 user nova-compute[71874]:       <entry name="product">OpenStack Nova</entry>
Apr 12 16:14:03 user nova-compute[71874]:       <entry name="version">0.0.0</entry>
Apr 12 16:14:03 user nova-compute[71874]:       <entry name="serial">947c2ca9-fd67-4e8d-b0dc-90c5c827a59e</entry>
Apr 12 16:14:03 user nova-compute[71874]:       <entry name="uuid">947c2ca9-fd67-4e8d-b0dc-90c5c827a59e</entry>
Apr 12 16:14:03 user nova-compute[71874]:       <entry name="family">Virtual Machine</entry>
Apr 12 16:14:03 user nova-compute[71874]:     </system>
Apr 12 16:14:03 user nova-compute[71874]:   </sysinfo>
Apr 12 16:14:03 user nova-compute[71874]:   <os>
Apr 12 16:14:03 user nova-compute[71874]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 16:14:03 user nova-compute[71874]:     <boot dev="hd"/>
Apr 12 16:14:03 user nova-compute[71874]:     <smbios mode="sysinfo"/>
Apr 12 16:14:03 user nova-compute[71874]:   </os>
Apr 12 16:14:03 user nova-compute[71874]:   <features>
Apr 12 16:14:03 user nova-compute[71874]:     <acpi/>
Apr 12 16:14:03 user nova-compute[71874]:     <apic/>
Apr 12 16:14:03 user nova-compute[71874]:     <vmcoreinfo/>
Apr 12 16:14:03 user nova-compute[71874]:   </features>
Apr 12 16:14:03 user nova-compute[71874]:   <clock offset="utc">
Apr 12 16:14:03 user nova-compute[71874]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 16:14:03 user nova-compute[71874]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 16:14:03 user nova-compute[71874]:     <timer name="hpet" present="no"/>
Apr 12 16:14:03 user nova-compute[71874]:   </clock>
Apr 12 16:14:03 user nova-compute[71874]:   <cpu mode="custom" match="exact">
Apr 12 16:14:03 user nova-compute[71874]:     <model>Nehalem</model>
Apr 12 16:14:03 user nova-compute[71874]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 16:14:03 user nova-compute[71874]:   </cpu>
Apr 12 16:14:03 user nova-compute[71874]:   <devices>
Apr 12 16:14:03 user nova-compute[71874]:     <disk type="file" device="disk">
Apr 12 16:14:03 user nova-compute[71874]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 16:14:03 user nova-compute[71874]:       <source file="/opt/stack/data/nova/instances/947c2ca9-fd67-4e8d-b0dc-90c5c827a59e/disk"/>
Apr 12 16:14:03 user nova-compute[71874]:       <target dev="vda" bus="virtio"/>
Apr 12 16:14:03 user nova-compute[71874]:     </disk>
Apr 12 16:14:03 user nova-compute[71874]:     <interface type="ethernet">
Apr 12 16:14:03 user nova-compute[71874]:       <mac address="fa:16:3e:f0:f9:71"/>
Apr 12 16:14:03 user nova-compute[71874]:       <model type="virtio"/>
Apr 12 16:14:03 user nova-compute[71874]:       <mtu size="1442"/>
Apr 12 16:14:03 user nova-compute[71874]:       <target dev="tapadb08d3a-a6"/>
Apr 12 16:14:03 user nova-compute[71874]:     </interface>
Apr 12 16:14:03 user nova-compute[71874]:     <serial type="pty">
Apr 12 16:14:03 user nova-compute[71874]:       <log file="/opt/stack/data/nova/instances/947c2ca9-fd67-4e8d-b0dc-90c5c827a59e/console.log" append="off"/>
Apr 12 16:14:03 user nova-compute[71874]:     </serial>
Apr 12 16:14:03 user nova-compute[71874]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 16:14:03 user nova-compute[71874]:     <video>
Apr 12 16:14:03 user nova-compute[71874]:       <model type="virtio"/>
Apr 12 16:14:03 user nova-compute[71874]:     </video>
Apr 12 16:14:03 user nova-compute[71874]:     <rng model="virtio">
Apr 12 16:14:03 user nova-compute[71874]:       <backend model="random">/dev/urandom</backend>
Apr 12 16:14:03 user nova-compute[71874]:     </rng>
Apr 12 16:14:03 user nova-compute[71874]:     <controller type="usb" index="0" model="none"/>
Apr 12 16:14:03 user nova-compute[71874]:     <memballoon model="virtio">
Apr 12 16:14:03 user nova-compute[71874]:       <stats period="10"/>
Apr 12 16:14:03 user nova-compute[71874]:     </memballoon>
Apr 12 16:14:03 user nova-compute[71874]:   </devices>
Apr 12 16:14:03 user nova-compute[71874]: </domain>
Apr 12 16:14:03 user nova-compute[71874]:  {{(pid=71874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 16:14:03 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-f07e1b0d-e740-46eb-af87-8d455c4c9b84 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T16:13:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1326442338',display_name='tempest-ServersNegativeTestJSON-server-1326442338',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1326442338',id=34,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='280a9a56afca4ce591faca7a94eca4b2',ramdisk_id='',reservation_id='r-is3ttqvp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-2057017930',owner_user_name='tempest-ServersNegativeTestJSON-2057017930-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T16:14:01Z,user_data=None,user_id='38c60e84c47047e2886220f2ef54391d',uuid=947c2ca9-fd67-4e8d-b0dc-90c5c827a59e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "adb08d3a-a6bb-4c1d-8b23-fbe49e6ff7de", "address": "fa:16:3e:f0:f9:71", "network": {"id": "89a33fcd-81e9-4815-8644-d9b33ceb236b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-241667694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "280a9a56afca4ce591faca7a94eca4b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadb08d3a-a6", "ovs_interfaceid": "adb08d3a-a6bb-4c1d-8b23-fbe49e6ff7de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 16:14:03 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-f07e1b0d-e740-46eb-af87-8d455c4c9b84 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Converting VIF {"id": "adb08d3a-a6bb-4c1d-8b23-fbe49e6ff7de", "address": "fa:16:3e:f0:f9:71", "network": {"id": "89a33fcd-81e9-4815-8644-d9b33ceb236b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-241667694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "280a9a56afca4ce591faca7a94eca4b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadb08d3a-a6", "ovs_interfaceid": "adb08d3a-a6bb-4c1d-8b23-fbe49e6ff7de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:14:03 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-f07e1b0d-e740-46eb-af87-8d455c4c9b84 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:f9:71,bridge_name='br-int',has_traffic_filtering=True,id=adb08d3a-a6bb-4c1d-8b23-fbe49e6ff7de,network=Network(89a33fcd-81e9-4815-8644-d9b33ceb236b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadb08d3a-a6') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:14:03 user nova-compute[71874]: DEBUG os_vif [None req-f07e1b0d-e740-46eb-af87-8d455c4c9b84 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:f9:71,bridge_name='br-int',has_traffic_filtering=True,id=adb08d3a-a6bb-4c1d-8b23-fbe49e6ff7de,network=Network(89a33fcd-81e9-4815-8644-d9b33ceb236b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadb08d3a-a6') {{(pid=71874) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 16:14:03 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:14:03 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:14:03 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 16:14:03 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:14:03 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapadb08d3a-a6, may_exist=True) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:14:03 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapadb08d3a-a6, col_values=(('external_ids', {'iface-id': 'adb08d3a-a6bb-4c1d-8b23-fbe49e6ff7de', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f0:f9:71', 'vm-uuid': '947c2ca9-fd67-4e8d-b0dc-90c5c827a59e'}),)) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:14:03 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:14:03 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:14:03 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:14:03 user nova-compute[71874]: INFO os_vif [None req-f07e1b0d-e740-46eb-af87-8d455c4c9b84 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:f9:71,bridge_name='br-int',has_traffic_filtering=True,id=adb08d3a-a6bb-4c1d-8b23-fbe49e6ff7de,network=Network(89a33fcd-81e9-4815-8644-d9b33ceb236b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadb08d3a-a6')
Apr 12 16:14:03 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-f07e1b0d-e740-46eb-af87-8d455c4c9b84 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] No BDM found with device name vda, not building metadata. {{(pid=71874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 16:14:03 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-f07e1b0d-e740-46eb-af87-8d455c4c9b84 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] No VIF found with MAC fa:16:3e:f0:f9:71, not building metadata {{(pid=71874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 16:14:04 user nova-compute[71874]: DEBUG nova.network.neutron [req-aa2f0061-e87e-457c-945d-70e0c2d39cd5 req-ce197e99-a35d-4350-ad6c-254e9f457f38 service nova] [instance: 947c2ca9-fd67-4e8d-b0dc-90c5c827a59e] Updated VIF entry in instance network info cache for port adb08d3a-a6bb-4c1d-8b23-fbe49e6ff7de. {{(pid=71874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 16:14:04 user nova-compute[71874]: DEBUG nova.network.neutron [req-aa2f0061-e87e-457c-945d-70e0c2d39cd5 req-ce197e99-a35d-4350-ad6c-254e9f457f38 service nova] [instance: 947c2ca9-fd67-4e8d-b0dc-90c5c827a59e] Updating instance_info_cache with network_info: [{"id": "adb08d3a-a6bb-4c1d-8b23-fbe49e6ff7de", "address": "fa:16:3e:f0:f9:71", "network": {"id": "89a33fcd-81e9-4815-8644-d9b33ceb236b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-241667694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "280a9a56afca4ce591faca7a94eca4b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadb08d3a-a6", "ovs_interfaceid": "adb08d3a-a6bb-4c1d-8b23-fbe49e6ff7de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:14:04 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-aa2f0061-e87e-457c-945d-70e0c2d39cd5 req-ce197e99-a35d-4350-ad6c-254e9f457f38 service nova] Releasing lock "refresh_cache-947c2ca9-fd67-4e8d-b0dc-90c5c827a59e" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:14:04 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-fbc004da-fd5e-4066-894a-101820513765 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Acquiring lock "78b6940a-f97a-4535-8973-3c2a5befbbab" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:14:04 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-fbc004da-fd5e-4066-894a-101820513765 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lock "78b6940a-f97a-4535-8973-3c2a5befbbab" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:14:04 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-fbc004da-fd5e-4066-894a-101820513765 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Acquiring lock "78b6940a-f97a-4535-8973-3c2a5befbbab-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:14:04 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-fbc004da-fd5e-4066-894a-101820513765 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lock "78b6940a-f97a-4535-8973-3c2a5befbbab-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:14:04 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-fbc004da-fd5e-4066-894a-101820513765 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lock "78b6940a-f97a-4535-8973-3c2a5befbbab-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:14:04 user nova-compute[71874]: INFO nova.compute.manager [None req-fbc004da-fd5e-4066-894a-101820513765 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] [instance: 78b6940a-f97a-4535-8973-3c2a5befbbab] Terminating instance
Apr 12 16:14:04 user nova-compute[71874]: DEBUG nova.compute.manager [None req-fbc004da-fd5e-4066-894a-101820513765 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] [instance: 78b6940a-f97a-4535-8973-3c2a5befbbab] Start destroying the instance on the hypervisor. {{(pid=71874) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 16:14:05 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:14:05 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:14:05 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:14:05 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:14:05 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:14:05 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:14:05 user nova-compute[71874]: DEBUG nova.compute.manager [req-92b698b5-8ef2-43ca-92d6-065c2baa5231 req-68de5a00-0f30-434c-8610-f406d619e073 service nova] [instance: 78b6940a-f97a-4535-8973-3c2a5befbbab] Received event network-changed-db313dea-d267-434a-96bb-d099b17ab2d4 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:14:05 user nova-compute[71874]: DEBUG nova.compute.manager [req-92b698b5-8ef2-43ca-92d6-065c2baa5231 req-68de5a00-0f30-434c-8610-f406d619e073 service nova] [instance: 78b6940a-f97a-4535-8973-3c2a5befbbab] Refreshing instance network info cache due to event network-changed-db313dea-d267-434a-96bb-d099b17ab2d4. {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 16:14:05 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-92b698b5-8ef2-43ca-92d6-065c2baa5231 req-68de5a00-0f30-434c-8610-f406d619e073 service nova] Acquiring lock "refresh_cache-78b6940a-f97a-4535-8973-3c2a5befbbab" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:14:05 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-92b698b5-8ef2-43ca-92d6-065c2baa5231 req-68de5a00-0f30-434c-8610-f406d619e073 service nova] Acquired lock "refresh_cache-78b6940a-f97a-4535-8973-3c2a5befbbab" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:14:05 user nova-compute[71874]: DEBUG nova.network.neutron [req-92b698b5-8ef2-43ca-92d6-065c2baa5231 req-68de5a00-0f30-434c-8610-f406d619e073 service nova] [instance: 78b6940a-f97a-4535-8973-3c2a5befbbab] Refreshing network info cache for port db313dea-d267-434a-96bb-d099b17ab2d4 {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 16:14:05 user nova-compute[71874]: DEBUG nova.compute.manager [req-a95e0d96-2cc0-42ec-9909-235a3dc2904b req-787c4bea-88f7-4364-abac-716864a8eed1 service nova] [instance: 78b6940a-f97a-4535-8973-3c2a5befbbab] Received event network-vif-unplugged-db313dea-d267-434a-96bb-d099b17ab2d4 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:14:05 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-a95e0d96-2cc0-42ec-9909-235a3dc2904b req-787c4bea-88f7-4364-abac-716864a8eed1 service nova] Acquiring lock "78b6940a-f97a-4535-8973-3c2a5befbbab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:14:05 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-a95e0d96-2cc0-42ec-9909-235a3dc2904b req-787c4bea-88f7-4364-abac-716864a8eed1 service nova] Lock "78b6940a-f97a-4535-8973-3c2a5befbbab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:14:05 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-a95e0d96-2cc0-42ec-9909-235a3dc2904b req-787c4bea-88f7-4364-abac-716864a8eed1 service nova] Lock "78b6940a-f97a-4535-8973-3c2a5befbbab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:14:05 user nova-compute[71874]: DEBUG nova.compute.manager [req-a95e0d96-2cc0-42ec-9909-235a3dc2904b req-787c4bea-88f7-4364-abac-716864a8eed1 service nova] [instance: 78b6940a-f97a-4535-8973-3c2a5befbbab] No waiting events found dispatching network-vif-unplugged-db313dea-d267-434a-96bb-d099b17ab2d4 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:14:05 user nova-compute[71874]: DEBUG nova.compute.manager [req-a95e0d96-2cc0-42ec-9909-235a3dc2904b req-787c4bea-88f7-4364-abac-716864a8eed1 service nova] [instance: 78b6940a-f97a-4535-8973-3c2a5befbbab] Received event network-vif-unplugged-db313dea-d267-434a-96bb-d099b17ab2d4 for instance with task_state deleting. {{(pid=71874) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 16:14:05 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:14:05 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:14:05 user nova-compute[71874]: DEBUG nova.network.neutron [req-92b698b5-8ef2-43ca-92d6-065c2baa5231 req-68de5a00-0f30-434c-8610-f406d619e073 service nova] [instance: 78b6940a-f97a-4535-8973-3c2a5befbbab] Updated VIF entry in instance network info cache for port db313dea-d267-434a-96bb-d099b17ab2d4. {{(pid=71874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 16:14:05 user nova-compute[71874]: DEBUG nova.network.neutron [req-92b698b5-8ef2-43ca-92d6-065c2baa5231 req-68de5a00-0f30-434c-8610-f406d619e073 service nova] [instance: 78b6940a-f97a-4535-8973-3c2a5befbbab] Updating instance_info_cache with network_info: [{"id": "db313dea-d267-434a-96bb-d099b17ab2d4", "address": "fa:16:3e:4c:7a:4f", "network": {"id": "1c560b5e-bb6f-42eb-b9b2-6b3f2eaed0f8", "bridge": "br-int", "label": "tempest-TestStampPattern-1356757354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a77372a5e83c4fc882b0a0b0eea46f06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb313dea-d2", "ovs_interfaceid": "db313dea-d267-434a-96bb-d099b17ab2d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:14:05 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-92b698b5-8ef2-43ca-92d6-065c2baa5231 req-68de5a00-0f30-434c-8610-f406d619e073 service nova] Releasing lock "refresh_cache-78b6940a-f97a-4535-8973-3c2a5befbbab" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:14:05 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:14:05 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:14:05 user nova-compute[71874]: INFO nova.virt.libvirt.driver [-] [instance: 78b6940a-f97a-4535-8973-3c2a5befbbab] Instance destroyed successfully.
Apr 12 16:14:05 user nova-compute[71874]: DEBUG nova.objects.instance [None req-fbc004da-fd5e-4066-894a-101820513765 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lazy-loading 'resources' on Instance uuid 78b6940a-f97a-4535-8973-3c2a5befbbab {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:14:05 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-fbc004da-fd5e-4066-894a-101820513765 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T16:07:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1441208586',display_name='tempest-TestStampPattern-server-1441208586',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-1441208586',id=24,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM9rCdORWoFaEzbUsNhuoBFSyjDv4K5w82ZJzoi+0Rba6d3tv8xkR5nGe+5wcm9lUrYy4FRmQCBzLyX7FSGTRKcYmN9F41l7pVMhhHvTYmD+PQt4JX5BTIQ1nRCFqJvvxg==',key_name='tempest-TestStampPattern-1321754823',keypairs=<?>,launch_index=0,launched_at=2023-04-12T16:07:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a77372a5e83c4fc882b0a0b0eea46f06',ramdisk_id='',reservation_id='r-3v4gwg0k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1256589700',owner_user_name='tempest-TestStampPattern-1256589700-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T16:10:12Z,user_data=None,user_id='5e0ffc0972674609b17fe2780751dfc5',uuid=78b6940a-f97a-4535-8973-3c2a5befbbab,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "db313dea-d267-434a-96bb-d099b17ab2d4", "address": "fa:16:3e:4c:7a:4f", "network": {"id": "1c560b5e-bb6f-42eb-b9b2-6b3f2eaed0f8", "bridge": "br-int", "label": "tempest-TestStampPattern-1356757354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a77372a5e83c4fc882b0a0b0eea46f06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb313dea-d2", "ovs_interfaceid": "db313dea-d267-434a-96bb-d099b17ab2d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 16:14:05 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-fbc004da-fd5e-4066-894a-101820513765 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Converting VIF {"id": "db313dea-d267-434a-96bb-d099b17ab2d4", "address": "fa:16:3e:4c:7a:4f", "network": {"id": "1c560b5e-bb6f-42eb-b9b2-6b3f2eaed0f8", "bridge": "br-int", "label": "tempest-TestStampPattern-1356757354-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a77372a5e83c4fc882b0a0b0eea46f06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb313dea-d2", "ovs_interfaceid": "db313dea-d267-434a-96bb-d099b17ab2d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:14:05 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-fbc004da-fd5e-4066-894a-101820513765 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4c:7a:4f,bridge_name='br-int',has_traffic_filtering=True,id=db313dea-d267-434a-96bb-d099b17ab2d4,network=Network(1c560b5e-bb6f-42eb-b9b2-6b3f2eaed0f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb313dea-d2') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:14:05 user nova-compute[71874]: DEBUG os_vif [None req-fbc004da-fd5e-4066-894a-101820513765 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4c:7a:4f,bridge_name='br-int',has_traffic_filtering=True,id=db313dea-d267-434a-96bb-d099b17ab2d4,network=Network(1c560b5e-bb6f-42eb-b9b2-6b3f2eaed0f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb313dea-d2') {{(pid=71874) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 16:14:05 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:14:05 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdb313dea-d2, bridge=br-int, if_exists=True) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:14:05 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:14:05 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:14:05 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:14:05 user nova-compute[71874]: INFO os_vif [None req-fbc004da-fd5e-4066-894a-101820513765 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4c:7a:4f,bridge_name='br-int',has_traffic_filtering=True,id=db313dea-d267-434a-96bb-d099b17ab2d4,network=Network(1c560b5e-bb6f-42eb-b9b2-6b3f2eaed0f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb313dea-d2')
Apr 12 16:14:05 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-fbc004da-fd5e-4066-894a-101820513765 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] [instance: 78b6940a-f97a-4535-8973-3c2a5befbbab] Deleting instance files /opt/stack/data/nova/instances/78b6940a-f97a-4535-8973-3c2a5befbbab_del
Apr 12 16:14:05 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-fbc004da-fd5e-4066-894a-101820513765 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] [instance: 78b6940a-f97a-4535-8973-3c2a5befbbab] Deletion of /opt/stack/data/nova/instances/78b6940a-f97a-4535-8973-3c2a5befbbab_del complete
Apr 12 16:14:06 user nova-compute[71874]: INFO nova.compute.manager [None req-fbc004da-fd5e-4066-894a-101820513765 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] [instance: 78b6940a-f97a-4535-8973-3c2a5befbbab] Took 1.11 seconds to destroy the instance on the hypervisor.
Apr 12 16:14:06 user nova-compute[71874]: DEBUG oslo.service.loopingcall [None req-fbc004da-fd5e-4066-894a-101820513765 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71874) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 16:14:06 user nova-compute[71874]: DEBUG nova.compute.manager [-] [instance: 78b6940a-f97a-4535-8973-3c2a5befbbab] Deallocating network for instance {{(pid=71874) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 16:14:06 user nova-compute[71874]: DEBUG nova.network.neutron [-] [instance: 78b6940a-f97a-4535-8973-3c2a5befbbab] deallocate_for_instance() {{(pid=71874) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 16:14:06 user nova-compute[71874]: DEBUG nova.network.neutron [-] [instance: 78b6940a-f97a-4535-8973-3c2a5befbbab] Updating instance_info_cache with network_info: [] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:14:06 user nova-compute[71874]: INFO nova.compute.manager [-] [instance: 78b6940a-f97a-4535-8973-3c2a5befbbab] Took 0.59 seconds to deallocate network for instance.
Apr 12 16:14:06 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-fbc004da-fd5e-4066-894a-101820513765 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:14:06 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-fbc004da-fd5e-4066-894a-101820513765 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:14:07 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-fbc004da-fd5e-4066-894a-101820513765 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Inventory has not changed in ProviderTree for provider: 0e94b4c8-cd49-45e4-9133-d36eb4b2456b {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 16:14:07 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-fbc004da-fd5e-4066-894a-101820513765 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Inventory has not changed for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 16:14:07 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-fbc004da-fd5e-4066-894a-101820513765 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.433s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:14:07 user nova-compute[71874]: INFO nova.scheduler.client.report [None req-fbc004da-fd5e-4066-894a-101820513765 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Deleted allocations for instance 78b6940a-f97a-4535-8973-3c2a5befbbab
Apr 12 16:14:07 user nova-compute[71874]: DEBUG nova.compute.manager [req-3bfb8fe8-d81e-46a9-8a78-1a5fc47f157a req-9583490d-ff86-43be-b734-19f8bf2ef1f6 service nova] [instance: 78b6940a-f97a-4535-8973-3c2a5befbbab] Received event network-vif-deleted-db313dea-d267-434a-96bb-d099b17ab2d4 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:14:07 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-fbc004da-fd5e-4066-894a-101820513765 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lock "78b6940a-f97a-4535-8973-3c2a5befbbab" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.432s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:14:07 user nova-compute[71874]: DEBUG nova.virt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Emitting event <LifecycleEvent: 1681316047.7603526, 947c2ca9-fd67-4e8d-b0dc-90c5c827a59e => Resumed> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:14:07 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 947c2ca9-fd67-4e8d-b0dc-90c5c827a59e] VM Resumed (Lifecycle Event)
Apr 12 16:14:07 user nova-compute[71874]: DEBUG nova.compute.manager [None req-f07e1b0d-e740-46eb-af87-8d455c4c9b84 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] [instance: 947c2ca9-fd67-4e8d-b0dc-90c5c827a59e] Instance event wait completed in 0 seconds for  {{(pid=71874) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 16:14:07 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-f07e1b0d-e740-46eb-af87-8d455c4c9b84 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] [instance: 947c2ca9-fd67-4e8d-b0dc-90c5c827a59e] Guest created on hypervisor {{(pid=71874) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 16:14:07 user nova-compute[71874]: INFO nova.virt.libvirt.driver [-] [instance: 947c2ca9-fd67-4e8d-b0dc-90c5c827a59e] Instance spawned successfully.
Apr 12 16:14:07 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-f07e1b0d-e740-46eb-af87-8d455c4c9b84 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] [instance: 947c2ca9-fd67-4e8d-b0dc-90c5c827a59e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 16:14:07 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 947c2ca9-fd67-4e8d-b0dc-90c5c827a59e] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:14:07 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 947c2ca9-fd67-4e8d-b0dc-90c5c827a59e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 16:14:07 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-f07e1b0d-e740-46eb-af87-8d455c4c9b84 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] [instance: 947c2ca9-fd67-4e8d-b0dc-90c5c827a59e] Found default for hw_cdrom_bus of ide {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:14:07 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-f07e1b0d-e740-46eb-af87-8d455c4c9b84 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] [instance: 947c2ca9-fd67-4e8d-b0dc-90c5c827a59e] Found default for hw_disk_bus of virtio {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:14:07 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-f07e1b0d-e740-46eb-af87-8d455c4c9b84 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] [instance: 947c2ca9-fd67-4e8d-b0dc-90c5c827a59e] Found default for hw_input_bus of None {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:14:07 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-f07e1b0d-e740-46eb-af87-8d455c4c9b84 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] [instance: 947c2ca9-fd67-4e8d-b0dc-90c5c827a59e] Found default for hw_pointer_model of None {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:14:07 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-f07e1b0d-e740-46eb-af87-8d455c4c9b84 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] [instance: 947c2ca9-fd67-4e8d-b0dc-90c5c827a59e] Found default for hw_video_model of virtio {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:14:07 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-f07e1b0d-e740-46eb-af87-8d455c4c9b84 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] [instance: 947c2ca9-fd67-4e8d-b0dc-90c5c827a59e] Found default for hw_vif_model of virtio {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:14:07 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 947c2ca9-fd67-4e8d-b0dc-90c5c827a59e] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 16:14:07 user nova-compute[71874]: DEBUG nova.virt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Emitting event <LifecycleEvent: 1681316047.7615552, 947c2ca9-fd67-4e8d-b0dc-90c5c827a59e => Started> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:14:07 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 947c2ca9-fd67-4e8d-b0dc-90c5c827a59e] VM Started (Lifecycle Event)
Apr 12 16:14:07 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 947c2ca9-fd67-4e8d-b0dc-90c5c827a59e] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:14:07 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 947c2ca9-fd67-4e8d-b0dc-90c5c827a59e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 16:14:07 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 947c2ca9-fd67-4e8d-b0dc-90c5c827a59e] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 16:14:07 user nova-compute[71874]: INFO nova.compute.manager [None req-f07e1b0d-e740-46eb-af87-8d455c4c9b84 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] [instance: 947c2ca9-fd67-4e8d-b0dc-90c5c827a59e] Took 6.83 seconds to spawn the instance on the hypervisor.
Apr 12 16:14:07 user nova-compute[71874]: DEBUG nova.compute.manager [None req-f07e1b0d-e740-46eb-af87-8d455c4c9b84 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] [instance: 947c2ca9-fd67-4e8d-b0dc-90c5c827a59e] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:14:07 user nova-compute[71874]: DEBUG nova.compute.manager [req-72307bd5-d146-4539-801b-a21c6158b9c5 req-6b9da292-6145-44a3-8943-b06a6b41f12a service nova] [instance: 78b6940a-f97a-4535-8973-3c2a5befbbab] Received event network-vif-plugged-db313dea-d267-434a-96bb-d099b17ab2d4 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:14:07 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-72307bd5-d146-4539-801b-a21c6158b9c5 req-6b9da292-6145-44a3-8943-b06a6b41f12a service nova] Acquiring lock "78b6940a-f97a-4535-8973-3c2a5befbbab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:14:07 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-72307bd5-d146-4539-801b-a21c6158b9c5 req-6b9da292-6145-44a3-8943-b06a6b41f12a service nova] Lock "78b6940a-f97a-4535-8973-3c2a5befbbab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:14:07 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-72307bd5-d146-4539-801b-a21c6158b9c5 req-6b9da292-6145-44a3-8943-b06a6b41f12a service nova] Lock "78b6940a-f97a-4535-8973-3c2a5befbbab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:14:07 user nova-compute[71874]: DEBUG nova.compute.manager [req-72307bd5-d146-4539-801b-a21c6158b9c5 req-6b9da292-6145-44a3-8943-b06a6b41f12a service nova] [instance: 78b6940a-f97a-4535-8973-3c2a5befbbab] No waiting events found dispatching network-vif-plugged-db313dea-d267-434a-96bb-d099b17ab2d4 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:14:07 user nova-compute[71874]: WARNING nova.compute.manager [req-72307bd5-d146-4539-801b-a21c6158b9c5 req-6b9da292-6145-44a3-8943-b06a6b41f12a service nova] [instance: 78b6940a-f97a-4535-8973-3c2a5befbbab] Received unexpected event network-vif-plugged-db313dea-d267-434a-96bb-d099b17ab2d4 for instance with vm_state deleted and task_state None.
Apr 12 16:14:07 user nova-compute[71874]: DEBUG nova.compute.manager [req-72307bd5-d146-4539-801b-a21c6158b9c5 req-6b9da292-6145-44a3-8943-b06a6b41f12a service nova] [instance: 947c2ca9-fd67-4e8d-b0dc-90c5c827a59e] Received event network-vif-plugged-adb08d3a-a6bb-4c1d-8b23-fbe49e6ff7de {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:14:07 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-72307bd5-d146-4539-801b-a21c6158b9c5 req-6b9da292-6145-44a3-8943-b06a6b41f12a service nova] Acquiring lock "947c2ca9-fd67-4e8d-b0dc-90c5c827a59e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:14:07 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-72307bd5-d146-4539-801b-a21c6158b9c5 req-6b9da292-6145-44a3-8943-b06a6b41f12a service nova] Lock "947c2ca9-fd67-4e8d-b0dc-90c5c827a59e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:14:07 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-72307bd5-d146-4539-801b-a21c6158b9c5 req-6b9da292-6145-44a3-8943-b06a6b41f12a service nova] Lock "947c2ca9-fd67-4e8d-b0dc-90c5c827a59e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:14:07 user nova-compute[71874]: DEBUG nova.compute.manager [req-72307bd5-d146-4539-801b-a21c6158b9c5 req-6b9da292-6145-44a3-8943-b06a6b41f12a service nova] [instance: 947c2ca9-fd67-4e8d-b0dc-90c5c827a59e] No waiting events found dispatching network-vif-plugged-adb08d3a-a6bb-4c1d-8b23-fbe49e6ff7de {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:14:07 user nova-compute[71874]: WARNING nova.compute.manager [req-72307bd5-d146-4539-801b-a21c6158b9c5 req-6b9da292-6145-44a3-8943-b06a6b41f12a service nova] [instance: 947c2ca9-fd67-4e8d-b0dc-90c5c827a59e] Received unexpected event network-vif-plugged-adb08d3a-a6bb-4c1d-8b23-fbe49e6ff7de for instance with vm_state building and task_state spawning.
Apr 12 16:14:07 user nova-compute[71874]: DEBUG nova.compute.manager [req-72307bd5-d146-4539-801b-a21c6158b9c5 req-6b9da292-6145-44a3-8943-b06a6b41f12a service nova] [instance: 947c2ca9-fd67-4e8d-b0dc-90c5c827a59e] Received event network-vif-plugged-adb08d3a-a6bb-4c1d-8b23-fbe49e6ff7de {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:14:07 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-72307bd5-d146-4539-801b-a21c6158b9c5 req-6b9da292-6145-44a3-8943-b06a6b41f12a service nova] Acquiring lock "947c2ca9-fd67-4e8d-b0dc-90c5c827a59e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:14:07 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-72307bd5-d146-4539-801b-a21c6158b9c5 req-6b9da292-6145-44a3-8943-b06a6b41f12a service nova] Lock "947c2ca9-fd67-4e8d-b0dc-90c5c827a59e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:14:07 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-72307bd5-d146-4539-801b-a21c6158b9c5 req-6b9da292-6145-44a3-8943-b06a6b41f12a service nova] Lock "947c2ca9-fd67-4e8d-b0dc-90c5c827a59e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:14:07 user nova-compute[71874]: DEBUG nova.compute.manager [req-72307bd5-d146-4539-801b-a21c6158b9c5 req-6b9da292-6145-44a3-8943-b06a6b41f12a service nova] [instance: 947c2ca9-fd67-4e8d-b0dc-90c5c827a59e] No waiting events found dispatching network-vif-plugged-adb08d3a-a6bb-4c1d-8b23-fbe49e6ff7de {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:14:07 user nova-compute[71874]: WARNING nova.compute.manager [req-72307bd5-d146-4539-801b-a21c6158b9c5 req-6b9da292-6145-44a3-8943-b06a6b41f12a service nova] [instance: 947c2ca9-fd67-4e8d-b0dc-90c5c827a59e] Received unexpected event network-vif-plugged-adb08d3a-a6bb-4c1d-8b23-fbe49e6ff7de for instance with vm_state building and task_state spawning.
Apr 12 16:14:07 user nova-compute[71874]: INFO nova.compute.manager [None req-f07e1b0d-e740-46eb-af87-8d455c4c9b84 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] [instance: 947c2ca9-fd67-4e8d-b0dc-90c5c827a59e] Took 7.88 seconds to build instance.
Apr 12 16:14:08 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-f07e1b0d-e740-46eb-af87-8d455c4c9b84 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Lock "947c2ca9-fd67-4e8d-b0dc-90c5c827a59e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.986s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:14:08 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:14:10 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:14:13 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:14:15 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:14:16 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-f63bb32e-8c68-4c53-b2f2-2d7a0a74f5c8 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Acquiring lock "b4c37cbf-1743-4dd5-97fd-2bb12ebee763" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:14:16 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-f63bb32e-8c68-4c53-b2f2-2d7a0a74f5c8 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "b4c37cbf-1743-4dd5-97fd-2bb12ebee763" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:14:16 user nova-compute[71874]: DEBUG nova.compute.manager [None req-f63bb32e-8c68-4c53-b2f2-2d7a0a74f5c8 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] Starting instance... {{(pid=71874) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 16:14:16 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-f63bb32e-8c68-4c53-b2f2-2d7a0a74f5c8 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:14:16 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-f63bb32e-8c68-4c53-b2f2-2d7a0a74f5c8 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:14:16 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-f63bb32e-8c68-4c53-b2f2-2d7a0a74f5c8 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71874) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 16:14:16 user nova-compute[71874]: INFO nova.compute.claims [None req-f63bb32e-8c68-4c53-b2f2-2d7a0a74f5c8 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] Claim successful on node user
Apr 12 16:14:16 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-f63bb32e-8c68-4c53-b2f2-2d7a0a74f5c8 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Inventory has not changed in ProviderTree for provider: 0e94b4c8-cd49-45e4-9133-d36eb4b2456b {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 16:14:16 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-f63bb32e-8c68-4c53-b2f2-2d7a0a74f5c8 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Inventory has not changed for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 16:14:16 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-f63bb32e-8c68-4c53-b2f2-2d7a0a74f5c8 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.453s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:14:16 user nova-compute[71874]: DEBUG nova.compute.manager [None req-f63bb32e-8c68-4c53-b2f2-2d7a0a74f5c8 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] Start building networks asynchronously for instance. {{(pid=71874) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 16:14:16 user nova-compute[71874]: DEBUG nova.compute.manager [None req-f63bb32e-8c68-4c53-b2f2-2d7a0a74f5c8 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] Allocating IP information in the background. {{(pid=71874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 16:14:16 user nova-compute[71874]: DEBUG nova.network.neutron [None req-f63bb32e-8c68-4c53-b2f2-2d7a0a74f5c8 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] allocate_for_instance() {{(pid=71874) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 16:14:16 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-f63bb32e-8c68-4c53-b2f2-2d7a0a74f5c8 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 16:14:16 user nova-compute[71874]: DEBUG nova.compute.manager [None req-f63bb32e-8c68-4c53-b2f2-2d7a0a74f5c8 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] Start building block device mappings for instance. {{(pid=71874) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 16:14:17 user nova-compute[71874]: DEBUG nova.policy [None req-f63bb32e-8c68-4c53-b2f2-2d7a0a74f5c8 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '16a68fa3490940ebaebc8d4ca5746f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236b9e609eb44071bc88971bff96931e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71874) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 16:14:17 user nova-compute[71874]: DEBUG nova.compute.manager [None req-f63bb32e-8c68-4c53-b2f2-2d7a0a74f5c8 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] Start spawning the instance on the hypervisor. {{(pid=71874) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 16:14:17 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-f63bb32e-8c68-4c53-b2f2-2d7a0a74f5c8 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] Creating instance directory {{(pid=71874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 16:14:17 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-f63bb32e-8c68-4c53-b2f2-2d7a0a74f5c8 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] Creating image(s)
Apr 12 16:14:17 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-f63bb32e-8c68-4c53-b2f2-2d7a0a74f5c8 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Acquiring lock "/opt/stack/data/nova/instances/b4c37cbf-1743-4dd5-97fd-2bb12ebee763/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:14:17 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-f63bb32e-8c68-4c53-b2f2-2d7a0a74f5c8 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "/opt/stack/data/nova/instances/b4c37cbf-1743-4dd5-97fd-2bb12ebee763/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:14:17 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-f63bb32e-8c68-4c53-b2f2-2d7a0a74f5c8 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "/opt/stack/data/nova/instances/b4c37cbf-1743-4dd5-97fd-2bb12ebee763/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.010s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:14:17 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-f63bb32e-8c68-4c53-b2f2-2d7a0a74f5c8 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Acquiring lock "92a18b5f5398a823902242dbe89b6c17acd30aab" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:14:17 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-f63bb32e-8c68-4c53-b2f2-2d7a0a74f5c8 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "92a18b5f5398a823902242dbe89b6c17acd30aab" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:14:17 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-f63bb32e-8c68-4c53-b2f2-2d7a0a74f5c8 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/92a18b5f5398a823902242dbe89b6c17acd30aab.part --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:14:17 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-f63bb32e-8c68-4c53-b2f2-2d7a0a74f5c8 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/92a18b5f5398a823902242dbe89b6c17acd30aab.part --force-share --output=json" returned: 0 in 0.140s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:14:17 user nova-compute[71874]: DEBUG nova.virt.images [None req-f63bb32e-8c68-4c53-b2f2-2d7a0a74f5c8 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] f2a10ad0-dd56-4297-aed7-ce5d72ea953b was qcow2, converting to raw {{(pid=71874) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 12 16:14:17 user nova-compute[71874]: DEBUG nova.privsep.utils [None req-f63bb32e-8c68-4c53-b2f2-2d7a0a74f5c8 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71874) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 12 16:14:17 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-f63bb32e-8c68-4c53-b2f2-2d7a0a74f5c8 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/92a18b5f5398a823902242dbe89b6c17acd30aab.part /opt/stack/data/nova/instances/_base/92a18b5f5398a823902242dbe89b6c17acd30aab.converted {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:14:17 user nova-compute[71874]: DEBUG nova.network.neutron [None req-f63bb32e-8c68-4c53-b2f2-2d7a0a74f5c8 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] Successfully created port: d023dabe-13d5-4bbb-aa87-e9c1f5f1a048 {{(pid=71874) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 16:14:17 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-f63bb32e-8c68-4c53-b2f2-2d7a0a74f5c8 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/92a18b5f5398a823902242dbe89b6c17acd30aab.part /opt/stack/data/nova/instances/_base/92a18b5f5398a823902242dbe89b6c17acd30aab.converted" returned: 0 in 0.160s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:14:17 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-f63bb32e-8c68-4c53-b2f2-2d7a0a74f5c8 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/92a18b5f5398a823902242dbe89b6c17acd30aab.converted --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:14:18 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-f63bb32e-8c68-4c53-b2f2-2d7a0a74f5c8 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/92a18b5f5398a823902242dbe89b6c17acd30aab.converted --force-share --output=json" returned: 0 in 0.152s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:14:18 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-f63bb32e-8c68-4c53-b2f2-2d7a0a74f5c8 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "92a18b5f5398a823902242dbe89b6c17acd30aab" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.912s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:14:18 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-f63bb32e-8c68-4c53-b2f2-2d7a0a74f5c8 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/92a18b5f5398a823902242dbe89b6c17acd30aab --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:14:18 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:14:18 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-f63bb32e-8c68-4c53-b2f2-2d7a0a74f5c8 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/92a18b5f5398a823902242dbe89b6c17acd30aab --force-share --output=json" returned: 0 in 0.175s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:14:18 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-f63bb32e-8c68-4c53-b2f2-2d7a0a74f5c8 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Acquiring lock "92a18b5f5398a823902242dbe89b6c17acd30aab" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:14:18 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-f63bb32e-8c68-4c53-b2f2-2d7a0a74f5c8 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "92a18b5f5398a823902242dbe89b6c17acd30aab" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:14:18 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-f63bb32e-8c68-4c53-b2f2-2d7a0a74f5c8 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/92a18b5f5398a823902242dbe89b6c17acd30aab --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:14:18 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-f63bb32e-8c68-4c53-b2f2-2d7a0a74f5c8 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/92a18b5f5398a823902242dbe89b6c17acd30aab --force-share --output=json" returned: 0 in 0.147s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:14:18 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-f63bb32e-8c68-4c53-b2f2-2d7a0a74f5c8 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/92a18b5f5398a823902242dbe89b6c17acd30aab,backing_fmt=raw /opt/stack/data/nova/instances/b4c37cbf-1743-4dd5-97fd-2bb12ebee763/disk 1073741824 {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:14:18 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-f63bb32e-8c68-4c53-b2f2-2d7a0a74f5c8 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/92a18b5f5398a823902242dbe89b6c17acd30aab,backing_fmt=raw /opt/stack/data/nova/instances/b4c37cbf-1743-4dd5-97fd-2bb12ebee763/disk 1073741824" returned: 0 in 0.062s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:14:18 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-f63bb32e-8c68-4c53-b2f2-2d7a0a74f5c8 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "92a18b5f5398a823902242dbe89b6c17acd30aab" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.219s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:14:18 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-f63bb32e-8c68-4c53-b2f2-2d7a0a74f5c8 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/92a18b5f5398a823902242dbe89b6c17acd30aab --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:14:18 user nova-compute[71874]: DEBUG nova.network.neutron [None req-f63bb32e-8c68-4c53-b2f2-2d7a0a74f5c8 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] Successfully updated port: d023dabe-13d5-4bbb-aa87-e9c1f5f1a048 {{(pid=71874) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 16:14:18 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-f63bb32e-8c68-4c53-b2f2-2d7a0a74f5c8 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Acquiring lock "refresh_cache-b4c37cbf-1743-4dd5-97fd-2bb12ebee763" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:14:18 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-f63bb32e-8c68-4c53-b2f2-2d7a0a74f5c8 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Acquired lock "refresh_cache-b4c37cbf-1743-4dd5-97fd-2bb12ebee763" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:14:18 user nova-compute[71874]: DEBUG nova.network.neutron [None req-f63bb32e-8c68-4c53-b2f2-2d7a0a74f5c8 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] Building network info cache for instance {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 16:14:18 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-f63bb32e-8c68-4c53-b2f2-2d7a0a74f5c8 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/92a18b5f5398a823902242dbe89b6c17acd30aab --force-share --output=json" returned: 0 in 0.141s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:14:18 user nova-compute[71874]: DEBUG nova.virt.disk.api [None req-f63bb32e-8c68-4c53-b2f2-2d7a0a74f5c8 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b4c37cbf-1743-4dd5-97fd-2bb12ebee763/disk. size=1073741824 {{(pid=71874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 16:14:18 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-f63bb32e-8c68-4c53-b2f2-2d7a0a74f5c8 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4c37cbf-1743-4dd5-97fd-2bb12ebee763/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:14:18 user nova-compute[71874]: DEBUG nova.compute.manager [req-81873284-0fc2-4344-a284-90e050149f35 req-7cf7e2a2-262f-49b7-8895-a701271dc58e service nova] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] Received event network-changed-d023dabe-13d5-4bbb-aa87-e9c1f5f1a048 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:14:18 user nova-compute[71874]: DEBUG nova.compute.manager [req-81873284-0fc2-4344-a284-90e050149f35 req-7cf7e2a2-262f-49b7-8895-a701271dc58e service nova] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] Refreshing instance network info cache due to event network-changed-d023dabe-13d5-4bbb-aa87-e9c1f5f1a048. {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 16:14:18 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-81873284-0fc2-4344-a284-90e050149f35 req-7cf7e2a2-262f-49b7-8895-a701271dc58e service nova] Acquiring lock "refresh_cache-b4c37cbf-1743-4dd5-97fd-2bb12ebee763" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:14:18 user nova-compute[71874]: DEBUG nova.network.neutron [None req-f63bb32e-8c68-4c53-b2f2-2d7a0a74f5c8 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] Instance cache missing network info. {{(pid=71874) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 16:14:18 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-f63bb32e-8c68-4c53-b2f2-2d7a0a74f5c8 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4c37cbf-1743-4dd5-97fd-2bb12ebee763/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:14:18 user nova-compute[71874]: DEBUG nova.virt.disk.api [None req-f63bb32e-8c68-4c53-b2f2-2d7a0a74f5c8 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Cannot resize image /opt/stack/data/nova/instances/b4c37cbf-1743-4dd5-97fd-2bb12ebee763/disk to a smaller size. {{(pid=71874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 16:14:18 user nova-compute[71874]: DEBUG nova.objects.instance [None req-f63bb32e-8c68-4c53-b2f2-2d7a0a74f5c8 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lazy-loading 'migration_context' on Instance uuid b4c37cbf-1743-4dd5-97fd-2bb12ebee763 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:14:18 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-f63bb32e-8c68-4c53-b2f2-2d7a0a74f5c8 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] Created local disks {{(pid=71874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 16:14:18 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-f63bb32e-8c68-4c53-b2f2-2d7a0a74f5c8 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] Ensure instance console log exists: /opt/stack/data/nova/instances/b4c37cbf-1743-4dd5-97fd-2bb12ebee763/console.log {{(pid=71874) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 16:14:18 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-f63bb32e-8c68-4c53-b2f2-2d7a0a74f5c8 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:14:18 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-f63bb32e-8c68-4c53-b2f2-2d7a0a74f5c8 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:14:18 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-f63bb32e-8c68-4c53-b2f2-2d7a0a74f5c8 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:14:19 user nova-compute[71874]: DEBUG nova.network.neutron [None req-f63bb32e-8c68-4c53-b2f2-2d7a0a74f5c8 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] Updating instance_info_cache with network_info: [{"id": "d023dabe-13d5-4bbb-aa87-e9c1f5f1a048", "address": "fa:16:3e:59:df:38", "network": {"id": "58f92787-e3b6-4fd3-bd75-7169f1a36651", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-614349033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "236b9e609eb44071bc88971bff96931e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd023dabe-13", "ovs_interfaceid": "d023dabe-13d5-4bbb-aa87-e9c1f5f1a048", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:14:19 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-f63bb32e-8c68-4c53-b2f2-2d7a0a74f5c8 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Releasing lock "refresh_cache-b4c37cbf-1743-4dd5-97fd-2bb12ebee763" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:14:19 user nova-compute[71874]: DEBUG nova.compute.manager [None req-f63bb32e-8c68-4c53-b2f2-2d7a0a74f5c8 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] Instance network_info: |[{"id": "d023dabe-13d5-4bbb-aa87-e9c1f5f1a048", "address": "fa:16:3e:59:df:38", "network": {"id": "58f92787-e3b6-4fd3-bd75-7169f1a36651", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-614349033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "236b9e609eb44071bc88971bff96931e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd023dabe-13", "ovs_interfaceid": "d023dabe-13d5-4bbb-aa87-e9c1f5f1a048", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 16:14:19 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-81873284-0fc2-4344-a284-90e050149f35 req-7cf7e2a2-262f-49b7-8895-a701271dc58e service nova] Acquired lock "refresh_cache-b4c37cbf-1743-4dd5-97fd-2bb12ebee763" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:14:19 user nova-compute[71874]: DEBUG nova.network.neutron [req-81873284-0fc2-4344-a284-90e050149f35 req-7cf7e2a2-262f-49b7-8895-a701271dc58e service nova] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] Refreshing network info cache for port d023dabe-13d5-4bbb-aa87-e9c1f5f1a048 {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 16:14:19 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-f63bb32e-8c68-4c53-b2f2-2d7a0a74f5c8 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] Start _get_guest_xml network_info=[{"id": "d023dabe-13d5-4bbb-aa87-e9c1f5f1a048", "address": "fa:16:3e:59:df:38", "network": {"id": "58f92787-e3b6-4fd3-bd75-7169f1a36651", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-614349033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "236b9e609eb44071bc88971bff96931e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd023dabe-13", "ovs_interfaceid": "d023dabe-13d5-4bbb-aa87-e9c1f5f1a048", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T16:14:13Z,direct_url=<?>,disk_format='qcow2',id=f2a10ad0-dd56-4297-aed7-ce5d72ea953b,min_disk=0,min_ram=0,name='tempest-scenario-img--957141521',owner='236b9e609eb44071bc88971bff96931e',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T16:14:15Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_options': None, 'image_id': 'f2a10ad0-dd56-4297-aed7-ce5d72ea953b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 16:14:19 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-f63bb32e-8c68-4c53-b2f2-2d7a0a74f5c8 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:14:19 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-f63bb32e-8c68-4c53-b2f2-2d7a0a74f5c8 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:14:19 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-f63bb32e-8c68-4c53-b2f2-2d7a0a74f5c8 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71874) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 16:14:19 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-f63bb32e-8c68-4c53-b2f2-2d7a0a74f5c8 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T15:56:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T16:14:13Z,direct_url=<?>,disk_format='qcow2',id=f2a10ad0-dd56-4297-aed7-ce5d72ea953b,min_disk=0,min_ram=0,name='tempest-scenario-img--957141521',owner='236b9e609eb44071bc88971bff96931e',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T16:14:15Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 16:14:19 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-f63bb32e-8c68-4c53-b2f2-2d7a0a74f5c8 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Flavor limits 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 16:14:19 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-f63bb32e-8c68-4c53-b2f2-2d7a0a74f5c8 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Image limits 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 16:14:19 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-f63bb32e-8c68-4c53-b2f2-2d7a0a74f5c8 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Flavor pref 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 16:14:19 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-f63bb32e-8c68-4c53-b2f2-2d7a0a74f5c8 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Image pref 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 16:14:19 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-f63bb32e-8c68-4c53-b2f2-2d7a0a74f5c8 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 16:14:19 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-f63bb32e-8c68-4c53-b2f2-2d7a0a74f5c8 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 16:14:19 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-f63bb32e-8c68-4c53-b2f2-2d7a0a74f5c8 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 16:14:19 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-f63bb32e-8c68-4c53-b2f2-2d7a0a74f5c8 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Got 1 possible topologies {{(pid=71874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 16:14:19 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-f63bb32e-8c68-4c53-b2f2-2d7a0a74f5c8 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 16:14:19 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-f63bb32e-8c68-4c53-b2f2-2d7a0a74f5c8 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 16:14:19 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-f63bb32e-8c68-4c53-b2f2-2d7a0a74f5c8 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T16:14:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1831226458',display_name='tempest-TestMinimumBasicScenario-server-1831226458',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1831226458',id=35,image_ref='f2a10ad0-dd56-4297-aed7-ce5d72ea953b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNbxR7XOwk113oWUkXlckv3xW8Ml31qZ6CdwMA2FLaXgBX+cAx40ag2FfMVKhGuA7H5T7OmtJlyS1451of3/3trw1T7Q3yghc0E0SJ2p2NDvcjF3/krMejZ/FZS/hV4u4g==',key_name='tempest-TestMinimumBasicScenario-1912647637',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='236b9e609eb44071bc88971bff96931e',ramdisk_id='',reservation_id='r-g8bpe8bm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f2a10ad0-dd56-4297-aed7-ce5d72ea953b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1374695003',owner_user_name='tempest-TestMinimumBasicScenario-1374695003-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T16:14:17Z,user_data=None,user_id='16a68fa3490940ebaebc8d4ca5746f6e',uuid=b4c37cbf-1743-4dd5-97fd-2bb12ebee763,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d023dabe-13d5-4bbb-aa87-e9c1f5f1a048", "address": "fa:16:3e:59:df:38", "network": {"id": "58f92787-e3b6-4fd3-bd75-7169f1a36651", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-614349033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "236b9e609eb44071bc88971bff96931e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd023dabe-13", "ovs_interfaceid": "d023dabe-13d5-4bbb-aa87-e9c1f5f1a048", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 16:14:19 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-f63bb32e-8c68-4c53-b2f2-2d7a0a74f5c8 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Converting VIF {"id": "d023dabe-13d5-4bbb-aa87-e9c1f5f1a048", "address": "fa:16:3e:59:df:38", "network": {"id": "58f92787-e3b6-4fd3-bd75-7169f1a36651", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-614349033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "236b9e609eb44071bc88971bff96931e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd023dabe-13", "ovs_interfaceid": "d023dabe-13d5-4bbb-aa87-e9c1f5f1a048", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:14:19 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-f63bb32e-8c68-4c53-b2f2-2d7a0a74f5c8 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:df:38,bridge_name='br-int',has_traffic_filtering=True,id=d023dabe-13d5-4bbb-aa87-e9c1f5f1a048,network=Network(58f92787-e3b6-4fd3-bd75-7169f1a36651),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd023dabe-13') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:14:19 user nova-compute[71874]: DEBUG nova.objects.instance [None req-f63bb32e-8c68-4c53-b2f2-2d7a0a74f5c8 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lazy-loading 'pci_devices' on Instance uuid b4c37cbf-1743-4dd5-97fd-2bb12ebee763 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:14:19 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-f63bb32e-8c68-4c53-b2f2-2d7a0a74f5c8 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] End _get_guest_xml xml=<domain type="kvm">
Apr 12 16:14:19 user nova-compute[71874]:   <uuid>b4c37cbf-1743-4dd5-97fd-2bb12ebee763</uuid>
Apr 12 16:14:19 user nova-compute[71874]:   <name>instance-00000023</name>
Apr 12 16:14:19 user nova-compute[71874]:   <memory>131072</memory>
Apr 12 16:14:19 user nova-compute[71874]:   <vcpu>1</vcpu>
Apr 12 16:14:19 user nova-compute[71874]:   <metadata>
Apr 12 16:14:19 user nova-compute[71874]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 16:14:19 user nova-compute[71874]:       <nova:package version="0.0.0"/>
Apr 12 16:14:19 user nova-compute[71874]:       <nova:name>tempest-TestMinimumBasicScenario-server-1831226458</nova:name>
Apr 12 16:14:19 user nova-compute[71874]:       <nova:creationTime>2023-04-12 16:14:19</nova:creationTime>
Apr 12 16:14:19 user nova-compute[71874]:       <nova:flavor name="m1.nano">
Apr 12 16:14:19 user nova-compute[71874]:         <nova:memory>128</nova:memory>
Apr 12 16:14:19 user nova-compute[71874]:         <nova:disk>1</nova:disk>
Apr 12 16:14:19 user nova-compute[71874]:         <nova:swap>0</nova:swap>
Apr 12 16:14:19 user nova-compute[71874]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 16:14:19 user nova-compute[71874]:         <nova:vcpus>1</nova:vcpus>
Apr 12 16:14:19 user nova-compute[71874]:       </nova:flavor>
Apr 12 16:14:19 user nova-compute[71874]:       <nova:owner>
Apr 12 16:14:19 user nova-compute[71874]:         <nova:user uuid="16a68fa3490940ebaebc8d4ca5746f6e">tempest-TestMinimumBasicScenario-1374695003-project-member</nova:user>
Apr 12 16:14:19 user nova-compute[71874]:         <nova:project uuid="236b9e609eb44071bc88971bff96931e">tempest-TestMinimumBasicScenario-1374695003</nova:project>
Apr 12 16:14:19 user nova-compute[71874]:       </nova:owner>
Apr 12 16:14:19 user nova-compute[71874]:       <nova:root type="image" uuid="f2a10ad0-dd56-4297-aed7-ce5d72ea953b"/>
Apr 12 16:14:19 user nova-compute[71874]:       <nova:ports>
Apr 12 16:14:19 user nova-compute[71874]:         <nova:port uuid="d023dabe-13d5-4bbb-aa87-e9c1f5f1a048">
Apr 12 16:14:19 user nova-compute[71874]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 12 16:14:19 user nova-compute[71874]:         </nova:port>
Apr 12 16:14:19 user nova-compute[71874]:       </nova:ports>
Apr 12 16:14:19 user nova-compute[71874]:     </nova:instance>
Apr 12 16:14:19 user nova-compute[71874]:   </metadata>
Apr 12 16:14:19 user nova-compute[71874]:   <sysinfo type="smbios">
Apr 12 16:14:19 user nova-compute[71874]:     <system>
Apr 12 16:14:19 user nova-compute[71874]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 16:14:19 user nova-compute[71874]:       <entry name="product">OpenStack Nova</entry>
Apr 12 16:14:19 user nova-compute[71874]:       <entry name="version">0.0.0</entry>
Apr 12 16:14:19 user nova-compute[71874]:       <entry name="serial">b4c37cbf-1743-4dd5-97fd-2bb12ebee763</entry>
Apr 12 16:14:19 user nova-compute[71874]:       <entry name="uuid">b4c37cbf-1743-4dd5-97fd-2bb12ebee763</entry>
Apr 12 16:14:19 user nova-compute[71874]:       <entry name="family">Virtual Machine</entry>
Apr 12 16:14:19 user nova-compute[71874]:     </system>
Apr 12 16:14:19 user nova-compute[71874]:   </sysinfo>
Apr 12 16:14:19 user nova-compute[71874]:   <os>
Apr 12 16:14:19 user nova-compute[71874]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 16:14:19 user nova-compute[71874]:     <boot dev="hd"/>
Apr 12 16:14:19 user nova-compute[71874]:     <smbios mode="sysinfo"/>
Apr 12 16:14:19 user nova-compute[71874]:   </os>
Apr 12 16:14:19 user nova-compute[71874]:   <features>
Apr 12 16:14:19 user nova-compute[71874]:     <acpi/>
Apr 12 16:14:19 user nova-compute[71874]:     <apic/>
Apr 12 16:14:19 user nova-compute[71874]:     <vmcoreinfo/>
Apr 12 16:14:19 user nova-compute[71874]:   </features>
Apr 12 16:14:19 user nova-compute[71874]:   <clock offset="utc">
Apr 12 16:14:19 user nova-compute[71874]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 16:14:19 user nova-compute[71874]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 16:14:19 user nova-compute[71874]:     <timer name="hpet" present="no"/>
Apr 12 16:14:19 user nova-compute[71874]:   </clock>
Apr 12 16:14:19 user nova-compute[71874]:   <cpu mode="custom" match="exact">
Apr 12 16:14:19 user nova-compute[71874]:     <model>Nehalem</model>
Apr 12 16:14:19 user nova-compute[71874]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 16:14:19 user nova-compute[71874]:   </cpu>
Apr 12 16:14:19 user nova-compute[71874]:   <devices>
Apr 12 16:14:19 user nova-compute[71874]:     <disk type="file" device="disk">
Apr 12 16:14:19 user nova-compute[71874]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 16:14:19 user nova-compute[71874]:       <source file="/opt/stack/data/nova/instances/b4c37cbf-1743-4dd5-97fd-2bb12ebee763/disk"/>
Apr 12 16:14:19 user nova-compute[71874]:       <target dev="vda" bus="virtio"/>
Apr 12 16:14:19 user nova-compute[71874]:     </disk>
Apr 12 16:14:19 user nova-compute[71874]:     <interface type="ethernet">
Apr 12 16:14:19 user nova-compute[71874]:       <mac address="fa:16:3e:59:df:38"/>
Apr 12 16:14:19 user nova-compute[71874]:       <model type="virtio"/>
Apr 12 16:14:19 user nova-compute[71874]:       <mtu size="1442"/>
Apr 12 16:14:19 user nova-compute[71874]:       <target dev="tapd023dabe-13"/>
Apr 12 16:14:19 user nova-compute[71874]:     </interface>
Apr 12 16:14:19 user nova-compute[71874]:     <serial type="pty">
Apr 12 16:14:19 user nova-compute[71874]:       <log file="/opt/stack/data/nova/instances/b4c37cbf-1743-4dd5-97fd-2bb12ebee763/console.log" append="off"/>
Apr 12 16:14:19 user nova-compute[71874]:     </serial>
Apr 12 16:14:19 user nova-compute[71874]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 16:14:19 user nova-compute[71874]:     <video>
Apr 12 16:14:19 user nova-compute[71874]:       <model type="virtio"/>
Apr 12 16:14:19 user nova-compute[71874]:     </video>
Apr 12 16:14:19 user nova-compute[71874]:     <rng model="virtio">
Apr 12 16:14:19 user nova-compute[71874]:       <backend model="random">/dev/urandom</backend>
Apr 12 16:14:19 user nova-compute[71874]:     </rng>
Apr 12 16:14:19 user nova-compute[71874]:     <controller type="usb" index="0" model="none"/>
Apr 12 16:14:19 user nova-compute[71874]:     <memballoon model="virtio">
Apr 12 16:14:19 user nova-compute[71874]:       <stats period="10"/>
Apr 12 16:14:19 user nova-compute[71874]:     </memballoon>
Apr 12 16:14:19 user nova-compute[71874]:   </devices>
Apr 12 16:14:19 user nova-compute[71874]: </domain>
Apr 12 16:14:19 user nova-compute[71874]:  {{(pid=71874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 16:14:19 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-f63bb32e-8c68-4c53-b2f2-2d7a0a74f5c8 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T16:14:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1831226458',display_name='tempest-TestMinimumBasicScenario-server-1831226458',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1831226458',id=35,image_ref='f2a10ad0-dd56-4297-aed7-ce5d72ea953b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNbxR7XOwk113oWUkXlckv3xW8Ml31qZ6CdwMA2FLaXgBX+cAx40ag2FfMVKhGuA7H5T7OmtJlyS1451of3/3trw1T7Q3yghc0E0SJ2p2NDvcjF3/krMejZ/FZS/hV4u4g==',key_name='tempest-TestMinimumBasicScenario-1912647637',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='236b9e609eb44071bc88971bff96931e',ramdisk_id='',reservation_id='r-g8bpe8bm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f2a10ad0-dd56-4297-aed7-ce5d72ea953b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1374695003',owner_user_name='tempest-TestMinimumBasicScenario-1374695003-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T16:14:17Z,user_data=None,user_id='16a68fa3490940ebaebc8d4ca5746f6e',uuid=b4c37cbf-1743-4dd5-97fd-2bb12ebee763,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d023dabe-13d5-4bbb-aa87-e9c1f5f1a048", "address": "fa:16:3e:59:df:38", "network": {"id": "58f92787-e3b6-4fd3-bd75-7169f1a36651", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-614349033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "236b9e609eb44071bc88971bff96931e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd023dabe-13", "ovs_interfaceid": "d023dabe-13d5-4bbb-aa87-e9c1f5f1a048", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 16:14:19 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-f63bb32e-8c68-4c53-b2f2-2d7a0a74f5c8 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Converting VIF {"id": "d023dabe-13d5-4bbb-aa87-e9c1f5f1a048", "address": "fa:16:3e:59:df:38", "network": {"id": "58f92787-e3b6-4fd3-bd75-7169f1a36651", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-614349033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "236b9e609eb44071bc88971bff96931e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd023dabe-13", "ovs_interfaceid": "d023dabe-13d5-4bbb-aa87-e9c1f5f1a048", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:14:19 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-f63bb32e-8c68-4c53-b2f2-2d7a0a74f5c8 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:df:38,bridge_name='br-int',has_traffic_filtering=True,id=d023dabe-13d5-4bbb-aa87-e9c1f5f1a048,network=Network(58f92787-e3b6-4fd3-bd75-7169f1a36651),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd023dabe-13') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:14:19 user nova-compute[71874]: DEBUG os_vif [None req-f63bb32e-8c68-4c53-b2f2-2d7a0a74f5c8 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:df:38,bridge_name='br-int',has_traffic_filtering=True,id=d023dabe-13d5-4bbb-aa87-e9c1f5f1a048,network=Network(58f92787-e3b6-4fd3-bd75-7169f1a36651),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd023dabe-13') {{(pid=71874) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 16:14:19 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:14:19 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:14:19 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 16:14:19 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:14:19 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd023dabe-13, may_exist=True) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:14:19 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd023dabe-13, col_values=(('external_ids', {'iface-id': 'd023dabe-13d5-4bbb-aa87-e9c1f5f1a048', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:59:df:38', 'vm-uuid': 'b4c37cbf-1743-4dd5-97fd-2bb12ebee763'}),)) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:14:19 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:14:19 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:14:19 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:14:19 user nova-compute[71874]: INFO os_vif [None req-f63bb32e-8c68-4c53-b2f2-2d7a0a74f5c8 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:df:38,bridge_name='br-int',has_traffic_filtering=True,id=d023dabe-13d5-4bbb-aa87-e9c1f5f1a048,network=Network(58f92787-e3b6-4fd3-bd75-7169f1a36651),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd023dabe-13')
Apr 12 16:14:19 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-f63bb32e-8c68-4c53-b2f2-2d7a0a74f5c8 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] No BDM found with device name vda, not building metadata. {{(pid=71874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 16:14:19 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-f63bb32e-8c68-4c53-b2f2-2d7a0a74f5c8 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] No VIF found with MAC fa:16:3e:59:df:38, not building metadata {{(pid=71874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 16:14:19 user nova-compute[71874]: DEBUG nova.network.neutron [req-81873284-0fc2-4344-a284-90e050149f35 req-7cf7e2a2-262f-49b7-8895-a701271dc58e service nova] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] Updated VIF entry in instance network info cache for port d023dabe-13d5-4bbb-aa87-e9c1f5f1a048. {{(pid=71874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 16:14:19 user nova-compute[71874]: DEBUG nova.network.neutron [req-81873284-0fc2-4344-a284-90e050149f35 req-7cf7e2a2-262f-49b7-8895-a701271dc58e service nova] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] Updating instance_info_cache with network_info: [{"id": "d023dabe-13d5-4bbb-aa87-e9c1f5f1a048", "address": "fa:16:3e:59:df:38", "network": {"id": "58f92787-e3b6-4fd3-bd75-7169f1a36651", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-614349033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "236b9e609eb44071bc88971bff96931e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd023dabe-13", "ovs_interfaceid": "d023dabe-13d5-4bbb-aa87-e9c1f5f1a048", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:14:19 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-81873284-0fc2-4344-a284-90e050149f35 req-7cf7e2a2-262f-49b7-8895-a701271dc58e service nova] Releasing lock "refresh_cache-b4c37cbf-1743-4dd5-97fd-2bb12ebee763" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:14:20 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:14:20 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:14:20 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:14:20 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:14:20 user nova-compute[71874]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681316045.9191391, 78b6940a-f97a-4535-8973-3c2a5befbbab => Stopped> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:14:20 user nova-compute[71874]: INFO nova.compute.manager [-] [instance: 78b6940a-f97a-4535-8973-3c2a5befbbab] VM Stopped (Lifecycle Event)
Apr 12 16:14:20 user nova-compute[71874]: DEBUG nova.compute.manager [None req-5e7edfd1-919c-4d38-bc7d-c101d3f36fe6 None None] [instance: 78b6940a-f97a-4535-8973-3c2a5befbbab] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:14:21 user nova-compute[71874]: DEBUG nova.compute.manager [req-9c0dc2ea-fef1-4ef4-93d0-fb27e92c7eb5 req-a914079f-6f74-4839-b505-da6606b64cd6 service nova] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] Received event network-vif-plugged-d023dabe-13d5-4bbb-aa87-e9c1f5f1a048 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:14:21 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-9c0dc2ea-fef1-4ef4-93d0-fb27e92c7eb5 req-a914079f-6f74-4839-b505-da6606b64cd6 service nova] Acquiring lock "b4c37cbf-1743-4dd5-97fd-2bb12ebee763-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:14:21 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-9c0dc2ea-fef1-4ef4-93d0-fb27e92c7eb5 req-a914079f-6f74-4839-b505-da6606b64cd6 service nova] Lock "b4c37cbf-1743-4dd5-97fd-2bb12ebee763-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:14:21 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-9c0dc2ea-fef1-4ef4-93d0-fb27e92c7eb5 req-a914079f-6f74-4839-b505-da6606b64cd6 service nova] Lock "b4c37cbf-1743-4dd5-97fd-2bb12ebee763-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:14:21 user nova-compute[71874]: DEBUG nova.compute.manager [req-9c0dc2ea-fef1-4ef4-93d0-fb27e92c7eb5 req-a914079f-6f74-4839-b505-da6606b64cd6 service nova] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] No waiting events found dispatching network-vif-plugged-d023dabe-13d5-4bbb-aa87-e9c1f5f1a048 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:14:21 user nova-compute[71874]: WARNING nova.compute.manager [req-9c0dc2ea-fef1-4ef4-93d0-fb27e92c7eb5 req-a914079f-6f74-4839-b505-da6606b64cd6 service nova] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] Received unexpected event network-vif-plugged-d023dabe-13d5-4bbb-aa87-e9c1f5f1a048 for instance with vm_state building and task_state spawning.
Apr 12 16:14:21 user nova-compute[71874]: DEBUG nova.objects.instance [None req-1aa6f02b-e438-46d9-9da8-a550e1f74e6a tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lazy-loading 'flavor' on Instance uuid 4190e244-84b1-47b6-813d-9cadb7c65975 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:14:21 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-1aa6f02b-e438-46d9-9da8-a550e1f74e6a tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Acquiring lock "refresh_cache-4190e244-84b1-47b6-813d-9cadb7c65975" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:14:21 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-1aa6f02b-e438-46d9-9da8-a550e1f74e6a tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Acquired lock "refresh_cache-4190e244-84b1-47b6-813d-9cadb7c65975" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:14:21 user nova-compute[71874]: DEBUG nova.network.neutron [None req-1aa6f02b-e438-46d9-9da8-a550e1f74e6a tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Building network info cache for instance {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 16:14:21 user nova-compute[71874]: DEBUG nova.objects.instance [None req-1aa6f02b-e438-46d9-9da8-a550e1f74e6a tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lazy-loading 'info_cache' on Instance uuid 4190e244-84b1-47b6-813d-9cadb7c65975 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:14:21 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:14:21 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:14:21 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:14:21 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:14:22 user nova-compute[71874]: DEBUG nova.network.neutron [None req-1aa6f02b-e438-46d9-9da8-a550e1f74e6a tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Updating instance_info_cache with network_info: [{"id": "eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c", "address": "fa:16:3e:d0:b5:d4", "network": {"id": "1ef428ff-90e5-4abd-93d0-b7c2c581cb26", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-425924095-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf4334df004490ba51b4d92ce5408ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeab1ea0c-8a", "ovs_interfaceid": "eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:14:22 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-1aa6f02b-e438-46d9-9da8-a550e1f74e6a tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Releasing lock "refresh_cache-4190e244-84b1-47b6-813d-9cadb7c65975" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:14:22 user nova-compute[71874]: INFO nova.virt.libvirt.driver [-] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Instance destroyed successfully.
Apr 12 16:14:22 user nova-compute[71874]: DEBUG nova.objects.instance [None req-1aa6f02b-e438-46d9-9da8-a550e1f74e6a tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lazy-loading 'resources' on Instance uuid 4190e244-84b1-47b6-813d-9cadb7c65975 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:14:22 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-1aa6f02b-e438-46d9-9da8-a550e1f74e6a tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T16:10:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1671411109',display_name='tempest-AttachVolumeTestJSON-server-1671411109',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1671411109',id=30,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFG81tsYAjuSLmCBJX5Oy53u6RydBq93WUwqVYUMtou9Wro9aHLYlkjtVGeLCCkr0S7Y24E90tPBrxAk1jNQ+AbkSKQBVRm7+VgL4Rx9C6hm1o9gCqXWuOVCyPnDpz3Eig==',key_name='tempest-keypair-1295229303',keypairs=<?>,launch_index=0,launched_at=2023-04-12T16:10:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='7cf4334df004490ba51b4d92ce5408ae',ramdisk_id='',reservation_id='r-sfgohvil',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-178648074',owner_user_name='tempest-AttachVolumeTestJSON-178648074-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T16:12:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2996f6997bb14fc3aec9c3736cc65b8a',uuid=4190e244-84b1-47b6-813d-9cadb7c65975,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c", "address": "fa:16:3e:d0:b5:d4", "network": {"id": "1ef428ff-90e5-4abd-93d0-b7c2c581cb26", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-425924095-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf4334df004490ba51b4d92ce5408ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeab1ea0c-8a", "ovs_interfaceid": "eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 16:14:22 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-1aa6f02b-e438-46d9-9da8-a550e1f74e6a tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Converting VIF {"id": "eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c", "address": "fa:16:3e:d0:b5:d4", "network": {"id": "1ef428ff-90e5-4abd-93d0-b7c2c581cb26", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-425924095-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf4334df004490ba51b4d92ce5408ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeab1ea0c-8a", "ovs_interfaceid": "eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:14:22 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-1aa6f02b-e438-46d9-9da8-a550e1f74e6a tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:b5:d4,bridge_name='br-int',has_traffic_filtering=True,id=eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c,network=Network(1ef428ff-90e5-4abd-93d0-b7c2c581cb26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeab1ea0c-8a') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:14:22 user nova-compute[71874]: DEBUG os_vif [None req-1aa6f02b-e438-46d9-9da8-a550e1f74e6a tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:b5:d4,bridge_name='br-int',has_traffic_filtering=True,id=eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c,network=Network(1ef428ff-90e5-4abd-93d0-b7c2c581cb26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeab1ea0c-8a') {{(pid=71874) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 16:14:22 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:14:22 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeab1ea0c-8a, bridge=br-int, if_exists=True) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:14:22 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:14:22 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:14:22 user nova-compute[71874]: INFO os_vif [None req-1aa6f02b-e438-46d9-9da8-a550e1f74e6a tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:b5:d4,bridge_name='br-int',has_traffic_filtering=True,id=eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c,network=Network(1ef428ff-90e5-4abd-93d0-b7c2c581cb26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeab1ea0c-8a')
Apr 12 16:14:22 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1aa6f02b-e438-46d9-9da8-a550e1f74e6a tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] calling os-brick to detach iSCSI Volume {{(pid=71874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 16:14:22 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aa6f02b-e438-46d9-9da8-a550e1f74e6a tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3c0216320>, {'target_iqn': 'iqn.2010-10.org.openstack:ce38c1b3-35b0-48cc-9b83-e9a676997784', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'APVXFMTJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg': {}}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:14:22 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-1aa6f02b-e438-46d9-9da8-a550e1f74e6a tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:14:22 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-1aa6f02b-e438-46d9-9da8-a550e1f74e6a tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:14:22 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-1aa6f02b-e438-46d9-9da8-a550e1f74e6a tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:14:22 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:14:22 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:14:22 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[7429f5f3-03cc-421e-b073-3c9a15ccca53]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ce38c1b3-35b0-48cc-9b83-e9a676997784\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:14:22 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aa6f02b-e438-46d9-9da8-a550e1f74e6a tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 16:14:22 user nova-compute[71874]: No targets found.
Apr 12 16:14:22 user nova-compute[71874]: iSNS:
Apr 12 16:14:22 user nova-compute[71874]: No targets found.
Apr 12 16:14:22 user nova-compute[71874]: STATIC:
Apr 12 16:14:22 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:ce38c1b3-35b0-48cc-9b83-e9a676997784
Apr 12 16:14:22 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:14:22 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:14:22 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304
Apr 12 16:14:22 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:14:22 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:14:22 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2
Apr 12 16:14:22 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:14:22 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:14:22 user nova-compute[71874]: FIRMWARE:
Apr 12 16:14:22 user nova-compute[71874]: No targets found.
Apr 12 16:14:22 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:14:22 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aa6f02b-e438-46d9-9da8-a550e1f74e6a tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 16:14:22 user nova-compute[71874]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 16:14:22 user nova-compute[71874]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71874) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 16:14:22 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aa6f02b-e438-46d9-9da8-a550e1f74e6a tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ce38c1b3-35b0-48cc-9b83-e9a676997784', 0)] {{(pid=71874) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 16:14:22 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:14:22 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:14:22 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[934a1245-dca1-4db0-aefc-2861ac509f53]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ce38c1b3-35b0-48cc-9b83-e9a676997784\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:14:22 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:14:22 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:14:22 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[1705c3a3-215f-4c91-b4c5-76bb193dc40d]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce38c1b3-35b0-48cc-9b83-e9a676997784 (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:14:22 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aa6f02b-e438-46d9-9da8-a550e1f74e6a tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:14:22 user nova-compute[71874]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304 (non-flash)
Apr 12 16:14:22 user nova-compute[71874]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce38c1b3-35b0-48cc-9b83-e9a676997784 (non-flash)
Apr 12 16:14:22 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:14:22 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aa6f02b-e438-46d9-9da8-a550e1f74e6a tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:14:22 user nova-compute[71874]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304 (non-flash)
Apr 12 16:14:22 user nova-compute[71874]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce38c1b3-35b0-48cc-9b83-e9a676997784 (non-flash)
Apr 12 16:14:22 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:14:22 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aa6f02b-e438-46d9-9da8-a550e1f74e6a tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc3d12af490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ce38c1b3-35b0-48cc-9b83-e9a676997784'): ({'sdg'}, set())}) {{(pid=71874) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 16:14:22 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-1aa6f02b-e438-46d9-9da8-a550e1f74e6a tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Removing single pathed devices sdg {{(pid=71874) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 16:14:22 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:14:22 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:14:22 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[035cebfb-6ab6-4981-bf9a-a93a5ee849b1]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:14:22 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:14:22 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.020s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:14:22 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d76b45b-e38c-4fa6-9f12-4ca08942b4fb]: (4, ('ok\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:14:22 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-1aa6f02b-e438-46d9-9da8-a550e1f74e6a tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Flushing IO for device /dev/sdg {{(pid=71874) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 16:14:22 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:14:22 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.015s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:14:22 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a538a98-936a-4cdc-87c2-8ebe4638b183]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:14:22 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-1aa6f02b-e438-46d9-9da8-a550e1f74e6a tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=71874) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 16:14:22 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:14:22 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.039s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:14:22 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[68e5ecaf-d545-475d-b2ac-2e1e4459c417]: (4, ('1', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:14:22 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-1aa6f02b-e438-46d9-9da8-a550e1f74e6a tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=71874) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 16:14:22 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-1aa6f02b-e438-46d9-9da8-a550e1f74e6a tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] SCSI volumes sdg have been removed. {{(pid=71874) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 16:14:22 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aa6f02b-e438-46d9-9da8-a550e1f74e6a tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ce38c1b3-35b0-48cc-9b83-e9a676997784')] {{(pid=71874) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 16:14:22 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce38c1b3-35b0-48cc-9b83-e9a676997784 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:14:22 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce38c1b3-35b0-48cc-9b83-e9a676997784 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:14:22 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[dba0607e-e30f-430a-a92c-5421bc4d7eaa]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:14:22 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aa6f02b-e438-46d9-9da8-a550e1f74e6a tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:14:22 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce38c1b3-35b0-48cc-9b83-e9a676997784 -p 172.16.0.220:3260 --logout {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:14:22 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce38c1b3-35b0-48cc-9b83-e9a676997784 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:14:22 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[c72c6d4b-56da-418e-9d18-e53e7a14c55c]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:ce38c1b3-35b0-48cc-9b83-e9a676997784, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:ce38c1b3-35b0-48cc-9b83-e9a676997784, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:14:22 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aa6f02b-e438-46d9-9da8-a550e1f74e6a tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:ce38c1b3-35b0-48cc-9b83-e9a676997784, portal: 172.16.0.220,3260]
Apr 12 16:14:22 user nova-compute[71874]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:ce38c1b3-35b0-48cc-9b83-e9a676997784, portal: 172.16.0.220,3260] successful.
Apr 12 16:14:22 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:14:22 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce38c1b3-35b0-48cc-9b83-e9a676997784 -p 172.16.0.220:3260 --op delete {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:14:22 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce38c1b3-35b0-48cc-9b83-e9a676997784 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:14:22 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[424879b0-8266-4537-9888-f57a4ccddbe5]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:14:22 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aa6f02b-e438-46d9-9da8-a550e1f74e6a tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:14:22 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-1aa6f02b-e438-46d9-9da8-a550e1f74e6a tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:14:22 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aa6f02b-e438-46d9-9da8-a550e1f74e6a tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] <== disconnect_volume: return (319ms) None {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:14:22 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1aa6f02b-e438-46d9-9da8-a550e1f74e6a tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Disconnected iSCSI Volume {{(pid=71874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 16:14:22 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-1aa6f02b-e438-46d9-9da8-a550e1f74e6a tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Start _get_guest_xml network_info=[{"id": "eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c", "address": "fa:16:3e:d0:b5:d4", "network": {"id": "1ef428ff-90e5-4abd-93d0-b7c2c581cb26", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-425924095-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf4334df004490ba51b4d92ce5408ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeab1ea0c-8a", "ovs_interfaceid": "eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=9dc63f14-8b70-4e72-89f2-13464f2f5c7c,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_options': None, 'image_id': '9dc63f14-8b70-4e72-89f2-13464f2f5c7c'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'delete_on_termination': False, 'attachment_id': '8f84a503-70fb-4a7f-b518-394a270ae17e', 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ce38c1b3-35b0-48cc-9b83-e9a676997784', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'APVXFMTJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, 'status': 'reserved', 'instance': '4190e244-84b1-47b6-813d-9cadb7c65975', 'attached_at': '', 'detached_at': '', 'volume_id': 'ce38c1b3-35b0-48cc-9b83-e9a676997784', 'serial': 'ce38c1b3-35b0-48cc-9b83-e9a676997784'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': None, 'volume_type': None} {{(pid=71874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 16:14:22 user nova-compute[71874]: DEBUG nova.objects.instance [None req-1aa6f02b-e438-46d9-9da8-a550e1f74e6a tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lazy-loading 'numa_topology' on Instance uuid 4190e244-84b1-47b6-813d-9cadb7c65975 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:14:22 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-1aa6f02b-e438-46d9-9da8-a550e1f74e6a tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:14:22 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-1aa6f02b-e438-46d9-9da8-a550e1f74e6a tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:14:22 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-1aa6f02b-e438-46d9-9da8-a550e1f74e6a tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71874) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 16:14:22 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-1aa6f02b-e438-46d9-9da8-a550e1f74e6a tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T15:56:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=9dc63f14-8b70-4e72-89f2-13464f2f5c7c,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 16:14:22 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-1aa6f02b-e438-46d9-9da8-a550e1f74e6a tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Flavor limits 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 16:14:22 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-1aa6f02b-e438-46d9-9da8-a550e1f74e6a tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Image limits 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 16:14:22 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-1aa6f02b-e438-46d9-9da8-a550e1f74e6a tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Flavor pref 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 16:14:22 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-1aa6f02b-e438-46d9-9da8-a550e1f74e6a tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Image pref 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 16:14:22 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-1aa6f02b-e438-46d9-9da8-a550e1f74e6a tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 16:14:22 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-1aa6f02b-e438-46d9-9da8-a550e1f74e6a tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 16:14:22 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-1aa6f02b-e438-46d9-9da8-a550e1f74e6a tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 16:14:22 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-1aa6f02b-e438-46d9-9da8-a550e1f74e6a tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Got 1 possible topologies {{(pid=71874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 16:14:22 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-1aa6f02b-e438-46d9-9da8-a550e1f74e6a tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 16:14:22 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-1aa6f02b-e438-46d9-9da8-a550e1f74e6a tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 16:14:22 user nova-compute[71874]: DEBUG nova.objects.instance [None req-1aa6f02b-e438-46d9-9da8-a550e1f74e6a tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4190e244-84b1-47b6-813d-9cadb7c65975 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:14:22 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1aa6f02b-e438-46d9-9da8-a550e1f74e6a tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Calling os-brick to attach iSCSI Volume {{(pid=71874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 16:14:22 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aa6f02b-e438-46d9-9da8-a550e1f74e6a tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3c0216320>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ce38c1b3-35b0-48cc-9b83-e9a676997784', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'APVXFMTJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:14:22 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-1aa6f02b-e438-46d9-9da8-a550e1f74e6a tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:14:22 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-1aa6f02b-e438-46d9-9da8-a550e1f74e6a tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:14:22 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-1aa6f02b-e438-46d9-9da8-a550e1f74e6a tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:14:22 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-1aa6f02b-e438-46d9-9da8-a550e1f74e6a tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:14:22 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-1aa6f02b-e438-46d9-9da8-a550e1f74e6a tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ce38c1b3-35b0-48cc-9b83-e9a676997784" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:14:22 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-1aa6f02b-e438-46d9-9da8-a550e1f74e6a tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ce38c1b3-35b0-48cc-9b83-e9a676997784" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:14:22 user nova-compute[71874]: INFO os_brick.initiator.connectors.iscsi [None req-1aa6f02b-e438-46d9-9da8-a550e1f74e6a tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 16:14:22 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce38c1b3-35b0-48cc-9b83-e9a676997784 -p 172.16.0.220:3260 {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:14:22 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce38c1b3-35b0-48cc-9b83-e9a676997784 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:14:22 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[a20c13af-a3d0-4cbc-b4ea-94ee86e97ae8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:14:22 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aa6f02b-e438-46d9-9da8-a550e1f74e6a tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 16:14:22 user nova-compute[71874]:  {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:14:22 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce38c1b3-35b0-48cc-9b83-e9a676997784 -p 172.16.0.220:3260 --interface default --op new {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:14:22 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce38c1b3-35b0-48cc-9b83-e9a676997784 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:14:22 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1b91a85-3e6f-4146-9da3-79868e32cc4f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ce38c1b3-35b0-48cc-9b83-e9a676997784] added\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:14:22 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aa6f02b-e438-46d9-9da8-a550e1f74e6a tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ce38c1b3-35b0-48cc-9b83-e9a676997784] added
Apr 12 16:14:22 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:14:22 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce38c1b3-35b0-48cc-9b83-e9a676997784 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:14:22 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce38c1b3-35b0-48cc-9b83-e9a676997784 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:14:22 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d7a5873-40ff-4a0b-9df3-f097f341da11]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:14:22 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aa6f02b-e438-46d9-9da8-a550e1f74e6a tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:14:22 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce38c1b3-35b0-48cc-9b83-e9a676997784 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:14:22 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce38c1b3-35b0-48cc-9b83-e9a676997784 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:14:22 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d85c7a7-ef07-4b9c-a593-5991284d8eef]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:14:22 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aa6f02b-e438-46d9-9da8-a550e1f74e6a tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:14:22 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce38c1b3-35b0-48cc-9b83-e9a676997784 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v APVXFMTJ {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:14:22 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce38c1b3-35b0-48cc-9b83-e9a676997784 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v APVXFMTJ" returned: 0 in 0.030s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:14:22 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[addfa8ba-8bbf-4338-b790-d9c53642d8c1]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:14:22 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aa6f02b-e438-46d9-9da8-a550e1f74e6a tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'APVXFMTJ'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:14:22 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce38c1b3-35b0-48cc-9b83-e9a676997784 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:14:22 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:14:22 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce38c1b3-35b0-48cc-9b83-e9a676997784 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:14:22 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[0230023f-eaad-436b-8d6d-f44911eb1b7c]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:14:22 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aa6f02b-e438-46d9-9da8-a550e1f74e6a tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:14:22 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:14:22 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:14:22 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:14:22 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:14:22 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Auditing locally available compute resources for user (node: user) {{(pid=71874) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 16:14:22 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:14:22 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[dca25ff8-bf90-4266-8f1b-d22c3ea3ac1d]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304 (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:14:22 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aa6f02b-e438-46d9-9da8-a550e1f74e6a tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:14:22 user nova-compute[71874]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304 (non-flash)
Apr 12 16:14:22 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:14:22 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aa6f02b-e438-46d9-9da8-a550e1f74e6a tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:14:22 user nova-compute[71874]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304 (non-flash)
Apr 12 16:14:22 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:14:22 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce38c1b3-35b0-48cc-9b83-e9a676997784 -p 172.16.0.220:3260 --login {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:14:22 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce38c1b3-35b0-48cc-9b83-e9a676997784 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:14:22 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[13acac9e-ddd3-45ad-a639-0d8977a26c44]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ce38c1b3-35b0-48cc-9b83-e9a676997784, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ce38c1b3-35b0-48cc-9b83-e9a676997784, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:14:22 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aa6f02b-e438-46d9-9da8-a550e1f74e6a tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ce38c1b3-35b0-48cc-9b83-e9a676997784, portal: 172.16.0.220,3260]
Apr 12 16:14:22 user nova-compute[71874]: Login to [iface: default, target: iqn.2010-10.org.openstack:ce38c1b3-35b0-48cc-9b83-e9a676997784, portal: 172.16.0.220,3260] successful.
Apr 12 16:14:22 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:14:22 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce38c1b3-35b0-48cc-9b83-e9a676997784 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:14:22 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce38c1b3-35b0-48cc-9b83-e9a676997784 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:14:22 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[705d3822-ff34-4962-91a3-ac617d68310f]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:14:22 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aa6f02b-e438-46d9-9da8-a550e1f74e6a tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:14:22 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:14:22 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:14:22 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bedf956-e598-4283-b142-569a8f575d50]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce38c1b3-35b0-48cc-9b83-e9a676997784 (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:14:23 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aa6f02b-e438-46d9-9da8-a550e1f74e6a tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:14:23 user nova-compute[71874]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304 (non-flash)
Apr 12 16:14:23 user nova-compute[71874]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce38c1b3-35b0-48cc-9b83-e9a676997784 (non-flash)
Apr 12 16:14:23 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:14:23 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aa6f02b-e438-46d9-9da8-a550e1f74e6a tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:14:23 user nova-compute[71874]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304 (non-flash)
Apr 12 16:14:23 user nova-compute[71874]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce38c1b3-35b0-48cc-9b83-e9a676997784 (non-flash)
Apr 12 16:14:23 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:14:23 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-1aa6f02b-e438-46d9-9da8-a550e1f74e6a tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ce38c1b3-35b0-48cc-9b83-e9a676997784" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.302s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:14:23 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aa6f02b-e438-46d9-9da8-a550e1f74e6a tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Connected to 172.16.0.220:3260 {{(pid=71874) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 16:14:23 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-1aa6f02b-e438-46d9-9da8-a550e1f74e6a tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] HCTL ('34', '-', '-', 0) found on session 36 with lun 0 {{(pid=71874) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 16:14:23 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-1aa6f02b-e438-46d9-9da8-a550e1f74e6a tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71874) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 16:14:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:14:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.022s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:14:23 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcd1db82-ec40-4af9-804f-5a11145adbc3]: (4, ('- - 0', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:14:23 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-1aa6f02b-e438-46d9-9da8-a550e1f74e6a tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Searching for a device in session 36 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71874) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 16:14:23 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aa6f02b-e438-46d9-9da8-a550e1f74e6a tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:ce38c1b3-35b0-48cc-9b83-e9a676997784', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'APVXFMTJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=71874) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 16:14:23 user nova-compute[71874]: DEBUG nova.virt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Emitting event <LifecycleEvent: 1681316063.1070194, b4c37cbf-1743-4dd5-97fd-2bb12ebee763 => Resumed> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:14:23 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] VM Resumed (Lifecycle Event)
Apr 12 16:14:23 user nova-compute[71874]: DEBUG nova.compute.manager [None req-f63bb32e-8c68-4c53-b2f2-2d7a0a74f5c8 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] Instance event wait completed in 0 seconds for  {{(pid=71874) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 16:14:23 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-f63bb32e-8c68-4c53-b2f2-2d7a0a74f5c8 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] Guest created on hypervisor {{(pid=71874) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 16:14:23 user nova-compute[71874]: INFO nova.virt.libvirt.driver [-] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] Instance spawned successfully.
Apr 12 16:14:23 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-f63bb32e-8c68-4c53-b2f2-2d7a0a74f5c8 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 16:14:23 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:14:23 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-f63bb32e-8c68-4c53-b2f2-2d7a0a74f5c8 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] Found default for hw_cdrom_bus of ide {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:14:23 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-f63bb32e-8c68-4c53-b2f2-2d7a0a74f5c8 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] Found default for hw_disk_bus of virtio {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:14:23 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-f63bb32e-8c68-4c53-b2f2-2d7a0a74f5c8 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] Found default for hw_input_bus of None {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:14:23 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-f63bb32e-8c68-4c53-b2f2-2d7a0a74f5c8 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] Found default for hw_pointer_model of None {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:14:23 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-f63bb32e-8c68-4c53-b2f2-2d7a0a74f5c8 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] Found default for hw_video_model of virtio {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:14:23 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-f63bb32e-8c68-4c53-b2f2-2d7a0a74f5c8 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] Found default for hw_vif_model of virtio {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:14:23 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 16:14:23 user nova-compute[71874]: DEBUG nova.compute.manager [req-786a6dcd-414c-454a-85f8-40ae399834ff req-b6350789-ef23-43d0-bdaf-9ee166bcc5d8 service nova] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] Received event network-vif-plugged-d023dabe-13d5-4bbb-aa87-e9c1f5f1a048 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:14:23 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-786a6dcd-414c-454a-85f8-40ae399834ff req-b6350789-ef23-43d0-bdaf-9ee166bcc5d8 service nova] Acquiring lock "b4c37cbf-1743-4dd5-97fd-2bb12ebee763-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:14:23 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-786a6dcd-414c-454a-85f8-40ae399834ff req-b6350789-ef23-43d0-bdaf-9ee166bcc5d8 service nova] Lock "b4c37cbf-1743-4dd5-97fd-2bb12ebee763-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:14:23 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-786a6dcd-414c-454a-85f8-40ae399834ff req-b6350789-ef23-43d0-bdaf-9ee166bcc5d8 service nova] Lock "b4c37cbf-1743-4dd5-97fd-2bb12ebee763-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:14:23 user nova-compute[71874]: DEBUG nova.compute.manager [req-786a6dcd-414c-454a-85f8-40ae399834ff req-b6350789-ef23-43d0-bdaf-9ee166bcc5d8 service nova] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] No waiting events found dispatching network-vif-plugged-d023dabe-13d5-4bbb-aa87-e9c1f5f1a048 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:14:23 user nova-compute[71874]: WARNING nova.compute.manager [req-786a6dcd-414c-454a-85f8-40ae399834ff req-b6350789-ef23-43d0-bdaf-9ee166bcc5d8 service nova] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] Received unexpected event network-vif-plugged-d023dabe-13d5-4bbb-aa87-e9c1f5f1a048 for instance with vm_state building and task_state spawning.
Apr 12 16:14:23 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 16:14:23 user nova-compute[71874]: DEBUG nova.virt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Emitting event <LifecycleEvent: 1681316063.1086583, b4c37cbf-1743-4dd5-97fd-2bb12ebee763 => Started> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:14:23 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] VM Started (Lifecycle Event)
Apr 12 16:14:23 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:14:23 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:14:23 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 16:14:23 user nova-compute[71874]: INFO nova.compute.manager [None req-f63bb32e-8c68-4c53-b2f2-2d7a0a74f5c8 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] Took 6.04 seconds to spawn the instance on the hypervisor.
Apr 12 16:14:23 user nova-compute[71874]: DEBUG nova.compute.manager [None req-f63bb32e-8c68-4c53-b2f2-2d7a0a74f5c8 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:14:23 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 16:14:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f641c6b-b508-42a7-ae98-c2bfb841d798/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:14:23 user nova-compute[71874]: INFO nova.compute.manager [None req-f63bb32e-8c68-4c53-b2f2-2d7a0a74f5c8 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] Took 7.09 seconds to build instance.
Apr 12 16:14:23 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-f63bb32e-8c68-4c53-b2f2-2d7a0a74f5c8 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "b4c37cbf-1743-4dd5-97fd-2bb12ebee763" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.192s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:14:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f641c6b-b508-42a7-ae98-c2bfb841d798/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:14:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f641c6b-b508-42a7-ae98-c2bfb841d798/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:14:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f641c6b-b508-42a7-ae98-c2bfb841d798/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:14:23 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 16:14:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32471bee-e77e-4a1b-8e00-d938a1373976/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:14:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32471bee-e77e-4a1b-8e00-d938a1373976/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:14:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32471bee-e77e-4a1b-8e00-d938a1373976/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:14:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32471bee-e77e-4a1b-8e00-d938a1373976/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:14:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473a30c4-5aa4-481c-8859-fda815d14872/disk.rescue --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:14:24 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-1aa6f02b-e438-46d9-9da8-a550e1f74e6a tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.349s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:14:24 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aa6f02b-e438-46d9-9da8-a550e1f74e6a tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] <== connect_volume: return (1352ms) {'type': 'block', 'scsi_wwn': '26461393839613265', 'path': '/dev/sdc'} {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:14:24 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1aa6f02b-e438-46d9-9da8-a550e1f74e6a tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26461393839613265', 'path': '/dev/sdc'} {{(pid=71874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 16:14:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473a30c4-5aa4-481c-8859-fda815d14872/disk.rescue --force-share --output=json" returned: 0 in 0.139s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:14:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473a30c4-5aa4-481c-8859-fda815d14872/disk.rescue --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:14:24 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-1aa6f02b-e438-46d9-9da8-a550e1f74e6a tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T16:10:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1671411109',display_name='tempest-AttachVolumeTestJSON-server-1671411109',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1671411109',id=30,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFG81tsYAjuSLmCBJX5Oy53u6RydBq93WUwqVYUMtou9Wro9aHLYlkjtVGeLCCkr0S7Y24E90tPBrxAk1jNQ+AbkSKQBVRm7+VgL4Rx9C6hm1o9gCqXWuOVCyPnDpz3Eig==',key_name='tempest-keypair-1295229303',keypairs=<?>,launch_index=0,launched_at=2023-04-12T16:10:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='7cf4334df004490ba51b4d92ce5408ae',ramdisk_id='',reservation_id='r-sfgohvil',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-178648074',owner_user_name='tempest-AttachVolumeTestJSON-178648074-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T16:12:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2996f6997bb14fc3aec9c3736cc65b8a',uuid=4190e244-84b1-47b6-813d-9cadb7c65975,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c", "address": "fa:16:3e:d0:b5:d4", "network": {"id": "1ef428ff-90e5-4abd-93d0-b7c2c581cb26", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-425924095-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf4334df004490ba51b4d92ce5408ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeab1ea0c-8a", "ovs_interfaceid": "eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 16:14:24 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-1aa6f02b-e438-46d9-9da8-a550e1f74e6a tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Converting VIF {"id": "eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c", "address": "fa:16:3e:d0:b5:d4", "network": {"id": "1ef428ff-90e5-4abd-93d0-b7c2c581cb26", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-425924095-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf4334df004490ba51b4d92ce5408ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeab1ea0c-8a", "ovs_interfaceid": "eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:14:24 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-1aa6f02b-e438-46d9-9da8-a550e1f74e6a tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:b5:d4,bridge_name='br-int',has_traffic_filtering=True,id=eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c,network=Network(1ef428ff-90e5-4abd-93d0-b7c2c581cb26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeab1ea0c-8a') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:14:24 user nova-compute[71874]: DEBUG nova.objects.instance [None req-1aa6f02b-e438-46d9-9da8-a550e1f74e6a tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lazy-loading 'pci_devices' on Instance uuid 4190e244-84b1-47b6-813d-9cadb7c65975 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:14:24 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-1aa6f02b-e438-46d9-9da8-a550e1f74e6a tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] End _get_guest_xml xml=<domain type="kvm">
Apr 12 16:14:24 user nova-compute[71874]:   <uuid>4190e244-84b1-47b6-813d-9cadb7c65975</uuid>
Apr 12 16:14:24 user nova-compute[71874]:   <name>instance-0000001e</name>
Apr 12 16:14:24 user nova-compute[71874]:   <memory>131072</memory>
Apr 12 16:14:24 user nova-compute[71874]:   <vcpu>1</vcpu>
Apr 12 16:14:24 user nova-compute[71874]:   <metadata>
Apr 12 16:14:24 user nova-compute[71874]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 16:14:24 user nova-compute[71874]:       <nova:package version="0.0.0"/>
Apr 12 16:14:24 user nova-compute[71874]:       <nova:name>tempest-AttachVolumeTestJSON-server-1671411109</nova:name>
Apr 12 16:14:24 user nova-compute[71874]:       <nova:creationTime>2023-04-12 16:14:22</nova:creationTime>
Apr 12 16:14:24 user nova-compute[71874]:       <nova:flavor name="m1.nano">
Apr 12 16:14:24 user nova-compute[71874]:         <nova:memory>128</nova:memory>
Apr 12 16:14:24 user nova-compute[71874]:         <nova:disk>1</nova:disk>
Apr 12 16:14:24 user nova-compute[71874]:         <nova:swap>0</nova:swap>
Apr 12 16:14:24 user nova-compute[71874]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 16:14:24 user nova-compute[71874]:         <nova:vcpus>1</nova:vcpus>
Apr 12 16:14:24 user nova-compute[71874]:       </nova:flavor>
Apr 12 16:14:24 user nova-compute[71874]:       <nova:owner>
Apr 12 16:14:24 user nova-compute[71874]:         <nova:user uuid="2996f6997bb14fc3aec9c3736cc65b8a">tempest-AttachVolumeTestJSON-178648074-project-member</nova:user>
Apr 12 16:14:24 user nova-compute[71874]:         <nova:project uuid="7cf4334df004490ba51b4d92ce5408ae">tempest-AttachVolumeTestJSON-178648074</nova:project>
Apr 12 16:14:24 user nova-compute[71874]:       </nova:owner>
Apr 12 16:14:24 user nova-compute[71874]:       <nova:root type="image" uuid="9dc63f14-8b70-4e72-89f2-13464f2f5c7c"/>
Apr 12 16:14:24 user nova-compute[71874]:       <nova:ports>
Apr 12 16:14:24 user nova-compute[71874]:         <nova:port uuid="eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c">
Apr 12 16:14:24 user nova-compute[71874]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 12 16:14:24 user nova-compute[71874]:         </nova:port>
Apr 12 16:14:24 user nova-compute[71874]:       </nova:ports>
Apr 12 16:14:24 user nova-compute[71874]:     </nova:instance>
Apr 12 16:14:24 user nova-compute[71874]:   </metadata>
Apr 12 16:14:24 user nova-compute[71874]:   <sysinfo type="smbios">
Apr 12 16:14:24 user nova-compute[71874]:     <system>
Apr 12 16:14:24 user nova-compute[71874]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 16:14:24 user nova-compute[71874]:       <entry name="product">OpenStack Nova</entry>
Apr 12 16:14:24 user nova-compute[71874]:       <entry name="version">0.0.0</entry>
Apr 12 16:14:24 user nova-compute[71874]:       <entry name="serial">4190e244-84b1-47b6-813d-9cadb7c65975</entry>
Apr 12 16:14:24 user nova-compute[71874]:       <entry name="uuid">4190e244-84b1-47b6-813d-9cadb7c65975</entry>
Apr 12 16:14:24 user nova-compute[71874]:       <entry name="family">Virtual Machine</entry>
Apr 12 16:14:24 user nova-compute[71874]:     </system>
Apr 12 16:14:24 user nova-compute[71874]:   </sysinfo>
Apr 12 16:14:24 user nova-compute[71874]:   <os>
Apr 12 16:14:24 user nova-compute[71874]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 16:14:24 user nova-compute[71874]:     <boot dev="hd"/>
Apr 12 16:14:24 user nova-compute[71874]:     <smbios mode="sysinfo"/>
Apr 12 16:14:24 user nova-compute[71874]:   </os>
Apr 12 16:14:24 user nova-compute[71874]:   <features>
Apr 12 16:14:24 user nova-compute[71874]:     <acpi/>
Apr 12 16:14:24 user nova-compute[71874]:     <apic/>
Apr 12 16:14:24 user nova-compute[71874]:     <vmcoreinfo/>
Apr 12 16:14:24 user nova-compute[71874]:   </features>
Apr 12 16:14:24 user nova-compute[71874]:   <clock offset="utc">
Apr 12 16:14:24 user nova-compute[71874]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 16:14:24 user nova-compute[71874]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 16:14:24 user nova-compute[71874]:     <timer name="hpet" present="no"/>
Apr 12 16:14:24 user nova-compute[71874]:   </clock>
Apr 12 16:14:24 user nova-compute[71874]:   <cpu mode="custom" match="exact">
Apr 12 16:14:24 user nova-compute[71874]:     <model>Nehalem</model>
Apr 12 16:14:24 user nova-compute[71874]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 16:14:24 user nova-compute[71874]:   </cpu>
Apr 12 16:14:24 user nova-compute[71874]:   <devices>
Apr 12 16:14:24 user nova-compute[71874]:     <disk type="file" device="disk">
Apr 12 16:14:24 user nova-compute[71874]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 16:14:24 user nova-compute[71874]:       <source file="/opt/stack/data/nova/instances/4190e244-84b1-47b6-813d-9cadb7c65975/disk"/>
Apr 12 16:14:24 user nova-compute[71874]:       <target dev="vda" bus="virtio"/>
Apr 12 16:14:24 user nova-compute[71874]:     </disk>
Apr 12 16:14:24 user nova-compute[71874]:     <disk type="block" device="disk">
Apr 12 16:14:24 user nova-compute[71874]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 16:14:24 user nova-compute[71874]:       <source dev="/dev/sdc"/>
Apr 12 16:14:24 user nova-compute[71874]:       <target dev="vdb" bus="virtio"/>
Apr 12 16:14:24 user nova-compute[71874]:       <serial>ce38c1b3-35b0-48cc-9b83-e9a676997784</serial>
Apr 12 16:14:24 user nova-compute[71874]:     </disk>
Apr 12 16:14:24 user nova-compute[71874]:     <interface type="ethernet">
Apr 12 16:14:24 user nova-compute[71874]:       <mac address="fa:16:3e:d0:b5:d4"/>
Apr 12 16:14:24 user nova-compute[71874]:       <model type="virtio"/>
Apr 12 16:14:24 user nova-compute[71874]:       <mtu size="1442"/>
Apr 12 16:14:24 user nova-compute[71874]:       <target dev="tapeab1ea0c-8a"/>
Apr 12 16:14:24 user nova-compute[71874]:     </interface>
Apr 12 16:14:24 user nova-compute[71874]:     <serial type="pty">
Apr 12 16:14:24 user nova-compute[71874]:       <log file="/opt/stack/data/nova/instances/4190e244-84b1-47b6-813d-9cadb7c65975/console.log" append="off"/>
Apr 12 16:14:24 user nova-compute[71874]:     </serial>
Apr 12 16:14:24 user nova-compute[71874]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 16:14:24 user nova-compute[71874]:     <video>
Apr 12 16:14:24 user nova-compute[71874]:       <model type="virtio"/>
Apr 12 16:14:24 user nova-compute[71874]:     </video>
Apr 12 16:14:24 user nova-compute[71874]:     <rng model="virtio">
Apr 12 16:14:24 user nova-compute[71874]:       <backend model="random">/dev/urandom</backend>
Apr 12 16:14:24 user nova-compute[71874]:     </rng>
Apr 12 16:14:24 user nova-compute[71874]:     <controller type="usb" index="0" model="none"/>
Apr 12 16:14:24 user nova-compute[71874]:     <memballoon model="virtio">
Apr 12 16:14:24 user nova-compute[71874]:       <stats period="10"/>
Apr 12 16:14:24 user nova-compute[71874]:     </memballoon>
Apr 12 16:14:24 user nova-compute[71874]:   </devices>
Apr 12 16:14:24 user nova-compute[71874]: </domain>
Apr 12 16:14:24 user nova-compute[71874]:  {{(pid=71874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 16:14:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-1aa6f02b-e438-46d9-9da8-a550e1f74e6a tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4190e244-84b1-47b6-813d-9cadb7c65975/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:14:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473a30c4-5aa4-481c-8859-fda815d14872/disk.rescue --force-share --output=json" returned: 0 in 0.141s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:14:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473a30c4-5aa4-481c-8859-fda815d14872/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:14:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-1aa6f02b-e438-46d9-9da8-a550e1f74e6a tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4190e244-84b1-47b6-813d-9cadb7c65975/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:14:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-1aa6f02b-e438-46d9-9da8-a550e1f74e6a tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4190e244-84b1-47b6-813d-9cadb7c65975/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:14:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473a30c4-5aa4-481c-8859-fda815d14872/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:14:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473a30c4-5aa4-481c-8859-fda815d14872/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:14:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-1aa6f02b-e438-46d9-9da8-a550e1f74e6a tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4190e244-84b1-47b6-813d-9cadb7c65975/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:14:24 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-1aa6f02b-e438-46d9-9da8-a550e1f74e6a tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 16:14:24 user nova-compute[71874]: DEBUG nova.objects.instance [None req-1aa6f02b-e438-46d9-9da8-a550e1f74e6a tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lazy-loading 'trusted_certs' on Instance uuid 4190e244-84b1-47b6-813d-9cadb7c65975 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:14:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-1aa6f02b-e438-46d9-9da8-a550e1f74e6a tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:14:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/473a30c4-5aa4-481c-8859-fda815d14872/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:14:24 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=71874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 16:14:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e8a977c-aa84-47c4-a838-b5f90820de1a/disk.rescue --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:14:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-1aa6f02b-e438-46d9-9da8-a550e1f74e6a tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json" returned: 0 in 0.176s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:14:24 user nova-compute[71874]: DEBUG nova.virt.disk.api [None req-1aa6f02b-e438-46d9-9da8-a550e1f74e6a tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4190e244-84b1-47b6-813d-9cadb7c65975/disk. size=1073741824 {{(pid=71874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 16:14:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-1aa6f02b-e438-46d9-9da8-a550e1f74e6a tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4190e244-84b1-47b6-813d-9cadb7c65975/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:14:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e8a977c-aa84-47c4-a838-b5f90820de1a/disk.rescue --force-share --output=json" returned: 0 in 0.147s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:14:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e8a977c-aa84-47c4-a838-b5f90820de1a/disk.rescue --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:14:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-1aa6f02b-e438-46d9-9da8-a550e1f74e6a tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4190e244-84b1-47b6-813d-9cadb7c65975/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:14:24 user nova-compute[71874]: DEBUG nova.virt.disk.api [None req-1aa6f02b-e438-46d9-9da8-a550e1f74e6a tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Cannot resize image /opt/stack/data/nova/instances/4190e244-84b1-47b6-813d-9cadb7c65975/disk to a smaller size. {{(pid=71874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 16:14:24 user nova-compute[71874]: DEBUG nova.objects.instance [None req-1aa6f02b-e438-46d9-9da8-a550e1f74e6a tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lazy-loading 'migration_context' on Instance uuid 4190e244-84b1-47b6-813d-9cadb7c65975 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:14:24 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-1aa6f02b-e438-46d9-9da8-a550e1f74e6a tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T16:10:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1671411109',display_name='tempest-AttachVolumeTestJSON-server-1671411109',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1671411109',id=30,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFG81tsYAjuSLmCBJX5Oy53u6RydBq93WUwqVYUMtou9Wro9aHLYlkjtVGeLCCkr0S7Y24E90tPBrxAk1jNQ+AbkSKQBVRm7+VgL4Rx9C6hm1o9gCqXWuOVCyPnDpz3Eig==',key_name='tempest-keypair-1295229303',keypairs=<?>,launch_index=0,launched_at=2023-04-12T16:10:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='7cf4334df004490ba51b4d92ce5408ae',ramdisk_id='',reservation_id='r-sfgohvil',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-178648074',owner_user_name='tempest-AttachVolumeTestJSON-178648074-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T16:12:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2996f6997bb14fc3aec9c3736cc65b8a',uuid=4190e244-84b1-47b6-813d-9cadb7c65975,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c", "address": "fa:16:3e:d0:b5:d4", "network": {"id": "1ef428ff-90e5-4abd-93d0-b7c2c581cb26", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-425924095-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf4334df004490ba51b4d92ce5408ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeab1ea0c-8a", "ovs_interfaceid": "eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 16:14:24 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-1aa6f02b-e438-46d9-9da8-a550e1f74e6a tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Converting VIF {"id": "eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c", "address": "fa:16:3e:d0:b5:d4", "network": {"id": "1ef428ff-90e5-4abd-93d0-b7c2c581cb26", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-425924095-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf4334df004490ba51b4d92ce5408ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeab1ea0c-8a", "ovs_interfaceid": "eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:14:24 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-1aa6f02b-e438-46d9-9da8-a550e1f74e6a tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:b5:d4,bridge_name='br-int',has_traffic_filtering=True,id=eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c,network=Network(1ef428ff-90e5-4abd-93d0-b7c2c581cb26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeab1ea0c-8a') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:14:24 user nova-compute[71874]: DEBUG os_vif [None req-1aa6f02b-e438-46d9-9da8-a550e1f74e6a tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:b5:d4,bridge_name='br-int',has_traffic_filtering=True,id=eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c,network=Network(1ef428ff-90e5-4abd-93d0-b7c2c581cb26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeab1ea0c-8a') {{(pid=71874) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 16:14:24 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:14:24 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:14:24 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 16:14:24 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:14:24 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeab1ea0c-8a, may_exist=True) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:14:24 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapeab1ea0c-8a, col_values=(('external_ids', {'iface-id': 'eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d0:b5:d4', 'vm-uuid': '4190e244-84b1-47b6-813d-9cadb7c65975'}),)) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:14:24 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:14:24 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:14:25 user nova-compute[71874]: INFO os_vif [None req-1aa6f02b-e438-46d9-9da8-a550e1f74e6a tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:b5:d4,bridge_name='br-int',has_traffic_filtering=True,id=eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c,network=Network(1ef428ff-90e5-4abd-93d0-b7c2c581cb26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeab1ea0c-8a')
Apr 12 16:14:25 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e8a977c-aa84-47c4-a838-b5f90820de1a/disk.rescue --force-share --output=json" returned: 0 in 0.287s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:14:25 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/016ae41d-b098-4126-ace7-3da00b40cb9c/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:14:25 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/016ae41d-b098-4126-ace7-3da00b40cb9c/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:14:25 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/016ae41d-b098-4126-ace7-3da00b40cb9c/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:14:25 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/016ae41d-b098-4126-ace7-3da00b40cb9c/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:14:25 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/608fbea2-b42b-4bb9-94a7-2b76dcdc2001/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:14:25 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/608fbea2-b42b-4bb9-94a7-2b76dcdc2001/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:14:25 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/608fbea2-b42b-4bb9-94a7-2b76dcdc2001/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:14:25 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/608fbea2-b42b-4bb9-94a7-2b76dcdc2001/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:14:25 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b613235-a905-466f-b9cc-a21a321a6313/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:14:25 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b613235-a905-466f-b9cc-a21a321a6313/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:14:25 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b613235-a905-466f-b9cc-a21a321a6313/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:14:25 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-ecad32ac-b31d-4ef9-a008-fa9aa860fd55 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Acquiring lock "7f641c6b-b508-42a7-ae98-c2bfb841d798" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:14:25 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-ecad32ac-b31d-4ef9-a008-fa9aa860fd55 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "7f641c6b-b508-42a7-ae98-c2bfb841d798" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.004s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:14:25 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-ecad32ac-b31d-4ef9-a008-fa9aa860fd55 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Acquiring lock "7f641c6b-b508-42a7-ae98-c2bfb841d798-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:14:25 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-ecad32ac-b31d-4ef9-a008-fa9aa860fd55 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "7f641c6b-b508-42a7-ae98-c2bfb841d798-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:14:25 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-ecad32ac-b31d-4ef9-a008-fa9aa860fd55 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "7f641c6b-b508-42a7-ae98-c2bfb841d798-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:14:25 user nova-compute[71874]: INFO nova.compute.manager [None req-ecad32ac-b31d-4ef9-a008-fa9aa860fd55 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] Terminating instance
Apr 12 16:14:25 user nova-compute[71874]: DEBUG nova.compute.manager [None req-ecad32ac-b31d-4ef9-a008-fa9aa860fd55 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] Start destroying the instance on the hypervisor. {{(pid=71874) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 16:14:26 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:14:26 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b613235-a905-466f-b9cc-a21a321a6313/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:14:26 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afebffae-dbf6-4876-8c9f-0364f0fde49c/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:14:26 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afebffae-dbf6-4876-8c9f-0364f0fde49c/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:14:26 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afebffae-dbf6-4876-8c9f-0364f0fde49c/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:14:26 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:14:26 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:14:26 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:14:26 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afebffae-dbf6-4876-8c9f-0364f0fde49c/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:14:26 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:14:26 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/947c2ca9-fd67-4e8d-b0dc-90c5c827a59e/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:14:26 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:14:26 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/947c2ca9-fd67-4e8d-b0dc-90c5c827a59e/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:14:26 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/947c2ca9-fd67-4e8d-b0dc-90c5c827a59e/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:14:26 user nova-compute[71874]: DEBUG nova.compute.manager [req-b10df85a-24c8-4e97-8c4d-aa1e1692eccd req-a3467b27-b87e-46af-b396-95011978cd19 service nova] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] Received event network-vif-unplugged-746786a9-c889-4ece-bc5e-a905bf8deb5c {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:14:26 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-b10df85a-24c8-4e97-8c4d-aa1e1692eccd req-a3467b27-b87e-46af-b396-95011978cd19 service nova] Acquiring lock "7f641c6b-b508-42a7-ae98-c2bfb841d798-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:14:26 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-b10df85a-24c8-4e97-8c4d-aa1e1692eccd req-a3467b27-b87e-46af-b396-95011978cd19 service nova] Lock "7f641c6b-b508-42a7-ae98-c2bfb841d798-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:14:26 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-b10df85a-24c8-4e97-8c4d-aa1e1692eccd req-a3467b27-b87e-46af-b396-95011978cd19 service nova] Lock "7f641c6b-b508-42a7-ae98-c2bfb841d798-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:14:26 user nova-compute[71874]: DEBUG nova.compute.manager [req-b10df85a-24c8-4e97-8c4d-aa1e1692eccd req-a3467b27-b87e-46af-b396-95011978cd19 service nova] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] No waiting events found dispatching network-vif-unplugged-746786a9-c889-4ece-bc5e-a905bf8deb5c {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:14:26 user nova-compute[71874]: DEBUG nova.compute.manager [req-b10df85a-24c8-4e97-8c4d-aa1e1692eccd req-a3467b27-b87e-46af-b396-95011978cd19 service nova] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] Received event network-vif-unplugged-746786a9-c889-4ece-bc5e-a905bf8deb5c for instance with task_state deleting. {{(pid=71874) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 16:14:26 user nova-compute[71874]: DEBUG nova.compute.manager [req-e2f81833-1a52-4208-887e-48e266371ea0 req-60723866-d08d-4c61-83f8-78dfa4061724 service nova] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Received event network-vif-plugged-eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:14:26 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-e2f81833-1a52-4208-887e-48e266371ea0 req-60723866-d08d-4c61-83f8-78dfa4061724 service nova] Acquiring lock "4190e244-84b1-47b6-813d-9cadb7c65975-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:14:27 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-e2f81833-1a52-4208-887e-48e266371ea0 req-60723866-d08d-4c61-83f8-78dfa4061724 service nova] Lock "4190e244-84b1-47b6-813d-9cadb7c65975-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:14:27 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-e2f81833-1a52-4208-887e-48e266371ea0 req-60723866-d08d-4c61-83f8-78dfa4061724 service nova] Lock "4190e244-84b1-47b6-813d-9cadb7c65975-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:14:27 user nova-compute[71874]: DEBUG nova.compute.manager [req-e2f81833-1a52-4208-887e-48e266371ea0 req-60723866-d08d-4c61-83f8-78dfa4061724 service nova] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] No waiting events found dispatching network-vif-plugged-eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:14:27 user nova-compute[71874]: WARNING nova.compute.manager [req-e2f81833-1a52-4208-887e-48e266371ea0 req-60723866-d08d-4c61-83f8-78dfa4061724 service nova] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Received unexpected event network-vif-plugged-eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c for instance with vm_state stopped and task_state powering-on.
Apr 12 16:14:27 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/947c2ca9-fd67-4e8d-b0dc-90c5c827a59e/disk --force-share --output=json" returned: 0 in 0.270s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:14:27 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4c37cbf-1743-4dd5-97fd-2bb12ebee763/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:14:27 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4c37cbf-1743-4dd5-97fd-2bb12ebee763/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:14:27 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4c37cbf-1743-4dd5-97fd-2bb12ebee763/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:14:27 user nova-compute[71874]: INFO nova.virt.libvirt.driver [-] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] Instance destroyed successfully.
Apr 12 16:14:27 user nova-compute[71874]: DEBUG nova.objects.instance [None req-ecad32ac-b31d-4ef9-a008-fa9aa860fd55 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lazy-loading 'resources' on Instance uuid 7f641c6b-b508-42a7-ae98-c2bfb841d798 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:14:27 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4c37cbf-1743-4dd5-97fd-2bb12ebee763/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:14:27 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-ecad32ac-b31d-4ef9-a008-fa9aa860fd55 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T16:07:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1180614007',display_name='tempest-ServerRescueNegativeTestJSON-server-1180614007',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1180614007',id=25,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPrkO3n8O4MAhGHzu305sUcOksNuZEgf5S2SaBBr3Crg5JA/Jbvt/iKbwzA0RYiZC3er8snS/bVFp1ZVLE3mVV6weKk+F4a0jnCrqA1XiOQQWJzF35GqBgQiIFDFUaocAg==',key_name='tempest-keypair-1217848071',keypairs=<?>,launch_index=0,launched_at=2023-04-12T16:09:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b3fe48a3b7d846a195f1e47cc7f69695',ramdisk_id='',reservation_id='r-ij3c9obi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-984710343',owner_user_name='tempest-ServerRescueNegativeTestJSON-984710343-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T16:11:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='880266e3fa4d4dd889648c10208a1f8e',uuid=7f641c6b-b508-42a7-ae98-c2bfb841d798,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "746786a9-c889-4ece-bc5e-a905bf8deb5c", "address": "fa:16:3e:aa:23:e3", "network": {"id": "06fae0be-02dd-4962-a1ac-fd0413772758", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1493924857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3fe48a3b7d846a195f1e47cc7f69695", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap746786a9-c8", "ovs_interfaceid": "746786a9-c889-4ece-bc5e-a905bf8deb5c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 16:14:27 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-ecad32ac-b31d-4ef9-a008-fa9aa860fd55 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Converting VIF {"id": "746786a9-c889-4ece-bc5e-a905bf8deb5c", "address": "fa:16:3e:aa:23:e3", "network": {"id": "06fae0be-02dd-4962-a1ac-fd0413772758", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1493924857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3fe48a3b7d846a195f1e47cc7f69695", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap746786a9-c8", "ovs_interfaceid": "746786a9-c889-4ece-bc5e-a905bf8deb5c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:14:27 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-ecad32ac-b31d-4ef9-a008-fa9aa860fd55 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:aa:23:e3,bridge_name='br-int',has_traffic_filtering=True,id=746786a9-c889-4ece-bc5e-a905bf8deb5c,network=Network(06fae0be-02dd-4962-a1ac-fd0413772758),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap746786a9-c8') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:14:27 user nova-compute[71874]: DEBUG os_vif [None req-ecad32ac-b31d-4ef9-a008-fa9aa860fd55 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:aa:23:e3,bridge_name='br-int',has_traffic_filtering=True,id=746786a9-c889-4ece-bc5e-a905bf8deb5c,network=Network(06fae0be-02dd-4962-a1ac-fd0413772758),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap746786a9-c8') {{(pid=71874) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 16:14:27 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:14:27 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap746786a9-c8, bridge=br-int, if_exists=True) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:14:27 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:14:27 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:14:27 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:14:27 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:14:27 user nova-compute[71874]: INFO os_vif [None req-ecad32ac-b31d-4ef9-a008-fa9aa860fd55 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:aa:23:e3,bridge_name='br-int',has_traffic_filtering=True,id=746786a9-c889-4ece-bc5e-a905bf8deb5c,network=Network(06fae0be-02dd-4962-a1ac-fd0413772758),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap746786a9-c8')
Apr 12 16:14:27 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-ecad32ac-b31d-4ef9-a008-fa9aa860fd55 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] Deleting instance files /opt/stack/data/nova/instances/7f641c6b-b508-42a7-ae98-c2bfb841d798_del
Apr 12 16:14:27 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-ecad32ac-b31d-4ef9-a008-fa9aa860fd55 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] Deletion of /opt/stack/data/nova/instances/7f641c6b-b508-42a7-ae98-c2bfb841d798_del complete
Apr 12 16:14:30 user nova-compute[71874]: DEBUG nova.virt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Emitting event <LifecycleEvent: 1681316069.6873107, 4190e244-84b1-47b6-813d-9cadb7c65975 => Resumed> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:14:30 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] VM Resumed (Lifecycle Event)
Apr 12 16:14:30 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:14:30 user nova-compute[71874]: DEBUG nova.compute.manager [None req-1aa6f02b-e438-46d9-9da8-a550e1f74e6a tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Instance event wait completed in 0 seconds for  {{(pid=71874) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 16:14:30 user nova-compute[71874]: DEBUG nova.compute.manager [req-30948bbc-2c0f-48a8-b424-8dc29855d3bb req-d8ea7c17-a9c6-43d9-9665-b8627802ca59 service nova] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] Received event network-vif-plugged-746786a9-c889-4ece-bc5e-a905bf8deb5c {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:14:30 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-30948bbc-2c0f-48a8-b424-8dc29855d3bb req-d8ea7c17-a9c6-43d9-9665-b8627802ca59 service nova] Acquiring lock "7f641c6b-b508-42a7-ae98-c2bfb841d798-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:14:30 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-30948bbc-2c0f-48a8-b424-8dc29855d3bb req-d8ea7c17-a9c6-43d9-9665-b8627802ca59 service nova] Lock "7f641c6b-b508-42a7-ae98-c2bfb841d798-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:14:30 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-30948bbc-2c0f-48a8-b424-8dc29855d3bb req-d8ea7c17-a9c6-43d9-9665-b8627802ca59 service nova] Lock "7f641c6b-b508-42a7-ae98-c2bfb841d798-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:14:30 user nova-compute[71874]: DEBUG nova.compute.manager [req-30948bbc-2c0f-48a8-b424-8dc29855d3bb req-d8ea7c17-a9c6-43d9-9665-b8627802ca59 service nova] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] No waiting events found dispatching network-vif-plugged-746786a9-c889-4ece-bc5e-a905bf8deb5c {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:14:30 user nova-compute[71874]: WARNING nova.compute.manager [req-30948bbc-2c0f-48a8-b424-8dc29855d3bb req-d8ea7c17-a9c6-43d9-9665-b8627802ca59 service nova] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] Received unexpected event network-vif-plugged-746786a9-c889-4ece-bc5e-a905bf8deb5c for instance with vm_state active and task_state deleting.
Apr 12 16:14:30 user nova-compute[71874]: DEBUG nova.compute.manager [req-9ab1f25d-8ab0-4587-8b00-9fa760dcf623 req-fe220ba2-d815-430e-b92f-5936e3f1dc63 service nova] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Received event network-vif-plugged-eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:14:30 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-9ab1f25d-8ab0-4587-8b00-9fa760dcf623 req-fe220ba2-d815-430e-b92f-5936e3f1dc63 service nova] Acquiring lock "4190e244-84b1-47b6-813d-9cadb7c65975-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:14:30 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-9ab1f25d-8ab0-4587-8b00-9fa760dcf623 req-fe220ba2-d815-430e-b92f-5936e3f1dc63 service nova] Lock "4190e244-84b1-47b6-813d-9cadb7c65975-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:14:30 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-9ab1f25d-8ab0-4587-8b00-9fa760dcf623 req-fe220ba2-d815-430e-b92f-5936e3f1dc63 service nova] Lock "4190e244-84b1-47b6-813d-9cadb7c65975-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:14:30 user nova-compute[71874]: DEBUG nova.compute.manager [req-9ab1f25d-8ab0-4587-8b00-9fa760dcf623 req-fe220ba2-d815-430e-b92f-5936e3f1dc63 service nova] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] No waiting events found dispatching network-vif-plugged-eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:14:30 user nova-compute[71874]: WARNING nova.compute.manager [req-9ab1f25d-8ab0-4587-8b00-9fa760dcf623 req-fe220ba2-d815-430e-b92f-5936e3f1dc63 service nova] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Received unexpected event network-vif-plugged-eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c for instance with vm_state stopped and task_state powering-on.
Apr 12 16:14:30 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:14:30 user nova-compute[71874]: INFO nova.compute.manager [None req-ecad32ac-b31d-4ef9-a008-fa9aa860fd55 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] Took 4.31 seconds to destroy the instance on the hypervisor.
Apr 12 16:14:30 user nova-compute[71874]: DEBUG oslo.service.loopingcall [None req-ecad32ac-b31d-4ef9-a008-fa9aa860fd55 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71874) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 16:14:30 user nova-compute[71874]: DEBUG nova.compute.manager [-] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] Deallocating network for instance {{(pid=71874) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 16:14:30 user nova-compute[71874]: DEBUG nova.network.neutron [-] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] deallocate_for_instance() {{(pid=71874) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 16:14:30 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=71874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 16:14:30 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:14:30 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:14:30 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Hypervisor/Node resource view: name=user free_ram=7550MB free_disk=25.727378845214844GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71874) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 16:14:30 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:14:30 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:14:30 user nova-compute[71874]: INFO nova.virt.libvirt.driver [-] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Instance rebooted successfully.
Apr 12 16:14:30 user nova-compute[71874]: DEBUG nova.compute.manager [None req-1aa6f02b-e438-46d9-9da8-a550e1f74e6a tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:14:30 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] During sync_power_state the instance has a pending task (powering-on). Skip.
Apr 12 16:14:30 user nova-compute[71874]: DEBUG nova.virt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Emitting event <LifecycleEvent: 1681316069.688212, 4190e244-84b1-47b6-813d-9cadb7c65975 => Started> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:14:30 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] VM Started (Lifecycle Event)
Apr 12 16:14:30 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:14:30 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=71874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 16:14:30 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] During sync_power_state the instance has a pending task (powering-on). Skip.
Apr 12 16:14:30 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance afebffae-dbf6-4876-8c9f-0364f0fde49c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:14:30 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 473a30c4-5aa4-481c-8859-fda815d14872 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:14:30 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 608fbea2-b42b-4bb9-94a7-2b76dcdc2001 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:14:30 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance f52ee906-c8fd-4cd5-842e-de98a5099c4f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:14:30 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 7f641c6b-b508-42a7-ae98-c2bfb841d798 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:14:30 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 016ae41d-b098-4126-ace7-3da00b40cb9c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:14:30 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 4190e244-84b1-47b6-813d-9cadb7c65975 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:14:30 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 0e8a977c-aa84-47c4-a838-b5f90820de1a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:14:30 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 1b613235-a905-466f-b9cc-a21a321a6313 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:14:30 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 32471bee-e77e-4a1b-8e00-d938a1373976 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:14:30 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 947c2ca9-fd67-4e8d-b0dc-90c5c827a59e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:14:30 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance b4c37cbf-1743-4dd5-97fd-2bb12ebee763 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:14:30 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=71874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 16:14:30 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Final resource view: name=user phys_ram=16023MB used_ram=2048MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=71874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 16:14:30 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Inventory has not changed in ProviderTree for provider: 0e94b4c8-cd49-45e4-9133-d36eb4b2456b {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 16:14:31 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Inventory has not changed for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 16:14:31 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Compute_service record updated for user:user {{(pid=71874) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 16:14:31 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.762s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:14:31 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:14:31 user nova-compute[71874]: DEBUG nova.network.neutron [-] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] Updating instance_info_cache with network_info: [] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:14:31 user nova-compute[71874]: INFO nova.compute.manager [-] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] Took 1.31 seconds to deallocate network for instance.
Apr 12 16:14:31 user nova-compute[71874]: DEBUG nova.compute.manager [req-941daf8b-7f2c-4540-8c35-88a80032748c req-14ff20eb-a06e-4571-a148-e00d87bd7514 service nova] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] Received event network-vif-deleted-746786a9-c889-4ece-bc5e-a905bf8deb5c {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:14:31 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-ecad32ac-b31d-4ef9-a008-fa9aa860fd55 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:14:31 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-ecad32ac-b31d-4ef9-a008-fa9aa860fd55 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:14:32 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:14:32 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:14:32 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Starting heal instance info cache {{(pid=71874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 16:14:32 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-ecad32ac-b31d-4ef9-a008-fa9aa860fd55 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Inventory has not changed in ProviderTree for provider: 0e94b4c8-cd49-45e4-9133-d36eb4b2456b {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 16:14:32 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-ecad32ac-b31d-4ef9-a008-fa9aa860fd55 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Inventory has not changed for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 16:14:32 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-ecad32ac-b31d-4ef9-a008-fa9aa860fd55 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.517s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:14:32 user nova-compute[71874]: INFO nova.scheduler.client.report [None req-ecad32ac-b31d-4ef9-a008-fa9aa860fd55 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Deleted allocations for instance 7f641c6b-b508-42a7-ae98-c2bfb841d798
Apr 12 16:14:32 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-ecad32ac-b31d-4ef9-a008-fa9aa860fd55 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "7f641c6b-b508-42a7-ae98-c2bfb841d798" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.442s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:14:32 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquiring lock "refresh_cache-608fbea2-b42b-4bb9-94a7-2b76dcdc2001" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:14:32 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquired lock "refresh_cache-608fbea2-b42b-4bb9-94a7-2b76dcdc2001" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:14:32 user nova-compute[71874]: DEBUG nova.network.neutron [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] [instance: 608fbea2-b42b-4bb9-94a7-2b76dcdc2001] Forcefully refreshing network info cache for instance {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 16:14:32 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:14:33 user nova-compute[71874]: DEBUG nova.network.neutron [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] [instance: 608fbea2-b42b-4bb9-94a7-2b76dcdc2001] Updating instance_info_cache with network_info: [{"id": "246d47a5-6953-4e38-8546-63953a8721cf", "address": "fa:16:3e:64:93:eb", "network": {"id": "b36306e0-04c5-4b1b-8022-05ff121c4e43", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1503204786-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9210f81232304e179d3e09914a492442", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap246d47a5-69", "ovs_interfaceid": "246d47a5-6953-4e38-8546-63953a8721cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:14:33 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Releasing lock "refresh_cache-608fbea2-b42b-4bb9-94a7-2b76dcdc2001" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:14:33 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] [instance: 608fbea2-b42b-4bb9-94a7-2b76dcdc2001] Updated the network info_cache for instance {{(pid=71874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 16:14:33 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:14:33 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:14:33 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:14:33 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:14:33 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:14:33 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:14:33 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71874) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 16:14:33 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:14:36 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:14:36 user nova-compute[71874]: INFO nova.compute.manager [None req-83ecaeec-9814-4e68-97ff-0941d1de1540 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 0e8a977c-aa84-47c4-a838-b5f90820de1a] Unrescuing
Apr 12 16:14:36 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-83ecaeec-9814-4e68-97ff-0941d1de1540 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Acquiring lock "refresh_cache-0e8a977c-aa84-47c4-a838-b5f90820de1a" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:14:36 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-83ecaeec-9814-4e68-97ff-0941d1de1540 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Acquired lock "refresh_cache-0e8a977c-aa84-47c4-a838-b5f90820de1a" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:14:36 user nova-compute[71874]: DEBUG nova.network.neutron [None req-83ecaeec-9814-4e68-97ff-0941d1de1540 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 0e8a977c-aa84-47c4-a838-b5f90820de1a] Building network info cache for instance {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 16:14:37 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:14:37 user nova-compute[71874]: DEBUG nova.network.neutron [None req-83ecaeec-9814-4e68-97ff-0941d1de1540 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 0e8a977c-aa84-47c4-a838-b5f90820de1a] Updating instance_info_cache with network_info: [{"id": "40e16d3f-2e2e-45df-be16-ef3622bfde2e", "address": "fa:16:3e:4d:9c:b1", "network": {"id": "b36306e0-04c5-4b1b-8022-05ff121c4e43", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1503204786-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9210f81232304e179d3e09914a492442", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40e16d3f-2e", "ovs_interfaceid": "40e16d3f-2e2e-45df-be16-ef3622bfde2e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:14:37 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-83ecaeec-9814-4e68-97ff-0941d1de1540 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Releasing lock "refresh_cache-0e8a977c-aa84-47c4-a838-b5f90820de1a" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:14:37 user nova-compute[71874]: DEBUG nova.objects.instance [None req-83ecaeec-9814-4e68-97ff-0941d1de1540 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lazy-loading 'flavor' on Instance uuid 0e8a977c-aa84-47c4-a838-b5f90820de1a {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:14:37 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:14:37 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:14:37 user nova-compute[71874]: DEBUG nova.compute.manager [req-3eef3e48-f26e-4638-9a72-0f9d890131b9 req-3e25a7af-eb95-4988-9246-31b8022bb5ff service nova] [instance: 0e8a977c-aa84-47c4-a838-b5f90820de1a] Received event network-vif-unplugged-40e16d3f-2e2e-45df-be16-ef3622bfde2e {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:14:37 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-3eef3e48-f26e-4638-9a72-0f9d890131b9 req-3e25a7af-eb95-4988-9246-31b8022bb5ff service nova] Acquiring lock "0e8a977c-aa84-47c4-a838-b5f90820de1a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:14:37 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-3eef3e48-f26e-4638-9a72-0f9d890131b9 req-3e25a7af-eb95-4988-9246-31b8022bb5ff service nova] Lock "0e8a977c-aa84-47c4-a838-b5f90820de1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:14:37 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-3eef3e48-f26e-4638-9a72-0f9d890131b9 req-3e25a7af-eb95-4988-9246-31b8022bb5ff service nova] Lock "0e8a977c-aa84-47c4-a838-b5f90820de1a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:14:37 user nova-compute[71874]: DEBUG nova.compute.manager [req-3eef3e48-f26e-4638-9a72-0f9d890131b9 req-3e25a7af-eb95-4988-9246-31b8022bb5ff service nova] [instance: 0e8a977c-aa84-47c4-a838-b5f90820de1a] No waiting events found dispatching network-vif-unplugged-40e16d3f-2e2e-45df-be16-ef3622bfde2e {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:14:37 user nova-compute[71874]: WARNING nova.compute.manager [req-3eef3e48-f26e-4638-9a72-0f9d890131b9 req-3e25a7af-eb95-4988-9246-31b8022bb5ff service nova] [instance: 0e8a977c-aa84-47c4-a838-b5f90820de1a] Received unexpected event network-vif-unplugged-40e16d3f-2e2e-45df-be16-ef3622bfde2e for instance with vm_state rescued and task_state unrescuing.
Apr 12 16:14:38 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:14:38 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:14:38 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:14:38 user nova-compute[71874]: INFO nova.virt.libvirt.driver [-] [instance: 0e8a977c-aa84-47c4-a838-b5f90820de1a] Instance destroyed successfully.
Apr 12 16:14:39 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:14:39 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:14:39 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:14:39 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:14:39 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:14:39 user nova-compute[71874]: DEBUG nova.compute.manager [req-1b386072-3f8f-4fe2-9142-1af5b08ed80d req-01b294c5-495b-4615-bd1c-b450ddb5f179 service nova] [instance: 0e8a977c-aa84-47c4-a838-b5f90820de1a] Received event network-vif-plugged-40e16d3f-2e2e-45df-be16-ef3622bfde2e {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:14:39 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-1b386072-3f8f-4fe2-9142-1af5b08ed80d req-01b294c5-495b-4615-bd1c-b450ddb5f179 service nova] Acquiring lock "0e8a977c-aa84-47c4-a838-b5f90820de1a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:14:39 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-1b386072-3f8f-4fe2-9142-1af5b08ed80d req-01b294c5-495b-4615-bd1c-b450ddb5f179 service nova] Lock "0e8a977c-aa84-47c4-a838-b5f90820de1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:14:39 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-1b386072-3f8f-4fe2-9142-1af5b08ed80d req-01b294c5-495b-4615-bd1c-b450ddb5f179 service nova] Lock "0e8a977c-aa84-47c4-a838-b5f90820de1a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:14:39 user nova-compute[71874]: DEBUG nova.compute.manager [req-1b386072-3f8f-4fe2-9142-1af5b08ed80d req-01b294c5-495b-4615-bd1c-b450ddb5f179 service nova] [instance: 0e8a977c-aa84-47c4-a838-b5f90820de1a] No waiting events found dispatching network-vif-plugged-40e16d3f-2e2e-45df-be16-ef3622bfde2e {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:14:39 user nova-compute[71874]: WARNING nova.compute.manager [req-1b386072-3f8f-4fe2-9142-1af5b08ed80d req-01b294c5-495b-4615-bd1c-b450ddb5f179 service nova] [instance: 0e8a977c-aa84-47c4-a838-b5f90820de1a] Received unexpected event network-vif-plugged-40e16d3f-2e2e-45df-be16-ef3622bfde2e for instance with vm_state rescued and task_state unrescuing.
Apr 12 16:14:40 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:14:40 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:14:42 user nova-compute[71874]: DEBUG nova.compute.manager [req-e3b1b41e-f61e-403e-be7f-a5815540736a req-e98f27c0-fc9b-4368-8a16-78afe1926187 service nova] [instance: 0e8a977c-aa84-47c4-a838-b5f90820de1a] Received event network-vif-plugged-40e16d3f-2e2e-45df-be16-ef3622bfde2e {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:14:42 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-e3b1b41e-f61e-403e-be7f-a5815540736a req-e98f27c0-fc9b-4368-8a16-78afe1926187 service nova] Acquiring lock "0e8a977c-aa84-47c4-a838-b5f90820de1a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:14:42 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-e3b1b41e-f61e-403e-be7f-a5815540736a req-e98f27c0-fc9b-4368-8a16-78afe1926187 service nova] Lock "0e8a977c-aa84-47c4-a838-b5f90820de1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:14:42 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-e3b1b41e-f61e-403e-be7f-a5815540736a req-e98f27c0-fc9b-4368-8a16-78afe1926187 service nova] Lock "0e8a977c-aa84-47c4-a838-b5f90820de1a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:14:42 user nova-compute[71874]: DEBUG nova.compute.manager [req-e3b1b41e-f61e-403e-be7f-a5815540736a req-e98f27c0-fc9b-4368-8a16-78afe1926187 service nova] [instance: 0e8a977c-aa84-47c4-a838-b5f90820de1a] No waiting events found dispatching network-vif-plugged-40e16d3f-2e2e-45df-be16-ef3622bfde2e {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:14:42 user nova-compute[71874]: WARNING nova.compute.manager [req-e3b1b41e-f61e-403e-be7f-a5815540736a req-e98f27c0-fc9b-4368-8a16-78afe1926187 service nova] [instance: 0e8a977c-aa84-47c4-a838-b5f90820de1a] Received unexpected event network-vif-plugged-40e16d3f-2e2e-45df-be16-ef3622bfde2e for instance with vm_state rescued and task_state unrescuing.
Apr 12 16:14:42 user nova-compute[71874]: DEBUG nova.compute.manager [req-e3b1b41e-f61e-403e-be7f-a5815540736a req-e98f27c0-fc9b-4368-8a16-78afe1926187 service nova] [instance: 0e8a977c-aa84-47c4-a838-b5f90820de1a] Received event network-vif-plugged-40e16d3f-2e2e-45df-be16-ef3622bfde2e {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:14:42 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-e3b1b41e-f61e-403e-be7f-a5815540736a req-e98f27c0-fc9b-4368-8a16-78afe1926187 service nova] Acquiring lock "0e8a977c-aa84-47c4-a838-b5f90820de1a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:14:42 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-e3b1b41e-f61e-403e-be7f-a5815540736a req-e98f27c0-fc9b-4368-8a16-78afe1926187 service nova] Lock "0e8a977c-aa84-47c4-a838-b5f90820de1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:14:42 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-e3b1b41e-f61e-403e-be7f-a5815540736a req-e98f27c0-fc9b-4368-8a16-78afe1926187 service nova] Lock "0e8a977c-aa84-47c4-a838-b5f90820de1a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:14:42 user nova-compute[71874]: DEBUG nova.compute.manager [req-e3b1b41e-f61e-403e-be7f-a5815540736a req-e98f27c0-fc9b-4368-8a16-78afe1926187 service nova] [instance: 0e8a977c-aa84-47c4-a838-b5f90820de1a] No waiting events found dispatching network-vif-plugged-40e16d3f-2e2e-45df-be16-ef3622bfde2e {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:14:42 user nova-compute[71874]: WARNING nova.compute.manager [req-e3b1b41e-f61e-403e-be7f-a5815540736a req-e98f27c0-fc9b-4368-8a16-78afe1926187 service nova] [instance: 0e8a977c-aa84-47c4-a838-b5f90820de1a] Received unexpected event network-vif-plugged-40e16d3f-2e2e-45df-be16-ef3622bfde2e for instance with vm_state rescued and task_state unrescuing.
Apr 12 16:14:42 user nova-compute[71874]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681316067.3998487, 7f641c6b-b508-42a7-ae98-c2bfb841d798 => Stopped> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:14:42 user nova-compute[71874]: INFO nova.compute.manager [-] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] VM Stopped (Lifecycle Event)
Apr 12 16:14:42 user nova-compute[71874]: DEBUG nova.virt.libvirt.host [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Removed pending event for 0e8a977c-aa84-47c4-a838-b5f90820de1a due to event {{(pid=71874) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 12 16:14:42 user nova-compute[71874]: DEBUG nova.virt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Emitting event <LifecycleEvent: 1681316082.4153388, 0e8a977c-aa84-47c4-a838-b5f90820de1a => Resumed> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:14:42 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 0e8a977c-aa84-47c4-a838-b5f90820de1a] VM Resumed (Lifecycle Event)
Apr 12 16:14:42 user nova-compute[71874]: DEBUG nova.compute.manager [None req-83ecaeec-9814-4e68-97ff-0941d1de1540 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 0e8a977c-aa84-47c4-a838-b5f90820de1a] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:14:42 user nova-compute[71874]: DEBUG nova.compute.manager [None req-c0a98035-c7d6-4990-89eb-be246a6c4e51 None None] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:14:42 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 0e8a977c-aa84-47c4-a838-b5f90820de1a] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:14:42 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 0e8a977c-aa84-47c4-a838-b5f90820de1a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 16:14:42 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:14:42 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 0e8a977c-aa84-47c4-a838-b5f90820de1a] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 12 16:14:42 user nova-compute[71874]: DEBUG nova.virt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Emitting event <LifecycleEvent: 1681316082.4156923, 0e8a977c-aa84-47c4-a838-b5f90820de1a => Started> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:14:42 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 0e8a977c-aa84-47c4-a838-b5f90820de1a] VM Started (Lifecycle Event)
Apr 12 16:14:42 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 0e8a977c-aa84-47c4-a838-b5f90820de1a] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:14:42 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 0e8a977c-aa84-47c4-a838-b5f90820de1a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 16:14:42 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-6095bc66-af1b-412a-ab92-dbe38ad854b6 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Acquiring lock "540a8fd5-8c18-4efe-97d4-9f0942cebcf5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:14:42 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-6095bc66-af1b-412a-ab92-dbe38ad854b6 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "540a8fd5-8c18-4efe-97d4-9f0942cebcf5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:14:42 user nova-compute[71874]: DEBUG nova.compute.manager [None req-6095bc66-af1b-412a-ab92-dbe38ad854b6 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] [instance: 540a8fd5-8c18-4efe-97d4-9f0942cebcf5] Starting instance... {{(pid=71874) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 16:14:43 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-6095bc66-af1b-412a-ab92-dbe38ad854b6 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:14:43 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-6095bc66-af1b-412a-ab92-dbe38ad854b6 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:14:43 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-6095bc66-af1b-412a-ab92-dbe38ad854b6 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71874) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 16:14:43 user nova-compute[71874]: INFO nova.compute.claims [None req-6095bc66-af1b-412a-ab92-dbe38ad854b6 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] [instance: 540a8fd5-8c18-4efe-97d4-9f0942cebcf5] Claim successful on node user
Apr 12 16:14:43 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:14:43 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-6095bc66-af1b-412a-ab92-dbe38ad854b6 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Inventory has not changed in ProviderTree for provider: 0e94b4c8-cd49-45e4-9133-d36eb4b2456b {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 16:14:43 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-6095bc66-af1b-412a-ab92-dbe38ad854b6 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Inventory has not changed for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 16:14:43 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-6095bc66-af1b-412a-ab92-dbe38ad854b6 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.633s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:14:43 user nova-compute[71874]: DEBUG nova.compute.manager [None req-6095bc66-af1b-412a-ab92-dbe38ad854b6 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] [instance: 540a8fd5-8c18-4efe-97d4-9f0942cebcf5] Start building networks asynchronously for instance. {{(pid=71874) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 16:14:43 user nova-compute[71874]: DEBUG nova.compute.manager [None req-6095bc66-af1b-412a-ab92-dbe38ad854b6 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] [instance: 540a8fd5-8c18-4efe-97d4-9f0942cebcf5] Allocating IP information in the background. {{(pid=71874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 16:14:43 user nova-compute[71874]: DEBUG nova.network.neutron [None req-6095bc66-af1b-412a-ab92-dbe38ad854b6 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] [instance: 540a8fd5-8c18-4efe-97d4-9f0942cebcf5] allocate_for_instance() {{(pid=71874) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 16:14:43 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-6095bc66-af1b-412a-ab92-dbe38ad854b6 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] [instance: 540a8fd5-8c18-4efe-97d4-9f0942cebcf5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 16:14:43 user nova-compute[71874]: DEBUG nova.compute.manager [None req-6095bc66-af1b-412a-ab92-dbe38ad854b6 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] [instance: 540a8fd5-8c18-4efe-97d4-9f0942cebcf5] Start building block device mappings for instance. {{(pid=71874) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 16:14:43 user nova-compute[71874]: DEBUG nova.policy [None req-6095bc66-af1b-412a-ab92-dbe38ad854b6 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3823da50be004112aaa5ee35b724c6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29d8082517724895a2027594f440071d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71874) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 16:14:43 user nova-compute[71874]: DEBUG nova.compute.manager [None req-6095bc66-af1b-412a-ab92-dbe38ad854b6 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] [instance: 540a8fd5-8c18-4efe-97d4-9f0942cebcf5] Start spawning the instance on the hypervisor. {{(pid=71874) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 16:14:43 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-6095bc66-af1b-412a-ab92-dbe38ad854b6 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] [instance: 540a8fd5-8c18-4efe-97d4-9f0942cebcf5] Creating instance directory {{(pid=71874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 16:14:43 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-6095bc66-af1b-412a-ab92-dbe38ad854b6 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] [instance: 540a8fd5-8c18-4efe-97d4-9f0942cebcf5] Creating image(s)
Apr 12 16:14:43 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-6095bc66-af1b-412a-ab92-dbe38ad854b6 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Acquiring lock "/opt/stack/data/nova/instances/540a8fd5-8c18-4efe-97d4-9f0942cebcf5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:14:43 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-6095bc66-af1b-412a-ab92-dbe38ad854b6 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "/opt/stack/data/nova/instances/540a8fd5-8c18-4efe-97d4-9f0942cebcf5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:14:44 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-6095bc66-af1b-412a-ab92-dbe38ad854b6 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "/opt/stack/data/nova/instances/540a8fd5-8c18-4efe-97d4-9f0942cebcf5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:14:44 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-6095bc66-af1b-412a-ab92-dbe38ad854b6 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:14:44 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-6095bc66-af1b-412a-ab92-dbe38ad854b6 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json" returned: 0 in 0.171s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:14:44 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-6095bc66-af1b-412a-ab92-dbe38ad854b6 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Acquiring lock "b88df1b37cb431f52bc53b5616015c89b5bec411" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:14:44 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-6095bc66-af1b-412a-ab92-dbe38ad854b6 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "b88df1b37cb431f52bc53b5616015c89b5bec411" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:14:44 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-6095bc66-af1b-412a-ab92-dbe38ad854b6 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:14:44 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-6095bc66-af1b-412a-ab92-dbe38ad854b6 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json" returned: 0 in 0.189s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:14:44 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-6095bc66-af1b-412a-ab92-dbe38ad854b6 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411,backing_fmt=raw /opt/stack/data/nova/instances/540a8fd5-8c18-4efe-97d4-9f0942cebcf5/disk 1073741824 {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:14:44 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-6095bc66-af1b-412a-ab92-dbe38ad854b6 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411,backing_fmt=raw /opt/stack/data/nova/instances/540a8fd5-8c18-4efe-97d4-9f0942cebcf5/disk 1073741824" returned: 0 in 0.062s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:14:44 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-6095bc66-af1b-412a-ab92-dbe38ad854b6 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "b88df1b37cb431f52bc53b5616015c89b5bec411" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.261s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:14:44 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-6095bc66-af1b-412a-ab92-dbe38ad854b6 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:14:44 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-6095bc66-af1b-412a-ab92-dbe38ad854b6 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json" returned: 0 in 0.152s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:14:44 user nova-compute[71874]: DEBUG nova.virt.disk.api [None req-6095bc66-af1b-412a-ab92-dbe38ad854b6 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Checking if we can resize image /opt/stack/data/nova/instances/540a8fd5-8c18-4efe-97d4-9f0942cebcf5/disk. size=1073741824 {{(pid=71874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 16:14:44 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-6095bc66-af1b-412a-ab92-dbe38ad854b6 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/540a8fd5-8c18-4efe-97d4-9f0942cebcf5/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:14:44 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-6095bc66-af1b-412a-ab92-dbe38ad854b6 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/540a8fd5-8c18-4efe-97d4-9f0942cebcf5/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:14:44 user nova-compute[71874]: DEBUG nova.virt.disk.api [None req-6095bc66-af1b-412a-ab92-dbe38ad854b6 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Cannot resize image /opt/stack/data/nova/instances/540a8fd5-8c18-4efe-97d4-9f0942cebcf5/disk to a smaller size. {{(pid=71874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 16:14:44 user nova-compute[71874]: DEBUG nova.objects.instance [None req-6095bc66-af1b-412a-ab92-dbe38ad854b6 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lazy-loading 'migration_context' on Instance uuid 540a8fd5-8c18-4efe-97d4-9f0942cebcf5 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:14:44 user nova-compute[71874]: DEBUG nova.network.neutron [None req-6095bc66-af1b-412a-ab92-dbe38ad854b6 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] [instance: 540a8fd5-8c18-4efe-97d4-9f0942cebcf5] Successfully created port: be492426-cc7d-4f76-80a2-ab97d8733e58 {{(pid=71874) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 16:14:44 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-6095bc66-af1b-412a-ab92-dbe38ad854b6 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] [instance: 540a8fd5-8c18-4efe-97d4-9f0942cebcf5] Created local disks {{(pid=71874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 16:14:44 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-6095bc66-af1b-412a-ab92-dbe38ad854b6 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] [instance: 540a8fd5-8c18-4efe-97d4-9f0942cebcf5] Ensure instance console log exists: /opt/stack/data/nova/instances/540a8fd5-8c18-4efe-97d4-9f0942cebcf5/console.log {{(pid=71874) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 16:14:44 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-6095bc66-af1b-412a-ab92-dbe38ad854b6 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:14:44 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-6095bc66-af1b-412a-ab92-dbe38ad854b6 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:14:44 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-6095bc66-af1b-412a-ab92-dbe38ad854b6 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:14:45 user nova-compute[71874]: DEBUG nova.network.neutron [None req-6095bc66-af1b-412a-ab92-dbe38ad854b6 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] [instance: 540a8fd5-8c18-4efe-97d4-9f0942cebcf5] Successfully updated port: be492426-cc7d-4f76-80a2-ab97d8733e58 {{(pid=71874) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 16:14:45 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-6095bc66-af1b-412a-ab92-dbe38ad854b6 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Acquiring lock "refresh_cache-540a8fd5-8c18-4efe-97d4-9f0942cebcf5" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:14:45 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-6095bc66-af1b-412a-ab92-dbe38ad854b6 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Acquired lock "refresh_cache-540a8fd5-8c18-4efe-97d4-9f0942cebcf5" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:14:45 user nova-compute[71874]: DEBUG nova.network.neutron [None req-6095bc66-af1b-412a-ab92-dbe38ad854b6 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] [instance: 540a8fd5-8c18-4efe-97d4-9f0942cebcf5] Building network info cache for instance {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 16:14:45 user nova-compute[71874]: DEBUG nova.compute.manager [req-f8543318-1b53-492f-a171-2ea0777fab01 req-311d2b0a-495b-41ba-9f19-2ec2ae43925a service nova] [instance: 540a8fd5-8c18-4efe-97d4-9f0942cebcf5] Received event network-changed-be492426-cc7d-4f76-80a2-ab97d8733e58 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:14:45 user nova-compute[71874]: DEBUG nova.compute.manager [req-f8543318-1b53-492f-a171-2ea0777fab01 req-311d2b0a-495b-41ba-9f19-2ec2ae43925a service nova] [instance: 540a8fd5-8c18-4efe-97d4-9f0942cebcf5] Refreshing instance network info cache due to event network-changed-be492426-cc7d-4f76-80a2-ab97d8733e58. {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 16:14:45 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-f8543318-1b53-492f-a171-2ea0777fab01 req-311d2b0a-495b-41ba-9f19-2ec2ae43925a service nova] Acquiring lock "refresh_cache-540a8fd5-8c18-4efe-97d4-9f0942cebcf5" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:14:45 user nova-compute[71874]: DEBUG nova.network.neutron [None req-6095bc66-af1b-412a-ab92-dbe38ad854b6 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] [instance: 540a8fd5-8c18-4efe-97d4-9f0942cebcf5] Instance cache missing network info. {{(pid=71874) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 16:14:45 user nova-compute[71874]: DEBUG nova.network.neutron [None req-6095bc66-af1b-412a-ab92-dbe38ad854b6 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] [instance: 540a8fd5-8c18-4efe-97d4-9f0942cebcf5] Updating instance_info_cache with network_info: [{"id": "be492426-cc7d-4f76-80a2-ab97d8733e58", "address": "fa:16:3e:23:bb:b8", "network": {"id": "9c134a59-09c8-44dc-b4c7-3bb522d3f948", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-787092091-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29d8082517724895a2027594f440071d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe492426-cc", "ovs_interfaceid": "be492426-cc7d-4f76-80a2-ab97d8733e58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:14:45 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-6095bc66-af1b-412a-ab92-dbe38ad854b6 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Releasing lock "refresh_cache-540a8fd5-8c18-4efe-97d4-9f0942cebcf5" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:14:45 user nova-compute[71874]: DEBUG nova.compute.manager [None req-6095bc66-af1b-412a-ab92-dbe38ad854b6 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] [instance: 540a8fd5-8c18-4efe-97d4-9f0942cebcf5] Instance network_info: |[{"id": "be492426-cc7d-4f76-80a2-ab97d8733e58", "address": "fa:16:3e:23:bb:b8", "network": {"id": "9c134a59-09c8-44dc-b4c7-3bb522d3f948", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-787092091-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29d8082517724895a2027594f440071d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe492426-cc", "ovs_interfaceid": "be492426-cc7d-4f76-80a2-ab97d8733e58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 16:14:45 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-f8543318-1b53-492f-a171-2ea0777fab01 req-311d2b0a-495b-41ba-9f19-2ec2ae43925a service nova] Acquired lock "refresh_cache-540a8fd5-8c18-4efe-97d4-9f0942cebcf5" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:14:45 user nova-compute[71874]: DEBUG nova.network.neutron [req-f8543318-1b53-492f-a171-2ea0777fab01 req-311d2b0a-495b-41ba-9f19-2ec2ae43925a service nova] [instance: 540a8fd5-8c18-4efe-97d4-9f0942cebcf5] Refreshing network info cache for port be492426-cc7d-4f76-80a2-ab97d8733e58 {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 16:14:45 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-6095bc66-af1b-412a-ab92-dbe38ad854b6 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] [instance: 540a8fd5-8c18-4efe-97d4-9f0942cebcf5] Start _get_guest_xml network_info=[{"id": "be492426-cc7d-4f76-80a2-ab97d8733e58", "address": "fa:16:3e:23:bb:b8", "network": {"id": "9c134a59-09c8-44dc-b4c7-3bb522d3f948", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-787092091-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29d8082517724895a2027594f440071d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe492426-cc", "ovs_interfaceid": "be492426-cc7d-4f76-80a2-ab97d8733e58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T15:55:37Z,direct_url=<?>,disk_format='qcow2',id=9dc63f14-8b70-4e72-89f2-13464f2f5c7c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='61a4936d9b7744c0b488d81c9b7746b6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T15:55:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_options': None, 'image_id': '9dc63f14-8b70-4e72-89f2-13464f2f5c7c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 16:14:45 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-6095bc66-af1b-412a-ab92-dbe38ad854b6 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:14:45 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-6095bc66-af1b-412a-ab92-dbe38ad854b6 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:14:45 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-6095bc66-af1b-412a-ab92-dbe38ad854b6 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71874) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 16:14:45 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-6095bc66-af1b-412a-ab92-dbe38ad854b6 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T15:56:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T15:55:37Z,direct_url=<?>,disk_format='qcow2',id=9dc63f14-8b70-4e72-89f2-13464f2f5c7c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='61a4936d9b7744c0b488d81c9b7746b6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T15:55:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 16:14:45 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-6095bc66-af1b-412a-ab92-dbe38ad854b6 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Flavor limits 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 16:14:45 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-6095bc66-af1b-412a-ab92-dbe38ad854b6 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Image limits 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 16:14:45 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-6095bc66-af1b-412a-ab92-dbe38ad854b6 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Flavor pref 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 16:14:45 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-6095bc66-af1b-412a-ab92-dbe38ad854b6 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Image pref 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 16:14:45 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-6095bc66-af1b-412a-ab92-dbe38ad854b6 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 16:14:45 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-6095bc66-af1b-412a-ab92-dbe38ad854b6 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 16:14:45 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-6095bc66-af1b-412a-ab92-dbe38ad854b6 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 16:14:45 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-6095bc66-af1b-412a-ab92-dbe38ad854b6 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Got 1 possible topologies {{(pid=71874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 16:14:45 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-6095bc66-af1b-412a-ab92-dbe38ad854b6 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 16:14:45 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-6095bc66-af1b-412a-ab92-dbe38ad854b6 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 16:14:46 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-6095bc66-af1b-412a-ab92-dbe38ad854b6 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T16:14:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-491760148',display_name='tempest-SnapshotDataIntegrityTests-server-491760148',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-491760148',id=36,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA+FpbR8FK82hCEPJ5HMQ8owWEJRGyodg69j5jSQV/QhgdEnkk4eYIy7X1tEJsjea4X8jfMn9W0N1l8a7XMKl5DRaLYt49U8Vr9yiskiXDGQVl0iBNmRtOG0NsqYt2si5A==',key_name='tempest-SnapshotDataIntegrityTests-437348076',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='29d8082517724895a2027594f440071d',ramdisk_id='',reservation_id='r-a3mgbodc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-540489687',owner_user_name='tempest-SnapshotDataIntegrityTests-540489687-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T16:14:44Z,user_data=None,user_id='3823da50be004112aaa5ee35b724c6df',uuid=540a8fd5-8c18-4efe-97d4-9f0942cebcf5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "be492426-cc7d-4f76-80a2-ab97d8733e58", "address": "fa:16:3e:23:bb:b8", "network": {"id": "9c134a59-09c8-44dc-b4c7-3bb522d3f948", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-787092091-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29d8082517724895a2027594f440071d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe492426-cc", "ovs_interfaceid": "be492426-cc7d-4f76-80a2-ab97d8733e58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 16:14:46 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-6095bc66-af1b-412a-ab92-dbe38ad854b6 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Converting VIF {"id": "be492426-cc7d-4f76-80a2-ab97d8733e58", "address": "fa:16:3e:23:bb:b8", "network": {"id": "9c134a59-09c8-44dc-b4c7-3bb522d3f948", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-787092091-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29d8082517724895a2027594f440071d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe492426-cc", "ovs_interfaceid": "be492426-cc7d-4f76-80a2-ab97d8733e58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:14:46 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-6095bc66-af1b-412a-ab92-dbe38ad854b6 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:bb:b8,bridge_name='br-int',has_traffic_filtering=True,id=be492426-cc7d-4f76-80a2-ab97d8733e58,network=Network(9c134a59-09c8-44dc-b4c7-3bb522d3f948),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe492426-cc') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:14:46 user nova-compute[71874]: DEBUG nova.objects.instance [None req-6095bc66-af1b-412a-ab92-dbe38ad854b6 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lazy-loading 'pci_devices' on Instance uuid 540a8fd5-8c18-4efe-97d4-9f0942cebcf5 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:14:46 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-6095bc66-af1b-412a-ab92-dbe38ad854b6 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] [instance: 540a8fd5-8c18-4efe-97d4-9f0942cebcf5] End _get_guest_xml xml=<domain type="kvm">
Apr 12 16:14:46 user nova-compute[71874]:   <uuid>540a8fd5-8c18-4efe-97d4-9f0942cebcf5</uuid>
Apr 12 16:14:46 user nova-compute[71874]:   <name>instance-00000024</name>
Apr 12 16:14:46 user nova-compute[71874]:   <memory>131072</memory>
Apr 12 16:14:46 user nova-compute[71874]:   <vcpu>1</vcpu>
Apr 12 16:14:46 user nova-compute[71874]:   <metadata>
Apr 12 16:14:46 user nova-compute[71874]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 16:14:46 user nova-compute[71874]:       <nova:package version="0.0.0"/>
Apr 12 16:14:46 user nova-compute[71874]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-491760148</nova:name>
Apr 12 16:14:46 user nova-compute[71874]:       <nova:creationTime>2023-04-12 16:14:45</nova:creationTime>
Apr 12 16:14:46 user nova-compute[71874]:       <nova:flavor name="m1.nano">
Apr 12 16:14:46 user nova-compute[71874]:         <nova:memory>128</nova:memory>
Apr 12 16:14:46 user nova-compute[71874]:         <nova:disk>1</nova:disk>
Apr 12 16:14:46 user nova-compute[71874]:         <nova:swap>0</nova:swap>
Apr 12 16:14:46 user nova-compute[71874]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 16:14:46 user nova-compute[71874]:         <nova:vcpus>1</nova:vcpus>
Apr 12 16:14:46 user nova-compute[71874]:       </nova:flavor>
Apr 12 16:14:46 user nova-compute[71874]:       <nova:owner>
Apr 12 16:14:46 user nova-compute[71874]:         <nova:user uuid="3823da50be004112aaa5ee35b724c6df">tempest-SnapshotDataIntegrityTests-540489687-project-member</nova:user>
Apr 12 16:14:46 user nova-compute[71874]:         <nova:project uuid="29d8082517724895a2027594f440071d">tempest-SnapshotDataIntegrityTests-540489687</nova:project>
Apr 12 16:14:46 user nova-compute[71874]:       </nova:owner>
Apr 12 16:14:46 user nova-compute[71874]:       <nova:root type="image" uuid="9dc63f14-8b70-4e72-89f2-13464f2f5c7c"/>
Apr 12 16:14:46 user nova-compute[71874]:       <nova:ports>
Apr 12 16:14:46 user nova-compute[71874]:         <nova:port uuid="be492426-cc7d-4f76-80a2-ab97d8733e58">
Apr 12 16:14:46 user nova-compute[71874]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 12 16:14:46 user nova-compute[71874]:         </nova:port>
Apr 12 16:14:46 user nova-compute[71874]:       </nova:ports>
Apr 12 16:14:46 user nova-compute[71874]:     </nova:instance>
Apr 12 16:14:46 user nova-compute[71874]:   </metadata>
Apr 12 16:14:46 user nova-compute[71874]:   <sysinfo type="smbios">
Apr 12 16:14:46 user nova-compute[71874]:     <system>
Apr 12 16:14:46 user nova-compute[71874]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 16:14:46 user nova-compute[71874]:       <entry name="product">OpenStack Nova</entry>
Apr 12 16:14:46 user nova-compute[71874]:       <entry name="version">0.0.0</entry>
Apr 12 16:14:46 user nova-compute[71874]:       <entry name="serial">540a8fd5-8c18-4efe-97d4-9f0942cebcf5</entry>
Apr 12 16:14:46 user nova-compute[71874]:       <entry name="uuid">540a8fd5-8c18-4efe-97d4-9f0942cebcf5</entry>
Apr 12 16:14:46 user nova-compute[71874]:       <entry name="family">Virtual Machine</entry>
Apr 12 16:14:46 user nova-compute[71874]:     </system>
Apr 12 16:14:46 user nova-compute[71874]:   </sysinfo>
Apr 12 16:14:46 user nova-compute[71874]:   <os>
Apr 12 16:14:46 user nova-compute[71874]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 16:14:46 user nova-compute[71874]:     <boot dev="hd"/>
Apr 12 16:14:46 user nova-compute[71874]:     <smbios mode="sysinfo"/>
Apr 12 16:14:46 user nova-compute[71874]:   </os>
Apr 12 16:14:46 user nova-compute[71874]:   <features>
Apr 12 16:14:46 user nova-compute[71874]:     <acpi/>
Apr 12 16:14:46 user nova-compute[71874]:     <apic/>
Apr 12 16:14:46 user nova-compute[71874]:     <vmcoreinfo/>
Apr 12 16:14:46 user nova-compute[71874]:   </features>
Apr 12 16:14:46 user nova-compute[71874]:   <clock offset="utc">
Apr 12 16:14:46 user nova-compute[71874]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 16:14:46 user nova-compute[71874]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 16:14:46 user nova-compute[71874]:     <timer name="hpet" present="no"/>
Apr 12 16:14:46 user nova-compute[71874]:   </clock>
Apr 12 16:14:46 user nova-compute[71874]:   <cpu mode="custom" match="exact">
Apr 12 16:14:46 user nova-compute[71874]:     <model>Nehalem</model>
Apr 12 16:14:46 user nova-compute[71874]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 16:14:46 user nova-compute[71874]:   </cpu>
Apr 12 16:14:46 user nova-compute[71874]:   <devices>
Apr 12 16:14:46 user nova-compute[71874]:     <disk type="file" device="disk">
Apr 12 16:14:46 user nova-compute[71874]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 16:14:46 user nova-compute[71874]:       <source file="/opt/stack/data/nova/instances/540a8fd5-8c18-4efe-97d4-9f0942cebcf5/disk"/>
Apr 12 16:14:46 user nova-compute[71874]:       <target dev="vda" bus="virtio"/>
Apr 12 16:14:46 user nova-compute[71874]:     </disk>
Apr 12 16:14:46 user nova-compute[71874]:     <interface type="ethernet">
Apr 12 16:14:46 user nova-compute[71874]:       <mac address="fa:16:3e:23:bb:b8"/>
Apr 12 16:14:46 user nova-compute[71874]:       <model type="virtio"/>
Apr 12 16:14:46 user nova-compute[71874]:       <mtu size="1442"/>
Apr 12 16:14:46 user nova-compute[71874]:       <target dev="tapbe492426-cc"/>
Apr 12 16:14:46 user nova-compute[71874]:     </interface>
Apr 12 16:14:46 user nova-compute[71874]:     <serial type="pty">
Apr 12 16:14:46 user nova-compute[71874]:       <log file="/opt/stack/data/nova/instances/540a8fd5-8c18-4efe-97d4-9f0942cebcf5/console.log" append="off"/>
Apr 12 16:14:46 user nova-compute[71874]:     </serial>
Apr 12 16:14:46 user nova-compute[71874]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 16:14:46 user nova-compute[71874]:     <video>
Apr 12 16:14:46 user nova-compute[71874]:       <model type="virtio"/>
Apr 12 16:14:46 user nova-compute[71874]:     </video>
Apr 12 16:14:46 user nova-compute[71874]:     <rng model="virtio">
Apr 12 16:14:46 user nova-compute[71874]:       <backend model="random">/dev/urandom</backend>
Apr 12 16:14:46 user nova-compute[71874]:     </rng>
Apr 12 16:14:46 user nova-compute[71874]:     <controller type="usb" index="0" model="none"/>
Apr 12 16:14:46 user nova-compute[71874]:     <memballoon model="virtio">
Apr 12 16:14:46 user nova-compute[71874]:       <stats period="10"/>
Apr 12 16:14:46 user nova-compute[71874]:     </memballoon>
Apr 12 16:14:46 user nova-compute[71874]:   </devices>
Apr 12 16:14:46 user nova-compute[71874]: </domain>
Apr 12 16:14:46 user nova-compute[71874]:  {{(pid=71874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 16:14:46 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-6095bc66-af1b-412a-ab92-dbe38ad854b6 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T16:14:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-491760148',display_name='tempest-SnapshotDataIntegrityTests-server-491760148',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-491760148',id=36,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA+FpbR8FK82hCEPJ5HMQ8owWEJRGyodg69j5jSQV/QhgdEnkk4eYIy7X1tEJsjea4X8jfMn9W0N1l8a7XMKl5DRaLYt49U8Vr9yiskiXDGQVl0iBNmRtOG0NsqYt2si5A==',key_name='tempest-SnapshotDataIntegrityTests-437348076',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='29d8082517724895a2027594f440071d',ramdisk_id='',reservation_id='r-a3mgbodc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-540489687',owner_user_name='tempest-SnapshotDataIntegrityTests-540489687-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T16:14:44Z,user_data=None,user_id='3823da50be004112aaa5ee35b724c6df',uuid=540a8fd5-8c18-4efe-97d4-9f0942cebcf5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "be492426-cc7d-4f76-80a2-ab97d8733e58", "address": "fa:16:3e:23:bb:b8", "network": {"id": "9c134a59-09c8-44dc-b4c7-3bb522d3f948", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-787092091-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29d8082517724895a2027594f440071d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe492426-cc", "ovs_interfaceid": "be492426-cc7d-4f76-80a2-ab97d8733e58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 16:14:46 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-6095bc66-af1b-412a-ab92-dbe38ad854b6 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Converting VIF {"id": "be492426-cc7d-4f76-80a2-ab97d8733e58", "address": "fa:16:3e:23:bb:b8", "network": {"id": "9c134a59-09c8-44dc-b4c7-3bb522d3f948", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-787092091-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29d8082517724895a2027594f440071d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe492426-cc", "ovs_interfaceid": "be492426-cc7d-4f76-80a2-ab97d8733e58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:14:46 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-6095bc66-af1b-412a-ab92-dbe38ad854b6 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:bb:b8,bridge_name='br-int',has_traffic_filtering=True,id=be492426-cc7d-4f76-80a2-ab97d8733e58,network=Network(9c134a59-09c8-44dc-b4c7-3bb522d3f948),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe492426-cc') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:14:46 user nova-compute[71874]: DEBUG os_vif [None req-6095bc66-af1b-412a-ab92-dbe38ad854b6 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:bb:b8,bridge_name='br-int',has_traffic_filtering=True,id=be492426-cc7d-4f76-80a2-ab97d8733e58,network=Network(9c134a59-09c8-44dc-b4c7-3bb522d3f948),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe492426-cc') {{(pid=71874) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 16:14:46 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:14:46 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:14:46 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 16:14:46 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:14:46 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbe492426-cc, may_exist=True) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:14:46 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbe492426-cc, col_values=(('external_ids', {'iface-id': 'be492426-cc7d-4f76-80a2-ab97d8733e58', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:23:bb:b8', 'vm-uuid': '540a8fd5-8c18-4efe-97d4-9f0942cebcf5'}),)) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:14:46 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:14:46 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:14:46 user nova-compute[71874]: INFO os_vif [None req-6095bc66-af1b-412a-ab92-dbe38ad854b6 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:bb:b8,bridge_name='br-int',has_traffic_filtering=True,id=be492426-cc7d-4f76-80a2-ab97d8733e58,network=Network(9c134a59-09c8-44dc-b4c7-3bb522d3f948),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe492426-cc')
Apr 12 16:14:46 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-6095bc66-af1b-412a-ab92-dbe38ad854b6 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] No BDM found with device name vda, not building metadata. {{(pid=71874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 16:14:46 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-6095bc66-af1b-412a-ab92-dbe38ad854b6 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] No VIF found with MAC fa:16:3e:23:bb:b8, not building metadata {{(pid=71874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 16:14:46 user nova-compute[71874]: DEBUG nova.network.neutron [req-f8543318-1b53-492f-a171-2ea0777fab01 req-311d2b0a-495b-41ba-9f19-2ec2ae43925a service nova] [instance: 540a8fd5-8c18-4efe-97d4-9f0942cebcf5] Updated VIF entry in instance network info cache for port be492426-cc7d-4f76-80a2-ab97d8733e58. {{(pid=71874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 16:14:46 user nova-compute[71874]: DEBUG nova.network.neutron [req-f8543318-1b53-492f-a171-2ea0777fab01 req-311d2b0a-495b-41ba-9f19-2ec2ae43925a service nova] [instance: 540a8fd5-8c18-4efe-97d4-9f0942cebcf5] Updating instance_info_cache with network_info: [{"id": "be492426-cc7d-4f76-80a2-ab97d8733e58", "address": "fa:16:3e:23:bb:b8", "network": {"id": "9c134a59-09c8-44dc-b4c7-3bb522d3f948", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-787092091-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29d8082517724895a2027594f440071d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe492426-cc", "ovs_interfaceid": "be492426-cc7d-4f76-80a2-ab97d8733e58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:14:46 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-f8543318-1b53-492f-a171-2ea0777fab01 req-311d2b0a-495b-41ba-9f19-2ec2ae43925a service nova] Releasing lock "refresh_cache-540a8fd5-8c18-4efe-97d4-9f0942cebcf5" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:14:47 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:14:47 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:14:47 user nova-compute[71874]: DEBUG nova.compute.manager [req-3234d0d8-218e-4a90-b707-1abd579e79e1 req-c3639adc-765c-44c6-96a2-c964cb83a790 service nova] [instance: 540a8fd5-8c18-4efe-97d4-9f0942cebcf5] Received event network-vif-plugged-be492426-cc7d-4f76-80a2-ab97d8733e58 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:14:47 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-3234d0d8-218e-4a90-b707-1abd579e79e1 req-c3639adc-765c-44c6-96a2-c964cb83a790 service nova] Acquiring lock "540a8fd5-8c18-4efe-97d4-9f0942cebcf5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:14:47 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-3234d0d8-218e-4a90-b707-1abd579e79e1 req-c3639adc-765c-44c6-96a2-c964cb83a790 service nova] Lock "540a8fd5-8c18-4efe-97d4-9f0942cebcf5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:14:47 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-3234d0d8-218e-4a90-b707-1abd579e79e1 req-c3639adc-765c-44c6-96a2-c964cb83a790 service nova] Lock "540a8fd5-8c18-4efe-97d4-9f0942cebcf5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:14:47 user nova-compute[71874]: DEBUG nova.compute.manager [req-3234d0d8-218e-4a90-b707-1abd579e79e1 req-c3639adc-765c-44c6-96a2-c964cb83a790 service nova] [instance: 540a8fd5-8c18-4efe-97d4-9f0942cebcf5] No waiting events found dispatching network-vif-plugged-be492426-cc7d-4f76-80a2-ab97d8733e58 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:14:47 user nova-compute[71874]: WARNING nova.compute.manager [req-3234d0d8-218e-4a90-b707-1abd579e79e1 req-c3639adc-765c-44c6-96a2-c964cb83a790 service nova] [instance: 540a8fd5-8c18-4efe-97d4-9f0942cebcf5] Received unexpected event network-vif-plugged-be492426-cc7d-4f76-80a2-ab97d8733e58 for instance with vm_state building and task_state spawning.
Apr 12 16:14:48 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:14:48 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:14:49 user nova-compute[71874]: DEBUG nova.virt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Emitting event <LifecycleEvent: 1681316089.6802404, 540a8fd5-8c18-4efe-97d4-9f0942cebcf5 => Resumed> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:14:49 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 540a8fd5-8c18-4efe-97d4-9f0942cebcf5] VM Resumed (Lifecycle Event)
Apr 12 16:14:49 user nova-compute[71874]: DEBUG nova.compute.manager [None req-6095bc66-af1b-412a-ab92-dbe38ad854b6 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] [instance: 540a8fd5-8c18-4efe-97d4-9f0942cebcf5] Instance event wait completed in 0 seconds for  {{(pid=71874) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 16:14:49 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-6095bc66-af1b-412a-ab92-dbe38ad854b6 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] [instance: 540a8fd5-8c18-4efe-97d4-9f0942cebcf5] Guest created on hypervisor {{(pid=71874) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 16:14:49 user nova-compute[71874]: INFO nova.virt.libvirt.driver [-] [instance: 540a8fd5-8c18-4efe-97d4-9f0942cebcf5] Instance spawned successfully.
Apr 12 16:14:49 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-6095bc66-af1b-412a-ab92-dbe38ad854b6 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] [instance: 540a8fd5-8c18-4efe-97d4-9f0942cebcf5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 16:14:49 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 540a8fd5-8c18-4efe-97d4-9f0942cebcf5] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:14:49 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 540a8fd5-8c18-4efe-97d4-9f0942cebcf5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 16:14:49 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-6095bc66-af1b-412a-ab92-dbe38ad854b6 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] [instance: 540a8fd5-8c18-4efe-97d4-9f0942cebcf5] Found default for hw_cdrom_bus of ide {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:14:49 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-6095bc66-af1b-412a-ab92-dbe38ad854b6 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] [instance: 540a8fd5-8c18-4efe-97d4-9f0942cebcf5] Found default for hw_disk_bus of virtio {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:14:49 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-6095bc66-af1b-412a-ab92-dbe38ad854b6 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] [instance: 540a8fd5-8c18-4efe-97d4-9f0942cebcf5] Found default for hw_input_bus of None {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:14:49 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-6095bc66-af1b-412a-ab92-dbe38ad854b6 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] [instance: 540a8fd5-8c18-4efe-97d4-9f0942cebcf5] Found default for hw_pointer_model of None {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:14:49 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-6095bc66-af1b-412a-ab92-dbe38ad854b6 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] [instance: 540a8fd5-8c18-4efe-97d4-9f0942cebcf5] Found default for hw_video_model of virtio {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:14:49 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-6095bc66-af1b-412a-ab92-dbe38ad854b6 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] [instance: 540a8fd5-8c18-4efe-97d4-9f0942cebcf5] Found default for hw_vif_model of virtio {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:14:49 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 540a8fd5-8c18-4efe-97d4-9f0942cebcf5] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 16:14:49 user nova-compute[71874]: DEBUG nova.virt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Emitting event <LifecycleEvent: 1681316089.686318, 540a8fd5-8c18-4efe-97d4-9f0942cebcf5 => Started> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:14:49 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 540a8fd5-8c18-4efe-97d4-9f0942cebcf5] VM Started (Lifecycle Event)
Apr 12 16:14:49 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 540a8fd5-8c18-4efe-97d4-9f0942cebcf5] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:14:49 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 540a8fd5-8c18-4efe-97d4-9f0942cebcf5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 16:14:49 user nova-compute[71874]: INFO nova.compute.manager [None req-6095bc66-af1b-412a-ab92-dbe38ad854b6 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] [instance: 540a8fd5-8c18-4efe-97d4-9f0942cebcf5] Took 5.82 seconds to spawn the instance on the hypervisor.
Apr 12 16:14:49 user nova-compute[71874]: DEBUG nova.compute.manager [None req-6095bc66-af1b-412a-ab92-dbe38ad854b6 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] [instance: 540a8fd5-8c18-4efe-97d4-9f0942cebcf5] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:14:49 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 540a8fd5-8c18-4efe-97d4-9f0942cebcf5] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 16:14:49 user nova-compute[71874]: DEBUG nova.compute.manager [req-c4d833e4-9354-4b80-b880-3fa8f968f80f req-cde9a06c-9cfc-42f2-9504-1dde265cb499 service nova] [instance: 540a8fd5-8c18-4efe-97d4-9f0942cebcf5] Received event network-vif-plugged-be492426-cc7d-4f76-80a2-ab97d8733e58 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:14:49 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-c4d833e4-9354-4b80-b880-3fa8f968f80f req-cde9a06c-9cfc-42f2-9504-1dde265cb499 service nova] Acquiring lock "540a8fd5-8c18-4efe-97d4-9f0942cebcf5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:14:49 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-c4d833e4-9354-4b80-b880-3fa8f968f80f req-cde9a06c-9cfc-42f2-9504-1dde265cb499 service nova] Lock "540a8fd5-8c18-4efe-97d4-9f0942cebcf5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:14:49 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-c4d833e4-9354-4b80-b880-3fa8f968f80f req-cde9a06c-9cfc-42f2-9504-1dde265cb499 service nova] Lock "540a8fd5-8c18-4efe-97d4-9f0942cebcf5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:14:49 user nova-compute[71874]: DEBUG nova.compute.manager [req-c4d833e4-9354-4b80-b880-3fa8f968f80f req-cde9a06c-9cfc-42f2-9504-1dde265cb499 service nova] [instance: 540a8fd5-8c18-4efe-97d4-9f0942cebcf5] No waiting events found dispatching network-vif-plugged-be492426-cc7d-4f76-80a2-ab97d8733e58 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:14:49 user nova-compute[71874]: WARNING nova.compute.manager [req-c4d833e4-9354-4b80-b880-3fa8f968f80f req-cde9a06c-9cfc-42f2-9504-1dde265cb499 service nova] [instance: 540a8fd5-8c18-4efe-97d4-9f0942cebcf5] Received unexpected event network-vif-plugged-be492426-cc7d-4f76-80a2-ab97d8733e58 for instance with vm_state building and task_state spawning.
Apr 12 16:14:49 user nova-compute[71874]: INFO nova.compute.manager [None req-6095bc66-af1b-412a-ab92-dbe38ad854b6 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] [instance: 540a8fd5-8c18-4efe-97d4-9f0942cebcf5] Took 6.87 seconds to build instance.
Apr 12 16:14:49 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-6095bc66-af1b-412a-ab92-dbe38ad854b6 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "540a8fd5-8c18-4efe-97d4-9f0942cebcf5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.985s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:14:51 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:14:53 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:14:56 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:14:58 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:15:00 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:15:01 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:15:02 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:15:03 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:15:03 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:15:06 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:15:08 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:15:10 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:15:11 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:15:12 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:15:13 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:15:16 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:15:17 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:15:18 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:15:19 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:15:21 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:15:21 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-8b788c9f-5a1e-4355-9bc3-b3c35e002500 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Acquiring lock "473a30c4-5aa4-481c-8859-fda815d14872" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:15:21 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-8b788c9f-5a1e-4355-9bc3-b3c35e002500 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "473a30c4-5aa4-481c-8859-fda815d14872" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:15:21 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-8b788c9f-5a1e-4355-9bc3-b3c35e002500 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Acquiring lock "473a30c4-5aa4-481c-8859-fda815d14872-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:15:21 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-8b788c9f-5a1e-4355-9bc3-b3c35e002500 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "473a30c4-5aa4-481c-8859-fda815d14872-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:15:21 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-8b788c9f-5a1e-4355-9bc3-b3c35e002500 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "473a30c4-5aa4-481c-8859-fda815d14872-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:15:21 user nova-compute[71874]: INFO nova.compute.manager [None req-8b788c9f-5a1e-4355-9bc3-b3c35e002500 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: 473a30c4-5aa4-481c-8859-fda815d14872] Terminating instance
Apr 12 16:15:21 user nova-compute[71874]: DEBUG nova.compute.manager [None req-8b788c9f-5a1e-4355-9bc3-b3c35e002500 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: 473a30c4-5aa4-481c-8859-fda815d14872] Start destroying the instance on the hypervisor. {{(pid=71874) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 16:15:21 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:15:22 user nova-compute[71874]: DEBUG nova.compute.manager [req-bd5b1caa-1004-4df4-9605-1928b5e707de req-150852b1-00a6-4701-ba5b-28a0ffe649b3 service nova] [instance: 473a30c4-5aa4-481c-8859-fda815d14872] Received event network-vif-unplugged-556d7c96-2d40-43fc-83fe-2059479a5265 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:15:22 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-bd5b1caa-1004-4df4-9605-1928b5e707de req-150852b1-00a6-4701-ba5b-28a0ffe649b3 service nova] Acquiring lock "473a30c4-5aa4-481c-8859-fda815d14872-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:15:22 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-bd5b1caa-1004-4df4-9605-1928b5e707de req-150852b1-00a6-4701-ba5b-28a0ffe649b3 service nova] Lock "473a30c4-5aa4-481c-8859-fda815d14872-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:15:22 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-bd5b1caa-1004-4df4-9605-1928b5e707de req-150852b1-00a6-4701-ba5b-28a0ffe649b3 service nova] Lock "473a30c4-5aa4-481c-8859-fda815d14872-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:15:22 user nova-compute[71874]: DEBUG nova.compute.manager [req-bd5b1caa-1004-4df4-9605-1928b5e707de req-150852b1-00a6-4701-ba5b-28a0ffe649b3 service nova] [instance: 473a30c4-5aa4-481c-8859-fda815d14872] No waiting events found dispatching network-vif-unplugged-556d7c96-2d40-43fc-83fe-2059479a5265 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:15:22 user nova-compute[71874]: DEBUG nova.compute.manager [req-bd5b1caa-1004-4df4-9605-1928b5e707de req-150852b1-00a6-4701-ba5b-28a0ffe649b3 service nova] [instance: 473a30c4-5aa4-481c-8859-fda815d14872] Received event network-vif-unplugged-556d7c96-2d40-43fc-83fe-2059479a5265 for instance with task_state deleting. {{(pid=71874) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 16:15:22 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:15:22 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:15:22 user nova-compute[71874]: INFO nova.virt.libvirt.driver [-] [instance: 473a30c4-5aa4-481c-8859-fda815d14872] Instance destroyed successfully.
Apr 12 16:15:22 user nova-compute[71874]: DEBUG nova.objects.instance [None req-8b788c9f-5a1e-4355-9bc3-b3c35e002500 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lazy-loading 'resources' on Instance uuid 473a30c4-5aa4-481c-8859-fda815d14872 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:15:22 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-8b788c9f-5a1e-4355-9bc3-b3c35e002500 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T15:59:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-908306689',display_name='tempest-ServerRescueNegativeTestJSON-server-908306689',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-908306689',id=2,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T16:01:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b3fe48a3b7d846a195f1e47cc7f69695',ramdisk_id='',reservation_id='r-r5sj1znk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-984710343',owner_user_name='tempest-ServerRescueNegativeTestJSON-984710343-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T16:01:19Z,user_data=None,user_id='880266e3fa4d4dd889648c10208a1f8e',uuid=473a30c4-5aa4-481c-8859-fda815d14872,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "556d7c96-2d40-43fc-83fe-2059479a5265", "address": "fa:16:3e:f3:a2:9e", "network": {"id": "06fae0be-02dd-4962-a1ac-fd0413772758", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1493924857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3fe48a3b7d846a195f1e47cc7f69695", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap556d7c96-2d", "ovs_interfaceid": "556d7c96-2d40-43fc-83fe-2059479a5265", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 16:15:22 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-8b788c9f-5a1e-4355-9bc3-b3c35e002500 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Converting VIF {"id": "556d7c96-2d40-43fc-83fe-2059479a5265", "address": "fa:16:3e:f3:a2:9e", "network": {"id": "06fae0be-02dd-4962-a1ac-fd0413772758", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1493924857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3fe48a3b7d846a195f1e47cc7f69695", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap556d7c96-2d", "ovs_interfaceid": "556d7c96-2d40-43fc-83fe-2059479a5265", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:15:22 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-8b788c9f-5a1e-4355-9bc3-b3c35e002500 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f3:a2:9e,bridge_name='br-int',has_traffic_filtering=True,id=556d7c96-2d40-43fc-83fe-2059479a5265,network=Network(06fae0be-02dd-4962-a1ac-fd0413772758),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap556d7c96-2d') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:15:22 user nova-compute[71874]: DEBUG os_vif [None req-8b788c9f-5a1e-4355-9bc3-b3c35e002500 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f3:a2:9e,bridge_name='br-int',has_traffic_filtering=True,id=556d7c96-2d40-43fc-83fe-2059479a5265,network=Network(06fae0be-02dd-4962-a1ac-fd0413772758),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap556d7c96-2d') {{(pid=71874) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 16:15:22 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:15:22 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap556d7c96-2d, bridge=br-int, if_exists=True) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:15:22 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:15:22 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:15:22 user nova-compute[71874]: INFO os_vif [None req-8b788c9f-5a1e-4355-9bc3-b3c35e002500 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f3:a2:9e,bridge_name='br-int',has_traffic_filtering=True,id=556d7c96-2d40-43fc-83fe-2059479a5265,network=Network(06fae0be-02dd-4962-a1ac-fd0413772758),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap556d7c96-2d')
Apr 12 16:15:22 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-8b788c9f-5a1e-4355-9bc3-b3c35e002500 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: 473a30c4-5aa4-481c-8859-fda815d14872] Deleting instance files /opt/stack/data/nova/instances/473a30c4-5aa4-481c-8859-fda815d14872_del
Apr 12 16:15:22 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-8b788c9f-5a1e-4355-9bc3-b3c35e002500 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: 473a30c4-5aa4-481c-8859-fda815d14872] Deletion of /opt/stack/data/nova/instances/473a30c4-5aa4-481c-8859-fda815d14872_del complete
Apr 12 16:15:22 user nova-compute[71874]: INFO nova.compute.manager [None req-8b788c9f-5a1e-4355-9bc3-b3c35e002500 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: 473a30c4-5aa4-481c-8859-fda815d14872] Took 0.87 seconds to destroy the instance on the hypervisor.
Apr 12 16:15:22 user nova-compute[71874]: DEBUG oslo.service.loopingcall [None req-8b788c9f-5a1e-4355-9bc3-b3c35e002500 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71874) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 16:15:22 user nova-compute[71874]: DEBUG nova.compute.manager [-] [instance: 473a30c4-5aa4-481c-8859-fda815d14872] Deallocating network for instance {{(pid=71874) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 16:15:22 user nova-compute[71874]: DEBUG nova.network.neutron [-] [instance: 473a30c4-5aa4-481c-8859-fda815d14872] deallocate_for_instance() {{(pid=71874) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 16:15:22 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:15:22 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:15:22 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:15:22 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:15:22 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Auditing locally available compute resources for user (node: user) {{(pid=71874) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 16:15:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/540a8fd5-8c18-4efe-97d4-9f0942cebcf5/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:15:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/540a8fd5-8c18-4efe-97d4-9f0942cebcf5/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:15:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/540a8fd5-8c18-4efe-97d4-9f0942cebcf5/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:15:23 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:15:23 user nova-compute[71874]: DEBUG nova.network.neutron [-] [instance: 473a30c4-5aa4-481c-8859-fda815d14872] Updating instance_info_cache with network_info: [] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:15:23 user nova-compute[71874]: INFO nova.compute.manager [-] [instance: 473a30c4-5aa4-481c-8859-fda815d14872] Took 0.56 seconds to deallocate network for instance.
Apr 12 16:15:23 user nova-compute[71874]: DEBUG nova.compute.manager [req-b9e50020-6577-4ef5-b6a7-79e3e069b1c5 req-5a09766e-7d12-4039-8e1b-929cebc73286 service nova] [instance: 473a30c4-5aa4-481c-8859-fda815d14872] Received event network-vif-deleted-556d7c96-2d40-43fc-83fe-2059479a5265 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:15:23 user nova-compute[71874]: INFO nova.compute.manager [req-b9e50020-6577-4ef5-b6a7-79e3e069b1c5 req-5a09766e-7d12-4039-8e1b-929cebc73286 service nova] [instance: 473a30c4-5aa4-481c-8859-fda815d14872] Neutron deleted interface 556d7c96-2d40-43fc-83fe-2059479a5265; detaching it from the instance and deleting it from the info cache
Apr 12 16:15:23 user nova-compute[71874]: DEBUG nova.network.neutron [req-b9e50020-6577-4ef5-b6a7-79e3e069b1c5 req-5a09766e-7d12-4039-8e1b-929cebc73286 service nova] [instance: 473a30c4-5aa4-481c-8859-fda815d14872] Updating instance_info_cache with network_info: [] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:15:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/540a8fd5-8c18-4efe-97d4-9f0942cebcf5/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:15:23 user nova-compute[71874]: DEBUG nova.compute.manager [req-b9e50020-6577-4ef5-b6a7-79e3e069b1c5 req-5a09766e-7d12-4039-8e1b-929cebc73286 service nova] [instance: 473a30c4-5aa4-481c-8859-fda815d14872] Detach interface failed, port_id=556d7c96-2d40-43fc-83fe-2059479a5265, reason: Instance 473a30c4-5aa4-481c-8859-fda815d14872 could not be found. {{(pid=71874) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 12 16:15:23 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 16:15:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32471bee-e77e-4a1b-8e00-d938a1373976/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:15:23 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-8b788c9f-5a1e-4355-9bc3-b3c35e002500 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:15:23 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-8b788c9f-5a1e-4355-9bc3-b3c35e002500 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:15:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32471bee-e77e-4a1b-8e00-d938a1373976/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:15:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32471bee-e77e-4a1b-8e00-d938a1373976/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:15:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32471bee-e77e-4a1b-8e00-d938a1373976/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:15:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4190e244-84b1-47b6-813d-9cadb7c65975/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:15:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4190e244-84b1-47b6-813d-9cadb7c65975/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:15:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4190e244-84b1-47b6-813d-9cadb7c65975/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:15:23 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-8b788c9f-5a1e-4355-9bc3-b3c35e002500 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Inventory has not changed in ProviderTree for provider: 0e94b4c8-cd49-45e4-9133-d36eb4b2456b {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 16:15:23 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-8b788c9f-5a1e-4355-9bc3-b3c35e002500 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Inventory has not changed for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 16:15:23 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-8b788c9f-5a1e-4355-9bc3-b3c35e002500 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.504s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:15:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4190e244-84b1-47b6-813d-9cadb7c65975/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:15:23 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 16:15:23 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=71874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 16:15:23 user nova-compute[71874]: INFO nova.scheduler.client.report [None req-8b788c9f-5a1e-4355-9bc3-b3c35e002500 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Deleted allocations for instance 473a30c4-5aa4-481c-8859-fda815d14872
Apr 12 16:15:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/016ae41d-b098-4126-ace7-3da00b40cb9c/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:15:24 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-8b788c9f-5a1e-4355-9bc3-b3c35e002500 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "473a30c4-5aa4-481c-8859-fda815d14872" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.215s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:15:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/016ae41d-b098-4126-ace7-3da00b40cb9c/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:15:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/016ae41d-b098-4126-ace7-3da00b40cb9c/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:15:24 user nova-compute[71874]: DEBUG nova.compute.manager [req-0004423f-668f-4c29-929f-74fabaceabe5 req-a8c15c93-b78f-45e9-8501-44a0256dc059 service nova] [instance: 473a30c4-5aa4-481c-8859-fda815d14872] Received event network-vif-plugged-556d7c96-2d40-43fc-83fe-2059479a5265 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:15:24 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-0004423f-668f-4c29-929f-74fabaceabe5 req-a8c15c93-b78f-45e9-8501-44a0256dc059 service nova] Acquiring lock "473a30c4-5aa4-481c-8859-fda815d14872-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:15:24 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-0004423f-668f-4c29-929f-74fabaceabe5 req-a8c15c93-b78f-45e9-8501-44a0256dc059 service nova] Lock "473a30c4-5aa4-481c-8859-fda815d14872-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:15:24 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-0004423f-668f-4c29-929f-74fabaceabe5 req-a8c15c93-b78f-45e9-8501-44a0256dc059 service nova] Lock "473a30c4-5aa4-481c-8859-fda815d14872-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:15:24 user nova-compute[71874]: DEBUG nova.compute.manager [req-0004423f-668f-4c29-929f-74fabaceabe5 req-a8c15c93-b78f-45e9-8501-44a0256dc059 service nova] [instance: 473a30c4-5aa4-481c-8859-fda815d14872] No waiting events found dispatching network-vif-plugged-556d7c96-2d40-43fc-83fe-2059479a5265 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:15:24 user nova-compute[71874]: WARNING nova.compute.manager [req-0004423f-668f-4c29-929f-74fabaceabe5 req-a8c15c93-b78f-45e9-8501-44a0256dc059 service nova] [instance: 473a30c4-5aa4-481c-8859-fda815d14872] Received unexpected event network-vif-plugged-556d7c96-2d40-43fc-83fe-2059479a5265 for instance with vm_state deleted and task_state None.
Apr 12 16:15:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/016ae41d-b098-4126-ace7-3da00b40cb9c/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:15:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/608fbea2-b42b-4bb9-94a7-2b76dcdc2001/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:15:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/608fbea2-b42b-4bb9-94a7-2b76dcdc2001/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:15:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/608fbea2-b42b-4bb9-94a7-2b76dcdc2001/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:15:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/608fbea2-b42b-4bb9-94a7-2b76dcdc2001/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:15:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b613235-a905-466f-b9cc-a21a321a6313/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:15:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b613235-a905-466f-b9cc-a21a321a6313/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:15:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b613235-a905-466f-b9cc-a21a321a6313/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:15:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b613235-a905-466f-b9cc-a21a321a6313/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:15:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afebffae-dbf6-4876-8c9f-0364f0fde49c/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:15:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afebffae-dbf6-4876-8c9f-0364f0fde49c/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:15:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afebffae-dbf6-4876-8c9f-0364f0fde49c/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:15:25 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afebffae-dbf6-4876-8c9f-0364f0fde49c/disk --force-share --output=json" returned: 0 in 0.484s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:15:25 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/947c2ca9-fd67-4e8d-b0dc-90c5c827a59e/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:15:25 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/947c2ca9-fd67-4e8d-b0dc-90c5c827a59e/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:15:25 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/947c2ca9-fd67-4e8d-b0dc-90c5c827a59e/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:15:25 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/947c2ca9-fd67-4e8d-b0dc-90c5c827a59e/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:15:25 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4c37cbf-1743-4dd5-97fd-2bb12ebee763/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:15:25 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4c37cbf-1743-4dd5-97fd-2bb12ebee763/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:15:25 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4c37cbf-1743-4dd5-97fd-2bb12ebee763/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:15:26 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4c37cbf-1743-4dd5-97fd-2bb12ebee763/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:15:26 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-eb506e4d-cac1-4b9e-97c5-226f6fb819b2 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "f42c5cf7-5b0c-4519-a8dc-4022eb20fa59" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:15:26 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-eb506e4d-cac1-4b9e-97c5-226f6fb819b2 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "f42c5cf7-5b0c-4519-a8dc-4022eb20fa59" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:15:26 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb506e4d-cac1-4b9e-97c5-226f6fb819b2 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: f42c5cf7-5b0c-4519-a8dc-4022eb20fa59] Starting instance... {{(pid=71874) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 16:15:26 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:15:26 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:15:26 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Hypervisor/Node resource view: name=user free_ram=7492MB free_disk=25.7314453125GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71874) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 16:15:26 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:15:26 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:15:26 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-eb506e4d-cac1-4b9e-97c5-226f6fb819b2 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:15:26 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance afebffae-dbf6-4876-8c9f-0364f0fde49c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:15:26 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 608fbea2-b42b-4bb9-94a7-2b76dcdc2001 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:15:26 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance f52ee906-c8fd-4cd5-842e-de98a5099c4f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:15:26 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 016ae41d-b098-4126-ace7-3da00b40cb9c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:15:26 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 4190e244-84b1-47b6-813d-9cadb7c65975 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:15:26 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 0e8a977c-aa84-47c4-a838-b5f90820de1a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:15:26 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 1b613235-a905-466f-b9cc-a21a321a6313 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:15:26 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 32471bee-e77e-4a1b-8e00-d938a1373976 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:15:26 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 947c2ca9-fd67-4e8d-b0dc-90c5c827a59e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:15:26 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance b4c37cbf-1743-4dd5-97fd-2bb12ebee763 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:15:26 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 540a8fd5-8c18-4efe-97d4-9f0942cebcf5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:15:27 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance f42c5cf7-5b0c-4519-a8dc-4022eb20fa59 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1689}}
Apr 12 16:15:27 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=71874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 16:15:27 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Final resource view: name=user phys_ram=16023MB used_ram=1920MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=71874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 16:15:27 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Inventory has not changed in ProviderTree for provider: 0e94b4c8-cd49-45e4-9133-d36eb4b2456b {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 16:15:27 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Inventory has not changed for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 16:15:27 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Compute_service record updated for user:user {{(pid=71874) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 16:15:27 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.692s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:15:27 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-eb506e4d-cac1-4b9e-97c5-226f6fb819b2 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.566s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:15:27 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:15:27 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Cleaning up deleted instances {{(pid=71874) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 12 16:15:27 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-eb506e4d-cac1-4b9e-97c5-226f6fb819b2 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71874) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 16:15:27 user nova-compute[71874]: INFO nova.compute.claims [None req-eb506e4d-cac1-4b9e-97c5-226f6fb819b2 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: f42c5cf7-5b0c-4519-a8dc-4022eb20fa59] Claim successful on node user
Apr 12 16:15:27 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] There are 0 instances to clean {{(pid=71874) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 12 16:15:27 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:15:27 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71874) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 12 16:15:27 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:15:27 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-eb506e4d-cac1-4b9e-97c5-226f6fb819b2 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Inventory has not changed in ProviderTree for provider: 0e94b4c8-cd49-45e4-9133-d36eb4b2456b {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 16:15:27 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-eb506e4d-cac1-4b9e-97c5-226f6fb819b2 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Inventory has not changed for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 16:15:27 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-eb506e4d-cac1-4b9e-97c5-226f6fb819b2 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.503s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:15:27 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb506e4d-cac1-4b9e-97c5-226f6fb819b2 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: f42c5cf7-5b0c-4519-a8dc-4022eb20fa59] Start building networks asynchronously for instance. {{(pid=71874) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 16:15:28 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb506e4d-cac1-4b9e-97c5-226f6fb819b2 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: f42c5cf7-5b0c-4519-a8dc-4022eb20fa59] Allocating IP information in the background. {{(pid=71874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 16:15:28 user nova-compute[71874]: DEBUG nova.network.neutron [None req-eb506e4d-cac1-4b9e-97c5-226f6fb819b2 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: f42c5cf7-5b0c-4519-a8dc-4022eb20fa59] allocate_for_instance() {{(pid=71874) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 16:15:28 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-eb506e4d-cac1-4b9e-97c5-226f6fb819b2 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: f42c5cf7-5b0c-4519-a8dc-4022eb20fa59] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 16:15:28 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb506e4d-cac1-4b9e-97c5-226f6fb819b2 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: f42c5cf7-5b0c-4519-a8dc-4022eb20fa59] Start building block device mappings for instance. {{(pid=71874) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 16:15:28 user nova-compute[71874]: INFO nova.virt.block_device [None req-eb506e4d-cac1-4b9e-97c5-226f6fb819b2 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: f42c5cf7-5b0c-4519-a8dc-4022eb20fa59] Booting with volume snapshot 4706b679-046d-4609-9320-396658940205 at /dev/vda
Apr 12 16:15:28 user nova-compute[71874]: DEBUG nova.policy [None req-eb506e4d-cac1-4b9e-97c5-226f6fb819b2 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7054687447fc42339e9046ced4915890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b1b89a5eeb408a8d0938e5f59f405f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71874) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 16:15:28 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:15:28 user nova-compute[71874]: DEBUG nova.network.neutron [None req-eb506e4d-cac1-4b9e-97c5-226f6fb819b2 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: f42c5cf7-5b0c-4519-a8dc-4022eb20fa59] Successfully created port: e3207e92-f3c0-4115-bda1-f02903827226 {{(pid=71874) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 16:15:29 user nova-compute[71874]: DEBUG nova.network.neutron [None req-eb506e4d-cac1-4b9e-97c5-226f6fb819b2 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: f42c5cf7-5b0c-4519-a8dc-4022eb20fa59] Successfully updated port: e3207e92-f3c0-4115-bda1-f02903827226 {{(pid=71874) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 16:15:29 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-eb506e4d-cac1-4b9e-97c5-226f6fb819b2 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "refresh_cache-f42c5cf7-5b0c-4519-a8dc-4022eb20fa59" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:15:29 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-eb506e4d-cac1-4b9e-97c5-226f6fb819b2 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquired lock "refresh_cache-f42c5cf7-5b0c-4519-a8dc-4022eb20fa59" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:15:29 user nova-compute[71874]: DEBUG nova.network.neutron [None req-eb506e4d-cac1-4b9e-97c5-226f6fb819b2 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: f42c5cf7-5b0c-4519-a8dc-4022eb20fa59] Building network info cache for instance {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 16:15:29 user nova-compute[71874]: DEBUG nova.compute.manager [req-8a4bee51-ae63-4a49-a71e-bf420d7d3c1a req-674cace5-0682-4d41-9997-38fb7b001bcc service nova] [instance: f42c5cf7-5b0c-4519-a8dc-4022eb20fa59] Received event network-changed-e3207e92-f3c0-4115-bda1-f02903827226 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:15:29 user nova-compute[71874]: DEBUG nova.compute.manager [req-8a4bee51-ae63-4a49-a71e-bf420d7d3c1a req-674cace5-0682-4d41-9997-38fb7b001bcc service nova] [instance: f42c5cf7-5b0c-4519-a8dc-4022eb20fa59] Refreshing instance network info cache due to event network-changed-e3207e92-f3c0-4115-bda1-f02903827226. {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 16:15:29 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-8a4bee51-ae63-4a49-a71e-bf420d7d3c1a req-674cace5-0682-4d41-9997-38fb7b001bcc service nova] Acquiring lock "refresh_cache-f42c5cf7-5b0c-4519-a8dc-4022eb20fa59" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:15:29 user nova-compute[71874]: DEBUG nova.network.neutron [None req-eb506e4d-cac1-4b9e-97c5-226f6fb819b2 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: f42c5cf7-5b0c-4519-a8dc-4022eb20fa59] Instance cache missing network info. {{(pid=71874) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 16:15:29 user nova-compute[71874]: DEBUG nova.network.neutron [None req-eb506e4d-cac1-4b9e-97c5-226f6fb819b2 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: f42c5cf7-5b0c-4519-a8dc-4022eb20fa59] Updating instance_info_cache with network_info: [{"id": "e3207e92-f3c0-4115-bda1-f02903827226", "address": "fa:16:3e:71:9c:0b", "network": {"id": "1439244b-8287-4bba-a88c-99d4b498cccd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1491302639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29b1b89a5eeb408a8d0938e5f59f405f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3207e92-f3", "ovs_interfaceid": "e3207e92-f3c0-4115-bda1-f02903827226", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:15:29 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-eb506e4d-cac1-4b9e-97c5-226f6fb819b2 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Releasing lock "refresh_cache-f42c5cf7-5b0c-4519-a8dc-4022eb20fa59" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:15:29 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb506e4d-cac1-4b9e-97c5-226f6fb819b2 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: f42c5cf7-5b0c-4519-a8dc-4022eb20fa59] Instance network_info: |[{"id": "e3207e92-f3c0-4115-bda1-f02903827226", "address": "fa:16:3e:71:9c:0b", "network": {"id": "1439244b-8287-4bba-a88c-99d4b498cccd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1491302639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29b1b89a5eeb408a8d0938e5f59f405f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3207e92-f3", "ovs_interfaceid": "e3207e92-f3c0-4115-bda1-f02903827226", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 16:15:29 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-8a4bee51-ae63-4a49-a71e-bf420d7d3c1a req-674cace5-0682-4d41-9997-38fb7b001bcc service nova] Acquired lock "refresh_cache-f42c5cf7-5b0c-4519-a8dc-4022eb20fa59" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:15:29 user nova-compute[71874]: DEBUG nova.network.neutron [req-8a4bee51-ae63-4a49-a71e-bf420d7d3c1a req-674cace5-0682-4d41-9997-38fb7b001bcc service nova] [instance: f42c5cf7-5b0c-4519-a8dc-4022eb20fa59] Refreshing network info cache for port e3207e92-f3c0-4115-bda1-f02903827226 {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 16:15:30 user nova-compute[71874]: DEBUG nova.network.neutron [req-8a4bee51-ae63-4a49-a71e-bf420d7d3c1a req-674cace5-0682-4d41-9997-38fb7b001bcc service nova] [instance: f42c5cf7-5b0c-4519-a8dc-4022eb20fa59] Updated VIF entry in instance network info cache for port e3207e92-f3c0-4115-bda1-f02903827226. {{(pid=71874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 16:15:30 user nova-compute[71874]: DEBUG nova.network.neutron [req-8a4bee51-ae63-4a49-a71e-bf420d7d3c1a req-674cace5-0682-4d41-9997-38fb7b001bcc service nova] [instance: f42c5cf7-5b0c-4519-a8dc-4022eb20fa59] Updating instance_info_cache with network_info: [{"id": "e3207e92-f3c0-4115-bda1-f02903827226", "address": "fa:16:3e:71:9c:0b", "network": {"id": "1439244b-8287-4bba-a88c-99d4b498cccd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1491302639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29b1b89a5eeb408a8d0938e5f59f405f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3207e92-f3", "ovs_interfaceid": "e3207e92-f3c0-4115-bda1-f02903827226", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:15:30 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-8a4bee51-ae63-4a49-a71e-bf420d7d3c1a req-674cace5-0682-4d41-9997-38fb7b001bcc service nova] Releasing lock "refresh_cache-f42c5cf7-5b0c-4519-a8dc-4022eb20fa59" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:15:30 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:15:30 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:15:30 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:15:30 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Starting heal instance info cache {{(pid=71874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 16:15:30 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquiring lock "refresh_cache-f52ee906-c8fd-4cd5-842e-de98a5099c4f" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:15:30 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquired lock "refresh_cache-f52ee906-c8fd-4cd5-842e-de98a5099c4f" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:15:30 user nova-compute[71874]: DEBUG nova.network.neutron [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] Forcefully refreshing network info cache for instance {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 16:15:31 user nova-compute[71874]: DEBUG nova.network.neutron [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] Updating instance_info_cache with network_info: [{"id": "955511f0-eca8-447d-a105-fdd5f182de62", "address": "fa:16:3e:ec:61:14", "network": {"id": "b36306e0-04c5-4b1b-8022-05ff121c4e43", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1503204786-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9210f81232304e179d3e09914a492442", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap955511f0-ec", "ovs_interfaceid": "955511f0-eca8-447d-a105-fdd5f182de62", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:15:31 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Releasing lock "refresh_cache-f52ee906-c8fd-4cd5-842e-de98a5099c4f" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:15:31 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] Updated the network info_cache for instance {{(pid=71874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 16:15:31 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:15:31 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:15:31 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:15:31 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:15:31 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:15:31 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:15:31 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71874) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 16:15:32 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:15:33 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:15:33 user nova-compute[71874]: DEBUG os_brick.utils [None req-eb506e4d-cac1-4b9e-97c5-226f6fb819b2 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:15:33 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:15:33 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:15:33 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cce158b-53f5-4729-bf8e-18fc5eb39644]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:61a48d4489d2\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:15:33 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:15:33 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:15:33 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[44c389b0-160c-406d-8126-10cc12ba569c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:15:33 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:15:33 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:15:33 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4864f1b-bc14-4c8f-b068-74217486fc77]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:15:33 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5a28a9f-cc94-4db0-92c9-11c408e63a34]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:15:33 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-eb506e4d-cac1-4b9e-97c5-226f6fb819b2 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Running cmd (subprocess): nvme version {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:15:33 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-eb506e4d-cac1-4b9e-97c5-226f6fb819b2 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] 'nvme version' failed. Not Retrying. {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 16:15:33 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.nvmeof [None req-eb506e4d-cac1-4b9e-97c5-226f6fb819b2 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] nvme not present on system {{(pid=71874) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 16:15:33 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:15:33 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 16:15:33 user nova-compute[71874]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 16:15:33 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfae2b64-d3e4-43d5-8007-590a779ddcd4]: (4, '') {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:15:33 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.lightos [None req-eb506e4d-cac1-4b9e-97c5-226f6fb819b2 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71874) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 16:15:33 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.lightos [None req-eb506e4d-cac1-4b9e-97c5-226f6fb819b2 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71874) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 16:15:33 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.lightos [None req-eb506e4d-cac1-4b9e-97c5-226f6fb819b2 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] LIGHTOS: no hostnqn found. {{(pid=71874) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 16:15:33 user nova-compute[71874]: DEBUG os_brick.utils [None req-eb506e4d-cac1-4b9e-97c5-226f6fb819b2 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:61a48d4489d2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:15:33 user nova-compute[71874]: DEBUG nova.virt.block_device [None req-eb506e4d-cac1-4b9e-97c5-226f6fb819b2 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: f42c5cf7-5b0c-4519-a8dc-4022eb20fa59] Updating existing volume attachment record: 81aac672-8a57-48ad-b9ee-ba91a8fa5dbf {{(pid=71874) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 16:15:37 user nova-compute[71874]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681316122.6788776, 473a30c4-5aa4-481c-8859-fda815d14872 => Stopped> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:15:37 user nova-compute[71874]: INFO nova.compute.manager [-] [instance: 473a30c4-5aa4-481c-8859-fda815d14872] VM Stopped (Lifecycle Event)
Apr 12 16:15:37 user nova-compute[71874]: DEBUG nova.compute.manager [None req-a4488f9b-6be6-41af-9bab-1c7e8d11ae4e None None] [instance: 473a30c4-5aa4-481c-8859-fda815d14872] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:15:37 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:15:38 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb506e4d-cac1-4b9e-97c5-226f6fb819b2 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: f42c5cf7-5b0c-4519-a8dc-4022eb20fa59] Start spawning the instance on the hypervisor. {{(pid=71874) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 16:15:38 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-eb506e4d-cac1-4b9e-97c5-226f6fb819b2 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: f42c5cf7-5b0c-4519-a8dc-4022eb20fa59] Creating instance directory {{(pid=71874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 16:15:38 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-eb506e4d-cac1-4b9e-97c5-226f6fb819b2 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: f42c5cf7-5b0c-4519-a8dc-4022eb20fa59] Creating image(s)
Apr 12 16:15:38 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-eb506e4d-cac1-4b9e-97c5-226f6fb819b2 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: f42c5cf7-5b0c-4519-a8dc-4022eb20fa59] Did not create local disks {{(pid=71874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 12 16:15:38 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-eb506e4d-cac1-4b9e-97c5-226f6fb819b2 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: f42c5cf7-5b0c-4519-a8dc-4022eb20fa59] Ensure instance console log exists: /opt/stack/data/nova/instances/f42c5cf7-5b0c-4519-a8dc-4022eb20fa59/console.log {{(pid=71874) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 16:15:38 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-eb506e4d-cac1-4b9e-97c5-226f6fb819b2 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:15:38 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-eb506e4d-cac1-4b9e-97c5-226f6fb819b2 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:15:38 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-eb506e4d-cac1-4b9e-97c5-226f6fb819b2 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:15:38 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-eb506e4d-cac1-4b9e-97c5-226f6fb819b2 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: f42c5cf7-5b0c-4519-a8dc-4022eb20fa59] Start _get_guest_xml network_info=[{"id": "e3207e92-f3c0-4115-bda1-f02903827226", "address": "fa:16:3e:71:9c:0b", "network": {"id": "1439244b-8287-4bba-a88c-99d4b498cccd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1491302639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29b1b89a5eeb408a8d0938e5f59f405f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3207e92-f3", "ovs_interfaceid": "e3207e92-f3c0-4115-bda1-f02903827226", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'delete_on_termination': True, 'attachment_id': '81aac672-8a57-48ad-b9ee-ba91a8fa5dbf', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c59288c2-ba2b-4a3a-8a0a-a683f07b0bba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VMDhrKPa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f42c5cf7-5b0c-4519-a8dc-4022eb20fa59', 'attached_at': '', 'detached_at': '', 'volume_id': 'c59288c2-ba2b-4a3a-8a0a-a683f07b0bba', 'serial': 'c59288c2-ba2b-4a3a-8a0a-a683f07b0bba'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'volume_type': None} {{(pid=71874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 16:15:38 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-eb506e4d-cac1-4b9e-97c5-226f6fb819b2 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:15:38 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-eb506e4d-cac1-4b9e-97c5-226f6fb819b2 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:15:38 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-eb506e4d-cac1-4b9e-97c5-226f6fb819b2 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71874) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 16:15:38 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-eb506e4d-cac1-4b9e-97c5-226f6fb819b2 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T15:56:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 16:15:38 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-eb506e4d-cac1-4b9e-97c5-226f6fb819b2 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Flavor limits 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 16:15:38 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-eb506e4d-cac1-4b9e-97c5-226f6fb819b2 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Image limits 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 16:15:38 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-eb506e4d-cac1-4b9e-97c5-226f6fb819b2 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Flavor pref 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 16:15:38 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-eb506e4d-cac1-4b9e-97c5-226f6fb819b2 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Image pref 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 16:15:38 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-eb506e4d-cac1-4b9e-97c5-226f6fb819b2 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 16:15:38 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-eb506e4d-cac1-4b9e-97c5-226f6fb819b2 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 16:15:38 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-eb506e4d-cac1-4b9e-97c5-226f6fb819b2 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 16:15:38 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-eb506e4d-cac1-4b9e-97c5-226f6fb819b2 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Got 1 possible topologies {{(pid=71874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 16:15:38 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-eb506e4d-cac1-4b9e-97c5-226f6fb819b2 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 16:15:38 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-eb506e4d-cac1-4b9e-97c5-226f6fb819b2 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 16:15:38 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb506e4d-cac1-4b9e-97c5-226f6fb819b2 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: f42c5cf7-5b0c-4519-a8dc-4022eb20fa59] Calling os-brick to attach iSCSI Volume {{(pid=71874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 16:15:38 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb506e4d-cac1-4b9e-97c5-226f6fb819b2 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3c0216320>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c59288c2-ba2b-4a3a-8a0a-a683f07b0bba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VMDhrKPa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:15:38 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-eb506e4d-cac1-4b9e-97c5-226f6fb819b2 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:15:38 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-eb506e4d-cac1-4b9e-97c5-226f6fb819b2 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:15:38 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-eb506e4d-cac1-4b9e-97c5-226f6fb819b2 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:15:38 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-eb506e4d-cac1-4b9e-97c5-226f6fb819b2 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:15:38 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-eb506e4d-cac1-4b9e-97c5-226f6fb819b2 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c59288c2-ba2b-4a3a-8a0a-a683f07b0bba" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:15:38 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-eb506e4d-cac1-4b9e-97c5-226f6fb819b2 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c59288c2-ba2b-4a3a-8a0a-a683f07b0bba" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:15:38 user nova-compute[71874]: INFO os_brick.initiator.connectors.iscsi [None req-eb506e4d-cac1-4b9e-97c5-226f6fb819b2 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 16:15:38 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c59288c2-ba2b-4a3a-8a0a-a683f07b0bba -p 172.16.0.220:3260 {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:15:38 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:15:38 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c59288c2-ba2b-4a3a-8a0a-a683f07b0bba -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:15:38 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d1f5c67-cd90-4833-9302-1babdf867f39]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:15:38 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb506e4d-cac1-4b9e-97c5-226f6fb819b2 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 16:15:38 user nova-compute[71874]:  {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:15:38 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c59288c2-ba2b-4a3a-8a0a-a683f07b0bba -p 172.16.0.220:3260 --interface default --op new {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:15:38 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c59288c2-ba2b-4a3a-8a0a-a683f07b0bba -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:15:38 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[b66b9ae5-ca4f-4dca-ac04-f3233bc869c4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c59288c2-ba2b-4a3a-8a0a-a683f07b0bba] added\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:15:38 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb506e4d-cac1-4b9e-97c5-226f6fb819b2 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c59288c2-ba2b-4a3a-8a0a-a683f07b0bba] added
Apr 12 16:15:38 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:15:38 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c59288c2-ba2b-4a3a-8a0a-a683f07b0bba -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:15:38 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c59288c2-ba2b-4a3a-8a0a-a683f07b0bba -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.039s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:15:38 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b91b68f-24ef-4f30-b440-8a08e478dfd6]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:15:38 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb506e4d-cac1-4b9e-97c5-226f6fb819b2 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:15:38 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c59288c2-ba2b-4a3a-8a0a-a683f07b0bba -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:15:38 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c59288c2-ba2b-4a3a-8a0a-a683f07b0bba -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:15:38 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[47eb6908-84cb-4219-b85b-3078a9b5e047]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:15:38 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb506e4d-cac1-4b9e-97c5-226f6fb819b2 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:15:38 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c59288c2-ba2b-4a3a-8a0a-a683f07b0bba -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VMDhrKPa {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:15:38 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c59288c2-ba2b-4a3a-8a0a-a683f07b0bba -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VMDhrKPa" returned: 0 in 0.017s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:15:38 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[0753d8e3-67fa-446e-b1f8-adcd5bbbabd5]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:15:38 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb506e4d-cac1-4b9e-97c5-226f6fb819b2 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VMDhrKPa'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:15:38 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c59288c2-ba2b-4a3a-8a0a-a683f07b0bba -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:15:38 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c59288c2-ba2b-4a3a-8a0a-a683f07b0bba -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:15:38 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[37e2bf2c-64d6-4c96-a7f6-166d15135bef]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:15:38 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb506e4d-cac1-4b9e-97c5-226f6fb819b2 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:15:38 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:15:38 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:15:38 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d3e739f-63fb-4dad-9b45-e389eb9be4d2]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce38c1b3-35b0-48cc-9b83-e9a676997784 (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:15:38 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb506e4d-cac1-4b9e-97c5-226f6fb819b2 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:15:38 user nova-compute[71874]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304 (non-flash)
Apr 12 16:15:38 user nova-compute[71874]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce38c1b3-35b0-48cc-9b83-e9a676997784 (non-flash)
Apr 12 16:15:38 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:15:38 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb506e4d-cac1-4b9e-97c5-226f6fb819b2 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:15:38 user nova-compute[71874]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304 (non-flash)
Apr 12 16:15:38 user nova-compute[71874]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce38c1b3-35b0-48cc-9b83-e9a676997784 (non-flash)
Apr 12 16:15:38 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:15:38 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c59288c2-ba2b-4a3a-8a0a-a683f07b0bba -p 172.16.0.220:3260 --login {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:15:38 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c59288c2-ba2b-4a3a-8a0a-a683f07b0bba -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:15:38 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[964db174-cb49-42db-a5d9-d0ba3e3e9703]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c59288c2-ba2b-4a3a-8a0a-a683f07b0bba, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c59288c2-ba2b-4a3a-8a0a-a683f07b0bba, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:15:38 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb506e4d-cac1-4b9e-97c5-226f6fb819b2 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c59288c2-ba2b-4a3a-8a0a-a683f07b0bba, portal: 172.16.0.220,3260]
Apr 12 16:15:38 user nova-compute[71874]: Login to [iface: default, target: iqn.2010-10.org.openstack:c59288c2-ba2b-4a3a-8a0a-a683f07b0bba, portal: 172.16.0.220,3260] successful.
Apr 12 16:15:38 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:15:38 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c59288c2-ba2b-4a3a-8a0a-a683f07b0bba -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:15:38 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c59288c2-ba2b-4a3a-8a0a-a683f07b0bba -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:15:38 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[0175b165-5f99-4223-b195-f060d35fa56f]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:15:38 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb506e4d-cac1-4b9e-97c5-226f6fb819b2 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:15:38 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:15:38 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:15:38 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c052ae9-6287-4f08-a6a7-3ba03bb92b62]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce38c1b3-35b0-48cc-9b83-e9a676997784 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c59288c2-ba2b-4a3a-8a0a-a683f07b0bba (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:15:38 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb506e4d-cac1-4b9e-97c5-226f6fb819b2 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:15:38 user nova-compute[71874]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304 (non-flash)
Apr 12 16:15:38 user nova-compute[71874]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce38c1b3-35b0-48cc-9b83-e9a676997784 (non-flash)
Apr 12 16:15:38 user nova-compute[71874]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c59288c2-ba2b-4a3a-8a0a-a683f07b0bba (non-flash)
Apr 12 16:15:38 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:15:38 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb506e4d-cac1-4b9e-97c5-226f6fb819b2 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:15:38 user nova-compute[71874]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304 (non-flash)
Apr 12 16:15:38 user nova-compute[71874]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce38c1b3-35b0-48cc-9b83-e9a676997784 (non-flash)
Apr 12 16:15:38 user nova-compute[71874]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c59288c2-ba2b-4a3a-8a0a-a683f07b0bba (non-flash)
Apr 12 16:15:38 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:15:38 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-eb506e4d-cac1-4b9e-97c5-226f6fb819b2 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c59288c2-ba2b-4a3a-8a0a-a683f07b0bba" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.316s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:15:38 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb506e4d-cac1-4b9e-97c5-226f6fb819b2 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Connected to 172.16.0.220:3260 {{(pid=71874) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 16:15:38 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-eb506e4d-cac1-4b9e-97c5-226f6fb819b2 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] HCTL ('35', '-', '-', 0) found on session 37 with lun 0 {{(pid=71874) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 16:15:38 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-eb506e4d-cac1-4b9e-97c5-226f6fb819b2 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71874) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 16:15:38 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:15:38 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:15:38 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[5166f0a7-74a2-474b-8f11-e45274d3231b]: (4, ('- - 0', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:15:38 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-eb506e4d-cac1-4b9e-97c5-226f6fb819b2 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Searching for a device in session 37 and hctl ['35', '*', '*', 0] yield: None {{(pid=71874) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 16:15:39 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-eb506e4d-cac1-4b9e-97c5-226f6fb819b2 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Searching for a device in session 37 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71874) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 16:15:39 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb506e4d-cac1-4b9e-97c5-226f6fb819b2 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:c59288c2-ba2b-4a3a-8a0a-a683f07b0bba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VMDhrKPa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71874) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 16:15:39 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-eb506e4d-cac1-4b9e-97c5-226f6fb819b2 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.354s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:15:39 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb506e4d-cac1-4b9e-97c5-226f6fb819b2 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] <== connect_volume: return (1355ms) {'type': 'block', 'scsi_wwn': '23533393239663435', 'path': '/dev/sdd'} {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:15:39 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb506e4d-cac1-4b9e-97c5-226f6fb819b2 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: f42c5cf7-5b0c-4519-a8dc-4022eb20fa59] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23533393239663435', 'path': '/dev/sdd'} {{(pid=71874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 16:15:39 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-eb506e4d-cac1-4b9e-97c5-226f6fb819b2 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T16:15:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-156970536',display_name='tempest-TestVolumeBootPattern-server-156970536',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-156970536',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='29b1b89a5eeb408a8d0938e5f59f405f',ramdisk_id='',reservation_id='r-rcnis5wa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-734600841',owner_user_name='tempest-TestVolumeBootPattern-734600841-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T16:15:28Z,user_data=None,user_id='7054687447fc42339e9046ced4915890',uuid=f42c5cf7-5b0c-4519-a8dc-4022eb20fa59,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e3207e92-f3c0-4115-bda1-f02903827226", "address": "fa:16:3e:71:9c:0b", "network": {"id": "1439244b-8287-4bba-a88c-99d4b498cccd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1491302639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29b1b89a5eeb408a8d0938e5f59f405f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3207e92-f3", "ovs_interfaceid": "e3207e92-f3c0-4115-bda1-f02903827226", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 16:15:39 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-eb506e4d-cac1-4b9e-97c5-226f6fb819b2 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Converting VIF {"id": "e3207e92-f3c0-4115-bda1-f02903827226", "address": "fa:16:3e:71:9c:0b", "network": {"id": "1439244b-8287-4bba-a88c-99d4b498cccd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1491302639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29b1b89a5eeb408a8d0938e5f59f405f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3207e92-f3", "ovs_interfaceid": "e3207e92-f3c0-4115-bda1-f02903827226", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:15:39 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-eb506e4d-cac1-4b9e-97c5-226f6fb819b2 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:9c:0b,bridge_name='br-int',has_traffic_filtering=True,id=e3207e92-f3c0-4115-bda1-f02903827226,network=Network(1439244b-8287-4bba-a88c-99d4b498cccd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3207e92-f3') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:15:39 user nova-compute[71874]: DEBUG nova.objects.instance [None req-eb506e4d-cac1-4b9e-97c5-226f6fb819b2 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lazy-loading 'pci_devices' on Instance uuid f42c5cf7-5b0c-4519-a8dc-4022eb20fa59 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:15:39 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-eb506e4d-cac1-4b9e-97c5-226f6fb819b2 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: f42c5cf7-5b0c-4519-a8dc-4022eb20fa59] End _get_guest_xml xml=<domain type="kvm">
Apr 12 16:15:39 user nova-compute[71874]:   <uuid>f42c5cf7-5b0c-4519-a8dc-4022eb20fa59</uuid>
Apr 12 16:15:39 user nova-compute[71874]:   <name>instance-00000025</name>
Apr 12 16:15:39 user nova-compute[71874]:   <memory>131072</memory>
Apr 12 16:15:39 user nova-compute[71874]:   <vcpu>1</vcpu>
Apr 12 16:15:39 user nova-compute[71874]:   <metadata>
Apr 12 16:15:39 user nova-compute[71874]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 16:15:39 user nova-compute[71874]:       <nova:package version="0.0.0"/>
Apr 12 16:15:39 user nova-compute[71874]:       <nova:name>tempest-TestVolumeBootPattern-server-156970536</nova:name>
Apr 12 16:15:39 user nova-compute[71874]:       <nova:creationTime>2023-04-12 16:15:38</nova:creationTime>
Apr 12 16:15:39 user nova-compute[71874]:       <nova:flavor name="m1.nano">
Apr 12 16:15:39 user nova-compute[71874]:         <nova:memory>128</nova:memory>
Apr 12 16:15:39 user nova-compute[71874]:         <nova:disk>1</nova:disk>
Apr 12 16:15:39 user nova-compute[71874]:         <nova:swap>0</nova:swap>
Apr 12 16:15:39 user nova-compute[71874]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 16:15:39 user nova-compute[71874]:         <nova:vcpus>1</nova:vcpus>
Apr 12 16:15:39 user nova-compute[71874]:       </nova:flavor>
Apr 12 16:15:39 user nova-compute[71874]:       <nova:owner>
Apr 12 16:15:39 user nova-compute[71874]:         <nova:user uuid="7054687447fc42339e9046ced4915890">tempest-TestVolumeBootPattern-734600841-project-member</nova:user>
Apr 12 16:15:39 user nova-compute[71874]:         <nova:project uuid="29b1b89a5eeb408a8d0938e5f59f405f">tempest-TestVolumeBootPattern-734600841</nova:project>
Apr 12 16:15:39 user nova-compute[71874]:       </nova:owner>
Apr 12 16:15:39 user nova-compute[71874]:       <nova:ports>
Apr 12 16:15:39 user nova-compute[71874]:         <nova:port uuid="e3207e92-f3c0-4115-bda1-f02903827226">
Apr 12 16:15:39 user nova-compute[71874]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 12 16:15:39 user nova-compute[71874]:         </nova:port>
Apr 12 16:15:39 user nova-compute[71874]:       </nova:ports>
Apr 12 16:15:39 user nova-compute[71874]:     </nova:instance>
Apr 12 16:15:39 user nova-compute[71874]:   </metadata>
Apr 12 16:15:39 user nova-compute[71874]:   <sysinfo type="smbios">
Apr 12 16:15:39 user nova-compute[71874]:     <system>
Apr 12 16:15:39 user nova-compute[71874]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 16:15:39 user nova-compute[71874]:       <entry name="product">OpenStack Nova</entry>
Apr 12 16:15:39 user nova-compute[71874]:       <entry name="version">0.0.0</entry>
Apr 12 16:15:39 user nova-compute[71874]:       <entry name="serial">f42c5cf7-5b0c-4519-a8dc-4022eb20fa59</entry>
Apr 12 16:15:39 user nova-compute[71874]:       <entry name="uuid">f42c5cf7-5b0c-4519-a8dc-4022eb20fa59</entry>
Apr 12 16:15:39 user nova-compute[71874]:       <entry name="family">Virtual Machine</entry>
Apr 12 16:15:39 user nova-compute[71874]:     </system>
Apr 12 16:15:39 user nova-compute[71874]:   </sysinfo>
Apr 12 16:15:39 user nova-compute[71874]:   <os>
Apr 12 16:15:39 user nova-compute[71874]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 16:15:39 user nova-compute[71874]:     <boot dev="hd"/>
Apr 12 16:15:39 user nova-compute[71874]:     <smbios mode="sysinfo"/>
Apr 12 16:15:39 user nova-compute[71874]:   </os>
Apr 12 16:15:39 user nova-compute[71874]:   <features>
Apr 12 16:15:39 user nova-compute[71874]:     <acpi/>
Apr 12 16:15:39 user nova-compute[71874]:     <apic/>
Apr 12 16:15:39 user nova-compute[71874]:     <vmcoreinfo/>
Apr 12 16:15:39 user nova-compute[71874]:   </features>
Apr 12 16:15:39 user nova-compute[71874]:   <clock offset="utc">
Apr 12 16:15:39 user nova-compute[71874]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 16:15:39 user nova-compute[71874]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 16:15:39 user nova-compute[71874]:     <timer name="hpet" present="no"/>
Apr 12 16:15:39 user nova-compute[71874]:   </clock>
Apr 12 16:15:39 user nova-compute[71874]:   <cpu mode="custom" match="exact">
Apr 12 16:15:39 user nova-compute[71874]:     <model>Nehalem</model>
Apr 12 16:15:39 user nova-compute[71874]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 16:15:39 user nova-compute[71874]:   </cpu>
Apr 12 16:15:39 user nova-compute[71874]:   <devices>
Apr 12 16:15:39 user nova-compute[71874]:     <disk type="block" device="disk">
Apr 12 16:15:39 user nova-compute[71874]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 16:15:39 user nova-compute[71874]:       <source dev="/dev/sdd"/>
Apr 12 16:15:39 user nova-compute[71874]:       <target dev="vda" bus="virtio"/>
Apr 12 16:15:39 user nova-compute[71874]:       <serial>c59288c2-ba2b-4a3a-8a0a-a683f07b0bba</serial>
Apr 12 16:15:39 user nova-compute[71874]:     </disk>
Apr 12 16:15:39 user nova-compute[71874]:     <interface type="ethernet">
Apr 12 16:15:39 user nova-compute[71874]:       <mac address="fa:16:3e:71:9c:0b"/>
Apr 12 16:15:39 user nova-compute[71874]:       <model type="virtio"/>
Apr 12 16:15:39 user nova-compute[71874]:       <mtu size="1442"/>
Apr 12 16:15:39 user nova-compute[71874]:       <target dev="tape3207e92-f3"/>
Apr 12 16:15:39 user nova-compute[71874]:     </interface>
Apr 12 16:15:39 user nova-compute[71874]:     <serial type="pty">
Apr 12 16:15:39 user nova-compute[71874]:       <log file="/opt/stack/data/nova/instances/f42c5cf7-5b0c-4519-a8dc-4022eb20fa59/console.log" append="off"/>
Apr 12 16:15:39 user nova-compute[71874]:     </serial>
Apr 12 16:15:39 user nova-compute[71874]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 16:15:39 user nova-compute[71874]:     <video>
Apr 12 16:15:39 user nova-compute[71874]:       <model type="virtio"/>
Apr 12 16:15:39 user nova-compute[71874]:     </video>
Apr 12 16:15:39 user nova-compute[71874]:     <rng model="virtio">
Apr 12 16:15:39 user nova-compute[71874]:       <backend model="random">/dev/urandom</backend>
Apr 12 16:15:39 user nova-compute[71874]:     </rng>
Apr 12 16:15:39 user nova-compute[71874]:     <controller type="usb" index="0" model="none"/>
Apr 12 16:15:39 user nova-compute[71874]:     <memballoon model="virtio">
Apr 12 16:15:39 user nova-compute[71874]:       <stats period="10"/>
Apr 12 16:15:39 user nova-compute[71874]:     </memballoon>
Apr 12 16:15:39 user nova-compute[71874]:   </devices>
Apr 12 16:15:39 user nova-compute[71874]: </domain>
Apr 12 16:15:39 user nova-compute[71874]:  {{(pid=71874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 16:15:39 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-eb506e4d-cac1-4b9e-97c5-226f6fb819b2 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T16:15:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-156970536',display_name='tempest-TestVolumeBootPattern-server-156970536',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-156970536',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='29b1b89a5eeb408a8d0938e5f59f405f',ramdisk_id='',reservation_id='r-rcnis5wa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-734600841',owner_user_name='tempest-TestVolumeBootPattern-734600841-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T16:15:28Z,user_data=None,user_id='7054687447fc42339e9046ced4915890',uuid=f42c5cf7-5b0c-4519-a8dc-4022eb20fa59,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e3207e92-f3c0-4115-bda1-f02903827226", "address": "fa:16:3e:71:9c:0b", "network": {"id": "1439244b-8287-4bba-a88c-99d4b498cccd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1491302639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29b1b89a5eeb408a8d0938e5f59f405f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3207e92-f3", "ovs_interfaceid": "e3207e92-f3c0-4115-bda1-f02903827226", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 16:15:39 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-eb506e4d-cac1-4b9e-97c5-226f6fb819b2 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Converting VIF {"id": "e3207e92-f3c0-4115-bda1-f02903827226", "address": "fa:16:3e:71:9c:0b", "network": {"id": "1439244b-8287-4bba-a88c-99d4b498cccd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1491302639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29b1b89a5eeb408a8d0938e5f59f405f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3207e92-f3", "ovs_interfaceid": "e3207e92-f3c0-4115-bda1-f02903827226", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:15:39 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-eb506e4d-cac1-4b9e-97c5-226f6fb819b2 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:9c:0b,bridge_name='br-int',has_traffic_filtering=True,id=e3207e92-f3c0-4115-bda1-f02903827226,network=Network(1439244b-8287-4bba-a88c-99d4b498cccd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3207e92-f3') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:15:39 user nova-compute[71874]: DEBUG os_vif [None req-eb506e4d-cac1-4b9e-97c5-226f6fb819b2 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:9c:0b,bridge_name='br-int',has_traffic_filtering=True,id=e3207e92-f3c0-4115-bda1-f02903827226,network=Network(1439244b-8287-4bba-a88c-99d4b498cccd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3207e92-f3') {{(pid=71874) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 16:15:39 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:15:39 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:15:39 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 16:15:39 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:15:39 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape3207e92-f3, may_exist=True) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:15:39 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape3207e92-f3, col_values=(('external_ids', {'iface-id': 'e3207e92-f3c0-4115-bda1-f02903827226', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:71:9c:0b', 'vm-uuid': 'f42c5cf7-5b0c-4519-a8dc-4022eb20fa59'}),)) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:15:39 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:15:39 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:15:39 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:15:39 user nova-compute[71874]: INFO os_vif [None req-eb506e4d-cac1-4b9e-97c5-226f6fb819b2 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:9c:0b,bridge_name='br-int',has_traffic_filtering=True,id=e3207e92-f3c0-4115-bda1-f02903827226,network=Network(1439244b-8287-4bba-a88c-99d4b498cccd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3207e92-f3')
Apr 12 16:15:39 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-eb506e4d-cac1-4b9e-97c5-226f6fb819b2 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] No BDM found with device name vda, not building metadata. {{(pid=71874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 16:15:39 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-eb506e4d-cac1-4b9e-97c5-226f6fb819b2 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] No VIF found with MAC fa:16:3e:71:9c:0b, not building metadata {{(pid=71874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 16:15:40 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:15:41 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:15:41 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:15:41 user nova-compute[71874]: DEBUG nova.compute.manager [req-5f589e6d-c00e-41bf-a120-629c100f4973 req-a588587e-366f-4ae7-8b82-0b31c1fbca8b service nova] [instance: f42c5cf7-5b0c-4519-a8dc-4022eb20fa59] Received event network-vif-plugged-e3207e92-f3c0-4115-bda1-f02903827226 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:15:41 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-5f589e6d-c00e-41bf-a120-629c100f4973 req-a588587e-366f-4ae7-8b82-0b31c1fbca8b service nova] Acquiring lock "f42c5cf7-5b0c-4519-a8dc-4022eb20fa59-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:15:41 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-5f589e6d-c00e-41bf-a120-629c100f4973 req-a588587e-366f-4ae7-8b82-0b31c1fbca8b service nova] Lock "f42c5cf7-5b0c-4519-a8dc-4022eb20fa59-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:15:41 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-5f589e6d-c00e-41bf-a120-629c100f4973 req-a588587e-366f-4ae7-8b82-0b31c1fbca8b service nova] Lock "f42c5cf7-5b0c-4519-a8dc-4022eb20fa59-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:15:41 user nova-compute[71874]: DEBUG nova.compute.manager [req-5f589e6d-c00e-41bf-a120-629c100f4973 req-a588587e-366f-4ae7-8b82-0b31c1fbca8b service nova] [instance: f42c5cf7-5b0c-4519-a8dc-4022eb20fa59] No waiting events found dispatching network-vif-plugged-e3207e92-f3c0-4115-bda1-f02903827226 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:15:41 user nova-compute[71874]: WARNING nova.compute.manager [req-5f589e6d-c00e-41bf-a120-629c100f4973 req-a588587e-366f-4ae7-8b82-0b31c1fbca8b service nova] [instance: f42c5cf7-5b0c-4519-a8dc-4022eb20fa59] Received unexpected event network-vif-plugged-e3207e92-f3c0-4115-bda1-f02903827226 for instance with vm_state building and task_state spawning.
Apr 12 16:15:41 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:15:41 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:15:42 user nova-compute[71874]: DEBUG nova.compute.manager [req-facc86c6-b14e-4b82-8d6f-90ab6b505e24 req-2cc68d20-7c32-4944-b2d4-9e7af0223490 service nova] [instance: 32471bee-e77e-4a1b-8e00-d938a1373976] Received event network-changed-69029e57-b138-43c1-b31f-59bc7957994d {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:15:42 user nova-compute[71874]: DEBUG nova.compute.manager [req-facc86c6-b14e-4b82-8d6f-90ab6b505e24 req-2cc68d20-7c32-4944-b2d4-9e7af0223490 service nova] [instance: 32471bee-e77e-4a1b-8e00-d938a1373976] Refreshing instance network info cache due to event network-changed-69029e57-b138-43c1-b31f-59bc7957994d. {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 16:15:42 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-facc86c6-b14e-4b82-8d6f-90ab6b505e24 req-2cc68d20-7c32-4944-b2d4-9e7af0223490 service nova] Acquiring lock "refresh_cache-32471bee-e77e-4a1b-8e00-d938a1373976" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:15:42 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-facc86c6-b14e-4b82-8d6f-90ab6b505e24 req-2cc68d20-7c32-4944-b2d4-9e7af0223490 service nova] Acquired lock "refresh_cache-32471bee-e77e-4a1b-8e00-d938a1373976" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:15:42 user nova-compute[71874]: DEBUG nova.network.neutron [req-facc86c6-b14e-4b82-8d6f-90ab6b505e24 req-2cc68d20-7c32-4944-b2d4-9e7af0223490 service nova] [instance: 32471bee-e77e-4a1b-8e00-d938a1373976] Refreshing network info cache for port 69029e57-b138-43c1-b31f-59bc7957994d {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 16:15:42 user nova-compute[71874]: DEBUG nova.network.neutron [req-facc86c6-b14e-4b82-8d6f-90ab6b505e24 req-2cc68d20-7c32-4944-b2d4-9e7af0223490 service nova] [instance: 32471bee-e77e-4a1b-8e00-d938a1373976] Updated VIF entry in instance network info cache for port 69029e57-b138-43c1-b31f-59bc7957994d. {{(pid=71874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 16:15:42 user nova-compute[71874]: DEBUG nova.network.neutron [req-facc86c6-b14e-4b82-8d6f-90ab6b505e24 req-2cc68d20-7c32-4944-b2d4-9e7af0223490 service nova] [instance: 32471bee-e77e-4a1b-8e00-d938a1373976] Updating instance_info_cache with network_info: [{"id": "69029e57-b138-43c1-b31f-59bc7957994d", "address": "fa:16:3e:04:8e:ce", "network": {"id": "e6694358-e361-4952-b859-93755c11721e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-667152893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97ea81bd1962466bbe552424973f71a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69029e57-b1", "ovs_interfaceid": "69029e57-b138-43c1-b31f-59bc7957994d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:15:43 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-facc86c6-b14e-4b82-8d6f-90ab6b505e24 req-2cc68d20-7c32-4944-b2d4-9e7af0223490 service nova] Releasing lock "refresh_cache-32471bee-e77e-4a1b-8e00-d938a1373976" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:15:43 user nova-compute[71874]: DEBUG nova.virt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Emitting event <LifecycleEvent: 1681316143.2117252, f42c5cf7-5b0c-4519-a8dc-4022eb20fa59 => Resumed> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:15:43 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: f42c5cf7-5b0c-4519-a8dc-4022eb20fa59] VM Resumed (Lifecycle Event)
Apr 12 16:15:43 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb506e4d-cac1-4b9e-97c5-226f6fb819b2 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: f42c5cf7-5b0c-4519-a8dc-4022eb20fa59] Instance event wait completed in 0 seconds for  {{(pid=71874) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 16:15:43 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-eb506e4d-cac1-4b9e-97c5-226f6fb819b2 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: f42c5cf7-5b0c-4519-a8dc-4022eb20fa59] Guest created on hypervisor {{(pid=71874) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 16:15:43 user nova-compute[71874]: INFO nova.virt.libvirt.driver [-] [instance: f42c5cf7-5b0c-4519-a8dc-4022eb20fa59] Instance spawned successfully.
Apr 12 16:15:43 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-eb506e4d-cac1-4b9e-97c5-226f6fb819b2 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: f42c5cf7-5b0c-4519-a8dc-4022eb20fa59] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 16:15:43 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: f42c5cf7-5b0c-4519-a8dc-4022eb20fa59] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:15:43 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: f42c5cf7-5b0c-4519-a8dc-4022eb20fa59] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 16:15:43 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-eb506e4d-cac1-4b9e-97c5-226f6fb819b2 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: f42c5cf7-5b0c-4519-a8dc-4022eb20fa59] Found default for hw_cdrom_bus of ide {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:15:43 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-eb506e4d-cac1-4b9e-97c5-226f6fb819b2 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: f42c5cf7-5b0c-4519-a8dc-4022eb20fa59] Found default for hw_disk_bus of virtio {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:15:43 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-eb506e4d-cac1-4b9e-97c5-226f6fb819b2 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: f42c5cf7-5b0c-4519-a8dc-4022eb20fa59] Found default for hw_input_bus of None {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:15:43 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-eb506e4d-cac1-4b9e-97c5-226f6fb819b2 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: f42c5cf7-5b0c-4519-a8dc-4022eb20fa59] Found default for hw_pointer_model of None {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:15:43 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-eb506e4d-cac1-4b9e-97c5-226f6fb819b2 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: f42c5cf7-5b0c-4519-a8dc-4022eb20fa59] Found default for hw_video_model of virtio {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:15:43 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-eb506e4d-cac1-4b9e-97c5-226f6fb819b2 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: f42c5cf7-5b0c-4519-a8dc-4022eb20fa59] Found default for hw_vif_model of virtio {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:15:43 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: f42c5cf7-5b0c-4519-a8dc-4022eb20fa59] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 16:15:43 user nova-compute[71874]: DEBUG nova.virt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Emitting event <LifecycleEvent: 1681316143.215903, f42c5cf7-5b0c-4519-a8dc-4022eb20fa59 => Started> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:15:43 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: f42c5cf7-5b0c-4519-a8dc-4022eb20fa59] VM Started (Lifecycle Event)
Apr 12 16:15:43 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:15:43 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: f42c5cf7-5b0c-4519-a8dc-4022eb20fa59] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:15:43 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: f42c5cf7-5b0c-4519-a8dc-4022eb20fa59] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 16:15:43 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: f42c5cf7-5b0c-4519-a8dc-4022eb20fa59] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 16:15:43 user nova-compute[71874]: INFO nova.compute.manager [None req-eb506e4d-cac1-4b9e-97c5-226f6fb819b2 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: f42c5cf7-5b0c-4519-a8dc-4022eb20fa59] Took 5.11 seconds to spawn the instance on the hypervisor.
Apr 12 16:15:43 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb506e4d-cac1-4b9e-97c5-226f6fb819b2 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: f42c5cf7-5b0c-4519-a8dc-4022eb20fa59] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:15:43 user nova-compute[71874]: INFO nova.compute.manager [None req-eb506e4d-cac1-4b9e-97c5-226f6fb819b2 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: f42c5cf7-5b0c-4519-a8dc-4022eb20fa59] Took 16.54 seconds to build instance.
Apr 12 16:15:43 user nova-compute[71874]: DEBUG nova.compute.manager [req-40fc0ac6-9c07-49d2-b857-e6d45582fab6 req-395ef9f8-f2c7-496f-999e-b0df945060a7 service nova] [instance: f42c5cf7-5b0c-4519-a8dc-4022eb20fa59] Received event network-vif-plugged-e3207e92-f3c0-4115-bda1-f02903827226 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:15:43 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-40fc0ac6-9c07-49d2-b857-e6d45582fab6 req-395ef9f8-f2c7-496f-999e-b0df945060a7 service nova] Acquiring lock "f42c5cf7-5b0c-4519-a8dc-4022eb20fa59-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:15:43 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-40fc0ac6-9c07-49d2-b857-e6d45582fab6 req-395ef9f8-f2c7-496f-999e-b0df945060a7 service nova] Lock "f42c5cf7-5b0c-4519-a8dc-4022eb20fa59-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:15:43 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-40fc0ac6-9c07-49d2-b857-e6d45582fab6 req-395ef9f8-f2c7-496f-999e-b0df945060a7 service nova] Lock "f42c5cf7-5b0c-4519-a8dc-4022eb20fa59-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:15:43 user nova-compute[71874]: DEBUG nova.compute.manager [req-40fc0ac6-9c07-49d2-b857-e6d45582fab6 req-395ef9f8-f2c7-496f-999e-b0df945060a7 service nova] [instance: f42c5cf7-5b0c-4519-a8dc-4022eb20fa59] No waiting events found dispatching network-vif-plugged-e3207e92-f3c0-4115-bda1-f02903827226 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:15:43 user nova-compute[71874]: WARNING nova.compute.manager [req-40fc0ac6-9c07-49d2-b857-e6d45582fab6 req-395ef9f8-f2c7-496f-999e-b0df945060a7 service nova] [instance: f42c5cf7-5b0c-4519-a8dc-4022eb20fa59] Received unexpected event network-vif-plugged-e3207e92-f3c0-4115-bda1-f02903827226 for instance with vm_state active and task_state None.
Apr 12 16:15:43 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-eb506e4d-cac1-4b9e-97c5-226f6fb819b2 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "f42c5cf7-5b0c-4519-a8dc-4022eb20fa59" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.284s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:15:44 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:15:46 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-876d6daf-1ae8-4c2f-b8bf-34a0a8016fe3 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "bef10c89-360e-42d6-aa26-7edf1afca567" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:15:46 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-876d6daf-1ae8-4c2f-b8bf-34a0a8016fe3 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "bef10c89-360e-42d6-aa26-7edf1afca567" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:15:46 user nova-compute[71874]: DEBUG nova.compute.manager [None req-876d6daf-1ae8-4c2f-b8bf-34a0a8016fe3 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] Starting instance... {{(pid=71874) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 16:15:46 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-876d6daf-1ae8-4c2f-b8bf-34a0a8016fe3 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:15:46 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-876d6daf-1ae8-4c2f-b8bf-34a0a8016fe3 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:15:46 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-876d6daf-1ae8-4c2f-b8bf-34a0a8016fe3 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71874) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 16:15:46 user nova-compute[71874]: INFO nova.compute.claims [None req-876d6daf-1ae8-4c2f-b8bf-34a0a8016fe3 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] Claim successful on node user
Apr 12 16:15:46 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-876d6daf-1ae8-4c2f-b8bf-34a0a8016fe3 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Refreshing inventories for resource provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b {{(pid=71874) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 12 16:15:46 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-876d6daf-1ae8-4c2f-b8bf-34a0a8016fe3 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Updating ProviderTree inventory for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 12 16:15:46 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-876d6daf-1ae8-4c2f-b8bf-34a0a8016fe3 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Updating inventory in ProviderTree for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 12 16:15:46 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-876d6daf-1ae8-4c2f-b8bf-34a0a8016fe3 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Refreshing aggregate associations for resource provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b, aggregates: None {{(pid=71874) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 12 16:15:46 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-876d6daf-1ae8-4c2f-b8bf-34a0a8016fe3 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Refreshing trait associations for resource provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b, traits: COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_ACCELERATORS,HW_CPU_X86_MMX,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE2,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_FDC,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE {{(pid=71874) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 12 16:15:46 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-876d6daf-1ae8-4c2f-b8bf-34a0a8016fe3 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Inventory has not changed in ProviderTree for provider: 0e94b4c8-cd49-45e4-9133-d36eb4b2456b {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 16:15:46 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-876d6daf-1ae8-4c2f-b8bf-34a0a8016fe3 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Inventory has not changed for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 16:15:47 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-876d6daf-1ae8-4c2f-b8bf-34a0a8016fe3 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.627s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:15:47 user nova-compute[71874]: DEBUG nova.compute.manager [None req-876d6daf-1ae8-4c2f-b8bf-34a0a8016fe3 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] Start building networks asynchronously for instance. {{(pid=71874) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 16:15:47 user nova-compute[71874]: DEBUG nova.compute.manager [None req-876d6daf-1ae8-4c2f-b8bf-34a0a8016fe3 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] Allocating IP information in the background. {{(pid=71874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 16:15:47 user nova-compute[71874]: DEBUG nova.network.neutron [None req-876d6daf-1ae8-4c2f-b8bf-34a0a8016fe3 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] allocate_for_instance() {{(pid=71874) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 16:15:47 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-876d6daf-1ae8-4c2f-b8bf-34a0a8016fe3 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 16:15:47 user nova-compute[71874]: DEBUG nova.compute.manager [None req-876d6daf-1ae8-4c2f-b8bf-34a0a8016fe3 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] Start building block device mappings for instance. {{(pid=71874) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 16:15:47 user nova-compute[71874]: DEBUG nova.policy [None req-876d6daf-1ae8-4c2f-b8bf-34a0a8016fe3 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1a699b3ba8304eadb8a53d465ea340cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ea81bd1962466bbe552424973f71a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71874) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 16:15:47 user nova-compute[71874]: INFO nova.virt.block_device [None req-876d6daf-1ae8-4c2f-b8bf-34a0a8016fe3 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] Booting with volume b5a801df-b37e-4132-8465-d4011ca47775 at /dev/vda
Apr 12 16:15:47 user nova-compute[71874]: DEBUG os_brick.utils [None req-876d6daf-1ae8-4c2f-b8bf-34a0a8016fe3 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:15:47 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:15:47 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:15:47 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e81fbb6-047f-451e-9b2e-670e3f7e4fd2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:61a48d4489d2\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:15:47 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:15:47 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:15:47 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[79ec7ec5-a346-4c94-ab21-2199ce82a248]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:15:47 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:15:47 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:15:47 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[85e720b7-61fa-4b7b-9fde-8cd92173e952]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:15:47 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd553d61-97d6-45d2-9a37-db3aa51d4fd8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:15:47 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-876d6daf-1ae8-4c2f-b8bf-34a0a8016fe3 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Running cmd (subprocess): nvme version {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:15:47 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-876d6daf-1ae8-4c2f-b8bf-34a0a8016fe3 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] 'nvme version' failed. Not Retrying. {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 16:15:47 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.nvmeof [None req-876d6daf-1ae8-4c2f-b8bf-34a0a8016fe3 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] nvme not present on system {{(pid=71874) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 16:15:47 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:15:47 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 16:15:47 user nova-compute[71874]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 16:15:47 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[23bb99da-f0b0-4fe9-91c5-4478da0e8622]: (4, '') {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:15:47 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.lightos [None req-876d6daf-1ae8-4c2f-b8bf-34a0a8016fe3 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71874) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 16:15:47 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.lightos [None req-876d6daf-1ae8-4c2f-b8bf-34a0a8016fe3 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71874) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 16:15:47 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.lightos [None req-876d6daf-1ae8-4c2f-b8bf-34a0a8016fe3 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] LIGHTOS: no hostnqn found. {{(pid=71874) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 16:15:47 user nova-compute[71874]: DEBUG os_brick.utils [None req-876d6daf-1ae8-4c2f-b8bf-34a0a8016fe3 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:61a48d4489d2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:15:47 user nova-compute[71874]: DEBUG nova.virt.block_device [None req-876d6daf-1ae8-4c2f-b8bf-34a0a8016fe3 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] Updating existing volume attachment record: a83f2eaa-6101-4efc-953a-61a1762fe0cf {{(pid=71874) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 16:15:48 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:15:48 user nova-compute[71874]: DEBUG nova.network.neutron [None req-876d6daf-1ae8-4c2f-b8bf-34a0a8016fe3 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] Successfully created port: ecba9b76-45d2-49e7-addc-367dc21b38ce {{(pid=71874) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 16:15:48 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:15:49 user nova-compute[71874]: DEBUG nova.network.neutron [None req-876d6daf-1ae8-4c2f-b8bf-34a0a8016fe3 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] Successfully updated port: ecba9b76-45d2-49e7-addc-367dc21b38ce {{(pid=71874) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 16:15:49 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-876d6daf-1ae8-4c2f-b8bf-34a0a8016fe3 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "refresh_cache-bef10c89-360e-42d6-aa26-7edf1afca567" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:15:49 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-876d6daf-1ae8-4c2f-b8bf-34a0a8016fe3 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquired lock "refresh_cache-bef10c89-360e-42d6-aa26-7edf1afca567" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:15:49 user nova-compute[71874]: DEBUG nova.network.neutron [None req-876d6daf-1ae8-4c2f-b8bf-34a0a8016fe3 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] Building network info cache for instance {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 16:15:49 user nova-compute[71874]: DEBUG nova.compute.manager [req-5672e5cb-afb7-40f4-a1a1-46138ddc2f9b req-298407c5-e61d-4cae-a111-af2a5ea4fe0c service nova] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] Received event network-changed-ecba9b76-45d2-49e7-addc-367dc21b38ce {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:15:49 user nova-compute[71874]: DEBUG nova.compute.manager [req-5672e5cb-afb7-40f4-a1a1-46138ddc2f9b req-298407c5-e61d-4cae-a111-af2a5ea4fe0c service nova] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] Refreshing instance network info cache due to event network-changed-ecba9b76-45d2-49e7-addc-367dc21b38ce. {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 16:15:49 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-5672e5cb-afb7-40f4-a1a1-46138ddc2f9b req-298407c5-e61d-4cae-a111-af2a5ea4fe0c service nova] Acquiring lock "refresh_cache-bef10c89-360e-42d6-aa26-7edf1afca567" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:15:49 user nova-compute[71874]: DEBUG nova.network.neutron [None req-876d6daf-1ae8-4c2f-b8bf-34a0a8016fe3 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] Instance cache missing network info. {{(pid=71874) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 16:15:49 user nova-compute[71874]: DEBUG nova.network.neutron [None req-876d6daf-1ae8-4c2f-b8bf-34a0a8016fe3 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] Updating instance_info_cache with network_info: [{"id": "ecba9b76-45d2-49e7-addc-367dc21b38ce", "address": "fa:16:3e:e4:f4:15", "network": {"id": "e6694358-e361-4952-b859-93755c11721e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-667152893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97ea81bd1962466bbe552424973f71a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecba9b76-45", "ovs_interfaceid": "ecba9b76-45d2-49e7-addc-367dc21b38ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:15:49 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-876d6daf-1ae8-4c2f-b8bf-34a0a8016fe3 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Releasing lock "refresh_cache-bef10c89-360e-42d6-aa26-7edf1afca567" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:15:49 user nova-compute[71874]: DEBUG nova.compute.manager [None req-876d6daf-1ae8-4c2f-b8bf-34a0a8016fe3 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] Instance network_info: |[{"id": "ecba9b76-45d2-49e7-addc-367dc21b38ce", "address": "fa:16:3e:e4:f4:15", "network": {"id": "e6694358-e361-4952-b859-93755c11721e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-667152893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97ea81bd1962466bbe552424973f71a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecba9b76-45", "ovs_interfaceid": "ecba9b76-45d2-49e7-addc-367dc21b38ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 16:15:49 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-5672e5cb-afb7-40f4-a1a1-46138ddc2f9b req-298407c5-e61d-4cae-a111-af2a5ea4fe0c service nova] Acquired lock "refresh_cache-bef10c89-360e-42d6-aa26-7edf1afca567" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:15:49 user nova-compute[71874]: DEBUG nova.network.neutron [req-5672e5cb-afb7-40f4-a1a1-46138ddc2f9b req-298407c5-e61d-4cae-a111-af2a5ea4fe0c service nova] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] Refreshing network info cache for port ecba9b76-45d2-49e7-addc-367dc21b38ce {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 16:15:49 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:15:50 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-e50da005-c51d-4fa7-860a-0791184efdf0 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Acquiring lock "947c2ca9-fd67-4e8d-b0dc-90c5c827a59e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:15:50 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-e50da005-c51d-4fa7-860a-0791184efdf0 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Lock "947c2ca9-fd67-4e8d-b0dc-90c5c827a59e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:15:50 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-e50da005-c51d-4fa7-860a-0791184efdf0 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Acquiring lock "947c2ca9-fd67-4e8d-b0dc-90c5c827a59e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:15:50 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-e50da005-c51d-4fa7-860a-0791184efdf0 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Lock "947c2ca9-fd67-4e8d-b0dc-90c5c827a59e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:15:50 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-e50da005-c51d-4fa7-860a-0791184efdf0 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Lock "947c2ca9-fd67-4e8d-b0dc-90c5c827a59e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:15:50 user nova-compute[71874]: INFO nova.compute.manager [None req-e50da005-c51d-4fa7-860a-0791184efdf0 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] [instance: 947c2ca9-fd67-4e8d-b0dc-90c5c827a59e] Terminating instance
Apr 12 16:15:50 user nova-compute[71874]: DEBUG nova.compute.manager [None req-e50da005-c51d-4fa7-860a-0791184efdf0 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] [instance: 947c2ca9-fd67-4e8d-b0dc-90c5c827a59e] Start destroying the instance on the hypervisor. {{(pid=71874) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 16:15:50 user nova-compute[71874]: DEBUG nova.network.neutron [req-5672e5cb-afb7-40f4-a1a1-46138ddc2f9b req-298407c5-e61d-4cae-a111-af2a5ea4fe0c service nova] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] Updated VIF entry in instance network info cache for port ecba9b76-45d2-49e7-addc-367dc21b38ce. {{(pid=71874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 16:15:50 user nova-compute[71874]: DEBUG nova.network.neutron [req-5672e5cb-afb7-40f4-a1a1-46138ddc2f9b req-298407c5-e61d-4cae-a111-af2a5ea4fe0c service nova] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] Updating instance_info_cache with network_info: [{"id": "ecba9b76-45d2-49e7-addc-367dc21b38ce", "address": "fa:16:3e:e4:f4:15", "network": {"id": "e6694358-e361-4952-b859-93755c11721e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-667152893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97ea81bd1962466bbe552424973f71a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecba9b76-45", "ovs_interfaceid": "ecba9b76-45d2-49e7-addc-367dc21b38ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:15:50 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-5672e5cb-afb7-40f4-a1a1-46138ddc2f9b req-298407c5-e61d-4cae-a111-af2a5ea4fe0c service nova] Releasing lock "refresh_cache-bef10c89-360e-42d6-aa26-7edf1afca567" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:15:50 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:15:50 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:15:50 user nova-compute[71874]: DEBUG nova.compute.manager [req-fb6f8052-613d-4d0b-b5a1-59cbd48992f6 req-a32c823c-2aa0-4f71-9205-f60b2e75db4f service nova] [instance: 947c2ca9-fd67-4e8d-b0dc-90c5c827a59e] Received event network-vif-unplugged-adb08d3a-a6bb-4c1d-8b23-fbe49e6ff7de {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:15:50 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-fb6f8052-613d-4d0b-b5a1-59cbd48992f6 req-a32c823c-2aa0-4f71-9205-f60b2e75db4f service nova] Acquiring lock "947c2ca9-fd67-4e8d-b0dc-90c5c827a59e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:15:50 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-fb6f8052-613d-4d0b-b5a1-59cbd48992f6 req-a32c823c-2aa0-4f71-9205-f60b2e75db4f service nova] Lock "947c2ca9-fd67-4e8d-b0dc-90c5c827a59e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:15:50 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-fb6f8052-613d-4d0b-b5a1-59cbd48992f6 req-a32c823c-2aa0-4f71-9205-f60b2e75db4f service nova] Lock "947c2ca9-fd67-4e8d-b0dc-90c5c827a59e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:15:50 user nova-compute[71874]: DEBUG nova.compute.manager [req-fb6f8052-613d-4d0b-b5a1-59cbd48992f6 req-a32c823c-2aa0-4f71-9205-f60b2e75db4f service nova] [instance: 947c2ca9-fd67-4e8d-b0dc-90c5c827a59e] No waiting events found dispatching network-vif-unplugged-adb08d3a-a6bb-4c1d-8b23-fbe49e6ff7de {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:15:50 user nova-compute[71874]: DEBUG nova.compute.manager [req-fb6f8052-613d-4d0b-b5a1-59cbd48992f6 req-a32c823c-2aa0-4f71-9205-f60b2e75db4f service nova] [instance: 947c2ca9-fd67-4e8d-b0dc-90c5c827a59e] Received event network-vif-unplugged-adb08d3a-a6bb-4c1d-8b23-fbe49e6ff7de for instance with task_state deleting. {{(pid=71874) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 16:15:50 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:15:50 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:15:50 user nova-compute[71874]: INFO nova.virt.libvirt.driver [-] [instance: 947c2ca9-fd67-4e8d-b0dc-90c5c827a59e] Instance destroyed successfully.
Apr 12 16:15:50 user nova-compute[71874]: DEBUG nova.objects.instance [None req-e50da005-c51d-4fa7-860a-0791184efdf0 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Lazy-loading 'resources' on Instance uuid 947c2ca9-fd67-4e8d-b0dc-90c5c827a59e {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:15:50 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-e50da005-c51d-4fa7-860a-0791184efdf0 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T16:13:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1326442338',display_name='tempest-ServersNegativeTestJSON-server-1326442338',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1326442338',id=34,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T16:14:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='280a9a56afca4ce591faca7a94eca4b2',ramdisk_id='',reservation_id='r-is3ttqvp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-2057017930',owner_user_name='tempest-ServersNegativeTestJSON-2057017930-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T16:14:08Z,user_data=None,user_id='38c60e84c47047e2886220f2ef54391d',uuid=947c2ca9-fd67-4e8d-b0dc-90c5c827a59e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "adb08d3a-a6bb-4c1d-8b23-fbe49e6ff7de", "address": "fa:16:3e:f0:f9:71", "network": {"id": "89a33fcd-81e9-4815-8644-d9b33ceb236b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-241667694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "280a9a56afca4ce591faca7a94eca4b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadb08d3a-a6", "ovs_interfaceid": "adb08d3a-a6bb-4c1d-8b23-fbe49e6ff7de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 16:15:50 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-e50da005-c51d-4fa7-860a-0791184efdf0 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Converting VIF {"id": "adb08d3a-a6bb-4c1d-8b23-fbe49e6ff7de", "address": "fa:16:3e:f0:f9:71", "network": {"id": "89a33fcd-81e9-4815-8644-d9b33ceb236b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-241667694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "280a9a56afca4ce591faca7a94eca4b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadb08d3a-a6", "ovs_interfaceid": "adb08d3a-a6bb-4c1d-8b23-fbe49e6ff7de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:15:50 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-e50da005-c51d-4fa7-860a-0791184efdf0 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:f9:71,bridge_name='br-int',has_traffic_filtering=True,id=adb08d3a-a6bb-4c1d-8b23-fbe49e6ff7de,network=Network(89a33fcd-81e9-4815-8644-d9b33ceb236b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadb08d3a-a6') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:15:50 user nova-compute[71874]: DEBUG os_vif [None req-e50da005-c51d-4fa7-860a-0791184efdf0 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:f9:71,bridge_name='br-int',has_traffic_filtering=True,id=adb08d3a-a6bb-4c1d-8b23-fbe49e6ff7de,network=Network(89a33fcd-81e9-4815-8644-d9b33ceb236b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadb08d3a-a6') {{(pid=71874) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 16:15:50 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:15:50 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapadb08d3a-a6, bridge=br-int, if_exists=True) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:15:50 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:15:50 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:15:50 user nova-compute[71874]: INFO os_vif [None req-e50da005-c51d-4fa7-860a-0791184efdf0 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:f9:71,bridge_name='br-int',has_traffic_filtering=True,id=adb08d3a-a6bb-4c1d-8b23-fbe49e6ff7de,network=Network(89a33fcd-81e9-4815-8644-d9b33ceb236b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadb08d3a-a6')
Apr 12 16:15:50 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-e50da005-c51d-4fa7-860a-0791184efdf0 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] [instance: 947c2ca9-fd67-4e8d-b0dc-90c5c827a59e] Deleting instance files /opt/stack/data/nova/instances/947c2ca9-fd67-4e8d-b0dc-90c5c827a59e_del
Apr 12 16:15:50 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-e50da005-c51d-4fa7-860a-0791184efdf0 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] [instance: 947c2ca9-fd67-4e8d-b0dc-90c5c827a59e] Deletion of /opt/stack/data/nova/instances/947c2ca9-fd67-4e8d-b0dc-90c5c827a59e_del complete
Apr 12 16:15:50 user nova-compute[71874]: INFO nova.compute.manager [None req-e50da005-c51d-4fa7-860a-0791184efdf0 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] [instance: 947c2ca9-fd67-4e8d-b0dc-90c5c827a59e] Took 0.69 seconds to destroy the instance on the hypervisor.
Apr 12 16:15:50 user nova-compute[71874]: DEBUG oslo.service.loopingcall [None req-e50da005-c51d-4fa7-860a-0791184efdf0 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71874) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 16:15:50 user nova-compute[71874]: DEBUG nova.compute.manager [-] [instance: 947c2ca9-fd67-4e8d-b0dc-90c5c827a59e] Deallocating network for instance {{(pid=71874) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 16:15:50 user nova-compute[71874]: DEBUG nova.network.neutron [-] [instance: 947c2ca9-fd67-4e8d-b0dc-90c5c827a59e] deallocate_for_instance() {{(pid=71874) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 16:15:51 user nova-compute[71874]: DEBUG nova.network.neutron [-] [instance: 947c2ca9-fd67-4e8d-b0dc-90c5c827a59e] Updating instance_info_cache with network_info: [] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:15:51 user nova-compute[71874]: INFO nova.compute.manager [-] [instance: 947c2ca9-fd67-4e8d-b0dc-90c5c827a59e] Took 0.46 seconds to deallocate network for instance.
Apr 12 16:15:51 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-e50da005-c51d-4fa7-860a-0791184efdf0 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:15:51 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-e50da005-c51d-4fa7-860a-0791184efdf0 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:15:51 user nova-compute[71874]: DEBUG nova.compute.manager [req-4a98e9fd-3a86-401f-86fd-ace9a572a96c req-028c0004-8f9e-4cb4-9c41-1c7da408b688 service nova] [instance: 947c2ca9-fd67-4e8d-b0dc-90c5c827a59e] Received event network-vif-deleted-adb08d3a-a6bb-4c1d-8b23-fbe49e6ff7de {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:15:51 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-e50da005-c51d-4fa7-860a-0791184efdf0 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Inventory has not changed in ProviderTree for provider: 0e94b4c8-cd49-45e4-9133-d36eb4b2456b {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 16:15:51 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-e50da005-c51d-4fa7-860a-0791184efdf0 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Inventory has not changed for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 16:15:51 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-e50da005-c51d-4fa7-860a-0791184efdf0 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.423s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:15:51 user nova-compute[71874]: INFO nova.scheduler.client.report [None req-e50da005-c51d-4fa7-860a-0791184efdf0 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Deleted allocations for instance 947c2ca9-fd67-4e8d-b0dc-90c5c827a59e
Apr 12 16:15:51 user nova-compute[71874]: DEBUG nova.compute.manager [None req-876d6daf-1ae8-4c2f-b8bf-34a0a8016fe3 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] Start spawning the instance on the hypervisor. {{(pid=71874) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 16:15:51 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-876d6daf-1ae8-4c2f-b8bf-34a0a8016fe3 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] Creating instance directory {{(pid=71874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 16:15:51 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-876d6daf-1ae8-4c2f-b8bf-34a0a8016fe3 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] Creating image(s)
Apr 12 16:15:51 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-876d6daf-1ae8-4c2f-b8bf-34a0a8016fe3 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] Did not create local disks {{(pid=71874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 12 16:15:51 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-876d6daf-1ae8-4c2f-b8bf-34a0a8016fe3 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] Ensure instance console log exists: /opt/stack/data/nova/instances/bef10c89-360e-42d6-aa26-7edf1afca567/console.log {{(pid=71874) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 16:15:51 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-876d6daf-1ae8-4c2f-b8bf-34a0a8016fe3 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:15:51 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-876d6daf-1ae8-4c2f-b8bf-34a0a8016fe3 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:15:51 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-876d6daf-1ae8-4c2f-b8bf-34a0a8016fe3 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:15:51 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-876d6daf-1ae8-4c2f-b8bf-34a0a8016fe3 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] Start _get_guest_xml network_info=[{"id": "ecba9b76-45d2-49e7-addc-367dc21b38ce", "address": "fa:16:3e:e4:f4:15", "network": {"id": "e6694358-e361-4952-b859-93755c11721e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-667152893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97ea81bd1962466bbe552424973f71a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecba9b76-45", "ovs_interfaceid": "ecba9b76-45d2-49e7-addc-367dc21b38ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'delete_on_termination': True, 'attachment_id': 'a83f2eaa-6101-4efc-953a-61a1762fe0cf', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IalnbXCE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'bef10c89-360e-42d6-aa26-7edf1afca567', 'attached_at': '', 'detached_at': '', 'volume_id': 'b5a801df-b37e-4132-8465-d4011ca47775', 'serial': 'b5a801df-b37e-4132-8465-d4011ca47775'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'volume_type': None} {{(pid=71874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 16:15:51 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-e50da005-c51d-4fa7-860a-0791184efdf0 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Lock "947c2ca9-fd67-4e8d-b0dc-90c5c827a59e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.802s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:15:51 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-876d6daf-1ae8-4c2f-b8bf-34a0a8016fe3 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:15:51 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-876d6daf-1ae8-4c2f-b8bf-34a0a8016fe3 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:15:51 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-876d6daf-1ae8-4c2f-b8bf-34a0a8016fe3 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71874) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 16:15:51 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-876d6daf-1ae8-4c2f-b8bf-34a0a8016fe3 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T15:56:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 16:15:51 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-876d6daf-1ae8-4c2f-b8bf-34a0a8016fe3 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Flavor limits 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 16:15:51 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-876d6daf-1ae8-4c2f-b8bf-34a0a8016fe3 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Image limits 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 16:15:51 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-876d6daf-1ae8-4c2f-b8bf-34a0a8016fe3 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Flavor pref 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 16:15:51 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-876d6daf-1ae8-4c2f-b8bf-34a0a8016fe3 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Image pref 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 16:15:51 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-876d6daf-1ae8-4c2f-b8bf-34a0a8016fe3 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 16:15:51 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-876d6daf-1ae8-4c2f-b8bf-34a0a8016fe3 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 16:15:51 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-876d6daf-1ae8-4c2f-b8bf-34a0a8016fe3 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 16:15:51 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-876d6daf-1ae8-4c2f-b8bf-34a0a8016fe3 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Got 1 possible topologies {{(pid=71874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 16:15:51 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-876d6daf-1ae8-4c2f-b8bf-34a0a8016fe3 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 16:15:51 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-876d6daf-1ae8-4c2f-b8bf-34a0a8016fe3 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 16:15:51 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-876d6daf-1ae8-4c2f-b8bf-34a0a8016fe3 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] Calling os-brick to attach iSCSI Volume {{(pid=71874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 16:15:51 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-876d6daf-1ae8-4c2f-b8bf-34a0a8016fe3 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3c0216320>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IalnbXCE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:15:51 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-876d6daf-1ae8-4c2f-b8bf-34a0a8016fe3 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:15:51 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-876d6daf-1ae8-4c2f-b8bf-34a0a8016fe3 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:15:51 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-876d6daf-1ae8-4c2f-b8bf-34a0a8016fe3 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:15:51 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-876d6daf-1ae8-4c2f-b8bf-34a0a8016fe3 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:15:51 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-876d6daf-1ae8-4c2f-b8bf-34a0a8016fe3 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:15:51 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-876d6daf-1ae8-4c2f-b8bf-34a0a8016fe3 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:15:51 user nova-compute[71874]: INFO os_brick.initiator.connectors.iscsi [None req-876d6daf-1ae8-4c2f-b8bf-34a0a8016fe3 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 16:15:51 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775 -p 172.16.0.220:3260 {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:15:51 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:15:51 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6a12e88-b41e-4103-a4c5-6720f9f074c9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:15:51 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-876d6daf-1ae8-4c2f-b8bf-34a0a8016fe3 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 16:15:51 user nova-compute[71874]:  {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:15:51 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775 -p 172.16.0.220:3260 --interface default --op new {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:15:51 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:15:51 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcb50aad-b9a3-4a3a-b56e-5005e3486ad1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775] added\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:15:51 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-876d6daf-1ae8-4c2f-b8bf-34a0a8016fe3 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775] added
Apr 12 16:15:51 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:15:51 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:15:52 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:15:52 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[66b8cbcb-904e-4fb7-a916-5275c864af51]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:15:52 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-876d6daf-1ae8-4c2f-b8bf-34a0a8016fe3 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:15:52 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:15:52 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:15:52 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[f51fcb69-3010-4f5b-b285-3f87f493f8a1]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:15:52 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-876d6daf-1ae8-4c2f-b8bf-34a0a8016fe3 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:15:52 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IalnbXCE {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:15:52 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IalnbXCE" returned: 0 in 0.018s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:15:52 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[c213cf17-b67c-4e47-a3d2-bf9f9c8cb7e1]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:15:52 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-876d6daf-1ae8-4c2f-b8bf-34a0a8016fe3 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IalnbXCE'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:15:52 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:15:52 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:15:52 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cae50fd-b6f0-4e96-93b0-249ad04f70ad]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:15:52 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-876d6daf-1ae8-4c2f-b8bf-34a0a8016fe3 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:15:52 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:15:52 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:15:52 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd40596a-72e4-49c1-b765-3882698b81b2]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce38c1b3-35b0-48cc-9b83-e9a676997784 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c59288c2-ba2b-4a3a-8a0a-a683f07b0bba (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:15:52 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-876d6daf-1ae8-4c2f-b8bf-34a0a8016fe3 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:15:52 user nova-compute[71874]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304 (non-flash)
Apr 12 16:15:52 user nova-compute[71874]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce38c1b3-35b0-48cc-9b83-e9a676997784 (non-flash)
Apr 12 16:15:52 user nova-compute[71874]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c59288c2-ba2b-4a3a-8a0a-a683f07b0bba (non-flash)
Apr 12 16:15:52 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:15:52 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-876d6daf-1ae8-4c2f-b8bf-34a0a8016fe3 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:15:52 user nova-compute[71874]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304 (non-flash)
Apr 12 16:15:52 user nova-compute[71874]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce38c1b3-35b0-48cc-9b83-e9a676997784 (non-flash)
Apr 12 16:15:52 user nova-compute[71874]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c59288c2-ba2b-4a3a-8a0a-a683f07b0bba (non-flash)
Apr 12 16:15:52 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:15:52 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775 -p 172.16.0.220:3260 --login {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:15:52 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:15:52 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f97e3c5-e531-4c0e-b742-026ee95dc178]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:15:52 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-876d6daf-1ae8-4c2f-b8bf-34a0a8016fe3 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775, portal: 172.16.0.220,3260]
Apr 12 16:15:52 user nova-compute[71874]: Login to [iface: default, target: iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775, portal: 172.16.0.220,3260] successful.
Apr 12 16:15:52 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:15:52 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:15:52 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:15:52 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[85a6c244-efd2-4f46-bb36-2ccc9defdcb2]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:15:52 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-876d6daf-1ae8-4c2f-b8bf-34a0a8016fe3 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:15:52 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:15:52 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:15:52 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[d62308c2-09e6-40e6-ba30-8981a5237c23]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce38c1b3-35b0-48cc-9b83-e9a676997784 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c59288c2-ba2b-4a3a-8a0a-a683f07b0bba (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775 (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:15:52 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-876d6daf-1ae8-4c2f-b8bf-34a0a8016fe3 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:15:52 user nova-compute[71874]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304 (non-flash)
Apr 12 16:15:52 user nova-compute[71874]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce38c1b3-35b0-48cc-9b83-e9a676997784 (non-flash)
Apr 12 16:15:52 user nova-compute[71874]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c59288c2-ba2b-4a3a-8a0a-a683f07b0bba (non-flash)
Apr 12 16:15:52 user nova-compute[71874]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775 (non-flash)
Apr 12 16:15:52 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:15:52 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-876d6daf-1ae8-4c2f-b8bf-34a0a8016fe3 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:15:52 user nova-compute[71874]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304 (non-flash)
Apr 12 16:15:52 user nova-compute[71874]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce38c1b3-35b0-48cc-9b83-e9a676997784 (non-flash)
Apr 12 16:15:52 user nova-compute[71874]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c59288c2-ba2b-4a3a-8a0a-a683f07b0bba (non-flash)
Apr 12 16:15:52 user nova-compute[71874]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775 (non-flash)
Apr 12 16:15:52 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:15:52 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-876d6daf-1ae8-4c2f-b8bf-34a0a8016fe3 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.298s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:15:52 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-876d6daf-1ae8-4c2f-b8bf-34a0a8016fe3 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Connected to 172.16.0.220:3260 {{(pid=71874) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 16:15:52 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-876d6daf-1ae8-4c2f-b8bf-34a0a8016fe3 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] HCTL ('36', '-', '-', 0) found on session 38 with lun 0 {{(pid=71874) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 16:15:52 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-876d6daf-1ae8-4c2f-b8bf-34a0a8016fe3 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71874) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 16:15:52 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:15:52 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:15:52 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[29bb3225-e92d-40cc-9773-8a011da35d16]: (4, ('- - 0', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:15:52 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-876d6daf-1ae8-4c2f-b8bf-34a0a8016fe3 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Searching for a device in session 38 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71874) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 16:15:52 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-876d6daf-1ae8-4c2f-b8bf-34a0a8016fe3 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IalnbXCE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71874) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 16:15:52 user nova-compute[71874]: DEBUG nova.compute.manager [req-7f45e988-0bae-4962-bfdc-16ffe27bf259 req-759992c6-6446-45db-be37-8a177c1def91 service nova] [instance: 947c2ca9-fd67-4e8d-b0dc-90c5c827a59e] Received event network-vif-plugged-adb08d3a-a6bb-4c1d-8b23-fbe49e6ff7de {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:15:52 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-7f45e988-0bae-4962-bfdc-16ffe27bf259 req-759992c6-6446-45db-be37-8a177c1def91 service nova] Acquiring lock "947c2ca9-fd67-4e8d-b0dc-90c5c827a59e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:15:52 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-7f45e988-0bae-4962-bfdc-16ffe27bf259 req-759992c6-6446-45db-be37-8a177c1def91 service nova] Lock "947c2ca9-fd67-4e8d-b0dc-90c5c827a59e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:15:52 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-7f45e988-0bae-4962-bfdc-16ffe27bf259 req-759992c6-6446-45db-be37-8a177c1def91 service nova] Lock "947c2ca9-fd67-4e8d-b0dc-90c5c827a59e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:15:52 user nova-compute[71874]: DEBUG nova.compute.manager [req-7f45e988-0bae-4962-bfdc-16ffe27bf259 req-759992c6-6446-45db-be37-8a177c1def91 service nova] [instance: 947c2ca9-fd67-4e8d-b0dc-90c5c827a59e] No waiting events found dispatching network-vif-plugged-adb08d3a-a6bb-4c1d-8b23-fbe49e6ff7de {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:15:52 user nova-compute[71874]: WARNING nova.compute.manager [req-7f45e988-0bae-4962-bfdc-16ffe27bf259 req-759992c6-6446-45db-be37-8a177c1def91 service nova] [instance: 947c2ca9-fd67-4e8d-b0dc-90c5c827a59e] Received unexpected event network-vif-plugged-adb08d3a-a6bb-4c1d-8b23-fbe49e6ff7de for instance with vm_state deleted and task_state None.
Apr 12 16:15:53 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-876d6daf-1ae8-4c2f-b8bf-34a0a8016fe3 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.334s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:15:53 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-876d6daf-1ae8-4c2f-b8bf-34a0a8016fe3 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] <== connect_volume: return (1337ms) {'type': 'block', 'scsi_wwn': '26237333333636538', 'path': '/dev/sde'} {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:15:53 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-876d6daf-1ae8-4c2f-b8bf-34a0a8016fe3 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26237333333636538', 'path': '/dev/sde'} {{(pid=71874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 16:15:53 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:15:53 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-876d6daf-1ae8-4c2f-b8bf-34a0a8016fe3 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T16:15:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1742194488',display_name='tempest-ServerActionsTestJSON-server-1742194488',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1742194488',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNmXVADjvoPSh3uGCGCTNS/vcfcDtUjn/vZEaV3bCllfz1ZO8VIgFuZhP+mAsa+G/KA4ubi5U9Vj41YtHGsakdPR5VoByhorvfUv/PIWtER2tn1LWX2mlFyT+T8AEJplPw==',key_name='tempest-keypair-1923467613',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='97ea81bd1962466bbe552424973f71a8',ramdisk_id='',reservation_id='r-kpxobl69',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-631887779',owner_user_name='tempest-ServerActionsTestJSON-631887779-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T16:15:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1a699b3ba8304eadb8a53d465ea340cf',uuid=bef10c89-360e-42d6-aa26-7edf1afca567,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ecba9b76-45d2-49e7-addc-367dc21b38ce", "address": "fa:16:3e:e4:f4:15", "network": {"id": "e6694358-e361-4952-b859-93755c11721e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-667152893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97ea81bd1962466bbe552424973f71a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecba9b76-45", "ovs_interfaceid": "ecba9b76-45d2-49e7-addc-367dc21b38ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 16:15:53 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-876d6daf-1ae8-4c2f-b8bf-34a0a8016fe3 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Converting VIF {"id": "ecba9b76-45d2-49e7-addc-367dc21b38ce", "address": "fa:16:3e:e4:f4:15", "network": {"id": "e6694358-e361-4952-b859-93755c11721e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-667152893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97ea81bd1962466bbe552424973f71a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecba9b76-45", "ovs_interfaceid": "ecba9b76-45d2-49e7-addc-367dc21b38ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:15:53 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-876d6daf-1ae8-4c2f-b8bf-34a0a8016fe3 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:f4:15,bridge_name='br-int',has_traffic_filtering=True,id=ecba9b76-45d2-49e7-addc-367dc21b38ce,network=Network(e6694358-e361-4952-b859-93755c11721e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecba9b76-45') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:15:53 user nova-compute[71874]: DEBUG nova.objects.instance [None req-876d6daf-1ae8-4c2f-b8bf-34a0a8016fe3 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lazy-loading 'pci_devices' on Instance uuid bef10c89-360e-42d6-aa26-7edf1afca567 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:15:53 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-876d6daf-1ae8-4c2f-b8bf-34a0a8016fe3 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] End _get_guest_xml xml=<domain type="kvm">
Apr 12 16:15:53 user nova-compute[71874]:   <uuid>bef10c89-360e-42d6-aa26-7edf1afca567</uuid>
Apr 12 16:15:53 user nova-compute[71874]:   <name>instance-00000026</name>
Apr 12 16:15:53 user nova-compute[71874]:   <memory>131072</memory>
Apr 12 16:15:53 user nova-compute[71874]:   <vcpu>1</vcpu>
Apr 12 16:15:53 user nova-compute[71874]:   <metadata>
Apr 12 16:15:53 user nova-compute[71874]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 16:15:53 user nova-compute[71874]:       <nova:package version="0.0.0"/>
Apr 12 16:15:53 user nova-compute[71874]:       <nova:name>tempest-ServerActionsTestJSON-server-1742194488</nova:name>
Apr 12 16:15:53 user nova-compute[71874]:       <nova:creationTime>2023-04-12 16:15:51</nova:creationTime>
Apr 12 16:15:53 user nova-compute[71874]:       <nova:flavor name="m1.nano">
Apr 12 16:15:53 user nova-compute[71874]:         <nova:memory>128</nova:memory>
Apr 12 16:15:53 user nova-compute[71874]:         <nova:disk>1</nova:disk>
Apr 12 16:15:53 user nova-compute[71874]:         <nova:swap>0</nova:swap>
Apr 12 16:15:53 user nova-compute[71874]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 16:15:53 user nova-compute[71874]:         <nova:vcpus>1</nova:vcpus>
Apr 12 16:15:53 user nova-compute[71874]:       </nova:flavor>
Apr 12 16:15:53 user nova-compute[71874]:       <nova:owner>
Apr 12 16:15:53 user nova-compute[71874]:         <nova:user uuid="1a699b3ba8304eadb8a53d465ea340cf">tempest-ServerActionsTestJSON-631887779-project-member</nova:user>
Apr 12 16:15:53 user nova-compute[71874]:         <nova:project uuid="97ea81bd1962466bbe552424973f71a8">tempest-ServerActionsTestJSON-631887779</nova:project>
Apr 12 16:15:53 user nova-compute[71874]:       </nova:owner>
Apr 12 16:15:53 user nova-compute[71874]:       <nova:ports>
Apr 12 16:15:53 user nova-compute[71874]:         <nova:port uuid="ecba9b76-45d2-49e7-addc-367dc21b38ce">
Apr 12 16:15:53 user nova-compute[71874]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 12 16:15:53 user nova-compute[71874]:         </nova:port>
Apr 12 16:15:53 user nova-compute[71874]:       </nova:ports>
Apr 12 16:15:53 user nova-compute[71874]:     </nova:instance>
Apr 12 16:15:53 user nova-compute[71874]:   </metadata>
Apr 12 16:15:53 user nova-compute[71874]:   <sysinfo type="smbios">
Apr 12 16:15:53 user nova-compute[71874]:     <system>
Apr 12 16:15:53 user nova-compute[71874]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 16:15:53 user nova-compute[71874]:       <entry name="product">OpenStack Nova</entry>
Apr 12 16:15:53 user nova-compute[71874]:       <entry name="version">0.0.0</entry>
Apr 12 16:15:53 user nova-compute[71874]:       <entry name="serial">bef10c89-360e-42d6-aa26-7edf1afca567</entry>
Apr 12 16:15:53 user nova-compute[71874]:       <entry name="uuid">bef10c89-360e-42d6-aa26-7edf1afca567</entry>
Apr 12 16:15:53 user nova-compute[71874]:       <entry name="family">Virtual Machine</entry>
Apr 12 16:15:53 user nova-compute[71874]:     </system>
Apr 12 16:15:53 user nova-compute[71874]:   </sysinfo>
Apr 12 16:15:53 user nova-compute[71874]:   <os>
Apr 12 16:15:53 user nova-compute[71874]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 16:15:53 user nova-compute[71874]:     <boot dev="hd"/>
Apr 12 16:15:53 user nova-compute[71874]:     <smbios mode="sysinfo"/>
Apr 12 16:15:53 user nova-compute[71874]:   </os>
Apr 12 16:15:53 user nova-compute[71874]:   <features>
Apr 12 16:15:53 user nova-compute[71874]:     <acpi/>
Apr 12 16:15:53 user nova-compute[71874]:     <apic/>
Apr 12 16:15:53 user nova-compute[71874]:     <vmcoreinfo/>
Apr 12 16:15:53 user nova-compute[71874]:   </features>
Apr 12 16:15:53 user nova-compute[71874]:   <clock offset="utc">
Apr 12 16:15:53 user nova-compute[71874]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 16:15:53 user nova-compute[71874]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 16:15:53 user nova-compute[71874]:     <timer name="hpet" present="no"/>
Apr 12 16:15:53 user nova-compute[71874]:   </clock>
Apr 12 16:15:53 user nova-compute[71874]:   <cpu mode="custom" match="exact">
Apr 12 16:15:53 user nova-compute[71874]:     <model>Nehalem</model>
Apr 12 16:15:53 user nova-compute[71874]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 16:15:53 user nova-compute[71874]:   </cpu>
Apr 12 16:15:53 user nova-compute[71874]:   <devices>
Apr 12 16:15:53 user nova-compute[71874]:     <disk type="block" device="disk">
Apr 12 16:15:53 user nova-compute[71874]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 16:15:53 user nova-compute[71874]:       <source dev="/dev/sde"/>
Apr 12 16:15:53 user nova-compute[71874]:       <target dev="vda" bus="virtio"/>
Apr 12 16:15:53 user nova-compute[71874]:       <serial>b5a801df-b37e-4132-8465-d4011ca47775</serial>
Apr 12 16:15:53 user nova-compute[71874]:     </disk>
Apr 12 16:15:53 user nova-compute[71874]:     <interface type="ethernet">
Apr 12 16:15:53 user nova-compute[71874]:       <mac address="fa:16:3e:e4:f4:15"/>
Apr 12 16:15:53 user nova-compute[71874]:       <model type="virtio"/>
Apr 12 16:15:53 user nova-compute[71874]:       <mtu size="1442"/>
Apr 12 16:15:53 user nova-compute[71874]:       <target dev="tapecba9b76-45"/>
Apr 12 16:15:53 user nova-compute[71874]:     </interface>
Apr 12 16:15:53 user nova-compute[71874]:     <serial type="pty">
Apr 12 16:15:53 user nova-compute[71874]:       <log file="/opt/stack/data/nova/instances/bef10c89-360e-42d6-aa26-7edf1afca567/console.log" append="off"/>
Apr 12 16:15:53 user nova-compute[71874]:     </serial>
Apr 12 16:15:53 user nova-compute[71874]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 16:15:53 user nova-compute[71874]:     <video>
Apr 12 16:15:53 user nova-compute[71874]:       <model type="virtio"/>
Apr 12 16:15:53 user nova-compute[71874]:     </video>
Apr 12 16:15:53 user nova-compute[71874]:     <rng model="virtio">
Apr 12 16:15:53 user nova-compute[71874]:       <backend model="random">/dev/urandom</backend>
Apr 12 16:15:53 user nova-compute[71874]:     </rng>
Apr 12 16:15:53 user nova-compute[71874]:     <controller type="usb" index="0" model="none"/>
Apr 12 16:15:53 user nova-compute[71874]:     <memballoon model="virtio">
Apr 12 16:15:53 user nova-compute[71874]:       <stats period="10"/>
Apr 12 16:15:53 user nova-compute[71874]:     </memballoon>
Apr 12 16:15:53 user nova-compute[71874]:   </devices>
Apr 12 16:15:53 user nova-compute[71874]: </domain>
Apr 12 16:15:53 user nova-compute[71874]:  {{(pid=71874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 16:15:53 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-876d6daf-1ae8-4c2f-b8bf-34a0a8016fe3 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T16:15:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1742194488',display_name='tempest-ServerActionsTestJSON-server-1742194488',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1742194488',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNmXVADjvoPSh3uGCGCTNS/vcfcDtUjn/vZEaV3bCllfz1ZO8VIgFuZhP+mAsa+G/KA4ubi5U9Vj41YtHGsakdPR5VoByhorvfUv/PIWtER2tn1LWX2mlFyT+T8AEJplPw==',key_name='tempest-keypair-1923467613',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='97ea81bd1962466bbe552424973f71a8',ramdisk_id='',reservation_id='r-kpxobl69',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-631887779',owner_user_name='tempest-ServerActionsTestJSON-631887779-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T16:15:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1a699b3ba8304eadb8a53d465ea340cf',uuid=bef10c89-360e-42d6-aa26-7edf1afca567,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ecba9b76-45d2-49e7-addc-367dc21b38ce", "address": "fa:16:3e:e4:f4:15", "network": {"id": "e6694358-e361-4952-b859-93755c11721e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-667152893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97ea81bd1962466bbe552424973f71a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecba9b76-45", "ovs_interfaceid": "ecba9b76-45d2-49e7-addc-367dc21b38ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 16:15:53 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-876d6daf-1ae8-4c2f-b8bf-34a0a8016fe3 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Converting VIF {"id": "ecba9b76-45d2-49e7-addc-367dc21b38ce", "address": "fa:16:3e:e4:f4:15", "network": {"id": "e6694358-e361-4952-b859-93755c11721e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-667152893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97ea81bd1962466bbe552424973f71a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecba9b76-45", "ovs_interfaceid": "ecba9b76-45d2-49e7-addc-367dc21b38ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:15:53 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-876d6daf-1ae8-4c2f-b8bf-34a0a8016fe3 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:f4:15,bridge_name='br-int',has_traffic_filtering=True,id=ecba9b76-45d2-49e7-addc-367dc21b38ce,network=Network(e6694358-e361-4952-b859-93755c11721e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecba9b76-45') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:15:53 user nova-compute[71874]: DEBUG os_vif [None req-876d6daf-1ae8-4c2f-b8bf-34a0a8016fe3 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:f4:15,bridge_name='br-int',has_traffic_filtering=True,id=ecba9b76-45d2-49e7-addc-367dc21b38ce,network=Network(e6694358-e361-4952-b859-93755c11721e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecba9b76-45') {{(pid=71874) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 16:15:53 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:15:53 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:15:53 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 16:15:53 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:15:53 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapecba9b76-45, may_exist=True) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:15:53 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapecba9b76-45, col_values=(('external_ids', {'iface-id': 'ecba9b76-45d2-49e7-addc-367dc21b38ce', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e4:f4:15', 'vm-uuid': 'bef10c89-360e-42d6-aa26-7edf1afca567'}),)) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:15:53 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:15:53 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:15:53 user nova-compute[71874]: INFO os_vif [None req-876d6daf-1ae8-4c2f-b8bf-34a0a8016fe3 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:f4:15,bridge_name='br-int',has_traffic_filtering=True,id=ecba9b76-45d2-49e7-addc-367dc21b38ce,network=Network(e6694358-e361-4952-b859-93755c11721e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecba9b76-45')
Apr 12 16:15:53 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-876d6daf-1ae8-4c2f-b8bf-34a0a8016fe3 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] No BDM found with device name vda, not building metadata. {{(pid=71874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 16:15:53 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-876d6daf-1ae8-4c2f-b8bf-34a0a8016fe3 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] No VIF found with MAC fa:16:3e:e4:f4:15, not building metadata {{(pid=71874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 16:15:54 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:15:54 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:15:54 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:15:54 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:15:54 user nova-compute[71874]: DEBUG nova.compute.manager [req-01d636f5-85ef-408c-a061-52a1e768cb35 req-01d6f495-7656-4187-86a5-36b2695609a5 service nova] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] Received event network-vif-plugged-ecba9b76-45d2-49e7-addc-367dc21b38ce {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:15:54 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-01d636f5-85ef-408c-a061-52a1e768cb35 req-01d6f495-7656-4187-86a5-36b2695609a5 service nova] Acquiring lock "bef10c89-360e-42d6-aa26-7edf1afca567-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:15:54 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-01d636f5-85ef-408c-a061-52a1e768cb35 req-01d6f495-7656-4187-86a5-36b2695609a5 service nova] Lock "bef10c89-360e-42d6-aa26-7edf1afca567-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:15:54 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-01d636f5-85ef-408c-a061-52a1e768cb35 req-01d6f495-7656-4187-86a5-36b2695609a5 service nova] Lock "bef10c89-360e-42d6-aa26-7edf1afca567-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:15:54 user nova-compute[71874]: DEBUG nova.compute.manager [req-01d636f5-85ef-408c-a061-52a1e768cb35 req-01d6f495-7656-4187-86a5-36b2695609a5 service nova] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] No waiting events found dispatching network-vif-plugged-ecba9b76-45d2-49e7-addc-367dc21b38ce {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:15:54 user nova-compute[71874]: WARNING nova.compute.manager [req-01d636f5-85ef-408c-a061-52a1e768cb35 req-01d6f495-7656-4187-86a5-36b2695609a5 service nova] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] Received unexpected event network-vif-plugged-ecba9b76-45d2-49e7-addc-367dc21b38ce for instance with vm_state building and task_state spawning.
Apr 12 16:15:54 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:15:54 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:15:56 user nova-compute[71874]: DEBUG nova.compute.manager [req-24659cc2-7ba9-4d2c-91d6-7aa0fcf34d0a req-05f92f0c-9b8f-4665-a449-7e9ff655a4d0 service nova] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] Received event network-vif-plugged-ecba9b76-45d2-49e7-addc-367dc21b38ce {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:15:56 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-24659cc2-7ba9-4d2c-91d6-7aa0fcf34d0a req-05f92f0c-9b8f-4665-a449-7e9ff655a4d0 service nova] Acquiring lock "bef10c89-360e-42d6-aa26-7edf1afca567-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:15:56 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-24659cc2-7ba9-4d2c-91d6-7aa0fcf34d0a req-05f92f0c-9b8f-4665-a449-7e9ff655a4d0 service nova] Lock "bef10c89-360e-42d6-aa26-7edf1afca567-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:15:56 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-24659cc2-7ba9-4d2c-91d6-7aa0fcf34d0a req-05f92f0c-9b8f-4665-a449-7e9ff655a4d0 service nova] Lock "bef10c89-360e-42d6-aa26-7edf1afca567-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:15:56 user nova-compute[71874]: DEBUG nova.compute.manager [req-24659cc2-7ba9-4d2c-91d6-7aa0fcf34d0a req-05f92f0c-9b8f-4665-a449-7e9ff655a4d0 service nova] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] No waiting events found dispatching network-vif-plugged-ecba9b76-45d2-49e7-addc-367dc21b38ce {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:15:56 user nova-compute[71874]: WARNING nova.compute.manager [req-24659cc2-7ba9-4d2c-91d6-7aa0fcf34d0a req-05f92f0c-9b8f-4665-a449-7e9ff655a4d0 service nova] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] Received unexpected event network-vif-plugged-ecba9b76-45d2-49e7-addc-367dc21b38ce for instance with vm_state building and task_state spawning.
Apr 12 16:15:57 user nova-compute[71874]: DEBUG nova.virt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Emitting event <LifecycleEvent: 1681316157.0667138, bef10c89-360e-42d6-aa26-7edf1afca567 => Resumed> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:15:57 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] VM Resumed (Lifecycle Event)
Apr 12 16:15:57 user nova-compute[71874]: DEBUG nova.compute.manager [None req-876d6daf-1ae8-4c2f-b8bf-34a0a8016fe3 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] Instance event wait completed in 0 seconds for  {{(pid=71874) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 16:15:57 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-876d6daf-1ae8-4c2f-b8bf-34a0a8016fe3 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] Guest created on hypervisor {{(pid=71874) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 16:15:57 user nova-compute[71874]: INFO nova.virt.libvirt.driver [-] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] Instance spawned successfully.
Apr 12 16:15:57 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-876d6daf-1ae8-4c2f-b8bf-34a0a8016fe3 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 16:15:57 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:15:57 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-876d6daf-1ae8-4c2f-b8bf-34a0a8016fe3 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] Found default for hw_cdrom_bus of ide {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:15:57 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-876d6daf-1ae8-4c2f-b8bf-34a0a8016fe3 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] Found default for hw_disk_bus of virtio {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:15:57 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-876d6daf-1ae8-4c2f-b8bf-34a0a8016fe3 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] Found default for hw_input_bus of None {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:15:57 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-876d6daf-1ae8-4c2f-b8bf-34a0a8016fe3 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] Found default for hw_pointer_model of None {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:15:57 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-876d6daf-1ae8-4c2f-b8bf-34a0a8016fe3 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] Found default for hw_video_model of virtio {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:15:57 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-876d6daf-1ae8-4c2f-b8bf-34a0a8016fe3 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] Found default for hw_vif_model of virtio {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:15:57 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 16:15:57 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 16:15:57 user nova-compute[71874]: DEBUG nova.virt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Emitting event <LifecycleEvent: 1681316157.067893, bef10c89-360e-42d6-aa26-7edf1afca567 => Started> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:15:57 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] VM Started (Lifecycle Event)
Apr 12 16:15:57 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:15:57 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 16:15:57 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 16:15:57 user nova-compute[71874]: INFO nova.compute.manager [None req-876d6daf-1ae8-4c2f-b8bf-34a0a8016fe3 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] Took 5.30 seconds to spawn the instance on the hypervisor.
Apr 12 16:15:57 user nova-compute[71874]: DEBUG nova.compute.manager [None req-876d6daf-1ae8-4c2f-b8bf-34a0a8016fe3 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:15:57 user nova-compute[71874]: INFO nova.compute.manager [None req-876d6daf-1ae8-4c2f-b8bf-34a0a8016fe3 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] Took 10.97 seconds to build instance.
Apr 12 16:15:57 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-876d6daf-1ae8-4c2f-b8bf-34a0a8016fe3 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "bef10c89-360e-42d6-aa26-7edf1afca567" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.079s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:15:58 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:15:58 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:16:03 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:16:03 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:16:05 user nova-compute[71874]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681316150.6875935, 947c2ca9-fd67-4e8d-b0dc-90c5c827a59e => Stopped> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:16:05 user nova-compute[71874]: INFO nova.compute.manager [-] [instance: 947c2ca9-fd67-4e8d-b0dc-90c5c827a59e] VM Stopped (Lifecycle Event)
Apr 12 16:16:05 user nova-compute[71874]: DEBUG nova.compute.manager [None req-0a940af0-703d-4a61-b9d6-15940be58216 None None] [instance: 947c2ca9-fd67-4e8d-b0dc-90c5c827a59e] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:16:08 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:16:08 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:16:08 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-70f5d78a-ec1c-4665-893f-22e9dea0dd10 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Acquiring lock "b4c37cbf-1743-4dd5-97fd-2bb12ebee763" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:16:08 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-70f5d78a-ec1c-4665-893f-22e9dea0dd10 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "b4c37cbf-1743-4dd5-97fd-2bb12ebee763" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:16:08 user nova-compute[71874]: DEBUG nova.objects.instance [None req-70f5d78a-ec1c-4665-893f-22e9dea0dd10 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lazy-loading 'flavor' on Instance uuid b4c37cbf-1743-4dd5-97fd-2bb12ebee763 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:16:08 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-70f5d78a-ec1c-4665-893f-22e9dea0dd10 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "b4c37cbf-1743-4dd5-97fd-2bb12ebee763" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.186s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:16:08 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-70f5d78a-ec1c-4665-893f-22e9dea0dd10 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Acquiring lock "b4c37cbf-1743-4dd5-97fd-2bb12ebee763" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:16:08 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-70f5d78a-ec1c-4665-893f-22e9dea0dd10 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "b4c37cbf-1743-4dd5-97fd-2bb12ebee763" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:16:08 user nova-compute[71874]: INFO nova.compute.manager [None req-70f5d78a-ec1c-4665-893f-22e9dea0dd10 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] Attaching volume 63821959-5dfd-4f66-a6e5-90a20b30efab to /dev/vdb
Apr 12 16:16:09 user nova-compute[71874]: DEBUG os_brick.utils [None req-70f5d78a-ec1c-4665-893f-22e9dea0dd10 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:16:09 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:16:09 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:16:09 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[6da7d7b8-b3c0-4bba-a1c4-294fa3c5da89]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:61a48d4489d2\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:16:09 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:16:09 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:16:09 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[dceee99f-5b65-4ad0-986e-1a036f71b8cd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:16:09 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:16:09 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:16:09 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[24199889-38dc-4b56-96bd-5b229e53f1c1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:16:09 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ae2be28-25e6-4f97-b12c-11434266b97c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:16:09 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-70f5d78a-ec1c-4665-893f-22e9dea0dd10 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Running cmd (subprocess): nvme version {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:16:09 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-70f5d78a-ec1c-4665-893f-22e9dea0dd10 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] 'nvme version' failed. Not Retrying. {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 16:16:09 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.nvmeof [None req-70f5d78a-ec1c-4665-893f-22e9dea0dd10 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] nvme not present on system {{(pid=71874) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 16:16:09 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:16:09 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 16:16:09 user nova-compute[71874]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 16:16:09 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[abbdce8f-492d-47e1-b4eb-c11a4f1fceb7]: (4, '') {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:16:09 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.lightos [None req-70f5d78a-ec1c-4665-893f-22e9dea0dd10 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71874) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 16:16:09 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.lightos [None req-70f5d78a-ec1c-4665-893f-22e9dea0dd10 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71874) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 16:16:09 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.lightos [None req-70f5d78a-ec1c-4665-893f-22e9dea0dd10 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] LIGHTOS: no hostnqn found. {{(pid=71874) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 16:16:09 user nova-compute[71874]: DEBUG os_brick.utils [None req-70f5d78a-ec1c-4665-893f-22e9dea0dd10 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:61a48d4489d2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:16:09 user nova-compute[71874]: DEBUG nova.virt.block_device [None req-70f5d78a-ec1c-4665-893f-22e9dea0dd10 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] Updating existing volume attachment record: ebd3c130-5d4f-45de-b40e-a181823ea342 {{(pid=71874) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 16:16:12 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-0c6e6dc4-cc92-43f0-bcfe-319575f5d37e tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Acquiring lock "afebffae-dbf6-4876-8c9f-0364f0fde49c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:16:12 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-0c6e6dc4-cc92-43f0-bcfe-319575f5d37e tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "afebffae-dbf6-4876-8c9f-0364f0fde49c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:16:12 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-0c6e6dc4-cc92-43f0-bcfe-319575f5d37e tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Acquiring lock "afebffae-dbf6-4876-8c9f-0364f0fde49c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:16:12 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-0c6e6dc4-cc92-43f0-bcfe-319575f5d37e tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "afebffae-dbf6-4876-8c9f-0364f0fde49c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:16:12 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-0c6e6dc4-cc92-43f0-bcfe-319575f5d37e tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "afebffae-dbf6-4876-8c9f-0364f0fde49c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:16:12 user nova-compute[71874]: INFO nova.compute.manager [None req-0c6e6dc4-cc92-43f0-bcfe-319575f5d37e tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] Terminating instance
Apr 12 16:16:12 user nova-compute[71874]: DEBUG nova.compute.manager [None req-0c6e6dc4-cc92-43f0-bcfe-319575f5d37e tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] Start destroying the instance on the hypervisor. {{(pid=71874) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 16:16:12 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-ab3d7d0c-2770-4143-b6ee-b8bafb28b577 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Acquiring lock "4190e244-84b1-47b6-813d-9cadb7c65975" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:16:12 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-ab3d7d0c-2770-4143-b6ee-b8bafb28b577 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "4190e244-84b1-47b6-813d-9cadb7c65975" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:16:12 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:16:12 user nova-compute[71874]: INFO nova.compute.manager [None req-ab3d7d0c-2770-4143-b6ee-b8bafb28b577 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Detaching volume ce38c1b3-35b0-48cc-9b83-e9a676997784
Apr 12 16:16:12 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:16:12 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:16:12 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:16:12 user nova-compute[71874]: INFO nova.virt.block_device [None req-ab3d7d0c-2770-4143-b6ee-b8bafb28b577 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Attempting to driver detach volume ce38c1b3-35b0-48cc-9b83-e9a676997784 from mountpoint /dev/vdb
Apr 12 16:16:12 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-ab3d7d0c-2770-4143-b6ee-b8bafb28b577 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Attempting to detach device vdb from instance 4190e244-84b1-47b6-813d-9cadb7c65975 from the persistent domain config. {{(pid=71874) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 16:16:12 user nova-compute[71874]: DEBUG nova.virt.libvirt.guest [None req-ab3d7d0c-2770-4143-b6ee-b8bafb28b577 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 16:16:12 user nova-compute[71874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 16:16:12 user nova-compute[71874]:   <source dev="/dev/sdc"/>
Apr 12 16:16:12 user nova-compute[71874]:   <target dev="vdb" bus="virtio"/>
Apr 12 16:16:12 user nova-compute[71874]:   <serial>ce38c1b3-35b0-48cc-9b83-e9a676997784</serial>
Apr 12 16:16:12 user nova-compute[71874]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 12 16:16:12 user nova-compute[71874]: </disk>
Apr 12 16:16:12 user nova-compute[71874]:  {{(pid=71874) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 16:16:12 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-ab3d7d0c-2770-4143-b6ee-b8bafb28b577 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Successfully detached device vdb from instance 4190e244-84b1-47b6-813d-9cadb7c65975 from the persistent domain config.
Apr 12 16:16:12 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-ab3d7d0c-2770-4143-b6ee-b8bafb28b577 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4190e244-84b1-47b6-813d-9cadb7c65975 from the live domain config. {{(pid=71874) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 16:16:12 user nova-compute[71874]: DEBUG nova.virt.libvirt.guest [None req-ab3d7d0c-2770-4143-b6ee-b8bafb28b577 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 16:16:12 user nova-compute[71874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 16:16:12 user nova-compute[71874]:   <source dev="/dev/sdc"/>
Apr 12 16:16:12 user nova-compute[71874]:   <target dev="vdb" bus="virtio"/>
Apr 12 16:16:12 user nova-compute[71874]:   <serial>ce38c1b3-35b0-48cc-9b83-e9a676997784</serial>
Apr 12 16:16:12 user nova-compute[71874]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 12 16:16:12 user nova-compute[71874]: </disk>
Apr 12 16:16:12 user nova-compute[71874]:  {{(pid=71874) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 16:16:12 user nova-compute[71874]: DEBUG nova.compute.manager [req-7e437b6e-5515-498e-8162-e88e73a98ade req-c31be11c-7c8d-4b8a-bfab-b29ac38e768c service nova] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] Received event network-vif-unplugged-c4b29e0b-0ad8-4897-acf3-76004ac0338b {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:16:12 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-7e437b6e-5515-498e-8162-e88e73a98ade req-c31be11c-7c8d-4b8a-bfab-b29ac38e768c service nova] Acquiring lock "afebffae-dbf6-4876-8c9f-0364f0fde49c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:16:12 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-7e437b6e-5515-498e-8162-e88e73a98ade req-c31be11c-7c8d-4b8a-bfab-b29ac38e768c service nova] Lock "afebffae-dbf6-4876-8c9f-0364f0fde49c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:16:12 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-7e437b6e-5515-498e-8162-e88e73a98ade req-c31be11c-7c8d-4b8a-bfab-b29ac38e768c service nova] Lock "afebffae-dbf6-4876-8c9f-0364f0fde49c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:16:12 user nova-compute[71874]: DEBUG nova.compute.manager [req-7e437b6e-5515-498e-8162-e88e73a98ade req-c31be11c-7c8d-4b8a-bfab-b29ac38e768c service nova] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] No waiting events found dispatching network-vif-unplugged-c4b29e0b-0ad8-4897-acf3-76004ac0338b {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:16:12 user nova-compute[71874]: DEBUG nova.compute.manager [req-7e437b6e-5515-498e-8162-e88e73a98ade req-c31be11c-7c8d-4b8a-bfab-b29ac38e768c service nova] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] Received event network-vif-unplugged-c4b29e0b-0ad8-4897-acf3-76004ac0338b for instance with task_state deleting. {{(pid=71874) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 16:16:13 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:16:13 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:16:13 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:16:13 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Received event <DeviceRemovedEvent: 1681316173.4516754, 4190e244-84b1-47b6-813d-9cadb7c65975 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71874) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 16:16:13 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-ab3d7d0c-2770-4143-b6ee-b8bafb28b577 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4190e244-84b1-47b6-813d-9cadb7c65975 {{(pid=71874) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 16:16:13 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-ab3d7d0c-2770-4143-b6ee-b8bafb28b577 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Successfully detached device vdb from instance 4190e244-84b1-47b6-813d-9cadb7c65975 from the live domain config.
Apr 12 16:16:13 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab3d7d0c-2770-4143-b6ee-b8bafb28b577 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] calling os-brick to detach iSCSI Volume {{(pid=71874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 16:16:13 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab3d7d0c-2770-4143-b6ee-b8bafb28b577 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3c0216320>, {'target_iqn': 'iqn.2010-10.org.openstack:ce38c1b3-35b0-48cc-9b83-e9a676997784', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'APVXFMTJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:16:13 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-ab3d7d0c-2770-4143-b6ee-b8bafb28b577 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:16:13 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-ab3d7d0c-2770-4143-b6ee-b8bafb28b577 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:16:13 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-ab3d7d0c-2770-4143-b6ee-b8bafb28b577 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:16:13 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:16:13 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.038s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:16:13 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[37f333c5-057c-4e24-b0a8-5660d4625ca3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ce38c1b3-35b0-48cc-9b83-e9a676997784\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c59288c2-ba2b-4a3a-8a0a-a683f07b0bba\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:16:13 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab3d7d0c-2770-4143-b6ee-b8bafb28b577 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 16:16:13 user nova-compute[71874]: No targets found.
Apr 12 16:16:13 user nova-compute[71874]: iSNS:
Apr 12 16:16:13 user nova-compute[71874]: No targets found.
Apr 12 16:16:13 user nova-compute[71874]: STATIC:
Apr 12 16:16:13 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:ce38c1b3-35b0-48cc-9b83-e9a676997784
Apr 12 16:16:13 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:16:13 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:16:13 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304
Apr 12 16:16:13 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:16:13 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:16:13 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:c59288c2-ba2b-4a3a-8a0a-a683f07b0bba
Apr 12 16:16:13 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:16:13 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:16:13 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775
Apr 12 16:16:13 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:16:13 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:16:13 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2
Apr 12 16:16:13 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:16:13 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:16:13 user nova-compute[71874]: FIRMWARE:
Apr 12 16:16:13 user nova-compute[71874]: No targets found.
Apr 12 16:16:13 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:16:13 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab3d7d0c-2770-4143-b6ee-b8bafb28b577 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 16:16:13 user nova-compute[71874]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 16:16:13 user nova-compute[71874]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71874) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 16:16:13 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab3d7d0c-2770-4143-b6ee-b8bafb28b577 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ce38c1b3-35b0-48cc-9b83-e9a676997784', 0)] {{(pid=71874) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 16:16:13 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:16:13 user nova-compute[71874]: INFO nova.virt.libvirt.driver [-] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] Instance destroyed successfully.
Apr 12 16:16:13 user nova-compute[71874]: DEBUG nova.objects.instance [None req-0c6e6dc4-cc92-43f0-bcfe-319575f5d37e tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lazy-loading 'resources' on Instance uuid afebffae-dbf6-4876-8c9f-0364f0fde49c {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:16:13 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:16:13 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[e950d2c7-38bb-4690-aa6f-0f81e054dca6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c59288c2-ba2b-4a3a-8a0a-a683f07b0bba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ce38c1b3-35b0-48cc-9b83-e9a676997784\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:16:13 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:16:13 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-0c6e6dc4-cc92-43f0-bcfe-319575f5d37e tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T15:59:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1230796191',display_name='tempest-ServerRescueNegativeTestJSON-server-1230796191',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1230796191',id=1,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T16:04:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b3fe48a3b7d846a195f1e47cc7f69695',ramdisk_id='',reservation_id='r-fjmy00j3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-984710343',owner_user_name='tempest-ServerRescueNegativeTestJSON-984710343-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T16:06:03Z,user_data=None,user_id='880266e3fa4d4dd889648c10208a1f8e',uuid=afebffae-dbf6-4876-8c9f-0364f0fde49c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c4b29e0b-0ad8-4897-acf3-76004ac0338b", "address": "fa:16:3e:b8:23:a7", "network": {"id": "06fae0be-02dd-4962-a1ac-fd0413772758", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1493924857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3fe48a3b7d846a195f1e47cc7f69695", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4b29e0b-0a", "ovs_interfaceid": "c4b29e0b-0ad8-4897-acf3-76004ac0338b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 16:16:13 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-0c6e6dc4-cc92-43f0-bcfe-319575f5d37e tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Converting VIF {"id": "c4b29e0b-0ad8-4897-acf3-76004ac0338b", "address": "fa:16:3e:b8:23:a7", "network": {"id": "06fae0be-02dd-4962-a1ac-fd0413772758", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1493924857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3fe48a3b7d846a195f1e47cc7f69695", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4b29e0b-0a", "ovs_interfaceid": "c4b29e0b-0ad8-4897-acf3-76004ac0338b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:16:13 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-0c6e6dc4-cc92-43f0-bcfe-319575f5d37e tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b8:23:a7,bridge_name='br-int',has_traffic_filtering=True,id=c4b29e0b-0ad8-4897-acf3-76004ac0338b,network=Network(06fae0be-02dd-4962-a1ac-fd0413772758),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4b29e0b-0a') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:16:13 user nova-compute[71874]: DEBUG os_vif [None req-0c6e6dc4-cc92-43f0-bcfe-319575f5d37e tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b8:23:a7,bridge_name='br-int',has_traffic_filtering=True,id=c4b29e0b-0ad8-4897-acf3-76004ac0338b,network=Network(06fae0be-02dd-4962-a1ac-fd0413772758),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4b29e0b-0a') {{(pid=71874) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 16:16:13 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:16:13 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc4b29e0b-0a, bridge=br-int, if_exists=True) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:16:13 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:16:13 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:16:13 user nova-compute[71874]: INFO os_vif [None req-0c6e6dc4-cc92-43f0-bcfe-319575f5d37e tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b8:23:a7,bridge_name='br-int',has_traffic_filtering=True,id=c4b29e0b-0ad8-4897-acf3-76004ac0338b,network=Network(06fae0be-02dd-4962-a1ac-fd0413772758),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4b29e0b-0a')
Apr 12 16:16:13 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-0c6e6dc4-cc92-43f0-bcfe-319575f5d37e tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] Deleting instance files /opt/stack/data/nova/instances/afebffae-dbf6-4876-8c9f-0364f0fde49c_del
Apr 12 16:16:13 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-0c6e6dc4-cc92-43f0-bcfe-319575f5d37e tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] Deletion of /opt/stack/data/nova/instances/afebffae-dbf6-4876-8c9f-0364f0fde49c_del complete
Apr 12 16:16:13 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:16:13 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff068f72-aa83-4fd3-8c51-2f2cca251359]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce38c1b3-35b0-48cc-9b83-e9a676997784 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c59288c2-ba2b-4a3a-8a0a-a683f07b0bba (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775 (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:16:13 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab3d7d0c-2770-4143-b6ee-b8bafb28b577 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:16:13 user nova-compute[71874]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304 (non-flash)
Apr 12 16:16:13 user nova-compute[71874]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce38c1b3-35b0-48cc-9b83-e9a676997784 (non-flash)
Apr 12 16:16:13 user nova-compute[71874]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c59288c2-ba2b-4a3a-8a0a-a683f07b0bba (non-flash)
Apr 12 16:16:13 user nova-compute[71874]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775 (non-flash)
Apr 12 16:16:13 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:16:13 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab3d7d0c-2770-4143-b6ee-b8bafb28b577 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:16:13 user nova-compute[71874]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304 (non-flash)
Apr 12 16:16:13 user nova-compute[71874]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce38c1b3-35b0-48cc-9b83-e9a676997784 (non-flash)
Apr 12 16:16:13 user nova-compute[71874]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c59288c2-ba2b-4a3a-8a0a-a683f07b0bba (non-flash)
Apr 12 16:16:13 user nova-compute[71874]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775 (non-flash)
Apr 12 16:16:13 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:16:13 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab3d7d0c-2770-4143-b6ee-b8bafb28b577 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc3c02a03a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ce38c1b3-35b0-48cc-9b83-e9a676997784'): ({'sdc'}, set())}) {{(pid=71874) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 16:16:13 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-ab3d7d0c-2770-4143-b6ee-b8bafb28b577 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Removing single pathed devices sdc {{(pid=71874) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 16:16:13 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:16:13 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:16:13 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bc3ea91-9ebf-4449-b6a3-04438bf0d827]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:16:13 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:16:13 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-70f5d78a-ec1c-4665-893f-22e9dea0dd10 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] Calling os-brick to attach iSCSI Volume {{(pid=71874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 16:16:13 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-70f5d78a-ec1c-4665-893f-22e9dea0dd10 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3c0216320>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:63821959-5dfd-4f66-a6e5-90a20b30efab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oVuXPgzQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:16:13 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-70f5d78a-ec1c-4665-893f-22e9dea0dd10 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:16:13 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-70f5d78a-ec1c-4665-893f-22e9dea0dd10 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:16:13 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:16:13 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[cca02f7e-7610-4b44-ab98-d5c2f51fe534]: (4, ('ok\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:16:13 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-ab3d7d0c-2770-4143-b6ee-b8bafb28b577 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Flushing IO for device /dev/sdc {{(pid=71874) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 16:16:13 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:16:13 user nova-compute[71874]: INFO nova.compute.manager [None req-0c6e6dc4-cc92-43f0-bcfe-319575f5d37e tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] Took 1.10 seconds to destroy the instance on the hypervisor.
Apr 12 16:16:13 user nova-compute[71874]: DEBUG oslo.service.loopingcall [None req-0c6e6dc4-cc92-43f0-bcfe-319575f5d37e tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71874) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 16:16:13 user nova-compute[71874]: DEBUG nova.compute.manager [-] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] Deallocating network for instance {{(pid=71874) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 16:16:13 user nova-compute[71874]: DEBUG nova.network.neutron [-] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] deallocate_for_instance() {{(pid=71874) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 16:16:13 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:16:13 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[7553bad8-4f25-43e3-b1a4-e109005ba42c]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:16:13 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-ab3d7d0c-2770-4143-b6ee-b8bafb28b577 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71874) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 16:16:13 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:16:13 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.037s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:16:13 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a60e6ff-808b-4d59-a873-5d50d0f21aef]: (4, ('1', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:16:13 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-ab3d7d0c-2770-4143-b6ee-b8bafb28b577 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71874) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 16:16:13 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-ab3d7d0c-2770-4143-b6ee-b8bafb28b577 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] SCSI volumes sdc have been removed. {{(pid=71874) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 16:16:13 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab3d7d0c-2770-4143-b6ee-b8bafb28b577 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ce38c1b3-35b0-48cc-9b83-e9a676997784')] {{(pid=71874) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 16:16:13 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce38c1b3-35b0-48cc-9b83-e9a676997784 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:16:13 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce38c1b3-35b0-48cc-9b83-e9a676997784 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:16:13 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[02c6797c-074d-414f-846f-78af1cdcb5ad]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:16:13 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab3d7d0c-2770-4143-b6ee-b8bafb28b577 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:16:13 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce38c1b3-35b0-48cc-9b83-e9a676997784 -p 172.16.0.220:3260 --logout {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:16:13 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce38c1b3-35b0-48cc-9b83-e9a676997784 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:16:13 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[95b67f76-b08b-4670-873f-4a795c6c013a]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:ce38c1b3-35b0-48cc-9b83-e9a676997784, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:ce38c1b3-35b0-48cc-9b83-e9a676997784, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:16:13 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab3d7d0c-2770-4143-b6ee-b8bafb28b577 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:ce38c1b3-35b0-48cc-9b83-e9a676997784, portal: 172.16.0.220,3260]
Apr 12 16:16:13 user nova-compute[71874]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:ce38c1b3-35b0-48cc-9b83-e9a676997784, portal: 172.16.0.220,3260] successful.
Apr 12 16:16:13 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:16:13 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce38c1b3-35b0-48cc-9b83-e9a676997784 -p 172.16.0.220:3260 --op delete {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:16:13 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce38c1b3-35b0-48cc-9b83-e9a676997784 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:16:13 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[572e553b-92af-4ddb-b407-35181ff91018]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:16:13 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab3d7d0c-2770-4143-b6ee-b8bafb28b577 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:16:13 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-ab3d7d0c-2770-4143-b6ee-b8bafb28b577 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.415s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:16:13 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab3d7d0c-2770-4143-b6ee-b8bafb28b577 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] <== disconnect_volume: return (416ms) None {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:16:13 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab3d7d0c-2770-4143-b6ee-b8bafb28b577 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Disconnected iSCSI Volume {{(pid=71874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 16:16:13 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-70f5d78a-ec1c-4665-893f-22e9dea0dd10 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.209s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:16:13 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-70f5d78a-ec1c-4665-893f-22e9dea0dd10 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:16:13 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-70f5d78a-ec1c-4665-893f-22e9dea0dd10 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:63821959-5dfd-4f66-a6e5-90a20b30efab" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:16:13 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-70f5d78a-ec1c-4665-893f-22e9dea0dd10 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:63821959-5dfd-4f66-a6e5-90a20b30efab" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:16:13 user nova-compute[71874]: INFO os_brick.initiator.connectors.iscsi [None req-70f5d78a-ec1c-4665-893f-22e9dea0dd10 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 16:16:13 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63821959-5dfd-4f66-a6e5-90a20b30efab -p 172.16.0.220:3260 {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:16:13 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63821959-5dfd-4f66-a6e5-90a20b30efab -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:16:13 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[91bfabc2-8459-492e-9730-811ebf0d464c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:16:13 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-70f5d78a-ec1c-4665-893f-22e9dea0dd10 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 16:16:13 user nova-compute[71874]:  {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:16:13 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63821959-5dfd-4f66-a6e5-90a20b30efab -p 172.16.0.220:3260 --interface default --op new {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:16:13 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63821959-5dfd-4f66-a6e5-90a20b30efab -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:16:13 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbd578b3-5b82-4a2e-a3b2-a3e40a82e12d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:63821959-5dfd-4f66-a6e5-90a20b30efab] added\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:16:13 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-70f5d78a-ec1c-4665-893f-22e9dea0dd10 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:63821959-5dfd-4f66-a6e5-90a20b30efab] added
Apr 12 16:16:13 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:16:13 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63821959-5dfd-4f66-a6e5-90a20b30efab -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:16:13 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63821959-5dfd-4f66-a6e5-90a20b30efab -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:16:13 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a814fd5-04f2-4c13-a7b9-661e284c596f]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:16:13 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-70f5d78a-ec1c-4665-893f-22e9dea0dd10 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:16:13 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63821959-5dfd-4f66-a6e5-90a20b30efab -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:16:13 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63821959-5dfd-4f66-a6e5-90a20b30efab -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:16:13 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ff2840c-cb99-4f61-aaaa-3940fe5e9529]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:16:13 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-70f5d78a-ec1c-4665-893f-22e9dea0dd10 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:16:13 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63821959-5dfd-4f66-a6e5-90a20b30efab -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oVuXPgzQ {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:16:13 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63821959-5dfd-4f66-a6e5-90a20b30efab -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oVuXPgzQ" returned: 0 in 0.018s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:16:13 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[658b1133-3acb-4f86-89ad-b6da6921579d]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:16:13 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-70f5d78a-ec1c-4665-893f-22e9dea0dd10 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oVuXPgzQ'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:16:14 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63821959-5dfd-4f66-a6e5-90a20b30efab -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:16:14 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63821959-5dfd-4f66-a6e5-90a20b30efab -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:16:14 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[44a5b8ea-e0ad-451e-93c0-a6533e9a4cae]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:16:14 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-70f5d78a-ec1c-4665-893f-22e9dea0dd10 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:16:14 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:16:14 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:16:14 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[03561d95-a92a-440a-b620-3aea2b75df01]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c59288c2-ba2b-4a3a-8a0a-a683f07b0bba (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775 (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:16:14 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-70f5d78a-ec1c-4665-893f-22e9dea0dd10 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:16:14 user nova-compute[71874]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304 (non-flash)
Apr 12 16:16:14 user nova-compute[71874]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c59288c2-ba2b-4a3a-8a0a-a683f07b0bba (non-flash)
Apr 12 16:16:14 user nova-compute[71874]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775 (non-flash)
Apr 12 16:16:14 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:16:14 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-70f5d78a-ec1c-4665-893f-22e9dea0dd10 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:16:14 user nova-compute[71874]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304 (non-flash)
Apr 12 16:16:14 user nova-compute[71874]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c59288c2-ba2b-4a3a-8a0a-a683f07b0bba (non-flash)
Apr 12 16:16:14 user nova-compute[71874]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775 (non-flash)
Apr 12 16:16:14 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:16:14 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63821959-5dfd-4f66-a6e5-90a20b30efab -p 172.16.0.220:3260 --login {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:16:14 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63821959-5dfd-4f66-a6e5-90a20b30efab -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:16:14 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bd8cfe8-1880-4622-aab5-e9a457c94e38]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:63821959-5dfd-4f66-a6e5-90a20b30efab, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:63821959-5dfd-4f66-a6e5-90a20b30efab, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:16:14 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-70f5d78a-ec1c-4665-893f-22e9dea0dd10 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:63821959-5dfd-4f66-a6e5-90a20b30efab, portal: 172.16.0.220,3260]
Apr 12 16:16:14 user nova-compute[71874]: Login to [iface: default, target: iqn.2010-10.org.openstack:63821959-5dfd-4f66-a6e5-90a20b30efab, portal: 172.16.0.220,3260] successful.
Apr 12 16:16:14 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:16:14 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63821959-5dfd-4f66-a6e5-90a20b30efab -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:16:14 user nova-compute[71874]: DEBUG nova.network.neutron [-] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] Updating instance_info_cache with network_info: [] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:16:14 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63821959-5dfd-4f66-a6e5-90a20b30efab -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:16:14 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cfe4ecf-afb1-4534-8575-aa5dc1af4fcc]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:16:14 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-70f5d78a-ec1c-4665-893f-22e9dea0dd10 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:16:14 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:16:14 user nova-compute[71874]: DEBUG nova.compute.manager [req-17632465-77ba-4511-b761-bf2c0a288c7f req-3ef791cb-1b4f-4092-9747-501edb61cf93 service nova] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] Received event network-vif-deleted-c4b29e0b-0ad8-4897-acf3-76004ac0338b {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:16:14 user nova-compute[71874]: INFO nova.compute.manager [req-17632465-77ba-4511-b761-bf2c0a288c7f req-3ef791cb-1b4f-4092-9747-501edb61cf93 service nova] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] Neutron deleted interface c4b29e0b-0ad8-4897-acf3-76004ac0338b; detaching it from the instance and deleting it from the info cache
Apr 12 16:16:14 user nova-compute[71874]: DEBUG nova.network.neutron [req-17632465-77ba-4511-b761-bf2c0a288c7f req-3ef791cb-1b4f-4092-9747-501edb61cf93 service nova] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] Updating instance_info_cache with network_info: [] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:16:14 user nova-compute[71874]: INFO nova.compute.manager [-] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] Took 0.49 seconds to deallocate network for instance.
Apr 12 16:16:14 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:16:14 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe5d4a02-c945-4c6e-a6f6-6ea9c3b62b02]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c59288c2-ba2b-4a3a-8a0a-a683f07b0bba (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63821959-5dfd-4f66-a6e5-90a20b30efab (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:16:14 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-70f5d78a-ec1c-4665-893f-22e9dea0dd10 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:16:14 user nova-compute[71874]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304 (non-flash)
Apr 12 16:16:14 user nova-compute[71874]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c59288c2-ba2b-4a3a-8a0a-a683f07b0bba (non-flash)
Apr 12 16:16:14 user nova-compute[71874]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775 (non-flash)
Apr 12 16:16:14 user nova-compute[71874]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63821959-5dfd-4f66-a6e5-90a20b30efab (non-flash)
Apr 12 16:16:14 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:16:14 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-70f5d78a-ec1c-4665-893f-22e9dea0dd10 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:16:14 user nova-compute[71874]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304 (non-flash)
Apr 12 16:16:14 user nova-compute[71874]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c59288c2-ba2b-4a3a-8a0a-a683f07b0bba (non-flash)
Apr 12 16:16:14 user nova-compute[71874]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775 (non-flash)
Apr 12 16:16:14 user nova-compute[71874]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63821959-5dfd-4f66-a6e5-90a20b30efab (non-flash)
Apr 12 16:16:14 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:16:14 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-70f5d78a-ec1c-4665-893f-22e9dea0dd10 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:63821959-5dfd-4f66-a6e5-90a20b30efab" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.312s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:16:14 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-70f5d78a-ec1c-4665-893f-22e9dea0dd10 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Connected to 172.16.0.220:3260 {{(pid=71874) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 16:16:14 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-70f5d78a-ec1c-4665-893f-22e9dea0dd10 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] HCTL ('34', '-', '-', 0) found on session 39 with lun 0 {{(pid=71874) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 16:16:14 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-70f5d78a-ec1c-4665-893f-22e9dea0dd10 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71874) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 16:16:14 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:16:14 user nova-compute[71874]: DEBUG nova.compute.manager [req-17632465-77ba-4511-b761-bf2c0a288c7f req-3ef791cb-1b4f-4092-9747-501edb61cf93 service nova] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] Detach interface failed, port_id=c4b29e0b-0ad8-4897-acf3-76004ac0338b, reason: Instance afebffae-dbf6-4876-8c9f-0364f0fde49c could not be found. {{(pid=71874) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 12 16:16:14 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:16:14 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f3fd55b-fcf9-4b38-a4b4-85f5b3a7b425]: (4, ('- - 0', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:16:14 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-70f5d78a-ec1c-4665-893f-22e9dea0dd10 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Searching for a device in session 39 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71874) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 16:16:14 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-70f5d78a-ec1c-4665-893f-22e9dea0dd10 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:63821959-5dfd-4f66-a6e5-90a20b30efab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oVuXPgzQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71874) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 16:16:14 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-0c6e6dc4-cc92-43f0-bcfe-319575f5d37e tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:16:14 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-0c6e6dc4-cc92-43f0-bcfe-319575f5d37e tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:16:14 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-0c6e6dc4-cc92-43f0-bcfe-319575f5d37e tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Inventory has not changed in ProviderTree for provider: 0e94b4c8-cd49-45e4-9133-d36eb4b2456b {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 16:16:14 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-0c6e6dc4-cc92-43f0-bcfe-319575f5d37e tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Inventory has not changed for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 16:16:14 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-0c6e6dc4-cc92-43f0-bcfe-319575f5d37e tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.380s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:16:14 user nova-compute[71874]: INFO nova.scheduler.client.report [None req-0c6e6dc4-cc92-43f0-bcfe-319575f5d37e tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Deleted allocations for instance afebffae-dbf6-4876-8c9f-0364f0fde49c
Apr 12 16:16:14 user nova-compute[71874]: DEBUG nova.objects.instance [None req-ab3d7d0c-2770-4143-b6ee-b8bafb28b577 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lazy-loading 'flavor' on Instance uuid 4190e244-84b1-47b6-813d-9cadb7c65975 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:16:14 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-ab3d7d0c-2770-4143-b6ee-b8bafb28b577 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "4190e244-84b1-47b6-813d-9cadb7c65975" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.053s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:16:14 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-0c6e6dc4-cc92-43f0-bcfe-319575f5d37e tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "afebffae-dbf6-4876-8c9f-0364f0fde49c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.162s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:16:14 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-363ea77e-658d-4eae-a702-cb55b4eeefe1 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Acquiring lock "4190e244-84b1-47b6-813d-9cadb7c65975" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:16:14 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-363ea77e-658d-4eae-a702-cb55b4eeefe1 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "4190e244-84b1-47b6-813d-9cadb7c65975" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:16:14 user nova-compute[71874]: DEBUG nova.compute.manager [None req-363ea77e-658d-4eae-a702-cb55b4eeefe1 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:16:14 user nova-compute[71874]: DEBUG nova.compute.manager [None req-363ea77e-658d-4eae-a702-cb55b4eeefe1 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=71874) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3323}}
Apr 12 16:16:14 user nova-compute[71874]: DEBUG nova.objects.instance [None req-363ea77e-658d-4eae-a702-cb55b4eeefe1 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lazy-loading 'flavor' on Instance uuid 4190e244-84b1-47b6-813d-9cadb7c65975 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:16:15 user nova-compute[71874]: DEBUG nova.compute.manager [req-2fe33c4b-a526-4217-9ff5-4b2d2facb9a0 req-ad7fe980-ba58-45ac-be87-137b638281b8 service nova] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] Received event network-vif-plugged-c4b29e0b-0ad8-4897-acf3-76004ac0338b {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:16:15 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-2fe33c4b-a526-4217-9ff5-4b2d2facb9a0 req-ad7fe980-ba58-45ac-be87-137b638281b8 service nova] Acquiring lock "afebffae-dbf6-4876-8c9f-0364f0fde49c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:16:15 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-2fe33c4b-a526-4217-9ff5-4b2d2facb9a0 req-ad7fe980-ba58-45ac-be87-137b638281b8 service nova] Lock "afebffae-dbf6-4876-8c9f-0364f0fde49c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:16:15 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-2fe33c4b-a526-4217-9ff5-4b2d2facb9a0 req-ad7fe980-ba58-45ac-be87-137b638281b8 service nova] Lock "afebffae-dbf6-4876-8c9f-0364f0fde49c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:16:15 user nova-compute[71874]: DEBUG nova.compute.manager [req-2fe33c4b-a526-4217-9ff5-4b2d2facb9a0 req-ad7fe980-ba58-45ac-be87-137b638281b8 service nova] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] No waiting events found dispatching network-vif-plugged-c4b29e0b-0ad8-4897-acf3-76004ac0338b {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:16:15 user nova-compute[71874]: WARNING nova.compute.manager [req-2fe33c4b-a526-4217-9ff5-4b2d2facb9a0 req-ad7fe980-ba58-45ac-be87-137b638281b8 service nova] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] Received unexpected event network-vif-plugged-c4b29e0b-0ad8-4897-acf3-76004ac0338b for instance with vm_state deleted and task_state None.
Apr 12 16:16:15 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:16:15 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:16:15 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:16:15 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:16:15 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:16:15 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-70f5d78a-ec1c-4665-893f-22e9dea0dd10 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.347s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:16:15 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-70f5d78a-ec1c-4665-893f-22e9dea0dd10 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] <== connect_volume: return (1557ms) {'type': 'block', 'scsi_wwn': '23137383766326535', 'path': '/dev/sdc'} {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:16:15 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-70f5d78a-ec1c-4665-893f-22e9dea0dd10 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23137383766326535', 'path': '/dev/sdc'} {{(pid=71874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 16:16:15 user nova-compute[71874]: DEBUG nova.objects.instance [None req-70f5d78a-ec1c-4665-893f-22e9dea0dd10 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lazy-loading 'flavor' on Instance uuid b4c37cbf-1743-4dd5-97fd-2bb12ebee763 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:16:15 user nova-compute[71874]: DEBUG nova.virt.libvirt.guest [None req-70f5d78a-ec1c-4665-893f-22e9dea0dd10 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 16:16:15 user nova-compute[71874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 16:16:15 user nova-compute[71874]:   <source dev="/dev/sdc"/>
Apr 12 16:16:15 user nova-compute[71874]:   <target dev="vdb" bus="virtio"/>
Apr 12 16:16:15 user nova-compute[71874]:   <serial>63821959-5dfd-4f66-a6e5-90a20b30efab</serial>
Apr 12 16:16:15 user nova-compute[71874]: </disk>
Apr 12 16:16:15 user nova-compute[71874]:  {{(pid=71874) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 16:16:15 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-70f5d78a-ec1c-4665-893f-22e9dea0dd10 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] No BDM found with device name vda, not building metadata. {{(pid=71874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 16:16:15 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-70f5d78a-ec1c-4665-893f-22e9dea0dd10 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 16:16:15 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-70f5d78a-ec1c-4665-893f-22e9dea0dd10 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] No VIF found with MAC fa:16:3e:59:df:38, not building metadata {{(pid=71874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 16:16:15 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-70f5d78a-ec1c-4665-893f-22e9dea0dd10 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "b4c37cbf-1743-4dd5-97fd-2bb12ebee763" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.866s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:16:15 user nova-compute[71874]: INFO nova.virt.libvirt.driver [-] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Instance destroyed successfully.
Apr 12 16:16:15 user nova-compute[71874]: DEBUG nova.compute.manager [None req-363ea77e-658d-4eae-a702-cb55b4eeefe1 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:16:16 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-363ea77e-658d-4eae-a702-cb55b4eeefe1 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "4190e244-84b1-47b6-813d-9cadb7c65975" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 1.032s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:16:16 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._sync_power_states {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:16:16 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Triggering sync for uuid 608fbea2-b42b-4bb9-94a7-2b76dcdc2001 {{(pid=71874) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 16:16:16 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Triggering sync for uuid f52ee906-c8fd-4cd5-842e-de98a5099c4f {{(pid=71874) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 16:16:16 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Triggering sync for uuid 016ae41d-b098-4126-ace7-3da00b40cb9c {{(pid=71874) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 16:16:16 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Triggering sync for uuid 4190e244-84b1-47b6-813d-9cadb7c65975 {{(pid=71874) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 16:16:16 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Triggering sync for uuid 0e8a977c-aa84-47c4-a838-b5f90820de1a {{(pid=71874) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 16:16:16 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Triggering sync for uuid 1b613235-a905-466f-b9cc-a21a321a6313 {{(pid=71874) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 16:16:16 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Triggering sync for uuid 32471bee-e77e-4a1b-8e00-d938a1373976 {{(pid=71874) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 16:16:16 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Triggering sync for uuid b4c37cbf-1743-4dd5-97fd-2bb12ebee763 {{(pid=71874) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 16:16:16 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Triggering sync for uuid 540a8fd5-8c18-4efe-97d4-9f0942cebcf5 {{(pid=71874) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 16:16:16 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Triggering sync for uuid f42c5cf7-5b0c-4519-a8dc-4022eb20fa59 {{(pid=71874) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 16:16:16 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Triggering sync for uuid bef10c89-360e-42d6-aa26-7edf1afca567 {{(pid=71874) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 16:16:16 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquiring lock "608fbea2-b42b-4bb9-94a7-2b76dcdc2001" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:16:16 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "608fbea2-b42b-4bb9-94a7-2b76dcdc2001" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:16:16 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquiring lock "f52ee906-c8fd-4cd5-842e-de98a5099c4f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:16:16 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "f52ee906-c8fd-4cd5-842e-de98a5099c4f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:16:16 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquiring lock "016ae41d-b098-4126-ace7-3da00b40cb9c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:16:16 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "016ae41d-b098-4126-ace7-3da00b40cb9c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:16:16 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquiring lock "4190e244-84b1-47b6-813d-9cadb7c65975" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:16:16 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "4190e244-84b1-47b6-813d-9cadb7c65975" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:16:16 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquiring lock "0e8a977c-aa84-47c4-a838-b5f90820de1a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:16:16 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "0e8a977c-aa84-47c4-a838-b5f90820de1a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:16:16 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquiring lock "1b613235-a905-466f-b9cc-a21a321a6313" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:16:16 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "1b613235-a905-466f-b9cc-a21a321a6313" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:16:16 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquiring lock "32471bee-e77e-4a1b-8e00-d938a1373976" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:16:16 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "32471bee-e77e-4a1b-8e00-d938a1373976" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:16:16 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquiring lock "b4c37cbf-1743-4dd5-97fd-2bb12ebee763" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:16:16 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "b4c37cbf-1743-4dd5-97fd-2bb12ebee763" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:16:16 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquiring lock "540a8fd5-8c18-4efe-97d4-9f0942cebcf5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:16:16 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "540a8fd5-8c18-4efe-97d4-9f0942cebcf5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:16:16 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquiring lock "f42c5cf7-5b0c-4519-a8dc-4022eb20fa59" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:16:16 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "f42c5cf7-5b0c-4519-a8dc-4022eb20fa59" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:16:16 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquiring lock "bef10c89-360e-42d6-aa26-7edf1afca567" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:16:16 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "bef10c89-360e-42d6-aa26-7edf1afca567" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:16:16 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "608fbea2-b42b-4bb9-94a7-2b76dcdc2001" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.043s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:16:16 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "f52ee906-c8fd-4cd5-842e-de98a5099c4f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.045s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:16:16 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "016ae41d-b098-4126-ace7-3da00b40cb9c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.057s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:16:16 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "0e8a977c-aa84-47c4-a838-b5f90820de1a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.064s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:16:16 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "4190e244-84b1-47b6-813d-9cadb7c65975" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.065s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:16:16 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "540a8fd5-8c18-4efe-97d4-9f0942cebcf5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.063s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:16:16 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "b4c37cbf-1743-4dd5-97fd-2bb12ebee763" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.066s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:16:16 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "1b613235-a905-466f-b9cc-a21a321a6313" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.070s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:16:16 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "32471bee-e77e-4a1b-8e00-d938a1373976" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.072s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:16:16 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "bef10c89-360e-42d6-aa26-7edf1afca567" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.072s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:16:16 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "f42c5cf7-5b0c-4519-a8dc-4022eb20fa59" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.074s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:16:17 user nova-compute[71874]: DEBUG nova.compute.manager [req-f50da646-1268-43aa-9913-5320524beadc req-36efc101-df6b-4428-82af-1dc35c568a18 service nova] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Received event network-vif-unplugged-eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:16:17 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-f50da646-1268-43aa-9913-5320524beadc req-36efc101-df6b-4428-82af-1dc35c568a18 service nova] Acquiring lock "4190e244-84b1-47b6-813d-9cadb7c65975-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:16:17 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-f50da646-1268-43aa-9913-5320524beadc req-36efc101-df6b-4428-82af-1dc35c568a18 service nova] Lock "4190e244-84b1-47b6-813d-9cadb7c65975-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:16:17 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-f50da646-1268-43aa-9913-5320524beadc req-36efc101-df6b-4428-82af-1dc35c568a18 service nova] Lock "4190e244-84b1-47b6-813d-9cadb7c65975-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:16:17 user nova-compute[71874]: DEBUG nova.compute.manager [req-f50da646-1268-43aa-9913-5320524beadc req-36efc101-df6b-4428-82af-1dc35c568a18 service nova] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] No waiting events found dispatching network-vif-unplugged-eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:16:17 user nova-compute[71874]: WARNING nova.compute.manager [req-f50da646-1268-43aa-9913-5320524beadc req-36efc101-df6b-4428-82af-1dc35c568a18 service nova] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Received unexpected event network-vif-unplugged-eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c for instance with vm_state stopped and task_state None.
Apr 12 16:16:17 user nova-compute[71874]: DEBUG nova.compute.manager [req-f50da646-1268-43aa-9913-5320524beadc req-36efc101-df6b-4428-82af-1dc35c568a18 service nova] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Received event network-vif-plugged-eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:16:17 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-f50da646-1268-43aa-9913-5320524beadc req-36efc101-df6b-4428-82af-1dc35c568a18 service nova] Acquiring lock "4190e244-84b1-47b6-813d-9cadb7c65975-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:16:17 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-f50da646-1268-43aa-9913-5320524beadc req-36efc101-df6b-4428-82af-1dc35c568a18 service nova] Lock "4190e244-84b1-47b6-813d-9cadb7c65975-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:16:17 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-f50da646-1268-43aa-9913-5320524beadc req-36efc101-df6b-4428-82af-1dc35c568a18 service nova] Lock "4190e244-84b1-47b6-813d-9cadb7c65975-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:16:17 user nova-compute[71874]: DEBUG nova.compute.manager [req-f50da646-1268-43aa-9913-5320524beadc req-36efc101-df6b-4428-82af-1dc35c568a18 service nova] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] No waiting events found dispatching network-vif-plugged-eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:16:17 user nova-compute[71874]: WARNING nova.compute.manager [req-f50da646-1268-43aa-9913-5320524beadc req-36efc101-df6b-4428-82af-1dc35c568a18 service nova] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Received unexpected event network-vif-plugged-eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c for instance with vm_state stopped and task_state None.
Apr 12 16:16:18 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:16:18 user nova-compute[71874]: DEBUG nova.compute.manager [req-33681586-90be-4b6f-84ac-d73692d9fa40 req-5f3af5f9-bed1-4a2c-8cb2-fb13570a95c4 service nova] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] Received event network-changed-d023dabe-13d5-4bbb-aa87-e9c1f5f1a048 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:16:18 user nova-compute[71874]: DEBUG nova.compute.manager [req-33681586-90be-4b6f-84ac-d73692d9fa40 req-5f3af5f9-bed1-4a2c-8cb2-fb13570a95c4 service nova] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] Refreshing instance network info cache due to event network-changed-d023dabe-13d5-4bbb-aa87-e9c1f5f1a048. {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 16:16:18 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-33681586-90be-4b6f-84ac-d73692d9fa40 req-5f3af5f9-bed1-4a2c-8cb2-fb13570a95c4 service nova] Acquiring lock "refresh_cache-b4c37cbf-1743-4dd5-97fd-2bb12ebee763" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:16:18 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-33681586-90be-4b6f-84ac-d73692d9fa40 req-5f3af5f9-bed1-4a2c-8cb2-fb13570a95c4 service nova] Acquired lock "refresh_cache-b4c37cbf-1743-4dd5-97fd-2bb12ebee763" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:16:18 user nova-compute[71874]: DEBUG nova.network.neutron [req-33681586-90be-4b6f-84ac-d73692d9fa40 req-5f3af5f9-bed1-4a2c-8cb2-fb13570a95c4 service nova] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] Refreshing network info cache for port d023dabe-13d5-4bbb-aa87-e9c1f5f1a048 {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 16:16:18 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:16:18 user nova-compute[71874]: DEBUG nova.network.neutron [req-33681586-90be-4b6f-84ac-d73692d9fa40 req-5f3af5f9-bed1-4a2c-8cb2-fb13570a95c4 service nova] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] Updated VIF entry in instance network info cache for port d023dabe-13d5-4bbb-aa87-e9c1f5f1a048. {{(pid=71874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 16:16:18 user nova-compute[71874]: DEBUG nova.network.neutron [req-33681586-90be-4b6f-84ac-d73692d9fa40 req-5f3af5f9-bed1-4a2c-8cb2-fb13570a95c4 service nova] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] Updating instance_info_cache with network_info: [{"id": "d023dabe-13d5-4bbb-aa87-e9c1f5f1a048", "address": "fa:16:3e:59:df:38", "network": {"id": "58f92787-e3b6-4fd3-bd75-7169f1a36651", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-614349033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "236b9e609eb44071bc88971bff96931e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd023dabe-13", "ovs_interfaceid": "d023dabe-13d5-4bbb-aa87-e9c1f5f1a048", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:16:18 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-33681586-90be-4b6f-84ac-d73692d9fa40 req-5f3af5f9-bed1-4a2c-8cb2-fb13570a95c4 service nova] Releasing lock "refresh_cache-b4c37cbf-1743-4dd5-97fd-2bb12ebee763" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:16:20 user nova-compute[71874]: DEBUG nova.compute.manager [req-c89288e1-ec58-40dd-a238-9ec2255f189a req-344efc60-8ed4-48ca-921d-ac7572d10425 service nova] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] Received event network-changed-d023dabe-13d5-4bbb-aa87-e9c1f5f1a048 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:16:20 user nova-compute[71874]: DEBUG nova.compute.manager [req-c89288e1-ec58-40dd-a238-9ec2255f189a req-344efc60-8ed4-48ca-921d-ac7572d10425 service nova] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] Refreshing instance network info cache due to event network-changed-d023dabe-13d5-4bbb-aa87-e9c1f5f1a048. {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 16:16:20 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-c89288e1-ec58-40dd-a238-9ec2255f189a req-344efc60-8ed4-48ca-921d-ac7572d10425 service nova] Acquiring lock "refresh_cache-b4c37cbf-1743-4dd5-97fd-2bb12ebee763" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:16:20 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-c89288e1-ec58-40dd-a238-9ec2255f189a req-344efc60-8ed4-48ca-921d-ac7572d10425 service nova] Acquired lock "refresh_cache-b4c37cbf-1743-4dd5-97fd-2bb12ebee763" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:16:20 user nova-compute[71874]: DEBUG nova.network.neutron [req-c89288e1-ec58-40dd-a238-9ec2255f189a req-344efc60-8ed4-48ca-921d-ac7572d10425 service nova] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] Refreshing network info cache for port d023dabe-13d5-4bbb-aa87-e9c1f5f1a048 {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 16:16:20 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d0d23f0b-9665-49f1-8bba-3f1cd8219575 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Acquiring lock "b4c37cbf-1743-4dd5-97fd-2bb12ebee763" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:16:20 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d0d23f0b-9665-49f1-8bba-3f1cd8219575 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "b4c37cbf-1743-4dd5-97fd-2bb12ebee763" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:16:20 user nova-compute[71874]: INFO nova.compute.manager [None req-d0d23f0b-9665-49f1-8bba-3f1cd8219575 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] Rebooting instance
Apr 12 16:16:20 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d0d23f0b-9665-49f1-8bba-3f1cd8219575 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Acquiring lock "refresh_cache-b4c37cbf-1743-4dd5-97fd-2bb12ebee763" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:16:21 user nova-compute[71874]: DEBUG nova.network.neutron [req-c89288e1-ec58-40dd-a238-9ec2255f189a req-344efc60-8ed4-48ca-921d-ac7572d10425 service nova] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] Updated VIF entry in instance network info cache for port d023dabe-13d5-4bbb-aa87-e9c1f5f1a048. {{(pid=71874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 16:16:21 user nova-compute[71874]: DEBUG nova.network.neutron [req-c89288e1-ec58-40dd-a238-9ec2255f189a req-344efc60-8ed4-48ca-921d-ac7572d10425 service nova] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] Updating instance_info_cache with network_info: [{"id": "d023dabe-13d5-4bbb-aa87-e9c1f5f1a048", "address": "fa:16:3e:59:df:38", "network": {"id": "58f92787-e3b6-4fd3-bd75-7169f1a36651", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-614349033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "236b9e609eb44071bc88971bff96931e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd023dabe-13", "ovs_interfaceid": "d023dabe-13d5-4bbb-aa87-e9c1f5f1a048", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:16:21 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-c89288e1-ec58-40dd-a238-9ec2255f189a req-344efc60-8ed4-48ca-921d-ac7572d10425 service nova] Releasing lock "refresh_cache-b4c37cbf-1743-4dd5-97fd-2bb12ebee763" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:16:21 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d0d23f0b-9665-49f1-8bba-3f1cd8219575 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Acquired lock "refresh_cache-b4c37cbf-1743-4dd5-97fd-2bb12ebee763" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:16:21 user nova-compute[71874]: DEBUG nova.network.neutron [None req-d0d23f0b-9665-49f1-8bba-3f1cd8219575 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] Building network info cache for instance {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 16:16:21 user nova-compute[71874]: DEBUG nova.network.neutron [None req-d0d23f0b-9665-49f1-8bba-3f1cd8219575 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] Updating instance_info_cache with network_info: [{"id": "d023dabe-13d5-4bbb-aa87-e9c1f5f1a048", "address": "fa:16:3e:59:df:38", "network": {"id": "58f92787-e3b6-4fd3-bd75-7169f1a36651", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-614349033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "236b9e609eb44071bc88971bff96931e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd023dabe-13", "ovs_interfaceid": "d023dabe-13d5-4bbb-aa87-e9c1f5f1a048", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:16:21 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d0d23f0b-9665-49f1-8bba-3f1cd8219575 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Releasing lock "refresh_cache-b4c37cbf-1743-4dd5-97fd-2bb12ebee763" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:16:21 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d0d23f0b-9665-49f1-8bba-3f1cd8219575 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:16:22 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:16:22 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:16:22 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:16:22 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:16:22 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Auditing locally available compute resources for user (node: user) {{(pid=71874) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 16:16:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/540a8fd5-8c18-4efe-97d4-9f0942cebcf5/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:16:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/540a8fd5-8c18-4efe-97d4-9f0942cebcf5/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:16:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/540a8fd5-8c18-4efe-97d4-9f0942cebcf5/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:16:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/540a8fd5-8c18-4efe-97d4-9f0942cebcf5/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:16:23 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:16:23 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 16:16:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32471bee-e77e-4a1b-8e00-d938a1373976/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:16:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32471bee-e77e-4a1b-8e00-d938a1373976/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:16:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32471bee-e77e-4a1b-8e00-d938a1373976/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:16:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32471bee-e77e-4a1b-8e00-d938a1373976/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:16:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4190e244-84b1-47b6-813d-9cadb7c65975/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:16:23 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:16:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4190e244-84b1-47b6-813d-9cadb7c65975/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:16:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4190e244-84b1-47b6-813d-9cadb7c65975/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:16:23 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:16:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4190e244-84b1-47b6-813d-9cadb7c65975/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:16:23 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:16:23 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=71874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 16:16:23 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=71874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 16:16:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/016ae41d-b098-4126-ace7-3da00b40cb9c/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:16:23 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:16:24 user nova-compute[71874]: DEBUG nova.compute.manager [req-2468b7a8-2700-4c78-9454-78207bc73ebd req-af01d0d2-5c4a-48c7-b16a-ae68b3313ab3 service nova] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] Received event network-vif-unplugged-d023dabe-13d5-4bbb-aa87-e9c1f5f1a048 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:16:24 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-2468b7a8-2700-4c78-9454-78207bc73ebd req-af01d0d2-5c4a-48c7-b16a-ae68b3313ab3 service nova] Acquiring lock "b4c37cbf-1743-4dd5-97fd-2bb12ebee763-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:16:24 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-2468b7a8-2700-4c78-9454-78207bc73ebd req-af01d0d2-5c4a-48c7-b16a-ae68b3313ab3 service nova] Lock "b4c37cbf-1743-4dd5-97fd-2bb12ebee763-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:16:24 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-2468b7a8-2700-4c78-9454-78207bc73ebd req-af01d0d2-5c4a-48c7-b16a-ae68b3313ab3 service nova] Lock "b4c37cbf-1743-4dd5-97fd-2bb12ebee763-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:16:24 user nova-compute[71874]: DEBUG nova.compute.manager [req-2468b7a8-2700-4c78-9454-78207bc73ebd req-af01d0d2-5c4a-48c7-b16a-ae68b3313ab3 service nova] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] No waiting events found dispatching network-vif-unplugged-d023dabe-13d5-4bbb-aa87-e9c1f5f1a048 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:16:24 user nova-compute[71874]: WARNING nova.compute.manager [req-2468b7a8-2700-4c78-9454-78207bc73ebd req-af01d0d2-5c4a-48c7-b16a-ae68b3313ab3 service nova] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] Received unexpected event network-vif-unplugged-d023dabe-13d5-4bbb-aa87-e9c1f5f1a048 for instance with vm_state active and task_state reboot_started.
Apr 12 16:16:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/016ae41d-b098-4126-ace7-3da00b40cb9c/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:16:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/016ae41d-b098-4126-ace7-3da00b40cb9c/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:16:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/016ae41d-b098-4126-ace7-3da00b40cb9c/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:16:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/608fbea2-b42b-4bb9-94a7-2b76dcdc2001/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:16:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/608fbea2-b42b-4bb9-94a7-2b76dcdc2001/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:16:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/608fbea2-b42b-4bb9-94a7-2b76dcdc2001/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:16:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/608fbea2-b42b-4bb9-94a7-2b76dcdc2001/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:16:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b613235-a905-466f-b9cc-a21a321a6313/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:16:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b613235-a905-466f-b9cc-a21a321a6313/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:16:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b613235-a905-466f-b9cc-a21a321a6313/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:16:24 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-d0d23f0b-9665-49f1-8bba-3f1cd8219575 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] Instance shutdown successfully.
Apr 12 16:16:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b613235-a905-466f-b9cc-a21a321a6313/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:16:24 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 16:16:26 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:16:26 user nova-compute[71874]: DEBUG nova.compute.manager [req-e096da37-55ad-41fa-bedb-3db1363399ab req-8e6b9d8d-7e91-4eb8-a70a-dc122847fa48 service nova] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] Received event network-vif-plugged-d023dabe-13d5-4bbb-aa87-e9c1f5f1a048 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:16:26 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-e096da37-55ad-41fa-bedb-3db1363399ab req-8e6b9d8d-7e91-4eb8-a70a-dc122847fa48 service nova] Acquiring lock "b4c37cbf-1743-4dd5-97fd-2bb12ebee763-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:16:26 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-e096da37-55ad-41fa-bedb-3db1363399ab req-8e6b9d8d-7e91-4eb8-a70a-dc122847fa48 service nova] Lock "b4c37cbf-1743-4dd5-97fd-2bb12ebee763-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:16:26 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-e096da37-55ad-41fa-bedb-3db1363399ab req-8e6b9d8d-7e91-4eb8-a70a-dc122847fa48 service nova] Lock "b4c37cbf-1743-4dd5-97fd-2bb12ebee763-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:16:26 user nova-compute[71874]: DEBUG nova.compute.manager [req-e096da37-55ad-41fa-bedb-3db1363399ab req-8e6b9d8d-7e91-4eb8-a70a-dc122847fa48 service nova] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] No waiting events found dispatching network-vif-plugged-d023dabe-13d5-4bbb-aa87-e9c1f5f1a048 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:16:26 user nova-compute[71874]: WARNING nova.compute.manager [req-e096da37-55ad-41fa-bedb-3db1363399ab req-8e6b9d8d-7e91-4eb8-a70a-dc122847fa48 service nova] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] Received unexpected event network-vif-plugged-d023dabe-13d5-4bbb-aa87-e9c1f5f1a048 for instance with vm_state active and task_state reboot_started.
Apr 12 16:16:26 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:16:26 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4c37cbf-1743-4dd5-97fd-2bb12ebee763/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:16:26 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4c37cbf-1743-4dd5-97fd-2bb12ebee763/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:16:26 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4c37cbf-1743-4dd5-97fd-2bb12ebee763/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:16:26 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:16:26 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:16:26 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:16:26 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4c37cbf-1743-4dd5-97fd-2bb12ebee763/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:16:26 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 16:16:26 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:16:26 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:16:28 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:16:28 user nova-compute[71874]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681316173.4680884, afebffae-dbf6-4876-8c9f-0364f0fde49c => Stopped> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:16:28 user nova-compute[71874]: INFO nova.compute.manager [-] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] VM Stopped (Lifecycle Event)
Apr 12 16:16:28 user nova-compute[71874]: DEBUG nova.virt.libvirt.host [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Removed pending event for b4c37cbf-1743-4dd5-97fd-2bb12ebee763 due to event {{(pid=71874) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 12 16:16:28 user nova-compute[71874]: DEBUG nova.virt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Emitting event <LifecycleEvent: 1681316188.588457, b4c37cbf-1743-4dd5-97fd-2bb12ebee763 => Resumed> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:16:28 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] VM Resumed (Lifecycle Event)
Apr 12 16:16:28 user nova-compute[71874]: DEBUG nova.compute.manager [req-6e8872c6-d625-426b-90be-cfd87e69d870 req-3d97afe9-0c3c-4564-8098-007382089db8 service nova] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] Received event network-vif-plugged-d023dabe-13d5-4bbb-aa87-e9c1f5f1a048 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:16:28 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-6e8872c6-d625-426b-90be-cfd87e69d870 req-3d97afe9-0c3c-4564-8098-007382089db8 service nova] Acquiring lock "b4c37cbf-1743-4dd5-97fd-2bb12ebee763-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:16:28 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-6e8872c6-d625-426b-90be-cfd87e69d870 req-3d97afe9-0c3c-4564-8098-007382089db8 service nova] Lock "b4c37cbf-1743-4dd5-97fd-2bb12ebee763-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:16:28 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-6e8872c6-d625-426b-90be-cfd87e69d870 req-3d97afe9-0c3c-4564-8098-007382089db8 service nova] Lock "b4c37cbf-1743-4dd5-97fd-2bb12ebee763-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:16:28 user nova-compute[71874]: DEBUG nova.compute.manager [req-6e8872c6-d625-426b-90be-cfd87e69d870 req-3d97afe9-0c3c-4564-8098-007382089db8 service nova] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] No waiting events found dispatching network-vif-plugged-d023dabe-13d5-4bbb-aa87-e9c1f5f1a048 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:16:28 user nova-compute[71874]: WARNING nova.compute.manager [req-6e8872c6-d625-426b-90be-cfd87e69d870 req-3d97afe9-0c3c-4564-8098-007382089db8 service nova] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] Received unexpected event network-vif-plugged-d023dabe-13d5-4bbb-aa87-e9c1f5f1a048 for instance with vm_state active and task_state reboot_started.
Apr 12 16:16:28 user nova-compute[71874]: DEBUG nova.compute.manager [req-6e8872c6-d625-426b-90be-cfd87e69d870 req-3d97afe9-0c3c-4564-8098-007382089db8 service nova] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] Received event network-vif-plugged-d023dabe-13d5-4bbb-aa87-e9c1f5f1a048 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:16:28 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-6e8872c6-d625-426b-90be-cfd87e69d870 req-3d97afe9-0c3c-4564-8098-007382089db8 service nova] Acquiring lock "b4c37cbf-1743-4dd5-97fd-2bb12ebee763-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:16:28 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-6e8872c6-d625-426b-90be-cfd87e69d870 req-3d97afe9-0c3c-4564-8098-007382089db8 service nova] Lock "b4c37cbf-1743-4dd5-97fd-2bb12ebee763-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:16:28 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-6e8872c6-d625-426b-90be-cfd87e69d870 req-3d97afe9-0c3c-4564-8098-007382089db8 service nova] Lock "b4c37cbf-1743-4dd5-97fd-2bb12ebee763-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:16:28 user nova-compute[71874]: DEBUG nova.compute.manager [req-6e8872c6-d625-426b-90be-cfd87e69d870 req-3d97afe9-0c3c-4564-8098-007382089db8 service nova] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] No waiting events found dispatching network-vif-plugged-d023dabe-13d5-4bbb-aa87-e9c1f5f1a048 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:16:28 user nova-compute[71874]: WARNING nova.compute.manager [req-6e8872c6-d625-426b-90be-cfd87e69d870 req-3d97afe9-0c3c-4564-8098-007382089db8 service nova] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] Received unexpected event network-vif-plugged-d023dabe-13d5-4bbb-aa87-e9c1f5f1a048 for instance with vm_state active and task_state reboot_started.
Apr 12 16:16:28 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:16:28 user nova-compute[71874]: DEBUG nova.compute.manager [None req-2a43a920-3309-4b09-b1f6-c90e77443071 None None] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:16:28 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-f0ca9461-f152-4583-a736-665781685ba3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Acquiring lock "0e8a977c-aa84-47c4-a838-b5f90820de1a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:16:28 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-f0ca9461-f152-4583-a736-665781685ba3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "0e8a977c-aa84-47c4-a838-b5f90820de1a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:16:28 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-f0ca9461-f152-4583-a736-665781685ba3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Acquiring lock "0e8a977c-aa84-47c4-a838-b5f90820de1a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:16:28 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-f0ca9461-f152-4583-a736-665781685ba3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "0e8a977c-aa84-47c4-a838-b5f90820de1a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:16:28 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-f0ca9461-f152-4583-a736-665781685ba3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "0e8a977c-aa84-47c4-a838-b5f90820de1a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:16:28 user nova-compute[71874]: INFO nova.compute.manager [None req-f0ca9461-f152-4583-a736-665781685ba3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 0e8a977c-aa84-47c4-a838-b5f90820de1a] Terminating instance
Apr 12 16:16:28 user nova-compute[71874]: DEBUG nova.compute.manager [None req-f0ca9461-f152-4583-a736-665781685ba3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 0e8a977c-aa84-47c4-a838-b5f90820de1a] Start destroying the instance on the hypervisor. {{(pid=71874) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 16:16:28 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=71874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 16:16:28 user nova-compute[71874]: INFO nova.virt.libvirt.driver [-] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] Instance running successfully.
Apr 12 16:16:28 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:16:28 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:16:28 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Hypervisor/Node resource view: name=user free_ram=7620MB free_disk=25.76641082763672GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71874) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 16:16:28 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:16:29 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:16:29 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-d0d23f0b-9665-49f1-8bba-3f1cd8219575 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] Instance soft rebooted successfully.
Apr 12 16:16:29 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d0d23f0b-9665-49f1-8bba-3f1cd8219575 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:16:29 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] During sync_power_state the instance has a pending task (reboot_started). Skip.
Apr 12 16:16:29 user nova-compute[71874]: DEBUG nova.virt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Emitting event <LifecycleEvent: 1681316188.5892885, b4c37cbf-1743-4dd5-97fd-2bb12ebee763 => Started> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:16:29 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] VM Started (Lifecycle Event)
Apr 12 16:16:29 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:16:29 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=71874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 16:16:29 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d0d23f0b-9665-49f1-8bba-3f1cd8219575 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "b4c37cbf-1743-4dd5-97fd-2bb12ebee763" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.210s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:16:29 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:16:29 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 608fbea2-b42b-4bb9-94a7-2b76dcdc2001 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:16:29 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance f52ee906-c8fd-4cd5-842e-de98a5099c4f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:16:29 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 016ae41d-b098-4126-ace7-3da00b40cb9c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:16:29 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 4190e244-84b1-47b6-813d-9cadb7c65975 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:16:29 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 0e8a977c-aa84-47c4-a838-b5f90820de1a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:16:29 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 1b613235-a905-466f-b9cc-a21a321a6313 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:16:29 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 32471bee-e77e-4a1b-8e00-d938a1373976 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:16:29 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance b4c37cbf-1743-4dd5-97fd-2bb12ebee763 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:16:29 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 540a8fd5-8c18-4efe-97d4-9f0942cebcf5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:16:29 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance f42c5cf7-5b0c-4519-a8dc-4022eb20fa59 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:16:29 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance bef10c89-360e-42d6-aa26-7edf1afca567 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:16:29 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=71874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 16:16:29 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Final resource view: name=user phys_ram=16023MB used_ram=1920MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=71874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 16:16:29 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:16:29 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:16:29 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Inventory has not changed in ProviderTree for provider: 0e94b4c8-cd49-45e4-9133-d36eb4b2456b {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 16:16:29 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Inventory has not changed for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 16:16:29 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Compute_service record updated for user:user {{(pid=71874) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 16:16:29 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.548s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:16:29 user nova-compute[71874]: INFO nova.virt.libvirt.driver [-] [instance: 0e8a977c-aa84-47c4-a838-b5f90820de1a] Instance destroyed successfully.
Apr 12 16:16:29 user nova-compute[71874]: DEBUG nova.objects.instance [None req-f0ca9461-f152-4583-a736-665781685ba3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lazy-loading 'resources' on Instance uuid 0e8a977c-aa84-47c4-a838-b5f90820de1a {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:16:29 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-f0ca9461-f152-4583-a736-665781685ba3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T16:10:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1308581862',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1308581862',id=31,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T16:12:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9210f81232304e179d3e09914a492442',ramdisk_id='',reservation_id='r-ji74zs90',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1443944578',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T16:14:42Z,user_data=None,user_id='73f9fa5bc22a4824b3cdcb8cf7bb380c',uuid=0e8a977c-aa84-47c4-a838-b5f90820de1a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "40e16d3f-2e2e-45df-be16-ef3622bfde2e", "address": "fa:16:3e:4d:9c:b1", "network": {"id": "b36306e0-04c5-4b1b-8022-05ff121c4e43", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1503204786-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9210f81232304e179d3e09914a492442", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40e16d3f-2e", "ovs_interfaceid": "40e16d3f-2e2e-45df-be16-ef3622bfde2e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 16:16:29 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-f0ca9461-f152-4583-a736-665781685ba3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Converting VIF {"id": "40e16d3f-2e2e-45df-be16-ef3622bfde2e", "address": "fa:16:3e:4d:9c:b1", "network": {"id": "b36306e0-04c5-4b1b-8022-05ff121c4e43", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1503204786-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9210f81232304e179d3e09914a492442", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40e16d3f-2e", "ovs_interfaceid": "40e16d3f-2e2e-45df-be16-ef3622bfde2e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:16:29 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-f0ca9461-f152-4583-a736-665781685ba3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4d:9c:b1,bridge_name='br-int',has_traffic_filtering=True,id=40e16d3f-2e2e-45df-be16-ef3622bfde2e,network=Network(b36306e0-04c5-4b1b-8022-05ff121c4e43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40e16d3f-2e') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:16:29 user nova-compute[71874]: DEBUG os_vif [None req-f0ca9461-f152-4583-a736-665781685ba3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4d:9c:b1,bridge_name='br-int',has_traffic_filtering=True,id=40e16d3f-2e2e-45df-be16-ef3622bfde2e,network=Network(b36306e0-04c5-4b1b-8022-05ff121c4e43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40e16d3f-2e') {{(pid=71874) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 16:16:29 user nova-compute[71874]: DEBUG nova.compute.manager [req-4459af7e-357e-4fbf-a66c-8aa7de8fc797 req-362ba96e-45f1-4649-9091-3f2f02d07098 service nova] [instance: 0e8a977c-aa84-47c4-a838-b5f90820de1a] Received event network-vif-unplugged-40e16d3f-2e2e-45df-be16-ef3622bfde2e {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:16:29 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-4459af7e-357e-4fbf-a66c-8aa7de8fc797 req-362ba96e-45f1-4649-9091-3f2f02d07098 service nova] Acquiring lock "0e8a977c-aa84-47c4-a838-b5f90820de1a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:16:29 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-4459af7e-357e-4fbf-a66c-8aa7de8fc797 req-362ba96e-45f1-4649-9091-3f2f02d07098 service nova] Lock "0e8a977c-aa84-47c4-a838-b5f90820de1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:16:29 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-4459af7e-357e-4fbf-a66c-8aa7de8fc797 req-362ba96e-45f1-4649-9091-3f2f02d07098 service nova] Lock "0e8a977c-aa84-47c4-a838-b5f90820de1a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:16:29 user nova-compute[71874]: DEBUG nova.compute.manager [req-4459af7e-357e-4fbf-a66c-8aa7de8fc797 req-362ba96e-45f1-4649-9091-3f2f02d07098 service nova] [instance: 0e8a977c-aa84-47c4-a838-b5f90820de1a] No waiting events found dispatching network-vif-unplugged-40e16d3f-2e2e-45df-be16-ef3622bfde2e {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:16:29 user nova-compute[71874]: DEBUG nova.compute.manager [req-4459af7e-357e-4fbf-a66c-8aa7de8fc797 req-362ba96e-45f1-4649-9091-3f2f02d07098 service nova] [instance: 0e8a977c-aa84-47c4-a838-b5f90820de1a] Received event network-vif-unplugged-40e16d3f-2e2e-45df-be16-ef3622bfde2e for instance with task_state deleting. {{(pid=71874) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 16:16:29 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:16:29 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap40e16d3f-2e, bridge=br-int, if_exists=True) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:16:29 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:16:29 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:16:29 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:16:29 user nova-compute[71874]: INFO os_vif [None req-f0ca9461-f152-4583-a736-665781685ba3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4d:9c:b1,bridge_name='br-int',has_traffic_filtering=True,id=40e16d3f-2e2e-45df-be16-ef3622bfde2e,network=Network(b36306e0-04c5-4b1b-8022-05ff121c4e43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40e16d3f-2e')
Apr 12 16:16:29 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0ca9461-f152-4583-a736-665781685ba3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 0e8a977c-aa84-47c4-a838-b5f90820de1a] calling os-brick to detach iSCSI Volume {{(pid=71874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 16:16:29 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0ca9461-f152-4583-a736-665781685ba3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3c0216320>, {'target_iqn': 'iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IwmgRBMr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:16:29 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-f0ca9461-f152-4583-a736-665781685ba3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:16:29 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-f0ca9461-f152-4583-a736-665781685ba3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:16:29 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-f0ca9461-f152-4583-a736-665781685ba3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:16:29 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:16:29 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:16:29 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[dba973b1-b624-4716-9c86-b97402c69c49]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:63821959-5dfd-4f66-a6e5-90a20b30efab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c59288c2-ba2b-4a3a-8a0a-a683f07b0bba\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:16:29 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0ca9461-f152-4583-a736-665781685ba3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 16:16:29 user nova-compute[71874]: No targets found.
Apr 12 16:16:29 user nova-compute[71874]: iSNS:
Apr 12 16:16:29 user nova-compute[71874]: No targets found.
Apr 12 16:16:29 user nova-compute[71874]: STATIC:
Apr 12 16:16:29 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:63821959-5dfd-4f66-a6e5-90a20b30efab
Apr 12 16:16:29 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:16:29 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:16:29 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304
Apr 12 16:16:29 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:16:29 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:16:29 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:c59288c2-ba2b-4a3a-8a0a-a683f07b0bba
Apr 12 16:16:29 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:16:29 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:16:29 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775
Apr 12 16:16:29 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:16:29 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:16:29 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2
Apr 12 16:16:29 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:16:29 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:16:29 user nova-compute[71874]: FIRMWARE:
Apr 12 16:16:29 user nova-compute[71874]: No targets found.
Apr 12 16:16:29 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:16:29 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0ca9461-f152-4583-a736-665781685ba3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 16:16:29 user nova-compute[71874]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 16:16:29 user nova-compute[71874]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71874) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 16:16:29 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0ca9461-f152-4583-a736-665781685ba3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304', 0)] {{(pid=71874) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 16:16:29 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:16:29 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:16:29 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3477a44-27bd-42e9-ab9b-80487e1181a1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:63821959-5dfd-4f66-a6e5-90a20b30efab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c59288c2-ba2b-4a3a-8a0a-a683f07b0bba\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:16:29 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:16:29 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:16:29 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[5db09ffa-7ac5-45a4-b88a-9c4248b404af]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c59288c2-ba2b-4a3a-8a0a-a683f07b0bba (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63821959-5dfd-4f66-a6e5-90a20b30efab (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:16:29 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0ca9461-f152-4583-a736-665781685ba3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:16:29 user nova-compute[71874]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304 (non-flash)
Apr 12 16:16:29 user nova-compute[71874]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c59288c2-ba2b-4a3a-8a0a-a683f07b0bba (non-flash)
Apr 12 16:16:29 user nova-compute[71874]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775 (non-flash)
Apr 12 16:16:29 user nova-compute[71874]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63821959-5dfd-4f66-a6e5-90a20b30efab (non-flash)
Apr 12 16:16:29 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:16:29 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0ca9461-f152-4583-a736-665781685ba3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:16:29 user nova-compute[71874]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304 (non-flash)
Apr 12 16:16:29 user nova-compute[71874]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c59288c2-ba2b-4a3a-8a0a-a683f07b0bba (non-flash)
Apr 12 16:16:29 user nova-compute[71874]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775 (non-flash)
Apr 12 16:16:29 user nova-compute[71874]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63821959-5dfd-4f66-a6e5-90a20b30efab (non-flash)
Apr 12 16:16:29 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:16:29 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0ca9461-f152-4583-a736-665781685ba3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc3c07cb400>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304'): ({'sdf'}, set())}) {{(pid=71874) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 16:16:29 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-f0ca9461-f152-4583-a736-665781685ba3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Removing single pathed devices sdf {{(pid=71874) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 16:16:29 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:16:29 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:16:29 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[73f5f2d4-349f-487e-8a12-56a60012eaea]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:16:29 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:16:29 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.025s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:16:29 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aef363a-eb29-4f5d-8723-299244d2985a]: (4, ('ok\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:16:29 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-f0ca9461-f152-4583-a736-665781685ba3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Flushing IO for device /dev/sdf {{(pid=71874) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 16:16:29 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:16:29 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:16:29 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5192f1b-5a49-4e8d-bf2e-0a0209a6f8eb]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:16:29 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-f0ca9461-f152-4583-a736-665781685ba3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=71874) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 16:16:29 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:16:30 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.060s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:16:30 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ef5cd6d-9a87-4167-8077-486253efc218]: (4, ('1', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:16:30 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-f0ca9461-f152-4583-a736-665781685ba3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=71874) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 16:16:30 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-f0ca9461-f152-4583-a736-665781685ba3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] SCSI volumes sdf have been removed. {{(pid=71874) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 16:16:30 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0ca9461-f152-4583-a736-665781685ba3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304')] {{(pid=71874) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 16:16:30 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:16:30 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:16:30 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ad777ef-9fbd-4a8b-9843-7ef3acf21a35]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:16:30 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0ca9461-f152-4583-a736-665781685ba3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:16:30 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304 -p 172.16.0.220:3260 --logout {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:16:30 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:16:30 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[a501e2a7-4b9b-4369-b348-7b27a15f17c7]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:16:30 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0ca9461-f152-4583-a736-665781685ba3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304, portal: 172.16.0.220,3260]
Apr 12 16:16:30 user nova-compute[71874]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304, portal: 172.16.0.220,3260] successful.
Apr 12 16:16:30 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:16:30 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304 -p 172.16.0.220:3260 --op delete {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:16:30 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c31b819-b8c1-4c22-b9c6-d276f2c03304 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:16:30 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1901925-9649-47ce-ae8e-fde4c3cc9788]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:16:30 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0ca9461-f152-4583-a736-665781685ba3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:16:30 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-f0ca9461-f152-4583-a736-665781685ba3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.366s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:16:30 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0ca9461-f152-4583-a736-665781685ba3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] <== disconnect_volume: return (367ms) None {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:16:30 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0ca9461-f152-4583-a736-665781685ba3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 0e8a977c-aa84-47c4-a838-b5f90820de1a] Disconnected iSCSI Volume {{(pid=71874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 16:16:30 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-f0ca9461-f152-4583-a736-665781685ba3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 0e8a977c-aa84-47c4-a838-b5f90820de1a] Deleting instance files /opt/stack/data/nova/instances/0e8a977c-aa84-47c4-a838-b5f90820de1a_del
Apr 12 16:16:30 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-f0ca9461-f152-4583-a736-665781685ba3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 0e8a977c-aa84-47c4-a838-b5f90820de1a] Deletion of /opt/stack/data/nova/instances/0e8a977c-aa84-47c4-a838-b5f90820de1a_del complete
Apr 12 16:16:30 user nova-compute[71874]: INFO nova.compute.manager [None req-f0ca9461-f152-4583-a736-665781685ba3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 0e8a977c-aa84-47c4-a838-b5f90820de1a] Took 1.28 seconds to destroy the instance on the hypervisor.
Apr 12 16:16:30 user nova-compute[71874]: DEBUG oslo.service.loopingcall [None req-f0ca9461-f152-4583-a736-665781685ba3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71874) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 16:16:30 user nova-compute[71874]: DEBUG nova.compute.manager [-] [instance: 0e8a977c-aa84-47c4-a838-b5f90820de1a] Deallocating network for instance {{(pid=71874) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 16:16:30 user nova-compute[71874]: DEBUG nova.network.neutron [-] [instance: 0e8a977c-aa84-47c4-a838-b5f90820de1a] deallocate_for_instance() {{(pid=71874) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 16:16:30 user nova-compute[71874]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681316175.9507325, 4190e244-84b1-47b6-813d-9cadb7c65975 => Stopped> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:16:30 user nova-compute[71874]: INFO nova.compute.manager [-] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] VM Stopped (Lifecycle Event)
Apr 12 16:16:30 user nova-compute[71874]: DEBUG nova.compute.manager [None req-b42d9979-5952-4951-8fed-d3070bff9ce7 None None] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:16:30 user nova-compute[71874]: DEBUG nova.compute.manager [None req-b42d9979-5952-4951-8fed-d3070bff9ce7 None None] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=71874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 16:16:31 user nova-compute[71874]: DEBUG nova.network.neutron [-] [instance: 0e8a977c-aa84-47c4-a838-b5f90820de1a] Updating instance_info_cache with network_info: [] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:16:31 user nova-compute[71874]: INFO nova.compute.manager [-] [instance: 0e8a977c-aa84-47c4-a838-b5f90820de1a] Took 0.87 seconds to deallocate network for instance.
Apr 12 16:16:31 user nova-compute[71874]: DEBUG nova.compute.manager [req-53b0cac6-162c-4f10-a362-8b20700e462c req-d12de7c9-980a-429a-b7f3-270735bb267d service nova] [instance: 0e8a977c-aa84-47c4-a838-b5f90820de1a] Received event network-vif-deleted-40e16d3f-2e2e-45df-be16-ef3622bfde2e {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:16:31 user nova-compute[71874]: DEBUG nova.compute.manager [req-a87c55ff-cca7-4740-82e7-4a4e92eec802 req-b0dce4e7-a1a7-4a4a-a255-744b006896a2 service nova] [instance: 0e8a977c-aa84-47c4-a838-b5f90820de1a] Received event network-vif-plugged-40e16d3f-2e2e-45df-be16-ef3622bfde2e {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:16:31 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-a87c55ff-cca7-4740-82e7-4a4e92eec802 req-b0dce4e7-a1a7-4a4a-a255-744b006896a2 service nova] Acquiring lock "0e8a977c-aa84-47c4-a838-b5f90820de1a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:16:31 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-a87c55ff-cca7-4740-82e7-4a4e92eec802 req-b0dce4e7-a1a7-4a4a-a255-744b006896a2 service nova] Lock "0e8a977c-aa84-47c4-a838-b5f90820de1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:16:31 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-a87c55ff-cca7-4740-82e7-4a4e92eec802 req-b0dce4e7-a1a7-4a4a-a255-744b006896a2 service nova] Lock "0e8a977c-aa84-47c4-a838-b5f90820de1a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:16:31 user nova-compute[71874]: DEBUG nova.compute.manager [req-a87c55ff-cca7-4740-82e7-4a4e92eec802 req-b0dce4e7-a1a7-4a4a-a255-744b006896a2 service nova] [instance: 0e8a977c-aa84-47c4-a838-b5f90820de1a] No waiting events found dispatching network-vif-plugged-40e16d3f-2e2e-45df-be16-ef3622bfde2e {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:16:31 user nova-compute[71874]: WARNING nova.compute.manager [req-a87c55ff-cca7-4740-82e7-4a4e92eec802 req-b0dce4e7-a1a7-4a4a-a255-744b006896a2 service nova] [instance: 0e8a977c-aa84-47c4-a838-b5f90820de1a] Received unexpected event network-vif-plugged-40e16d3f-2e2e-45df-be16-ef3622bfde2e for instance with vm_state active and task_state deleting.
Apr 12 16:16:32 user nova-compute[71874]: INFO nova.compute.manager [None req-f0ca9461-f152-4583-a736-665781685ba3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 0e8a977c-aa84-47c4-a838-b5f90820de1a] Took 1.05 seconds to detach 1 volumes for instance.
Apr 12 16:16:32 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-f0ca9461-f152-4583-a736-665781685ba3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:16:32 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-f0ca9461-f152-4583-a736-665781685ba3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:16:32 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-f0ca9461-f152-4583-a736-665781685ba3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Inventory has not changed in ProviderTree for provider: 0e94b4c8-cd49-45e4-9133-d36eb4b2456b {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 16:16:32 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-f0ca9461-f152-4583-a736-665781685ba3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Inventory has not changed for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 16:16:32 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-f0ca9461-f152-4583-a736-665781685ba3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.325s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:16:32 user nova-compute[71874]: INFO nova.scheduler.client.report [None req-f0ca9461-f152-4583-a736-665781685ba3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Deleted allocations for instance 0e8a977c-aa84-47c4-a838-b5f90820de1a
Apr 12 16:16:32 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-f0ca9461-f152-4583-a736-665781685ba3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "0e8a977c-aa84-47c4-a838-b5f90820de1a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.706s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:16:33 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:16:33 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:16:33 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:16:33 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Starting heal instance info cache {{(pid=71874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 16:16:33 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquiring lock "refresh_cache-016ae41d-b098-4126-ace7-3da00b40cb9c" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:16:33 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquired lock "refresh_cache-016ae41d-b098-4126-ace7-3da00b40cb9c" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:16:33 user nova-compute[71874]: DEBUG nova.network.neutron [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] [instance: 016ae41d-b098-4126-ace7-3da00b40cb9c] Forcefully refreshing network info cache for instance {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 16:16:34 user nova-compute[71874]: DEBUG nova.network.neutron [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] [instance: 016ae41d-b098-4126-ace7-3da00b40cb9c] Updating instance_info_cache with network_info: [{"id": "6aeec58e-a9ce-429d-a931-f860d7352c2e", "address": "fa:16:3e:8b:30:9b", "network": {"id": "b36306e0-04c5-4b1b-8022-05ff121c4e43", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1503204786-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9210f81232304e179d3e09914a492442", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6aeec58e-a9", "ovs_interfaceid": "6aeec58e-a9ce-429d-a931-f860d7352c2e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:16:34 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Releasing lock "refresh_cache-016ae41d-b098-4126-ace7-3da00b40cb9c" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:16:34 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] [instance: 016ae41d-b098-4126-ace7-3da00b40cb9c] Updated the network info_cache for instance {{(pid=71874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 16:16:34 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:16:34 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:16:34 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:16:34 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:16:34 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:16:34 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:16:34 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71874) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 16:16:34 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:16:35 user nova-compute[71874]: DEBUG nova.compute.manager [req-74beebf4-07e2-486f-b4fb-d0a5d1685d81 req-51179c82-3e0c-429e-9245-0ad3b22876dc service nova] [instance: 540a8fd5-8c18-4efe-97d4-9f0942cebcf5] Received event network-changed-be492426-cc7d-4f76-80a2-ab97d8733e58 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:16:35 user nova-compute[71874]: DEBUG nova.compute.manager [req-74beebf4-07e2-486f-b4fb-d0a5d1685d81 req-51179c82-3e0c-429e-9245-0ad3b22876dc service nova] [instance: 540a8fd5-8c18-4efe-97d4-9f0942cebcf5] Refreshing instance network info cache due to event network-changed-be492426-cc7d-4f76-80a2-ab97d8733e58. {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 16:16:35 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-74beebf4-07e2-486f-b4fb-d0a5d1685d81 req-51179c82-3e0c-429e-9245-0ad3b22876dc service nova] Acquiring lock "refresh_cache-540a8fd5-8c18-4efe-97d4-9f0942cebcf5" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:16:35 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-74beebf4-07e2-486f-b4fb-d0a5d1685d81 req-51179c82-3e0c-429e-9245-0ad3b22876dc service nova] Acquired lock "refresh_cache-540a8fd5-8c18-4efe-97d4-9f0942cebcf5" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:16:35 user nova-compute[71874]: DEBUG nova.network.neutron [req-74beebf4-07e2-486f-b4fb-d0a5d1685d81 req-51179c82-3e0c-429e-9245-0ad3b22876dc service nova] [instance: 540a8fd5-8c18-4efe-97d4-9f0942cebcf5] Refreshing network info cache for port be492426-cc7d-4f76-80a2-ab97d8733e58 {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 16:16:36 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-3011c593-f3a8-45ed-8e34-6e8fabdbb41d tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Acquiring lock "540a8fd5-8c18-4efe-97d4-9f0942cebcf5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:16:36 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-3011c593-f3a8-45ed-8e34-6e8fabdbb41d tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "540a8fd5-8c18-4efe-97d4-9f0942cebcf5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:16:36 user nova-compute[71874]: DEBUG nova.objects.instance [None req-3011c593-f3a8-45ed-8e34-6e8fabdbb41d tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lazy-loading 'flavor' on Instance uuid 540a8fd5-8c18-4efe-97d4-9f0942cebcf5 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:16:36 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-3011c593-f3a8-45ed-8e34-6e8fabdbb41d tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "540a8fd5-8c18-4efe-97d4-9f0942cebcf5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.081s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:16:36 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-3011c593-f3a8-45ed-8e34-6e8fabdbb41d tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Acquiring lock "540a8fd5-8c18-4efe-97d4-9f0942cebcf5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:16:36 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-3011c593-f3a8-45ed-8e34-6e8fabdbb41d tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "540a8fd5-8c18-4efe-97d4-9f0942cebcf5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:16:36 user nova-compute[71874]: INFO nova.compute.manager [None req-3011c593-f3a8-45ed-8e34-6e8fabdbb41d tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] [instance: 540a8fd5-8c18-4efe-97d4-9f0942cebcf5] Attaching volume 4ce30534-445d-4386-acd3-b41a1946b625 to /dev/vdb
Apr 12 16:16:36 user nova-compute[71874]: DEBUG os_brick.utils [None req-3011c593-f3a8-45ed-8e34-6e8fabdbb41d tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:16:36 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:16:36 user nova-compute[71874]: DEBUG nova.network.neutron [req-74beebf4-07e2-486f-b4fb-d0a5d1685d81 req-51179c82-3e0c-429e-9245-0ad3b22876dc service nova] [instance: 540a8fd5-8c18-4efe-97d4-9f0942cebcf5] Updated VIF entry in instance network info cache for port be492426-cc7d-4f76-80a2-ab97d8733e58. {{(pid=71874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 16:16:36 user nova-compute[71874]: DEBUG nova.network.neutron [req-74beebf4-07e2-486f-b4fb-d0a5d1685d81 req-51179c82-3e0c-429e-9245-0ad3b22876dc service nova] [instance: 540a8fd5-8c18-4efe-97d4-9f0942cebcf5] Updating instance_info_cache with network_info: [{"id": "be492426-cc7d-4f76-80a2-ab97d8733e58", "address": "fa:16:3e:23:bb:b8", "network": {"id": "9c134a59-09c8-44dc-b4c7-3bb522d3f948", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-787092091-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29d8082517724895a2027594f440071d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe492426-cc", "ovs_interfaceid": "be492426-cc7d-4f76-80a2-ab97d8733e58", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:16:36 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:16:36 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[dde7b179-25ad-41d7-842a-a690f105ef86]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:61a48d4489d2\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:16:36 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:16:36 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-74beebf4-07e2-486f-b4fb-d0a5d1685d81 req-51179c82-3e0c-429e-9245-0ad3b22876dc service nova] Releasing lock "refresh_cache-540a8fd5-8c18-4efe-97d4-9f0942cebcf5" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:16:36 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:16:36 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[715fad6c-0946-42fb-aa36-dde23bf98fb2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:16:36 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:16:36 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:16:36 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[82078149-6e9f-45bd-b74c-3c9cac2552d5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:16:36 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec1b838c-4668-47c4-94bc-ae746c295e11]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:16:36 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-3011c593-f3a8-45ed-8e34-6e8fabdbb41d tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Running cmd (subprocess): nvme version {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:16:36 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-3011c593-f3a8-45ed-8e34-6e8fabdbb41d tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] 'nvme version' failed. Not Retrying. {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 16:16:36 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3011c593-f3a8-45ed-8e34-6e8fabdbb41d tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] nvme not present on system {{(pid=71874) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 16:16:36 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:16:36 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 16:16:36 user nova-compute[71874]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 16:16:36 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d896849-dc1d-44ce-bbd6-22229d80c5c5]: (4, '') {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:16:36 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.lightos [None req-3011c593-f3a8-45ed-8e34-6e8fabdbb41d tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71874) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 16:16:36 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.lightos [None req-3011c593-f3a8-45ed-8e34-6e8fabdbb41d tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71874) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 16:16:36 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.lightos [None req-3011c593-f3a8-45ed-8e34-6e8fabdbb41d tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] LIGHTOS: no hostnqn found. {{(pid=71874) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 16:16:36 user nova-compute[71874]: DEBUG os_brick.utils [None req-3011c593-f3a8-45ed-8e34-6e8fabdbb41d tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:61a48d4489d2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:16:36 user nova-compute[71874]: DEBUG nova.virt.block_device [None req-3011c593-f3a8-45ed-8e34-6e8fabdbb41d tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] [instance: 540a8fd5-8c18-4efe-97d4-9f0942cebcf5] Updating existing volume attachment record: b1ccc90c-220a-4800-b7f6-ed12cf97c388 {{(pid=71874) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 16:16:38 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:16:39 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:16:40 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3011c593-f3a8-45ed-8e34-6e8fabdbb41d tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] [instance: 540a8fd5-8c18-4efe-97d4-9f0942cebcf5] Calling os-brick to attach iSCSI Volume {{(pid=71874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 16:16:40 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-3011c593-f3a8-45ed-8e34-6e8fabdbb41d tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3c0216320>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4ce30534-445d-4386-acd3-b41a1946b625', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kpWcQueo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:16:40 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-3011c593-f3a8-45ed-8e34-6e8fabdbb41d tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:16:40 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-3011c593-f3a8-45ed-8e34-6e8fabdbb41d tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:16:40 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-3011c593-f3a8-45ed-8e34-6e8fabdbb41d tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:16:40 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-3011c593-f3a8-45ed-8e34-6e8fabdbb41d tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:16:40 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-3011c593-f3a8-45ed-8e34-6e8fabdbb41d tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4ce30534-445d-4386-acd3-b41a1946b625" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:16:40 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-3011c593-f3a8-45ed-8e34-6e8fabdbb41d tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4ce30534-445d-4386-acd3-b41a1946b625" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:16:40 user nova-compute[71874]: INFO os_brick.initiator.connectors.iscsi [None req-3011c593-f3a8-45ed-8e34-6e8fabdbb41d tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 16:16:40 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ce30534-445d-4386-acd3-b41a1946b625 -p 172.16.0.220:3260 {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:16:40 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ce30534-445d-4386-acd3-b41a1946b625 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:16:40 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e95a80e-b045-4cdc-a455-a02a4c7dcd35]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:16:40 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-3011c593-f3a8-45ed-8e34-6e8fabdbb41d tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 16:16:40 user nova-compute[71874]:  {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:16:40 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ce30534-445d-4386-acd3-b41a1946b625 -p 172.16.0.220:3260 --interface default --op new {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:16:40 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ce30534-445d-4386-acd3-b41a1946b625 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:16:40 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[d485fc30-66e3-4830-ada6-beef647d90c0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4ce30534-445d-4386-acd3-b41a1946b625] added\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:16:40 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-3011c593-f3a8-45ed-8e34-6e8fabdbb41d tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4ce30534-445d-4386-acd3-b41a1946b625] added
Apr 12 16:16:40 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:16:40 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ce30534-445d-4386-acd3-b41a1946b625 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:16:40 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ce30534-445d-4386-acd3-b41a1946b625 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:16:40 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[7541b10c-7dd0-4ebb-92a5-d5d63289969a]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:16:40 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-3011c593-f3a8-45ed-8e34-6e8fabdbb41d tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:16:40 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ce30534-445d-4386-acd3-b41a1946b625 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:16:40 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ce30534-445d-4386-acd3-b41a1946b625 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:16:40 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[aebc41d8-f2f4-4029-a337-687114689c20]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:16:40 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-3011c593-f3a8-45ed-8e34-6e8fabdbb41d tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:16:40 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ce30534-445d-4386-acd3-b41a1946b625 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kpWcQueo {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:16:40 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ce30534-445d-4386-acd3-b41a1946b625 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kpWcQueo" returned: 0 in 0.020s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:16:40 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[26c5f558-bc76-419c-ba79-cfac7d5c68b9]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:16:40 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-3011c593-f3a8-45ed-8e34-6e8fabdbb41d tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kpWcQueo'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:16:40 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ce30534-445d-4386-acd3-b41a1946b625 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:16:40 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ce30534-445d-4386-acd3-b41a1946b625 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:16:40 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eb00d72-1ff0-4384-9544-405f25e6faa0]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:16:40 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-3011c593-f3a8-45ed-8e34-6e8fabdbb41d tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:16:40 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:16:41 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:16:41 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc0ee6e9-a449-4fa8-a6eb-5071a985fa39]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c59288c2-ba2b-4a3a-8a0a-a683f07b0bba (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63821959-5dfd-4f66-a6e5-90a20b30efab (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:16:41 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-3011c593-f3a8-45ed-8e34-6e8fabdbb41d tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:16:41 user nova-compute[71874]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c59288c2-ba2b-4a3a-8a0a-a683f07b0bba (non-flash)
Apr 12 16:16:41 user nova-compute[71874]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775 (non-flash)
Apr 12 16:16:41 user nova-compute[71874]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63821959-5dfd-4f66-a6e5-90a20b30efab (non-flash)
Apr 12 16:16:41 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:16:41 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-3011c593-f3a8-45ed-8e34-6e8fabdbb41d tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:16:41 user nova-compute[71874]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c59288c2-ba2b-4a3a-8a0a-a683f07b0bba (non-flash)
Apr 12 16:16:41 user nova-compute[71874]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775 (non-flash)
Apr 12 16:16:41 user nova-compute[71874]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63821959-5dfd-4f66-a6e5-90a20b30efab (non-flash)
Apr 12 16:16:41 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:16:41 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ce30534-445d-4386-acd3-b41a1946b625 -p 172.16.0.220:3260 --login {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:16:41 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ce30534-445d-4386-acd3-b41a1946b625 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:16:41 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[421f38b0-bb33-49c5-83ea-b660a354dce6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4ce30534-445d-4386-acd3-b41a1946b625, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4ce30534-445d-4386-acd3-b41a1946b625, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:16:41 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-3011c593-f3a8-45ed-8e34-6e8fabdbb41d tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4ce30534-445d-4386-acd3-b41a1946b625, portal: 172.16.0.220,3260]
Apr 12 16:16:41 user nova-compute[71874]: Login to [iface: default, target: iqn.2010-10.org.openstack:4ce30534-445d-4386-acd3-b41a1946b625, portal: 172.16.0.220,3260] successful.
Apr 12 16:16:41 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:16:41 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ce30534-445d-4386-acd3-b41a1946b625 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:16:41 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ce30534-445d-4386-acd3-b41a1946b625 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:16:41 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[63218c9a-1f1c-495a-b559-c2eb8089d409]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:16:41 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-3011c593-f3a8-45ed-8e34-6e8fabdbb41d tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:16:41 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:16:41 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:16:41 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[5323a715-6dc6-4c1a-a77f-8b224082ded6]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c59288c2-ba2b-4a3a-8a0a-a683f07b0bba (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63821959-5dfd-4f66-a6e5-90a20b30efab (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ce30534-445d-4386-acd3-b41a1946b625 (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:16:41 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-3011c593-f3a8-45ed-8e34-6e8fabdbb41d tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:16:41 user nova-compute[71874]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c59288c2-ba2b-4a3a-8a0a-a683f07b0bba (non-flash)
Apr 12 16:16:41 user nova-compute[71874]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775 (non-flash)
Apr 12 16:16:41 user nova-compute[71874]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63821959-5dfd-4f66-a6e5-90a20b30efab (non-flash)
Apr 12 16:16:41 user nova-compute[71874]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ce30534-445d-4386-acd3-b41a1946b625 (non-flash)
Apr 12 16:16:41 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:16:41 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-3011c593-f3a8-45ed-8e34-6e8fabdbb41d tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:16:41 user nova-compute[71874]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c59288c2-ba2b-4a3a-8a0a-a683f07b0bba (non-flash)
Apr 12 16:16:41 user nova-compute[71874]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775 (non-flash)
Apr 12 16:16:41 user nova-compute[71874]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63821959-5dfd-4f66-a6e5-90a20b30efab (non-flash)
Apr 12 16:16:41 user nova-compute[71874]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ce30534-445d-4386-acd3-b41a1946b625 (non-flash)
Apr 12 16:16:41 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:16:41 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-3011c593-f3a8-45ed-8e34-6e8fabdbb41d tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4ce30534-445d-4386-acd3-b41a1946b625" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.292s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:16:41 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-3011c593-f3a8-45ed-8e34-6e8fabdbb41d tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Connected to 172.16.0.220:3260 {{(pid=71874) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 16:16:41 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-3011c593-f3a8-45ed-8e34-6e8fabdbb41d tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] HCTL ('37', '-', '-', 0) found on session 40 with lun 0 {{(pid=71874) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 16:16:41 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-3011c593-f3a8-45ed-8e34-6e8fabdbb41d tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=71874) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 16:16:41 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:16:41 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.020s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:16:41 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d7d451a-8892-4590-9f5d-beecb414ba11]: (4, ('- - 0', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:16:41 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-3011c593-f3a8-45ed-8e34-6e8fabdbb41d tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Searching for a device in session 40 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=71874) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 16:16:41 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-3011c593-f3a8-45ed-8e34-6e8fabdbb41d tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:4ce30534-445d-4386-acd3-b41a1946b625', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kpWcQueo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71874) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 16:16:42 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-3011c593-f3a8-45ed-8e34-6e8fabdbb41d tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.339s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:16:42 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-3011c593-f3a8-45ed-8e34-6e8fabdbb41d tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] <== connect_volume: return (1341ms) {'type': 'block', 'scsi_wwn': '23963313361376136', 'path': '/dev/sdf'} {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:16:42 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3011c593-f3a8-45ed-8e34-6e8fabdbb41d tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] [instance: 540a8fd5-8c18-4efe-97d4-9f0942cebcf5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23963313361376136', 'path': '/dev/sdf'} {{(pid=71874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 16:16:42 user nova-compute[71874]: DEBUG nova.objects.instance [None req-3011c593-f3a8-45ed-8e34-6e8fabdbb41d tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lazy-loading 'flavor' on Instance uuid 540a8fd5-8c18-4efe-97d4-9f0942cebcf5 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:16:42 user nova-compute[71874]: DEBUG nova.virt.libvirt.guest [None req-3011c593-f3a8-45ed-8e34-6e8fabdbb41d tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 16:16:42 user nova-compute[71874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 16:16:42 user nova-compute[71874]:   <source dev="/dev/sdf"/>
Apr 12 16:16:42 user nova-compute[71874]:   <target dev="vdb" bus="virtio"/>
Apr 12 16:16:42 user nova-compute[71874]:   <serial>4ce30534-445d-4386-acd3-b41a1946b625</serial>
Apr 12 16:16:42 user nova-compute[71874]: </disk>
Apr 12 16:16:42 user nova-compute[71874]:  {{(pid=71874) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 16:16:42 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-3011c593-f3a8-45ed-8e34-6e8fabdbb41d tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] No BDM found with device name vda, not building metadata. {{(pid=71874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 16:16:42 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-3011c593-f3a8-45ed-8e34-6e8fabdbb41d tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 16:16:42 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-3011c593-f3a8-45ed-8e34-6e8fabdbb41d tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] No VIF found with MAC fa:16:3e:23:bb:b8, not building metadata {{(pid=71874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 16:16:42 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-3011c593-f3a8-45ed-8e34-6e8fabdbb41d tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "540a8fd5-8c18-4efe-97d4-9f0942cebcf5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.438s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:16:43 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:16:44 user nova-compute[71874]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681316189.7512565, 0e8a977c-aa84-47c4-a838-b5f90820de1a => Stopped> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:16:44 user nova-compute[71874]: INFO nova.compute.manager [-] [instance: 0e8a977c-aa84-47c4-a838-b5f90820de1a] VM Stopped (Lifecycle Event)
Apr 12 16:16:44 user nova-compute[71874]: DEBUG nova.compute.manager [None req-8531d06f-0aa7-4e72-80e4-f8f215d14ceb None None] [instance: 0e8a977c-aa84-47c4-a838-b5f90820de1a] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:16:44 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:16:48 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:16:49 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:16:52 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-b14147da-6e94-4022-89d7-9a1bb662d1ba tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Acquiring lock "540a8fd5-8c18-4efe-97d4-9f0942cebcf5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:16:52 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-b14147da-6e94-4022-89d7-9a1bb662d1ba tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "540a8fd5-8c18-4efe-97d4-9f0942cebcf5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:16:52 user nova-compute[71874]: INFO nova.compute.manager [None req-b14147da-6e94-4022-89d7-9a1bb662d1ba tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] [instance: 540a8fd5-8c18-4efe-97d4-9f0942cebcf5] Detaching volume 4ce30534-445d-4386-acd3-b41a1946b625
Apr 12 16:16:52 user nova-compute[71874]: INFO nova.virt.block_device [None req-b14147da-6e94-4022-89d7-9a1bb662d1ba tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] [instance: 540a8fd5-8c18-4efe-97d4-9f0942cebcf5] Attempting to driver detach volume 4ce30534-445d-4386-acd3-b41a1946b625 from mountpoint /dev/vdb
Apr 12 16:16:52 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-b14147da-6e94-4022-89d7-9a1bb662d1ba tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Attempting to detach device vdb from instance 540a8fd5-8c18-4efe-97d4-9f0942cebcf5 from the persistent domain config. {{(pid=71874) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 16:16:52 user nova-compute[71874]: DEBUG nova.virt.libvirt.guest [None req-b14147da-6e94-4022-89d7-9a1bb662d1ba tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 16:16:52 user nova-compute[71874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 16:16:52 user nova-compute[71874]:   <source dev="/dev/sdf"/>
Apr 12 16:16:52 user nova-compute[71874]:   <target dev="vdb" bus="virtio"/>
Apr 12 16:16:52 user nova-compute[71874]:   <serial>4ce30534-445d-4386-acd3-b41a1946b625</serial>
Apr 12 16:16:52 user nova-compute[71874]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 16:16:52 user nova-compute[71874]: </disk>
Apr 12 16:16:52 user nova-compute[71874]:  {{(pid=71874) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 16:16:52 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-b14147da-6e94-4022-89d7-9a1bb662d1ba tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Successfully detached device vdb from instance 540a8fd5-8c18-4efe-97d4-9f0942cebcf5 from the persistent domain config.
Apr 12 16:16:52 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-b14147da-6e94-4022-89d7-9a1bb662d1ba tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 540a8fd5-8c18-4efe-97d4-9f0942cebcf5 from the live domain config. {{(pid=71874) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 16:16:52 user nova-compute[71874]: DEBUG nova.virt.libvirt.guest [None req-b14147da-6e94-4022-89d7-9a1bb662d1ba tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 16:16:52 user nova-compute[71874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 16:16:52 user nova-compute[71874]:   <source dev="/dev/sdf"/>
Apr 12 16:16:52 user nova-compute[71874]:   <target dev="vdb" bus="virtio"/>
Apr 12 16:16:52 user nova-compute[71874]:   <serial>4ce30534-445d-4386-acd3-b41a1946b625</serial>
Apr 12 16:16:52 user nova-compute[71874]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 16:16:52 user nova-compute[71874]: </disk>
Apr 12 16:16:52 user nova-compute[71874]:  {{(pid=71874) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 16:16:53 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Received event <DeviceRemovedEvent: 1681316213.013047, 540a8fd5-8c18-4efe-97d4-9f0942cebcf5 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71874) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 16:16:53 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-b14147da-6e94-4022-89d7-9a1bb662d1ba tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 540a8fd5-8c18-4efe-97d4-9f0942cebcf5 {{(pid=71874) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 16:16:53 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-b14147da-6e94-4022-89d7-9a1bb662d1ba tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Successfully detached device vdb from instance 540a8fd5-8c18-4efe-97d4-9f0942cebcf5 from the live domain config.
Apr 12 16:16:53 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b14147da-6e94-4022-89d7-9a1bb662d1ba tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] [instance: 540a8fd5-8c18-4efe-97d4-9f0942cebcf5] calling os-brick to detach iSCSI Volume {{(pid=71874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 16:16:53 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-b14147da-6e94-4022-89d7-9a1bb662d1ba tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3c0216320>, {'target_iqn': 'iqn.2010-10.org.openstack:4ce30534-445d-4386-acd3-b41a1946b625', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kpWcQueo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:16:53 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-b14147da-6e94-4022-89d7-9a1bb662d1ba tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:16:53 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-b14147da-6e94-4022-89d7-9a1bb662d1ba tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:16:53 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-b14147da-6e94-4022-89d7-9a1bb662d1ba tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:16:53 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:16:53 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:16:53 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[448dee3c-a168-4ca8-b175-6e13ca7d1cc2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:63821959-5dfd-4f66-a6e5-90a20b30efab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4ce30534-445d-4386-acd3-b41a1946b625\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c59288c2-ba2b-4a3a-8a0a-a683f07b0bba\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:16:53 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-b14147da-6e94-4022-89d7-9a1bb662d1ba tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 16:16:53 user nova-compute[71874]: No targets found.
Apr 12 16:16:53 user nova-compute[71874]: iSNS:
Apr 12 16:16:53 user nova-compute[71874]: No targets found.
Apr 12 16:16:53 user nova-compute[71874]: STATIC:
Apr 12 16:16:53 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:63821959-5dfd-4f66-a6e5-90a20b30efab
Apr 12 16:16:53 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:16:53 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:16:53 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:4ce30534-445d-4386-acd3-b41a1946b625
Apr 12 16:16:53 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:16:53 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:16:53 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:c59288c2-ba2b-4a3a-8a0a-a683f07b0bba
Apr 12 16:16:53 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:16:53 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:16:53 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775
Apr 12 16:16:53 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:16:53 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:16:53 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2
Apr 12 16:16:53 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:16:53 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:16:53 user nova-compute[71874]: FIRMWARE:
Apr 12 16:16:53 user nova-compute[71874]: No targets found.
Apr 12 16:16:53 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:16:53 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-b14147da-6e94-4022-89d7-9a1bb662d1ba tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 16:16:53 user nova-compute[71874]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 16:16:53 user nova-compute[71874]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71874) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 16:16:53 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-b14147da-6e94-4022-89d7-9a1bb662d1ba tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4ce30534-445d-4386-acd3-b41a1946b625', 0)] {{(pid=71874) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 16:16:53 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:16:53 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:16:53 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[5edb5a76-dfe2-488f-afb3-562fdfc4a00e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4ce30534-445d-4386-acd3-b41a1946b625\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:63821959-5dfd-4f66-a6e5-90a20b30efab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c59288c2-ba2b-4a3a-8a0a-a683f07b0bba\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:16:53 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:16:53 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:16:53 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e97a720-5538-495f-bfcb-831b9eedc6de]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c59288c2-ba2b-4a3a-8a0a-a683f07b0bba (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63821959-5dfd-4f66-a6e5-90a20b30efab (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ce30534-445d-4386-acd3-b41a1946b625 (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:16:53 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-b14147da-6e94-4022-89d7-9a1bb662d1ba tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:16:53 user nova-compute[71874]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c59288c2-ba2b-4a3a-8a0a-a683f07b0bba (non-flash)
Apr 12 16:16:53 user nova-compute[71874]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775 (non-flash)
Apr 12 16:16:53 user nova-compute[71874]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63821959-5dfd-4f66-a6e5-90a20b30efab (non-flash)
Apr 12 16:16:53 user nova-compute[71874]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ce30534-445d-4386-acd3-b41a1946b625 (non-flash)
Apr 12 16:16:53 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:16:53 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-b14147da-6e94-4022-89d7-9a1bb662d1ba tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:16:53 user nova-compute[71874]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c59288c2-ba2b-4a3a-8a0a-a683f07b0bba (non-flash)
Apr 12 16:16:53 user nova-compute[71874]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775 (non-flash)
Apr 12 16:16:53 user nova-compute[71874]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63821959-5dfd-4f66-a6e5-90a20b30efab (non-flash)
Apr 12 16:16:53 user nova-compute[71874]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ce30534-445d-4386-acd3-b41a1946b625 (non-flash)
Apr 12 16:16:53 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:16:53 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-b14147da-6e94-4022-89d7-9a1bb662d1ba tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc3c02a2950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4ce30534-445d-4386-acd3-b41a1946b625'): ({'sdf'}, set())}) {{(pid=71874) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 16:16:53 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-b14147da-6e94-4022-89d7-9a1bb662d1ba tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Removing single pathed devices sdf {{(pid=71874) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 16:16:53 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:16:53 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:16:53 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[ded49040-b654-4b73-a96a-9121d7c84017]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:16:53 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:16:53 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:16:53 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[524a38e5-5e3d-4404-82d2-e857acb85361]: (4, ('ok\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:16:53 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-b14147da-6e94-4022-89d7-9a1bb662d1ba tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Flushing IO for device /dev/sdf {{(pid=71874) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 16:16:53 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:16:53 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:16:53 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[9661ce98-fd4c-43e9-a0e6-c29c6c8e7f83]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:16:53 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-b14147da-6e94-4022-89d7-9a1bb662d1ba tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=71874) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 16:16:53 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:16:53 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.050s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:16:53 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[c171f91b-bf59-4020-9cfa-b3ea10bd440b]: (4, ('1', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:16:53 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-b14147da-6e94-4022-89d7-9a1bb662d1ba tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=71874) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 16:16:53 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-b14147da-6e94-4022-89d7-9a1bb662d1ba tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] SCSI volumes sdf have been removed. {{(pid=71874) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 16:16:53 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-b14147da-6e94-4022-89d7-9a1bb662d1ba tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4ce30534-445d-4386-acd3-b41a1946b625')] {{(pid=71874) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 16:16:53 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ce30534-445d-4386-acd3-b41a1946b625 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:16:53 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ce30534-445d-4386-acd3-b41a1946b625 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:16:53 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7af5edb-99e0-4efe-9c05-be5f26d342a8]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:16:53 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-b14147da-6e94-4022-89d7-9a1bb662d1ba tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:16:53 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ce30534-445d-4386-acd3-b41a1946b625 -p 172.16.0.220:3260 --logout {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:16:53 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ce30534-445d-4386-acd3-b41a1946b625 -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:16:53 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[59c4b6f7-9568-4af4-854d-c45f0d971d30]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:4ce30534-445d-4386-acd3-b41a1946b625, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:4ce30534-445d-4386-acd3-b41a1946b625, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:16:53 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-b14147da-6e94-4022-89d7-9a1bb662d1ba tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:4ce30534-445d-4386-acd3-b41a1946b625, portal: 172.16.0.220,3260]
Apr 12 16:16:53 user nova-compute[71874]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:4ce30534-445d-4386-acd3-b41a1946b625, portal: 172.16.0.220,3260] successful.
Apr 12 16:16:53 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:16:53 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ce30534-445d-4386-acd3-b41a1946b625 -p 172.16.0.220:3260 --op delete {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:16:53 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:16:53 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ce30534-445d-4386-acd3-b41a1946b625 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:16:53 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dd140ef-ae6b-4013-980d-e6050932479a]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:16:53 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-b14147da-6e94-4022-89d7-9a1bb662d1ba tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:16:53 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-b14147da-6e94-4022-89d7-9a1bb662d1ba tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:16:53 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-b14147da-6e94-4022-89d7-9a1bb662d1ba tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] <== disconnect_volume: return (336ms) None {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:16:53 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b14147da-6e94-4022-89d7-9a1bb662d1ba tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] [instance: 540a8fd5-8c18-4efe-97d4-9f0942cebcf5] Disconnected iSCSI Volume {{(pid=71874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 16:16:54 user nova-compute[71874]: DEBUG nova.objects.instance [None req-b14147da-6e94-4022-89d7-9a1bb662d1ba tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lazy-loading 'flavor' on Instance uuid 540a8fd5-8c18-4efe-97d4-9f0942cebcf5 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:16:54 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-b14147da-6e94-4022-89d7-9a1bb662d1ba tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "540a8fd5-8c18-4efe-97d4-9f0942cebcf5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.675s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:16:54 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:16:58 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:16:59 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:17:04 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:17:05 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:17:08 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:17:09 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:17:13 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:17:14 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:17:15 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:17:16 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-adb42830-66aa-4d05-a25d-46f4b40054fb tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "f42c5cf7-5b0c-4519-a8dc-4022eb20fa59" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:17:16 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-adb42830-66aa-4d05-a25d-46f4b40054fb tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "f42c5cf7-5b0c-4519-a8dc-4022eb20fa59" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:17:16 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-adb42830-66aa-4d05-a25d-46f4b40054fb tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "f42c5cf7-5b0c-4519-a8dc-4022eb20fa59-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:17:16 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-adb42830-66aa-4d05-a25d-46f4b40054fb tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "f42c5cf7-5b0c-4519-a8dc-4022eb20fa59-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:17:16 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-adb42830-66aa-4d05-a25d-46f4b40054fb tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "f42c5cf7-5b0c-4519-a8dc-4022eb20fa59-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:17:16 user nova-compute[71874]: INFO nova.compute.manager [None req-adb42830-66aa-4d05-a25d-46f4b40054fb tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: f42c5cf7-5b0c-4519-a8dc-4022eb20fa59] Terminating instance
Apr 12 16:17:16 user nova-compute[71874]: DEBUG nova.compute.manager [None req-adb42830-66aa-4d05-a25d-46f4b40054fb tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: f42c5cf7-5b0c-4519-a8dc-4022eb20fa59] Start destroying the instance on the hypervisor. {{(pid=71874) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 16:17:16 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:17:16 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:17:16 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:17:16 user nova-compute[71874]: DEBUG nova.compute.manager [req-e8c7c8b9-a081-41f1-b358-c5a0d8df0dc1 req-cfae1975-3805-4fa4-89b7-9c56b585f053 service nova] [instance: f42c5cf7-5b0c-4519-a8dc-4022eb20fa59] Received event network-vif-unplugged-e3207e92-f3c0-4115-bda1-f02903827226 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:17:16 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-e8c7c8b9-a081-41f1-b358-c5a0d8df0dc1 req-cfae1975-3805-4fa4-89b7-9c56b585f053 service nova] Acquiring lock "f42c5cf7-5b0c-4519-a8dc-4022eb20fa59-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:17:16 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-e8c7c8b9-a081-41f1-b358-c5a0d8df0dc1 req-cfae1975-3805-4fa4-89b7-9c56b585f053 service nova] Lock "f42c5cf7-5b0c-4519-a8dc-4022eb20fa59-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:17:16 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-e8c7c8b9-a081-41f1-b358-c5a0d8df0dc1 req-cfae1975-3805-4fa4-89b7-9c56b585f053 service nova] Lock "f42c5cf7-5b0c-4519-a8dc-4022eb20fa59-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:17:16 user nova-compute[71874]: DEBUG nova.compute.manager [req-e8c7c8b9-a081-41f1-b358-c5a0d8df0dc1 req-cfae1975-3805-4fa4-89b7-9c56b585f053 service nova] [instance: f42c5cf7-5b0c-4519-a8dc-4022eb20fa59] No waiting events found dispatching network-vif-unplugged-e3207e92-f3c0-4115-bda1-f02903827226 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:17:16 user nova-compute[71874]: DEBUG nova.compute.manager [req-e8c7c8b9-a081-41f1-b358-c5a0d8df0dc1 req-cfae1975-3805-4fa4-89b7-9c56b585f053 service nova] [instance: f42c5cf7-5b0c-4519-a8dc-4022eb20fa59] Received event network-vif-unplugged-e3207e92-f3c0-4115-bda1-f02903827226 for instance with task_state deleting. {{(pid=71874) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 16:17:17 user nova-compute[71874]: INFO nova.virt.libvirt.driver [-] [instance: f42c5cf7-5b0c-4519-a8dc-4022eb20fa59] Instance destroyed successfully.
Apr 12 16:17:17 user nova-compute[71874]: DEBUG nova.objects.instance [None req-adb42830-66aa-4d05-a25d-46f4b40054fb tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lazy-loading 'resources' on Instance uuid f42c5cf7-5b0c-4519-a8dc-4022eb20fa59 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:17:17 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-adb42830-66aa-4d05-a25d-46f4b40054fb tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T16:15:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-156970536',display_name='tempest-TestVolumeBootPattern-server-156970536',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-156970536',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T16:15:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='29b1b89a5eeb408a8d0938e5f59f405f',ramdisk_id='',reservation_id='r-rcnis5wa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-734600841',owner_user_name='tempest-TestVolumeBootPattern-734600841-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T16:15:43Z,user_data=None,user_id='7054687447fc42339e9046ced4915890',uuid=f42c5cf7-5b0c-4519-a8dc-4022eb20fa59,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e3207e92-f3c0-4115-bda1-f02903827226", "address": "fa:16:3e:71:9c:0b", "network": {"id": "1439244b-8287-4bba-a88c-99d4b498cccd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1491302639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29b1b89a5eeb408a8d0938e5f59f405f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3207e92-f3", "ovs_interfaceid": "e3207e92-f3c0-4115-bda1-f02903827226", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 16:17:17 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-adb42830-66aa-4d05-a25d-46f4b40054fb tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Converting VIF {"id": "e3207e92-f3c0-4115-bda1-f02903827226", "address": "fa:16:3e:71:9c:0b", "network": {"id": "1439244b-8287-4bba-a88c-99d4b498cccd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1491302639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29b1b89a5eeb408a8d0938e5f59f405f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3207e92-f3", "ovs_interfaceid": "e3207e92-f3c0-4115-bda1-f02903827226", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:17:17 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-adb42830-66aa-4d05-a25d-46f4b40054fb tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:9c:0b,bridge_name='br-int',has_traffic_filtering=True,id=e3207e92-f3c0-4115-bda1-f02903827226,network=Network(1439244b-8287-4bba-a88c-99d4b498cccd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3207e92-f3') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:17:17 user nova-compute[71874]: DEBUG os_vif [None req-adb42830-66aa-4d05-a25d-46f4b40054fb tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:9c:0b,bridge_name='br-int',has_traffic_filtering=True,id=e3207e92-f3c0-4115-bda1-f02903827226,network=Network(1439244b-8287-4bba-a88c-99d4b498cccd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3207e92-f3') {{(pid=71874) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 16:17:17 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:17:17 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape3207e92-f3, bridge=br-int, if_exists=True) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:17:17 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:17:17 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:17:17 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:17:17 user nova-compute[71874]: INFO os_vif [None req-adb42830-66aa-4d05-a25d-46f4b40054fb tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:9c:0b,bridge_name='br-int',has_traffic_filtering=True,id=e3207e92-f3c0-4115-bda1-f02903827226,network=Network(1439244b-8287-4bba-a88c-99d4b498cccd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3207e92-f3')
Apr 12 16:17:17 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-adb42830-66aa-4d05-a25d-46f4b40054fb tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: f42c5cf7-5b0c-4519-a8dc-4022eb20fa59] calling os-brick to detach iSCSI Volume {{(pid=71874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 16:17:17 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-adb42830-66aa-4d05-a25d-46f4b40054fb tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3c0216320>, {'target_iqn': 'iqn.2010-10.org.openstack:c59288c2-ba2b-4a3a-8a0a-a683f07b0bba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VMDhrKPa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:17:17 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-adb42830-66aa-4d05-a25d-46f4b40054fb tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:17:17 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-adb42830-66aa-4d05-a25d-46f4b40054fb tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:17:17 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-adb42830-66aa-4d05-a25d-46f4b40054fb tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:17:17 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:17:17 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.032s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:17:17 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c9a82dc-9ca3-473a-aed8-6abc3b7a3282]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:63821959-5dfd-4f66-a6e5-90a20b30efab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c59288c2-ba2b-4a3a-8a0a-a683f07b0bba\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:17:17 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-adb42830-66aa-4d05-a25d-46f4b40054fb tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 16:17:17 user nova-compute[71874]: No targets found.
Apr 12 16:17:17 user nova-compute[71874]: iSNS:
Apr 12 16:17:17 user nova-compute[71874]: No targets found.
Apr 12 16:17:17 user nova-compute[71874]: STATIC:
Apr 12 16:17:17 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:63821959-5dfd-4f66-a6e5-90a20b30efab
Apr 12 16:17:17 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:17:17 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:17:17 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:c59288c2-ba2b-4a3a-8a0a-a683f07b0bba
Apr 12 16:17:17 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:17:17 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:17:17 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775
Apr 12 16:17:17 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:17:17 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:17:17 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2
Apr 12 16:17:17 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:17:17 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:17:17 user nova-compute[71874]: FIRMWARE:
Apr 12 16:17:17 user nova-compute[71874]: No targets found.
Apr 12 16:17:17 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:17:17 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-adb42830-66aa-4d05-a25d-46f4b40054fb tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 16:17:17 user nova-compute[71874]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 16:17:17 user nova-compute[71874]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71874) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 16:17:17 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-adb42830-66aa-4d05-a25d-46f4b40054fb tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c59288c2-ba2b-4a3a-8a0a-a683f07b0bba', 0)] {{(pid=71874) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 16:17:17 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:17:17 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:17:17 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef2e85ef-95cb-4f67-b691-932feffd8c50]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:63821959-5dfd-4f66-a6e5-90a20b30efab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c59288c2-ba2b-4a3a-8a0a-a683f07b0bba\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:17:17 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:17:17 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:17:17 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[987fea9f-834a-42a4-9e5b-11cb3863bd52]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c59288c2-ba2b-4a3a-8a0a-a683f07b0bba (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63821959-5dfd-4f66-a6e5-90a20b30efab (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:17:17 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-adb42830-66aa-4d05-a25d-46f4b40054fb tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:17:17 user nova-compute[71874]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c59288c2-ba2b-4a3a-8a0a-a683f07b0bba (non-flash)
Apr 12 16:17:17 user nova-compute[71874]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775 (non-flash)
Apr 12 16:17:17 user nova-compute[71874]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63821959-5dfd-4f66-a6e5-90a20b30efab (non-flash)
Apr 12 16:17:17 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:17:17 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-adb42830-66aa-4d05-a25d-46f4b40054fb tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:17:17 user nova-compute[71874]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c59288c2-ba2b-4a3a-8a0a-a683f07b0bba (non-flash)
Apr 12 16:17:17 user nova-compute[71874]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775 (non-flash)
Apr 12 16:17:17 user nova-compute[71874]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63821959-5dfd-4f66-a6e5-90a20b30efab (non-flash)
Apr 12 16:17:17 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:17:17 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-adb42830-66aa-4d05-a25d-46f4b40054fb tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc3c0222830>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c59288c2-ba2b-4a3a-8a0a-a683f07b0bba'): ({'sdd'}, set())}) {{(pid=71874) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 16:17:17 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-adb42830-66aa-4d05-a25d-46f4b40054fb tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Removing single pathed devices sdd {{(pid=71874) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 16:17:17 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:17:17 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:17:17 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cb4be19-10e6-48e6-8d3a-9fd5cda82da1]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:17:17 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:17:17 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:17:17 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[72e9b477-3694-4fa4-b7fc-6f291a50ff95]: (4, ('ok\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:17:17 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-adb42830-66aa-4d05-a25d-46f4b40054fb tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Flushing IO for device /dev/sdd {{(pid=71874) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 16:17:17 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:17:17 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:17:17 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[e86deb3f-7933-459f-ab12-1ede86dc8c04]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:17:17 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-adb42830-66aa-4d05-a25d-46f4b40054fb tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71874) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 16:17:17 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:17:17 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.037s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:17:17 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7fa3bb1-8120-4c9e-9cca-5a0d99897027]: (4, ('1', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:17:17 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-adb42830-66aa-4d05-a25d-46f4b40054fb tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71874) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 16:17:17 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-adb42830-66aa-4d05-a25d-46f4b40054fb tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] SCSI volumes sdd have been removed. {{(pid=71874) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 16:17:17 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-adb42830-66aa-4d05-a25d-46f4b40054fb tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c59288c2-ba2b-4a3a-8a0a-a683f07b0bba')] {{(pid=71874) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 16:17:17 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c59288c2-ba2b-4a3a-8a0a-a683f07b0bba -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:17:17 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c59288c2-ba2b-4a3a-8a0a-a683f07b0bba -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:17:17 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb8aa8a8-1040-4ea9-9716-9576d0240bbf]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:17:17 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-adb42830-66aa-4d05-a25d-46f4b40054fb tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:17:17 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c59288c2-ba2b-4a3a-8a0a-a683f07b0bba -p 172.16.0.220:3260 --logout {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:17:17 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c59288c2-ba2b-4a3a-8a0a-a683f07b0bba -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:17:17 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a6d2e89-3fe0-4649-9daa-d672b7ae517e]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:c59288c2-ba2b-4a3a-8a0a-a683f07b0bba, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:c59288c2-ba2b-4a3a-8a0a-a683f07b0bba, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:17:17 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-adb42830-66aa-4d05-a25d-46f4b40054fb tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:c59288c2-ba2b-4a3a-8a0a-a683f07b0bba, portal: 172.16.0.220,3260]
Apr 12 16:17:17 user nova-compute[71874]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:c59288c2-ba2b-4a3a-8a0a-a683f07b0bba, portal: 172.16.0.220,3260] successful.
Apr 12 16:17:17 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:17:17 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c59288c2-ba2b-4a3a-8a0a-a683f07b0bba -p 172.16.0.220:3260 --op delete {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:17:17 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c59288c2-ba2b-4a3a-8a0a-a683f07b0bba -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:17:17 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[45441d1a-d878-436f-af6a-169edad03667]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:17:17 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-adb42830-66aa-4d05-a25d-46f4b40054fb tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:17:17 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-adb42830-66aa-4d05-a25d-46f4b40054fb tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:17:17 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-adb42830-66aa-4d05-a25d-46f4b40054fb tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] <== disconnect_volume: return (336ms) None {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:17:17 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-adb42830-66aa-4d05-a25d-46f4b40054fb tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: f42c5cf7-5b0c-4519-a8dc-4022eb20fa59] Disconnected iSCSI Volume {{(pid=71874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 16:17:17 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-adb42830-66aa-4d05-a25d-46f4b40054fb tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: f42c5cf7-5b0c-4519-a8dc-4022eb20fa59] Deleting instance files /opt/stack/data/nova/instances/f42c5cf7-5b0c-4519-a8dc-4022eb20fa59_del
Apr 12 16:17:17 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-adb42830-66aa-4d05-a25d-46f4b40054fb tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: f42c5cf7-5b0c-4519-a8dc-4022eb20fa59] Deletion of /opt/stack/data/nova/instances/f42c5cf7-5b0c-4519-a8dc-4022eb20fa59_del complete
Apr 12 16:17:17 user nova-compute[71874]: INFO nova.compute.manager [None req-adb42830-66aa-4d05-a25d-46f4b40054fb tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: f42c5cf7-5b0c-4519-a8dc-4022eb20fa59] Took 1.23 seconds to destroy the instance on the hypervisor.
Apr 12 16:17:17 user nova-compute[71874]: DEBUG oslo.service.loopingcall [None req-adb42830-66aa-4d05-a25d-46f4b40054fb tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71874) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 16:17:17 user nova-compute[71874]: DEBUG nova.compute.manager [-] [instance: f42c5cf7-5b0c-4519-a8dc-4022eb20fa59] Deallocating network for instance {{(pid=71874) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 16:17:17 user nova-compute[71874]: DEBUG nova.network.neutron [-] [instance: f42c5cf7-5b0c-4519-a8dc-4022eb20fa59] deallocate_for_instance() {{(pid=71874) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 16:17:18 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-3f2b7079-c8c1-49c2-a234-74c234f90844 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Acquiring lock "016ae41d-b098-4126-ace7-3da00b40cb9c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:17:18 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-3f2b7079-c8c1-49c2-a234-74c234f90844 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "016ae41d-b098-4126-ace7-3da00b40cb9c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:17:18 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-3f2b7079-c8c1-49c2-a234-74c234f90844 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Acquiring lock "016ae41d-b098-4126-ace7-3da00b40cb9c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:17:18 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-3f2b7079-c8c1-49c2-a234-74c234f90844 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "016ae41d-b098-4126-ace7-3da00b40cb9c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:17:18 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-3f2b7079-c8c1-49c2-a234-74c234f90844 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "016ae41d-b098-4126-ace7-3da00b40cb9c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:17:18 user nova-compute[71874]: INFO nova.compute.manager [None req-3f2b7079-c8c1-49c2-a234-74c234f90844 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 016ae41d-b098-4126-ace7-3da00b40cb9c] Terminating instance
Apr 12 16:17:18 user nova-compute[71874]: DEBUG nova.compute.manager [None req-3f2b7079-c8c1-49c2-a234-74c234f90844 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 016ae41d-b098-4126-ace7-3da00b40cb9c] Start destroying the instance on the hypervisor. {{(pid=71874) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 16:17:18 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:17:18 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:17:18 user nova-compute[71874]: DEBUG nova.compute.manager [req-5f566533-4e64-4933-8238-7b10bcbd7ac2 req-05def5fc-b5f6-489a-bc42-8e1a1717362c service nova] [instance: 016ae41d-b098-4126-ace7-3da00b40cb9c] Received event network-vif-unplugged-6aeec58e-a9ce-429d-a931-f860d7352c2e {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:17:18 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-5f566533-4e64-4933-8238-7b10bcbd7ac2 req-05def5fc-b5f6-489a-bc42-8e1a1717362c service nova] Acquiring lock "016ae41d-b098-4126-ace7-3da00b40cb9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:17:18 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-5f566533-4e64-4933-8238-7b10bcbd7ac2 req-05def5fc-b5f6-489a-bc42-8e1a1717362c service nova] Lock "016ae41d-b098-4126-ace7-3da00b40cb9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:17:18 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-5f566533-4e64-4933-8238-7b10bcbd7ac2 req-05def5fc-b5f6-489a-bc42-8e1a1717362c service nova] Lock "016ae41d-b098-4126-ace7-3da00b40cb9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:17:18 user nova-compute[71874]: DEBUG nova.compute.manager [req-5f566533-4e64-4933-8238-7b10bcbd7ac2 req-05def5fc-b5f6-489a-bc42-8e1a1717362c service nova] [instance: 016ae41d-b098-4126-ace7-3da00b40cb9c] No waiting events found dispatching network-vif-unplugged-6aeec58e-a9ce-429d-a931-f860d7352c2e {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:17:18 user nova-compute[71874]: DEBUG nova.compute.manager [req-5f566533-4e64-4933-8238-7b10bcbd7ac2 req-05def5fc-b5f6-489a-bc42-8e1a1717362c service nova] [instance: 016ae41d-b098-4126-ace7-3da00b40cb9c] Received event network-vif-unplugged-6aeec58e-a9ce-429d-a931-f860d7352c2e for instance with task_state deleting. {{(pid=71874) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 16:17:18 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:17:18 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:17:18 user nova-compute[71874]: DEBUG nova.network.neutron [-] [instance: f42c5cf7-5b0c-4519-a8dc-4022eb20fa59] Updating instance_info_cache with network_info: [] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:17:18 user nova-compute[71874]: INFO nova.compute.manager [-] [instance: f42c5cf7-5b0c-4519-a8dc-4022eb20fa59] Took 0.86 seconds to deallocate network for instance.
Apr 12 16:17:18 user nova-compute[71874]: INFO nova.virt.libvirt.driver [-] [instance: 016ae41d-b098-4126-ace7-3da00b40cb9c] Instance destroyed successfully.
Apr 12 16:17:18 user nova-compute[71874]: DEBUG nova.objects.instance [None req-3f2b7079-c8c1-49c2-a234-74c234f90844 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lazy-loading 'resources' on Instance uuid 016ae41d-b098-4126-ace7-3da00b40cb9c {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:17:18 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-3f2b7079-c8c1-49c2-a234-74c234f90844 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T16:07:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1903529512',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1903529512',id=26,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T16:08:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9210f81232304e179d3e09914a492442',ramdisk_id='',reservation_id='r-p2olcd7k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1443944578',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T16:09:53Z,user_data=None,user_id='73f9fa5bc22a4824b3cdcb8cf7bb380c',uuid=016ae41d-b098-4126-ace7-3da00b40cb9c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6aeec58e-a9ce-429d-a931-f860d7352c2e", "address": "fa:16:3e:8b:30:9b", "network": {"id": "b36306e0-04c5-4b1b-8022-05ff121c4e43", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1503204786-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9210f81232304e179d3e09914a492442", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6aeec58e-a9", "ovs_interfaceid": "6aeec58e-a9ce-429d-a931-f860d7352c2e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 16:17:18 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-3f2b7079-c8c1-49c2-a234-74c234f90844 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Converting VIF {"id": "6aeec58e-a9ce-429d-a931-f860d7352c2e", "address": "fa:16:3e:8b:30:9b", "network": {"id": "b36306e0-04c5-4b1b-8022-05ff121c4e43", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1503204786-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9210f81232304e179d3e09914a492442", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6aeec58e-a9", "ovs_interfaceid": "6aeec58e-a9ce-429d-a931-f860d7352c2e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:17:18 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-3f2b7079-c8c1-49c2-a234-74c234f90844 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8b:30:9b,bridge_name='br-int',has_traffic_filtering=True,id=6aeec58e-a9ce-429d-a931-f860d7352c2e,network=Network(b36306e0-04c5-4b1b-8022-05ff121c4e43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6aeec58e-a9') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:17:18 user nova-compute[71874]: DEBUG os_vif [None req-3f2b7079-c8c1-49c2-a234-74c234f90844 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8b:30:9b,bridge_name='br-int',has_traffic_filtering=True,id=6aeec58e-a9ce-429d-a931-f860d7352c2e,network=Network(b36306e0-04c5-4b1b-8022-05ff121c4e43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6aeec58e-a9') {{(pid=71874) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 16:17:18 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:17:18 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6aeec58e-a9, bridge=br-int, if_exists=True) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:17:18 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:17:18 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:17:18 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:17:18 user nova-compute[71874]: INFO os_vif [None req-3f2b7079-c8c1-49c2-a234-74c234f90844 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8b:30:9b,bridge_name='br-int',has_traffic_filtering=True,id=6aeec58e-a9ce-429d-a931-f860d7352c2e,network=Network(b36306e0-04c5-4b1b-8022-05ff121c4e43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6aeec58e-a9')
Apr 12 16:17:18 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-3f2b7079-c8c1-49c2-a234-74c234f90844 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 016ae41d-b098-4126-ace7-3da00b40cb9c] Deleting instance files /opt/stack/data/nova/instances/016ae41d-b098-4126-ace7-3da00b40cb9c_del
Apr 12 16:17:18 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-3f2b7079-c8c1-49c2-a234-74c234f90844 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 016ae41d-b098-4126-ace7-3da00b40cb9c] Deletion of /opt/stack/data/nova/instances/016ae41d-b098-4126-ace7-3da00b40cb9c_del complete
Apr 12 16:17:18 user nova-compute[71874]: DEBUG nova.compute.manager [req-36bd5610-cbb0-4ab4-9fa1-ac5879489ca5 req-5e390d72-f869-4f9f-afd0-ca917925b9b2 service nova] [instance: f42c5cf7-5b0c-4519-a8dc-4022eb20fa59] Received event network-vif-plugged-e3207e92-f3c0-4115-bda1-f02903827226 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:17:18 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-36bd5610-cbb0-4ab4-9fa1-ac5879489ca5 req-5e390d72-f869-4f9f-afd0-ca917925b9b2 service nova] Acquiring lock "f42c5cf7-5b0c-4519-a8dc-4022eb20fa59-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:17:18 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-36bd5610-cbb0-4ab4-9fa1-ac5879489ca5 req-5e390d72-f869-4f9f-afd0-ca917925b9b2 service nova] Lock "f42c5cf7-5b0c-4519-a8dc-4022eb20fa59-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:17:18 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-36bd5610-cbb0-4ab4-9fa1-ac5879489ca5 req-5e390d72-f869-4f9f-afd0-ca917925b9b2 service nova] Lock "f42c5cf7-5b0c-4519-a8dc-4022eb20fa59-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:17:18 user nova-compute[71874]: DEBUG nova.compute.manager [req-36bd5610-cbb0-4ab4-9fa1-ac5879489ca5 req-5e390d72-f869-4f9f-afd0-ca917925b9b2 service nova] [instance: f42c5cf7-5b0c-4519-a8dc-4022eb20fa59] No waiting events found dispatching network-vif-plugged-e3207e92-f3c0-4115-bda1-f02903827226 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:17:18 user nova-compute[71874]: WARNING nova.compute.manager [req-36bd5610-cbb0-4ab4-9fa1-ac5879489ca5 req-5e390d72-f869-4f9f-afd0-ca917925b9b2 service nova] [instance: f42c5cf7-5b0c-4519-a8dc-4022eb20fa59] Received unexpected event network-vif-plugged-e3207e92-f3c0-4115-bda1-f02903827226 for instance with vm_state active and task_state deleting.
Apr 12 16:17:18 user nova-compute[71874]: DEBUG nova.compute.manager [req-36bd5610-cbb0-4ab4-9fa1-ac5879489ca5 req-5e390d72-f869-4f9f-afd0-ca917925b9b2 service nova] [instance: f42c5cf7-5b0c-4519-a8dc-4022eb20fa59] Received event network-vif-deleted-e3207e92-f3c0-4115-bda1-f02903827226 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:17:18 user nova-compute[71874]: INFO nova.compute.manager [None req-3f2b7079-c8c1-49c2-a234-74c234f90844 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 016ae41d-b098-4126-ace7-3da00b40cb9c] Took 0.71 seconds to destroy the instance on the hypervisor.
Apr 12 16:17:18 user nova-compute[71874]: DEBUG oslo.service.loopingcall [None req-3f2b7079-c8c1-49c2-a234-74c234f90844 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71874) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 16:17:18 user nova-compute[71874]: DEBUG nova.compute.manager [-] [instance: 016ae41d-b098-4126-ace7-3da00b40cb9c] Deallocating network for instance {{(pid=71874) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 16:17:18 user nova-compute[71874]: DEBUG nova.network.neutron [-] [instance: 016ae41d-b098-4126-ace7-3da00b40cb9c] deallocate_for_instance() {{(pid=71874) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 16:17:19 user nova-compute[71874]: DEBUG nova.network.neutron [-] [instance: 016ae41d-b098-4126-ace7-3da00b40cb9c] Updating instance_info_cache with network_info: [] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:17:19 user nova-compute[71874]: INFO nova.compute.manager [-] [instance: 016ae41d-b098-4126-ace7-3da00b40cb9c] Took 0.58 seconds to deallocate network for instance.
Apr 12 16:17:19 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-3f2b7079-c8c1-49c2-a234-74c234f90844 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:17:19 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-3f2b7079-c8c1-49c2-a234-74c234f90844 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:17:19 user nova-compute[71874]: INFO nova.compute.manager [None req-adb42830-66aa-4d05-a25d-46f4b40054fb tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: f42c5cf7-5b0c-4519-a8dc-4022eb20fa59] Took 1.00 seconds to detach 1 volumes for instance.
Apr 12 16:17:19 user nova-compute[71874]: DEBUG nova.compute.manager [None req-adb42830-66aa-4d05-a25d-46f4b40054fb tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: f42c5cf7-5b0c-4519-a8dc-4022eb20fa59] Deleting volume: c59288c2-ba2b-4a3a-8a0a-a683f07b0bba {{(pid=71874) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 12 16:17:19 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-adb42830-66aa-4d05-a25d-46f4b40054fb tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:17:19 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-3f2b7079-c8c1-49c2-a234-74c234f90844 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Inventory has not changed in ProviderTree for provider: 0e94b4c8-cd49-45e4-9133-d36eb4b2456b {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 16:17:19 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-3f2b7079-c8c1-49c2-a234-74c234f90844 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Inventory has not changed for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 16:17:19 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-3f2b7079-c8c1-49c2-a234-74c234f90844 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.336s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:17:19 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-adb42830-66aa-4d05-a25d-46f4b40054fb tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.118s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:17:20 user nova-compute[71874]: INFO nova.scheduler.client.report [None req-3f2b7079-c8c1-49c2-a234-74c234f90844 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Deleted allocations for instance 016ae41d-b098-4126-ace7-3da00b40cb9c
Apr 12 16:17:20 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-3f2b7079-c8c1-49c2-a234-74c234f90844 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "016ae41d-b098-4126-ace7-3da00b40cb9c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.850s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:17:20 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-adb42830-66aa-4d05-a25d-46f4b40054fb tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Inventory has not changed in ProviderTree for provider: 0e94b4c8-cd49-45e4-9133-d36eb4b2456b {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 16:17:20 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-adb42830-66aa-4d05-a25d-46f4b40054fb tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Inventory has not changed for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 16:17:20 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-adb42830-66aa-4d05-a25d-46f4b40054fb tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.398s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:17:20 user nova-compute[71874]: INFO nova.scheduler.client.report [None req-adb42830-66aa-4d05-a25d-46f4b40054fb tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Deleted allocations for instance f42c5cf7-5b0c-4519-a8dc-4022eb20fa59
Apr 12 16:17:20 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-adb42830-66aa-4d05-a25d-46f4b40054fb tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "f42c5cf7-5b0c-4519-a8dc-4022eb20fa59" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.855s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:17:20 user nova-compute[71874]: DEBUG nova.compute.manager [req-89ed1e9b-8bcc-449d-921d-1a4818005c68 req-329405d3-2156-4941-8c99-1c5e7195ed0d service nova] [instance: 016ae41d-b098-4126-ace7-3da00b40cb9c] Received event network-vif-plugged-6aeec58e-a9ce-429d-a931-f860d7352c2e {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:17:20 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-89ed1e9b-8bcc-449d-921d-1a4818005c68 req-329405d3-2156-4941-8c99-1c5e7195ed0d service nova] Acquiring lock "016ae41d-b098-4126-ace7-3da00b40cb9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:17:20 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-89ed1e9b-8bcc-449d-921d-1a4818005c68 req-329405d3-2156-4941-8c99-1c5e7195ed0d service nova] Lock "016ae41d-b098-4126-ace7-3da00b40cb9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:17:20 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-89ed1e9b-8bcc-449d-921d-1a4818005c68 req-329405d3-2156-4941-8c99-1c5e7195ed0d service nova] Lock "016ae41d-b098-4126-ace7-3da00b40cb9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:17:20 user nova-compute[71874]: DEBUG nova.compute.manager [req-89ed1e9b-8bcc-449d-921d-1a4818005c68 req-329405d3-2156-4941-8c99-1c5e7195ed0d service nova] [instance: 016ae41d-b098-4126-ace7-3da00b40cb9c] No waiting events found dispatching network-vif-plugged-6aeec58e-a9ce-429d-a931-f860d7352c2e {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:17:20 user nova-compute[71874]: WARNING nova.compute.manager [req-89ed1e9b-8bcc-449d-921d-1a4818005c68 req-329405d3-2156-4941-8c99-1c5e7195ed0d service nova] [instance: 016ae41d-b098-4126-ace7-3da00b40cb9c] Received unexpected event network-vif-plugged-6aeec58e-a9ce-429d-a931-f860d7352c2e for instance with vm_state deleted and task_state None.
Apr 12 16:17:21 user nova-compute[71874]: DEBUG nova.compute.manager [req-bd51522b-82b8-4474-b170-5a86a57d61af req-bf58e2d4-a648-4a5d-8181-6a57a5ac71c7 service nova] [instance: 016ae41d-b098-4126-ace7-3da00b40cb9c] Received event network-vif-deleted-6aeec58e-a9ce-429d-a931-f860d7352c2e {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:17:23 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:17:24 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:17:24 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:17:24 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:17:24 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:17:24 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Auditing locally available compute resources for user (node: user) {{(pid=71874) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 16:17:25 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/540a8fd5-8c18-4efe-97d4-9f0942cebcf5/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:17:25 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/540a8fd5-8c18-4efe-97d4-9f0942cebcf5/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:17:25 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/540a8fd5-8c18-4efe-97d4-9f0942cebcf5/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:17:25 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/540a8fd5-8c18-4efe-97d4-9f0942cebcf5/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:17:25 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 16:17:25 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32471bee-e77e-4a1b-8e00-d938a1373976/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:17:25 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32471bee-e77e-4a1b-8e00-d938a1373976/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:17:25 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32471bee-e77e-4a1b-8e00-d938a1373976/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:17:25 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32471bee-e77e-4a1b-8e00-d938a1373976/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:17:25 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4190e244-84b1-47b6-813d-9cadb7c65975/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:17:25 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4190e244-84b1-47b6-813d-9cadb7c65975/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:17:25 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4190e244-84b1-47b6-813d-9cadb7c65975/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:17:25 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4190e244-84b1-47b6-813d-9cadb7c65975/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:17:25 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=71874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 16:17:25 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/608fbea2-b42b-4bb9-94a7-2b76dcdc2001/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:17:26 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/608fbea2-b42b-4bb9-94a7-2b76dcdc2001/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:17:26 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/608fbea2-b42b-4bb9-94a7-2b76dcdc2001/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:17:26 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/608fbea2-b42b-4bb9-94a7-2b76dcdc2001/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:17:26 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b613235-a905-466f-b9cc-a21a321a6313/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:17:26 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b613235-a905-466f-b9cc-a21a321a6313/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:17:26 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b613235-a905-466f-b9cc-a21a321a6313/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:17:26 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b613235-a905-466f-b9cc-a21a321a6313/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:17:26 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4c37cbf-1743-4dd5-97fd-2bb12ebee763/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:17:26 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4c37cbf-1743-4dd5-97fd-2bb12ebee763/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:17:26 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4c37cbf-1743-4dd5-97fd-2bb12ebee763/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:17:26 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4c37cbf-1743-4dd5-97fd-2bb12ebee763/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:17:26 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 16:17:27 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:17:27 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:17:27 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Hypervisor/Node resource view: name=user free_ram=7958MB free_disk=25.846004486083984GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71874) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 16:17:27 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:17:27 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:17:27 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 608fbea2-b42b-4bb9-94a7-2b76dcdc2001 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:17:27 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance f52ee906-c8fd-4cd5-842e-de98a5099c4f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:17:27 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 4190e244-84b1-47b6-813d-9cadb7c65975 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:17:27 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 1b613235-a905-466f-b9cc-a21a321a6313 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:17:27 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 32471bee-e77e-4a1b-8e00-d938a1373976 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:17:27 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance b4c37cbf-1743-4dd5-97fd-2bb12ebee763 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:17:27 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 540a8fd5-8c18-4efe-97d4-9f0942cebcf5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:17:27 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance bef10c89-360e-42d6-aa26-7edf1afca567 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:17:27 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=71874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 16:17:27 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Final resource view: name=user phys_ram=16023MB used_ram=1536MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=71874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 16:17:28 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Inventory has not changed in ProviderTree for provider: 0e94b4c8-cd49-45e4-9133-d36eb4b2456b {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 16:17:28 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Inventory has not changed for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 16:17:28 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Compute_service record updated for user:user {{(pid=71874) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 16:17:28 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.567s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:17:28 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:17:30 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:17:30 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:17:30 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:17:31 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:17:31 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:17:31 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Starting heal instance info cache {{(pid=71874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 16:17:31 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquiring lock "refresh_cache-4190e244-84b1-47b6-813d-9cadb7c65975" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:17:31 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquired lock "refresh_cache-4190e244-84b1-47b6-813d-9cadb7c65975" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:17:32 user nova-compute[71874]: DEBUG nova.network.neutron [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Forcefully refreshing network info cache for instance {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 16:17:32 user nova-compute[71874]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681316237.416056, f42c5cf7-5b0c-4519-a8dc-4022eb20fa59 => Stopped> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:17:32 user nova-compute[71874]: INFO nova.compute.manager [-] [instance: f42c5cf7-5b0c-4519-a8dc-4022eb20fa59] VM Stopped (Lifecycle Event)
Apr 12 16:17:32 user nova-compute[71874]: DEBUG nova.compute.manager [None req-e4b5cfc4-5d0b-440a-bed8-bd59c3c515e8 None None] [instance: f42c5cf7-5b0c-4519-a8dc-4022eb20fa59] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:17:32 user nova-compute[71874]: DEBUG nova.network.neutron [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Updating instance_info_cache with network_info: [{"id": "eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c", "address": "fa:16:3e:d0:b5:d4", "network": {"id": "1ef428ff-90e5-4abd-93d0-b7c2c581cb26", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-425924095-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf4334df004490ba51b4d92ce5408ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeab1ea0c-8a", "ovs_interfaceid": "eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:17:32 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Releasing lock "refresh_cache-4190e244-84b1-47b6-813d-9cadb7c65975" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:17:32 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Updated the network info_cache for instance {{(pid=71874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 16:17:32 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:17:32 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:17:32 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71874) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 16:17:33 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:17:33 user nova-compute[71874]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681316238.8641775, 016ae41d-b098-4126-ace7-3da00b40cb9c => Stopped> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:17:33 user nova-compute[71874]: INFO nova.compute.manager [-] [instance: 016ae41d-b098-4126-ace7-3da00b40cb9c] VM Stopped (Lifecycle Event)
Apr 12 16:17:33 user nova-compute[71874]: DEBUG nova.compute.manager [None req-edfcdb53-6329-47ad-86b2-0a3016e8780c None None] [instance: 016ae41d-b098-4126-ace7-3da00b40cb9c] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:17:33 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:17:33 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:17:33 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71874) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 16:17:33 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71874) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 16:17:33 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71874) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 16:17:33 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:17:34 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:17:37 user nova-compute[71874]: DEBUG nova.compute.manager [req-4d6c1a88-b467-454d-8185-f923b4e6aaa2 req-434acfc9-c803-4b2f-9beb-4e611c49a9c2 service nova] [instance: 32471bee-e77e-4a1b-8e00-d938a1373976] Received event network-changed-69029e57-b138-43c1-b31f-59bc7957994d {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:17:37 user nova-compute[71874]: DEBUG nova.compute.manager [req-4d6c1a88-b467-454d-8185-f923b4e6aaa2 req-434acfc9-c803-4b2f-9beb-4e611c49a9c2 service nova] [instance: 32471bee-e77e-4a1b-8e00-d938a1373976] Refreshing instance network info cache due to event network-changed-69029e57-b138-43c1-b31f-59bc7957994d. {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 16:17:37 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-4d6c1a88-b467-454d-8185-f923b4e6aaa2 req-434acfc9-c803-4b2f-9beb-4e611c49a9c2 service nova] Acquiring lock "refresh_cache-32471bee-e77e-4a1b-8e00-d938a1373976" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:17:37 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-4d6c1a88-b467-454d-8185-f923b4e6aaa2 req-434acfc9-c803-4b2f-9beb-4e611c49a9c2 service nova] Acquired lock "refresh_cache-32471bee-e77e-4a1b-8e00-d938a1373976" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:17:37 user nova-compute[71874]: DEBUG nova.network.neutron [req-4d6c1a88-b467-454d-8185-f923b4e6aaa2 req-434acfc9-c803-4b2f-9beb-4e611c49a9c2 service nova] [instance: 32471bee-e77e-4a1b-8e00-d938a1373976] Refreshing network info cache for port 69029e57-b138-43c1-b31f-59bc7957994d {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 16:17:37 user nova-compute[71874]: DEBUG nova.network.neutron [req-4d6c1a88-b467-454d-8185-f923b4e6aaa2 req-434acfc9-c803-4b2f-9beb-4e611c49a9c2 service nova] [instance: 32471bee-e77e-4a1b-8e00-d938a1373976] Updated VIF entry in instance network info cache for port 69029e57-b138-43c1-b31f-59bc7957994d. {{(pid=71874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 16:17:37 user nova-compute[71874]: DEBUG nova.network.neutron [req-4d6c1a88-b467-454d-8185-f923b4e6aaa2 req-434acfc9-c803-4b2f-9beb-4e611c49a9c2 service nova] [instance: 32471bee-e77e-4a1b-8e00-d938a1373976] Updating instance_info_cache with network_info: [{"id": "69029e57-b138-43c1-b31f-59bc7957994d", "address": "fa:16:3e:04:8e:ce", "network": {"id": "e6694358-e361-4952-b859-93755c11721e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-667152893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97ea81bd1962466bbe552424973f71a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69029e57-b1", "ovs_interfaceid": "69029e57-b138-43c1-b31f-59bc7957994d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:17:37 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-4d6c1a88-b467-454d-8185-f923b4e6aaa2 req-434acfc9-c803-4b2f-9beb-4e611c49a9c2 service nova] Releasing lock "refresh_cache-32471bee-e77e-4a1b-8e00-d938a1373976" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:17:38 user nova-compute[71874]: DEBUG nova.compute.manager [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] Stashing vm_state: active {{(pid=71874) _prep_resize /opt/stack/nova/nova/compute/manager.py:5499}}
Apr 12 16:17:38 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:17:38 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:17:38 user nova-compute[71874]: DEBUG nova.objects.instance [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lazy-loading 'pci_requests' on Instance uuid bef10c89-360e-42d6-aa26-7edf1afca567 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:17:38 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71874) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 16:17:38 user nova-compute[71874]: INFO nova.compute.claims [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] Claim successful on node user
Apr 12 16:17:38 user nova-compute[71874]: DEBUG nova.objects.instance [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lazy-loading 'resources' on Instance uuid bef10c89-360e-42d6-aa26-7edf1afca567 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:17:38 user nova-compute[71874]: DEBUG nova.objects.instance [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lazy-loading 'pci_devices' on Instance uuid bef10c89-360e-42d6-aa26-7edf1afca567 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:17:38 user nova-compute[71874]: INFO nova.compute.resource_tracker [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] Updating resource usage from migration 6b3c0b85-4c61-422d-b540-ee366451d208
Apr 12 16:17:38 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:17:38 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:17:38 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=71874) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 16:17:38 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71874) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 16:17:38 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71874) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 16:17:38 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:17:39 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Inventory has not changed in ProviderTree for provider: 0e94b4c8-cd49-45e4-9133-d36eb4b2456b {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 16:17:39 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Inventory has not changed for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 16:17:39 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.402s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:17:39 user nova-compute[71874]: INFO nova.compute.manager [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] Migrating
Apr 12 16:17:39 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "refresh_cache-bef10c89-360e-42d6-aa26-7edf1afca567" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:17:39 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquired lock "refresh_cache-bef10c89-360e-42d6-aa26-7edf1afca567" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:17:39 user nova-compute[71874]: DEBUG nova.network.neutron [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] Building network info cache for instance {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 16:17:39 user nova-compute[71874]: DEBUG nova.compute.manager [req-badef273-20a3-4fbd-8c4d-d834d7512e79 req-4cff0207-d493-45d7-9b53-62ac1b9f49f3 service nova] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] Received event network-changed-ecba9b76-45d2-49e7-addc-367dc21b38ce {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:17:39 user nova-compute[71874]: DEBUG nova.compute.manager [req-badef273-20a3-4fbd-8c4d-d834d7512e79 req-4cff0207-d493-45d7-9b53-62ac1b9f49f3 service nova] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] Refreshing instance network info cache due to event network-changed-ecba9b76-45d2-49e7-addc-367dc21b38ce. {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 16:17:39 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-badef273-20a3-4fbd-8c4d-d834d7512e79 req-4cff0207-d493-45d7-9b53-62ac1b9f49f3 service nova] Acquiring lock "refresh_cache-bef10c89-360e-42d6-aa26-7edf1afca567" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:17:40 user nova-compute[71874]: DEBUG nova.network.neutron [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] Updating instance_info_cache with network_info: [{"id": "ecba9b76-45d2-49e7-addc-367dc21b38ce", "address": "fa:16:3e:e4:f4:15", "network": {"id": "e6694358-e361-4952-b859-93755c11721e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-667152893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97ea81bd1962466bbe552424973f71a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecba9b76-45", "ovs_interfaceid": "ecba9b76-45d2-49e7-addc-367dc21b38ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:17:40 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Releasing lock "refresh_cache-bef10c89-360e-42d6-aa26-7edf1afca567" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:17:40 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-badef273-20a3-4fbd-8c4d-d834d7512e79 req-4cff0207-d493-45d7-9b53-62ac1b9f49f3 service nova] Acquired lock "refresh_cache-bef10c89-360e-42d6-aa26-7edf1afca567" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:17:40 user nova-compute[71874]: DEBUG nova.network.neutron [req-badef273-20a3-4fbd-8c4d-d834d7512e79 req-4cff0207-d493-45d7-9b53-62ac1b9f49f3 service nova] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] Refreshing network info cache for port ecba9b76-45d2-49e7-addc-367dc21b38ce {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 16:17:40 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] Starting migrate_disk_and_power_off {{(pid=71874) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11460}}
Apr 12 16:17:40 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:17:40 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:17:40 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:17:40 user nova-compute[71874]: DEBUG nova.compute.manager [req-3a99739d-b8c9-40bd-af00-bbc6ce67c171 req-d11c2da1-a493-4d44-90ce-0f9b40cb848c service nova] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] Received event network-vif-unplugged-ecba9b76-45d2-49e7-addc-367dc21b38ce {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:17:40 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-3a99739d-b8c9-40bd-af00-bbc6ce67c171 req-d11c2da1-a493-4d44-90ce-0f9b40cb848c service nova] Acquiring lock "bef10c89-360e-42d6-aa26-7edf1afca567-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:17:40 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-3a99739d-b8c9-40bd-af00-bbc6ce67c171 req-d11c2da1-a493-4d44-90ce-0f9b40cb848c service nova] Lock "bef10c89-360e-42d6-aa26-7edf1afca567-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:17:40 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-3a99739d-b8c9-40bd-af00-bbc6ce67c171 req-d11c2da1-a493-4d44-90ce-0f9b40cb848c service nova] Lock "bef10c89-360e-42d6-aa26-7edf1afca567-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:17:40 user nova-compute[71874]: DEBUG nova.compute.manager [req-3a99739d-b8c9-40bd-af00-bbc6ce67c171 req-d11c2da1-a493-4d44-90ce-0f9b40cb848c service nova] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] No waiting events found dispatching network-vif-unplugged-ecba9b76-45d2-49e7-addc-367dc21b38ce {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:17:40 user nova-compute[71874]: WARNING nova.compute.manager [req-3a99739d-b8c9-40bd-af00-bbc6ce67c171 req-d11c2da1-a493-4d44-90ce-0f9b40cb848c service nova] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] Received unexpected event network-vif-unplugged-ecba9b76-45d2-49e7-addc-367dc21b38ce for instance with vm_state active and task_state resize_migrating.
Apr 12 16:17:40 user nova-compute[71874]: DEBUG nova.network.neutron [req-badef273-20a3-4fbd-8c4d-d834d7512e79 req-4cff0207-d493-45d7-9b53-62ac1b9f49f3 service nova] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] Updated VIF entry in instance network info cache for port ecba9b76-45d2-49e7-addc-367dc21b38ce. {{(pid=71874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 16:17:40 user nova-compute[71874]: DEBUG nova.network.neutron [req-badef273-20a3-4fbd-8c4d-d834d7512e79 req-4cff0207-d493-45d7-9b53-62ac1b9f49f3 service nova] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] Updating instance_info_cache with network_info: [{"id": "ecba9b76-45d2-49e7-addc-367dc21b38ce", "address": "fa:16:3e:e4:f4:15", "network": {"id": "e6694358-e361-4952-b859-93755c11721e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-667152893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97ea81bd1962466bbe552424973f71a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecba9b76-45", "ovs_interfaceid": "ecba9b76-45d2-49e7-addc-367dc21b38ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:17:40 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-badef273-20a3-4fbd-8c4d-d834d7512e79 req-4cff0207-d493-45d7-9b53-62ac1b9f49f3 service nova] Releasing lock "refresh_cache-bef10c89-360e-42d6-aa26-7edf1afca567" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:17:41 user nova-compute[71874]: INFO nova.virt.libvirt.driver [-] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] Instance destroyed successfully.
Apr 12 16:17:41 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T16:15:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1742194488',display_name='tempest-ServerActionsTestJSON-server-1742194488',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1742194488',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNmXVADjvoPSh3uGCGCTNS/vcfcDtUjn/vZEaV3bCllfz1ZO8VIgFuZhP+mAsa+G/KA4ubi5U9Vj41YtHGsakdPR5VoByhorvfUv/PIWtER2tn1LWX2mlFyT+T8AEJplPw==',key_name='tempest-keypair-1923467613',keypairs=<?>,launch_index=0,launched_at=2023-04-12T16:15:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='97ea81bd1962466bbe552424973f71a8',ramdisk_id='',reservation_id='r-kpxobl69',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-631887779',owner_user_name='tempest-ServerActionsTestJSON-631887779-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T16:17:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1a699b3ba8304eadb8a53d465ea340cf',uuid=bef10c89-360e-42d6-aa26-7edf1afca567,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ecba9b76-45d2-49e7-addc-367dc21b38ce", "address": "fa:16:3e:e4:f4:15", "network": {"id": "e6694358-e361-4952-b859-93755c11721e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-667152893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-667152893-network", "vif_mac": "fa:16:3e:e4:f4:15"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97ea81bd1962466bbe552424973f71a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecba9b76-45", "ovs_interfaceid": "ecba9b76-45d2-49e7-addc-367dc21b38ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 16:17:41 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Converting VIF {"id": "ecba9b76-45d2-49e7-addc-367dc21b38ce", "address": "fa:16:3e:e4:f4:15", "network": {"id": "e6694358-e361-4952-b859-93755c11721e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-667152893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-667152893-network", "vif_mac": "fa:16:3e:e4:f4:15"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97ea81bd1962466bbe552424973f71a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecba9b76-45", "ovs_interfaceid": "ecba9b76-45d2-49e7-addc-367dc21b38ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:17:41 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e4:f4:15,bridge_name='br-int',has_traffic_filtering=True,id=ecba9b76-45d2-49e7-addc-367dc21b38ce,network=Network(e6694358-e361-4952-b859-93755c11721e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecba9b76-45') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:17:41 user nova-compute[71874]: DEBUG os_vif [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e4:f4:15,bridge_name='br-int',has_traffic_filtering=True,id=ecba9b76-45d2-49e7-addc-367dc21b38ce,network=Network(e6694358-e361-4952-b859-93755c11721e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecba9b76-45') {{(pid=71874) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 16:17:41 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:17:41 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapecba9b76-45, bridge=br-int, if_exists=True) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:17:41 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:17:41 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:17:41 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:17:41 user nova-compute[71874]: INFO os_vif [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e4:f4:15,bridge_name='br-int',has_traffic_filtering=True,id=ecba9b76-45d2-49e7-addc-367dc21b38ce,network=Network(e6694358-e361-4952-b859-93755c11721e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecba9b76-45')
Apr 12 16:17:41 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] calling os-brick to detach iSCSI Volume {{(pid=71874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 16:17:41 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3c0216320>, {'target_iqn': 'iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IalnbXCE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:17:41 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:17:41 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:17:41 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:17:41 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:17:41 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:17:41 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[90ff3a35-e339-4a11-add3-3a954e36ea2a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:63821959-5dfd-4f66-a6e5-90a20b30efab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:17:41 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 16:17:41 user nova-compute[71874]: No targets found.
Apr 12 16:17:41 user nova-compute[71874]: iSNS:
Apr 12 16:17:41 user nova-compute[71874]: No targets found.
Apr 12 16:17:41 user nova-compute[71874]: STATIC:
Apr 12 16:17:41 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:63821959-5dfd-4f66-a6e5-90a20b30efab
Apr 12 16:17:41 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:17:41 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:17:41 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775
Apr 12 16:17:41 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:17:41 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:17:41 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2
Apr 12 16:17:41 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:17:41 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:17:41 user nova-compute[71874]: FIRMWARE:
Apr 12 16:17:41 user nova-compute[71874]: No targets found.
Apr 12 16:17:41 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:17:41 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 16:17:41 user nova-compute[71874]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 16:17:41 user nova-compute[71874]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71874) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 16:17:41 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775', 0)] {{(pid=71874) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 16:17:41 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:17:41 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:17:41 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[8245ddea-eb40-422c-b2dd-c3756de512fd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:63821959-5dfd-4f66-a6e5-90a20b30efab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:17:41 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:17:41 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:17:41 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[939274b0-c84d-4aec-9d70-8056b9213b51]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63821959-5dfd-4f66-a6e5-90a20b30efab (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:17:41 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:17:41 user nova-compute[71874]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775 (non-flash)
Apr 12 16:17:41 user nova-compute[71874]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63821959-5dfd-4f66-a6e5-90a20b30efab (non-flash)
Apr 12 16:17:41 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:17:41 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:17:41 user nova-compute[71874]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775 (non-flash)
Apr 12 16:17:41 user nova-compute[71874]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63821959-5dfd-4f66-a6e5-90a20b30efab (non-flash)
Apr 12 16:17:41 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:17:41 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc3c03d1bd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775'): ({'sde'}, set())}) {{(pid=71874) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 16:17:41 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Removing single pathed devices sde {{(pid=71874) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 16:17:41 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:17:41 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:17:41 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccabad43-48b7-4020-bb22-53c0e930738a]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:17:41 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:17:41 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.024s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:17:41 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2125d46-f1f7-4264-b76b-26905b13e725]: (4, ('ok\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:17:41 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Flushing IO for device /dev/sde {{(pid=71874) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 16:17:41 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:17:41 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.019s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:17:41 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[91aa0235-9489-4fb7-8731-5f51b050711a]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:17:41 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71874) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 16:17:41 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:17:41 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.051s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:17:41 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[941bf082-4014-4958-983d-c3ae48a26371]: (4, ('1', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:17:41 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71874) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 16:17:41 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] SCSI volumes sde have been removed. {{(pid=71874) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 16:17:41 user nova-compute[71874]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_b44b7610', '/dev/disk/by-id/scsi-1SCST_BIOb44b7610-b7333ce8c83e8989', '/dev/disk/by-id/scsi-26237333333636538') {{(pid=82384) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 12 16:17:41 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[096d66d6-d4a0-4ea8-bc50-190652ee70ea]: (4, None) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:17:41 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775')] {{(pid=71874) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 16:17:41 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:17:41 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:17:41 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[23af1ea7-0d89-4d0e-a9e1-80cc6a25cefa]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:17:41 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:17:41 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775 -p 172.16.0.220:3260 --logout {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:17:41 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:17:41 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[320731cd-bafb-4536-942c-520eff5e4d0e]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:17:41 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775, portal: 172.16.0.220,3260]
Apr 12 16:17:41 user nova-compute[71874]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775, portal: 172.16.0.220,3260] successful.
Apr 12 16:17:41 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:17:41 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775 -p 172.16.0.220:3260 --op delete {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:17:41 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.100s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:17:41 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[5beaf74e-dc56-42b2-ae9c-7c1bf3a982ac]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:17:41 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:17:41 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.426s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:17:41 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] <== disconnect_volume: return (428ms) None {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:17:41 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] Disconnected iSCSI Volume {{(pid=71874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 16:17:41 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] skipping disk /dev/sde (vda) as it is a volume {{(pid=71874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 16:17:42 user nova-compute[71874]: DEBUG nova.network.neutron [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] Port ecba9b76-45d2-49e7-addc-367dc21b38ce binding to destination host user is already ACTIVE {{(pid=71874) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3161}}
Apr 12 16:17:42 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "bef10c89-360e-42d6-aa26-7edf1afca567-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:17:42 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "bef10c89-360e-42d6-aa26-7edf1afca567-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:17:42 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "bef10c89-360e-42d6-aa26-7edf1afca567-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:17:42 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "refresh_cache-bef10c89-360e-42d6-aa26-7edf1afca567" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:17:42 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquired lock "refresh_cache-bef10c89-360e-42d6-aa26-7edf1afca567" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:17:42 user nova-compute[71874]: DEBUG nova.network.neutron [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] Building network info cache for instance {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 16:17:42 user nova-compute[71874]: DEBUG nova.compute.manager [req-ff6f568a-23bb-40bb-b462-c5af616ceb61 req-9a90cf47-6661-4b9e-a9d3-13510d931a51 service nova] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] Received event network-vif-plugged-ecba9b76-45d2-49e7-addc-367dc21b38ce {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:17:42 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-ff6f568a-23bb-40bb-b462-c5af616ceb61 req-9a90cf47-6661-4b9e-a9d3-13510d931a51 service nova] Acquiring lock "bef10c89-360e-42d6-aa26-7edf1afca567-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:17:42 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-ff6f568a-23bb-40bb-b462-c5af616ceb61 req-9a90cf47-6661-4b9e-a9d3-13510d931a51 service nova] Lock "bef10c89-360e-42d6-aa26-7edf1afca567-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:17:42 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-ff6f568a-23bb-40bb-b462-c5af616ceb61 req-9a90cf47-6661-4b9e-a9d3-13510d931a51 service nova] Lock "bef10c89-360e-42d6-aa26-7edf1afca567-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:17:42 user nova-compute[71874]: DEBUG nova.compute.manager [req-ff6f568a-23bb-40bb-b462-c5af616ceb61 req-9a90cf47-6661-4b9e-a9d3-13510d931a51 service nova] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] No waiting events found dispatching network-vif-plugged-ecba9b76-45d2-49e7-addc-367dc21b38ce {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:17:42 user nova-compute[71874]: WARNING nova.compute.manager [req-ff6f568a-23bb-40bb-b462-c5af616ceb61 req-9a90cf47-6661-4b9e-a9d3-13510d931a51 service nova] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] Received unexpected event network-vif-plugged-ecba9b76-45d2-49e7-addc-367dc21b38ce for instance with vm_state active and task_state resize_migrated.
Apr 12 16:17:43 user nova-compute[71874]: DEBUG nova.network.neutron [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] Updating instance_info_cache with network_info: [{"id": "ecba9b76-45d2-49e7-addc-367dc21b38ce", "address": "fa:16:3e:e4:f4:15", "network": {"id": "e6694358-e361-4952-b859-93755c11721e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-667152893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97ea81bd1962466bbe552424973f71a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecba9b76-45", "ovs_interfaceid": "ecba9b76-45d2-49e7-addc-367dc21b38ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:17:43 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Releasing lock "refresh_cache-bef10c89-360e-42d6-aa26-7edf1afca567" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:17:43 user nova-compute[71874]: DEBUG os_brick.utils [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:17:43 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:17:43 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:17:43 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[da051964-4b5e-466d-91bb-214959639278]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:61a48d4489d2\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:17:43 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:17:43 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:17:43 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c89a8f9-7e58-4e33-b23b-045335c2edd1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:17:43 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:17:43 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:17:43 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:17:43 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[286fa18b-55bc-4667-a45b-669420915eaa]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:17:43 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac84e564-a112-4b10-bcb3-6fb1633913d8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:17:43 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Running cmd (subprocess): nvme version {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:17:43 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] 'nvme version' failed. Not Retrying. {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 16:17:43 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.nvmeof [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] nvme not present on system {{(pid=71874) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 16:17:43 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:17:43 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 16:17:43 user nova-compute[71874]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 16:17:43 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[01db9f9a-ce88-4bd5-a976-1bfaa4703863]: (4, '') {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:17:43 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.lightos [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71874) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 16:17:43 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.lightos [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71874) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 16:17:43 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.lightos [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] LIGHTOS: no hostnqn found. {{(pid=71874) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 16:17:43 user nova-compute[71874]: DEBUG os_brick.utils [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:61a48d4489d2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:17:45 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-32074722-9dad-4b8e-b284-22fa3bca9012 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Acquiring lock "540a8fd5-8c18-4efe-97d4-9f0942cebcf5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:17:45 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-32074722-9dad-4b8e-b284-22fa3bca9012 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "540a8fd5-8c18-4efe-97d4-9f0942cebcf5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:17:45 user nova-compute[71874]: DEBUG nova.objects.instance [None req-32074722-9dad-4b8e-b284-22fa3bca9012 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lazy-loading 'flavor' on Instance uuid 540a8fd5-8c18-4efe-97d4-9f0942cebcf5 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:17:45 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-32074722-9dad-4b8e-b284-22fa3bca9012 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "540a8fd5-8c18-4efe-97d4-9f0942cebcf5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:17:45 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-32074722-9dad-4b8e-b284-22fa3bca9012 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Acquiring lock "540a8fd5-8c18-4efe-97d4-9f0942cebcf5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:17:45 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-32074722-9dad-4b8e-b284-22fa3bca9012 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "540a8fd5-8c18-4efe-97d4-9f0942cebcf5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:17:45 user nova-compute[71874]: INFO nova.compute.manager [None req-32074722-9dad-4b8e-b284-22fa3bca9012 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] [instance: 540a8fd5-8c18-4efe-97d4-9f0942cebcf5] Attaching volume f226cff8-461e-4933-9803-280654a66125 to /dev/vdb
Apr 12 16:17:45 user nova-compute[71874]: DEBUG os_brick.utils [None req-32074722-9dad-4b8e-b284-22fa3bca9012 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:17:45 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:17:45 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:17:45 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[b630768c-88fe-40c5-876d-b32ae6c56bf7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:61a48d4489d2\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:17:45 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:17:45 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:17:45 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2bde69a-eac5-44ef-8302-49936426fb7e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:17:45 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:17:45 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:17:45 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ea81981-5256-41b3-a6a2-12b51f0412bd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:17:45 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cc2aa13-39ff-411e-984a-71c959db03e8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:17:45 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-32074722-9dad-4b8e-b284-22fa3bca9012 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Running cmd (subprocess): nvme version {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:17:45 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-32074722-9dad-4b8e-b284-22fa3bca9012 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] 'nvme version' failed. Not Retrying. {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 16:17:45 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.nvmeof [None req-32074722-9dad-4b8e-b284-22fa3bca9012 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] nvme not present on system {{(pid=71874) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 16:17:45 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:17:45 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 16:17:45 user nova-compute[71874]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 16:17:45 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[b93f3085-d85e-4372-818f-938b068f0b40]: (4, '') {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:17:45 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.lightos [None req-32074722-9dad-4b8e-b284-22fa3bca9012 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71874) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 16:17:45 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.lightos [None req-32074722-9dad-4b8e-b284-22fa3bca9012 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71874) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 16:17:45 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.lightos [None req-32074722-9dad-4b8e-b284-22fa3bca9012 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] LIGHTOS: no hostnqn found. {{(pid=71874) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 16:17:45 user nova-compute[71874]: DEBUG os_brick.utils [None req-32074722-9dad-4b8e-b284-22fa3bca9012 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:61a48d4489d2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:17:45 user nova-compute[71874]: DEBUG nova.virt.block_device [None req-32074722-9dad-4b8e-b284-22fa3bca9012 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] [instance: 540a8fd5-8c18-4efe-97d4-9f0942cebcf5] Updating existing volume attachment record: 76bc3e74-7f0d-47b6-9965-e4916cedb46b {{(pid=71874) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 16:17:46 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:17:48 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] Starting finish_migration {{(pid=71874) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11647}}
Apr 12 16:17:48 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] Instance directory exists: not creating {{(pid=71874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 12 16:17:48 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] Creating image(s)
Apr 12 16:17:48 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] Did not create local disks {{(pid=71874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 12 16:17:48 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] Ensure instance console log exists: /opt/stack/data/nova/instances/bef10c89-360e-42d6-aa26-7edf1afca567/console.log {{(pid=71874) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 16:17:48 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:17:48 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:17:48 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:17:48 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] Start _get_guest_xml network_info=[{"id": "ecba9b76-45d2-49e7-addc-367dc21b38ce", "address": "fa:16:3e:e4:f4:15", "network": {"id": "e6694358-e361-4952-b859-93755c11721e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-667152893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-667152893-network", "vif_mac": "fa:16:3e:e4:f4:15"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97ea81bd1962466bbe552424973f71a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecba9b76-45", "ovs_interfaceid": "ecba9b76-45d2-49e7-addc-367dc21b38ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'delete_on_termination': True, 'attachment_id': '749e1658-eead-4539-b14c-4494b1773ae2', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IalnbXCE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'bef10c89-360e-42d6-aa26-7edf1afca567', 'attached_at': '2023-04-12T16:17:48.000000', 'detached_at': '', 'volume_id': 'b5a801df-b37e-4132-8465-d4011ca47775', 'serial': 'b5a801df-b37e-4132-8465-d4011ca47775'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'volume_type': None} {{(pid=71874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 16:17:48 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:17:48 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:17:48 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71874) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 16:17:48 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T15:56:47Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=192,name='m1.micro',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 16:17:48 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Flavor limits 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 16:17:48 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Image limits 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 16:17:48 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Flavor pref 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 16:17:48 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Image pref 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 16:17:48 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 16:17:48 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 16:17:48 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 16:17:48 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Got 1 possible topologies {{(pid=71874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 16:17:48 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 16:17:48 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 16:17:48 user nova-compute[71874]: DEBUG nova.objects.instance [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lazy-loading 'vcpu_model' on Instance uuid bef10c89-360e-42d6-aa26-7edf1afca567 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:17:48 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] Calling os-brick to attach iSCSI Volume {{(pid=71874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 16:17:48 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3c0216320>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IalnbXCE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:17:48 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:17:48 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:17:48 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:17:48 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:17:48 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:17:48 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:17:48 user nova-compute[71874]: INFO os_brick.initiator.connectors.iscsi [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 16:17:48 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775 -p 172.16.0.220:3260 {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:17:48 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:17:48 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[3268ff6f-1baa-4cf3-8d6d-89870fdd5db4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:17:48 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 16:17:48 user nova-compute[71874]:  {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:17:48 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775 -p 172.16.0.220:3260 --interface default --op new {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:17:48 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:17:48 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[d24649a8-91d9-40ab-a0b2-dcc2f825d4a6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775] added\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:17:48 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775] added
Apr 12 16:17:48 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:17:48 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:17:48 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:17:48 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[623f7abf-a7d5-41f2-9bf7-99e947d4559e]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:17:48 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:17:48 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:17:48 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:17:48 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dd23b8f-e1ee-44ea-8b58-5794ade97fe5]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:17:48 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:17:48 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IalnbXCE {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:17:48 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IalnbXCE" returned: 0 in 0.018s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:17:48 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[89344414-d11d-4854-b3a7-becf0189741f]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:17:48 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IalnbXCE'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:17:48 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:17:48 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:17:48 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[db396ff9-692a-4d0f-ac84-70e76ad251ae]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:17:48 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:17:48 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:17:48 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:17:48 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[048042ed-3c95-4b34-b4c5-c48e3ac14705]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63821959-5dfd-4f66-a6e5-90a20b30efab (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:17:48 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:17:48 user nova-compute[71874]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63821959-5dfd-4f66-a6e5-90a20b30efab (non-flash)
Apr 12 16:17:48 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:17:48 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:17:48 user nova-compute[71874]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63821959-5dfd-4f66-a6e5-90a20b30efab (non-flash)
Apr 12 16:17:48 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:17:48 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775 -p 172.16.0.220:3260 --login {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:17:48 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:17:48 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[030b0522-ca8e-496d-9ec8-3603fd024e06]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:17:48 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775, portal: 172.16.0.220,3260]
Apr 12 16:17:48 user nova-compute[71874]: Login to [iface: default, target: iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775, portal: 172.16.0.220,3260] successful.
Apr 12 16:17:48 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:17:48 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:17:48 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:17:48 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5b86d9e-cae8-47c3-b3cb-0c48816007c5]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:17:48 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:17:48 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:17:48 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:17:48 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[e53266fd-b4a1-48c5-9f82-6cccd8689de8]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63821959-5dfd-4f66-a6e5-90a20b30efab (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775 (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:17:48 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:17:48 user nova-compute[71874]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63821959-5dfd-4f66-a6e5-90a20b30efab (non-flash)
Apr 12 16:17:48 user nova-compute[71874]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775 (non-flash)
Apr 12 16:17:48 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:17:48 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:17:48 user nova-compute[71874]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63821959-5dfd-4f66-a6e5-90a20b30efab (non-flash)
Apr 12 16:17:48 user nova-compute[71874]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775 (non-flash)
Apr 12 16:17:48 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:17:48 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:17:48 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Connected to 172.16.0.220:3260 {{(pid=71874) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 16:17:48 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] HCTL ('35', '-', '-', 0) found on session 41 with lun 0 {{(pid=71874) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 16:17:48 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71874) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 16:17:48 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:17:48 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:17:48 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bb6260a-988e-4c72-bbf6-0d4468b79802]: (4, ('- - 0', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:17:48 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Searching for a device in session 41 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71874) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 16:17:48 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IalnbXCE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71874) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 16:17:48 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:17:49 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:17:49 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] <== connect_volume: return (1316ms) {'type': 'block', 'scsi_wwn': '26237333333636538', 'path': '/dev/sdd'} {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:17:49 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26237333333636538', 'path': '/dev/sdd'} {{(pid=71874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 16:17:49 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T16:15:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1742194488',display_name='tempest-ServerActionsTestJSON-server-1742194488',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1742194488',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNmXVADjvoPSh3uGCGCTNS/vcfcDtUjn/vZEaV3bCllfz1ZO8VIgFuZhP+mAsa+G/KA4ubi5U9Vj41YtHGsakdPR5VoByhorvfUv/PIWtER2tn1LWX2mlFyT+T8AEJplPw==',key_name='tempest-keypair-1923467613',keypairs=<?>,launch_index=0,launched_at=2023-04-12T16:15:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='97ea81bd1962466bbe552424973f71a8',ramdisk_id='',reservation_id='r-kpxobl69',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-631887779',owner_user_name='tempest-ServerActionsTestJSON-631887779-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T16:17:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1a699b3ba8304eadb8a53d465ea340cf',uuid=bef10c89-360e-42d6-aa26-7edf1afca567,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ecba9b76-45d2-49e7-addc-367dc21b38ce", "address": "fa:16:3e:e4:f4:15", "network": {"id": "e6694358-e361-4952-b859-93755c11721e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-667152893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-667152893-network", "vif_mac": "fa:16:3e:e4:f4:15"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97ea81bd1962466bbe552424973f71a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecba9b76-45", "ovs_interfaceid": "ecba9b76-45d2-49e7-addc-367dc21b38ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 16:17:49 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Converting VIF {"id": "ecba9b76-45d2-49e7-addc-367dc21b38ce", "address": "fa:16:3e:e4:f4:15", "network": {"id": "e6694358-e361-4952-b859-93755c11721e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-667152893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-667152893-network", "vif_mac": "fa:16:3e:e4:f4:15"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97ea81bd1962466bbe552424973f71a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecba9b76-45", "ovs_interfaceid": "ecba9b76-45d2-49e7-addc-367dc21b38ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:17:49 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:f4:15,bridge_name='br-int',has_traffic_filtering=True,id=ecba9b76-45d2-49e7-addc-367dc21b38ce,network=Network(e6694358-e361-4952-b859-93755c11721e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecba9b76-45') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:17:49 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] End _get_guest_xml xml=<domain type="kvm">
Apr 12 16:17:49 user nova-compute[71874]:   <uuid>bef10c89-360e-42d6-aa26-7edf1afca567</uuid>
Apr 12 16:17:49 user nova-compute[71874]:   <name>instance-00000026</name>
Apr 12 16:17:49 user nova-compute[71874]:   <memory>196608</memory>
Apr 12 16:17:49 user nova-compute[71874]:   <vcpu>1</vcpu>
Apr 12 16:17:49 user nova-compute[71874]:   <metadata>
Apr 12 16:17:49 user nova-compute[71874]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 16:17:49 user nova-compute[71874]:       <nova:package version="0.0.0"/>
Apr 12 16:17:49 user nova-compute[71874]:       <nova:name>tempest-ServerActionsTestJSON-server-1742194488</nova:name>
Apr 12 16:17:49 user nova-compute[71874]:       <nova:creationTime>2023-04-12 16:17:48</nova:creationTime>
Apr 12 16:17:49 user nova-compute[71874]:       <nova:flavor name="m1.micro">
Apr 12 16:17:49 user nova-compute[71874]:         <nova:memory>192</nova:memory>
Apr 12 16:17:49 user nova-compute[71874]:         <nova:disk>1</nova:disk>
Apr 12 16:17:49 user nova-compute[71874]:         <nova:swap>0</nova:swap>
Apr 12 16:17:49 user nova-compute[71874]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 16:17:49 user nova-compute[71874]:         <nova:vcpus>1</nova:vcpus>
Apr 12 16:17:49 user nova-compute[71874]:       </nova:flavor>
Apr 12 16:17:49 user nova-compute[71874]:       <nova:owner>
Apr 12 16:17:49 user nova-compute[71874]:         <nova:user uuid="1a699b3ba8304eadb8a53d465ea340cf">tempest-ServerActionsTestJSON-631887779-project-member</nova:user>
Apr 12 16:17:49 user nova-compute[71874]:         <nova:project uuid="97ea81bd1962466bbe552424973f71a8">tempest-ServerActionsTestJSON-631887779</nova:project>
Apr 12 16:17:49 user nova-compute[71874]:       </nova:owner>
Apr 12 16:17:49 user nova-compute[71874]:       <nova:ports>
Apr 12 16:17:49 user nova-compute[71874]:         <nova:port uuid="ecba9b76-45d2-49e7-addc-367dc21b38ce">
Apr 12 16:17:49 user nova-compute[71874]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 12 16:17:49 user nova-compute[71874]:         </nova:port>
Apr 12 16:17:49 user nova-compute[71874]:       </nova:ports>
Apr 12 16:17:49 user nova-compute[71874]:     </nova:instance>
Apr 12 16:17:49 user nova-compute[71874]:   </metadata>
Apr 12 16:17:49 user nova-compute[71874]:   <sysinfo type="smbios">
Apr 12 16:17:49 user nova-compute[71874]:     <system>
Apr 12 16:17:49 user nova-compute[71874]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 16:17:49 user nova-compute[71874]:       <entry name="product">OpenStack Nova</entry>
Apr 12 16:17:49 user nova-compute[71874]:       <entry name="version">0.0.0</entry>
Apr 12 16:17:49 user nova-compute[71874]:       <entry name="serial">bef10c89-360e-42d6-aa26-7edf1afca567</entry>
Apr 12 16:17:49 user nova-compute[71874]:       <entry name="uuid">bef10c89-360e-42d6-aa26-7edf1afca567</entry>
Apr 12 16:17:49 user nova-compute[71874]:       <entry name="family">Virtual Machine</entry>
Apr 12 16:17:49 user nova-compute[71874]:     </system>
Apr 12 16:17:49 user nova-compute[71874]:   </sysinfo>
Apr 12 16:17:49 user nova-compute[71874]:   <os>
Apr 12 16:17:49 user nova-compute[71874]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 16:17:49 user nova-compute[71874]:     <boot dev="hd"/>
Apr 12 16:17:49 user nova-compute[71874]:     <smbios mode="sysinfo"/>
Apr 12 16:17:49 user nova-compute[71874]:   </os>
Apr 12 16:17:49 user nova-compute[71874]:   <features>
Apr 12 16:17:49 user nova-compute[71874]:     <acpi/>
Apr 12 16:17:49 user nova-compute[71874]:     <apic/>
Apr 12 16:17:49 user nova-compute[71874]:     <vmcoreinfo/>
Apr 12 16:17:49 user nova-compute[71874]:   </features>
Apr 12 16:17:49 user nova-compute[71874]:   <clock offset="utc">
Apr 12 16:17:49 user nova-compute[71874]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 16:17:49 user nova-compute[71874]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 16:17:49 user nova-compute[71874]:     <timer name="hpet" present="no"/>
Apr 12 16:17:49 user nova-compute[71874]:   </clock>
Apr 12 16:17:49 user nova-compute[71874]:   <cpu mode="custom" match="exact">
Apr 12 16:17:49 user nova-compute[71874]:     <model>Nehalem</model>
Apr 12 16:17:49 user nova-compute[71874]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 16:17:49 user nova-compute[71874]:   </cpu>
Apr 12 16:17:49 user nova-compute[71874]:   <devices>
Apr 12 16:17:49 user nova-compute[71874]:     <disk type="block" device="disk">
Apr 12 16:17:49 user nova-compute[71874]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 16:17:49 user nova-compute[71874]:       <source dev="/dev/sdd"/>
Apr 12 16:17:49 user nova-compute[71874]:       <target dev="vda" bus="virtio"/>
Apr 12 16:17:49 user nova-compute[71874]:       <serial>b5a801df-b37e-4132-8465-d4011ca47775</serial>
Apr 12 16:17:49 user nova-compute[71874]:     </disk>
Apr 12 16:17:49 user nova-compute[71874]:     <interface type="ethernet">
Apr 12 16:17:49 user nova-compute[71874]:       <mac address="fa:16:3e:e4:f4:15"/>
Apr 12 16:17:49 user nova-compute[71874]:       <model type="virtio"/>
Apr 12 16:17:49 user nova-compute[71874]:       <mtu size="1442"/>
Apr 12 16:17:49 user nova-compute[71874]:       <target dev="tapecba9b76-45"/>
Apr 12 16:17:49 user nova-compute[71874]:     </interface>
Apr 12 16:17:49 user nova-compute[71874]:     <serial type="pty">
Apr 12 16:17:49 user nova-compute[71874]:       <log file="/opt/stack/data/nova/instances/bef10c89-360e-42d6-aa26-7edf1afca567/console.log" append="off"/>
Apr 12 16:17:49 user nova-compute[71874]:     </serial>
Apr 12 16:17:49 user nova-compute[71874]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 16:17:49 user nova-compute[71874]:     <video>
Apr 12 16:17:49 user nova-compute[71874]:       <model type="virtio"/>
Apr 12 16:17:49 user nova-compute[71874]:     </video>
Apr 12 16:17:49 user nova-compute[71874]:     <rng model="virtio">
Apr 12 16:17:49 user nova-compute[71874]:       <backend model="random">/dev/urandom</backend>
Apr 12 16:17:49 user nova-compute[71874]:     </rng>
Apr 12 16:17:49 user nova-compute[71874]:     <controller type="usb" index="0" model="none"/>
Apr 12 16:17:49 user nova-compute[71874]:     <memballoon model="virtio">
Apr 12 16:17:49 user nova-compute[71874]:       <stats period="10"/>
Apr 12 16:17:49 user nova-compute[71874]:     </memballoon>
Apr 12 16:17:49 user nova-compute[71874]:   </devices>
Apr 12 16:17:49 user nova-compute[71874]: </domain>
Apr 12 16:17:49 user nova-compute[71874]:  {{(pid=71874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 16:17:49 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T16:15:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1742194488',display_name='tempest-ServerActionsTestJSON-server-1742194488',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1742194488',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNmXVADjvoPSh3uGCGCTNS/vcfcDtUjn/vZEaV3bCllfz1ZO8VIgFuZhP+mAsa+G/KA4ubi5U9Vj41YtHGsakdPR5VoByhorvfUv/PIWtER2tn1LWX2mlFyT+T8AEJplPw==',key_name='tempest-keypair-1923467613',keypairs=<?>,launch_index=0,launched_at=2023-04-12T16:15:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='97ea81bd1962466bbe552424973f71a8',ramdisk_id='',reservation_id='r-kpxobl69',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-631887779',owner_user_name='tempest-ServerActionsTestJSON-631887779-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T16:17:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1a699b3ba8304eadb8a53d465ea340cf',uuid=bef10c89-360e-42d6-aa26-7edf1afca567,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ecba9b76-45d2-49e7-addc-367dc21b38ce", "address": "fa:16:3e:e4:f4:15", "network": {"id": "e6694358-e361-4952-b859-93755c11721e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-667152893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-667152893-network", "vif_mac": "fa:16:3e:e4:f4:15"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97ea81bd1962466bbe552424973f71a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecba9b76-45", "ovs_interfaceid": "ecba9b76-45d2-49e7-addc-367dc21b38ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 16:17:49 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Converting VIF {"id": "ecba9b76-45d2-49e7-addc-367dc21b38ce", "address": "fa:16:3e:e4:f4:15", "network": {"id": "e6694358-e361-4952-b859-93755c11721e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-667152893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-667152893-network", "vif_mac": "fa:16:3e:e4:f4:15"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97ea81bd1962466bbe552424973f71a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecba9b76-45", "ovs_interfaceid": "ecba9b76-45d2-49e7-addc-367dc21b38ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:17:49 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:f4:15,bridge_name='br-int',has_traffic_filtering=True,id=ecba9b76-45d2-49e7-addc-367dc21b38ce,network=Network(e6694358-e361-4952-b859-93755c11721e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecba9b76-45') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:17:49 user nova-compute[71874]: DEBUG os_vif [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:f4:15,bridge_name='br-int',has_traffic_filtering=True,id=ecba9b76-45d2-49e7-addc-367dc21b38ce,network=Network(e6694358-e361-4952-b859-93755c11721e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecba9b76-45') {{(pid=71874) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 16:17:49 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:17:49 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:17:49 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 16:17:49 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:17:49 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapecba9b76-45, may_exist=True) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:17:49 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapecba9b76-45, col_values=(('external_ids', {'iface-id': 'ecba9b76-45d2-49e7-addc-367dc21b38ce', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e4:f4:15', 'vm-uuid': 'bef10c89-360e-42d6-aa26-7edf1afca567'}),)) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:17:49 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:17:49 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:17:49 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:17:49 user nova-compute[71874]: INFO os_vif [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:f4:15,bridge_name='br-int',has_traffic_filtering=True,id=ecba9b76-45d2-49e7-addc-367dc21b38ce,network=Network(e6694358-e361-4952-b859-93755c11721e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecba9b76-45')
Apr 12 16:17:49 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] No BDM found with device name vda, not building metadata. {{(pid=71874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 16:17:49 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] No VIF found with MAC fa:16:3e:e4:f4:15, not building metadata {{(pid=71874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 16:17:50 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32074722-9dad-4b8e-b284-22fa3bca9012 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] [instance: 540a8fd5-8c18-4efe-97d4-9f0942cebcf5] Calling os-brick to attach iSCSI Volume {{(pid=71874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 16:17:50 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-32074722-9dad-4b8e-b284-22fa3bca9012 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3c0216320>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f226cff8-461e-4933-9803-280654a66125', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WNwhRiuP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:17:50 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-32074722-9dad-4b8e-b284-22fa3bca9012 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:17:50 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-32074722-9dad-4b8e-b284-22fa3bca9012 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:17:50 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-32074722-9dad-4b8e-b284-22fa3bca9012 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:17:50 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-32074722-9dad-4b8e-b284-22fa3bca9012 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:17:50 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-32074722-9dad-4b8e-b284-22fa3bca9012 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f226cff8-461e-4933-9803-280654a66125" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:17:50 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-32074722-9dad-4b8e-b284-22fa3bca9012 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f226cff8-461e-4933-9803-280654a66125" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:17:50 user nova-compute[71874]: INFO os_brick.initiator.connectors.iscsi [None req-32074722-9dad-4b8e-b284-22fa3bca9012 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 16:17:50 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f226cff8-461e-4933-9803-280654a66125 -p 172.16.0.220:3260 {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:17:50 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f226cff8-461e-4933-9803-280654a66125 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:17:50 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a0b93bb-debf-4067-b084-b8be2a43bdbe]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:17:50 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-32074722-9dad-4b8e-b284-22fa3bca9012 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 16:17:50 user nova-compute[71874]:  {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:17:50 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f226cff8-461e-4933-9803-280654a66125 -p 172.16.0.220:3260 --interface default --op new {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:17:50 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f226cff8-461e-4933-9803-280654a66125 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:17:50 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9e8a1c9-92c1-42b3-a20b-3244c6adb800]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f226cff8-461e-4933-9803-280654a66125] added\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:17:50 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-32074722-9dad-4b8e-b284-22fa3bca9012 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f226cff8-461e-4933-9803-280654a66125] added
Apr 12 16:17:50 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:17:50 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f226cff8-461e-4933-9803-280654a66125 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:17:50 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f226cff8-461e-4933-9803-280654a66125 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:17:50 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[3590ac07-be2f-470d-9f90-4ff37dbcd1fa]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:17:50 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-32074722-9dad-4b8e-b284-22fa3bca9012 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:17:50 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f226cff8-461e-4933-9803-280654a66125 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:17:50 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f226cff8-461e-4933-9803-280654a66125 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:17:50 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[d22adae6-b9d9-4778-a5ac-480dbf591401]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:17:50 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-32074722-9dad-4b8e-b284-22fa3bca9012 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:17:50 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f226cff8-461e-4933-9803-280654a66125 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WNwhRiuP {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:17:50 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f226cff8-461e-4933-9803-280654a66125 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WNwhRiuP" returned: 0 in 0.020s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:17:50 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[a74f4a9e-df93-422d-abef-5ae8695e42fc]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:17:50 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-32074722-9dad-4b8e-b284-22fa3bca9012 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WNwhRiuP'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:17:50 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f226cff8-461e-4933-9803-280654a66125 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:17:50 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f226cff8-461e-4933-9803-280654a66125 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:17:50 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[e329563b-1ab2-4d14-a855-ed447924c2f2]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:17:50 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-32074722-9dad-4b8e-b284-22fa3bca9012 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:17:50 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:17:50 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:17:50 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[49abb5e6-045d-4445-aef5-14330fc8707c]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63821959-5dfd-4f66-a6e5-90a20b30efab (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775 (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:17:50 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-32074722-9dad-4b8e-b284-22fa3bca9012 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:17:50 user nova-compute[71874]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63821959-5dfd-4f66-a6e5-90a20b30efab (non-flash)
Apr 12 16:17:50 user nova-compute[71874]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775 (non-flash)
Apr 12 16:17:50 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:17:50 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-32074722-9dad-4b8e-b284-22fa3bca9012 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:17:50 user nova-compute[71874]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63821959-5dfd-4f66-a6e5-90a20b30efab (non-flash)
Apr 12 16:17:50 user nova-compute[71874]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775 (non-flash)
Apr 12 16:17:50 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:17:50 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f226cff8-461e-4933-9803-280654a66125 -p 172.16.0.220:3260 --login {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:17:50 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f226cff8-461e-4933-9803-280654a66125 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:17:50 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[12a47d90-fca0-4ad9-80a9-50de18f2c3e4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f226cff8-461e-4933-9803-280654a66125, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f226cff8-461e-4933-9803-280654a66125, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:17:50 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-32074722-9dad-4b8e-b284-22fa3bca9012 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f226cff8-461e-4933-9803-280654a66125, portal: 172.16.0.220,3260]
Apr 12 16:17:50 user nova-compute[71874]: Login to [iface: default, target: iqn.2010-10.org.openstack:f226cff8-461e-4933-9803-280654a66125, portal: 172.16.0.220,3260] successful.
Apr 12 16:17:50 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:17:50 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f226cff8-461e-4933-9803-280654a66125 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:17:50 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f226cff8-461e-4933-9803-280654a66125 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:17:50 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7702a5f-f30f-4fe2-8fa8-6e5f5701b2fd]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:17:50 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-32074722-9dad-4b8e-b284-22fa3bca9012 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:17:50 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:17:50 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:17:50 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[052ecab9-2c66-408c-a4c2-b998c17e5f1c]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63821959-5dfd-4f66-a6e5-90a20b30efab (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f226cff8-461e-4933-9803-280654a66125 (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:17:50 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-32074722-9dad-4b8e-b284-22fa3bca9012 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:17:50 user nova-compute[71874]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63821959-5dfd-4f66-a6e5-90a20b30efab (non-flash)
Apr 12 16:17:50 user nova-compute[71874]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775 (non-flash)
Apr 12 16:17:50 user nova-compute[71874]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f226cff8-461e-4933-9803-280654a66125 (non-flash)
Apr 12 16:17:50 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:17:50 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-32074722-9dad-4b8e-b284-22fa3bca9012 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:17:50 user nova-compute[71874]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63821959-5dfd-4f66-a6e5-90a20b30efab (non-flash)
Apr 12 16:17:50 user nova-compute[71874]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775 (non-flash)
Apr 12 16:17:50 user nova-compute[71874]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f226cff8-461e-4933-9803-280654a66125 (non-flash)
Apr 12 16:17:50 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:17:50 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-32074722-9dad-4b8e-b284-22fa3bca9012 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f226cff8-461e-4933-9803-280654a66125" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.278s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:17:50 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-32074722-9dad-4b8e-b284-22fa3bca9012 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Connected to 172.16.0.220:3260 {{(pid=71874) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 16:17:50 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-32074722-9dad-4b8e-b284-22fa3bca9012 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] HCTL ('36', '-', '-', 0) found on session 42 with lun 0 {{(pid=71874) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 16:17:50 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-32074722-9dad-4b8e-b284-22fa3bca9012 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71874) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 16:17:50 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:17:50 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:17:50 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d839cc5-ad1d-4be0-b931-4f7d4b49f074]: (4, ('- - 0', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:17:50 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-32074722-9dad-4b8e-b284-22fa3bca9012 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Searching for a device in session 42 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71874) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 16:17:50 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-32074722-9dad-4b8e-b284-22fa3bca9012 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:f226cff8-461e-4933-9803-280654a66125', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WNwhRiuP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71874) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 16:17:50 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:17:50 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:17:50 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:17:50 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:17:51 user nova-compute[71874]: DEBUG nova.compute.manager [req-d268c992-b032-47d3-bde3-4423ccf7d119 req-75df045f-041b-4d1f-a37e-b81a6ed78c92 service nova] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] Received event network-vif-plugged-ecba9b76-45d2-49e7-addc-367dc21b38ce {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:17:51 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-d268c992-b032-47d3-bde3-4423ccf7d119 req-75df045f-041b-4d1f-a37e-b81a6ed78c92 service nova] Acquiring lock "bef10c89-360e-42d6-aa26-7edf1afca567-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:17:51 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-d268c992-b032-47d3-bde3-4423ccf7d119 req-75df045f-041b-4d1f-a37e-b81a6ed78c92 service nova] Lock "bef10c89-360e-42d6-aa26-7edf1afca567-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:17:51 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-d268c992-b032-47d3-bde3-4423ccf7d119 req-75df045f-041b-4d1f-a37e-b81a6ed78c92 service nova] Lock "bef10c89-360e-42d6-aa26-7edf1afca567-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:17:51 user nova-compute[71874]: DEBUG nova.compute.manager [req-d268c992-b032-47d3-bde3-4423ccf7d119 req-75df045f-041b-4d1f-a37e-b81a6ed78c92 service nova] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] No waiting events found dispatching network-vif-plugged-ecba9b76-45d2-49e7-addc-367dc21b38ce {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:17:51 user nova-compute[71874]: WARNING nova.compute.manager [req-d268c992-b032-47d3-bde3-4423ccf7d119 req-75df045f-041b-4d1f-a37e-b81a6ed78c92 service nova] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] Received unexpected event network-vif-plugged-ecba9b76-45d2-49e7-addc-367dc21b38ce for instance with vm_state active and task_state resize_finish.
Apr 12 16:17:51 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:17:51 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:17:51 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-32074722-9dad-4b8e-b284-22fa3bca9012 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.313s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:17:51 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-32074722-9dad-4b8e-b284-22fa3bca9012 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] <== connect_volume: return (1314ms) {'type': 'block', 'scsi_wwn': '26461633730643130', 'path': '/dev/sde'} {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:17:51 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32074722-9dad-4b8e-b284-22fa3bca9012 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] [instance: 540a8fd5-8c18-4efe-97d4-9f0942cebcf5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26461633730643130', 'path': '/dev/sde'} {{(pid=71874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 16:17:51 user nova-compute[71874]: DEBUG nova.objects.instance [None req-32074722-9dad-4b8e-b284-22fa3bca9012 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lazy-loading 'flavor' on Instance uuid 540a8fd5-8c18-4efe-97d4-9f0942cebcf5 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:17:51 user nova-compute[71874]: DEBUG nova.virt.libvirt.guest [None req-32074722-9dad-4b8e-b284-22fa3bca9012 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 16:17:51 user nova-compute[71874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 16:17:51 user nova-compute[71874]:   <source dev="/dev/sde"/>
Apr 12 16:17:51 user nova-compute[71874]:   <target dev="vdb" bus="virtio"/>
Apr 12 16:17:51 user nova-compute[71874]:   <serial>f226cff8-461e-4933-9803-280654a66125</serial>
Apr 12 16:17:51 user nova-compute[71874]: </disk>
Apr 12 16:17:51 user nova-compute[71874]:  {{(pid=71874) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 16:17:52 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-32074722-9dad-4b8e-b284-22fa3bca9012 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] No BDM found with device name vda, not building metadata. {{(pid=71874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 16:17:52 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-32074722-9dad-4b8e-b284-22fa3bca9012 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 16:17:52 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-32074722-9dad-4b8e-b284-22fa3bca9012 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] No VIF found with MAC fa:16:3e:23:bb:b8, not building metadata {{(pid=71874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 16:17:52 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-32074722-9dad-4b8e-b284-22fa3bca9012 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "540a8fd5-8c18-4efe-97d4-9f0942cebcf5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.553s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:17:52 user nova-compute[71874]: DEBUG nova.virt.libvirt.host [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Removed pending event for bef10c89-360e-42d6-aa26-7edf1afca567 due to event {{(pid=71874) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 12 16:17:52 user nova-compute[71874]: DEBUG nova.virt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Emitting event <LifecycleEvent: 1681316272.956565, bef10c89-360e-42d6-aa26-7edf1afca567 => Resumed> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:17:52 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] VM Resumed (Lifecycle Event)
Apr 12 16:17:52 user nova-compute[71874]: DEBUG nova.compute.manager [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] Instance event wait completed in 0 seconds for  {{(pid=71874) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 16:17:52 user nova-compute[71874]: INFO nova.virt.libvirt.driver [-] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] Instance running successfully.
Apr 12 16:17:52 user nova-compute[71874]: DEBUG nova.virt.libvirt.guest [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] Failed to set time: agent not configured {{(pid=71874) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Apr 12 16:17:52 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] finish_migration finished successfully. {{(pid=71874) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11742}}
Apr 12 16:17:52 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:17:52 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=71874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 16:17:53 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] During sync_power_state the instance has a pending task (resize_finish). Skip.
Apr 12 16:17:53 user nova-compute[71874]: DEBUG nova.virt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Emitting event <LifecycleEvent: 1681316272.9582522, bef10c89-360e-42d6-aa26-7edf1afca567 => Started> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:17:53 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] VM Started (Lifecycle Event)
Apr 12 16:17:53 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:17:53 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=71874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 16:17:53 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] During sync_power_state the instance has a pending task (resize_finish). Skip.
Apr 12 16:17:53 user nova-compute[71874]: DEBUG nova.compute.manager [req-b8635af7-141f-44a8-8c14-56f74177ebf1 req-07e452aa-cd7a-4be6-aff5-9f7b82959047 service nova] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] Received event network-vif-plugged-ecba9b76-45d2-49e7-addc-367dc21b38ce {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:17:53 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-b8635af7-141f-44a8-8c14-56f74177ebf1 req-07e452aa-cd7a-4be6-aff5-9f7b82959047 service nova] Acquiring lock "bef10c89-360e-42d6-aa26-7edf1afca567-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:17:53 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-b8635af7-141f-44a8-8c14-56f74177ebf1 req-07e452aa-cd7a-4be6-aff5-9f7b82959047 service nova] Lock "bef10c89-360e-42d6-aa26-7edf1afca567-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:17:53 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-b8635af7-141f-44a8-8c14-56f74177ebf1 req-07e452aa-cd7a-4be6-aff5-9f7b82959047 service nova] Lock "bef10c89-360e-42d6-aa26-7edf1afca567-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:17:53 user nova-compute[71874]: DEBUG nova.compute.manager [req-b8635af7-141f-44a8-8c14-56f74177ebf1 req-07e452aa-cd7a-4be6-aff5-9f7b82959047 service nova] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] No waiting events found dispatching network-vif-plugged-ecba9b76-45d2-49e7-addc-367dc21b38ce {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:17:53 user nova-compute[71874]: WARNING nova.compute.manager [req-b8635af7-141f-44a8-8c14-56f74177ebf1 req-07e452aa-cd7a-4be6-aff5-9f7b82959047 service nova] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] Received unexpected event network-vif-plugged-ecba9b76-45d2-49e7-addc-367dc21b38ce for instance with vm_state active and task_state resize_finish.
Apr 12 16:17:53 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:17:54 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-64a039c4-fb74-4ae4-b093-d3e37b23419b tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Acquiring lock "540a8fd5-8c18-4efe-97d4-9f0942cebcf5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:17:54 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-64a039c4-fb74-4ae4-b093-d3e37b23419b tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "540a8fd5-8c18-4efe-97d4-9f0942cebcf5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:17:54 user nova-compute[71874]: INFO nova.compute.manager [None req-64a039c4-fb74-4ae4-b093-d3e37b23419b tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] [instance: 540a8fd5-8c18-4efe-97d4-9f0942cebcf5] Detaching volume f226cff8-461e-4933-9803-280654a66125
Apr 12 16:17:54 user nova-compute[71874]: INFO nova.virt.block_device [None req-64a039c4-fb74-4ae4-b093-d3e37b23419b tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] [instance: 540a8fd5-8c18-4efe-97d4-9f0942cebcf5] Attempting to driver detach volume f226cff8-461e-4933-9803-280654a66125 from mountpoint /dev/vdb
Apr 12 16:17:54 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-64a039c4-fb74-4ae4-b093-d3e37b23419b tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Attempting to detach device vdb from instance 540a8fd5-8c18-4efe-97d4-9f0942cebcf5 from the persistent domain config. {{(pid=71874) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 16:17:54 user nova-compute[71874]: DEBUG nova.virt.libvirt.guest [None req-64a039c4-fb74-4ae4-b093-d3e37b23419b tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 16:17:54 user nova-compute[71874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 16:17:54 user nova-compute[71874]:   <source dev="/dev/sde"/>
Apr 12 16:17:54 user nova-compute[71874]:   <target dev="vdb" bus="virtio"/>
Apr 12 16:17:54 user nova-compute[71874]:   <serial>f226cff8-461e-4933-9803-280654a66125</serial>
Apr 12 16:17:54 user nova-compute[71874]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 16:17:54 user nova-compute[71874]: </disk>
Apr 12 16:17:54 user nova-compute[71874]:  {{(pid=71874) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 16:17:54 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-64a039c4-fb74-4ae4-b093-d3e37b23419b tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Successfully detached device vdb from instance 540a8fd5-8c18-4efe-97d4-9f0942cebcf5 from the persistent domain config.
Apr 12 16:17:54 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-64a039c4-fb74-4ae4-b093-d3e37b23419b tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 540a8fd5-8c18-4efe-97d4-9f0942cebcf5 from the live domain config. {{(pid=71874) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 16:17:54 user nova-compute[71874]: DEBUG nova.virt.libvirt.guest [None req-64a039c4-fb74-4ae4-b093-d3e37b23419b tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 16:17:54 user nova-compute[71874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 16:17:54 user nova-compute[71874]:   <source dev="/dev/sde"/>
Apr 12 16:17:54 user nova-compute[71874]:   <target dev="vdb" bus="virtio"/>
Apr 12 16:17:54 user nova-compute[71874]:   <serial>f226cff8-461e-4933-9803-280654a66125</serial>
Apr 12 16:17:54 user nova-compute[71874]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 16:17:54 user nova-compute[71874]: </disk>
Apr 12 16:17:54 user nova-compute[71874]:  {{(pid=71874) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 16:17:54 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:17:54 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Received event <DeviceRemovedEvent: 1681316274.6655285, 540a8fd5-8c18-4efe-97d4-9f0942cebcf5 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71874) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 16:17:54 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-64a039c4-fb74-4ae4-b093-d3e37b23419b tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 540a8fd5-8c18-4efe-97d4-9f0942cebcf5 {{(pid=71874) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 16:17:54 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-64a039c4-fb74-4ae4-b093-d3e37b23419b tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Successfully detached device vdb from instance 540a8fd5-8c18-4efe-97d4-9f0942cebcf5 from the live domain config.
Apr 12 16:17:54 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-64a039c4-fb74-4ae4-b093-d3e37b23419b tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] [instance: 540a8fd5-8c18-4efe-97d4-9f0942cebcf5] calling os-brick to detach iSCSI Volume {{(pid=71874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 16:17:54 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-64a039c4-fb74-4ae4-b093-d3e37b23419b tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3c0216320>, {'target_iqn': 'iqn.2010-10.org.openstack:f226cff8-461e-4933-9803-280654a66125', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WNwhRiuP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:17:54 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-64a039c4-fb74-4ae4-b093-d3e37b23419b tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:17:54 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-64a039c4-fb74-4ae4-b093-d3e37b23419b tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:17:54 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-64a039c4-fb74-4ae4-b093-d3e37b23419b tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:17:54 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:17:54 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:17:54 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[2762c77c-19a2-4d50-a5f5-1f37c6e74bf5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:63821959-5dfd-4f66-a6e5-90a20b30efab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f226cff8-461e-4933-9803-280654a66125\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:17:54 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-64a039c4-fb74-4ae4-b093-d3e37b23419b tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 16:17:54 user nova-compute[71874]: No targets found.
Apr 12 16:17:54 user nova-compute[71874]: iSNS:
Apr 12 16:17:54 user nova-compute[71874]: No targets found.
Apr 12 16:17:54 user nova-compute[71874]: STATIC:
Apr 12 16:17:54 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:63821959-5dfd-4f66-a6e5-90a20b30efab
Apr 12 16:17:54 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:17:54 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:17:54 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:f226cff8-461e-4933-9803-280654a66125
Apr 12 16:17:54 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:17:54 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:17:54 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775
Apr 12 16:17:54 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:17:54 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:17:54 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2
Apr 12 16:17:54 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:17:54 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:17:54 user nova-compute[71874]: FIRMWARE:
Apr 12 16:17:54 user nova-compute[71874]: No targets found.
Apr 12 16:17:54 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:17:54 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-64a039c4-fb74-4ae4-b093-d3e37b23419b tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 16:17:54 user nova-compute[71874]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 16:17:54 user nova-compute[71874]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71874) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 16:17:54 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-64a039c4-fb74-4ae4-b093-d3e37b23419b tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f226cff8-461e-4933-9803-280654a66125', 0)] {{(pid=71874) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 16:17:54 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:17:54 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:17:54 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[c107e986-5ce9-4611-ae43-11d910440185]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:63821959-5dfd-4f66-a6e5-90a20b30efab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f226cff8-461e-4933-9803-280654a66125\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:17:54 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:17:54 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:17:54 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[05c88e9f-2628-4087-b8b7-515a77de2ffb]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63821959-5dfd-4f66-a6e5-90a20b30efab (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f226cff8-461e-4933-9803-280654a66125 (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:17:54 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-64a039c4-fb74-4ae4-b093-d3e37b23419b tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:17:54 user nova-compute[71874]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63821959-5dfd-4f66-a6e5-90a20b30efab (non-flash)
Apr 12 16:17:54 user nova-compute[71874]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775 (non-flash)
Apr 12 16:17:54 user nova-compute[71874]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f226cff8-461e-4933-9803-280654a66125 (non-flash)
Apr 12 16:17:54 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:17:54 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-64a039c4-fb74-4ae4-b093-d3e37b23419b tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:17:54 user nova-compute[71874]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63821959-5dfd-4f66-a6e5-90a20b30efab (non-flash)
Apr 12 16:17:54 user nova-compute[71874]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775 (non-flash)
Apr 12 16:17:54 user nova-compute[71874]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f226cff8-461e-4933-9803-280654a66125 (non-flash)
Apr 12 16:17:54 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:17:54 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-64a039c4-fb74-4ae4-b093-d3e37b23419b tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc3d443b7f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f226cff8-461e-4933-9803-280654a66125'): ({'sde'}, set())}) {{(pid=71874) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 16:17:54 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-64a039c4-fb74-4ae4-b093-d3e37b23419b tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Removing single pathed devices sde {{(pid=71874) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 16:17:54 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:17:54 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:17:54 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4363fe2-7d41-47ab-b7c7-4cb32d6d0b70]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:17:54 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:17:54 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:17:54 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5b129ff-deb8-449b-ac73-5d8a671dc768]: (4, ('ok\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:17:54 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-64a039c4-fb74-4ae4-b093-d3e37b23419b tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Flushing IO for device /dev/sde {{(pid=71874) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 16:17:54 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:17:54 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:17:54 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa191853-7a25-44fd-a94f-6cecc942154c]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:17:54 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-64a039c4-fb74-4ae4-b093-d3e37b23419b tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71874) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 16:17:54 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:17:54 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.064s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:17:54 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[972c2bae-e70c-4bd8-9208-b37d894ae98c]: (4, ('1', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:17:54 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-64a039c4-fb74-4ae4-b093-d3e37b23419b tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71874) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 16:17:54 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-64a039c4-fb74-4ae4-b093-d3e37b23419b tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] SCSI volumes sde have been removed. {{(pid=71874) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 16:17:54 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-64a039c4-fb74-4ae4-b093-d3e37b23419b tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f226cff8-461e-4933-9803-280654a66125')] {{(pid=71874) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 16:17:54 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f226cff8-461e-4933-9803-280654a66125 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:17:54 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f226cff8-461e-4933-9803-280654a66125 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:17:54 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ccdbab5-c897-4e42-8db4-6b8b84bb3eb6]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:17:54 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-64a039c4-fb74-4ae4-b093-d3e37b23419b tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:17:54 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f226cff8-461e-4933-9803-280654a66125 -p 172.16.0.220:3260 --logout {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:17:55 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f226cff8-461e-4933-9803-280654a66125 -p 172.16.0.220:3260 --logout" returned: 0 in 0.082s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:17:55 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[896b3d29-2f27-4ec6-b811-78de8048e077]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:f226cff8-461e-4933-9803-280654a66125, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:f226cff8-461e-4933-9803-280654a66125, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:17:55 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-64a039c4-fb74-4ae4-b093-d3e37b23419b tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:f226cff8-461e-4933-9803-280654a66125, portal: 172.16.0.220,3260]
Apr 12 16:17:55 user nova-compute[71874]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:f226cff8-461e-4933-9803-280654a66125, portal: 172.16.0.220,3260] successful.
Apr 12 16:17:55 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:17:55 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f226cff8-461e-4933-9803-280654a66125 -p 172.16.0.220:3260 --op delete {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:17:55 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f226cff8-461e-4933-9803-280654a66125 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:17:55 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[651bbb22-b245-4c6a-ab6d-ebcc234477b9]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:17:55 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-64a039c4-fb74-4ae4-b093-d3e37b23419b tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:17:55 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-64a039c4-fb74-4ae4-b093-d3e37b23419b tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.372s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:17:55 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-64a039c4-fb74-4ae4-b093-d3e37b23419b tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] <== disconnect_volume: return (374ms) None {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:17:55 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-64a039c4-fb74-4ae4-b093-d3e37b23419b tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] [instance: 540a8fd5-8c18-4efe-97d4-9f0942cebcf5] Disconnected iSCSI Volume {{(pid=71874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 16:17:55 user nova-compute[71874]: DEBUG nova.objects.instance [None req-64a039c4-fb74-4ae4-b093-d3e37b23419b tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lazy-loading 'flavor' on Instance uuid 540a8fd5-8c18-4efe-97d4-9f0942cebcf5 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:17:55 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-64a039c4-fb74-4ae4-b093-d3e37b23419b tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "540a8fd5-8c18-4efe-97d4-9f0942cebcf5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.781s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:17:58 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:17:59 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:18:04 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:18:05 user nova-compute[71874]: DEBUG nova.objects.instance [None req-0aaccf0e-ec39-4a02-a484-c1218277a94e tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lazy-loading 'flavor' on Instance uuid 4190e244-84b1-47b6-813d-9cadb7c65975 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:18:05 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-0aaccf0e-ec39-4a02-a484-c1218277a94e tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Acquiring lock "refresh_cache-4190e244-84b1-47b6-813d-9cadb7c65975" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:18:05 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-0aaccf0e-ec39-4a02-a484-c1218277a94e tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Acquired lock "refresh_cache-4190e244-84b1-47b6-813d-9cadb7c65975" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:18:05 user nova-compute[71874]: DEBUG nova.network.neutron [None req-0aaccf0e-ec39-4a02-a484-c1218277a94e tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Building network info cache for instance {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 16:18:05 user nova-compute[71874]: DEBUG nova.objects.instance [None req-0aaccf0e-ec39-4a02-a484-c1218277a94e tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lazy-loading 'info_cache' on Instance uuid 4190e244-84b1-47b6-813d-9cadb7c65975 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:18:06 user nova-compute[71874]: DEBUG nova.network.neutron [None req-0aaccf0e-ec39-4a02-a484-c1218277a94e tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Updating instance_info_cache with network_info: [{"id": "eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c", "address": "fa:16:3e:d0:b5:d4", "network": {"id": "1ef428ff-90e5-4abd-93d0-b7c2c581cb26", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-425924095-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf4334df004490ba51b4d92ce5408ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeab1ea0c-8a", "ovs_interfaceid": "eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:18:06 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-0aaccf0e-ec39-4a02-a484-c1218277a94e tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Releasing lock "refresh_cache-4190e244-84b1-47b6-813d-9cadb7c65975" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:18:06 user nova-compute[71874]: INFO nova.virt.libvirt.driver [-] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Instance destroyed successfully.
Apr 12 16:18:06 user nova-compute[71874]: DEBUG nova.objects.instance [None req-0aaccf0e-ec39-4a02-a484-c1218277a94e tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lazy-loading 'resources' on Instance uuid 4190e244-84b1-47b6-813d-9cadb7c65975 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:18:06 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-0aaccf0e-ec39-4a02-a484-c1218277a94e tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T16:10:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1671411109',display_name='tempest-AttachVolumeTestJSON-server-1671411109',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1671411109',id=30,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFG81tsYAjuSLmCBJX5Oy53u6RydBq93WUwqVYUMtou9Wro9aHLYlkjtVGeLCCkr0S7Y24E90tPBrxAk1jNQ+AbkSKQBVRm7+VgL4Rx9C6hm1o9gCqXWuOVCyPnDpz3Eig==',key_name='tempest-keypair-1295229303',keypairs=<?>,launch_index=0,launched_at=2023-04-12T16:10:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='7cf4334df004490ba51b4d92ce5408ae',ramdisk_id='',reservation_id='r-sfgohvil',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-178648074',owner_user_name='tempest-AttachVolumeTestJSON-178648074-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T16:16:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2996f6997bb14fc3aec9c3736cc65b8a',uuid=4190e244-84b1-47b6-813d-9cadb7c65975,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c", "address": "fa:16:3e:d0:b5:d4", "network": {"id": "1ef428ff-90e5-4abd-93d0-b7c2c581cb26", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-425924095-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf4334df004490ba51b4d92ce5408ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeab1ea0c-8a", "ovs_interfaceid": "eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 16:18:06 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-0aaccf0e-ec39-4a02-a484-c1218277a94e tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Converting VIF {"id": "eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c", "address": "fa:16:3e:d0:b5:d4", "network": {"id": "1ef428ff-90e5-4abd-93d0-b7c2c581cb26", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-425924095-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf4334df004490ba51b4d92ce5408ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeab1ea0c-8a", "ovs_interfaceid": "eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:18:06 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-0aaccf0e-ec39-4a02-a484-c1218277a94e tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:b5:d4,bridge_name='br-int',has_traffic_filtering=True,id=eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c,network=Network(1ef428ff-90e5-4abd-93d0-b7c2c581cb26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeab1ea0c-8a') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:18:06 user nova-compute[71874]: DEBUG os_vif [None req-0aaccf0e-ec39-4a02-a484-c1218277a94e tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:b5:d4,bridge_name='br-int',has_traffic_filtering=True,id=eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c,network=Network(1ef428ff-90e5-4abd-93d0-b7c2c581cb26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeab1ea0c-8a') {{(pid=71874) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 16:18:06 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:18:06 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeab1ea0c-8a, bridge=br-int, if_exists=True) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:18:06 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:18:06 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:18:06 user nova-compute[71874]: INFO os_vif [None req-0aaccf0e-ec39-4a02-a484-c1218277a94e tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:b5:d4,bridge_name='br-int',has_traffic_filtering=True,id=eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c,network=Network(1ef428ff-90e5-4abd-93d0-b7c2c581cb26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeab1ea0c-8a')
Apr 12 16:18:06 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-0aaccf0e-ec39-4a02-a484-c1218277a94e tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Start _get_guest_xml network_info=[{"id": "eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c", "address": "fa:16:3e:d0:b5:d4", "network": {"id": "1ef428ff-90e5-4abd-93d0-b7c2c581cb26", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-425924095-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf4334df004490ba51b4d92ce5408ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeab1ea0c-8a", "ovs_interfaceid": "eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=9dc63f14-8b70-4e72-89f2-13464f2f5c7c,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_options': None, 'image_id': '9dc63f14-8b70-4e72-89f2-13464f2f5c7c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 16:18:06 user nova-compute[71874]: DEBUG nova.objects.instance [None req-0aaccf0e-ec39-4a02-a484-c1218277a94e tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lazy-loading 'numa_topology' on Instance uuid 4190e244-84b1-47b6-813d-9cadb7c65975 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:18:06 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-0aaccf0e-ec39-4a02-a484-c1218277a94e tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:18:06 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-0aaccf0e-ec39-4a02-a484-c1218277a94e tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:18:06 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-0aaccf0e-ec39-4a02-a484-c1218277a94e tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71874) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 16:18:06 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-0aaccf0e-ec39-4a02-a484-c1218277a94e tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T15:56:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=9dc63f14-8b70-4e72-89f2-13464f2f5c7c,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 16:18:06 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-0aaccf0e-ec39-4a02-a484-c1218277a94e tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Flavor limits 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 16:18:06 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-0aaccf0e-ec39-4a02-a484-c1218277a94e tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Image limits 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 16:18:06 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-0aaccf0e-ec39-4a02-a484-c1218277a94e tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Flavor pref 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 16:18:06 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-0aaccf0e-ec39-4a02-a484-c1218277a94e tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Image pref 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 16:18:06 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-0aaccf0e-ec39-4a02-a484-c1218277a94e tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 16:18:06 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-0aaccf0e-ec39-4a02-a484-c1218277a94e tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 16:18:06 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-0aaccf0e-ec39-4a02-a484-c1218277a94e tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 16:18:06 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-0aaccf0e-ec39-4a02-a484-c1218277a94e tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Got 1 possible topologies {{(pid=71874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 16:18:06 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-0aaccf0e-ec39-4a02-a484-c1218277a94e tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 16:18:06 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-0aaccf0e-ec39-4a02-a484-c1218277a94e tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 16:18:06 user nova-compute[71874]: DEBUG nova.objects.instance [None req-0aaccf0e-ec39-4a02-a484-c1218277a94e tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4190e244-84b1-47b6-813d-9cadb7c65975 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:18:06 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-0aaccf0e-ec39-4a02-a484-c1218277a94e tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T16:10:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1671411109',display_name='tempest-AttachVolumeTestJSON-server-1671411109',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1671411109',id=30,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFG81tsYAjuSLmCBJX5Oy53u6RydBq93WUwqVYUMtou9Wro9aHLYlkjtVGeLCCkr0S7Y24E90tPBrxAk1jNQ+AbkSKQBVRm7+VgL4Rx9C6hm1o9gCqXWuOVCyPnDpz3Eig==',key_name='tempest-keypair-1295229303',keypairs=<?>,launch_index=0,launched_at=2023-04-12T16:10:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='7cf4334df004490ba51b4d92ce5408ae',ramdisk_id='',reservation_id='r-sfgohvil',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-178648074',owner_user_name='tempest-AttachVolumeTestJSON-178648074-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T16:16:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2996f6997bb14fc3aec9c3736cc65b8a',uuid=4190e244-84b1-47b6-813d-9cadb7c65975,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c", "address": "fa:16:3e:d0:b5:d4", "network": {"id": "1ef428ff-90e5-4abd-93d0-b7c2c581cb26", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-425924095-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf4334df004490ba51b4d92ce5408ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeab1ea0c-8a", "ovs_interfaceid": "eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 16:18:06 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-0aaccf0e-ec39-4a02-a484-c1218277a94e tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Converting VIF {"id": "eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c", "address": "fa:16:3e:d0:b5:d4", "network": {"id": "1ef428ff-90e5-4abd-93d0-b7c2c581cb26", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-425924095-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf4334df004490ba51b4d92ce5408ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeab1ea0c-8a", "ovs_interfaceid": "eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:18:06 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-0aaccf0e-ec39-4a02-a484-c1218277a94e tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:b5:d4,bridge_name='br-int',has_traffic_filtering=True,id=eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c,network=Network(1ef428ff-90e5-4abd-93d0-b7c2c581cb26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeab1ea0c-8a') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:18:06 user nova-compute[71874]: DEBUG nova.objects.instance [None req-0aaccf0e-ec39-4a02-a484-c1218277a94e tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lazy-loading 'pci_devices' on Instance uuid 4190e244-84b1-47b6-813d-9cadb7c65975 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:18:06 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-0aaccf0e-ec39-4a02-a484-c1218277a94e tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] End _get_guest_xml xml=<domain type="kvm">
Apr 12 16:18:06 user nova-compute[71874]:   <uuid>4190e244-84b1-47b6-813d-9cadb7c65975</uuid>
Apr 12 16:18:06 user nova-compute[71874]:   <name>instance-0000001e</name>
Apr 12 16:18:06 user nova-compute[71874]:   <memory>131072</memory>
Apr 12 16:18:06 user nova-compute[71874]:   <vcpu>1</vcpu>
Apr 12 16:18:06 user nova-compute[71874]:   <metadata>
Apr 12 16:18:06 user nova-compute[71874]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 16:18:06 user nova-compute[71874]:       <nova:package version="0.0.0"/>
Apr 12 16:18:06 user nova-compute[71874]:       <nova:name>tempest-AttachVolumeTestJSON-server-1671411109</nova:name>
Apr 12 16:18:06 user nova-compute[71874]:       <nova:creationTime>2023-04-12 16:18:06</nova:creationTime>
Apr 12 16:18:06 user nova-compute[71874]:       <nova:flavor name="m1.nano">
Apr 12 16:18:06 user nova-compute[71874]:         <nova:memory>128</nova:memory>
Apr 12 16:18:06 user nova-compute[71874]:         <nova:disk>1</nova:disk>
Apr 12 16:18:06 user nova-compute[71874]:         <nova:swap>0</nova:swap>
Apr 12 16:18:06 user nova-compute[71874]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 16:18:06 user nova-compute[71874]:         <nova:vcpus>1</nova:vcpus>
Apr 12 16:18:06 user nova-compute[71874]:       </nova:flavor>
Apr 12 16:18:06 user nova-compute[71874]:       <nova:owner>
Apr 12 16:18:06 user nova-compute[71874]:         <nova:user uuid="2996f6997bb14fc3aec9c3736cc65b8a">tempest-AttachVolumeTestJSON-178648074-project-member</nova:user>
Apr 12 16:18:06 user nova-compute[71874]:         <nova:project uuid="7cf4334df004490ba51b4d92ce5408ae">tempest-AttachVolumeTestJSON-178648074</nova:project>
Apr 12 16:18:06 user nova-compute[71874]:       </nova:owner>
Apr 12 16:18:06 user nova-compute[71874]:       <nova:root type="image" uuid="9dc63f14-8b70-4e72-89f2-13464f2f5c7c"/>
Apr 12 16:18:06 user nova-compute[71874]:       <nova:ports>
Apr 12 16:18:06 user nova-compute[71874]:         <nova:port uuid="eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c">
Apr 12 16:18:06 user nova-compute[71874]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 12 16:18:06 user nova-compute[71874]:         </nova:port>
Apr 12 16:18:06 user nova-compute[71874]:       </nova:ports>
Apr 12 16:18:06 user nova-compute[71874]:     </nova:instance>
Apr 12 16:18:06 user nova-compute[71874]:   </metadata>
Apr 12 16:18:06 user nova-compute[71874]:   <sysinfo type="smbios">
Apr 12 16:18:06 user nova-compute[71874]:     <system>
Apr 12 16:18:06 user nova-compute[71874]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 16:18:06 user nova-compute[71874]:       <entry name="product">OpenStack Nova</entry>
Apr 12 16:18:06 user nova-compute[71874]:       <entry name="version">0.0.0</entry>
Apr 12 16:18:06 user nova-compute[71874]:       <entry name="serial">4190e244-84b1-47b6-813d-9cadb7c65975</entry>
Apr 12 16:18:06 user nova-compute[71874]:       <entry name="uuid">4190e244-84b1-47b6-813d-9cadb7c65975</entry>
Apr 12 16:18:06 user nova-compute[71874]:       <entry name="family">Virtual Machine</entry>
Apr 12 16:18:06 user nova-compute[71874]:     </system>
Apr 12 16:18:06 user nova-compute[71874]:   </sysinfo>
Apr 12 16:18:06 user nova-compute[71874]:   <os>
Apr 12 16:18:06 user nova-compute[71874]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 16:18:06 user nova-compute[71874]:     <boot dev="hd"/>
Apr 12 16:18:06 user nova-compute[71874]:     <smbios mode="sysinfo"/>
Apr 12 16:18:06 user nova-compute[71874]:   </os>
Apr 12 16:18:06 user nova-compute[71874]:   <features>
Apr 12 16:18:06 user nova-compute[71874]:     <acpi/>
Apr 12 16:18:06 user nova-compute[71874]:     <apic/>
Apr 12 16:18:06 user nova-compute[71874]:     <vmcoreinfo/>
Apr 12 16:18:06 user nova-compute[71874]:   </features>
Apr 12 16:18:06 user nova-compute[71874]:   <clock offset="utc">
Apr 12 16:18:06 user nova-compute[71874]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 16:18:06 user nova-compute[71874]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 16:18:06 user nova-compute[71874]:     <timer name="hpet" present="no"/>
Apr 12 16:18:06 user nova-compute[71874]:   </clock>
Apr 12 16:18:06 user nova-compute[71874]:   <cpu mode="custom" match="exact">
Apr 12 16:18:06 user nova-compute[71874]:     <model>Nehalem</model>
Apr 12 16:18:06 user nova-compute[71874]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 16:18:06 user nova-compute[71874]:   </cpu>
Apr 12 16:18:06 user nova-compute[71874]:   <devices>
Apr 12 16:18:06 user nova-compute[71874]:     <disk type="file" device="disk">
Apr 12 16:18:06 user nova-compute[71874]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 16:18:06 user nova-compute[71874]:       <source file="/opt/stack/data/nova/instances/4190e244-84b1-47b6-813d-9cadb7c65975/disk"/>
Apr 12 16:18:06 user nova-compute[71874]:       <target dev="vda" bus="virtio"/>
Apr 12 16:18:06 user nova-compute[71874]:     </disk>
Apr 12 16:18:06 user nova-compute[71874]:     <interface type="ethernet">
Apr 12 16:18:06 user nova-compute[71874]:       <mac address="fa:16:3e:d0:b5:d4"/>
Apr 12 16:18:06 user nova-compute[71874]:       <model type="virtio"/>
Apr 12 16:18:06 user nova-compute[71874]:       <mtu size="1442"/>
Apr 12 16:18:06 user nova-compute[71874]:       <target dev="tapeab1ea0c-8a"/>
Apr 12 16:18:06 user nova-compute[71874]:     </interface>
Apr 12 16:18:06 user nova-compute[71874]:     <serial type="pty">
Apr 12 16:18:06 user nova-compute[71874]:       <log file="/opt/stack/data/nova/instances/4190e244-84b1-47b6-813d-9cadb7c65975/console.log" append="off"/>
Apr 12 16:18:06 user nova-compute[71874]:     </serial>
Apr 12 16:18:06 user nova-compute[71874]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 16:18:06 user nova-compute[71874]:     <video>
Apr 12 16:18:06 user nova-compute[71874]:       <model type="virtio"/>
Apr 12 16:18:06 user nova-compute[71874]:     </video>
Apr 12 16:18:06 user nova-compute[71874]:     <rng model="virtio">
Apr 12 16:18:06 user nova-compute[71874]:       <backend model="random">/dev/urandom</backend>
Apr 12 16:18:06 user nova-compute[71874]:     </rng>
Apr 12 16:18:06 user nova-compute[71874]:     <controller type="usb" index="0" model="none"/>
Apr 12 16:18:06 user nova-compute[71874]:     <memballoon model="virtio">
Apr 12 16:18:06 user nova-compute[71874]:       <stats period="10"/>
Apr 12 16:18:06 user nova-compute[71874]:     </memballoon>
Apr 12 16:18:06 user nova-compute[71874]:   </devices>
Apr 12 16:18:06 user nova-compute[71874]: </domain>
Apr 12 16:18:06 user nova-compute[71874]:  {{(pid=71874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 16:18:06 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-0aaccf0e-ec39-4a02-a484-c1218277a94e tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4190e244-84b1-47b6-813d-9cadb7c65975/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:18:06 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-0aaccf0e-ec39-4a02-a484-c1218277a94e tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4190e244-84b1-47b6-813d-9cadb7c65975/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:18:06 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-0aaccf0e-ec39-4a02-a484-c1218277a94e tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4190e244-84b1-47b6-813d-9cadb7c65975/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:18:06 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-0aaccf0e-ec39-4a02-a484-c1218277a94e tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4190e244-84b1-47b6-813d-9cadb7c65975/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:18:06 user nova-compute[71874]: DEBUG nova.objects.instance [None req-0aaccf0e-ec39-4a02-a484-c1218277a94e tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lazy-loading 'trusted_certs' on Instance uuid 4190e244-84b1-47b6-813d-9cadb7c65975 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:18:06 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-0aaccf0e-ec39-4a02-a484-c1218277a94e tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:18:06 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-0aaccf0e-ec39-4a02-a484-c1218277a94e tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json" returned: 0 in 0.132s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:18:06 user nova-compute[71874]: DEBUG nova.virt.disk.api [None req-0aaccf0e-ec39-4a02-a484-c1218277a94e tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4190e244-84b1-47b6-813d-9cadb7c65975/disk. size=1073741824 {{(pid=71874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 16:18:06 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-0aaccf0e-ec39-4a02-a484-c1218277a94e tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4190e244-84b1-47b6-813d-9cadb7c65975/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:18:06 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-0aaccf0e-ec39-4a02-a484-c1218277a94e tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4190e244-84b1-47b6-813d-9cadb7c65975/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:18:06 user nova-compute[71874]: DEBUG nova.virt.disk.api [None req-0aaccf0e-ec39-4a02-a484-c1218277a94e tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Cannot resize image /opt/stack/data/nova/instances/4190e244-84b1-47b6-813d-9cadb7c65975/disk to a smaller size. {{(pid=71874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 16:18:06 user nova-compute[71874]: DEBUG nova.objects.instance [None req-0aaccf0e-ec39-4a02-a484-c1218277a94e tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lazy-loading 'migration_context' on Instance uuid 4190e244-84b1-47b6-813d-9cadb7c65975 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:18:06 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-0aaccf0e-ec39-4a02-a484-c1218277a94e tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T16:10:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1671411109',display_name='tempest-AttachVolumeTestJSON-server-1671411109',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1671411109',id=30,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFG81tsYAjuSLmCBJX5Oy53u6RydBq93WUwqVYUMtou9Wro9aHLYlkjtVGeLCCkr0S7Y24E90tPBrxAk1jNQ+AbkSKQBVRm7+VgL4Rx9C6hm1o9gCqXWuOVCyPnDpz3Eig==',key_name='tempest-keypair-1295229303',keypairs=<?>,launch_index=0,launched_at=2023-04-12T16:10:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='7cf4334df004490ba51b4d92ce5408ae',ramdisk_id='',reservation_id='r-sfgohvil',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-178648074',owner_user_name='tempest-AttachVolumeTestJSON-178648074-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T16:16:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2996f6997bb14fc3aec9c3736cc65b8a',uuid=4190e244-84b1-47b6-813d-9cadb7c65975,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c", "address": "fa:16:3e:d0:b5:d4", "network": {"id": "1ef428ff-90e5-4abd-93d0-b7c2c581cb26", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-425924095-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf4334df004490ba51b4d92ce5408ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeab1ea0c-8a", "ovs_interfaceid": "eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 16:18:06 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-0aaccf0e-ec39-4a02-a484-c1218277a94e tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Converting VIF {"id": "eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c", "address": "fa:16:3e:d0:b5:d4", "network": {"id": "1ef428ff-90e5-4abd-93d0-b7c2c581cb26", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-425924095-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf4334df004490ba51b4d92ce5408ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeab1ea0c-8a", "ovs_interfaceid": "eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:18:06 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-0aaccf0e-ec39-4a02-a484-c1218277a94e tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:b5:d4,bridge_name='br-int',has_traffic_filtering=True,id=eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c,network=Network(1ef428ff-90e5-4abd-93d0-b7c2c581cb26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeab1ea0c-8a') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:18:06 user nova-compute[71874]: DEBUG os_vif [None req-0aaccf0e-ec39-4a02-a484-c1218277a94e tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:b5:d4,bridge_name='br-int',has_traffic_filtering=True,id=eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c,network=Network(1ef428ff-90e5-4abd-93d0-b7c2c581cb26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeab1ea0c-8a') {{(pid=71874) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 16:18:06 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:18:06 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:18:06 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 16:18:06 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:18:06 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeab1ea0c-8a, may_exist=True) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:18:06 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapeab1ea0c-8a, col_values=(('external_ids', {'iface-id': 'eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d0:b5:d4', 'vm-uuid': '4190e244-84b1-47b6-813d-9cadb7c65975'}),)) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:18:06 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:18:06 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:18:07 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:18:07 user nova-compute[71874]: INFO os_vif [None req-0aaccf0e-ec39-4a02-a484-c1218277a94e tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:b5:d4,bridge_name='br-int',has_traffic_filtering=True,id=eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c,network=Network(1ef428ff-90e5-4abd-93d0-b7c2c581cb26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeab1ea0c-8a')
Apr 12 16:18:08 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:18:08 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:18:08 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:18:08 user nova-compute[71874]: DEBUG nova.compute.manager [req-608cce95-fcf5-45a1-88e8-d8634ed9cd31 req-22570b52-031f-4e16-a109-20041ee51d30 service nova] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Received event network-vif-plugged-eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:18:08 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-608cce95-fcf5-45a1-88e8-d8634ed9cd31 req-22570b52-031f-4e16-a109-20041ee51d30 service nova] Acquiring lock "4190e244-84b1-47b6-813d-9cadb7c65975-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:18:08 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-608cce95-fcf5-45a1-88e8-d8634ed9cd31 req-22570b52-031f-4e16-a109-20041ee51d30 service nova] Lock "4190e244-84b1-47b6-813d-9cadb7c65975-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:18:08 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-608cce95-fcf5-45a1-88e8-d8634ed9cd31 req-22570b52-031f-4e16-a109-20041ee51d30 service nova] Lock "4190e244-84b1-47b6-813d-9cadb7c65975-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:18:08 user nova-compute[71874]: DEBUG nova.compute.manager [req-608cce95-fcf5-45a1-88e8-d8634ed9cd31 req-22570b52-031f-4e16-a109-20041ee51d30 service nova] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] No waiting events found dispatching network-vif-plugged-eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:18:08 user nova-compute[71874]: WARNING nova.compute.manager [req-608cce95-fcf5-45a1-88e8-d8634ed9cd31 req-22570b52-031f-4e16-a109-20041ee51d30 service nova] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Received unexpected event network-vif-plugged-eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c for instance with vm_state stopped and task_state powering-on.
Apr 12 16:18:08 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-75c15527-7517-4c4e-ba4f-8c623e014837 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Acquiring lock "f52ee906-c8fd-4cd5-842e-de98a5099c4f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:18:08 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-75c15527-7517-4c4e-ba4f-8c623e014837 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "f52ee906-c8fd-4cd5-842e-de98a5099c4f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:18:08 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-75c15527-7517-4c4e-ba4f-8c623e014837 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Acquiring lock "f52ee906-c8fd-4cd5-842e-de98a5099c4f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:18:08 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-75c15527-7517-4c4e-ba4f-8c623e014837 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "f52ee906-c8fd-4cd5-842e-de98a5099c4f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:18:08 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-75c15527-7517-4c4e-ba4f-8c623e014837 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "f52ee906-c8fd-4cd5-842e-de98a5099c4f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:18:08 user nova-compute[71874]: INFO nova.compute.manager [None req-75c15527-7517-4c4e-ba4f-8c623e014837 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] Terminating instance
Apr 12 16:18:08 user nova-compute[71874]: DEBUG nova.compute.manager [None req-75c15527-7517-4c4e-ba4f-8c623e014837 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] Start destroying the instance on the hypervisor. {{(pid=71874) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 16:18:09 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:18:09 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:18:09 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:18:09 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:18:09 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:18:09 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:18:09 user nova-compute[71874]: DEBUG nova.compute.manager [req-073e018f-752b-4dc7-a7bc-5ee62849377d req-11844588-f080-4113-abfc-7ffa26d5cb8e service nova] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] Received event network-vif-unplugged-955511f0-eca8-447d-a105-fdd5f182de62 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:18:09 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-073e018f-752b-4dc7-a7bc-5ee62849377d req-11844588-f080-4113-abfc-7ffa26d5cb8e service nova] Acquiring lock "f52ee906-c8fd-4cd5-842e-de98a5099c4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:18:09 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-073e018f-752b-4dc7-a7bc-5ee62849377d req-11844588-f080-4113-abfc-7ffa26d5cb8e service nova] Lock "f52ee906-c8fd-4cd5-842e-de98a5099c4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:18:09 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-073e018f-752b-4dc7-a7bc-5ee62849377d req-11844588-f080-4113-abfc-7ffa26d5cb8e service nova] Lock "f52ee906-c8fd-4cd5-842e-de98a5099c4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:18:09 user nova-compute[71874]: DEBUG nova.compute.manager [req-073e018f-752b-4dc7-a7bc-5ee62849377d req-11844588-f080-4113-abfc-7ffa26d5cb8e service nova] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] No waiting events found dispatching network-vif-unplugged-955511f0-eca8-447d-a105-fdd5f182de62 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:18:09 user nova-compute[71874]: DEBUG nova.compute.manager [req-073e018f-752b-4dc7-a7bc-5ee62849377d req-11844588-f080-4113-abfc-7ffa26d5cb8e service nova] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] Received event network-vif-unplugged-955511f0-eca8-447d-a105-fdd5f182de62 for instance with task_state deleting. {{(pid=71874) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 16:18:09 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:18:09 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:18:09 user nova-compute[71874]: INFO nova.virt.libvirt.driver [-] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] Instance destroyed successfully.
Apr 12 16:18:09 user nova-compute[71874]: DEBUG nova.objects.instance [None req-75c15527-7517-4c4e-ba4f-8c623e014837 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lazy-loading 'resources' on Instance uuid f52ee906-c8fd-4cd5-842e-de98a5099c4f {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:18:09 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-75c15527-7517-4c4e-ba4f-8c623e014837 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T16:02:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2141634890',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2141634890',id=15,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T16:04:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9210f81232304e179d3e09914a492442',ramdisk_id='',reservation_id='r-ny60dh1j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1443944578',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T16:06:10Z,user_data=None,user_id='73f9fa5bc22a4824b3cdcb8cf7bb380c',uuid=f52ee906-c8fd-4cd5-842e-de98a5099c4f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "955511f0-eca8-447d-a105-fdd5f182de62", "address": "fa:16:3e:ec:61:14", "network": {"id": "b36306e0-04c5-4b1b-8022-05ff121c4e43", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1503204786-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9210f81232304e179d3e09914a492442", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap955511f0-ec", "ovs_interfaceid": "955511f0-eca8-447d-a105-fdd5f182de62", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 16:18:09 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-75c15527-7517-4c4e-ba4f-8c623e014837 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Converting VIF {"id": "955511f0-eca8-447d-a105-fdd5f182de62", "address": "fa:16:3e:ec:61:14", "network": {"id": "b36306e0-04c5-4b1b-8022-05ff121c4e43", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1503204786-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9210f81232304e179d3e09914a492442", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap955511f0-ec", "ovs_interfaceid": "955511f0-eca8-447d-a105-fdd5f182de62", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:18:09 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-75c15527-7517-4c4e-ba4f-8c623e014837 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ec:61:14,bridge_name='br-int',has_traffic_filtering=True,id=955511f0-eca8-447d-a105-fdd5f182de62,network=Network(b36306e0-04c5-4b1b-8022-05ff121c4e43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap955511f0-ec') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:18:09 user nova-compute[71874]: DEBUG os_vif [None req-75c15527-7517-4c4e-ba4f-8c623e014837 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ec:61:14,bridge_name='br-int',has_traffic_filtering=True,id=955511f0-eca8-447d-a105-fdd5f182de62,network=Network(b36306e0-04c5-4b1b-8022-05ff121c4e43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap955511f0-ec') {{(pid=71874) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 16:18:09 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:18:09 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap955511f0-ec, bridge=br-int, if_exists=True) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:18:09 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:18:09 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:18:09 user nova-compute[71874]: INFO os_vif [None req-75c15527-7517-4c4e-ba4f-8c623e014837 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ec:61:14,bridge_name='br-int',has_traffic_filtering=True,id=955511f0-eca8-447d-a105-fdd5f182de62,network=Network(b36306e0-04c5-4b1b-8022-05ff121c4e43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap955511f0-ec')
Apr 12 16:18:09 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-75c15527-7517-4c4e-ba4f-8c623e014837 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] calling os-brick to detach iSCSI Volume {{(pid=71874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 16:18:09 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-75c15527-7517-4c4e-ba4f-8c623e014837 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3c0216320>, {'target_iqn': 'iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aufDXJAj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:18:09 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-75c15527-7517-4c4e-ba4f-8c623e014837 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:18:09 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-75c15527-7517-4c4e-ba4f-8c623e014837 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:18:09 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-75c15527-7517-4c4e-ba4f-8c623e014837 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:18:09 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:18:09 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:18:09 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf5d5291-d5cc-4e47-95b1-12ff4e70d660]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:63821959-5dfd-4f66-a6e5-90a20b30efab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:18:09 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-75c15527-7517-4c4e-ba4f-8c623e014837 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 16:18:09 user nova-compute[71874]: No targets found.
Apr 12 16:18:09 user nova-compute[71874]: iSNS:
Apr 12 16:18:09 user nova-compute[71874]: No targets found.
Apr 12 16:18:09 user nova-compute[71874]: STATIC:
Apr 12 16:18:09 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:63821959-5dfd-4f66-a6e5-90a20b30efab
Apr 12 16:18:09 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:18:09 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:18:09 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775
Apr 12 16:18:09 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:18:09 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:18:09 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2
Apr 12 16:18:09 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:18:09 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:18:09 user nova-compute[71874]: FIRMWARE:
Apr 12 16:18:09 user nova-compute[71874]: No targets found.
Apr 12 16:18:09 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:18:09 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-75c15527-7517-4c4e-ba4f-8c623e014837 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 16:18:09 user nova-compute[71874]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 16:18:09 user nova-compute[71874]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71874) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 16:18:09 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-75c15527-7517-4c4e-ba4f-8c623e014837 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2', 0)] {{(pid=71874) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 16:18:09 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:18:09 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:18:09 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[aacfe4e8-529d-48ae-bf85-0f2609da9940]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:63821959-5dfd-4f66-a6e5-90a20b30efab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:18:09 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:18:09 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:18:09 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[d349cc2e-deef-4306-96dc-837c112ee501]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63821959-5dfd-4f66-a6e5-90a20b30efab (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775 (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:18:09 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-75c15527-7517-4c4e-ba4f-8c623e014837 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:18:09 user nova-compute[71874]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63821959-5dfd-4f66-a6e5-90a20b30efab (non-flash)
Apr 12 16:18:09 user nova-compute[71874]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775 (non-flash)
Apr 12 16:18:09 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:18:09 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-75c15527-7517-4c4e-ba4f-8c623e014837 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 (non-flash)
Apr 12 16:18:09 user nova-compute[71874]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63821959-5dfd-4f66-a6e5-90a20b30efab (non-flash)
Apr 12 16:18:09 user nova-compute[71874]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775 (non-flash)
Apr 12 16:18:09 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:18:09 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-75c15527-7517-4c4e-ba4f-8c623e014837 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc3c02a31c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2'): ({'sdb'}, set())}) {{(pid=71874) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 16:18:09 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-75c15527-7517-4c4e-ba4f-8c623e014837 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Removing single pathed devices sdb {{(pid=71874) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 16:18:09 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:18:09 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:18:09 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[d53a4531-0c76-4df2-9067-e589ac38195d]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:18:09 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:18:09 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:18:09 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[61165bbf-33fc-405d-935c-66770fafc726]: (4, ('ok\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:18:09 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-75c15527-7517-4c4e-ba4f-8c623e014837 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Flushing IO for device /dev/sdb {{(pid=71874) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 16:18:09 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:18:09 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:18:09 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[8079ec3d-1614-46a1-a1a1-500d63eb599d]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:18:09 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-75c15527-7517-4c4e-ba4f-8c623e014837 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71874) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 16:18:09 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:18:09 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:18:09 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ebc811e-f9d8-4745-939f-1fb6ed0d7490]: (4, ('1', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:18:09 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-75c15527-7517-4c4e-ba4f-8c623e014837 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71874) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 16:18:09 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-75c15527-7517-4c4e-ba4f-8c623e014837 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] SCSI volumes sdb have been removed. {{(pid=71874) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 16:18:09 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-75c15527-7517-4c4e-ba4f-8c623e014837 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2')] {{(pid=71874) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 16:18:09 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:18:09 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:18:09 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9496dbb-d5c9-402c-ae43-0316d37bfdb0]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:18:09 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-75c15527-7517-4c4e-ba4f-8c623e014837 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:18:09 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 -p 172.16.0.220:3260 --logout {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:18:10 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:18:10 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[599c8d9d-d16c-43a2-beb6-71b746f96e6b]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:18:10 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-75c15527-7517-4c4e-ba4f-8c623e014837 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2, portal: 172.16.0.220,3260]
Apr 12 16:18:10 user nova-compute[71874]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2, portal: 172.16.0.220,3260] successful.
Apr 12 16:18:10 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:18:10 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 -p 172.16.0.220:3260 --op delete {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:18:10 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3ef648d-928f-4687-906e-f415a564fea2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:18:10 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6413ca9-1618-475a-b377-5033fcfd1851]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:18:10 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-75c15527-7517-4c4e-ba4f-8c623e014837 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:18:10 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-75c15527-7517-4c4e-ba4f-8c623e014837 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:18:10 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-75c15527-7517-4c4e-ba4f-8c623e014837 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] <== disconnect_volume: return (308ms) None {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:18:10 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-75c15527-7517-4c4e-ba4f-8c623e014837 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] Disconnected iSCSI Volume {{(pid=71874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 16:18:10 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-75c15527-7517-4c4e-ba4f-8c623e014837 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] Deleting instance files /opt/stack/data/nova/instances/f52ee906-c8fd-4cd5-842e-de98a5099c4f_del
Apr 12 16:18:10 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-75c15527-7517-4c4e-ba4f-8c623e014837 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] Deletion of /opt/stack/data/nova/instances/f52ee906-c8fd-4cd5-842e-de98a5099c4f_del complete
Apr 12 16:18:10 user nova-compute[71874]: INFO nova.compute.manager [None req-75c15527-7517-4c4e-ba4f-8c623e014837 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] Took 1.19 seconds to destroy the instance on the hypervisor.
Apr 12 16:18:10 user nova-compute[71874]: DEBUG oslo.service.loopingcall [None req-75c15527-7517-4c4e-ba4f-8c623e014837 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71874) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 16:18:10 user nova-compute[71874]: DEBUG nova.compute.manager [-] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] Deallocating network for instance {{(pid=71874) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 16:18:10 user nova-compute[71874]: DEBUG nova.network.neutron [-] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] deallocate_for_instance() {{(pid=71874) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 16:18:10 user nova-compute[71874]: DEBUG nova.network.neutron [-] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] Updating instance_info_cache with network_info: [] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:18:10 user nova-compute[71874]: INFO nova.compute.manager [-] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] Took 0.50 seconds to deallocate network for instance.
Apr 12 16:18:10 user nova-compute[71874]: DEBUG nova.compute.manager [req-14d56617-4e0d-45e3-8f56-d7c63b733472 req-6b0d6dc5-ac8b-4b72-9f73-399a7b5e824f service nova] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] Received event network-vif-deleted-955511f0-eca8-447d-a105-fdd5f182de62 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:18:10 user nova-compute[71874]: INFO nova.compute.manager [req-14d56617-4e0d-45e3-8f56-d7c63b733472 req-6b0d6dc5-ac8b-4b72-9f73-399a7b5e824f service nova] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] Neutron deleted interface 955511f0-eca8-447d-a105-fdd5f182de62; detaching it from the instance and deleting it from the info cache
Apr 12 16:18:10 user nova-compute[71874]: DEBUG nova.network.neutron [req-14d56617-4e0d-45e3-8f56-d7c63b733472 req-6b0d6dc5-ac8b-4b72-9f73-399a7b5e824f service nova] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] Updating instance_info_cache with network_info: [] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:18:10 user nova-compute[71874]: DEBUG nova.compute.manager [req-14d56617-4e0d-45e3-8f56-d7c63b733472 req-6b0d6dc5-ac8b-4b72-9f73-399a7b5e824f service nova] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] Detach interface failed, port_id=955511f0-eca8-447d-a105-fdd5f182de62, reason: Instance f52ee906-c8fd-4cd5-842e-de98a5099c4f could not be found. {{(pid=71874) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 12 16:18:10 user nova-compute[71874]: DEBUG nova.compute.manager [req-d4b3b37e-7e28-4e9a-ae8e-be60d972d969 req-163a2ff0-8cac-4721-a9f0-518d8f99d656 service nova] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Received event network-vif-plugged-eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:18:10 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-d4b3b37e-7e28-4e9a-ae8e-be60d972d969 req-163a2ff0-8cac-4721-a9f0-518d8f99d656 service nova] Acquiring lock "4190e244-84b1-47b6-813d-9cadb7c65975-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:18:10 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-d4b3b37e-7e28-4e9a-ae8e-be60d972d969 req-163a2ff0-8cac-4721-a9f0-518d8f99d656 service nova] Lock "4190e244-84b1-47b6-813d-9cadb7c65975-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:18:10 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-d4b3b37e-7e28-4e9a-ae8e-be60d972d969 req-163a2ff0-8cac-4721-a9f0-518d8f99d656 service nova] Lock "4190e244-84b1-47b6-813d-9cadb7c65975-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:18:10 user nova-compute[71874]: DEBUG nova.compute.manager [req-d4b3b37e-7e28-4e9a-ae8e-be60d972d969 req-163a2ff0-8cac-4721-a9f0-518d8f99d656 service nova] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] No waiting events found dispatching network-vif-plugged-eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:18:10 user nova-compute[71874]: WARNING nova.compute.manager [req-d4b3b37e-7e28-4e9a-ae8e-be60d972d969 req-163a2ff0-8cac-4721-a9f0-518d8f99d656 service nova] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Received unexpected event network-vif-plugged-eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c for instance with vm_state stopped and task_state powering-on.
Apr 12 16:18:10 user nova-compute[71874]: DEBUG nova.virt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Emitting event <LifecycleEvent: 1681316290.8030286, 4190e244-84b1-47b6-813d-9cadb7c65975 => Resumed> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:18:10 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] VM Resumed (Lifecycle Event)
Apr 12 16:18:10 user nova-compute[71874]: DEBUG nova.compute.manager [None req-0aaccf0e-ec39-4a02-a484-c1218277a94e tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Instance event wait completed in 0 seconds for  {{(pid=71874) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 16:18:10 user nova-compute[71874]: INFO nova.virt.libvirt.driver [-] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Instance rebooted successfully.
Apr 12 16:18:10 user nova-compute[71874]: DEBUG nova.compute.manager [None req-0aaccf0e-ec39-4a02-a484-c1218277a94e tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:18:10 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:18:10 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=71874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 16:18:10 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] During sync_power_state the instance has a pending task (powering-on). Skip.
Apr 12 16:18:10 user nova-compute[71874]: DEBUG nova.virt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Emitting event <LifecycleEvent: 1681316290.8046265, 4190e244-84b1-47b6-813d-9cadb7c65975 => Started> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:18:10 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] VM Started (Lifecycle Event)
Apr 12 16:18:10 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:18:10 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=71874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 16:18:11 user nova-compute[71874]: DEBUG nova.compute.manager [req-a7e45348-2eb0-4988-82d2-e2130fc978af req-3cfd0a6f-d62e-4608-8258-aa731079f6dc service nova] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] Received event network-vif-plugged-955511f0-eca8-447d-a105-fdd5f182de62 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:18:11 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-a7e45348-2eb0-4988-82d2-e2130fc978af req-3cfd0a6f-d62e-4608-8258-aa731079f6dc service nova] Acquiring lock "f52ee906-c8fd-4cd5-842e-de98a5099c4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:18:11 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-a7e45348-2eb0-4988-82d2-e2130fc978af req-3cfd0a6f-d62e-4608-8258-aa731079f6dc service nova] Lock "f52ee906-c8fd-4cd5-842e-de98a5099c4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:18:11 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-a7e45348-2eb0-4988-82d2-e2130fc978af req-3cfd0a6f-d62e-4608-8258-aa731079f6dc service nova] Lock "f52ee906-c8fd-4cd5-842e-de98a5099c4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:18:11 user nova-compute[71874]: DEBUG nova.compute.manager [req-a7e45348-2eb0-4988-82d2-e2130fc978af req-3cfd0a6f-d62e-4608-8258-aa731079f6dc service nova] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] No waiting events found dispatching network-vif-plugged-955511f0-eca8-447d-a105-fdd5f182de62 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:18:11 user nova-compute[71874]: WARNING nova.compute.manager [req-a7e45348-2eb0-4988-82d2-e2130fc978af req-3cfd0a6f-d62e-4608-8258-aa731079f6dc service nova] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] Received unexpected event network-vif-plugged-955511f0-eca8-447d-a105-fdd5f182de62 for instance with vm_state active and task_state deleting.
Apr 12 16:18:11 user nova-compute[71874]: INFO nova.compute.manager [None req-75c15527-7517-4c4e-ba4f-8c623e014837 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] Took 0.89 seconds to detach 1 volumes for instance.
Apr 12 16:18:11 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-75c15527-7517-4c4e-ba4f-8c623e014837 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:18:11 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-75c15527-7517-4c4e-ba4f-8c623e014837 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:18:11 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-75c15527-7517-4c4e-ba4f-8c623e014837 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Inventory has not changed in ProviderTree for provider: 0e94b4c8-cd49-45e4-9133-d36eb4b2456b {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 16:18:11 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-75c15527-7517-4c4e-ba4f-8c623e014837 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Inventory has not changed for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 16:18:11 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-75c15527-7517-4c4e-ba4f-8c623e014837 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.382s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:18:12 user nova-compute[71874]: INFO nova.scheduler.client.report [None req-75c15527-7517-4c4e-ba4f-8c623e014837 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Deleted allocations for instance f52ee906-c8fd-4cd5-842e-de98a5099c4f
Apr 12 16:18:12 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-75c15527-7517-4c4e-ba4f-8c623e014837 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "f52ee906-c8fd-4cd5-842e-de98a5099c4f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.189s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:18:12 user nova-compute[71874]: DEBUG nova.compute.manager [req-c67dede3-7d27-4f4d-9a21-6adf94c0346f req-057f6d4a-c39a-4c70-8491-48037dc9a4b5 service nova] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] Received event network-changed-d023dabe-13d5-4bbb-aa87-e9c1f5f1a048 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:18:12 user nova-compute[71874]: DEBUG nova.compute.manager [req-c67dede3-7d27-4f4d-9a21-6adf94c0346f req-057f6d4a-c39a-4c70-8491-48037dc9a4b5 service nova] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] Refreshing instance network info cache due to event network-changed-d023dabe-13d5-4bbb-aa87-e9c1f5f1a048. {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 16:18:12 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-c67dede3-7d27-4f4d-9a21-6adf94c0346f req-057f6d4a-c39a-4c70-8491-48037dc9a4b5 service nova] Acquiring lock "refresh_cache-b4c37cbf-1743-4dd5-97fd-2bb12ebee763" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:18:12 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-c67dede3-7d27-4f4d-9a21-6adf94c0346f req-057f6d4a-c39a-4c70-8491-48037dc9a4b5 service nova] Acquired lock "refresh_cache-b4c37cbf-1743-4dd5-97fd-2bb12ebee763" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:18:12 user nova-compute[71874]: DEBUG nova.network.neutron [req-c67dede3-7d27-4f4d-9a21-6adf94c0346f req-057f6d4a-c39a-4c70-8491-48037dc9a4b5 service nova] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] Refreshing network info cache for port d023dabe-13d5-4bbb-aa87-e9c1f5f1a048 {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 16:18:13 user nova-compute[71874]: DEBUG nova.compute.manager [req-9db50534-2fa0-48a3-91d5-1b27ede0bff0 req-74e6847b-971b-4d37-bc6b-639e1aad754e service nova] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] Received event network-changed-d023dabe-13d5-4bbb-aa87-e9c1f5f1a048 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:18:13 user nova-compute[71874]: DEBUG nova.compute.manager [req-9db50534-2fa0-48a3-91d5-1b27ede0bff0 req-74e6847b-971b-4d37-bc6b-639e1aad754e service nova] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] Refreshing instance network info cache due to event network-changed-d023dabe-13d5-4bbb-aa87-e9c1f5f1a048. {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 16:18:13 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-9db50534-2fa0-48a3-91d5-1b27ede0bff0 req-74e6847b-971b-4d37-bc6b-639e1aad754e service nova] Acquiring lock "refresh_cache-b4c37cbf-1743-4dd5-97fd-2bb12ebee763" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:18:13 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-a11fa36b-0930-4d12-8597-015eda7500f3 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Acquiring lock "b4c37cbf-1743-4dd5-97fd-2bb12ebee763" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:18:13 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-a11fa36b-0930-4d12-8597-015eda7500f3 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "b4c37cbf-1743-4dd5-97fd-2bb12ebee763" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:18:13 user nova-compute[71874]: INFO nova.compute.manager [None req-a11fa36b-0930-4d12-8597-015eda7500f3 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] Detaching volume 63821959-5dfd-4f66-a6e5-90a20b30efab
Apr 12 16:18:13 user nova-compute[71874]: DEBUG nova.network.neutron [req-c67dede3-7d27-4f4d-9a21-6adf94c0346f req-057f6d4a-c39a-4c70-8491-48037dc9a4b5 service nova] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] Updated VIF entry in instance network info cache for port d023dabe-13d5-4bbb-aa87-e9c1f5f1a048. {{(pid=71874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 16:18:13 user nova-compute[71874]: DEBUG nova.network.neutron [req-c67dede3-7d27-4f4d-9a21-6adf94c0346f req-057f6d4a-c39a-4c70-8491-48037dc9a4b5 service nova] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] Updating instance_info_cache with network_info: [{"id": "d023dabe-13d5-4bbb-aa87-e9c1f5f1a048", "address": "fa:16:3e:59:df:38", "network": {"id": "58f92787-e3b6-4fd3-bd75-7169f1a36651", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-614349033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "236b9e609eb44071bc88971bff96931e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd023dabe-13", "ovs_interfaceid": "d023dabe-13d5-4bbb-aa87-e9c1f5f1a048", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:18:13 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:18:13 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-c67dede3-7d27-4f4d-9a21-6adf94c0346f req-057f6d4a-c39a-4c70-8491-48037dc9a4b5 service nova] Releasing lock "refresh_cache-b4c37cbf-1743-4dd5-97fd-2bb12ebee763" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:18:13 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-9db50534-2fa0-48a3-91d5-1b27ede0bff0 req-74e6847b-971b-4d37-bc6b-639e1aad754e service nova] Acquired lock "refresh_cache-b4c37cbf-1743-4dd5-97fd-2bb12ebee763" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:18:13 user nova-compute[71874]: DEBUG nova.network.neutron [req-9db50534-2fa0-48a3-91d5-1b27ede0bff0 req-74e6847b-971b-4d37-bc6b-639e1aad754e service nova] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] Refreshing network info cache for port d023dabe-13d5-4bbb-aa87-e9c1f5f1a048 {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 16:18:13 user nova-compute[71874]: INFO nova.virt.block_device [None req-a11fa36b-0930-4d12-8597-015eda7500f3 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] Attempting to driver detach volume 63821959-5dfd-4f66-a6e5-90a20b30efab from mountpoint /dev/vdb
Apr 12 16:18:13 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-a11fa36b-0930-4d12-8597-015eda7500f3 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Attempting to detach device vdb from instance b4c37cbf-1743-4dd5-97fd-2bb12ebee763 from the persistent domain config. {{(pid=71874) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 16:18:13 user nova-compute[71874]: DEBUG nova.virt.libvirt.guest [None req-a11fa36b-0930-4d12-8597-015eda7500f3 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 16:18:13 user nova-compute[71874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 16:18:13 user nova-compute[71874]:   <source dev="/dev/sdc"/>
Apr 12 16:18:13 user nova-compute[71874]:   <target dev="vdb" bus="virtio"/>
Apr 12 16:18:13 user nova-compute[71874]:   <serial>63821959-5dfd-4f66-a6e5-90a20b30efab</serial>
Apr 12 16:18:13 user nova-compute[71874]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 16:18:13 user nova-compute[71874]: </disk>
Apr 12 16:18:13 user nova-compute[71874]:  {{(pid=71874) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 16:18:13 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-a11fa36b-0930-4d12-8597-015eda7500f3 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Successfully detached device vdb from instance b4c37cbf-1743-4dd5-97fd-2bb12ebee763 from the persistent domain config.
Apr 12 16:18:13 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-a11fa36b-0930-4d12-8597-015eda7500f3 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b4c37cbf-1743-4dd5-97fd-2bb12ebee763 from the live domain config. {{(pid=71874) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 16:18:13 user nova-compute[71874]: DEBUG nova.virt.libvirt.guest [None req-a11fa36b-0930-4d12-8597-015eda7500f3 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 16:18:13 user nova-compute[71874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 16:18:13 user nova-compute[71874]:   <source dev="/dev/sdc"/>
Apr 12 16:18:13 user nova-compute[71874]:   <target dev="vdb" bus="virtio"/>
Apr 12 16:18:13 user nova-compute[71874]:   <serial>63821959-5dfd-4f66-a6e5-90a20b30efab</serial>
Apr 12 16:18:13 user nova-compute[71874]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 16:18:13 user nova-compute[71874]: </disk>
Apr 12 16:18:13 user nova-compute[71874]:  {{(pid=71874) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 16:18:14 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Received event <DeviceRemovedEvent: 1681316293.9565027, b4c37cbf-1743-4dd5-97fd-2bb12ebee763 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71874) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 16:18:14 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-a11fa36b-0930-4d12-8597-015eda7500f3 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b4c37cbf-1743-4dd5-97fd-2bb12ebee763 {{(pid=71874) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 16:18:14 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-a11fa36b-0930-4d12-8597-015eda7500f3 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Successfully detached device vdb from instance b4c37cbf-1743-4dd5-97fd-2bb12ebee763 from the live domain config.
Apr 12 16:18:14 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a11fa36b-0930-4d12-8597-015eda7500f3 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] calling os-brick to detach iSCSI Volume {{(pid=71874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 16:18:14 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-a11fa36b-0930-4d12-8597-015eda7500f3 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3c0216320>, {'target_iqn': 'iqn.2010-10.org.openstack:63821959-5dfd-4f66-a6e5-90a20b30efab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oVuXPgzQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:18:14 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-a11fa36b-0930-4d12-8597-015eda7500f3 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:18:14 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-a11fa36b-0930-4d12-8597-015eda7500f3 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:18:14 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-a11fa36b-0930-4d12-8597-015eda7500f3 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:18:14 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:18:14 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:18:14 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[56a24c90-79a2-45c6-b9d7-3a17944dd52d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:63821959-5dfd-4f66-a6e5-90a20b30efab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:18:14 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-a11fa36b-0930-4d12-8597-015eda7500f3 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 16:18:14 user nova-compute[71874]: No targets found.
Apr 12 16:18:14 user nova-compute[71874]: iSNS:
Apr 12 16:18:14 user nova-compute[71874]: No targets found.
Apr 12 16:18:14 user nova-compute[71874]: STATIC:
Apr 12 16:18:14 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:63821959-5dfd-4f66-a6e5-90a20b30efab
Apr 12 16:18:14 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:18:14 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:18:14 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775
Apr 12 16:18:14 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:18:14 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:18:14 user nova-compute[71874]: FIRMWARE:
Apr 12 16:18:14 user nova-compute[71874]: No targets found.
Apr 12 16:18:14 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:18:14 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-a11fa36b-0930-4d12-8597-015eda7500f3 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 16:18:14 user nova-compute[71874]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 16:18:14 user nova-compute[71874]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71874) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 16:18:14 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-a11fa36b-0930-4d12-8597-015eda7500f3 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:63821959-5dfd-4f66-a6e5-90a20b30efab', 0)] {{(pid=71874) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 16:18:14 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:18:14 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:18:14 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[99abdfb3-a77d-4343-8c9a-5f6160541fce]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:63821959-5dfd-4f66-a6e5-90a20b30efab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:18:14 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:18:14 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:18:14 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8ee6558-c1f2-4fc2-922f-d7a6897fdd76]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63821959-5dfd-4f66-a6e5-90a20b30efab (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775 (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:18:14 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-a11fa36b-0930-4d12-8597-015eda7500f3 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63821959-5dfd-4f66-a6e5-90a20b30efab (non-flash)
Apr 12 16:18:14 user nova-compute[71874]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775 (non-flash)
Apr 12 16:18:14 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:18:14 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-a11fa36b-0930-4d12-8597-015eda7500f3 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63821959-5dfd-4f66-a6e5-90a20b30efab (non-flash)
Apr 12 16:18:14 user nova-compute[71874]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775 (non-flash)
Apr 12 16:18:14 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:18:14 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-a11fa36b-0930-4d12-8597-015eda7500f3 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc3c03d36d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:63821959-5dfd-4f66-a6e5-90a20b30efab'): ({'sdc'}, set())}) {{(pid=71874) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 16:18:14 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-a11fa36b-0930-4d12-8597-015eda7500f3 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Removing single pathed devices sdc {{(pid=71874) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 16:18:14 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:18:14 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:18:14 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[af957c4e-79c4-415a-81f1-dabac7a0e1e7]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:18:14 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:18:14 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.024s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:18:14 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[61179b7a-09ad-443c-a394-079510361e36]: (4, ('ok\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:18:14 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-a11fa36b-0930-4d12-8597-015eda7500f3 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Flushing IO for device /dev/sdc {{(pid=71874) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 16:18:14 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:18:14 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:18:14 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[c976c2f5-3a61-4135-880b-6979dadfe954]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:18:14 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-a11fa36b-0930-4d12-8597-015eda7500f3 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71874) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 16:18:14 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:18:14 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:18:14 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb0719dc-afd3-46d6-9c41-2a31c41b2381]: (4, ('1', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:18:14 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-a11fa36b-0930-4d12-8597-015eda7500f3 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71874) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 16:18:14 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-a11fa36b-0930-4d12-8597-015eda7500f3 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] SCSI volumes sdc have been removed. {{(pid=71874) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 16:18:14 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-a11fa36b-0930-4d12-8597-015eda7500f3 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:63821959-5dfd-4f66-a6e5-90a20b30efab')] {{(pid=71874) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 16:18:14 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63821959-5dfd-4f66-a6e5-90a20b30efab -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:18:14 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63821959-5dfd-4f66-a6e5-90a20b30efab -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:18:14 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab1dea1b-fe9a-45b0-8c58-93261f9c0ca8]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:18:14 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-a11fa36b-0930-4d12-8597-015eda7500f3 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:18:14 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63821959-5dfd-4f66-a6e5-90a20b30efab -p 172.16.0.220:3260 --logout {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:18:14 user nova-compute[71874]: DEBUG nova.network.neutron [req-9db50534-2fa0-48a3-91d5-1b27ede0bff0 req-74e6847b-971b-4d37-bc6b-639e1aad754e service nova] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] Updated VIF entry in instance network info cache for port d023dabe-13d5-4bbb-aa87-e9c1f5f1a048. {{(pid=71874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 16:18:14 user nova-compute[71874]: DEBUG nova.network.neutron [req-9db50534-2fa0-48a3-91d5-1b27ede0bff0 req-74e6847b-971b-4d37-bc6b-639e1aad754e service nova] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] Updating instance_info_cache with network_info: [{"id": "d023dabe-13d5-4bbb-aa87-e9c1f5f1a048", "address": "fa:16:3e:59:df:38", "network": {"id": "58f92787-e3b6-4fd3-bd75-7169f1a36651", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-614349033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "236b9e609eb44071bc88971bff96931e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd023dabe-13", "ovs_interfaceid": "d023dabe-13d5-4bbb-aa87-e9c1f5f1a048", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:18:14 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-9db50534-2fa0-48a3-91d5-1b27ede0bff0 req-74e6847b-971b-4d37-bc6b-639e1aad754e service nova] Releasing lock "refresh_cache-b4c37cbf-1743-4dd5-97fd-2bb12ebee763" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:18:14 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63821959-5dfd-4f66-a6e5-90a20b30efab -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:18:14 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[30f8833f-1293-44b7-b2a8-10fa14ed8bb8]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:63821959-5dfd-4f66-a6e5-90a20b30efab, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:63821959-5dfd-4f66-a6e5-90a20b30efab, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:18:14 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-a11fa36b-0930-4d12-8597-015eda7500f3 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:63821959-5dfd-4f66-a6e5-90a20b30efab, portal: 172.16.0.220,3260]
Apr 12 16:18:14 user nova-compute[71874]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:63821959-5dfd-4f66-a6e5-90a20b30efab, portal: 172.16.0.220,3260] successful.
Apr 12 16:18:14 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:18:14 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63821959-5dfd-4f66-a6e5-90a20b30efab -p 172.16.0.220:3260 --op delete {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:18:14 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63821959-5dfd-4f66-a6e5-90a20b30efab -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:18:14 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[45436884-883b-4c92-af3b-cd89b740667b]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:18:14 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-a11fa36b-0930-4d12-8597-015eda7500f3 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:18:14 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-a11fa36b-0930-4d12-8597-015eda7500f3 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.324s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:18:14 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-a11fa36b-0930-4d12-8597-015eda7500f3 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] <== disconnect_volume: return (325ms) None {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:18:14 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a11fa36b-0930-4d12-8597-015eda7500f3 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] Disconnected iSCSI Volume {{(pid=71874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 16:18:14 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:18:15 user nova-compute[71874]: DEBUG nova.objects.instance [None req-a11fa36b-0930-4d12-8597-015eda7500f3 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lazy-loading 'flavor' on Instance uuid b4c37cbf-1743-4dd5-97fd-2bb12ebee763 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:18:15 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-a11fa36b-0930-4d12-8597-015eda7500f3 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "b4c37cbf-1743-4dd5-97fd-2bb12ebee763" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.921s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:18:15 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-c699c40c-42ae-4799-9b2c-b32d03f991ea tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "77842113-37e8-4dc3-bd28-84417eb1ac31" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:18:15 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-c699c40c-42ae-4799-9b2c-b32d03f991ea tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "77842113-37e8-4dc3-bd28-84417eb1ac31" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:18:15 user nova-compute[71874]: DEBUG nova.compute.manager [None req-c699c40c-42ae-4799-9b2c-b32d03f991ea tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 77842113-37e8-4dc3-bd28-84417eb1ac31] Starting instance... {{(pid=71874) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 16:18:15 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-c699c40c-42ae-4799-9b2c-b32d03f991ea tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:18:15 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-c699c40c-42ae-4799-9b2c-b32d03f991ea tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:18:15 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-c699c40c-42ae-4799-9b2c-b32d03f991ea tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71874) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 16:18:15 user nova-compute[71874]: INFO nova.compute.claims [None req-c699c40c-42ae-4799-9b2c-b32d03f991ea tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 77842113-37e8-4dc3-bd28-84417eb1ac31] Claim successful on node user
Apr 12 16:18:15 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-c699c40c-42ae-4799-9b2c-b32d03f991ea tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Inventory has not changed in ProviderTree for provider: 0e94b4c8-cd49-45e4-9133-d36eb4b2456b {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 16:18:15 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-c699c40c-42ae-4799-9b2c-b32d03f991ea tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Inventory has not changed for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 16:18:15 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-c699c40c-42ae-4799-9b2c-b32d03f991ea tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.342s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:18:15 user nova-compute[71874]: DEBUG nova.compute.manager [None req-c699c40c-42ae-4799-9b2c-b32d03f991ea tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 77842113-37e8-4dc3-bd28-84417eb1ac31] Start building networks asynchronously for instance. {{(pid=71874) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 16:18:15 user nova-compute[71874]: DEBUG nova.compute.manager [None req-c699c40c-42ae-4799-9b2c-b32d03f991ea tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 77842113-37e8-4dc3-bd28-84417eb1ac31] Allocating IP information in the background. {{(pid=71874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 16:18:15 user nova-compute[71874]: DEBUG nova.network.neutron [None req-c699c40c-42ae-4799-9b2c-b32d03f991ea tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 77842113-37e8-4dc3-bd28-84417eb1ac31] allocate_for_instance() {{(pid=71874) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 16:18:15 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-c699c40c-42ae-4799-9b2c-b32d03f991ea tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 77842113-37e8-4dc3-bd28-84417eb1ac31] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 16:18:15 user nova-compute[71874]: DEBUG nova.compute.manager [None req-c699c40c-42ae-4799-9b2c-b32d03f991ea tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 77842113-37e8-4dc3-bd28-84417eb1ac31] Start building block device mappings for instance. {{(pid=71874) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 16:18:16 user nova-compute[71874]: INFO nova.virt.block_device [None req-c699c40c-42ae-4799-9b2c-b32d03f991ea tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 77842113-37e8-4dc3-bd28-84417eb1ac31] Booting with volume 952c0ad3-7b56-454e-af58-10213195373d at /dev/vda
Apr 12 16:18:16 user nova-compute[71874]: DEBUG nova.policy [None req-c699c40c-42ae-4799-9b2c-b32d03f991ea tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7054687447fc42339e9046ced4915890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b1b89a5eeb408a8d0938e5f59f405f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71874) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 16:18:16 user nova-compute[71874]: DEBUG os_brick.utils [None req-c699c40c-42ae-4799-9b2c-b32d03f991ea tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:18:16 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:18:16 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:18:16 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[5db98c19-d34a-479a-86d7-02125ed9372f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:61a48d4489d2\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:18:16 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:18:16 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:18:16 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0a9059d-50a7-459d-ba4b-8a80b5e777f3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:18:16 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:18:16 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:18:16 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[a400a192-3d6d-413d-8e29-0d4243d4e5da]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:18:16 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[08c9f24d-1aad-4b2d-a61c-81b6d7a3663d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:18:16 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-c699c40c-42ae-4799-9b2c-b32d03f991ea tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Running cmd (subprocess): nvme version {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:18:16 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-c699c40c-42ae-4799-9b2c-b32d03f991ea tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] 'nvme version' failed. Not Retrying. {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 16:18:16 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c699c40c-42ae-4799-9b2c-b32d03f991ea tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] nvme not present on system {{(pid=71874) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 16:18:16 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:18:16 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 16:18:16 user nova-compute[71874]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 16:18:16 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad3b4b70-ae63-4d32-bd19-675b6c135258]: (4, '') {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:18:16 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.lightos [None req-c699c40c-42ae-4799-9b2c-b32d03f991ea tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71874) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 16:18:16 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.lightos [None req-c699c40c-42ae-4799-9b2c-b32d03f991ea tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71874) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 16:18:16 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.lightos [None req-c699c40c-42ae-4799-9b2c-b32d03f991ea tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] LIGHTOS: no hostnqn found. {{(pid=71874) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 16:18:16 user nova-compute[71874]: DEBUG os_brick.utils [None req-c699c40c-42ae-4799-9b2c-b32d03f991ea tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:61a48d4489d2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:18:16 user nova-compute[71874]: DEBUG nova.virt.block_device [None req-c699c40c-42ae-4799-9b2c-b32d03f991ea tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 77842113-37e8-4dc3-bd28-84417eb1ac31] Updating existing volume attachment record: ce5c081a-984e-4355-b0b4-bf79e8bd0be4 {{(pid=71874) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 16:18:16 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:18:16 user nova-compute[71874]: DEBUG nova.network.neutron [None req-c699c40c-42ae-4799-9b2c-b32d03f991ea tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 77842113-37e8-4dc3-bd28-84417eb1ac31] Successfully created port: c9b27dd5-a751-4179-af86-77931b5f55e6 {{(pid=71874) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 16:18:17 user nova-compute[71874]: DEBUG nova.network.neutron [None req-c699c40c-42ae-4799-9b2c-b32d03f991ea tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 77842113-37e8-4dc3-bd28-84417eb1ac31] Successfully updated port: c9b27dd5-a751-4179-af86-77931b5f55e6 {{(pid=71874) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 16:18:17 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-c699c40c-42ae-4799-9b2c-b32d03f991ea tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "refresh_cache-77842113-37e8-4dc3-bd28-84417eb1ac31" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:18:17 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-c699c40c-42ae-4799-9b2c-b32d03f991ea tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquired lock "refresh_cache-77842113-37e8-4dc3-bd28-84417eb1ac31" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:18:17 user nova-compute[71874]: DEBUG nova.network.neutron [None req-c699c40c-42ae-4799-9b2c-b32d03f991ea tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 77842113-37e8-4dc3-bd28-84417eb1ac31] Building network info cache for instance {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 16:18:17 user nova-compute[71874]: DEBUG nova.compute.manager [req-fa00f27b-4e25-49c7-b3e5-db863ca46968 req-152051fd-3c61-4643-9029-77b666b3e518 service nova] [instance: 77842113-37e8-4dc3-bd28-84417eb1ac31] Received event network-changed-c9b27dd5-a751-4179-af86-77931b5f55e6 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:18:17 user nova-compute[71874]: DEBUG nova.compute.manager [req-fa00f27b-4e25-49c7-b3e5-db863ca46968 req-152051fd-3c61-4643-9029-77b666b3e518 service nova] [instance: 77842113-37e8-4dc3-bd28-84417eb1ac31] Refreshing instance network info cache due to event network-changed-c9b27dd5-a751-4179-af86-77931b5f55e6. {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 16:18:17 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-fa00f27b-4e25-49c7-b3e5-db863ca46968 req-152051fd-3c61-4643-9029-77b666b3e518 service nova] Acquiring lock "refresh_cache-77842113-37e8-4dc3-bd28-84417eb1ac31" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:18:17 user nova-compute[71874]: DEBUG nova.network.neutron [None req-c699c40c-42ae-4799-9b2c-b32d03f991ea tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 77842113-37e8-4dc3-bd28-84417eb1ac31] Instance cache missing network info. {{(pid=71874) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 16:18:17 user nova-compute[71874]: DEBUG nova.network.neutron [None req-c699c40c-42ae-4799-9b2c-b32d03f991ea tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 77842113-37e8-4dc3-bd28-84417eb1ac31] Updating instance_info_cache with network_info: [{"id": "c9b27dd5-a751-4179-af86-77931b5f55e6", "address": "fa:16:3e:cb:0c:5a", "network": {"id": "1439244b-8287-4bba-a88c-99d4b498cccd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1491302639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29b1b89a5eeb408a8d0938e5f59f405f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9b27dd5-a7", "ovs_interfaceid": "c9b27dd5-a751-4179-af86-77931b5f55e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:18:17 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-c699c40c-42ae-4799-9b2c-b32d03f991ea tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Releasing lock "refresh_cache-77842113-37e8-4dc3-bd28-84417eb1ac31" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:18:17 user nova-compute[71874]: DEBUG nova.compute.manager [None req-c699c40c-42ae-4799-9b2c-b32d03f991ea tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 77842113-37e8-4dc3-bd28-84417eb1ac31] Instance network_info: |[{"id": "c9b27dd5-a751-4179-af86-77931b5f55e6", "address": "fa:16:3e:cb:0c:5a", "network": {"id": "1439244b-8287-4bba-a88c-99d4b498cccd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1491302639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29b1b89a5eeb408a8d0938e5f59f405f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9b27dd5-a7", "ovs_interfaceid": "c9b27dd5-a751-4179-af86-77931b5f55e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 16:18:17 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-fa00f27b-4e25-49c7-b3e5-db863ca46968 req-152051fd-3c61-4643-9029-77b666b3e518 service nova] Acquired lock "refresh_cache-77842113-37e8-4dc3-bd28-84417eb1ac31" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:18:17 user nova-compute[71874]: DEBUG nova.network.neutron [req-fa00f27b-4e25-49c7-b3e5-db863ca46968 req-152051fd-3c61-4643-9029-77b666b3e518 service nova] [instance: 77842113-37e8-4dc3-bd28-84417eb1ac31] Refreshing network info cache for port c9b27dd5-a751-4179-af86-77931b5f55e6 {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 16:18:18 user nova-compute[71874]: DEBUG nova.network.neutron [req-fa00f27b-4e25-49c7-b3e5-db863ca46968 req-152051fd-3c61-4643-9029-77b666b3e518 service nova] [instance: 77842113-37e8-4dc3-bd28-84417eb1ac31] Updated VIF entry in instance network info cache for port c9b27dd5-a751-4179-af86-77931b5f55e6. {{(pid=71874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 16:18:18 user nova-compute[71874]: DEBUG nova.network.neutron [req-fa00f27b-4e25-49c7-b3e5-db863ca46968 req-152051fd-3c61-4643-9029-77b666b3e518 service nova] [instance: 77842113-37e8-4dc3-bd28-84417eb1ac31] Updating instance_info_cache with network_info: [{"id": "c9b27dd5-a751-4179-af86-77931b5f55e6", "address": "fa:16:3e:cb:0c:5a", "network": {"id": "1439244b-8287-4bba-a88c-99d4b498cccd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1491302639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29b1b89a5eeb408a8d0938e5f59f405f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9b27dd5-a7", "ovs_interfaceid": "c9b27dd5-a751-4179-af86-77931b5f55e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:18:18 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-fa00f27b-4e25-49c7-b3e5-db863ca46968 req-152051fd-3c61-4643-9029-77b666b3e518 service nova] Releasing lock "refresh_cache-77842113-37e8-4dc3-bd28-84417eb1ac31" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:18:19 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:18:21 user nova-compute[71874]: DEBUG nova.compute.manager [None req-c699c40c-42ae-4799-9b2c-b32d03f991ea tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 77842113-37e8-4dc3-bd28-84417eb1ac31] Start spawning the instance on the hypervisor. {{(pid=71874) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 16:18:21 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-c699c40c-42ae-4799-9b2c-b32d03f991ea tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 77842113-37e8-4dc3-bd28-84417eb1ac31] Creating instance directory {{(pid=71874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 16:18:21 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-c699c40c-42ae-4799-9b2c-b32d03f991ea tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 77842113-37e8-4dc3-bd28-84417eb1ac31] Creating image(s)
Apr 12 16:18:21 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-c699c40c-42ae-4799-9b2c-b32d03f991ea tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 77842113-37e8-4dc3-bd28-84417eb1ac31] Did not create local disks {{(pid=71874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 12 16:18:21 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-c699c40c-42ae-4799-9b2c-b32d03f991ea tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 77842113-37e8-4dc3-bd28-84417eb1ac31] Ensure instance console log exists: /opt/stack/data/nova/instances/77842113-37e8-4dc3-bd28-84417eb1ac31/console.log {{(pid=71874) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 16:18:21 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-c699c40c-42ae-4799-9b2c-b32d03f991ea tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:18:21 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-c699c40c-42ae-4799-9b2c-b32d03f991ea tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:18:21 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-c699c40c-42ae-4799-9b2c-b32d03f991ea tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:18:21 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-c699c40c-42ae-4799-9b2c-b32d03f991ea tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 77842113-37e8-4dc3-bd28-84417eb1ac31] Start _get_guest_xml network_info=[{"id": "c9b27dd5-a751-4179-af86-77931b5f55e6", "address": "fa:16:3e:cb:0c:5a", "network": {"id": "1439244b-8287-4bba-a88c-99d4b498cccd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1491302639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29b1b89a5eeb408a8d0938e5f59f405f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9b27dd5-a7", "ovs_interfaceid": "c9b27dd5-a751-4179-af86-77931b5f55e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'delete_on_termination': True, 'attachment_id': 'ce5c081a-984e-4355-b0b4-bf79e8bd0be4', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:952c0ad3-7b56-454e-af58-10213195373d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CVOnjaXq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '77842113-37e8-4dc3-bd28-84417eb1ac31', 'attached_at': '', 'detached_at': '', 'volume_id': '952c0ad3-7b56-454e-af58-10213195373d', 'serial': '952c0ad3-7b56-454e-af58-10213195373d'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'volume_type': None} {{(pid=71874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 16:18:21 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-c699c40c-42ae-4799-9b2c-b32d03f991ea tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:18:21 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-c699c40c-42ae-4799-9b2c-b32d03f991ea tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:18:21 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-c699c40c-42ae-4799-9b2c-b32d03f991ea tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71874) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 16:18:21 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-c699c40c-42ae-4799-9b2c-b32d03f991ea tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T15:56:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 16:18:21 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-c699c40c-42ae-4799-9b2c-b32d03f991ea tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Flavor limits 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 16:18:21 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-c699c40c-42ae-4799-9b2c-b32d03f991ea tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Image limits 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 16:18:21 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-c699c40c-42ae-4799-9b2c-b32d03f991ea tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Flavor pref 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 16:18:21 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-c699c40c-42ae-4799-9b2c-b32d03f991ea tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Image pref 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 16:18:21 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-c699c40c-42ae-4799-9b2c-b32d03f991ea tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 16:18:21 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-c699c40c-42ae-4799-9b2c-b32d03f991ea tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 16:18:21 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-c699c40c-42ae-4799-9b2c-b32d03f991ea tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 16:18:21 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-c699c40c-42ae-4799-9b2c-b32d03f991ea tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Got 1 possible topologies {{(pid=71874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 16:18:21 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-c699c40c-42ae-4799-9b2c-b32d03f991ea tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 16:18:21 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-c699c40c-42ae-4799-9b2c-b32d03f991ea tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 16:18:21 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c699c40c-42ae-4799-9b2c-b32d03f991ea tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 77842113-37e8-4dc3-bd28-84417eb1ac31] Calling os-brick to attach iSCSI Volume {{(pid=71874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 16:18:21 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-c699c40c-42ae-4799-9b2c-b32d03f991ea tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3c0216320>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:952c0ad3-7b56-454e-af58-10213195373d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CVOnjaXq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:18:21 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-c699c40c-42ae-4799-9b2c-b32d03f991ea tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:18:21 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-c699c40c-42ae-4799-9b2c-b32d03f991ea tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:18:21 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-c699c40c-42ae-4799-9b2c-b32d03f991ea tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:18:21 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-c699c40c-42ae-4799-9b2c-b32d03f991ea tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:18:21 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-c699c40c-42ae-4799-9b2c-b32d03f991ea tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:952c0ad3-7b56-454e-af58-10213195373d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:18:21 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-c699c40c-42ae-4799-9b2c-b32d03f991ea tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:952c0ad3-7b56-454e-af58-10213195373d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:18:21 user nova-compute[71874]: INFO os_brick.initiator.connectors.iscsi [None req-c699c40c-42ae-4799-9b2c-b32d03f991ea tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 16:18:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:952c0ad3-7b56-454e-af58-10213195373d -p 172.16.0.220:3260 {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:18:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:952c0ad3-7b56-454e-af58-10213195373d -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:18:21 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e541828-254b-4ffa-99b9-d8aca928afc7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:18:21 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-c699c40c-42ae-4799-9b2c-b32d03f991ea tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 16:18:21 user nova-compute[71874]:  {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:18:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:952c0ad3-7b56-454e-af58-10213195373d -p 172.16.0.220:3260 --interface default --op new {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:18:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:952c0ad3-7b56-454e-af58-10213195373d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:18:21 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cfade26-698a-4078-9711-ef6cd6ee428e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:952c0ad3-7b56-454e-af58-10213195373d] added\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:18:21 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-c699c40c-42ae-4799-9b2c-b32d03f991ea tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:952c0ad3-7b56-454e-af58-10213195373d] added
Apr 12 16:18:21 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:18:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:952c0ad3-7b56-454e-af58-10213195373d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:18:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:952c0ad3-7b56-454e-af58-10213195373d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:18:21 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[134e9325-d6ca-4222-bd9a-6ad385d417a8]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:18:21 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-c699c40c-42ae-4799-9b2c-b32d03f991ea tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:18:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:952c0ad3-7b56-454e-af58-10213195373d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:18:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:952c0ad3-7b56-454e-af58-10213195373d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.036s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:18:21 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac43823c-9f6d-4a36-8c7c-9ad7adc27aff]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:18:21 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-c699c40c-42ae-4799-9b2c-b32d03f991ea tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:18:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:952c0ad3-7b56-454e-af58-10213195373d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CVOnjaXq {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:18:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:952c0ad3-7b56-454e-af58-10213195373d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CVOnjaXq" returned: 0 in 0.019s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:18:21 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bba21df-2d6a-42de-9808-e0c075df0635]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:18:21 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-c699c40c-42ae-4799-9b2c-b32d03f991ea tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CVOnjaXq'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:18:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:952c0ad3-7b56-454e-af58-10213195373d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:18:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:952c0ad3-7b56-454e-af58-10213195373d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.039s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:18:21 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb0b9e5e-93f8-4186-a33e-fb40b584a2c2]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:18:21 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-c699c40c-42ae-4799-9b2c-b32d03f991ea tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:18:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:18:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:18:21 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[a17447a8-8eaa-4dd5-b9f7-0a461314067d]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775 (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:18:21 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-c699c40c-42ae-4799-9b2c-b32d03f991ea tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775 (non-flash)
Apr 12 16:18:21 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:18:21 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-c699c40c-42ae-4799-9b2c-b32d03f991ea tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775 (non-flash)
Apr 12 16:18:21 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:18:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:952c0ad3-7b56-454e-af58-10213195373d -p 172.16.0.220:3260 --login {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:18:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:952c0ad3-7b56-454e-af58-10213195373d -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:18:21 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab614b2f-ac84-4c68-92f7-5575a205282d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:952c0ad3-7b56-454e-af58-10213195373d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:952c0ad3-7b56-454e-af58-10213195373d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:18:21 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-c699c40c-42ae-4799-9b2c-b32d03f991ea tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:952c0ad3-7b56-454e-af58-10213195373d, portal: 172.16.0.220,3260]
Apr 12 16:18:21 user nova-compute[71874]: Login to [iface: default, target: iqn.2010-10.org.openstack:952c0ad3-7b56-454e-af58-10213195373d, portal: 172.16.0.220,3260] successful.
Apr 12 16:18:21 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:18:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:952c0ad3-7b56-454e-af58-10213195373d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:18:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:952c0ad3-7b56-454e-af58-10213195373d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:18:21 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9108b07-42ed-4003-b0cf-c9c36df14464]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:18:21 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-c699c40c-42ae-4799-9b2c-b32d03f991ea tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:18:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:18:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:18:21 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d7ef631-1699-4e90-9be6-16b7d9274179]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:952c0ad3-7b56-454e-af58-10213195373d (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:18:21 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-c699c40c-42ae-4799-9b2c-b32d03f991ea tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775 (non-flash)
Apr 12 16:18:21 user nova-compute[71874]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:952c0ad3-7b56-454e-af58-10213195373d (non-flash)
Apr 12 16:18:21 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:18:21 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-c699c40c-42ae-4799-9b2c-b32d03f991ea tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775 (non-flash)
Apr 12 16:18:21 user nova-compute[71874]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:952c0ad3-7b56-454e-af58-10213195373d (non-flash)
Apr 12 16:18:21 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:18:21 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-c699c40c-42ae-4799-9b2c-b32d03f991ea tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:952c0ad3-7b56-454e-af58-10213195373d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.316s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:18:21 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-c699c40c-42ae-4799-9b2c-b32d03f991ea tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Connected to 172.16.0.220:3260 {{(pid=71874) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 16:18:21 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-c699c40c-42ae-4799-9b2c-b32d03f991ea tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] HCTL ('33', '-', '-', 0) found on session 43 with lun 0 {{(pid=71874) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 16:18:21 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-c699c40c-42ae-4799-9b2c-b32d03f991ea tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71874) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 16:18:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:18:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:18:21 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[211809d0-73db-4561-bafb-8aa55c39fe9c]: (4, ('- - 0', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:18:21 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-c699c40c-42ae-4799-9b2c-b32d03f991ea tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Searching for a device in session 43 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71874) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 16:18:21 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-c699c40c-42ae-4799-9b2c-b32d03f991ea tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:952c0ad3-7b56-454e-af58-10213195373d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CVOnjaXq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71874) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 16:18:22 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-c699c40c-42ae-4799-9b2c-b32d03f991ea tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.349s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:18:22 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-c699c40c-42ae-4799-9b2c-b32d03f991ea tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] <== connect_volume: return (1351ms) {'type': 'block', 'scsi_wwn': '23636653464343431', 'path': '/dev/sdb'} {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:18:22 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c699c40c-42ae-4799-9b2c-b32d03f991ea tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 77842113-37e8-4dc3-bd28-84417eb1ac31] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23636653464343431', 'path': '/dev/sdb'} {{(pid=71874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 16:18:22 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-c699c40c-42ae-4799-9b2c-b32d03f991ea tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T16:18:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1534459262',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1534459262',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1534459262',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='29b1b89a5eeb408a8d0938e5f59f405f',ramdisk_id='',reservation_id='r-gqr2t7mb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-734600841',owner_user_name='tempest-TestVolumeBootPattern-734600841-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T16:18:16Z,user_data=None,user_id='7054687447fc42339e9046ced4915890',uuid=77842113-37e8-4dc3-bd28-84417eb1ac31,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c9b27dd5-a751-4179-af86-77931b5f55e6", "address": "fa:16:3e:cb:0c:5a", "network": {"id": "1439244b-8287-4bba-a88c-99d4b498cccd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1491302639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29b1b89a5eeb408a8d0938e5f59f405f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9b27dd5-a7", "ovs_interfaceid": "c9b27dd5-a751-4179-af86-77931b5f55e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 16:18:22 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-c699c40c-42ae-4799-9b2c-b32d03f991ea tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Converting VIF {"id": "c9b27dd5-a751-4179-af86-77931b5f55e6", "address": "fa:16:3e:cb:0c:5a", "network": {"id": "1439244b-8287-4bba-a88c-99d4b498cccd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1491302639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29b1b89a5eeb408a8d0938e5f59f405f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9b27dd5-a7", "ovs_interfaceid": "c9b27dd5-a751-4179-af86-77931b5f55e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:18:22 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-c699c40c-42ae-4799-9b2c-b32d03f991ea tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:0c:5a,bridge_name='br-int',has_traffic_filtering=True,id=c9b27dd5-a751-4179-af86-77931b5f55e6,network=Network(1439244b-8287-4bba-a88c-99d4b498cccd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9b27dd5-a7') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:18:22 user nova-compute[71874]: DEBUG nova.objects.instance [None req-c699c40c-42ae-4799-9b2c-b32d03f991ea tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lazy-loading 'pci_devices' on Instance uuid 77842113-37e8-4dc3-bd28-84417eb1ac31 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:18:22 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-c699c40c-42ae-4799-9b2c-b32d03f991ea tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 77842113-37e8-4dc3-bd28-84417eb1ac31] End _get_guest_xml xml=<domain type="kvm">
Apr 12 16:18:22 user nova-compute[71874]:   <uuid>77842113-37e8-4dc3-bd28-84417eb1ac31</uuid>
Apr 12 16:18:22 user nova-compute[71874]:   <name>instance-00000027</name>
Apr 12 16:18:22 user nova-compute[71874]:   <memory>131072</memory>
Apr 12 16:18:22 user nova-compute[71874]:   <vcpu>1</vcpu>
Apr 12 16:18:22 user nova-compute[71874]:   <metadata>
Apr 12 16:18:22 user nova-compute[71874]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 16:18:22 user nova-compute[71874]:       <nova:package version="0.0.0"/>
Apr 12 16:18:22 user nova-compute[71874]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1534459262</nova:name>
Apr 12 16:18:22 user nova-compute[71874]:       <nova:creationTime>2023-04-12 16:18:21</nova:creationTime>
Apr 12 16:18:22 user nova-compute[71874]:       <nova:flavor name="m1.nano">
Apr 12 16:18:22 user nova-compute[71874]:         <nova:memory>128</nova:memory>
Apr 12 16:18:22 user nova-compute[71874]:         <nova:disk>1</nova:disk>
Apr 12 16:18:22 user nova-compute[71874]:         <nova:swap>0</nova:swap>
Apr 12 16:18:22 user nova-compute[71874]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 16:18:22 user nova-compute[71874]:         <nova:vcpus>1</nova:vcpus>
Apr 12 16:18:22 user nova-compute[71874]:       </nova:flavor>
Apr 12 16:18:22 user nova-compute[71874]:       <nova:owner>
Apr 12 16:18:22 user nova-compute[71874]:         <nova:user uuid="7054687447fc42339e9046ced4915890">tempest-TestVolumeBootPattern-734600841-project-member</nova:user>
Apr 12 16:18:22 user nova-compute[71874]:         <nova:project uuid="29b1b89a5eeb408a8d0938e5f59f405f">tempest-TestVolumeBootPattern-734600841</nova:project>
Apr 12 16:18:22 user nova-compute[71874]:       </nova:owner>
Apr 12 16:18:22 user nova-compute[71874]:       <nova:ports>
Apr 12 16:18:22 user nova-compute[71874]:         <nova:port uuid="c9b27dd5-a751-4179-af86-77931b5f55e6">
Apr 12 16:18:22 user nova-compute[71874]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 12 16:18:22 user nova-compute[71874]:         </nova:port>
Apr 12 16:18:22 user nova-compute[71874]:       </nova:ports>
Apr 12 16:18:22 user nova-compute[71874]:     </nova:instance>
Apr 12 16:18:22 user nova-compute[71874]:   </metadata>
Apr 12 16:18:22 user nova-compute[71874]:   <sysinfo type="smbios">
Apr 12 16:18:22 user nova-compute[71874]:     <system>
Apr 12 16:18:22 user nova-compute[71874]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 16:18:22 user nova-compute[71874]:       <entry name="product">OpenStack Nova</entry>
Apr 12 16:18:22 user nova-compute[71874]:       <entry name="version">0.0.0</entry>
Apr 12 16:18:22 user nova-compute[71874]:       <entry name="serial">77842113-37e8-4dc3-bd28-84417eb1ac31</entry>
Apr 12 16:18:22 user nova-compute[71874]:       <entry name="uuid">77842113-37e8-4dc3-bd28-84417eb1ac31</entry>
Apr 12 16:18:22 user nova-compute[71874]:       <entry name="family">Virtual Machine</entry>
Apr 12 16:18:22 user nova-compute[71874]:     </system>
Apr 12 16:18:22 user nova-compute[71874]:   </sysinfo>
Apr 12 16:18:22 user nova-compute[71874]:   <os>
Apr 12 16:18:22 user nova-compute[71874]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 16:18:22 user nova-compute[71874]:     <boot dev="hd"/>
Apr 12 16:18:22 user nova-compute[71874]:     <smbios mode="sysinfo"/>
Apr 12 16:18:22 user nova-compute[71874]:   </os>
Apr 12 16:18:22 user nova-compute[71874]:   <features>
Apr 12 16:18:22 user nova-compute[71874]:     <acpi/>
Apr 12 16:18:22 user nova-compute[71874]:     <apic/>
Apr 12 16:18:22 user nova-compute[71874]:     <vmcoreinfo/>
Apr 12 16:18:22 user nova-compute[71874]:   </features>
Apr 12 16:18:22 user nova-compute[71874]:   <clock offset="utc">
Apr 12 16:18:22 user nova-compute[71874]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 16:18:22 user nova-compute[71874]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 16:18:22 user nova-compute[71874]:     <timer name="hpet" present="no"/>
Apr 12 16:18:22 user nova-compute[71874]:   </clock>
Apr 12 16:18:22 user nova-compute[71874]:   <cpu mode="custom" match="exact">
Apr 12 16:18:22 user nova-compute[71874]:     <model>Nehalem</model>
Apr 12 16:18:22 user nova-compute[71874]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 16:18:22 user nova-compute[71874]:   </cpu>
Apr 12 16:18:22 user nova-compute[71874]:   <devices>
Apr 12 16:18:22 user nova-compute[71874]:     <disk type="block" device="disk">
Apr 12 16:18:22 user nova-compute[71874]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 16:18:22 user nova-compute[71874]:       <source dev="/dev/sdb"/>
Apr 12 16:18:22 user nova-compute[71874]:       <target dev="vda" bus="virtio"/>
Apr 12 16:18:22 user nova-compute[71874]:       <serial>952c0ad3-7b56-454e-af58-10213195373d</serial>
Apr 12 16:18:22 user nova-compute[71874]:     </disk>
Apr 12 16:18:22 user nova-compute[71874]:     <interface type="ethernet">
Apr 12 16:18:22 user nova-compute[71874]:       <mac address="fa:16:3e:cb:0c:5a"/>
Apr 12 16:18:22 user nova-compute[71874]:       <model type="virtio"/>
Apr 12 16:18:22 user nova-compute[71874]:       <mtu size="1442"/>
Apr 12 16:18:22 user nova-compute[71874]:       <target dev="tapc9b27dd5-a7"/>
Apr 12 16:18:22 user nova-compute[71874]:     </interface>
Apr 12 16:18:22 user nova-compute[71874]:     <serial type="pty">
Apr 12 16:18:22 user nova-compute[71874]:       <log file="/opt/stack/data/nova/instances/77842113-37e8-4dc3-bd28-84417eb1ac31/console.log" append="off"/>
Apr 12 16:18:22 user nova-compute[71874]:     </serial>
Apr 12 16:18:22 user nova-compute[71874]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 16:18:22 user nova-compute[71874]:     <video>
Apr 12 16:18:22 user nova-compute[71874]:       <model type="virtio"/>
Apr 12 16:18:22 user nova-compute[71874]:     </video>
Apr 12 16:18:22 user nova-compute[71874]:     <rng model="virtio">
Apr 12 16:18:22 user nova-compute[71874]:       <backend model="random">/dev/urandom</backend>
Apr 12 16:18:22 user nova-compute[71874]:     </rng>
Apr 12 16:18:22 user nova-compute[71874]:     <controller type="usb" index="0" model="none"/>
Apr 12 16:18:22 user nova-compute[71874]:     <memballoon model="virtio">
Apr 12 16:18:22 user nova-compute[71874]:       <stats period="10"/>
Apr 12 16:18:22 user nova-compute[71874]:     </memballoon>
Apr 12 16:18:22 user nova-compute[71874]:   </devices>
Apr 12 16:18:22 user nova-compute[71874]: </domain>
Apr 12 16:18:22 user nova-compute[71874]:  {{(pid=71874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 16:18:22 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-c699c40c-42ae-4799-9b2c-b32d03f991ea tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T16:18:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1534459262',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1534459262',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1534459262',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='29b1b89a5eeb408a8d0938e5f59f405f',ramdisk_id='',reservation_id='r-gqr2t7mb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-734600841',owner_user_name='tempest-TestVolumeBootPattern-734600841-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T16:18:16Z,user_data=None,user_id='7054687447fc42339e9046ced4915890',uuid=77842113-37e8-4dc3-bd28-84417eb1ac31,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c9b27dd5-a751-4179-af86-77931b5f55e6", "address": "fa:16:3e:cb:0c:5a", "network": {"id": "1439244b-8287-4bba-a88c-99d4b498cccd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1491302639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29b1b89a5eeb408a8d0938e5f59f405f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9b27dd5-a7", "ovs_interfaceid": "c9b27dd5-a751-4179-af86-77931b5f55e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 16:18:22 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-c699c40c-42ae-4799-9b2c-b32d03f991ea tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Converting VIF {"id": "c9b27dd5-a751-4179-af86-77931b5f55e6", "address": "fa:16:3e:cb:0c:5a", "network": {"id": "1439244b-8287-4bba-a88c-99d4b498cccd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1491302639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29b1b89a5eeb408a8d0938e5f59f405f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9b27dd5-a7", "ovs_interfaceid": "c9b27dd5-a751-4179-af86-77931b5f55e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:18:22 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-c699c40c-42ae-4799-9b2c-b32d03f991ea tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:0c:5a,bridge_name='br-int',has_traffic_filtering=True,id=c9b27dd5-a751-4179-af86-77931b5f55e6,network=Network(1439244b-8287-4bba-a88c-99d4b498cccd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9b27dd5-a7') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:18:22 user nova-compute[71874]: DEBUG os_vif [None req-c699c40c-42ae-4799-9b2c-b32d03f991ea tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:0c:5a,bridge_name='br-int',has_traffic_filtering=True,id=c9b27dd5-a751-4179-af86-77931b5f55e6,network=Network(1439244b-8287-4bba-a88c-99d4b498cccd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9b27dd5-a7') {{(pid=71874) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 16:18:22 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:18:22 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:18:22 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 16:18:22 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:18:22 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc9b27dd5-a7, may_exist=True) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:18:22 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc9b27dd5-a7, col_values=(('external_ids', {'iface-id': 'c9b27dd5-a751-4179-af86-77931b5f55e6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cb:0c:5a', 'vm-uuid': '77842113-37e8-4dc3-bd28-84417eb1ac31'}),)) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:18:22 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:18:22 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:18:22 user nova-compute[71874]: INFO os_vif [None req-c699c40c-42ae-4799-9b2c-b32d03f991ea tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:0c:5a,bridge_name='br-int',has_traffic_filtering=True,id=c9b27dd5-a751-4179-af86-77931b5f55e6,network=Network(1439244b-8287-4bba-a88c-99d4b498cccd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9b27dd5-a7')
Apr 12 16:18:22 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-c699c40c-42ae-4799-9b2c-b32d03f991ea tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] No BDM found with device name vda, not building metadata. {{(pid=71874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 16:18:22 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-c699c40c-42ae-4799-9b2c-b32d03f991ea tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] No VIF found with MAC fa:16:3e:cb:0c:5a, not building metadata {{(pid=71874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 16:18:23 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:18:23 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:18:24 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:18:24 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:18:24 user nova-compute[71874]: DEBUG nova.compute.manager [req-995eec94-b7d8-4835-9c16-6e5bd370ac24 req-be354bf9-da43-4969-9ae4-a3dc4e2845eb service nova] [instance: 77842113-37e8-4dc3-bd28-84417eb1ac31] Received event network-vif-plugged-c9b27dd5-a751-4179-af86-77931b5f55e6 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:18:24 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-995eec94-b7d8-4835-9c16-6e5bd370ac24 req-be354bf9-da43-4969-9ae4-a3dc4e2845eb service nova] Acquiring lock "77842113-37e8-4dc3-bd28-84417eb1ac31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:18:24 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-995eec94-b7d8-4835-9c16-6e5bd370ac24 req-be354bf9-da43-4969-9ae4-a3dc4e2845eb service nova] Lock "77842113-37e8-4dc3-bd28-84417eb1ac31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.006s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:18:24 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-995eec94-b7d8-4835-9c16-6e5bd370ac24 req-be354bf9-da43-4969-9ae4-a3dc4e2845eb service nova] Lock "77842113-37e8-4dc3-bd28-84417eb1ac31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:18:24 user nova-compute[71874]: DEBUG nova.compute.manager [req-995eec94-b7d8-4835-9c16-6e5bd370ac24 req-be354bf9-da43-4969-9ae4-a3dc4e2845eb service nova] [instance: 77842113-37e8-4dc3-bd28-84417eb1ac31] No waiting events found dispatching network-vif-plugged-c9b27dd5-a751-4179-af86-77931b5f55e6 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:18:24 user nova-compute[71874]: WARNING nova.compute.manager [req-995eec94-b7d8-4835-9c16-6e5bd370ac24 req-be354bf9-da43-4969-9ae4-a3dc4e2845eb service nova] [instance: 77842113-37e8-4dc3-bd28-84417eb1ac31] Received unexpected event network-vif-plugged-c9b27dd5-a751-4179-af86-77931b5f55e6 for instance with vm_state building and task_state spawning.
Apr 12 16:18:24 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:18:24 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:18:24 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:18:24 user nova-compute[71874]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681316289.6919708, f52ee906-c8fd-4cd5-842e-de98a5099c4f => Stopped> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:18:24 user nova-compute[71874]: INFO nova.compute.manager [-] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] VM Stopped (Lifecycle Event)
Apr 12 16:18:24 user nova-compute[71874]: DEBUG nova.compute.manager [None req-0fe06b3f-c969-4a63-a986-42684a651c00 None None] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:18:25 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:18:25 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:18:25 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:18:25 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:18:25 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Auditing locally available compute resources for user (node: user) {{(pid=71874) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 16:18:26 user nova-compute[71874]: DEBUG nova.virt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Emitting event <LifecycleEvent: 1681316306.1876051, 77842113-37e8-4dc3-bd28-84417eb1ac31 => Resumed> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:18:26 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 77842113-37e8-4dc3-bd28-84417eb1ac31] VM Resumed (Lifecycle Event)
Apr 12 16:18:26 user nova-compute[71874]: DEBUG nova.compute.manager [None req-c699c40c-42ae-4799-9b2c-b32d03f991ea tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 77842113-37e8-4dc3-bd28-84417eb1ac31] Instance event wait completed in 0 seconds for  {{(pid=71874) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 16:18:26 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-c699c40c-42ae-4799-9b2c-b32d03f991ea tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 77842113-37e8-4dc3-bd28-84417eb1ac31] Guest created on hypervisor {{(pid=71874) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 16:18:26 user nova-compute[71874]: INFO nova.virt.libvirt.driver [-] [instance: 77842113-37e8-4dc3-bd28-84417eb1ac31] Instance spawned successfully.
Apr 12 16:18:26 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-c699c40c-42ae-4799-9b2c-b32d03f991ea tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 77842113-37e8-4dc3-bd28-84417eb1ac31] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 16:18:26 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 77842113-37e8-4dc3-bd28-84417eb1ac31] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:18:26 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 77842113-37e8-4dc3-bd28-84417eb1ac31] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 16:18:26 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-c699c40c-42ae-4799-9b2c-b32d03f991ea tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 77842113-37e8-4dc3-bd28-84417eb1ac31] Found default for hw_cdrom_bus of ide {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:18:26 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-c699c40c-42ae-4799-9b2c-b32d03f991ea tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 77842113-37e8-4dc3-bd28-84417eb1ac31] Found default for hw_disk_bus of virtio {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:18:26 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-c699c40c-42ae-4799-9b2c-b32d03f991ea tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 77842113-37e8-4dc3-bd28-84417eb1ac31] Found default for hw_input_bus of None {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:18:26 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-c699c40c-42ae-4799-9b2c-b32d03f991ea tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 77842113-37e8-4dc3-bd28-84417eb1ac31] Found default for hw_pointer_model of None {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:18:26 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-c699c40c-42ae-4799-9b2c-b32d03f991ea tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 77842113-37e8-4dc3-bd28-84417eb1ac31] Found default for hw_video_model of virtio {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:18:26 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-c699c40c-42ae-4799-9b2c-b32d03f991ea tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 77842113-37e8-4dc3-bd28-84417eb1ac31] Found default for hw_vif_model of virtio {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:18:26 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 77842113-37e8-4dc3-bd28-84417eb1ac31] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 16:18:26 user nova-compute[71874]: DEBUG nova.virt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Emitting event <LifecycleEvent: 1681316306.1896813, 77842113-37e8-4dc3-bd28-84417eb1ac31 => Started> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:18:26 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 77842113-37e8-4dc3-bd28-84417eb1ac31] VM Started (Lifecycle Event)
Apr 12 16:18:26 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 77842113-37e8-4dc3-bd28-84417eb1ac31] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:18:26 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 77842113-37e8-4dc3-bd28-84417eb1ac31] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 16:18:26 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 77842113-37e8-4dc3-bd28-84417eb1ac31] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 16:18:26 user nova-compute[71874]: DEBUG nova.compute.manager [req-a1910bb2-8adf-411d-af06-0a7aef08d36b req-089fa473-e058-43fc-8bcc-3e1b0259368c service nova] [instance: 77842113-37e8-4dc3-bd28-84417eb1ac31] Received event network-vif-plugged-c9b27dd5-a751-4179-af86-77931b5f55e6 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:18:26 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-a1910bb2-8adf-411d-af06-0a7aef08d36b req-089fa473-e058-43fc-8bcc-3e1b0259368c service nova] Acquiring lock "77842113-37e8-4dc3-bd28-84417eb1ac31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:18:26 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-a1910bb2-8adf-411d-af06-0a7aef08d36b req-089fa473-e058-43fc-8bcc-3e1b0259368c service nova] Lock "77842113-37e8-4dc3-bd28-84417eb1ac31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:18:26 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-a1910bb2-8adf-411d-af06-0a7aef08d36b req-089fa473-e058-43fc-8bcc-3e1b0259368c service nova] Lock "77842113-37e8-4dc3-bd28-84417eb1ac31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:18:26 user nova-compute[71874]: DEBUG nova.compute.manager [req-a1910bb2-8adf-411d-af06-0a7aef08d36b req-089fa473-e058-43fc-8bcc-3e1b0259368c service nova] [instance: 77842113-37e8-4dc3-bd28-84417eb1ac31] No waiting events found dispatching network-vif-plugged-c9b27dd5-a751-4179-af86-77931b5f55e6 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:18:26 user nova-compute[71874]: WARNING nova.compute.manager [req-a1910bb2-8adf-411d-af06-0a7aef08d36b req-089fa473-e058-43fc-8bcc-3e1b0259368c service nova] [instance: 77842113-37e8-4dc3-bd28-84417eb1ac31] Received unexpected event network-vif-plugged-c9b27dd5-a751-4179-af86-77931b5f55e6 for instance with vm_state building and task_state spawning.
Apr 12 16:18:26 user nova-compute[71874]: INFO nova.compute.manager [None req-c699c40c-42ae-4799-9b2c-b32d03f991ea tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 77842113-37e8-4dc3-bd28-84417eb1ac31] Took 5.19 seconds to spawn the instance on the hypervisor.
Apr 12 16:18:26 user nova-compute[71874]: DEBUG nova.compute.manager [None req-c699c40c-42ae-4799-9b2c-b32d03f991ea tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 77842113-37e8-4dc3-bd28-84417eb1ac31] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:18:26 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 16:18:26 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b613235-a905-466f-b9cc-a21a321a6313/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:18:26 user nova-compute[71874]: INFO nova.compute.manager [None req-c699c40c-42ae-4799-9b2c-b32d03f991ea tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 77842113-37e8-4dc3-bd28-84417eb1ac31] Took 10.97 seconds to build instance.
Apr 12 16:18:26 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-c699c40c-42ae-4799-9b2c-b32d03f991ea tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "77842113-37e8-4dc3-bd28-84417eb1ac31" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.065s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:18:26 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b613235-a905-466f-b9cc-a21a321a6313/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:18:26 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b613235-a905-466f-b9cc-a21a321a6313/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:18:26 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b613235-a905-466f-b9cc-a21a321a6313/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:18:26 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4c37cbf-1743-4dd5-97fd-2bb12ebee763/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:18:26 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4c37cbf-1743-4dd5-97fd-2bb12ebee763/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:18:26 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4c37cbf-1743-4dd5-97fd-2bb12ebee763/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:18:27 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4c37cbf-1743-4dd5-97fd-2bb12ebee763/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:18:27 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4190e244-84b1-47b6-813d-9cadb7c65975/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:18:27 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4190e244-84b1-47b6-813d-9cadb7c65975/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:18:27 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4190e244-84b1-47b6-813d-9cadb7c65975/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:18:27 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4190e244-84b1-47b6-813d-9cadb7c65975/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:18:27 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/608fbea2-b42b-4bb9-94a7-2b76dcdc2001/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:18:27 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:18:27 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/608fbea2-b42b-4bb9-94a7-2b76dcdc2001/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:18:27 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/608fbea2-b42b-4bb9-94a7-2b76dcdc2001/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:18:27 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/608fbea2-b42b-4bb9-94a7-2b76dcdc2001/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:18:27 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 16:18:27 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/540a8fd5-8c18-4efe-97d4-9f0942cebcf5/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:18:27 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/540a8fd5-8c18-4efe-97d4-9f0942cebcf5/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:18:27 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/540a8fd5-8c18-4efe-97d4-9f0942cebcf5/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:18:28 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/540a8fd5-8c18-4efe-97d4-9f0942cebcf5/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:18:28 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32471bee-e77e-4a1b-8e00-d938a1373976/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:18:28 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32471bee-e77e-4a1b-8e00-d938a1373976/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:18:28 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32471bee-e77e-4a1b-8e00-d938a1373976/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:18:28 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:18:28 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32471bee-e77e-4a1b-8e00-d938a1373976/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:18:29 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:18:29 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:18:29 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Hypervisor/Node resource view: name=user free_ram=7828MB free_disk=25.82373809814453GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71874) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 16:18:29 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:18:29 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:18:29 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Applying migration context for instance bef10c89-360e-42d6-aa26-7edf1afca567 as it has an incoming, in-progress migration 6b3c0b85-4c61-422d-b540-ee366451d208. Migration status is finished {{(pid=71874) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:950}}
Apr 12 16:18:29 user nova-compute[71874]: INFO nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] Updating resource usage from migration 6b3c0b85-4c61-422d-b540-ee366451d208
Apr 12 16:18:29 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 608fbea2-b42b-4bb9-94a7-2b76dcdc2001 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:18:29 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 4190e244-84b1-47b6-813d-9cadb7c65975 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:18:29 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 1b613235-a905-466f-b9cc-a21a321a6313 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:18:29 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 32471bee-e77e-4a1b-8e00-d938a1373976 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:18:29 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance b4c37cbf-1743-4dd5-97fd-2bb12ebee763 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:18:29 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 540a8fd5-8c18-4efe-97d4-9f0942cebcf5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:18:29 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Migration 6b3c0b85-4c61-422d-b540-ee366451d208 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1637}}
Apr 12 16:18:29 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance bef10c89-360e-42d6-aa26-7edf1afca567 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:18:29 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 77842113-37e8-4dc3-bd28-84417eb1ac31 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:18:29 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=71874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 16:18:29 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Final resource view: name=user phys_ram=16023MB used_ram=1728MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=71874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 16:18:29 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Inventory has not changed in ProviderTree for provider: 0e94b4c8-cd49-45e4-9133-d36eb4b2456b {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 16:18:29 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Inventory has not changed for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 16:18:29 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Compute_service record updated for user:user {{(pid=71874) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 16:18:29 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.535s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:18:32 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:18:32 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:18:32 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Starting heal instance info cache {{(pid=71874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 16:18:32 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:18:32 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquiring lock "refresh_cache-1b613235-a905-466f-b9cc-a21a321a6313" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:18:32 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquired lock "refresh_cache-1b613235-a905-466f-b9cc-a21a321a6313" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:18:32 user nova-compute[71874]: DEBUG nova.network.neutron [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] [instance: 1b613235-a905-466f-b9cc-a21a321a6313] Forcefully refreshing network info cache for instance {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 16:18:33 user nova-compute[71874]: DEBUG nova.network.neutron [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] [instance: 1b613235-a905-466f-b9cc-a21a321a6313] Updating instance_info_cache with network_info: [{"id": "8a0b8df5-77c2-4888-b715-9f4bafba36b9", "address": "fa:16:3e:a4:ea:da", "network": {"id": "89a33fcd-81e9-4815-8644-d9b33ceb236b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-241667694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "280a9a56afca4ce591faca7a94eca4b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a0b8df5-77", "ovs_interfaceid": "8a0b8df5-77c2-4888-b715-9f4bafba36b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:18:33 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Releasing lock "refresh_cache-1b613235-a905-466f-b9cc-a21a321a6313" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:18:33 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] [instance: 1b613235-a905-466f-b9cc-a21a321a6313] Updated the network info_cache for instance {{(pid=71874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 16:18:33 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:18:33 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:18:33 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:18:33 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:18:33 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71874) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 16:18:33 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:18:35 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:18:35 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:18:37 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:18:38 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:18:42 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:18:43 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:18:46 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-679ecd3e-5491-4468-8eb9-5f1c6ed8bdad tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Acquiring lock "540a8fd5-8c18-4efe-97d4-9f0942cebcf5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:18:46 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-679ecd3e-5491-4468-8eb9-5f1c6ed8bdad tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "540a8fd5-8c18-4efe-97d4-9f0942cebcf5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:18:46 user nova-compute[71874]: DEBUG nova.objects.instance [None req-679ecd3e-5491-4468-8eb9-5f1c6ed8bdad tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lazy-loading 'flavor' on Instance uuid 540a8fd5-8c18-4efe-97d4-9f0942cebcf5 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:18:46 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-679ecd3e-5491-4468-8eb9-5f1c6ed8bdad tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "540a8fd5-8c18-4efe-97d4-9f0942cebcf5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:18:47 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-679ecd3e-5491-4468-8eb9-5f1c6ed8bdad tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Acquiring lock "540a8fd5-8c18-4efe-97d4-9f0942cebcf5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:18:47 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-679ecd3e-5491-4468-8eb9-5f1c6ed8bdad tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "540a8fd5-8c18-4efe-97d4-9f0942cebcf5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:18:47 user nova-compute[71874]: INFO nova.compute.manager [None req-679ecd3e-5491-4468-8eb9-5f1c6ed8bdad tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] [instance: 540a8fd5-8c18-4efe-97d4-9f0942cebcf5] Attaching volume e10b2d66-b8c0-4332-b262-72786fea9f15 to /dev/vdb
Apr 12 16:18:47 user nova-compute[71874]: DEBUG os_brick.utils [None req-679ecd3e-5491-4468-8eb9-5f1c6ed8bdad tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:18:47 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:18:47 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:18:47 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[34208a03-3f8b-4431-b693-8e787971cd22]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:61a48d4489d2\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:18:47 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:18:47 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:18:47 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[b47b8d1f-6ae8-4f3b-b29b-2bc5be12aa6a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:18:47 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:18:47 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:18:47 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bf8e681-732c-4b9e-9a08-db4584c680e3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:18:47 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[04a9d392-1850-4f2c-9b02-9a35747a0808]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:18:47 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-679ecd3e-5491-4468-8eb9-5f1c6ed8bdad tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Running cmd (subprocess): nvme version {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:18:47 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-679ecd3e-5491-4468-8eb9-5f1c6ed8bdad tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] 'nvme version' failed. Not Retrying. {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 16:18:47 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.nvmeof [None req-679ecd3e-5491-4468-8eb9-5f1c6ed8bdad tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] nvme not present on system {{(pid=71874) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 16:18:47 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:18:47 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 16:18:47 user nova-compute[71874]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 16:18:47 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[2626caac-ea50-4dcb-b6ca-947fb7eec3ac]: (4, '') {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:18:47 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.lightos [None req-679ecd3e-5491-4468-8eb9-5f1c6ed8bdad tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71874) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 16:18:47 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.lightos [None req-679ecd3e-5491-4468-8eb9-5f1c6ed8bdad tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71874) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 16:18:47 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.lightos [None req-679ecd3e-5491-4468-8eb9-5f1c6ed8bdad tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] LIGHTOS: no hostnqn found. {{(pid=71874) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 16:18:47 user nova-compute[71874]: DEBUG os_brick.utils [None req-679ecd3e-5491-4468-8eb9-5f1c6ed8bdad tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:61a48d4489d2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:18:47 user nova-compute[71874]: DEBUG nova.virt.block_device [None req-679ecd3e-5491-4468-8eb9-5f1c6ed8bdad tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] [instance: 540a8fd5-8c18-4efe-97d4-9f0942cebcf5] Updating existing volume attachment record: d51d612e-9574-46c1-9632-720da94f174b {{(pid=71874) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 16:18:47 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:18:48 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:18:51 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-679ecd3e-5491-4468-8eb9-5f1c6ed8bdad tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] [instance: 540a8fd5-8c18-4efe-97d4-9f0942cebcf5] Calling os-brick to attach iSCSI Volume {{(pid=71874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 16:18:51 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-679ecd3e-5491-4468-8eb9-5f1c6ed8bdad tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3c0216320>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e10b2d66-b8c0-4332-b262-72786fea9f15', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nRgMGIeb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:18:51 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-679ecd3e-5491-4468-8eb9-5f1c6ed8bdad tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:18:51 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-679ecd3e-5491-4468-8eb9-5f1c6ed8bdad tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:18:51 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-679ecd3e-5491-4468-8eb9-5f1c6ed8bdad tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:18:51 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-679ecd3e-5491-4468-8eb9-5f1c6ed8bdad tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:18:51 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-679ecd3e-5491-4468-8eb9-5f1c6ed8bdad tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e10b2d66-b8c0-4332-b262-72786fea9f15" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:18:51 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-679ecd3e-5491-4468-8eb9-5f1c6ed8bdad tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e10b2d66-b8c0-4332-b262-72786fea9f15" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:18:51 user nova-compute[71874]: INFO os_brick.initiator.connectors.iscsi [None req-679ecd3e-5491-4468-8eb9-5f1c6ed8bdad tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 16:18:51 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e10b2d66-b8c0-4332-b262-72786fea9f15 -p 172.16.0.220:3260 {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:18:51 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e10b2d66-b8c0-4332-b262-72786fea9f15 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:18:51 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b04ead3-c43a-4d93-a15b-c6b549ceb9bf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:18:51 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-679ecd3e-5491-4468-8eb9-5f1c6ed8bdad tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 16:18:51 user nova-compute[71874]:  {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:18:51 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e10b2d66-b8c0-4332-b262-72786fea9f15 -p 172.16.0.220:3260 --interface default --op new {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:18:51 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e10b2d66-b8c0-4332-b262-72786fea9f15 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:18:51 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e569946-db24-4868-97e3-f91c05badc03]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e10b2d66-b8c0-4332-b262-72786fea9f15] added\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:18:51 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-679ecd3e-5491-4468-8eb9-5f1c6ed8bdad tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e10b2d66-b8c0-4332-b262-72786fea9f15] added
Apr 12 16:18:51 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:18:51 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e10b2d66-b8c0-4332-b262-72786fea9f15 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:18:51 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e10b2d66-b8c0-4332-b262-72786fea9f15 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:18:51 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c649aa4-0e2c-46d7-9553-f8fde6e6ee66]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:18:51 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-679ecd3e-5491-4468-8eb9-5f1c6ed8bdad tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:18:51 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e10b2d66-b8c0-4332-b262-72786fea9f15 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:18:51 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e10b2d66-b8c0-4332-b262-72786fea9f15 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:18:51 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[5500dffb-9209-433b-9526-5366cd144510]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:18:51 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-679ecd3e-5491-4468-8eb9-5f1c6ed8bdad tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:18:51 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e10b2d66-b8c0-4332-b262-72786fea9f15 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nRgMGIeb {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:18:51 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e10b2d66-b8c0-4332-b262-72786fea9f15 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nRgMGIeb" returned: 0 in 0.018s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:18:51 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3643b73-42ba-4ae8-909c-dd6f2b5c4e47]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:18:51 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-679ecd3e-5491-4468-8eb9-5f1c6ed8bdad tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nRgMGIeb'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:18:51 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e10b2d66-b8c0-4332-b262-72786fea9f15 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:18:51 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e10b2d66-b8c0-4332-b262-72786fea9f15 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:18:51 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9d7ef1a-0172-4b5f-bf88-930d5278883a]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:18:51 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-679ecd3e-5491-4468-8eb9-5f1c6ed8bdad tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:18:51 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:18:51 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:18:51 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b4bd857-7fc9-41ec-a6e1-a3525ccd78d6]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:952c0ad3-7b56-454e-af58-10213195373d (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:18:51 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-679ecd3e-5491-4468-8eb9-5f1c6ed8bdad tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775 (non-flash)
Apr 12 16:18:51 user nova-compute[71874]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:952c0ad3-7b56-454e-af58-10213195373d (non-flash)
Apr 12 16:18:51 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:18:51 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-679ecd3e-5491-4468-8eb9-5f1c6ed8bdad tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775 (non-flash)
Apr 12 16:18:51 user nova-compute[71874]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:952c0ad3-7b56-454e-af58-10213195373d (non-flash)
Apr 12 16:18:51 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:18:51 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e10b2d66-b8c0-4332-b262-72786fea9f15 -p 172.16.0.220:3260 --login {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:18:51 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e10b2d66-b8c0-4332-b262-72786fea9f15 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:18:51 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd0dbb46-dd41-4b74-8c4f-daa8e4f2396f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e10b2d66-b8c0-4332-b262-72786fea9f15, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e10b2d66-b8c0-4332-b262-72786fea9f15, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:18:51 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-679ecd3e-5491-4468-8eb9-5f1c6ed8bdad tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e10b2d66-b8c0-4332-b262-72786fea9f15, portal: 172.16.0.220,3260]
Apr 12 16:18:51 user nova-compute[71874]: Login to [iface: default, target: iqn.2010-10.org.openstack:e10b2d66-b8c0-4332-b262-72786fea9f15, portal: 172.16.0.220,3260] successful.
Apr 12 16:18:51 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:18:51 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e10b2d66-b8c0-4332-b262-72786fea9f15 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:18:51 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e10b2d66-b8c0-4332-b262-72786fea9f15 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:18:51 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[62816098-468b-4602-97ad-89313f73c86c]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:18:51 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-679ecd3e-5491-4468-8eb9-5f1c6ed8bdad tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:18:51 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:18:51 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:18:51 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[4608ce0c-ef43-4c41-bdd2-d6adaa6aa0a6]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:952c0ad3-7b56-454e-af58-10213195373d (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e10b2d66-b8c0-4332-b262-72786fea9f15 (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:18:51 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-679ecd3e-5491-4468-8eb9-5f1c6ed8bdad tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775 (non-flash)
Apr 12 16:18:51 user nova-compute[71874]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:952c0ad3-7b56-454e-af58-10213195373d (non-flash)
Apr 12 16:18:51 user nova-compute[71874]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e10b2d66-b8c0-4332-b262-72786fea9f15 (non-flash)
Apr 12 16:18:51 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:18:51 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-679ecd3e-5491-4468-8eb9-5f1c6ed8bdad tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775 (non-flash)
Apr 12 16:18:51 user nova-compute[71874]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:952c0ad3-7b56-454e-af58-10213195373d (non-flash)
Apr 12 16:18:51 user nova-compute[71874]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e10b2d66-b8c0-4332-b262-72786fea9f15 (non-flash)
Apr 12 16:18:51 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:18:51 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-679ecd3e-5491-4468-8eb9-5f1c6ed8bdad tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e10b2d66-b8c0-4332-b262-72786fea9f15" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.267s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:18:51 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-679ecd3e-5491-4468-8eb9-5f1c6ed8bdad tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Connected to 172.16.0.220:3260 {{(pid=71874) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 16:18:51 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-679ecd3e-5491-4468-8eb9-5f1c6ed8bdad tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] HCTL ('34', '-', '-', 0) found on session 44 with lun 0 {{(pid=71874) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 16:18:51 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-679ecd3e-5491-4468-8eb9-5f1c6ed8bdad tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71874) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 16:18:51 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:18:51 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:18:51 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e86a615-04c8-4411-b4f7-88ea95b566ff]: (4, ('- - 0', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:18:51 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-679ecd3e-5491-4468-8eb9-5f1c6ed8bdad tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Searching for a device in session 44 and hctl ['34', '*', '*', 0] yield: None {{(pid=71874) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 16:18:52 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:18:52 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-679ecd3e-5491-4468-8eb9-5f1c6ed8bdad tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Searching for a device in session 44 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71874) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 16:18:52 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-679ecd3e-5491-4468-8eb9-5f1c6ed8bdad tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:e10b2d66-b8c0-4332-b262-72786fea9f15', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nRgMGIeb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71874) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 16:18:52 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-679ecd3e-5491-4468-8eb9-5f1c6ed8bdad tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.296s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:18:52 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-679ecd3e-5491-4468-8eb9-5f1c6ed8bdad tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] <== connect_volume: return (1297ms) {'type': 'block', 'scsi_wwn': '23537356234313264', 'path': '/dev/sdc'} {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:18:52 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-679ecd3e-5491-4468-8eb9-5f1c6ed8bdad tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] [instance: 540a8fd5-8c18-4efe-97d4-9f0942cebcf5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23537356234313264', 'path': '/dev/sdc'} {{(pid=71874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 16:18:52 user nova-compute[71874]: DEBUG nova.objects.instance [None req-679ecd3e-5491-4468-8eb9-5f1c6ed8bdad tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lazy-loading 'flavor' on Instance uuid 540a8fd5-8c18-4efe-97d4-9f0942cebcf5 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:18:52 user nova-compute[71874]: DEBUG nova.virt.libvirt.guest [None req-679ecd3e-5491-4468-8eb9-5f1c6ed8bdad tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 16:18:52 user nova-compute[71874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 16:18:52 user nova-compute[71874]:   <source dev="/dev/sdc"/>
Apr 12 16:18:52 user nova-compute[71874]:   <target dev="vdb" bus="virtio"/>
Apr 12 16:18:52 user nova-compute[71874]:   <serial>e10b2d66-b8c0-4332-b262-72786fea9f15</serial>
Apr 12 16:18:52 user nova-compute[71874]: </disk>
Apr 12 16:18:52 user nova-compute[71874]:  {{(pid=71874) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 16:18:53 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-679ecd3e-5491-4468-8eb9-5f1c6ed8bdad tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] No BDM found with device name vda, not building metadata. {{(pid=71874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 16:18:53 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-679ecd3e-5491-4468-8eb9-5f1c6ed8bdad tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 16:18:53 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-679ecd3e-5491-4468-8eb9-5f1c6ed8bdad tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] No VIF found with MAC fa:16:3e:23:bb:b8, not building metadata {{(pid=71874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 16:18:53 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:18:53 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-679ecd3e-5491-4468-8eb9-5f1c6ed8bdad tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "540a8fd5-8c18-4efe-97d4-9f0942cebcf5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.355s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:18:54 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-7250612f-a469-442d-851e-9f53fc70a34e tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Acquiring lock "540a8fd5-8c18-4efe-97d4-9f0942cebcf5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:18:54 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-7250612f-a469-442d-851e-9f53fc70a34e tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "540a8fd5-8c18-4efe-97d4-9f0942cebcf5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:18:54 user nova-compute[71874]: INFO nova.compute.manager [None req-7250612f-a469-442d-851e-9f53fc70a34e tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] [instance: 540a8fd5-8c18-4efe-97d4-9f0942cebcf5] Detaching volume e10b2d66-b8c0-4332-b262-72786fea9f15
Apr 12 16:18:54 user nova-compute[71874]: INFO nova.virt.block_device [None req-7250612f-a469-442d-851e-9f53fc70a34e tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] [instance: 540a8fd5-8c18-4efe-97d4-9f0942cebcf5] Attempting to driver detach volume e10b2d66-b8c0-4332-b262-72786fea9f15 from mountpoint /dev/vdb
Apr 12 16:18:54 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-7250612f-a469-442d-851e-9f53fc70a34e tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Attempting to detach device vdb from instance 540a8fd5-8c18-4efe-97d4-9f0942cebcf5 from the persistent domain config. {{(pid=71874) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 16:18:54 user nova-compute[71874]: DEBUG nova.virt.libvirt.guest [None req-7250612f-a469-442d-851e-9f53fc70a34e tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 16:18:54 user nova-compute[71874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 16:18:54 user nova-compute[71874]:   <source dev="/dev/sdc"/>
Apr 12 16:18:54 user nova-compute[71874]:   <target dev="vdb" bus="virtio"/>
Apr 12 16:18:54 user nova-compute[71874]:   <serial>e10b2d66-b8c0-4332-b262-72786fea9f15</serial>
Apr 12 16:18:54 user nova-compute[71874]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 16:18:54 user nova-compute[71874]: </disk>
Apr 12 16:18:54 user nova-compute[71874]:  {{(pid=71874) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 16:18:54 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-7250612f-a469-442d-851e-9f53fc70a34e tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Successfully detached device vdb from instance 540a8fd5-8c18-4efe-97d4-9f0942cebcf5 from the persistent domain config.
Apr 12 16:18:54 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-7250612f-a469-442d-851e-9f53fc70a34e tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 540a8fd5-8c18-4efe-97d4-9f0942cebcf5 from the live domain config. {{(pid=71874) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 16:18:54 user nova-compute[71874]: DEBUG nova.virt.libvirt.guest [None req-7250612f-a469-442d-851e-9f53fc70a34e tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 16:18:54 user nova-compute[71874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 16:18:54 user nova-compute[71874]:   <source dev="/dev/sdc"/>
Apr 12 16:18:54 user nova-compute[71874]:   <target dev="vdb" bus="virtio"/>
Apr 12 16:18:54 user nova-compute[71874]:   <serial>e10b2d66-b8c0-4332-b262-72786fea9f15</serial>
Apr 12 16:18:54 user nova-compute[71874]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 16:18:54 user nova-compute[71874]: </disk>
Apr 12 16:18:54 user nova-compute[71874]:  {{(pid=71874) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 16:18:54 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Received event <DeviceRemovedEvent: 1681316334.6131883, 540a8fd5-8c18-4efe-97d4-9f0942cebcf5 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71874) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 16:18:54 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-7250612f-a469-442d-851e-9f53fc70a34e tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 540a8fd5-8c18-4efe-97d4-9f0942cebcf5 {{(pid=71874) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 16:18:54 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-7250612f-a469-442d-851e-9f53fc70a34e tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Successfully detached device vdb from instance 540a8fd5-8c18-4efe-97d4-9f0942cebcf5 from the live domain config.
Apr 12 16:18:54 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7250612f-a469-442d-851e-9f53fc70a34e tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] [instance: 540a8fd5-8c18-4efe-97d4-9f0942cebcf5] calling os-brick to detach iSCSI Volume {{(pid=71874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 16:18:54 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-7250612f-a469-442d-851e-9f53fc70a34e tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3c0216320>, {'target_iqn': 'iqn.2010-10.org.openstack:e10b2d66-b8c0-4332-b262-72786fea9f15', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nRgMGIeb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:18:54 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-7250612f-a469-442d-851e-9f53fc70a34e tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:18:54 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-7250612f-a469-442d-851e-9f53fc70a34e tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:18:54 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-7250612f-a469-442d-851e-9f53fc70a34e tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:18:54 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:18:54 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:18:54 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a084c13-843a-455f-a842-22f69361f58b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:952c0ad3-7b56-454e-af58-10213195373d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e10b2d66-b8c0-4332-b262-72786fea9f15\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:18:54 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-7250612f-a469-442d-851e-9f53fc70a34e tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 16:18:54 user nova-compute[71874]: No targets found.
Apr 12 16:18:54 user nova-compute[71874]: iSNS:
Apr 12 16:18:54 user nova-compute[71874]: No targets found.
Apr 12 16:18:54 user nova-compute[71874]: STATIC:
Apr 12 16:18:54 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:952c0ad3-7b56-454e-af58-10213195373d
Apr 12 16:18:54 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:18:54 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:18:54 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:e10b2d66-b8c0-4332-b262-72786fea9f15
Apr 12 16:18:54 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:18:54 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:18:54 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775
Apr 12 16:18:54 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:18:54 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:18:54 user nova-compute[71874]: FIRMWARE:
Apr 12 16:18:54 user nova-compute[71874]: No targets found.
Apr 12 16:18:54 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:18:54 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-7250612f-a469-442d-851e-9f53fc70a34e tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 16:18:54 user nova-compute[71874]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 16:18:54 user nova-compute[71874]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71874) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 16:18:54 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-7250612f-a469-442d-851e-9f53fc70a34e tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e10b2d66-b8c0-4332-b262-72786fea9f15', 0)] {{(pid=71874) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 16:18:54 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:18:54 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:18:54 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[04e53e3c-321c-48a6-916d-cf19c5c86208]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:952c0ad3-7b56-454e-af58-10213195373d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e10b2d66-b8c0-4332-b262-72786fea9f15\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:18:54 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:18:54 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:18:54 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[70368256-c66a-4b41-8f96-eb2dcfab89df]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:952c0ad3-7b56-454e-af58-10213195373d (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e10b2d66-b8c0-4332-b262-72786fea9f15 (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:18:54 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-7250612f-a469-442d-851e-9f53fc70a34e tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775 (non-flash)
Apr 12 16:18:54 user nova-compute[71874]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:952c0ad3-7b56-454e-af58-10213195373d (non-flash)
Apr 12 16:18:54 user nova-compute[71874]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e10b2d66-b8c0-4332-b262-72786fea9f15 (non-flash)
Apr 12 16:18:54 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:18:54 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-7250612f-a469-442d-851e-9f53fc70a34e tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775 (non-flash)
Apr 12 16:18:54 user nova-compute[71874]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:952c0ad3-7b56-454e-af58-10213195373d (non-flash)
Apr 12 16:18:54 user nova-compute[71874]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e10b2d66-b8c0-4332-b262-72786fea9f15 (non-flash)
Apr 12 16:18:54 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:18:54 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-7250612f-a469-442d-851e-9f53fc70a34e tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc3c0221c60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e10b2d66-b8c0-4332-b262-72786fea9f15'): ({'sdc'}, set())}) {{(pid=71874) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 16:18:54 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-7250612f-a469-442d-851e-9f53fc70a34e tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Removing single pathed devices sdc {{(pid=71874) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 16:18:54 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:18:54 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:18:54 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[89799729-b97e-4c2f-8d9c-ab3a688daa8c]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:18:54 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:18:54 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:18:54 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9dbef19-f45d-4d37-8c1e-8f588ad38624]: (4, ('ok\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:18:54 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-7250612f-a469-442d-851e-9f53fc70a34e tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Flushing IO for device /dev/sdc {{(pid=71874) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 16:18:54 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:18:54 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.019s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:18:54 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[24864abb-3923-41a1-993d-8abcf25c88a9]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:18:54 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-7250612f-a469-442d-851e-9f53fc70a34e tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71874) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 16:18:54 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:18:54 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:18:54 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc2f3803-f2f7-4a9f-9fc2-75f559b3ac47]: (4, ('1', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:18:54 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-7250612f-a469-442d-851e-9f53fc70a34e tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71874) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 16:18:54 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-7250612f-a469-442d-851e-9f53fc70a34e tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] SCSI volumes sdc have been removed. {{(pid=71874) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 16:18:54 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-7250612f-a469-442d-851e-9f53fc70a34e tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e10b2d66-b8c0-4332-b262-72786fea9f15')] {{(pid=71874) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 16:18:54 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e10b2d66-b8c0-4332-b262-72786fea9f15 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:18:54 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e10b2d66-b8c0-4332-b262-72786fea9f15 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:18:54 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3fe54cb-a1f3-490e-8923-4064b902f03a]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:18:54 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-7250612f-a469-442d-851e-9f53fc70a34e tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:18:54 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e10b2d66-b8c0-4332-b262-72786fea9f15 -p 172.16.0.220:3260 --logout {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:18:54 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e10b2d66-b8c0-4332-b262-72786fea9f15 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:18:54 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[88015894-8125-468f-8a47-dd8f4148268c]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:e10b2d66-b8c0-4332-b262-72786fea9f15, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:e10b2d66-b8c0-4332-b262-72786fea9f15, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:18:54 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-7250612f-a469-442d-851e-9f53fc70a34e tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:e10b2d66-b8c0-4332-b262-72786fea9f15, portal: 172.16.0.220,3260]
Apr 12 16:18:54 user nova-compute[71874]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:e10b2d66-b8c0-4332-b262-72786fea9f15, portal: 172.16.0.220,3260] successful.
Apr 12 16:18:54 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:18:54 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e10b2d66-b8c0-4332-b262-72786fea9f15 -p 172.16.0.220:3260 --op delete {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:18:54 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e10b2d66-b8c0-4332-b262-72786fea9f15 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:18:54 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7a79635-bf5b-4f4c-95fe-ef17b5b8c0ed]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:18:54 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-7250612f-a469-442d-851e-9f53fc70a34e tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:18:54 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-7250612f-a469-442d-851e-9f53fc70a34e tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:18:54 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-7250612f-a469-442d-851e-9f53fc70a34e tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] <== disconnect_volume: return (318ms) None {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:18:54 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7250612f-a469-442d-851e-9f53fc70a34e tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] [instance: 540a8fd5-8c18-4efe-97d4-9f0942cebcf5] Disconnected iSCSI Volume {{(pid=71874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 16:18:55 user nova-compute[71874]: DEBUG nova.objects.instance [None req-7250612f-a469-442d-851e-9f53fc70a34e tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lazy-loading 'flavor' on Instance uuid 540a8fd5-8c18-4efe-97d4-9f0942cebcf5 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:18:55 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-7250612f-a469-442d-851e-9f53fc70a34e tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "540a8fd5-8c18-4efe-97d4-9f0942cebcf5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.817s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:18:57 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:18:58 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:18:59 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-225ef27c-d938-4e86-b656-374268696f47 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Acquiring lock "608fbea2-b42b-4bb9-94a7-2b76dcdc2001" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:18:59 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-225ef27c-d938-4e86-b656-374268696f47 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "608fbea2-b42b-4bb9-94a7-2b76dcdc2001" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:18:59 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-225ef27c-d938-4e86-b656-374268696f47 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Acquiring lock "608fbea2-b42b-4bb9-94a7-2b76dcdc2001-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:18:59 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-225ef27c-d938-4e86-b656-374268696f47 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "608fbea2-b42b-4bb9-94a7-2b76dcdc2001-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:18:59 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-225ef27c-d938-4e86-b656-374268696f47 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "608fbea2-b42b-4bb9-94a7-2b76dcdc2001-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:18:59 user nova-compute[71874]: INFO nova.compute.manager [None req-225ef27c-d938-4e86-b656-374268696f47 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 608fbea2-b42b-4bb9-94a7-2b76dcdc2001] Terminating instance
Apr 12 16:18:59 user nova-compute[71874]: DEBUG nova.compute.manager [None req-225ef27c-d938-4e86-b656-374268696f47 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 608fbea2-b42b-4bb9-94a7-2b76dcdc2001] Start destroying the instance on the hypervisor. {{(pid=71874) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 16:18:59 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:18:59 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:18:59 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:18:59 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:18:59 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:18:59 user nova-compute[71874]: DEBUG nova.compute.manager [req-eb6db9dc-4769-4496-980e-1ea8abf80368 req-40d39c9b-a115-435b-b4a0-f584c9bd18c4 service nova] [instance: 608fbea2-b42b-4bb9-94a7-2b76dcdc2001] Received event network-vif-unplugged-246d47a5-6953-4e38-8546-63953a8721cf {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:18:59 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-eb6db9dc-4769-4496-980e-1ea8abf80368 req-40d39c9b-a115-435b-b4a0-f584c9bd18c4 service nova] Acquiring lock "608fbea2-b42b-4bb9-94a7-2b76dcdc2001-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:18:59 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-eb6db9dc-4769-4496-980e-1ea8abf80368 req-40d39c9b-a115-435b-b4a0-f584c9bd18c4 service nova] Lock "608fbea2-b42b-4bb9-94a7-2b76dcdc2001-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:18:59 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-eb6db9dc-4769-4496-980e-1ea8abf80368 req-40d39c9b-a115-435b-b4a0-f584c9bd18c4 service nova] Lock "608fbea2-b42b-4bb9-94a7-2b76dcdc2001-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:18:59 user nova-compute[71874]: DEBUG nova.compute.manager [req-eb6db9dc-4769-4496-980e-1ea8abf80368 req-40d39c9b-a115-435b-b4a0-f584c9bd18c4 service nova] [instance: 608fbea2-b42b-4bb9-94a7-2b76dcdc2001] No waiting events found dispatching network-vif-unplugged-246d47a5-6953-4e38-8546-63953a8721cf {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:18:59 user nova-compute[71874]: DEBUG nova.compute.manager [req-eb6db9dc-4769-4496-980e-1ea8abf80368 req-40d39c9b-a115-435b-b4a0-f584c9bd18c4 service nova] [instance: 608fbea2-b42b-4bb9-94a7-2b76dcdc2001] Received event network-vif-unplugged-246d47a5-6953-4e38-8546-63953a8721cf for instance with task_state deleting. {{(pid=71874) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 16:19:00 user nova-compute[71874]: INFO nova.virt.libvirt.driver [-] [instance: 608fbea2-b42b-4bb9-94a7-2b76dcdc2001] Instance destroyed successfully.
Apr 12 16:19:00 user nova-compute[71874]: DEBUG nova.objects.instance [None req-225ef27c-d938-4e86-b656-374268696f47 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lazy-loading 'resources' on Instance uuid 608fbea2-b42b-4bb9-94a7-2b76dcdc2001 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:19:00 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-225ef27c-d938-4e86-b656-374268696f47 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T15:59:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1280952745',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1280952745',id=3,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T15:59:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9210f81232304e179d3e09914a492442',ramdisk_id='',reservation_id='r-1qz32z1g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1443944578',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T16:01:20Z,user_data=None,user_id='73f9fa5bc22a4824b3cdcb8cf7bb380c',uuid=608fbea2-b42b-4bb9-94a7-2b76dcdc2001,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "246d47a5-6953-4e38-8546-63953a8721cf", "address": "fa:16:3e:64:93:eb", "network": {"id": "b36306e0-04c5-4b1b-8022-05ff121c4e43", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1503204786-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9210f81232304e179d3e09914a492442", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap246d47a5-69", "ovs_interfaceid": "246d47a5-6953-4e38-8546-63953a8721cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 16:19:00 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-225ef27c-d938-4e86-b656-374268696f47 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Converting VIF {"id": "246d47a5-6953-4e38-8546-63953a8721cf", "address": "fa:16:3e:64:93:eb", "network": {"id": "b36306e0-04c5-4b1b-8022-05ff121c4e43", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1503204786-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9210f81232304e179d3e09914a492442", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap246d47a5-69", "ovs_interfaceid": "246d47a5-6953-4e38-8546-63953a8721cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:19:00 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-225ef27c-d938-4e86-b656-374268696f47 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:64:93:eb,bridge_name='br-int',has_traffic_filtering=True,id=246d47a5-6953-4e38-8546-63953a8721cf,network=Network(b36306e0-04c5-4b1b-8022-05ff121c4e43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap246d47a5-69') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:19:00 user nova-compute[71874]: DEBUG os_vif [None req-225ef27c-d938-4e86-b656-374268696f47 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:64:93:eb,bridge_name='br-int',has_traffic_filtering=True,id=246d47a5-6953-4e38-8546-63953a8721cf,network=Network(b36306e0-04c5-4b1b-8022-05ff121c4e43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap246d47a5-69') {{(pid=71874) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 16:19:00 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:19:00 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap246d47a5-69, bridge=br-int, if_exists=True) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:19:00 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:19:00 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:19:00 user nova-compute[71874]: INFO os_vif [None req-225ef27c-d938-4e86-b656-374268696f47 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:64:93:eb,bridge_name='br-int',has_traffic_filtering=True,id=246d47a5-6953-4e38-8546-63953a8721cf,network=Network(b36306e0-04c5-4b1b-8022-05ff121c4e43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap246d47a5-69')
Apr 12 16:19:00 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-225ef27c-d938-4e86-b656-374268696f47 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 608fbea2-b42b-4bb9-94a7-2b76dcdc2001] Deleting instance files /opt/stack/data/nova/instances/608fbea2-b42b-4bb9-94a7-2b76dcdc2001_del
Apr 12 16:19:00 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-225ef27c-d938-4e86-b656-374268696f47 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 608fbea2-b42b-4bb9-94a7-2b76dcdc2001] Deletion of /opt/stack/data/nova/instances/608fbea2-b42b-4bb9-94a7-2b76dcdc2001_del complete
Apr 12 16:19:00 user nova-compute[71874]: INFO nova.compute.manager [None req-225ef27c-d938-4e86-b656-374268696f47 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 608fbea2-b42b-4bb9-94a7-2b76dcdc2001] Took 0.87 seconds to destroy the instance on the hypervisor.
Apr 12 16:19:00 user nova-compute[71874]: DEBUG oslo.service.loopingcall [None req-225ef27c-d938-4e86-b656-374268696f47 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71874) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 16:19:00 user nova-compute[71874]: DEBUG nova.compute.manager [-] [instance: 608fbea2-b42b-4bb9-94a7-2b76dcdc2001] Deallocating network for instance {{(pid=71874) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 16:19:00 user nova-compute[71874]: DEBUG nova.network.neutron [-] [instance: 608fbea2-b42b-4bb9-94a7-2b76dcdc2001] deallocate_for_instance() {{(pid=71874) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 16:19:01 user nova-compute[71874]: DEBUG nova.network.neutron [-] [instance: 608fbea2-b42b-4bb9-94a7-2b76dcdc2001] Updating instance_info_cache with network_info: [] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:19:01 user nova-compute[71874]: INFO nova.compute.manager [-] [instance: 608fbea2-b42b-4bb9-94a7-2b76dcdc2001] Took 0.50 seconds to deallocate network for instance.
Apr 12 16:19:01 user nova-compute[71874]: DEBUG nova.compute.manager [req-341f4298-2c6c-4e8d-8b7c-833c63447b98 req-826dc099-725a-421f-a5d3-0694a9c664a9 service nova] [instance: 608fbea2-b42b-4bb9-94a7-2b76dcdc2001] Received event network-vif-deleted-246d47a5-6953-4e38-8546-63953a8721cf {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:19:01 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-225ef27c-d938-4e86-b656-374268696f47 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:19:01 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-225ef27c-d938-4e86-b656-374268696f47 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:19:01 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-225ef27c-d938-4e86-b656-374268696f47 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Inventory has not changed in ProviderTree for provider: 0e94b4c8-cd49-45e4-9133-d36eb4b2456b {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 16:19:01 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-225ef27c-d938-4e86-b656-374268696f47 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Inventory has not changed for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 16:19:01 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-225ef27c-d938-4e86-b656-374268696f47 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.348s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:19:01 user nova-compute[71874]: INFO nova.scheduler.client.report [None req-225ef27c-d938-4e86-b656-374268696f47 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Deleted allocations for instance 608fbea2-b42b-4bb9-94a7-2b76dcdc2001
Apr 12 16:19:01 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-225ef27c-d938-4e86-b656-374268696f47 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "608fbea2-b42b-4bb9-94a7-2b76dcdc2001" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.901s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:19:01 user nova-compute[71874]: DEBUG nova.compute.manager [req-dccd3a43-fb7b-4012-9f45-47fe2a69644e req-9a5f22ac-dc67-446f-a0e8-e16efa7d4c24 service nova] [instance: 608fbea2-b42b-4bb9-94a7-2b76dcdc2001] Received event network-vif-plugged-246d47a5-6953-4e38-8546-63953a8721cf {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:19:01 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-dccd3a43-fb7b-4012-9f45-47fe2a69644e req-9a5f22ac-dc67-446f-a0e8-e16efa7d4c24 service nova] Acquiring lock "608fbea2-b42b-4bb9-94a7-2b76dcdc2001-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:19:01 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-dccd3a43-fb7b-4012-9f45-47fe2a69644e req-9a5f22ac-dc67-446f-a0e8-e16efa7d4c24 service nova] Lock "608fbea2-b42b-4bb9-94a7-2b76dcdc2001-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:19:01 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-dccd3a43-fb7b-4012-9f45-47fe2a69644e req-9a5f22ac-dc67-446f-a0e8-e16efa7d4c24 service nova] Lock "608fbea2-b42b-4bb9-94a7-2b76dcdc2001-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:19:01 user nova-compute[71874]: DEBUG nova.compute.manager [req-dccd3a43-fb7b-4012-9f45-47fe2a69644e req-9a5f22ac-dc67-446f-a0e8-e16efa7d4c24 service nova] [instance: 608fbea2-b42b-4bb9-94a7-2b76dcdc2001] No waiting events found dispatching network-vif-plugged-246d47a5-6953-4e38-8546-63953a8721cf {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:19:01 user nova-compute[71874]: WARNING nova.compute.manager [req-dccd3a43-fb7b-4012-9f45-47fe2a69644e req-9a5f22ac-dc67-446f-a0e8-e16efa7d4c24 service nova] [instance: 608fbea2-b42b-4bb9-94a7-2b76dcdc2001] Received unexpected event network-vif-plugged-246d47a5-6953-4e38-8546-63953a8721cf for instance with vm_state deleted and task_state None.
Apr 12 16:19:05 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:19:06 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-bdb1b1f9-5efc-4654-aa9f-a0af8682ed27 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Acquiring lock "b4c37cbf-1743-4dd5-97fd-2bb12ebee763" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:19:06 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-bdb1b1f9-5efc-4654-aa9f-a0af8682ed27 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "b4c37cbf-1743-4dd5-97fd-2bb12ebee763" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:19:06 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-bdb1b1f9-5efc-4654-aa9f-a0af8682ed27 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Acquiring lock "b4c37cbf-1743-4dd5-97fd-2bb12ebee763-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:19:06 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-bdb1b1f9-5efc-4654-aa9f-a0af8682ed27 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "b4c37cbf-1743-4dd5-97fd-2bb12ebee763-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:19:06 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-bdb1b1f9-5efc-4654-aa9f-a0af8682ed27 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "b4c37cbf-1743-4dd5-97fd-2bb12ebee763-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:19:06 user nova-compute[71874]: INFO nova.compute.manager [None req-bdb1b1f9-5efc-4654-aa9f-a0af8682ed27 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] Terminating instance
Apr 12 16:19:06 user nova-compute[71874]: DEBUG nova.compute.manager [None req-bdb1b1f9-5efc-4654-aa9f-a0af8682ed27 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] Start destroying the instance on the hypervisor. {{(pid=71874) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 16:19:06 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:19:06 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:19:06 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:19:06 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:19:06 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:19:06 user nova-compute[71874]: DEBUG nova.compute.manager [req-3b109d4b-6ed3-48f1-b575-2b670b5b7c70 req-817e9dae-0aac-4d13-9109-0dc314042cde service nova] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] Received event network-vif-unplugged-d023dabe-13d5-4bbb-aa87-e9c1f5f1a048 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:19:06 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-3b109d4b-6ed3-48f1-b575-2b670b5b7c70 req-817e9dae-0aac-4d13-9109-0dc314042cde service nova] Acquiring lock "b4c37cbf-1743-4dd5-97fd-2bb12ebee763-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:19:06 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-3b109d4b-6ed3-48f1-b575-2b670b5b7c70 req-817e9dae-0aac-4d13-9109-0dc314042cde service nova] Lock "b4c37cbf-1743-4dd5-97fd-2bb12ebee763-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:19:06 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-3b109d4b-6ed3-48f1-b575-2b670b5b7c70 req-817e9dae-0aac-4d13-9109-0dc314042cde service nova] Lock "b4c37cbf-1743-4dd5-97fd-2bb12ebee763-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:19:06 user nova-compute[71874]: DEBUG nova.compute.manager [req-3b109d4b-6ed3-48f1-b575-2b670b5b7c70 req-817e9dae-0aac-4d13-9109-0dc314042cde service nova] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] No waiting events found dispatching network-vif-unplugged-d023dabe-13d5-4bbb-aa87-e9c1f5f1a048 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:19:06 user nova-compute[71874]: DEBUG nova.compute.manager [req-3b109d4b-6ed3-48f1-b575-2b670b5b7c70 req-817e9dae-0aac-4d13-9109-0dc314042cde service nova] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] Received event network-vif-unplugged-d023dabe-13d5-4bbb-aa87-e9c1f5f1a048 for instance with task_state deleting. {{(pid=71874) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 16:19:06 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:19:06 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:19:06 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:19:06 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:19:06 user nova-compute[71874]: INFO nova.virt.libvirt.driver [-] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] Instance destroyed successfully.
Apr 12 16:19:06 user nova-compute[71874]: DEBUG nova.objects.instance [None req-bdb1b1f9-5efc-4654-aa9f-a0af8682ed27 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lazy-loading 'resources' on Instance uuid b4c37cbf-1743-4dd5-97fd-2bb12ebee763 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:19:06 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-bdb1b1f9-5efc-4654-aa9f-a0af8682ed27 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T16:14:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1831226458',display_name='tempest-TestMinimumBasicScenario-server-1831226458',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1831226458',id=35,image_ref='f2a10ad0-dd56-4297-aed7-ce5d72ea953b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNbxR7XOwk113oWUkXlckv3xW8Ml31qZ6CdwMA2FLaXgBX+cAx40ag2FfMVKhGuA7H5T7OmtJlyS1451of3/3trw1T7Q3yghc0E0SJ2p2NDvcjF3/krMejZ/FZS/hV4u4g==',key_name='tempest-TestMinimumBasicScenario-1912647637',keypairs=<?>,launch_index=0,launched_at=2023-04-12T16:14:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='236b9e609eb44071bc88971bff96931e',ramdisk_id='',reservation_id='r-g8bpe8bm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f2a10ad0-dd56-4297-aed7-ce5d72ea953b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1374695003',owner_user_name='tempest-TestMinimumBasicScenario-1374695003-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T16:16:29Z,user_data=None,user_id='16a68fa3490940ebaebc8d4ca5746f6e',uuid=b4c37cbf-1743-4dd5-97fd-2bb12ebee763,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d023dabe-13d5-4bbb-aa87-e9c1f5f1a048", "address": "fa:16:3e:59:df:38", "network": {"id": "58f92787-e3b6-4fd3-bd75-7169f1a36651", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-614349033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "236b9e609eb44071bc88971bff96931e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd023dabe-13", "ovs_interfaceid": "d023dabe-13d5-4bbb-aa87-e9c1f5f1a048", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 16:19:06 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-bdb1b1f9-5efc-4654-aa9f-a0af8682ed27 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Converting VIF {"id": "d023dabe-13d5-4bbb-aa87-e9c1f5f1a048", "address": "fa:16:3e:59:df:38", "network": {"id": "58f92787-e3b6-4fd3-bd75-7169f1a36651", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-614349033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "236b9e609eb44071bc88971bff96931e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd023dabe-13", "ovs_interfaceid": "d023dabe-13d5-4bbb-aa87-e9c1f5f1a048", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:19:06 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-bdb1b1f9-5efc-4654-aa9f-a0af8682ed27 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:59:df:38,bridge_name='br-int',has_traffic_filtering=True,id=d023dabe-13d5-4bbb-aa87-e9c1f5f1a048,network=Network(58f92787-e3b6-4fd3-bd75-7169f1a36651),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd023dabe-13') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:19:06 user nova-compute[71874]: DEBUG os_vif [None req-bdb1b1f9-5efc-4654-aa9f-a0af8682ed27 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:59:df:38,bridge_name='br-int',has_traffic_filtering=True,id=d023dabe-13d5-4bbb-aa87-e9c1f5f1a048,network=Network(58f92787-e3b6-4fd3-bd75-7169f1a36651),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd023dabe-13') {{(pid=71874) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 16:19:06 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:19:06 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd023dabe-13, bridge=br-int, if_exists=True) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:19:06 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:19:06 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:19:06 user nova-compute[71874]: INFO os_vif [None req-bdb1b1f9-5efc-4654-aa9f-a0af8682ed27 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:59:df:38,bridge_name='br-int',has_traffic_filtering=True,id=d023dabe-13d5-4bbb-aa87-e9c1f5f1a048,network=Network(58f92787-e3b6-4fd3-bd75-7169f1a36651),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd023dabe-13')
Apr 12 16:19:06 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-bdb1b1f9-5efc-4654-aa9f-a0af8682ed27 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] Deleting instance files /opt/stack/data/nova/instances/b4c37cbf-1743-4dd5-97fd-2bb12ebee763_del
Apr 12 16:19:06 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-bdb1b1f9-5efc-4654-aa9f-a0af8682ed27 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] Deletion of /opt/stack/data/nova/instances/b4c37cbf-1743-4dd5-97fd-2bb12ebee763_del complete
Apr 12 16:19:06 user nova-compute[71874]: INFO nova.compute.manager [None req-bdb1b1f9-5efc-4654-aa9f-a0af8682ed27 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] Took 0.87 seconds to destroy the instance on the hypervisor.
Apr 12 16:19:06 user nova-compute[71874]: DEBUG oslo.service.loopingcall [None req-bdb1b1f9-5efc-4654-aa9f-a0af8682ed27 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71874) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 16:19:06 user nova-compute[71874]: DEBUG nova.compute.manager [-] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] Deallocating network for instance {{(pid=71874) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 16:19:06 user nova-compute[71874]: DEBUG nova.network.neutron [-] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] deallocate_for_instance() {{(pid=71874) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 16:19:07 user nova-compute[71874]: DEBUG nova.network.neutron [-] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] Updating instance_info_cache with network_info: [] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:19:07 user nova-compute[71874]: INFO nova.compute.manager [-] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] Took 0.44 seconds to deallocate network for instance.
Apr 12 16:19:07 user nova-compute[71874]: DEBUG nova.compute.manager [req-96d20422-e5a6-4c9b-84a6-1b869d9a7198 req-978d8f96-317a-4177-ab2b-491b680f9d8a service nova] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] Received event network-vif-deleted-d023dabe-13d5-4bbb-aa87-e9c1f5f1a048 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:19:07 user nova-compute[71874]: INFO nova.compute.manager [req-96d20422-e5a6-4c9b-84a6-1b869d9a7198 req-978d8f96-317a-4177-ab2b-491b680f9d8a service nova] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] Neutron deleted interface d023dabe-13d5-4bbb-aa87-e9c1f5f1a048; detaching it from the instance and deleting it from the info cache
Apr 12 16:19:07 user nova-compute[71874]: DEBUG nova.network.neutron [req-96d20422-e5a6-4c9b-84a6-1b869d9a7198 req-978d8f96-317a-4177-ab2b-491b680f9d8a service nova] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] Updating instance_info_cache with network_info: [] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:19:07 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:19:07 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:19:07 user nova-compute[71874]: DEBUG nova.compute.manager [req-96d20422-e5a6-4c9b-84a6-1b869d9a7198 req-978d8f96-317a-4177-ab2b-491b680f9d8a service nova] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] Detach interface failed, port_id=d023dabe-13d5-4bbb-aa87-e9c1f5f1a048, reason: Instance b4c37cbf-1743-4dd5-97fd-2bb12ebee763 could not be found. {{(pid=71874) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 12 16:19:07 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:19:07 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-bdb1b1f9-5efc-4654-aa9f-a0af8682ed27 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:19:07 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-bdb1b1f9-5efc-4654-aa9f-a0af8682ed27 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:19:07 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:19:07 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:19:07 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-bdb1b1f9-5efc-4654-aa9f-a0af8682ed27 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Inventory has not changed in ProviderTree for provider: 0e94b4c8-cd49-45e4-9133-d36eb4b2456b {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 16:19:07 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-bdb1b1f9-5efc-4654-aa9f-a0af8682ed27 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Inventory has not changed for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 16:19:07 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-bdb1b1f9-5efc-4654-aa9f-a0af8682ed27 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.300s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:19:07 user nova-compute[71874]: INFO nova.scheduler.client.report [None req-bdb1b1f9-5efc-4654-aa9f-a0af8682ed27 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Deleted allocations for instance b4c37cbf-1743-4dd5-97fd-2bb12ebee763
Apr 12 16:19:07 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-bdb1b1f9-5efc-4654-aa9f-a0af8682ed27 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "b4c37cbf-1743-4dd5-97fd-2bb12ebee763" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.774s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:19:08 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:19:08 user nova-compute[71874]: DEBUG nova.compute.manager [req-3f1216e0-3796-4d6d-acc8-8e566684f030 req-0d1b280e-f2e3-4ed4-a524-dbfe2deb2ad1 service nova] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] Received event network-vif-plugged-d023dabe-13d5-4bbb-aa87-e9c1f5f1a048 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:19:08 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-3f1216e0-3796-4d6d-acc8-8e566684f030 req-0d1b280e-f2e3-4ed4-a524-dbfe2deb2ad1 service nova] Acquiring lock "b4c37cbf-1743-4dd5-97fd-2bb12ebee763-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:19:08 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-3f1216e0-3796-4d6d-acc8-8e566684f030 req-0d1b280e-f2e3-4ed4-a524-dbfe2deb2ad1 service nova] Lock "b4c37cbf-1743-4dd5-97fd-2bb12ebee763-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:19:08 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-3f1216e0-3796-4d6d-acc8-8e566684f030 req-0d1b280e-f2e3-4ed4-a524-dbfe2deb2ad1 service nova] Lock "b4c37cbf-1743-4dd5-97fd-2bb12ebee763-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:19:08 user nova-compute[71874]: DEBUG nova.compute.manager [req-3f1216e0-3796-4d6d-acc8-8e566684f030 req-0d1b280e-f2e3-4ed4-a524-dbfe2deb2ad1 service nova] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] No waiting events found dispatching network-vif-plugged-d023dabe-13d5-4bbb-aa87-e9c1f5f1a048 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:19:08 user nova-compute[71874]: WARNING nova.compute.manager [req-3f1216e0-3796-4d6d-acc8-8e566684f030 req-0d1b280e-f2e3-4ed4-a524-dbfe2deb2ad1 service nova] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] Received unexpected event network-vif-plugged-d023dabe-13d5-4bbb-aa87-e9c1f5f1a048 for instance with vm_state deleted and task_state None.
Apr 12 16:19:11 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:19:13 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:19:15 user nova-compute[71874]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681316340.4090614, 608fbea2-b42b-4bb9-94a7-2b76dcdc2001 => Stopped> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:19:15 user nova-compute[71874]: INFO nova.compute.manager [-] [instance: 608fbea2-b42b-4bb9-94a7-2b76dcdc2001] VM Stopped (Lifecycle Event)
Apr 12 16:19:15 user nova-compute[71874]: DEBUG nova.compute.manager [None req-e3275072-1dcc-4d1c-afb6-efad3d7ebc27 None None] [instance: 608fbea2-b42b-4bb9-94a7-2b76dcdc2001] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:19:16 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:19:21 user nova-compute[71874]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681316346.8568747, b4c37cbf-1743-4dd5-97fd-2bb12ebee763 => Stopped> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:19:21 user nova-compute[71874]: INFO nova.compute.manager [-] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] VM Stopped (Lifecycle Event)
Apr 12 16:19:21 user nova-compute[71874]: DEBUG nova.compute.manager [None req-be6e57fc-bb0d-4b0e-9dba-ffc86cb2faf7 None None] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:19:21 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:19:25 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:19:25 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:19:25 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:19:25 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:19:25 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Auditing locally available compute resources for user (node: user) {{(pid=71874) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 16:19:26 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 16:19:26 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b613235-a905-466f-b9cc-a21a321a6313/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:19:26 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b613235-a905-466f-b9cc-a21a321a6313/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:19:26 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b613235-a905-466f-b9cc-a21a321a6313/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:19:26 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b613235-a905-466f-b9cc-a21a321a6313/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:19:26 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4190e244-84b1-47b6-813d-9cadb7c65975/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:19:26 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4190e244-84b1-47b6-813d-9cadb7c65975/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:19:26 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4190e244-84b1-47b6-813d-9cadb7c65975/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:19:26 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4190e244-84b1-47b6-813d-9cadb7c65975/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:19:26 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 16:19:26 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/540a8fd5-8c18-4efe-97d4-9f0942cebcf5/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:19:26 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:19:26 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/540a8fd5-8c18-4efe-97d4-9f0942cebcf5/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:19:26 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/540a8fd5-8c18-4efe-97d4-9f0942cebcf5/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:19:27 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/540a8fd5-8c18-4efe-97d4-9f0942cebcf5/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:19:27 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32471bee-e77e-4a1b-8e00-d938a1373976/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:19:27 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32471bee-e77e-4a1b-8e00-d938a1373976/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:19:27 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32471bee-e77e-4a1b-8e00-d938a1373976/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:19:27 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32471bee-e77e-4a1b-8e00-d938a1373976/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:19:27 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:19:27 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:19:27 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Hypervisor/Node resource view: name=user free_ram=8017MB free_disk=25.92556381225586GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71874) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 16:19:27 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:19:27 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:19:28 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Applying migration context for instance bef10c89-360e-42d6-aa26-7edf1afca567 as it has an incoming, in-progress migration 6b3c0b85-4c61-422d-b540-ee366451d208. Migration status is finished {{(pid=71874) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:950}}
Apr 12 16:19:28 user nova-compute[71874]: INFO nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] Updating resource usage from migration 6b3c0b85-4c61-422d-b540-ee366451d208
Apr 12 16:19:28 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 4190e244-84b1-47b6-813d-9cadb7c65975 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:19:28 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 1b613235-a905-466f-b9cc-a21a321a6313 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:19:28 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 32471bee-e77e-4a1b-8e00-d938a1373976 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:19:28 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 540a8fd5-8c18-4efe-97d4-9f0942cebcf5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:19:28 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Migration 6b3c0b85-4c61-422d-b540-ee366451d208 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1637}}
Apr 12 16:19:28 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance bef10c89-360e-42d6-aa26-7edf1afca567 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:19:28 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 77842113-37e8-4dc3-bd28-84417eb1ac31 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:19:28 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=71874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 16:19:28 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Final resource view: name=user phys_ram=16023MB used_ram=1472MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=71874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 16:19:28 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Inventory has not changed in ProviderTree for provider: 0e94b4c8-cd49-45e4-9133-d36eb4b2456b {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 16:19:28 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Inventory has not changed for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 16:19:28 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Compute_service record updated for user:user {{(pid=71874) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 16:19:28 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.366s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:19:28 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-b3670cb8-ae89-4336-939f-60ae28ae704b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "bef10c89-360e-42d6-aa26-7edf1afca567" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:19:28 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-b3670cb8-ae89-4336-939f-60ae28ae704b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "bef10c89-360e-42d6-aa26-7edf1afca567" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:19:28 user nova-compute[71874]: DEBUG nova.compute.manager [None req-b3670cb8-ae89-4336-939f-60ae28ae704b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] Going to confirm migration 2 {{(pid=71874) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4663}}
Apr 12 16:19:28 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:19:28 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-b3670cb8-ae89-4336-939f-60ae28ae704b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "refresh_cache-bef10c89-360e-42d6-aa26-7edf1afca567" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:19:28 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-b3670cb8-ae89-4336-939f-60ae28ae704b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquired lock "refresh_cache-bef10c89-360e-42d6-aa26-7edf1afca567" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:19:28 user nova-compute[71874]: DEBUG nova.network.neutron [None req-b3670cb8-ae89-4336-939f-60ae28ae704b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] Building network info cache for instance {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 16:19:28 user nova-compute[71874]: DEBUG nova.objects.instance [None req-b3670cb8-ae89-4336-939f-60ae28ae704b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lazy-loading 'info_cache' on Instance uuid bef10c89-360e-42d6-aa26-7edf1afca567 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:19:28 user nova-compute[71874]: DEBUG nova.network.neutron [None req-b3670cb8-ae89-4336-939f-60ae28ae704b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] Updating instance_info_cache with network_info: [{"id": "ecba9b76-45d2-49e7-addc-367dc21b38ce", "address": "fa:16:3e:e4:f4:15", "network": {"id": "e6694358-e361-4952-b859-93755c11721e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-667152893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97ea81bd1962466bbe552424973f71a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecba9b76-45", "ovs_interfaceid": "ecba9b76-45d2-49e7-addc-367dc21b38ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:19:29 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-b3670cb8-ae89-4336-939f-60ae28ae704b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Releasing lock "refresh_cache-bef10c89-360e-42d6-aa26-7edf1afca567" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:19:29 user nova-compute[71874]: DEBUG nova.objects.instance [None req-b3670cb8-ae89-4336-939f-60ae28ae704b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lazy-loading 'migration_context' on Instance uuid bef10c89-360e-42d6-aa26-7edf1afca567 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:19:29 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-b3670cb8-ae89-4336-939f-60ae28ae704b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:19:29 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-b3670cb8-ae89-4336-939f-60ae28ae704b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:19:29 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-b3670cb8-ae89-4336-939f-60ae28ae704b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Inventory has not changed in ProviderTree for provider: 0e94b4c8-cd49-45e4-9133-d36eb4b2456b {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 16:19:29 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-b3670cb8-ae89-4336-939f-60ae28ae704b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Inventory has not changed for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 16:19:29 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-b3670cb8-ae89-4336-939f-60ae28ae704b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.261s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:19:29 user nova-compute[71874]: INFO nova.scheduler.client.report [None req-b3670cb8-ae89-4336-939f-60ae28ae704b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Deleted allocation for migration 6b3c0b85-4c61-422d-b540-ee366451d208
Apr 12 16:19:29 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-b3670cb8-ae89-4336-939f-60ae28ae704b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "bef10c89-360e-42d6-aa26-7edf1afca567" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.179s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:19:31 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:19:31 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:19:31 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:19:31 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:19:32 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:19:33 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:19:33 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:19:33 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Starting heal instance info cache {{(pid=71874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 16:19:33 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Rebuilding the list of instances to heal {{(pid=71874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 16:19:33 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquiring lock "refresh_cache-4190e244-84b1-47b6-813d-9cadb7c65975" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:19:33 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquired lock "refresh_cache-4190e244-84b1-47b6-813d-9cadb7c65975" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:19:33 user nova-compute[71874]: DEBUG nova.network.neutron [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Forcefully refreshing network info cache for instance {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 16:19:33 user nova-compute[71874]: DEBUG nova.objects.instance [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lazy-loading 'info_cache' on Instance uuid 4190e244-84b1-47b6-813d-9cadb7c65975 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:19:34 user nova-compute[71874]: DEBUG nova.network.neutron [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Updating instance_info_cache with network_info: [{"id": "eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c", "address": "fa:16:3e:d0:b5:d4", "network": {"id": "1ef428ff-90e5-4abd-93d0-b7c2c581cb26", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-425924095-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf4334df004490ba51b4d92ce5408ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeab1ea0c-8a", "ovs_interfaceid": "eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:19:34 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Releasing lock "refresh_cache-4190e244-84b1-47b6-813d-9cadb7c65975" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:19:34 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Updated the network info_cache for instance {{(pid=71874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 16:19:34 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:19:34 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71874) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 16:19:35 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:19:36 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:19:36 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:19:41 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:19:43 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:19:46 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:19:47 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-112f0937-728c-4451-887c-cbf3aab2e56a tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Acquiring lock "540a8fd5-8c18-4efe-97d4-9f0942cebcf5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:19:47 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-112f0937-728c-4451-887c-cbf3aab2e56a tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "540a8fd5-8c18-4efe-97d4-9f0942cebcf5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:19:47 user nova-compute[71874]: DEBUG nova.objects.instance [None req-112f0937-728c-4451-887c-cbf3aab2e56a tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lazy-loading 'flavor' on Instance uuid 540a8fd5-8c18-4efe-97d4-9f0942cebcf5 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:19:47 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-112f0937-728c-4451-887c-cbf3aab2e56a tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "540a8fd5-8c18-4efe-97d4-9f0942cebcf5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:19:47 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-112f0937-728c-4451-887c-cbf3aab2e56a tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Acquiring lock "540a8fd5-8c18-4efe-97d4-9f0942cebcf5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:19:47 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-112f0937-728c-4451-887c-cbf3aab2e56a tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "540a8fd5-8c18-4efe-97d4-9f0942cebcf5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:19:47 user nova-compute[71874]: INFO nova.compute.manager [None req-112f0937-728c-4451-887c-cbf3aab2e56a tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] [instance: 540a8fd5-8c18-4efe-97d4-9f0942cebcf5] Attaching volume f0b87cf1-91fb-4365-9356-8aab68a15e7e to /dev/vdb
Apr 12 16:19:47 user nova-compute[71874]: DEBUG os_brick.utils [None req-112f0937-728c-4451-887c-cbf3aab2e56a tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:19:47 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:19:47 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:19:47 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac34265d-39a4-437c-8997-dd6da33c347f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:61a48d4489d2\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:19:47 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:19:47 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:19:47 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[936c7186-12a0-47f8-bec6-24bbaf7aea48]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:19:47 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:19:47 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:19:47 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[62e90caa-c767-4755-9c9a-9732bf307d98]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:19:47 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[43dc2f8b-afe7-478d-8517-c00ae1c99b0b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:19:47 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-112f0937-728c-4451-887c-cbf3aab2e56a tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Running cmd (subprocess): nvme version {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:19:47 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-112f0937-728c-4451-887c-cbf3aab2e56a tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] 'nvme version' failed. Not Retrying. {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 16:19:47 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.nvmeof [None req-112f0937-728c-4451-887c-cbf3aab2e56a tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] nvme not present on system {{(pid=71874) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 16:19:47 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:19:47 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 16:19:47 user nova-compute[71874]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 16:19:47 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc8d2876-2c0f-43dc-af5c-0d67e8f2dbed]: (4, '') {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:19:47 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.lightos [None req-112f0937-728c-4451-887c-cbf3aab2e56a tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71874) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 16:19:47 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.lightos [None req-112f0937-728c-4451-887c-cbf3aab2e56a tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71874) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 16:19:47 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.lightos [None req-112f0937-728c-4451-887c-cbf3aab2e56a tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] LIGHTOS: no hostnqn found. {{(pid=71874) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 16:19:47 user nova-compute[71874]: DEBUG os_brick.utils [None req-112f0937-728c-4451-887c-cbf3aab2e56a tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:61a48d4489d2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:19:47 user nova-compute[71874]: DEBUG nova.virt.block_device [None req-112f0937-728c-4451-887c-cbf3aab2e56a tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] [instance: 540a8fd5-8c18-4efe-97d4-9f0942cebcf5] Updating existing volume attachment record: 44dbfc42-55d1-41a9-9659-a96426cb758d {{(pid=71874) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 16:19:48 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:19:51 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:19:51 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:19:51 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-112f0937-728c-4451-887c-cbf3aab2e56a tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] [instance: 540a8fd5-8c18-4efe-97d4-9f0942cebcf5] Calling os-brick to attach iSCSI Volume {{(pid=71874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 16:19:51 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-112f0937-728c-4451-887c-cbf3aab2e56a tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3c0216320>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f0b87cf1-91fb-4365-9356-8aab68a15e7e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qYUHQRak', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:19:51 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-112f0937-728c-4451-887c-cbf3aab2e56a tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:19:51 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-112f0937-728c-4451-887c-cbf3aab2e56a tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:19:51 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-112f0937-728c-4451-887c-cbf3aab2e56a tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:19:51 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-112f0937-728c-4451-887c-cbf3aab2e56a tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:19:51 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-112f0937-728c-4451-887c-cbf3aab2e56a tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f0b87cf1-91fb-4365-9356-8aab68a15e7e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:19:51 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-112f0937-728c-4451-887c-cbf3aab2e56a tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f0b87cf1-91fb-4365-9356-8aab68a15e7e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:19:51 user nova-compute[71874]: INFO os_brick.initiator.connectors.iscsi [None req-112f0937-728c-4451-887c-cbf3aab2e56a tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 16:19:51 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0b87cf1-91fb-4365-9356-8aab68a15e7e -p 172.16.0.220:3260 {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:19:52 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0b87cf1-91fb-4365-9356-8aab68a15e7e -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:19:52 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[4522e70a-be55-475d-ac9c-042368b3275e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:19:52 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-112f0937-728c-4451-887c-cbf3aab2e56a tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 16:19:52 user nova-compute[71874]:  {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:19:52 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0b87cf1-91fb-4365-9356-8aab68a15e7e -p 172.16.0.220:3260 --interface default --op new {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:19:52 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0b87cf1-91fb-4365-9356-8aab68a15e7e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:19:52 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa4d9e75-b966-4690-b720-febe68233a4f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f0b87cf1-91fb-4365-9356-8aab68a15e7e] added\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:19:52 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-112f0937-728c-4451-887c-cbf3aab2e56a tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f0b87cf1-91fb-4365-9356-8aab68a15e7e] added
Apr 12 16:19:52 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:19:52 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0b87cf1-91fb-4365-9356-8aab68a15e7e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:19:52 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0b87cf1-91fb-4365-9356-8aab68a15e7e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:19:52 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[d66ff4e3-9384-4c2b-9fc3-8e82226ba897]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:19:52 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-112f0937-728c-4451-887c-cbf3aab2e56a tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:19:52 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0b87cf1-91fb-4365-9356-8aab68a15e7e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:19:52 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0b87cf1-91fb-4365-9356-8aab68a15e7e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:19:52 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[653b08c6-b6f8-4be4-8e2b-9dca4e150d67]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:19:52 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-112f0937-728c-4451-887c-cbf3aab2e56a tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:19:52 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0b87cf1-91fb-4365-9356-8aab68a15e7e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qYUHQRak {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:19:52 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0b87cf1-91fb-4365-9356-8aab68a15e7e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qYUHQRak" returned: 0 in 0.018s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:19:52 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d8483bd-e86f-456b-9b7a-e0a194361aec]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:19:52 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-112f0937-728c-4451-887c-cbf3aab2e56a tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qYUHQRak'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:19:52 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0b87cf1-91fb-4365-9356-8aab68a15e7e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:19:52 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0b87cf1-91fb-4365-9356-8aab68a15e7e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:19:52 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dbb726e-5dff-4f5f-b0a2-ed8ea6c5e203]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:19:52 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-112f0937-728c-4451-887c-cbf3aab2e56a tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:19:52 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:19:52 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:19:52 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d6fe17c-ecba-42d1-8a5e-56463a04eb18]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:952c0ad3-7b56-454e-af58-10213195373d (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:19:52 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-112f0937-728c-4451-887c-cbf3aab2e56a tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775 (non-flash)
Apr 12 16:19:52 user nova-compute[71874]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:952c0ad3-7b56-454e-af58-10213195373d (non-flash)
Apr 12 16:19:52 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:19:52 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-112f0937-728c-4451-887c-cbf3aab2e56a tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775 (non-flash)
Apr 12 16:19:52 user nova-compute[71874]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:952c0ad3-7b56-454e-af58-10213195373d (non-flash)
Apr 12 16:19:52 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:19:52 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0b87cf1-91fb-4365-9356-8aab68a15e7e -p 172.16.0.220:3260 --login {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:19:52 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:19:52 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0b87cf1-91fb-4365-9356-8aab68a15e7e -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:19:52 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[4870f9f5-5917-4b5c-80d2-04cef5fef8d0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f0b87cf1-91fb-4365-9356-8aab68a15e7e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f0b87cf1-91fb-4365-9356-8aab68a15e7e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:19:52 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-112f0937-728c-4451-887c-cbf3aab2e56a tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f0b87cf1-91fb-4365-9356-8aab68a15e7e, portal: 172.16.0.220,3260]
Apr 12 16:19:52 user nova-compute[71874]: Login to [iface: default, target: iqn.2010-10.org.openstack:f0b87cf1-91fb-4365-9356-8aab68a15e7e, portal: 172.16.0.220,3260] successful.
Apr 12 16:19:52 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:19:52 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0b87cf1-91fb-4365-9356-8aab68a15e7e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:19:52 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0b87cf1-91fb-4365-9356-8aab68a15e7e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:19:52 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[8672de79-c8cd-4b61-8298-9727975eb6ad]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:19:52 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-112f0937-728c-4451-887c-cbf3aab2e56a tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:19:52 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:19:52 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:19:52 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f2fd1cd-73cb-4e7b-aaa1-6ea202bcdacc]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:952c0ad3-7b56-454e-af58-10213195373d (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0b87cf1-91fb-4365-9356-8aab68a15e7e (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:19:52 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-112f0937-728c-4451-887c-cbf3aab2e56a tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775 (non-flash)
Apr 12 16:19:52 user nova-compute[71874]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:952c0ad3-7b56-454e-af58-10213195373d (non-flash)
Apr 12 16:19:52 user nova-compute[71874]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0b87cf1-91fb-4365-9356-8aab68a15e7e (non-flash)
Apr 12 16:19:52 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:19:52 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-112f0937-728c-4451-887c-cbf3aab2e56a tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775 (non-flash)
Apr 12 16:19:52 user nova-compute[71874]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:952c0ad3-7b56-454e-af58-10213195373d (non-flash)
Apr 12 16:19:52 user nova-compute[71874]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0b87cf1-91fb-4365-9356-8aab68a15e7e (non-flash)
Apr 12 16:19:52 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:19:52 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-112f0937-728c-4451-887c-cbf3aab2e56a tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f0b87cf1-91fb-4365-9356-8aab68a15e7e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.292s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:19:52 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-112f0937-728c-4451-887c-cbf3aab2e56a tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Connected to 172.16.0.220:3260 {{(pid=71874) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 16:19:52 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-112f0937-728c-4451-887c-cbf3aab2e56a tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] HCTL ('34', '-', '-', 0) found on session 45 with lun 0 {{(pid=71874) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 16:19:52 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-112f0937-728c-4451-887c-cbf3aab2e56a tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71874) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 16:19:52 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:19:52 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:19:52 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c3e8487-3b2f-4efc-bbd5-58a5a5e5b652]: (4, ('- - 0', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:19:52 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-112f0937-728c-4451-887c-cbf3aab2e56a tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Searching for a device in session 45 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71874) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 16:19:52 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-112f0937-728c-4451-887c-cbf3aab2e56a tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:f0b87cf1-91fb-4365-9356-8aab68a15e7e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qYUHQRak', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71874) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 16:19:53 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-112f0937-728c-4451-887c-cbf3aab2e56a tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.327s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:19:53 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-112f0937-728c-4451-887c-cbf3aab2e56a tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] <== connect_volume: return (1328ms) {'type': 'block', 'scsi_wwn': '23064343634663431', 'path': '/dev/sdc'} {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:19:53 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-112f0937-728c-4451-887c-cbf3aab2e56a tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] [instance: 540a8fd5-8c18-4efe-97d4-9f0942cebcf5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23064343634663431', 'path': '/dev/sdc'} {{(pid=71874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 16:19:53 user nova-compute[71874]: DEBUG nova.objects.instance [None req-112f0937-728c-4451-887c-cbf3aab2e56a tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lazy-loading 'flavor' on Instance uuid 540a8fd5-8c18-4efe-97d4-9f0942cebcf5 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:19:53 user nova-compute[71874]: DEBUG nova.virt.libvirt.guest [None req-112f0937-728c-4451-887c-cbf3aab2e56a tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 16:19:53 user nova-compute[71874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 16:19:53 user nova-compute[71874]:   <source dev="/dev/sdc"/>
Apr 12 16:19:53 user nova-compute[71874]:   <target dev="vdb" bus="virtio"/>
Apr 12 16:19:53 user nova-compute[71874]:   <serial>f0b87cf1-91fb-4365-9356-8aab68a15e7e</serial>
Apr 12 16:19:53 user nova-compute[71874]: </disk>
Apr 12 16:19:53 user nova-compute[71874]:  {{(pid=71874) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 16:19:53 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-112f0937-728c-4451-887c-cbf3aab2e56a tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] No BDM found with device name vda, not building metadata. {{(pid=71874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 16:19:53 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-112f0937-728c-4451-887c-cbf3aab2e56a tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 16:19:53 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-112f0937-728c-4451-887c-cbf3aab2e56a tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] No VIF found with MAC fa:16:3e:23:bb:b8, not building metadata {{(pid=71874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 16:19:53 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-112f0937-728c-4451-887c-cbf3aab2e56a tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "540a8fd5-8c18-4efe-97d4-9f0942cebcf5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.569s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:19:55 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-377952d4-ba38-4380-afbb-052444672c63 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Acquiring lock "540a8fd5-8c18-4efe-97d4-9f0942cebcf5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:19:55 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-377952d4-ba38-4380-afbb-052444672c63 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "540a8fd5-8c18-4efe-97d4-9f0942cebcf5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:19:55 user nova-compute[71874]: INFO nova.compute.manager [None req-377952d4-ba38-4380-afbb-052444672c63 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] [instance: 540a8fd5-8c18-4efe-97d4-9f0942cebcf5] Detaching volume f0b87cf1-91fb-4365-9356-8aab68a15e7e
Apr 12 16:19:55 user nova-compute[71874]: INFO nova.virt.block_device [None req-377952d4-ba38-4380-afbb-052444672c63 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] [instance: 540a8fd5-8c18-4efe-97d4-9f0942cebcf5] Attempting to driver detach volume f0b87cf1-91fb-4365-9356-8aab68a15e7e from mountpoint /dev/vdb
Apr 12 16:19:55 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-377952d4-ba38-4380-afbb-052444672c63 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Attempting to detach device vdb from instance 540a8fd5-8c18-4efe-97d4-9f0942cebcf5 from the persistent domain config. {{(pid=71874) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 16:19:55 user nova-compute[71874]: DEBUG nova.virt.libvirt.guest [None req-377952d4-ba38-4380-afbb-052444672c63 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 16:19:55 user nova-compute[71874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 16:19:55 user nova-compute[71874]:   <source dev="/dev/sdc"/>
Apr 12 16:19:55 user nova-compute[71874]:   <target dev="vdb" bus="virtio"/>
Apr 12 16:19:55 user nova-compute[71874]:   <serial>f0b87cf1-91fb-4365-9356-8aab68a15e7e</serial>
Apr 12 16:19:55 user nova-compute[71874]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 16:19:55 user nova-compute[71874]: </disk>
Apr 12 16:19:55 user nova-compute[71874]:  {{(pid=71874) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 16:19:55 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-377952d4-ba38-4380-afbb-052444672c63 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Successfully detached device vdb from instance 540a8fd5-8c18-4efe-97d4-9f0942cebcf5 from the persistent domain config.
Apr 12 16:19:55 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-377952d4-ba38-4380-afbb-052444672c63 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 540a8fd5-8c18-4efe-97d4-9f0942cebcf5 from the live domain config. {{(pid=71874) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 16:19:55 user nova-compute[71874]: DEBUG nova.virt.libvirt.guest [None req-377952d4-ba38-4380-afbb-052444672c63 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 16:19:55 user nova-compute[71874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 16:19:55 user nova-compute[71874]:   <source dev="/dev/sdc"/>
Apr 12 16:19:55 user nova-compute[71874]:   <target dev="vdb" bus="virtio"/>
Apr 12 16:19:55 user nova-compute[71874]:   <serial>f0b87cf1-91fb-4365-9356-8aab68a15e7e</serial>
Apr 12 16:19:55 user nova-compute[71874]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 16:19:55 user nova-compute[71874]: </disk>
Apr 12 16:19:55 user nova-compute[71874]:  {{(pid=71874) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 16:19:56 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Received event <DeviceRemovedEvent: 1681316396.145212, 540a8fd5-8c18-4efe-97d4-9f0942cebcf5 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71874) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 16:19:56 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-377952d4-ba38-4380-afbb-052444672c63 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 540a8fd5-8c18-4efe-97d4-9f0942cebcf5 {{(pid=71874) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 16:19:56 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-377952d4-ba38-4380-afbb-052444672c63 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Successfully detached device vdb from instance 540a8fd5-8c18-4efe-97d4-9f0942cebcf5 from the live domain config.
Apr 12 16:19:56 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-377952d4-ba38-4380-afbb-052444672c63 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] [instance: 540a8fd5-8c18-4efe-97d4-9f0942cebcf5] calling os-brick to detach iSCSI Volume {{(pid=71874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 16:19:56 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-377952d4-ba38-4380-afbb-052444672c63 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3c0216320>, {'target_iqn': 'iqn.2010-10.org.openstack:f0b87cf1-91fb-4365-9356-8aab68a15e7e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qYUHQRak', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:19:56 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-377952d4-ba38-4380-afbb-052444672c63 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:19:56 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-377952d4-ba38-4380-afbb-052444672c63 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:19:56 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-377952d4-ba38-4380-afbb-052444672c63 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:19:56 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:19:56 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:19:56 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[3723489d-7015-40c2-bd0f-dea50ffdd8c0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:952c0ad3-7b56-454e-af58-10213195373d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f0b87cf1-91fb-4365-9356-8aab68a15e7e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:19:56 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-377952d4-ba38-4380-afbb-052444672c63 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 16:19:56 user nova-compute[71874]: No targets found.
Apr 12 16:19:56 user nova-compute[71874]: iSNS:
Apr 12 16:19:56 user nova-compute[71874]: No targets found.
Apr 12 16:19:56 user nova-compute[71874]: STATIC:
Apr 12 16:19:56 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:952c0ad3-7b56-454e-af58-10213195373d
Apr 12 16:19:56 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:19:56 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:19:56 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:f0b87cf1-91fb-4365-9356-8aab68a15e7e
Apr 12 16:19:56 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:19:56 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:19:56 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775
Apr 12 16:19:56 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:19:56 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:19:56 user nova-compute[71874]: FIRMWARE:
Apr 12 16:19:56 user nova-compute[71874]: No targets found.
Apr 12 16:19:56 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:19:56 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-377952d4-ba38-4380-afbb-052444672c63 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 16:19:56 user nova-compute[71874]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 16:19:56 user nova-compute[71874]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71874) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 16:19:56 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-377952d4-ba38-4380-afbb-052444672c63 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f0b87cf1-91fb-4365-9356-8aab68a15e7e', 0)] {{(pid=71874) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 16:19:56 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:19:56 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:19:56 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5998cb3-ae0a-4548-a1f0-56385486db78]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:952c0ad3-7b56-454e-af58-10213195373d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f0b87cf1-91fb-4365-9356-8aab68a15e7e\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:19:56 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:19:56 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:19:56 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[44312732-9d77-418d-909b-8e9fe2c3e7c7]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:952c0ad3-7b56-454e-af58-10213195373d (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0b87cf1-91fb-4365-9356-8aab68a15e7e (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:19:56 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-377952d4-ba38-4380-afbb-052444672c63 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775 (non-flash)
Apr 12 16:19:56 user nova-compute[71874]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:952c0ad3-7b56-454e-af58-10213195373d (non-flash)
Apr 12 16:19:56 user nova-compute[71874]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0b87cf1-91fb-4365-9356-8aab68a15e7e (non-flash)
Apr 12 16:19:56 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:19:56 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-377952d4-ba38-4380-afbb-052444672c63 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775 (non-flash)
Apr 12 16:19:56 user nova-compute[71874]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:952c0ad3-7b56-454e-af58-10213195373d (non-flash)
Apr 12 16:19:56 user nova-compute[71874]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0b87cf1-91fb-4365-9356-8aab68a15e7e (non-flash)
Apr 12 16:19:56 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:19:56 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-377952d4-ba38-4380-afbb-052444672c63 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc3c076ec20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f0b87cf1-91fb-4365-9356-8aab68a15e7e'): ({'sdc'}, set())}) {{(pid=71874) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 16:19:56 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-377952d4-ba38-4380-afbb-052444672c63 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Removing single pathed devices sdc {{(pid=71874) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 16:19:56 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:19:56 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:19:56 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[0284c3ae-d1c9-4e9d-8d46-fe0cd22c1628]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:19:56 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:19:56 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:19:56 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[38f013de-cf57-47c3-af24-db916393a1eb]: (4, ('ok\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:19:56 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-377952d4-ba38-4380-afbb-052444672c63 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Flushing IO for device /dev/sdc {{(pid=71874) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 16:19:56 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:19:56 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:19:56 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8f0db23-65b9-4e1c-b1ee-04811683c04b]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:19:56 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-377952d4-ba38-4380-afbb-052444672c63 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71874) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 16:19:56 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:19:56 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.038s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:19:56 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[e71bf48f-badc-4848-8a5f-fd7c9008422a]: (4, ('1', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:19:56 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-377952d4-ba38-4380-afbb-052444672c63 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71874) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 16:19:56 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-377952d4-ba38-4380-afbb-052444672c63 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] SCSI volumes sdc have been removed. {{(pid=71874) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 16:19:56 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-377952d4-ba38-4380-afbb-052444672c63 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f0b87cf1-91fb-4365-9356-8aab68a15e7e')] {{(pid=71874) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 16:19:56 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0b87cf1-91fb-4365-9356-8aab68a15e7e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:19:56 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0b87cf1-91fb-4365-9356-8aab68a15e7e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:19:56 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b3dc462-3f44-4b12-8826-8367cec018f5]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:19:56 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-377952d4-ba38-4380-afbb-052444672c63 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:19:56 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0b87cf1-91fb-4365-9356-8aab68a15e7e -p 172.16.0.220:3260 --logout {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:19:56 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0b87cf1-91fb-4365-9356-8aab68a15e7e -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:19:56 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f87725f-757d-4b0c-a2dd-93c755bc102f]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:f0b87cf1-91fb-4365-9356-8aab68a15e7e, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:f0b87cf1-91fb-4365-9356-8aab68a15e7e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:19:56 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-377952d4-ba38-4380-afbb-052444672c63 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:f0b87cf1-91fb-4365-9356-8aab68a15e7e, portal: 172.16.0.220,3260]
Apr 12 16:19:56 user nova-compute[71874]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:f0b87cf1-91fb-4365-9356-8aab68a15e7e, portal: 172.16.0.220,3260] successful.
Apr 12 16:19:56 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:19:56 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0b87cf1-91fb-4365-9356-8aab68a15e7e -p 172.16.0.220:3260 --op delete {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:19:56 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0b87cf1-91fb-4365-9356-8aab68a15e7e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:19:56 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[88bb2d36-09b1-4cbe-b544-0a75f60b95f7]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:19:56 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-377952d4-ba38-4380-afbb-052444672c63 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:19:56 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-377952d4-ba38-4380-afbb-052444672c63 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.324s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:19:56 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-377952d4-ba38-4380-afbb-052444672c63 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] <== disconnect_volume: return (325ms) None {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:19:56 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-377952d4-ba38-4380-afbb-052444672c63 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] [instance: 540a8fd5-8c18-4efe-97d4-9f0942cebcf5] Disconnected iSCSI Volume {{(pid=71874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 16:19:56 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-8788920f-134f-47f0-979a-8cc5046dfa4a tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Acquiring lock "4190e244-84b1-47b6-813d-9cadb7c65975" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:19:56 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-8788920f-134f-47f0-979a-8cc5046dfa4a tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "4190e244-84b1-47b6-813d-9cadb7c65975" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:19:56 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-8788920f-134f-47f0-979a-8cc5046dfa4a tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Acquiring lock "4190e244-84b1-47b6-813d-9cadb7c65975-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:19:56 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-8788920f-134f-47f0-979a-8cc5046dfa4a tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "4190e244-84b1-47b6-813d-9cadb7c65975-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:19:56 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-8788920f-134f-47f0-979a-8cc5046dfa4a tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "4190e244-84b1-47b6-813d-9cadb7c65975-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:19:56 user nova-compute[71874]: INFO nova.compute.manager [None req-8788920f-134f-47f0-979a-8cc5046dfa4a tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Terminating instance
Apr 12 16:19:56 user nova-compute[71874]: DEBUG nova.compute.manager [None req-8788920f-134f-47f0-979a-8cc5046dfa4a tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Start destroying the instance on the hypervisor. {{(pid=71874) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 16:19:56 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:19:56 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:19:56 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:19:56 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:19:56 user nova-compute[71874]: DEBUG nova.compute.manager [req-08859f6d-2d27-4348-8982-292bf827cec3 req-e03683d1-cc28-4f93-80b3-36be683eae01 service nova] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Received event network-vif-unplugged-eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:19:56 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-08859f6d-2d27-4348-8982-292bf827cec3 req-e03683d1-cc28-4f93-80b3-36be683eae01 service nova] Acquiring lock "4190e244-84b1-47b6-813d-9cadb7c65975-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:19:56 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-08859f6d-2d27-4348-8982-292bf827cec3 req-e03683d1-cc28-4f93-80b3-36be683eae01 service nova] Lock "4190e244-84b1-47b6-813d-9cadb7c65975-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:19:56 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-08859f6d-2d27-4348-8982-292bf827cec3 req-e03683d1-cc28-4f93-80b3-36be683eae01 service nova] Lock "4190e244-84b1-47b6-813d-9cadb7c65975-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:19:56 user nova-compute[71874]: DEBUG nova.compute.manager [req-08859f6d-2d27-4348-8982-292bf827cec3 req-e03683d1-cc28-4f93-80b3-36be683eae01 service nova] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] No waiting events found dispatching network-vif-unplugged-eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:19:56 user nova-compute[71874]: DEBUG nova.compute.manager [req-08859f6d-2d27-4348-8982-292bf827cec3 req-e03683d1-cc28-4f93-80b3-36be683eae01 service nova] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Received event network-vif-unplugged-eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c for instance with task_state deleting. {{(pid=71874) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 16:19:56 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:19:57 user nova-compute[71874]: INFO nova.virt.libvirt.driver [-] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Instance destroyed successfully.
Apr 12 16:19:57 user nova-compute[71874]: DEBUG nova.objects.instance [None req-8788920f-134f-47f0-979a-8cc5046dfa4a tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lazy-loading 'resources' on Instance uuid 4190e244-84b1-47b6-813d-9cadb7c65975 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:19:57 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-8788920f-134f-47f0-979a-8cc5046dfa4a tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T16:10:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1671411109',display_name='tempest-AttachVolumeTestJSON-server-1671411109',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1671411109',id=30,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFG81tsYAjuSLmCBJX5Oy53u6RydBq93WUwqVYUMtou9Wro9aHLYlkjtVGeLCCkr0S7Y24E90tPBrxAk1jNQ+AbkSKQBVRm7+VgL4Rx9C6hm1o9gCqXWuOVCyPnDpz3Eig==',key_name='tempest-keypair-1295229303',keypairs=<?>,launch_index=0,launched_at=2023-04-12T16:10:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7cf4334df004490ba51b4d92ce5408ae',ramdisk_id='',reservation_id='r-sfgohvil',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-178648074',owner_user_name='tempest-AttachVolumeTestJSON-178648074-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T16:18:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2996f6997bb14fc3aec9c3736cc65b8a',uuid=4190e244-84b1-47b6-813d-9cadb7c65975,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c", "address": "fa:16:3e:d0:b5:d4", "network": {"id": "1ef428ff-90e5-4abd-93d0-b7c2c581cb26", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-425924095-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf4334df004490ba51b4d92ce5408ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeab1ea0c-8a", "ovs_interfaceid": "eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 16:19:57 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-8788920f-134f-47f0-979a-8cc5046dfa4a tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Converting VIF {"id": "eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c", "address": "fa:16:3e:d0:b5:d4", "network": {"id": "1ef428ff-90e5-4abd-93d0-b7c2c581cb26", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-425924095-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf4334df004490ba51b4d92ce5408ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeab1ea0c-8a", "ovs_interfaceid": "eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:19:57 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-8788920f-134f-47f0-979a-8cc5046dfa4a tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d0:b5:d4,bridge_name='br-int',has_traffic_filtering=True,id=eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c,network=Network(1ef428ff-90e5-4abd-93d0-b7c2c581cb26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeab1ea0c-8a') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:19:57 user nova-compute[71874]: DEBUG os_vif [None req-8788920f-134f-47f0-979a-8cc5046dfa4a tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d0:b5:d4,bridge_name='br-int',has_traffic_filtering=True,id=eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c,network=Network(1ef428ff-90e5-4abd-93d0-b7c2c581cb26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeab1ea0c-8a') {{(pid=71874) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 16:19:57 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:19:57 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeab1ea0c-8a, bridge=br-int, if_exists=True) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:19:57 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:19:57 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:19:57 user nova-compute[71874]: INFO os_vif [None req-8788920f-134f-47f0-979a-8cc5046dfa4a tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d0:b5:d4,bridge_name='br-int',has_traffic_filtering=True,id=eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c,network=Network(1ef428ff-90e5-4abd-93d0-b7c2c581cb26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeab1ea0c-8a')
Apr 12 16:19:57 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-8788920f-134f-47f0-979a-8cc5046dfa4a tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Deleting instance files /opt/stack/data/nova/instances/4190e244-84b1-47b6-813d-9cadb7c65975_del
Apr 12 16:19:57 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-8788920f-134f-47f0-979a-8cc5046dfa4a tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Deletion of /opt/stack/data/nova/instances/4190e244-84b1-47b6-813d-9cadb7c65975_del complete
Apr 12 16:19:57 user nova-compute[71874]: INFO nova.compute.manager [None req-8788920f-134f-47f0-979a-8cc5046dfa4a tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Took 0.71 seconds to destroy the instance on the hypervisor.
Apr 12 16:19:57 user nova-compute[71874]: DEBUG oslo.service.loopingcall [None req-8788920f-134f-47f0-979a-8cc5046dfa4a tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71874) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 16:19:57 user nova-compute[71874]: DEBUG nova.compute.manager [-] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Deallocating network for instance {{(pid=71874) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 16:19:57 user nova-compute[71874]: DEBUG nova.network.neutron [-] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] deallocate_for_instance() {{(pid=71874) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 16:19:57 user nova-compute[71874]: DEBUG nova.objects.instance [None req-377952d4-ba38-4380-afbb-052444672c63 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lazy-loading 'flavor' on Instance uuid 540a8fd5-8c18-4efe-97d4-9f0942cebcf5 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:19:57 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-377952d4-ba38-4380-afbb-052444672c63 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "540a8fd5-8c18-4efe-97d4-9f0942cebcf5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.891s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:19:58 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:19:58 user nova-compute[71874]: DEBUG nova.network.neutron [-] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Updating instance_info_cache with network_info: [] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:19:58 user nova-compute[71874]: INFO nova.compute.manager [-] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Took 1.37 seconds to deallocate network for instance.
Apr 12 16:19:58 user nova-compute[71874]: DEBUG nova.compute.manager [req-18c4f2e0-773a-4f9b-ab45-f306fd6f6b78 req-8527ed51-55cf-4f2e-bd51-0344eece08c6 service nova] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Received event network-vif-deleted-eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:19:58 user nova-compute[71874]: INFO nova.compute.manager [req-18c4f2e0-773a-4f9b-ab45-f306fd6f6b78 req-8527ed51-55cf-4f2e-bd51-0344eece08c6 service nova] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Neutron deleted interface eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c; detaching it from the instance and deleting it from the info cache
Apr 12 16:19:58 user nova-compute[71874]: DEBUG nova.network.neutron [req-18c4f2e0-773a-4f9b-ab45-f306fd6f6b78 req-8527ed51-55cf-4f2e-bd51-0344eece08c6 service nova] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Updating instance_info_cache with network_info: [] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:19:58 user nova-compute[71874]: DEBUG nova.compute.manager [req-18c4f2e0-773a-4f9b-ab45-f306fd6f6b78 req-8527ed51-55cf-4f2e-bd51-0344eece08c6 service nova] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Detach interface failed, port_id=eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c, reason: Instance 4190e244-84b1-47b6-813d-9cadb7c65975 could not be found. {{(pid=71874) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 12 16:19:58 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-8788920f-134f-47f0-979a-8cc5046dfa4a tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:19:58 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-8788920f-134f-47f0-979a-8cc5046dfa4a tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:19:58 user nova-compute[71874]: DEBUG nova.compute.manager [req-9aefbc21-7287-4341-b800-949963215a2b req-d0e72188-50d2-4408-8341-8d7294a12f4b service nova] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Received event network-vif-plugged-eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:19:58 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-9aefbc21-7287-4341-b800-949963215a2b req-d0e72188-50d2-4408-8341-8d7294a12f4b service nova] Acquiring lock "4190e244-84b1-47b6-813d-9cadb7c65975-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:19:58 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-9aefbc21-7287-4341-b800-949963215a2b req-d0e72188-50d2-4408-8341-8d7294a12f4b service nova] Lock "4190e244-84b1-47b6-813d-9cadb7c65975-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:19:58 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-9aefbc21-7287-4341-b800-949963215a2b req-d0e72188-50d2-4408-8341-8d7294a12f4b service nova] Lock "4190e244-84b1-47b6-813d-9cadb7c65975-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:19:58 user nova-compute[71874]: DEBUG nova.compute.manager [req-9aefbc21-7287-4341-b800-949963215a2b req-d0e72188-50d2-4408-8341-8d7294a12f4b service nova] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] No waiting events found dispatching network-vif-plugged-eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:19:58 user nova-compute[71874]: WARNING nova.compute.manager [req-9aefbc21-7287-4341-b800-949963215a2b req-d0e72188-50d2-4408-8341-8d7294a12f4b service nova] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Received unexpected event network-vif-plugged-eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c for instance with vm_state deleted and task_state None.
Apr 12 16:19:58 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-8788920f-134f-47f0-979a-8cc5046dfa4a tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Inventory has not changed in ProviderTree for provider: 0e94b4c8-cd49-45e4-9133-d36eb4b2456b {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 16:19:58 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-8788920f-134f-47f0-979a-8cc5046dfa4a tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Inventory has not changed for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 16:19:59 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-8788920f-134f-47f0-979a-8cc5046dfa4a tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.310s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:19:59 user nova-compute[71874]: INFO nova.scheduler.client.report [None req-8788920f-134f-47f0-979a-8cc5046dfa4a tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Deleted allocations for instance 4190e244-84b1-47b6-813d-9cadb7c65975
Apr 12 16:19:59 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-8788920f-134f-47f0-979a-8cc5046dfa4a tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "4190e244-84b1-47b6-813d-9cadb7c65975" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.620s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:19:59 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:20:02 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:20:02 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:20:07 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:20:10 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-7b6a2f79-26cd-4754-a92d-3a5e572ad092 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "eb6ec19f-61e7-43af-92d7-44fbf8535d04" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:20:10 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-7b6a2f79-26cd-4754-a92d-3a5e572ad092 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "eb6ec19f-61e7-43af-92d7-44fbf8535d04" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:20:10 user nova-compute[71874]: DEBUG nova.compute.manager [None req-7b6a2f79-26cd-4754-a92d-3a5e572ad092 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: eb6ec19f-61e7-43af-92d7-44fbf8535d04] Starting instance... {{(pid=71874) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 16:20:10 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-7b6a2f79-26cd-4754-a92d-3a5e572ad092 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:20:10 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-7b6a2f79-26cd-4754-a92d-3a5e572ad092 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:20:10 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-7b6a2f79-26cd-4754-a92d-3a5e572ad092 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71874) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 16:20:10 user nova-compute[71874]: INFO nova.compute.claims [None req-7b6a2f79-26cd-4754-a92d-3a5e572ad092 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: eb6ec19f-61e7-43af-92d7-44fbf8535d04] Claim successful on node user
Apr 12 16:20:10 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-7b6a2f79-26cd-4754-a92d-3a5e572ad092 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Inventory has not changed in ProviderTree for provider: 0e94b4c8-cd49-45e4-9133-d36eb4b2456b {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 16:20:10 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-7b6a2f79-26cd-4754-a92d-3a5e572ad092 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Inventory has not changed for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 16:20:10 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-7b6a2f79-26cd-4754-a92d-3a5e572ad092 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.311s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:20:10 user nova-compute[71874]: DEBUG nova.compute.manager [None req-7b6a2f79-26cd-4754-a92d-3a5e572ad092 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: eb6ec19f-61e7-43af-92d7-44fbf8535d04] Start building networks asynchronously for instance. {{(pid=71874) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 16:20:10 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-7b6a2f79-26cd-4754-a92d-3a5e572ad092 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: eb6ec19f-61e7-43af-92d7-44fbf8535d04] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 16:20:10 user nova-compute[71874]: DEBUG nova.compute.manager [None req-7b6a2f79-26cd-4754-a92d-3a5e572ad092 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: eb6ec19f-61e7-43af-92d7-44fbf8535d04] Allocating IP information in the background. {{(pid=71874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 16:20:10 user nova-compute[71874]: DEBUG nova.network.neutron [None req-7b6a2f79-26cd-4754-a92d-3a5e572ad092 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: eb6ec19f-61e7-43af-92d7-44fbf8535d04] allocate_for_instance() {{(pid=71874) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 16:20:10 user nova-compute[71874]: DEBUG nova.compute.manager [None req-7b6a2f79-26cd-4754-a92d-3a5e572ad092 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: eb6ec19f-61e7-43af-92d7-44fbf8535d04] Start building block device mappings for instance. {{(pid=71874) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 16:20:10 user nova-compute[71874]: INFO nova.virt.block_device [None req-7b6a2f79-26cd-4754-a92d-3a5e572ad092 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: eb6ec19f-61e7-43af-92d7-44fbf8535d04] Booting with volume snapshot b3b07d81-9f28-4168-8209-3eaf44f37a1f at /dev/vda
Apr 12 16:20:10 user nova-compute[71874]: DEBUG nova.policy [None req-7b6a2f79-26cd-4754-a92d-3a5e572ad092 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7054687447fc42339e9046ced4915890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b1b89a5eeb408a8d0938e5f59f405f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71874) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 16:20:11 user nova-compute[71874]: DEBUG nova.network.neutron [None req-7b6a2f79-26cd-4754-a92d-3a5e572ad092 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: eb6ec19f-61e7-43af-92d7-44fbf8535d04] Successfully created port: b392629c-5b31-400b-be14-aa168e45f717 {{(pid=71874) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 16:20:12 user nova-compute[71874]: DEBUG nova.network.neutron [None req-7b6a2f79-26cd-4754-a92d-3a5e572ad092 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: eb6ec19f-61e7-43af-92d7-44fbf8535d04] Successfully updated port: b392629c-5b31-400b-be14-aa168e45f717 {{(pid=71874) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 16:20:12 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-7b6a2f79-26cd-4754-a92d-3a5e572ad092 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "refresh_cache-eb6ec19f-61e7-43af-92d7-44fbf8535d04" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:20:12 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-7b6a2f79-26cd-4754-a92d-3a5e572ad092 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquired lock "refresh_cache-eb6ec19f-61e7-43af-92d7-44fbf8535d04" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:20:12 user nova-compute[71874]: DEBUG nova.network.neutron [None req-7b6a2f79-26cd-4754-a92d-3a5e572ad092 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: eb6ec19f-61e7-43af-92d7-44fbf8535d04] Building network info cache for instance {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 16:20:12 user nova-compute[71874]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681316397.146971, 4190e244-84b1-47b6-813d-9cadb7c65975 => Stopped> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:20:12 user nova-compute[71874]: INFO nova.compute.manager [-] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] VM Stopped (Lifecycle Event)
Apr 12 16:20:12 user nova-compute[71874]: DEBUG nova.compute.manager [req-8da40804-9f87-4da0-a77c-fa66e07e3ad1 req-caa125b7-487b-4e7f-be08-27c5ac9578d9 service nova] [instance: eb6ec19f-61e7-43af-92d7-44fbf8535d04] Received event network-changed-b392629c-5b31-400b-be14-aa168e45f717 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:20:12 user nova-compute[71874]: DEBUG nova.compute.manager [req-8da40804-9f87-4da0-a77c-fa66e07e3ad1 req-caa125b7-487b-4e7f-be08-27c5ac9578d9 service nova] [instance: eb6ec19f-61e7-43af-92d7-44fbf8535d04] Refreshing instance network info cache due to event network-changed-b392629c-5b31-400b-be14-aa168e45f717. {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 16:20:12 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-8da40804-9f87-4da0-a77c-fa66e07e3ad1 req-caa125b7-487b-4e7f-be08-27c5ac9578d9 service nova] Acquiring lock "refresh_cache-eb6ec19f-61e7-43af-92d7-44fbf8535d04" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:20:12 user nova-compute[71874]: DEBUG nova.compute.manager [None req-24de7506-e0c5-4372-86b2-58e70cbbe6aa None None] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:20:12 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:20:12 user nova-compute[71874]: DEBUG nova.network.neutron [None req-7b6a2f79-26cd-4754-a92d-3a5e572ad092 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: eb6ec19f-61e7-43af-92d7-44fbf8535d04] Instance cache missing network info. {{(pid=71874) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 16:20:12 user nova-compute[71874]: DEBUG nova.network.neutron [None req-7b6a2f79-26cd-4754-a92d-3a5e572ad092 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: eb6ec19f-61e7-43af-92d7-44fbf8535d04] Updating instance_info_cache with network_info: [{"id": "b392629c-5b31-400b-be14-aa168e45f717", "address": "fa:16:3e:71:a8:aa", "network": {"id": "1439244b-8287-4bba-a88c-99d4b498cccd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1491302639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29b1b89a5eeb408a8d0938e5f59f405f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb392629c-5b", "ovs_interfaceid": "b392629c-5b31-400b-be14-aa168e45f717", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:20:12 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-7b6a2f79-26cd-4754-a92d-3a5e572ad092 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Releasing lock "refresh_cache-eb6ec19f-61e7-43af-92d7-44fbf8535d04" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:20:12 user nova-compute[71874]: DEBUG nova.compute.manager [None req-7b6a2f79-26cd-4754-a92d-3a5e572ad092 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: eb6ec19f-61e7-43af-92d7-44fbf8535d04] Instance network_info: |[{"id": "b392629c-5b31-400b-be14-aa168e45f717", "address": "fa:16:3e:71:a8:aa", "network": {"id": "1439244b-8287-4bba-a88c-99d4b498cccd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1491302639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29b1b89a5eeb408a8d0938e5f59f405f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb392629c-5b", "ovs_interfaceid": "b392629c-5b31-400b-be14-aa168e45f717", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 16:20:12 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-8da40804-9f87-4da0-a77c-fa66e07e3ad1 req-caa125b7-487b-4e7f-be08-27c5ac9578d9 service nova] Acquired lock "refresh_cache-eb6ec19f-61e7-43af-92d7-44fbf8535d04" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:20:12 user nova-compute[71874]: DEBUG nova.network.neutron [req-8da40804-9f87-4da0-a77c-fa66e07e3ad1 req-caa125b7-487b-4e7f-be08-27c5ac9578d9 service nova] [instance: eb6ec19f-61e7-43af-92d7-44fbf8535d04] Refreshing network info cache for port b392629c-5b31-400b-be14-aa168e45f717 {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 16:20:13 user nova-compute[71874]: DEBUG nova.network.neutron [req-8da40804-9f87-4da0-a77c-fa66e07e3ad1 req-caa125b7-487b-4e7f-be08-27c5ac9578d9 service nova] [instance: eb6ec19f-61e7-43af-92d7-44fbf8535d04] Updated VIF entry in instance network info cache for port b392629c-5b31-400b-be14-aa168e45f717. {{(pid=71874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 16:20:13 user nova-compute[71874]: DEBUG nova.network.neutron [req-8da40804-9f87-4da0-a77c-fa66e07e3ad1 req-caa125b7-487b-4e7f-be08-27c5ac9578d9 service nova] [instance: eb6ec19f-61e7-43af-92d7-44fbf8535d04] Updating instance_info_cache with network_info: [{"id": "b392629c-5b31-400b-be14-aa168e45f717", "address": "fa:16:3e:71:a8:aa", "network": {"id": "1439244b-8287-4bba-a88c-99d4b498cccd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1491302639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29b1b89a5eeb408a8d0938e5f59f405f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb392629c-5b", "ovs_interfaceid": "b392629c-5b31-400b-be14-aa168e45f717", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:20:13 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-8da40804-9f87-4da0-a77c-fa66e07e3ad1 req-caa125b7-487b-4e7f-be08-27c5ac9578d9 service nova] Releasing lock "refresh_cache-eb6ec19f-61e7-43af-92d7-44fbf8535d04" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:20:16 user nova-compute[71874]: DEBUG os_brick.utils [None req-7b6a2f79-26cd-4754-a92d-3a5e572ad092 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:20:16 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:20:16 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:20:16 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ee212db-458b-4705-9344-cc075d6afe16]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:61a48d4489d2\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:20:16 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:20:16 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.014s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:20:16 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[eada480c-d838-4986-b520-c03e2d6583ac]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:20:16 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:20:16 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:20:16 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[30446fd3-152b-4109-8cb3-33764eca1da5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:20:16 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[276c05fc-7eb5-4cfe-94db-40f88063bc61]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:20:16 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-7b6a2f79-26cd-4754-a92d-3a5e572ad092 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Running cmd (subprocess): nvme version {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:20:16 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-7b6a2f79-26cd-4754-a92d-3a5e572ad092 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] 'nvme version' failed. Not Retrying. {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 16:20:16 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7b6a2f79-26cd-4754-a92d-3a5e572ad092 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] nvme not present on system {{(pid=71874) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 16:20:16 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:20:16 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 16:20:16 user nova-compute[71874]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 16:20:16 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eb21a62-d6f0-4fde-bd61-2b7cab667510]: (4, '') {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:20:16 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.lightos [None req-7b6a2f79-26cd-4754-a92d-3a5e572ad092 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71874) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 16:20:16 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.lightos [None req-7b6a2f79-26cd-4754-a92d-3a5e572ad092 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71874) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 16:20:16 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.lightos [None req-7b6a2f79-26cd-4754-a92d-3a5e572ad092 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] LIGHTOS: no hostnqn found. {{(pid=71874) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 16:20:16 user nova-compute[71874]: DEBUG os_brick.utils [None req-7b6a2f79-26cd-4754-a92d-3a5e572ad092 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:61a48d4489d2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:20:16 user nova-compute[71874]: DEBUG nova.virt.block_device [None req-7b6a2f79-26cd-4754-a92d-3a5e572ad092 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: eb6ec19f-61e7-43af-92d7-44fbf8535d04] Updating existing volume attachment record: a36931c4-98c8-45bb-bee7-bd47f36ca713 {{(pid=71874) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 16:20:17 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:20:21 user nova-compute[71874]: DEBUG nova.compute.manager [None req-7b6a2f79-26cd-4754-a92d-3a5e572ad092 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: eb6ec19f-61e7-43af-92d7-44fbf8535d04] Start spawning the instance on the hypervisor. {{(pid=71874) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 16:20:21 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-7b6a2f79-26cd-4754-a92d-3a5e572ad092 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: eb6ec19f-61e7-43af-92d7-44fbf8535d04] Creating instance directory {{(pid=71874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 16:20:21 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-7b6a2f79-26cd-4754-a92d-3a5e572ad092 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: eb6ec19f-61e7-43af-92d7-44fbf8535d04] Creating image(s)
Apr 12 16:20:21 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-7b6a2f79-26cd-4754-a92d-3a5e572ad092 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: eb6ec19f-61e7-43af-92d7-44fbf8535d04] Did not create local disks {{(pid=71874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 12 16:20:21 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-7b6a2f79-26cd-4754-a92d-3a5e572ad092 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: eb6ec19f-61e7-43af-92d7-44fbf8535d04] Ensure instance console log exists: /opt/stack/data/nova/instances/eb6ec19f-61e7-43af-92d7-44fbf8535d04/console.log {{(pid=71874) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 16:20:21 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-7b6a2f79-26cd-4754-a92d-3a5e572ad092 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:20:21 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-7b6a2f79-26cd-4754-a92d-3a5e572ad092 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:20:21 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-7b6a2f79-26cd-4754-a92d-3a5e572ad092 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:20:21 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-7b6a2f79-26cd-4754-a92d-3a5e572ad092 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: eb6ec19f-61e7-43af-92d7-44fbf8535d04] Start _get_guest_xml network_info=[{"id": "b392629c-5b31-400b-be14-aa168e45f717", "address": "fa:16:3e:71:a8:aa", "network": {"id": "1439244b-8287-4bba-a88c-99d4b498cccd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1491302639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29b1b89a5eeb408a8d0938e5f59f405f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb392629c-5b", "ovs_interfaceid": "b392629c-5b31-400b-be14-aa168e45f717", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-04-12T16:20:07Z,direct_url=<?>,disk_format='qcow2',id=85e3d4b3-113c-46c2-9365-bfa680ff8338,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1169753440',owner='29b1b89a5eeb408a8d0938e5f59f405f',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-04-12T16:20:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'delete_on_termination': True, 'attachment_id': 'a36931c4-98c8-45bb-bee7-bd47f36ca713', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f1a40711-37cc-48c3-9696-d6d52670932c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PIWcQZAN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'eb6ec19f-61e7-43af-92d7-44fbf8535d04', 'attached_at': '', 'detached_at': '', 'volume_id': 'f1a40711-37cc-48c3-9696-d6d52670932c', 'serial': 'f1a40711-37cc-48c3-9696-d6d52670932c'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'volume_type': None} {{(pid=71874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 16:20:21 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-7b6a2f79-26cd-4754-a92d-3a5e572ad092 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:20:21 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-7b6a2f79-26cd-4754-a92d-3a5e572ad092 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:20:21 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-7b6a2f79-26cd-4754-a92d-3a5e572ad092 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71874) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 16:20:21 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-7b6a2f79-26cd-4754-a92d-3a5e572ad092 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T15:56:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-04-12T16:20:07Z,direct_url=<?>,disk_format='qcow2',id=85e3d4b3-113c-46c2-9365-bfa680ff8338,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1169753440',owner='29b1b89a5eeb408a8d0938e5f59f405f',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-04-12T16:20:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 16:20:21 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-7b6a2f79-26cd-4754-a92d-3a5e572ad092 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Flavor limits 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 16:20:21 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-7b6a2f79-26cd-4754-a92d-3a5e572ad092 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Image limits 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 16:20:21 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-7b6a2f79-26cd-4754-a92d-3a5e572ad092 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Flavor pref 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 16:20:21 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-7b6a2f79-26cd-4754-a92d-3a5e572ad092 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Image pref 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 16:20:21 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-7b6a2f79-26cd-4754-a92d-3a5e572ad092 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 16:20:21 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-7b6a2f79-26cd-4754-a92d-3a5e572ad092 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 16:20:21 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-7b6a2f79-26cd-4754-a92d-3a5e572ad092 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 16:20:21 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-7b6a2f79-26cd-4754-a92d-3a5e572ad092 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Got 1 possible topologies {{(pid=71874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 16:20:21 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-7b6a2f79-26cd-4754-a92d-3a5e572ad092 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 16:20:21 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-7b6a2f79-26cd-4754-a92d-3a5e572ad092 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 16:20:21 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b6a2f79-26cd-4754-a92d-3a5e572ad092 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: eb6ec19f-61e7-43af-92d7-44fbf8535d04] Calling os-brick to attach iSCSI Volume {{(pid=71874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 16:20:21 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b6a2f79-26cd-4754-a92d-3a5e572ad092 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3c0216320>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f1a40711-37cc-48c3-9696-d6d52670932c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PIWcQZAN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:20:21 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-7b6a2f79-26cd-4754-a92d-3a5e572ad092 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:20:21 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-7b6a2f79-26cd-4754-a92d-3a5e572ad092 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:20:21 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-7b6a2f79-26cd-4754-a92d-3a5e572ad092 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:20:21 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-7b6a2f79-26cd-4754-a92d-3a5e572ad092 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:20:21 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-7b6a2f79-26cd-4754-a92d-3a5e572ad092 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f1a40711-37cc-48c3-9696-d6d52670932c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:20:21 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-7b6a2f79-26cd-4754-a92d-3a5e572ad092 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f1a40711-37cc-48c3-9696-d6d52670932c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:20:21 user nova-compute[71874]: INFO os_brick.initiator.connectors.iscsi [None req-7b6a2f79-26cd-4754-a92d-3a5e572ad092 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 16:20:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1a40711-37cc-48c3-9696-d6d52670932c -p 172.16.0.220:3260 {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:20:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1a40711-37cc-48c3-9696-d6d52670932c -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:20:21 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[44b0626d-d75d-4298-8ed8-72baa94d681a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:20:21 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b6a2f79-26cd-4754-a92d-3a5e572ad092 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 16:20:21 user nova-compute[71874]:  {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:20:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1a40711-37cc-48c3-9696-d6d52670932c -p 172.16.0.220:3260 --interface default --op new {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:20:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1a40711-37cc-48c3-9696-d6d52670932c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:20:21 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[eae19dee-fa69-4d26-ab9e-e4c6be1bbc22]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f1a40711-37cc-48c3-9696-d6d52670932c] added\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:20:21 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b6a2f79-26cd-4754-a92d-3a5e572ad092 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f1a40711-37cc-48c3-9696-d6d52670932c] added
Apr 12 16:20:21 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:20:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1a40711-37cc-48c3-9696-d6d52670932c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:20:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1a40711-37cc-48c3-9696-d6d52670932c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:20:21 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[b75e9c7b-fd58-463c-a70b-e41ed9d3fd2f]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:20:21 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b6a2f79-26cd-4754-a92d-3a5e572ad092 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:20:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1a40711-37cc-48c3-9696-d6d52670932c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:20:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1a40711-37cc-48c3-9696-d6d52670932c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:20:21 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[f73130f8-3988-4197-ac30-d04f7129fa6a]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:20:21 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b6a2f79-26cd-4754-a92d-3a5e572ad092 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:20:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1a40711-37cc-48c3-9696-d6d52670932c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PIWcQZAN {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:20:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1a40711-37cc-48c3-9696-d6d52670932c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PIWcQZAN" returned: 0 in 0.025s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:20:21 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a7deb34-caf1-4318-a4f6-dcb89005849b]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:20:21 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b6a2f79-26cd-4754-a92d-3a5e572ad092 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PIWcQZAN'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:20:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1a40711-37cc-48c3-9696-d6d52670932c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:20:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1a40711-37cc-48c3-9696-d6d52670932c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:20:21 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[d47d4c11-cb90-4b86-bd6d-9e4cda35bde0]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:20:21 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b6a2f79-26cd-4754-a92d-3a5e572ad092 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:20:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:20:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:20:21 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[39af70a4-ecff-4df4-8ffb-2a96a1a25a87]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:952c0ad3-7b56-454e-af58-10213195373d (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:20:21 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b6a2f79-26cd-4754-a92d-3a5e572ad092 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775 (non-flash)
Apr 12 16:20:21 user nova-compute[71874]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:952c0ad3-7b56-454e-af58-10213195373d (non-flash)
Apr 12 16:20:21 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:20:21 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b6a2f79-26cd-4754-a92d-3a5e572ad092 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775 (non-flash)
Apr 12 16:20:21 user nova-compute[71874]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:952c0ad3-7b56-454e-af58-10213195373d (non-flash)
Apr 12 16:20:21 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:20:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1a40711-37cc-48c3-9696-d6d52670932c -p 172.16.0.220:3260 --login {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:20:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1a40711-37cc-48c3-9696-d6d52670932c -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:20:21 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[098cd757-1ef7-417f-bada-10f751a9e94d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f1a40711-37cc-48c3-9696-d6d52670932c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f1a40711-37cc-48c3-9696-d6d52670932c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:20:21 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b6a2f79-26cd-4754-a92d-3a5e572ad092 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f1a40711-37cc-48c3-9696-d6d52670932c, portal: 172.16.0.220,3260]
Apr 12 16:20:21 user nova-compute[71874]: Login to [iface: default, target: iqn.2010-10.org.openstack:f1a40711-37cc-48c3-9696-d6d52670932c, portal: 172.16.0.220,3260] successful.
Apr 12 16:20:21 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:20:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1a40711-37cc-48c3-9696-d6d52670932c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:20:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1a40711-37cc-48c3-9696-d6d52670932c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:20:21 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[697e3a33-9618-4db1-8662-dde61401cbe2]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:20:21 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b6a2f79-26cd-4754-a92d-3a5e572ad092 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:20:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:20:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:20:21 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3cec6c0-cc1e-4e0d-bfa2-52e7de0a8038]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:952c0ad3-7b56-454e-af58-10213195373d (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1a40711-37cc-48c3-9696-d6d52670932c (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:20:21 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b6a2f79-26cd-4754-a92d-3a5e572ad092 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775 (non-flash)
Apr 12 16:20:21 user nova-compute[71874]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:952c0ad3-7b56-454e-af58-10213195373d (non-flash)
Apr 12 16:20:21 user nova-compute[71874]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1a40711-37cc-48c3-9696-d6d52670932c (non-flash)
Apr 12 16:20:21 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:20:21 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b6a2f79-26cd-4754-a92d-3a5e572ad092 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775 (non-flash)
Apr 12 16:20:21 user nova-compute[71874]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:952c0ad3-7b56-454e-af58-10213195373d (non-flash)
Apr 12 16:20:21 user nova-compute[71874]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1a40711-37cc-48c3-9696-d6d52670932c (non-flash)
Apr 12 16:20:21 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:20:21 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-7b6a2f79-26cd-4754-a92d-3a5e572ad092 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f1a40711-37cc-48c3-9696-d6d52670932c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.282s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:20:21 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b6a2f79-26cd-4754-a92d-3a5e572ad092 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Connected to 172.16.0.220:3260 {{(pid=71874) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 16:20:21 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-7b6a2f79-26cd-4754-a92d-3a5e572ad092 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] HCTL ('34', '-', '-', 0) found on session 46 with lun 0 {{(pid=71874) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 16:20:21 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-7b6a2f79-26cd-4754-a92d-3a5e572ad092 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71874) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 16:20:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:20:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:20:21 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[18a405ab-4708-4824-894c-0c3300a91fdb]: (4, ('- - 0', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:20:21 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-7b6a2f79-26cd-4754-a92d-3a5e572ad092 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Searching for a device in session 46 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71874) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 16:20:21 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b6a2f79-26cd-4754-a92d-3a5e572ad092 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:f1a40711-37cc-48c3-9696-d6d52670932c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PIWcQZAN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71874) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 16:20:22 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:20:22 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-7b6a2f79-26cd-4754-a92d-3a5e572ad092 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.313s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:20:22 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b6a2f79-26cd-4754-a92d-3a5e572ad092 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] <== connect_volume: return (1315ms) {'type': 'block', 'scsi_wwn': '23539636536643461', 'path': '/dev/sdc'} {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:20:22 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b6a2f79-26cd-4754-a92d-3a5e572ad092 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: eb6ec19f-61e7-43af-92d7-44fbf8535d04] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23539636536643461', 'path': '/dev/sdc'} {{(pid=71874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 16:20:22 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-7b6a2f79-26cd-4754-a92d-3a5e572ad092 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T16:20:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1807466168',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1807466168',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1807466168',id=40,image_ref='85e3d4b3-113c-46c2-9365-bfa680ff8338',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='29b1b89a5eeb408a8d0938e5f59f405f',ramdisk_id='',reservation_id='r-h5ug49mp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-734600841',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-734600841-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-734600841',owner_user_name='tempest-TestVolumeBootPattern-734600841-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T16:20:11Z,user_data=None,user_id='7054687447fc42339e9046ced4915890',uuid=eb6ec19f-61e7-43af-92d7-44fbf8535d04,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b392629c-5b31-400b-be14-aa168e45f717", "address": "fa:16:3e:71:a8:aa", "network": {"id": "1439244b-8287-4bba-a88c-99d4b498cccd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1491302639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29b1b89a5eeb408a8d0938e5f59f405f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb392629c-5b", "ovs_interfaceid": "b392629c-5b31-400b-be14-aa168e45f717", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 16:20:22 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-7b6a2f79-26cd-4754-a92d-3a5e572ad092 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Converting VIF {"id": "b392629c-5b31-400b-be14-aa168e45f717", "address": "fa:16:3e:71:a8:aa", "network": {"id": "1439244b-8287-4bba-a88c-99d4b498cccd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1491302639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29b1b89a5eeb408a8d0938e5f59f405f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb392629c-5b", "ovs_interfaceid": "b392629c-5b31-400b-be14-aa168e45f717", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:20:22 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-7b6a2f79-26cd-4754-a92d-3a5e572ad092 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:a8:aa,bridge_name='br-int',has_traffic_filtering=True,id=b392629c-5b31-400b-be14-aa168e45f717,network=Network(1439244b-8287-4bba-a88c-99d4b498cccd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb392629c-5b') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:20:22 user nova-compute[71874]: DEBUG nova.objects.instance [None req-7b6a2f79-26cd-4754-a92d-3a5e572ad092 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lazy-loading 'pci_devices' on Instance uuid eb6ec19f-61e7-43af-92d7-44fbf8535d04 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:20:22 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-7b6a2f79-26cd-4754-a92d-3a5e572ad092 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: eb6ec19f-61e7-43af-92d7-44fbf8535d04] End _get_guest_xml xml=<domain type="kvm">
Apr 12 16:20:22 user nova-compute[71874]:   <uuid>eb6ec19f-61e7-43af-92d7-44fbf8535d04</uuid>
Apr 12 16:20:22 user nova-compute[71874]:   <name>instance-00000028</name>
Apr 12 16:20:22 user nova-compute[71874]:   <memory>131072</memory>
Apr 12 16:20:22 user nova-compute[71874]:   <vcpu>1</vcpu>
Apr 12 16:20:22 user nova-compute[71874]:   <metadata>
Apr 12 16:20:22 user nova-compute[71874]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 16:20:22 user nova-compute[71874]:       <nova:package version="0.0.0"/>
Apr 12 16:20:22 user nova-compute[71874]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1807466168</nova:name>
Apr 12 16:20:22 user nova-compute[71874]:       <nova:creationTime>2023-04-12 16:20:21</nova:creationTime>
Apr 12 16:20:22 user nova-compute[71874]:       <nova:flavor name="m1.nano">
Apr 12 16:20:22 user nova-compute[71874]:         <nova:memory>128</nova:memory>
Apr 12 16:20:22 user nova-compute[71874]:         <nova:disk>1</nova:disk>
Apr 12 16:20:22 user nova-compute[71874]:         <nova:swap>0</nova:swap>
Apr 12 16:20:22 user nova-compute[71874]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 16:20:22 user nova-compute[71874]:         <nova:vcpus>1</nova:vcpus>
Apr 12 16:20:22 user nova-compute[71874]:       </nova:flavor>
Apr 12 16:20:22 user nova-compute[71874]:       <nova:owner>
Apr 12 16:20:22 user nova-compute[71874]:         <nova:user uuid="7054687447fc42339e9046ced4915890">tempest-TestVolumeBootPattern-734600841-project-member</nova:user>
Apr 12 16:20:22 user nova-compute[71874]:         <nova:project uuid="29b1b89a5eeb408a8d0938e5f59f405f">tempest-TestVolumeBootPattern-734600841</nova:project>
Apr 12 16:20:22 user nova-compute[71874]:       </nova:owner>
Apr 12 16:20:22 user nova-compute[71874]:       <nova:root type="image" uuid="85e3d4b3-113c-46c2-9365-bfa680ff8338"/>
Apr 12 16:20:22 user nova-compute[71874]:       <nova:ports>
Apr 12 16:20:22 user nova-compute[71874]:         <nova:port uuid="b392629c-5b31-400b-be14-aa168e45f717">
Apr 12 16:20:22 user nova-compute[71874]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 12 16:20:22 user nova-compute[71874]:         </nova:port>
Apr 12 16:20:22 user nova-compute[71874]:       </nova:ports>
Apr 12 16:20:22 user nova-compute[71874]:     </nova:instance>
Apr 12 16:20:22 user nova-compute[71874]:   </metadata>
Apr 12 16:20:22 user nova-compute[71874]:   <sysinfo type="smbios">
Apr 12 16:20:22 user nova-compute[71874]:     <system>
Apr 12 16:20:22 user nova-compute[71874]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 16:20:22 user nova-compute[71874]:       <entry name="product">OpenStack Nova</entry>
Apr 12 16:20:22 user nova-compute[71874]:       <entry name="version">0.0.0</entry>
Apr 12 16:20:22 user nova-compute[71874]:       <entry name="serial">eb6ec19f-61e7-43af-92d7-44fbf8535d04</entry>
Apr 12 16:20:22 user nova-compute[71874]:       <entry name="uuid">eb6ec19f-61e7-43af-92d7-44fbf8535d04</entry>
Apr 12 16:20:22 user nova-compute[71874]:       <entry name="family">Virtual Machine</entry>
Apr 12 16:20:22 user nova-compute[71874]:     </system>
Apr 12 16:20:22 user nova-compute[71874]:   </sysinfo>
Apr 12 16:20:22 user nova-compute[71874]:   <os>
Apr 12 16:20:22 user nova-compute[71874]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 16:20:22 user nova-compute[71874]:     <boot dev="hd"/>
Apr 12 16:20:22 user nova-compute[71874]:     <smbios mode="sysinfo"/>
Apr 12 16:20:22 user nova-compute[71874]:   </os>
Apr 12 16:20:22 user nova-compute[71874]:   <features>
Apr 12 16:20:22 user nova-compute[71874]:     <acpi/>
Apr 12 16:20:22 user nova-compute[71874]:     <apic/>
Apr 12 16:20:22 user nova-compute[71874]:     <vmcoreinfo/>
Apr 12 16:20:22 user nova-compute[71874]:   </features>
Apr 12 16:20:22 user nova-compute[71874]:   <clock offset="utc">
Apr 12 16:20:22 user nova-compute[71874]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 16:20:22 user nova-compute[71874]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 16:20:22 user nova-compute[71874]:     <timer name="hpet" present="no"/>
Apr 12 16:20:22 user nova-compute[71874]:   </clock>
Apr 12 16:20:22 user nova-compute[71874]:   <cpu mode="custom" match="exact">
Apr 12 16:20:22 user nova-compute[71874]:     <model>Nehalem</model>
Apr 12 16:20:22 user nova-compute[71874]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 16:20:22 user nova-compute[71874]:   </cpu>
Apr 12 16:20:22 user nova-compute[71874]:   <devices>
Apr 12 16:20:22 user nova-compute[71874]:     <disk type="block" device="disk">
Apr 12 16:20:22 user nova-compute[71874]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 16:20:22 user nova-compute[71874]:       <source dev="/dev/sdc"/>
Apr 12 16:20:22 user nova-compute[71874]:       <target dev="vda" bus="virtio"/>
Apr 12 16:20:22 user nova-compute[71874]:       <serial>f1a40711-37cc-48c3-9696-d6d52670932c</serial>
Apr 12 16:20:22 user nova-compute[71874]:     </disk>
Apr 12 16:20:22 user nova-compute[71874]:     <interface type="ethernet">
Apr 12 16:20:22 user nova-compute[71874]:       <mac address="fa:16:3e:71:a8:aa"/>
Apr 12 16:20:22 user nova-compute[71874]:       <model type="virtio"/>
Apr 12 16:20:22 user nova-compute[71874]:       <mtu size="1442"/>
Apr 12 16:20:22 user nova-compute[71874]:       <target dev="tapb392629c-5b"/>
Apr 12 16:20:22 user nova-compute[71874]:     </interface>
Apr 12 16:20:22 user nova-compute[71874]:     <serial type="pty">
Apr 12 16:20:22 user nova-compute[71874]:       <log file="/opt/stack/data/nova/instances/eb6ec19f-61e7-43af-92d7-44fbf8535d04/console.log" append="off"/>
Apr 12 16:20:22 user nova-compute[71874]:     </serial>
Apr 12 16:20:22 user nova-compute[71874]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 16:20:22 user nova-compute[71874]:     <video>
Apr 12 16:20:22 user nova-compute[71874]:       <model type="virtio"/>
Apr 12 16:20:22 user nova-compute[71874]:     </video>
Apr 12 16:20:22 user nova-compute[71874]:     <rng model="virtio">
Apr 12 16:20:22 user nova-compute[71874]:       <backend model="random">/dev/urandom</backend>
Apr 12 16:20:22 user nova-compute[71874]:     </rng>
Apr 12 16:20:22 user nova-compute[71874]:     <controller type="usb" index="0" model="none"/>
Apr 12 16:20:22 user nova-compute[71874]:     <memballoon model="virtio">
Apr 12 16:20:22 user nova-compute[71874]:       <stats period="10"/>
Apr 12 16:20:22 user nova-compute[71874]:     </memballoon>
Apr 12 16:20:22 user nova-compute[71874]:   </devices>
Apr 12 16:20:22 user nova-compute[71874]: </domain>
Apr 12 16:20:22 user nova-compute[71874]:  {{(pid=71874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 16:20:22 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-7b6a2f79-26cd-4754-a92d-3a5e572ad092 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T16:20:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1807466168',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1807466168',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1807466168',id=40,image_ref='85e3d4b3-113c-46c2-9365-bfa680ff8338',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='29b1b89a5eeb408a8d0938e5f59f405f',ramdisk_id='',reservation_id='r-h5ug49mp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-734600841',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-734600841-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-734600841',owner_user_name='tempest-TestVolumeBootPattern-734600841-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T16:20:11Z,user_data=None,user_id='7054687447fc42339e9046ced4915890',uuid=eb6ec19f-61e7-43af-92d7-44fbf8535d04,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b392629c-5b31-400b-be14-aa168e45f717", "address": "fa:16:3e:71:a8:aa", "network": {"id": "1439244b-8287-4bba-a88c-99d4b498cccd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1491302639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29b1b89a5eeb408a8d0938e5f59f405f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb392629c-5b", "ovs_interfaceid": "b392629c-5b31-400b-be14-aa168e45f717", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 16:20:22 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-7b6a2f79-26cd-4754-a92d-3a5e572ad092 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Converting VIF {"id": "b392629c-5b31-400b-be14-aa168e45f717", "address": "fa:16:3e:71:a8:aa", "network": {"id": "1439244b-8287-4bba-a88c-99d4b498cccd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1491302639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29b1b89a5eeb408a8d0938e5f59f405f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb392629c-5b", "ovs_interfaceid": "b392629c-5b31-400b-be14-aa168e45f717", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:20:22 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-7b6a2f79-26cd-4754-a92d-3a5e572ad092 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:a8:aa,bridge_name='br-int',has_traffic_filtering=True,id=b392629c-5b31-400b-be14-aa168e45f717,network=Network(1439244b-8287-4bba-a88c-99d4b498cccd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb392629c-5b') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:20:22 user nova-compute[71874]: DEBUG os_vif [None req-7b6a2f79-26cd-4754-a92d-3a5e572ad092 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:a8:aa,bridge_name='br-int',has_traffic_filtering=True,id=b392629c-5b31-400b-be14-aa168e45f717,network=Network(1439244b-8287-4bba-a88c-99d4b498cccd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb392629c-5b') {{(pid=71874) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 16:20:22 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:20:22 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:20:22 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 16:20:22 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:20:22 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb392629c-5b, may_exist=True) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:20:22 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb392629c-5b, col_values=(('external_ids', {'iface-id': 'b392629c-5b31-400b-be14-aa168e45f717', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:71:a8:aa', 'vm-uuid': 'eb6ec19f-61e7-43af-92d7-44fbf8535d04'}),)) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:20:22 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:20:22 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:20:22 user nova-compute[71874]: INFO os_vif [None req-7b6a2f79-26cd-4754-a92d-3a5e572ad092 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:a8:aa,bridge_name='br-int',has_traffic_filtering=True,id=b392629c-5b31-400b-be14-aa168e45f717,network=Network(1439244b-8287-4bba-a88c-99d4b498cccd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb392629c-5b')
Apr 12 16:20:22 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-7b6a2f79-26cd-4754-a92d-3a5e572ad092 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] No BDM found with device name vda, not building metadata. {{(pid=71874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 16:20:22 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-7b6a2f79-26cd-4754-a92d-3a5e572ad092 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] No VIF found with MAC fa:16:3e:71:a8:aa, not building metadata {{(pid=71874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 16:20:23 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:20:24 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:20:24 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:20:24 user nova-compute[71874]: DEBUG nova.compute.manager [req-f67d2611-4495-4e20-8a63-500d672fe1d0 req-e6ca222a-9324-42dd-bbe5-ab6a44ad49db service nova] [instance: eb6ec19f-61e7-43af-92d7-44fbf8535d04] Received event network-vif-plugged-b392629c-5b31-400b-be14-aa168e45f717 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:20:24 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-f67d2611-4495-4e20-8a63-500d672fe1d0 req-e6ca222a-9324-42dd-bbe5-ab6a44ad49db service nova] Acquiring lock "eb6ec19f-61e7-43af-92d7-44fbf8535d04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:20:24 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-f67d2611-4495-4e20-8a63-500d672fe1d0 req-e6ca222a-9324-42dd-bbe5-ab6a44ad49db service nova] Lock "eb6ec19f-61e7-43af-92d7-44fbf8535d04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:20:24 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-f67d2611-4495-4e20-8a63-500d672fe1d0 req-e6ca222a-9324-42dd-bbe5-ab6a44ad49db service nova] Lock "eb6ec19f-61e7-43af-92d7-44fbf8535d04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:20:24 user nova-compute[71874]: DEBUG nova.compute.manager [req-f67d2611-4495-4e20-8a63-500d672fe1d0 req-e6ca222a-9324-42dd-bbe5-ab6a44ad49db service nova] [instance: eb6ec19f-61e7-43af-92d7-44fbf8535d04] No waiting events found dispatching network-vif-plugged-b392629c-5b31-400b-be14-aa168e45f717 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:20:24 user nova-compute[71874]: WARNING nova.compute.manager [req-f67d2611-4495-4e20-8a63-500d672fe1d0 req-e6ca222a-9324-42dd-bbe5-ab6a44ad49db service nova] [instance: eb6ec19f-61e7-43af-92d7-44fbf8535d04] Received unexpected event network-vif-plugged-b392629c-5b31-400b-be14-aa168e45f717 for instance with vm_state building and task_state spawning.
Apr 12 16:20:24 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:20:24 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:20:24 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Cleaning up deleted instances {{(pid=71874) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 12 16:20:24 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] There are 0 instances to clean {{(pid=71874) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 12 16:20:26 user nova-compute[71874]: DEBUG nova.virt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Emitting event <LifecycleEvent: 1681316426.2434487, eb6ec19f-61e7-43af-92d7-44fbf8535d04 => Resumed> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:20:26 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: eb6ec19f-61e7-43af-92d7-44fbf8535d04] VM Resumed (Lifecycle Event)
Apr 12 16:20:26 user nova-compute[71874]: DEBUG nova.compute.manager [None req-7b6a2f79-26cd-4754-a92d-3a5e572ad092 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: eb6ec19f-61e7-43af-92d7-44fbf8535d04] Instance event wait completed in 0 seconds for  {{(pid=71874) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 16:20:26 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-7b6a2f79-26cd-4754-a92d-3a5e572ad092 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: eb6ec19f-61e7-43af-92d7-44fbf8535d04] Guest created on hypervisor {{(pid=71874) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 16:20:26 user nova-compute[71874]: INFO nova.virt.libvirt.driver [-] [instance: eb6ec19f-61e7-43af-92d7-44fbf8535d04] Instance spawned successfully.
Apr 12 16:20:26 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-7b6a2f79-26cd-4754-a92d-3a5e572ad092 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: eb6ec19f-61e7-43af-92d7-44fbf8535d04] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 16:20:26 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-7b6a2f79-26cd-4754-a92d-3a5e572ad092 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: eb6ec19f-61e7-43af-92d7-44fbf8535d04] Found default for hw_input_bus of None {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:20:26 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-7b6a2f79-26cd-4754-a92d-3a5e572ad092 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: eb6ec19f-61e7-43af-92d7-44fbf8535d04] Found default for hw_pointer_model of None {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:20:26 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: eb6ec19f-61e7-43af-92d7-44fbf8535d04] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:20:26 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: eb6ec19f-61e7-43af-92d7-44fbf8535d04] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 16:20:26 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: eb6ec19f-61e7-43af-92d7-44fbf8535d04] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 16:20:26 user nova-compute[71874]: DEBUG nova.virt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Emitting event <LifecycleEvent: 1681316426.249651, eb6ec19f-61e7-43af-92d7-44fbf8535d04 => Started> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:20:26 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: eb6ec19f-61e7-43af-92d7-44fbf8535d04] VM Started (Lifecycle Event)
Apr 12 16:20:26 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: eb6ec19f-61e7-43af-92d7-44fbf8535d04] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:20:26 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: eb6ec19f-61e7-43af-92d7-44fbf8535d04] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 16:20:26 user nova-compute[71874]: DEBUG nova.compute.manager [req-5b880a91-6d60-4cd6-9ffa-9bd48202f1f6 req-93d6f4f6-8317-4da1-b260-3a06c071adff service nova] [instance: eb6ec19f-61e7-43af-92d7-44fbf8535d04] Received event network-vif-plugged-b392629c-5b31-400b-be14-aa168e45f717 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:20:26 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-5b880a91-6d60-4cd6-9ffa-9bd48202f1f6 req-93d6f4f6-8317-4da1-b260-3a06c071adff service nova] Acquiring lock "eb6ec19f-61e7-43af-92d7-44fbf8535d04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:20:26 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-5b880a91-6d60-4cd6-9ffa-9bd48202f1f6 req-93d6f4f6-8317-4da1-b260-3a06c071adff service nova] Lock "eb6ec19f-61e7-43af-92d7-44fbf8535d04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:20:26 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-5b880a91-6d60-4cd6-9ffa-9bd48202f1f6 req-93d6f4f6-8317-4da1-b260-3a06c071adff service nova] Lock "eb6ec19f-61e7-43af-92d7-44fbf8535d04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:20:26 user nova-compute[71874]: DEBUG nova.compute.manager [req-5b880a91-6d60-4cd6-9ffa-9bd48202f1f6 req-93d6f4f6-8317-4da1-b260-3a06c071adff service nova] [instance: eb6ec19f-61e7-43af-92d7-44fbf8535d04] No waiting events found dispatching network-vif-plugged-b392629c-5b31-400b-be14-aa168e45f717 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:20:26 user nova-compute[71874]: WARNING nova.compute.manager [req-5b880a91-6d60-4cd6-9ffa-9bd48202f1f6 req-93d6f4f6-8317-4da1-b260-3a06c071adff service nova] [instance: eb6ec19f-61e7-43af-92d7-44fbf8535d04] Received unexpected event network-vif-plugged-b392629c-5b31-400b-be14-aa168e45f717 for instance with vm_state building and task_state spawning.
Apr 12 16:20:26 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: eb6ec19f-61e7-43af-92d7-44fbf8535d04] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 16:20:26 user nova-compute[71874]: INFO nova.compute.manager [None req-7b6a2f79-26cd-4754-a92d-3a5e572ad092 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: eb6ec19f-61e7-43af-92d7-44fbf8535d04] Took 5.32 seconds to spawn the instance on the hypervisor.
Apr 12 16:20:26 user nova-compute[71874]: DEBUG nova.compute.manager [None req-7b6a2f79-26cd-4754-a92d-3a5e572ad092 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: eb6ec19f-61e7-43af-92d7-44fbf8535d04] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:20:26 user nova-compute[71874]: INFO nova.compute.manager [None req-7b6a2f79-26cd-4754-a92d-3a5e572ad092 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: eb6ec19f-61e7-43af-92d7-44fbf8535d04] Took 16.37 seconds to build instance.
Apr 12 16:20:26 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-7b6a2f79-26cd-4754-a92d-3a5e572ad092 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "eb6ec19f-61e7-43af-92d7-44fbf8535d04" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.472s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:20:26 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:20:26 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:20:26 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:20:26 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:20:26 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Auditing locally available compute resources for user (node: user) {{(pid=71874) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 16:20:27 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 16:20:27 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b613235-a905-466f-b9cc-a21a321a6313/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:20:27 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b613235-a905-466f-b9cc-a21a321a6313/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:20:27 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b613235-a905-466f-b9cc-a21a321a6313/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:20:27 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b613235-a905-466f-b9cc-a21a321a6313/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:20:27 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 16:20:27 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 16:20:27 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/540a8fd5-8c18-4efe-97d4-9f0942cebcf5/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:20:27 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:20:27 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/540a8fd5-8c18-4efe-97d4-9f0942cebcf5/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:20:27 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/540a8fd5-8c18-4efe-97d4-9f0942cebcf5/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:20:27 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/540a8fd5-8c18-4efe-97d4-9f0942cebcf5/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:20:27 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32471bee-e77e-4a1b-8e00-d938a1373976/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:20:28 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32471bee-e77e-4a1b-8e00-d938a1373976/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:20:28 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32471bee-e77e-4a1b-8e00-d938a1373976/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:20:28 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32471bee-e77e-4a1b-8e00-d938a1373976/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:20:28 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:20:28 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:20:28 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:20:28 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Hypervisor/Node resource view: name=user free_ram=8113MB free_disk=25.96255874633789GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71874) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 16:20:28 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:20:28 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:20:28 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 1b613235-a905-466f-b9cc-a21a321a6313 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:20:28 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 32471bee-e77e-4a1b-8e00-d938a1373976 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:20:28 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 540a8fd5-8c18-4efe-97d4-9f0942cebcf5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:20:28 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance bef10c89-360e-42d6-aa26-7edf1afca567 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:20:28 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 77842113-37e8-4dc3-bd28-84417eb1ac31 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:20:28 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance eb6ec19f-61e7-43af-92d7-44fbf8535d04 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:20:28 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=71874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 16:20:28 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Final resource view: name=user phys_ram=16023MB used_ram=1344MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=71874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 16:20:29 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Inventory has not changed in ProviderTree for provider: 0e94b4c8-cd49-45e4-9133-d36eb4b2456b {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 16:20:29 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Inventory has not changed for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 16:20:29 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Compute_service record updated for user:user {{(pid=71874) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 16:20:29 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.387s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:20:30 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:20:30 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:20:30 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71874) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 12 16:20:31 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:20:31 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:20:32 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:20:32 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:20:33 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:20:33 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Starting heal instance info cache {{(pid=71874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 16:20:33 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquiring lock "refresh_cache-1b613235-a905-466f-b9cc-a21a321a6313" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:20:33 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquired lock "refresh_cache-1b613235-a905-466f-b9cc-a21a321a6313" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:20:33 user nova-compute[71874]: DEBUG nova.network.neutron [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] [instance: 1b613235-a905-466f-b9cc-a21a321a6313] Forcefully refreshing network info cache for instance {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 16:20:34 user nova-compute[71874]: DEBUG nova.network.neutron [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] [instance: 1b613235-a905-466f-b9cc-a21a321a6313] Updating instance_info_cache with network_info: [{"id": "8a0b8df5-77c2-4888-b715-9f4bafba36b9", "address": "fa:16:3e:a4:ea:da", "network": {"id": "89a33fcd-81e9-4815-8644-d9b33ceb236b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-241667694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "280a9a56afca4ce591faca7a94eca4b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a0b8df5-77", "ovs_interfaceid": "8a0b8df5-77c2-4888-b715-9f4bafba36b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:20:34 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Releasing lock "refresh_cache-1b613235-a905-466f-b9cc-a21a321a6313" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:20:34 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] [instance: 1b613235-a905-466f-b9cc-a21a321a6313] Updated the network info_cache for instance {{(pid=71874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 16:20:35 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:20:35 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71874) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 16:20:37 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:20:37 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:20:38 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:20:38 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:20:42 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:20:43 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:20:47 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:20:48 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:20:50 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-79af718b-a39a-45a4-8f8e-68d384353932 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Acquiring lock "1b613235-a905-466f-b9cc-a21a321a6313" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:20:50 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-79af718b-a39a-45a4-8f8e-68d384353932 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Lock "1b613235-a905-466f-b9cc-a21a321a6313" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:20:50 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-79af718b-a39a-45a4-8f8e-68d384353932 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Acquiring lock "1b613235-a905-466f-b9cc-a21a321a6313-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:20:50 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-79af718b-a39a-45a4-8f8e-68d384353932 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Lock "1b613235-a905-466f-b9cc-a21a321a6313-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:20:50 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-79af718b-a39a-45a4-8f8e-68d384353932 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Lock "1b613235-a905-466f-b9cc-a21a321a6313-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:20:50 user nova-compute[71874]: INFO nova.compute.manager [None req-79af718b-a39a-45a4-8f8e-68d384353932 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] [instance: 1b613235-a905-466f-b9cc-a21a321a6313] Terminating instance
Apr 12 16:20:50 user nova-compute[71874]: DEBUG nova.compute.manager [None req-79af718b-a39a-45a4-8f8e-68d384353932 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] [instance: 1b613235-a905-466f-b9cc-a21a321a6313] Start destroying the instance on the hypervisor. {{(pid=71874) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 16:20:50 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:20:50 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:20:50 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:20:50 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:20:50 user nova-compute[71874]: DEBUG nova.compute.manager [req-077075c3-1199-4dc8-8121-32774f7d93f8 req-15ce681f-1cbd-4616-b601-e589a1cdb411 service nova] [instance: 1b613235-a905-466f-b9cc-a21a321a6313] Received event network-vif-unplugged-8a0b8df5-77c2-4888-b715-9f4bafba36b9 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:20:50 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-077075c3-1199-4dc8-8121-32774f7d93f8 req-15ce681f-1cbd-4616-b601-e589a1cdb411 service nova] Acquiring lock "1b613235-a905-466f-b9cc-a21a321a6313-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:20:50 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-077075c3-1199-4dc8-8121-32774f7d93f8 req-15ce681f-1cbd-4616-b601-e589a1cdb411 service nova] Lock "1b613235-a905-466f-b9cc-a21a321a6313-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:20:50 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-077075c3-1199-4dc8-8121-32774f7d93f8 req-15ce681f-1cbd-4616-b601-e589a1cdb411 service nova] Lock "1b613235-a905-466f-b9cc-a21a321a6313-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:20:50 user nova-compute[71874]: DEBUG nova.compute.manager [req-077075c3-1199-4dc8-8121-32774f7d93f8 req-15ce681f-1cbd-4616-b601-e589a1cdb411 service nova] [instance: 1b613235-a905-466f-b9cc-a21a321a6313] No waiting events found dispatching network-vif-unplugged-8a0b8df5-77c2-4888-b715-9f4bafba36b9 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:20:50 user nova-compute[71874]: DEBUG nova.compute.manager [req-077075c3-1199-4dc8-8121-32774f7d93f8 req-15ce681f-1cbd-4616-b601-e589a1cdb411 service nova] [instance: 1b613235-a905-466f-b9cc-a21a321a6313] Received event network-vif-unplugged-8a0b8df5-77c2-4888-b715-9f4bafba36b9 for instance with task_state deleting. {{(pid=71874) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 16:20:51 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-dd8fd665-654f-4fa0-8e55-03f97cbbff9d tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Acquiring lock "8503d42f-646c-4e59-91fd-0c006b08de7b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:20:51 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-dd8fd665-654f-4fa0-8e55-03f97cbbff9d tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "8503d42f-646c-4e59-91fd-0c006b08de7b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:20:51 user nova-compute[71874]: DEBUG nova.compute.manager [None req-dd8fd665-654f-4fa0-8e55-03f97cbbff9d tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 8503d42f-646c-4e59-91fd-0c006b08de7b] Starting instance... {{(pid=71874) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 16:20:51 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-dd8fd665-654f-4fa0-8e55-03f97cbbff9d tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:20:51 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-dd8fd665-654f-4fa0-8e55-03f97cbbff9d tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:20:51 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-dd8fd665-654f-4fa0-8e55-03f97cbbff9d tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71874) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 16:20:51 user nova-compute[71874]: INFO nova.compute.claims [None req-dd8fd665-654f-4fa0-8e55-03f97cbbff9d tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 8503d42f-646c-4e59-91fd-0c006b08de7b] Claim successful on node user
Apr 12 16:20:51 user nova-compute[71874]: INFO nova.virt.libvirt.driver [-] [instance: 1b613235-a905-466f-b9cc-a21a321a6313] Instance destroyed successfully.
Apr 12 16:20:51 user nova-compute[71874]: DEBUG nova.objects.instance [None req-79af718b-a39a-45a4-8f8e-68d384353932 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Lazy-loading 'resources' on Instance uuid 1b613235-a905-466f-b9cc-a21a321a6313 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:20:51 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-dd8fd665-654f-4fa0-8e55-03f97cbbff9d tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Refreshing inventories for resource provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b {{(pid=71874) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 12 16:20:51 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-dd8fd665-654f-4fa0-8e55-03f97cbbff9d tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Updating ProviderTree inventory for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 12 16:20:51 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-dd8fd665-654f-4fa0-8e55-03f97cbbff9d tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Updating inventory in ProviderTree for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 12 16:20:51 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-79af718b-a39a-45a4-8f8e-68d384353932 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T16:12:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-598591302',display_name='tempest-ServersNegativeTestJSON-server-598591302',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-598591302',id=32,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T16:12:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='280a9a56afca4ce591faca7a94eca4b2',ramdisk_id='',reservation_id='r-tcsvpe92',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-2057017930',owner_user_name='tempest-ServersNegativeTestJSON-2057017930-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T16:12:16Z,user_data=None,user_id='38c60e84c47047e2886220f2ef54391d',uuid=1b613235-a905-466f-b9cc-a21a321a6313,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8a0b8df5-77c2-4888-b715-9f4bafba36b9", "address": "fa:16:3e:a4:ea:da", "network": {"id": "89a33fcd-81e9-4815-8644-d9b33ceb236b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-241667694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "280a9a56afca4ce591faca7a94eca4b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a0b8df5-77", "ovs_interfaceid": "8a0b8df5-77c2-4888-b715-9f4bafba36b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 16:20:51 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-79af718b-a39a-45a4-8f8e-68d384353932 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Converting VIF {"id": "8a0b8df5-77c2-4888-b715-9f4bafba36b9", "address": "fa:16:3e:a4:ea:da", "network": {"id": "89a33fcd-81e9-4815-8644-d9b33ceb236b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-241667694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "280a9a56afca4ce591faca7a94eca4b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a0b8df5-77", "ovs_interfaceid": "8a0b8df5-77c2-4888-b715-9f4bafba36b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:20:51 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-79af718b-a39a-45a4-8f8e-68d384353932 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a4:ea:da,bridge_name='br-int',has_traffic_filtering=True,id=8a0b8df5-77c2-4888-b715-9f4bafba36b9,network=Network(89a33fcd-81e9-4815-8644-d9b33ceb236b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a0b8df5-77') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:20:51 user nova-compute[71874]: DEBUG os_vif [None req-79af718b-a39a-45a4-8f8e-68d384353932 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a4:ea:da,bridge_name='br-int',has_traffic_filtering=True,id=8a0b8df5-77c2-4888-b715-9f4bafba36b9,network=Network(89a33fcd-81e9-4815-8644-d9b33ceb236b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a0b8df5-77') {{(pid=71874) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 16:20:51 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:20:51 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8a0b8df5-77, bridge=br-int, if_exists=True) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:20:51 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:20:51 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-dd8fd665-654f-4fa0-8e55-03f97cbbff9d tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Refreshing aggregate associations for resource provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b, aggregates: None {{(pid=71874) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 12 16:20:51 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:20:51 user nova-compute[71874]: INFO os_vif [None req-79af718b-a39a-45a4-8f8e-68d384353932 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a4:ea:da,bridge_name='br-int',has_traffic_filtering=True,id=8a0b8df5-77c2-4888-b715-9f4bafba36b9,network=Network(89a33fcd-81e9-4815-8644-d9b33ceb236b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a0b8df5-77')
Apr 12 16:20:51 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-79af718b-a39a-45a4-8f8e-68d384353932 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] [instance: 1b613235-a905-466f-b9cc-a21a321a6313] Deleting instance files /opt/stack/data/nova/instances/1b613235-a905-466f-b9cc-a21a321a6313_del
Apr 12 16:20:51 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-79af718b-a39a-45a4-8f8e-68d384353932 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] [instance: 1b613235-a905-466f-b9cc-a21a321a6313] Deletion of /opt/stack/data/nova/instances/1b613235-a905-466f-b9cc-a21a321a6313_del complete
Apr 12 16:20:51 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-dd8fd665-654f-4fa0-8e55-03f97cbbff9d tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Refreshing trait associations for resource provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b, traits: COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_ACCELERATORS,HW_CPU_X86_MMX,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE2,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_FDC,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE {{(pid=71874) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 12 16:20:51 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:20:51 user nova-compute[71874]: INFO nova.compute.manager [None req-79af718b-a39a-45a4-8f8e-68d384353932 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] [instance: 1b613235-a905-466f-b9cc-a21a321a6313] Took 1.34 seconds to destroy the instance on the hypervisor.
Apr 12 16:20:52 user nova-compute[71874]: DEBUG oslo.service.loopingcall [None req-79af718b-a39a-45a4-8f8e-68d384353932 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71874) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 16:20:52 user nova-compute[71874]: DEBUG nova.compute.manager [-] [instance: 1b613235-a905-466f-b9cc-a21a321a6313] Deallocating network for instance {{(pid=71874) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 16:20:52 user nova-compute[71874]: DEBUG nova.network.neutron [-] [instance: 1b613235-a905-466f-b9cc-a21a321a6313] deallocate_for_instance() {{(pid=71874) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 16:20:52 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-dd8fd665-654f-4fa0-8e55-03f97cbbff9d tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Inventory has not changed in ProviderTree for provider: 0e94b4c8-cd49-45e4-9133-d36eb4b2456b {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 16:20:52 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-dd8fd665-654f-4fa0-8e55-03f97cbbff9d tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Inventory has not changed for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 16:20:52 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-dd8fd665-654f-4fa0-8e55-03f97cbbff9d tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.053s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:20:52 user nova-compute[71874]: DEBUG nova.compute.manager [None req-dd8fd665-654f-4fa0-8e55-03f97cbbff9d tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 8503d42f-646c-4e59-91fd-0c006b08de7b] Start building networks asynchronously for instance. {{(pid=71874) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 16:20:52 user nova-compute[71874]: DEBUG nova.compute.manager [None req-dd8fd665-654f-4fa0-8e55-03f97cbbff9d tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 8503d42f-646c-4e59-91fd-0c006b08de7b] Allocating IP information in the background. {{(pid=71874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 16:20:52 user nova-compute[71874]: DEBUG nova.network.neutron [None req-dd8fd665-654f-4fa0-8e55-03f97cbbff9d tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 8503d42f-646c-4e59-91fd-0c006b08de7b] allocate_for_instance() {{(pid=71874) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 16:20:52 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-dd8fd665-654f-4fa0-8e55-03f97cbbff9d tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 8503d42f-646c-4e59-91fd-0c006b08de7b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 16:20:52 user nova-compute[71874]: DEBUG nova.compute.manager [None req-dd8fd665-654f-4fa0-8e55-03f97cbbff9d tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 8503d42f-646c-4e59-91fd-0c006b08de7b] Start building block device mappings for instance. {{(pid=71874) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 16:20:52 user nova-compute[71874]: DEBUG nova.policy [None req-dd8fd665-654f-4fa0-8e55-03f97cbbff9d tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2996f6997bb14fc3aec9c3736cc65b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf4334df004490ba51b4d92ce5408ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71874) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 16:20:52 user nova-compute[71874]: DEBUG nova.compute.manager [None req-dd8fd665-654f-4fa0-8e55-03f97cbbff9d tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 8503d42f-646c-4e59-91fd-0c006b08de7b] Start spawning the instance on the hypervisor. {{(pid=71874) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 16:20:52 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-dd8fd665-654f-4fa0-8e55-03f97cbbff9d tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 8503d42f-646c-4e59-91fd-0c006b08de7b] Creating instance directory {{(pid=71874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 16:20:52 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-dd8fd665-654f-4fa0-8e55-03f97cbbff9d tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 8503d42f-646c-4e59-91fd-0c006b08de7b] Creating image(s)
Apr 12 16:20:52 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-dd8fd665-654f-4fa0-8e55-03f97cbbff9d tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Acquiring lock "/opt/stack/data/nova/instances/8503d42f-646c-4e59-91fd-0c006b08de7b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:20:52 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-dd8fd665-654f-4fa0-8e55-03f97cbbff9d tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "/opt/stack/data/nova/instances/8503d42f-646c-4e59-91fd-0c006b08de7b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:20:52 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-dd8fd665-654f-4fa0-8e55-03f97cbbff9d tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "/opt/stack/data/nova/instances/8503d42f-646c-4e59-91fd-0c006b08de7b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:20:52 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-dd8fd665-654f-4fa0-8e55-03f97cbbff9d tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:20:52 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:20:52 user nova-compute[71874]: DEBUG nova.network.neutron [-] [instance: 1b613235-a905-466f-b9cc-a21a321a6313] Updating instance_info_cache with network_info: [] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:20:52 user nova-compute[71874]: INFO nova.compute.manager [-] [instance: 1b613235-a905-466f-b9cc-a21a321a6313] Took 0.75 seconds to deallocate network for instance.
Apr 12 16:20:52 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-79af718b-a39a-45a4-8f8e-68d384353932 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:20:52 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-79af718b-a39a-45a4-8f8e-68d384353932 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:20:52 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-dd8fd665-654f-4fa0-8e55-03f97cbbff9d tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json" returned: 0 in 0.166s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:20:52 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-dd8fd665-654f-4fa0-8e55-03f97cbbff9d tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Acquiring lock "b88df1b37cb431f52bc53b5616015c89b5bec411" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:20:52 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-dd8fd665-654f-4fa0-8e55-03f97cbbff9d tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "b88df1b37cb431f52bc53b5616015c89b5bec411" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:20:52 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-dd8fd665-654f-4fa0-8e55-03f97cbbff9d tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:20:52 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-dd8fd665-654f-4fa0-8e55-03f97cbbff9d tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json" returned: 0 in 0.139s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:20:52 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-dd8fd665-654f-4fa0-8e55-03f97cbbff9d tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411,backing_fmt=raw /opt/stack/data/nova/instances/8503d42f-646c-4e59-91fd-0c006b08de7b/disk 1073741824 {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:20:52 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-dd8fd665-654f-4fa0-8e55-03f97cbbff9d tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411,backing_fmt=raw /opt/stack/data/nova/instances/8503d42f-646c-4e59-91fd-0c006b08de7b/disk 1073741824" returned: 0 in 0.052s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:20:52 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-dd8fd665-654f-4fa0-8e55-03f97cbbff9d tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "b88df1b37cb431f52bc53b5616015c89b5bec411" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.197s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:20:52 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-dd8fd665-654f-4fa0-8e55-03f97cbbff9d tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:20:53 user nova-compute[71874]: DEBUG nova.compute.manager [req-de784852-e3a3-4cc8-bd00-ec662e685be5 req-7ad62510-452e-4493-aabf-87df23a2efa3 service nova] [instance: 1b613235-a905-466f-b9cc-a21a321a6313] Received event network-vif-plugged-8a0b8df5-77c2-4888-b715-9f4bafba36b9 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:20:53 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-de784852-e3a3-4cc8-bd00-ec662e685be5 req-7ad62510-452e-4493-aabf-87df23a2efa3 service nova] Acquiring lock "1b613235-a905-466f-b9cc-a21a321a6313-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:20:53 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-de784852-e3a3-4cc8-bd00-ec662e685be5 req-7ad62510-452e-4493-aabf-87df23a2efa3 service nova] Lock "1b613235-a905-466f-b9cc-a21a321a6313-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:20:53 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-de784852-e3a3-4cc8-bd00-ec662e685be5 req-7ad62510-452e-4493-aabf-87df23a2efa3 service nova] Lock "1b613235-a905-466f-b9cc-a21a321a6313-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:20:53 user nova-compute[71874]: DEBUG nova.compute.manager [req-de784852-e3a3-4cc8-bd00-ec662e685be5 req-7ad62510-452e-4493-aabf-87df23a2efa3 service nova] [instance: 1b613235-a905-466f-b9cc-a21a321a6313] No waiting events found dispatching network-vif-plugged-8a0b8df5-77c2-4888-b715-9f4bafba36b9 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:20:53 user nova-compute[71874]: WARNING nova.compute.manager [req-de784852-e3a3-4cc8-bd00-ec662e685be5 req-7ad62510-452e-4493-aabf-87df23a2efa3 service nova] [instance: 1b613235-a905-466f-b9cc-a21a321a6313] Received unexpected event network-vif-plugged-8a0b8df5-77c2-4888-b715-9f4bafba36b9 for instance with vm_state deleted and task_state None.
Apr 12 16:20:53 user nova-compute[71874]: DEBUG nova.compute.manager [req-de784852-e3a3-4cc8-bd00-ec662e685be5 req-7ad62510-452e-4493-aabf-87df23a2efa3 service nova] [instance: 1b613235-a905-466f-b9cc-a21a321a6313] Received event network-vif-deleted-8a0b8df5-77c2-4888-b715-9f4bafba36b9 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:20:53 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-79af718b-a39a-45a4-8f8e-68d384353932 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Inventory has not changed in ProviderTree for provider: 0e94b4c8-cd49-45e4-9133-d36eb4b2456b {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 16:20:53 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-79af718b-a39a-45a4-8f8e-68d384353932 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Inventory has not changed for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 16:20:53 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-dd8fd665-654f-4fa0-8e55-03f97cbbff9d tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json" returned: 0 in 0.150s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:20:53 user nova-compute[71874]: DEBUG nova.virt.disk.api [None req-dd8fd665-654f-4fa0-8e55-03f97cbbff9d tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8503d42f-646c-4e59-91fd-0c006b08de7b/disk. size=1073741824 {{(pid=71874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 16:20:53 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-dd8fd665-654f-4fa0-8e55-03f97cbbff9d tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8503d42f-646c-4e59-91fd-0c006b08de7b/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:20:53 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-79af718b-a39a-45a4-8f8e-68d384353932 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.401s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:20:53 user nova-compute[71874]: INFO nova.scheduler.client.report [None req-79af718b-a39a-45a4-8f8e-68d384353932 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Deleted allocations for instance 1b613235-a905-466f-b9cc-a21a321a6313
Apr 12 16:20:53 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-dd8fd665-654f-4fa0-8e55-03f97cbbff9d tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8503d42f-646c-4e59-91fd-0c006b08de7b/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:20:53 user nova-compute[71874]: DEBUG nova.virt.disk.api [None req-dd8fd665-654f-4fa0-8e55-03f97cbbff9d tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Cannot resize image /opt/stack/data/nova/instances/8503d42f-646c-4e59-91fd-0c006b08de7b/disk to a smaller size. {{(pid=71874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 16:20:53 user nova-compute[71874]: DEBUG nova.objects.instance [None req-dd8fd665-654f-4fa0-8e55-03f97cbbff9d tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lazy-loading 'migration_context' on Instance uuid 8503d42f-646c-4e59-91fd-0c006b08de7b {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:20:53 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-dd8fd665-654f-4fa0-8e55-03f97cbbff9d tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 8503d42f-646c-4e59-91fd-0c006b08de7b] Created local disks {{(pid=71874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 16:20:53 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-dd8fd665-654f-4fa0-8e55-03f97cbbff9d tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 8503d42f-646c-4e59-91fd-0c006b08de7b] Ensure instance console log exists: /opt/stack/data/nova/instances/8503d42f-646c-4e59-91fd-0c006b08de7b/console.log {{(pid=71874) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 16:20:53 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-dd8fd665-654f-4fa0-8e55-03f97cbbff9d tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:20:53 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-dd8fd665-654f-4fa0-8e55-03f97cbbff9d tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:20:53 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-dd8fd665-654f-4fa0-8e55-03f97cbbff9d tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:20:53 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-79af718b-a39a-45a4-8f8e-68d384353932 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Lock "1b613235-a905-466f-b9cc-a21a321a6313" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.694s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:20:53 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:20:53 user nova-compute[71874]: DEBUG nova.network.neutron [None req-dd8fd665-654f-4fa0-8e55-03f97cbbff9d tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 8503d42f-646c-4e59-91fd-0c006b08de7b] Successfully created port: 48d1ca2a-7881-4f05-a889-0e40e46c0e12 {{(pid=71874) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 16:20:54 user nova-compute[71874]: DEBUG nova.network.neutron [None req-dd8fd665-654f-4fa0-8e55-03f97cbbff9d tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 8503d42f-646c-4e59-91fd-0c006b08de7b] Successfully updated port: 48d1ca2a-7881-4f05-a889-0e40e46c0e12 {{(pid=71874) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 16:20:54 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-dd8fd665-654f-4fa0-8e55-03f97cbbff9d tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Acquiring lock "refresh_cache-8503d42f-646c-4e59-91fd-0c006b08de7b" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:20:54 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-dd8fd665-654f-4fa0-8e55-03f97cbbff9d tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Acquired lock "refresh_cache-8503d42f-646c-4e59-91fd-0c006b08de7b" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:20:54 user nova-compute[71874]: DEBUG nova.network.neutron [None req-dd8fd665-654f-4fa0-8e55-03f97cbbff9d tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 8503d42f-646c-4e59-91fd-0c006b08de7b] Building network info cache for instance {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 16:20:54 user nova-compute[71874]: DEBUG nova.network.neutron [None req-dd8fd665-654f-4fa0-8e55-03f97cbbff9d tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 8503d42f-646c-4e59-91fd-0c006b08de7b] Instance cache missing network info. {{(pid=71874) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 16:20:54 user nova-compute[71874]: DEBUG nova.compute.manager [req-f8f464c2-4ba8-424f-9dfd-83d8fa3b9f16 req-cbc7361e-90c9-4481-83eb-b9a10f73454f service nova] [instance: 8503d42f-646c-4e59-91fd-0c006b08de7b] Received event network-changed-48d1ca2a-7881-4f05-a889-0e40e46c0e12 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:20:54 user nova-compute[71874]: DEBUG nova.compute.manager [req-f8f464c2-4ba8-424f-9dfd-83d8fa3b9f16 req-cbc7361e-90c9-4481-83eb-b9a10f73454f service nova] [instance: 8503d42f-646c-4e59-91fd-0c006b08de7b] Refreshing instance network info cache due to event network-changed-48d1ca2a-7881-4f05-a889-0e40e46c0e12. {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 16:20:54 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-f8f464c2-4ba8-424f-9dfd-83d8fa3b9f16 req-cbc7361e-90c9-4481-83eb-b9a10f73454f service nova] Acquiring lock "refresh_cache-8503d42f-646c-4e59-91fd-0c006b08de7b" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:20:54 user nova-compute[71874]: DEBUG nova.network.neutron [None req-dd8fd665-654f-4fa0-8e55-03f97cbbff9d tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 8503d42f-646c-4e59-91fd-0c006b08de7b] Updating instance_info_cache with network_info: [{"id": "48d1ca2a-7881-4f05-a889-0e40e46c0e12", "address": "fa:16:3e:af:68:02", "network": {"id": "1ef428ff-90e5-4abd-93d0-b7c2c581cb26", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-425924095-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf4334df004490ba51b4d92ce5408ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48d1ca2a-78", "ovs_interfaceid": "48d1ca2a-7881-4f05-a889-0e40e46c0e12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:20:54 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-dd8fd665-654f-4fa0-8e55-03f97cbbff9d tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Releasing lock "refresh_cache-8503d42f-646c-4e59-91fd-0c006b08de7b" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:20:54 user nova-compute[71874]: DEBUG nova.compute.manager [None req-dd8fd665-654f-4fa0-8e55-03f97cbbff9d tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 8503d42f-646c-4e59-91fd-0c006b08de7b] Instance network_info: |[{"id": "48d1ca2a-7881-4f05-a889-0e40e46c0e12", "address": "fa:16:3e:af:68:02", "network": {"id": "1ef428ff-90e5-4abd-93d0-b7c2c581cb26", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-425924095-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf4334df004490ba51b4d92ce5408ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48d1ca2a-78", "ovs_interfaceid": "48d1ca2a-7881-4f05-a889-0e40e46c0e12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 16:20:54 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-f8f464c2-4ba8-424f-9dfd-83d8fa3b9f16 req-cbc7361e-90c9-4481-83eb-b9a10f73454f service nova] Acquired lock "refresh_cache-8503d42f-646c-4e59-91fd-0c006b08de7b" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:20:54 user nova-compute[71874]: DEBUG nova.network.neutron [req-f8f464c2-4ba8-424f-9dfd-83d8fa3b9f16 req-cbc7361e-90c9-4481-83eb-b9a10f73454f service nova] [instance: 8503d42f-646c-4e59-91fd-0c006b08de7b] Refreshing network info cache for port 48d1ca2a-7881-4f05-a889-0e40e46c0e12 {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 16:20:54 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-dd8fd665-654f-4fa0-8e55-03f97cbbff9d tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 8503d42f-646c-4e59-91fd-0c006b08de7b] Start _get_guest_xml network_info=[{"id": "48d1ca2a-7881-4f05-a889-0e40e46c0e12", "address": "fa:16:3e:af:68:02", "network": {"id": "1ef428ff-90e5-4abd-93d0-b7c2c581cb26", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-425924095-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf4334df004490ba51b4d92ce5408ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48d1ca2a-78", "ovs_interfaceid": "48d1ca2a-7881-4f05-a889-0e40e46c0e12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T15:55:37Z,direct_url=<?>,disk_format='qcow2',id=9dc63f14-8b70-4e72-89f2-13464f2f5c7c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='61a4936d9b7744c0b488d81c9b7746b6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T15:55:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_options': None, 'image_id': '9dc63f14-8b70-4e72-89f2-13464f2f5c7c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 16:20:54 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-dd8fd665-654f-4fa0-8e55-03f97cbbff9d tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:20:54 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-dd8fd665-654f-4fa0-8e55-03f97cbbff9d tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:20:54 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-dd8fd665-654f-4fa0-8e55-03f97cbbff9d tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71874) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 16:20:54 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-dd8fd665-654f-4fa0-8e55-03f97cbbff9d tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T15:56:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T15:55:37Z,direct_url=<?>,disk_format='qcow2',id=9dc63f14-8b70-4e72-89f2-13464f2f5c7c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='61a4936d9b7744c0b488d81c9b7746b6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T15:55:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 16:20:54 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-dd8fd665-654f-4fa0-8e55-03f97cbbff9d tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Flavor limits 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 16:20:54 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-dd8fd665-654f-4fa0-8e55-03f97cbbff9d tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Image limits 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 16:20:54 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-dd8fd665-654f-4fa0-8e55-03f97cbbff9d tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Flavor pref 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 16:20:54 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-dd8fd665-654f-4fa0-8e55-03f97cbbff9d tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Image pref 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 16:20:54 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-dd8fd665-654f-4fa0-8e55-03f97cbbff9d tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 16:20:54 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-dd8fd665-654f-4fa0-8e55-03f97cbbff9d tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 16:20:54 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-dd8fd665-654f-4fa0-8e55-03f97cbbff9d tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 16:20:54 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-dd8fd665-654f-4fa0-8e55-03f97cbbff9d tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Got 1 possible topologies {{(pid=71874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 16:20:54 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-dd8fd665-654f-4fa0-8e55-03f97cbbff9d tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 16:20:54 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-dd8fd665-654f-4fa0-8e55-03f97cbbff9d tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 16:20:54 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-dd8fd665-654f-4fa0-8e55-03f97cbbff9d tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T16:20:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1694219693',display_name='tempest-AttachVolumeTestJSON-server-1694219693',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1694219693',id=41,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFegUIJydsU75qcTJSV45dkY83seloCWf7obTREoxQ5Tzm2UtnqJnKrcKtlka/HBhmbE6gwOWBaksH9phh2mET8aWcIhrLEtEDmJocz9/pW3fFh7UqcEP6/AzD4YnExbQA==',key_name='tempest-keypair-857316521',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7cf4334df004490ba51b4d92ce5408ae',ramdisk_id='',reservation_id='r-e7rtictf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-178648074',owner_user_name='tempest-AttachVolumeTestJSON-178648074-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T16:20:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2996f6997bb14fc3aec9c3736cc65b8a',uuid=8503d42f-646c-4e59-91fd-0c006b08de7b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "48d1ca2a-7881-4f05-a889-0e40e46c0e12", "address": "fa:16:3e:af:68:02", "network": {"id": "1ef428ff-90e5-4abd-93d0-b7c2c581cb26", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-425924095-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf4334df004490ba51b4d92ce5408ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48d1ca2a-78", "ovs_interfaceid": "48d1ca2a-7881-4f05-a889-0e40e46c0e12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 16:20:54 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-dd8fd665-654f-4fa0-8e55-03f97cbbff9d tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Converting VIF {"id": "48d1ca2a-7881-4f05-a889-0e40e46c0e12", "address": "fa:16:3e:af:68:02", "network": {"id": "1ef428ff-90e5-4abd-93d0-b7c2c581cb26", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-425924095-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf4334df004490ba51b4d92ce5408ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48d1ca2a-78", "ovs_interfaceid": "48d1ca2a-7881-4f05-a889-0e40e46c0e12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:20:54 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-dd8fd665-654f-4fa0-8e55-03f97cbbff9d tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:68:02,bridge_name='br-int',has_traffic_filtering=True,id=48d1ca2a-7881-4f05-a889-0e40e46c0e12,network=Network(1ef428ff-90e5-4abd-93d0-b7c2c581cb26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48d1ca2a-78') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:20:54 user nova-compute[71874]: DEBUG nova.objects.instance [None req-dd8fd665-654f-4fa0-8e55-03f97cbbff9d tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lazy-loading 'pci_devices' on Instance uuid 8503d42f-646c-4e59-91fd-0c006b08de7b {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:20:54 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-dd8fd665-654f-4fa0-8e55-03f97cbbff9d tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 8503d42f-646c-4e59-91fd-0c006b08de7b] End _get_guest_xml xml=<domain type="kvm">
Apr 12 16:20:54 user nova-compute[71874]:   <uuid>8503d42f-646c-4e59-91fd-0c006b08de7b</uuid>
Apr 12 16:20:54 user nova-compute[71874]:   <name>instance-00000029</name>
Apr 12 16:20:54 user nova-compute[71874]:   <memory>131072</memory>
Apr 12 16:20:54 user nova-compute[71874]:   <vcpu>1</vcpu>
Apr 12 16:20:54 user nova-compute[71874]:   <metadata>
Apr 12 16:20:54 user nova-compute[71874]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 16:20:54 user nova-compute[71874]:       <nova:package version="0.0.0"/>
Apr 12 16:20:54 user nova-compute[71874]:       <nova:name>tempest-AttachVolumeTestJSON-server-1694219693</nova:name>
Apr 12 16:20:54 user nova-compute[71874]:       <nova:creationTime>2023-04-12 16:20:54</nova:creationTime>
Apr 12 16:20:54 user nova-compute[71874]:       <nova:flavor name="m1.nano">
Apr 12 16:20:54 user nova-compute[71874]:         <nova:memory>128</nova:memory>
Apr 12 16:20:54 user nova-compute[71874]:         <nova:disk>1</nova:disk>
Apr 12 16:20:54 user nova-compute[71874]:         <nova:swap>0</nova:swap>
Apr 12 16:20:54 user nova-compute[71874]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 16:20:54 user nova-compute[71874]:         <nova:vcpus>1</nova:vcpus>
Apr 12 16:20:54 user nova-compute[71874]:       </nova:flavor>
Apr 12 16:20:54 user nova-compute[71874]:       <nova:owner>
Apr 12 16:20:54 user nova-compute[71874]:         <nova:user uuid="2996f6997bb14fc3aec9c3736cc65b8a">tempest-AttachVolumeTestJSON-178648074-project-member</nova:user>
Apr 12 16:20:54 user nova-compute[71874]:         <nova:project uuid="7cf4334df004490ba51b4d92ce5408ae">tempest-AttachVolumeTestJSON-178648074</nova:project>
Apr 12 16:20:54 user nova-compute[71874]:       </nova:owner>
Apr 12 16:20:54 user nova-compute[71874]:       <nova:root type="image" uuid="9dc63f14-8b70-4e72-89f2-13464f2f5c7c"/>
Apr 12 16:20:54 user nova-compute[71874]:       <nova:ports>
Apr 12 16:20:54 user nova-compute[71874]:         <nova:port uuid="48d1ca2a-7881-4f05-a889-0e40e46c0e12">
Apr 12 16:20:54 user nova-compute[71874]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 12 16:20:54 user nova-compute[71874]:         </nova:port>
Apr 12 16:20:54 user nova-compute[71874]:       </nova:ports>
Apr 12 16:20:54 user nova-compute[71874]:     </nova:instance>
Apr 12 16:20:54 user nova-compute[71874]:   </metadata>
Apr 12 16:20:54 user nova-compute[71874]:   <sysinfo type="smbios">
Apr 12 16:20:54 user nova-compute[71874]:     <system>
Apr 12 16:20:54 user nova-compute[71874]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 16:20:54 user nova-compute[71874]:       <entry name="product">OpenStack Nova</entry>
Apr 12 16:20:54 user nova-compute[71874]:       <entry name="version">0.0.0</entry>
Apr 12 16:20:54 user nova-compute[71874]:       <entry name="serial">8503d42f-646c-4e59-91fd-0c006b08de7b</entry>
Apr 12 16:20:54 user nova-compute[71874]:       <entry name="uuid">8503d42f-646c-4e59-91fd-0c006b08de7b</entry>
Apr 12 16:20:54 user nova-compute[71874]:       <entry name="family">Virtual Machine</entry>
Apr 12 16:20:54 user nova-compute[71874]:     </system>
Apr 12 16:20:54 user nova-compute[71874]:   </sysinfo>
Apr 12 16:20:54 user nova-compute[71874]:   <os>
Apr 12 16:20:54 user nova-compute[71874]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 16:20:54 user nova-compute[71874]:     <boot dev="hd"/>
Apr 12 16:20:54 user nova-compute[71874]:     <smbios mode="sysinfo"/>
Apr 12 16:20:54 user nova-compute[71874]:   </os>
Apr 12 16:20:54 user nova-compute[71874]:   <features>
Apr 12 16:20:54 user nova-compute[71874]:     <acpi/>
Apr 12 16:20:54 user nova-compute[71874]:     <apic/>
Apr 12 16:20:54 user nova-compute[71874]:     <vmcoreinfo/>
Apr 12 16:20:54 user nova-compute[71874]:   </features>
Apr 12 16:20:54 user nova-compute[71874]:   <clock offset="utc">
Apr 12 16:20:54 user nova-compute[71874]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 16:20:54 user nova-compute[71874]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 16:20:54 user nova-compute[71874]:     <timer name="hpet" present="no"/>
Apr 12 16:20:54 user nova-compute[71874]:   </clock>
Apr 12 16:20:54 user nova-compute[71874]:   <cpu mode="custom" match="exact">
Apr 12 16:20:54 user nova-compute[71874]:     <model>Nehalem</model>
Apr 12 16:20:54 user nova-compute[71874]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 16:20:54 user nova-compute[71874]:   </cpu>
Apr 12 16:20:54 user nova-compute[71874]:   <devices>
Apr 12 16:20:54 user nova-compute[71874]:     <disk type="file" device="disk">
Apr 12 16:20:54 user nova-compute[71874]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 16:20:54 user nova-compute[71874]:       <source file="/opt/stack/data/nova/instances/8503d42f-646c-4e59-91fd-0c006b08de7b/disk"/>
Apr 12 16:20:54 user nova-compute[71874]:       <target dev="vda" bus="virtio"/>
Apr 12 16:20:54 user nova-compute[71874]:     </disk>
Apr 12 16:20:54 user nova-compute[71874]:     <interface type="ethernet">
Apr 12 16:20:54 user nova-compute[71874]:       <mac address="fa:16:3e:af:68:02"/>
Apr 12 16:20:54 user nova-compute[71874]:       <model type="virtio"/>
Apr 12 16:20:54 user nova-compute[71874]:       <mtu size="1442"/>
Apr 12 16:20:54 user nova-compute[71874]:       <target dev="tap48d1ca2a-78"/>
Apr 12 16:20:54 user nova-compute[71874]:     </interface>
Apr 12 16:20:54 user nova-compute[71874]:     <serial type="pty">
Apr 12 16:20:54 user nova-compute[71874]:       <log file="/opt/stack/data/nova/instances/8503d42f-646c-4e59-91fd-0c006b08de7b/console.log" append="off"/>
Apr 12 16:20:54 user nova-compute[71874]:     </serial>
Apr 12 16:20:54 user nova-compute[71874]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 16:20:54 user nova-compute[71874]:     <video>
Apr 12 16:20:54 user nova-compute[71874]:       <model type="virtio"/>
Apr 12 16:20:54 user nova-compute[71874]:     </video>
Apr 12 16:20:54 user nova-compute[71874]:     <rng model="virtio">
Apr 12 16:20:54 user nova-compute[71874]:       <backend model="random">/dev/urandom</backend>
Apr 12 16:20:54 user nova-compute[71874]:     </rng>
Apr 12 16:20:54 user nova-compute[71874]:     <controller type="usb" index="0" model="none"/>
Apr 12 16:20:54 user nova-compute[71874]:     <memballoon model="virtio">
Apr 12 16:20:54 user nova-compute[71874]:       <stats period="10"/>
Apr 12 16:20:54 user nova-compute[71874]:     </memballoon>
Apr 12 16:20:54 user nova-compute[71874]:   </devices>
Apr 12 16:20:54 user nova-compute[71874]: </domain>
Apr 12 16:20:54 user nova-compute[71874]:  {{(pid=71874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 16:20:54 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-dd8fd665-654f-4fa0-8e55-03f97cbbff9d tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T16:20:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1694219693',display_name='tempest-AttachVolumeTestJSON-server-1694219693',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1694219693',id=41,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFegUIJydsU75qcTJSV45dkY83seloCWf7obTREoxQ5Tzm2UtnqJnKrcKtlka/HBhmbE6gwOWBaksH9phh2mET8aWcIhrLEtEDmJocz9/pW3fFh7UqcEP6/AzD4YnExbQA==',key_name='tempest-keypair-857316521',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7cf4334df004490ba51b4d92ce5408ae',ramdisk_id='',reservation_id='r-e7rtictf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-178648074',owner_user_name='tempest-AttachVolumeTestJSON-178648074-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T16:20:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2996f6997bb14fc3aec9c3736cc65b8a',uuid=8503d42f-646c-4e59-91fd-0c006b08de7b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "48d1ca2a-7881-4f05-a889-0e40e46c0e12", "address": "fa:16:3e:af:68:02", "network": {"id": "1ef428ff-90e5-4abd-93d0-b7c2c581cb26", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-425924095-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf4334df004490ba51b4d92ce5408ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48d1ca2a-78", "ovs_interfaceid": "48d1ca2a-7881-4f05-a889-0e40e46c0e12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 16:20:54 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-dd8fd665-654f-4fa0-8e55-03f97cbbff9d tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Converting VIF {"id": "48d1ca2a-7881-4f05-a889-0e40e46c0e12", "address": "fa:16:3e:af:68:02", "network": {"id": "1ef428ff-90e5-4abd-93d0-b7c2c581cb26", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-425924095-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf4334df004490ba51b4d92ce5408ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48d1ca2a-78", "ovs_interfaceid": "48d1ca2a-7881-4f05-a889-0e40e46c0e12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:20:54 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-dd8fd665-654f-4fa0-8e55-03f97cbbff9d tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:68:02,bridge_name='br-int',has_traffic_filtering=True,id=48d1ca2a-7881-4f05-a889-0e40e46c0e12,network=Network(1ef428ff-90e5-4abd-93d0-b7c2c581cb26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48d1ca2a-78') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:20:54 user nova-compute[71874]: DEBUG os_vif [None req-dd8fd665-654f-4fa0-8e55-03f97cbbff9d tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:68:02,bridge_name='br-int',has_traffic_filtering=True,id=48d1ca2a-7881-4f05-a889-0e40e46c0e12,network=Network(1ef428ff-90e5-4abd-93d0-b7c2c581cb26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48d1ca2a-78') {{(pid=71874) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 16:20:54 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:20:54 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:20:54 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 16:20:54 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:20:54 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap48d1ca2a-78, may_exist=True) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:20:54 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap48d1ca2a-78, col_values=(('external_ids', {'iface-id': '48d1ca2a-7881-4f05-a889-0e40e46c0e12', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:af:68:02', 'vm-uuid': '8503d42f-646c-4e59-91fd-0c006b08de7b'}),)) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:20:54 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:20:54 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:20:54 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:20:54 user nova-compute[71874]: INFO os_vif [None req-dd8fd665-654f-4fa0-8e55-03f97cbbff9d tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:68:02,bridge_name='br-int',has_traffic_filtering=True,id=48d1ca2a-7881-4f05-a889-0e40e46c0e12,network=Network(1ef428ff-90e5-4abd-93d0-b7c2c581cb26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48d1ca2a-78')
Apr 12 16:20:54 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-dd8fd665-654f-4fa0-8e55-03f97cbbff9d tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] No BDM found with device name vda, not building metadata. {{(pid=71874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 16:20:54 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-dd8fd665-654f-4fa0-8e55-03f97cbbff9d tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] No VIF found with MAC fa:16:3e:af:68:02, not building metadata {{(pid=71874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 16:20:55 user nova-compute[71874]: DEBUG nova.network.neutron [req-f8f464c2-4ba8-424f-9dfd-83d8fa3b9f16 req-cbc7361e-90c9-4481-83eb-b9a10f73454f service nova] [instance: 8503d42f-646c-4e59-91fd-0c006b08de7b] Updated VIF entry in instance network info cache for port 48d1ca2a-7881-4f05-a889-0e40e46c0e12. {{(pid=71874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 16:20:55 user nova-compute[71874]: DEBUG nova.network.neutron [req-f8f464c2-4ba8-424f-9dfd-83d8fa3b9f16 req-cbc7361e-90c9-4481-83eb-b9a10f73454f service nova] [instance: 8503d42f-646c-4e59-91fd-0c006b08de7b] Updating instance_info_cache with network_info: [{"id": "48d1ca2a-7881-4f05-a889-0e40e46c0e12", "address": "fa:16:3e:af:68:02", "network": {"id": "1ef428ff-90e5-4abd-93d0-b7c2c581cb26", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-425924095-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf4334df004490ba51b4d92ce5408ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48d1ca2a-78", "ovs_interfaceid": "48d1ca2a-7881-4f05-a889-0e40e46c0e12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:20:55 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-f8f464c2-4ba8-424f-9dfd-83d8fa3b9f16 req-cbc7361e-90c9-4481-83eb-b9a10f73454f service nova] Releasing lock "refresh_cache-8503d42f-646c-4e59-91fd-0c006b08de7b" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:20:56 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:20:56 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:20:56 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:20:56 user nova-compute[71874]: DEBUG nova.compute.manager [req-6b992eb4-711c-4e5a-96fd-3125f543c777 req-801adc32-3c3b-441d-8052-729cb6b689da service nova] [instance: 8503d42f-646c-4e59-91fd-0c006b08de7b] Received event network-vif-plugged-48d1ca2a-7881-4f05-a889-0e40e46c0e12 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:20:56 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-6b992eb4-711c-4e5a-96fd-3125f543c777 req-801adc32-3c3b-441d-8052-729cb6b689da service nova] Acquiring lock "8503d42f-646c-4e59-91fd-0c006b08de7b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:20:56 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-6b992eb4-711c-4e5a-96fd-3125f543c777 req-801adc32-3c3b-441d-8052-729cb6b689da service nova] Lock "8503d42f-646c-4e59-91fd-0c006b08de7b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:20:56 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-6b992eb4-711c-4e5a-96fd-3125f543c777 req-801adc32-3c3b-441d-8052-729cb6b689da service nova] Lock "8503d42f-646c-4e59-91fd-0c006b08de7b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:20:56 user nova-compute[71874]: DEBUG nova.compute.manager [req-6b992eb4-711c-4e5a-96fd-3125f543c777 req-801adc32-3c3b-441d-8052-729cb6b689da service nova] [instance: 8503d42f-646c-4e59-91fd-0c006b08de7b] No waiting events found dispatching network-vif-plugged-48d1ca2a-7881-4f05-a889-0e40e46c0e12 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:20:56 user nova-compute[71874]: WARNING nova.compute.manager [req-6b992eb4-711c-4e5a-96fd-3125f543c777 req-801adc32-3c3b-441d-8052-729cb6b689da service nova] [instance: 8503d42f-646c-4e59-91fd-0c006b08de7b] Received unexpected event network-vif-plugged-48d1ca2a-7881-4f05-a889-0e40e46c0e12 for instance with vm_state building and task_state spawning.
Apr 12 16:20:56 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:20:56 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:20:56 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:20:58 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:20:58 user nova-compute[71874]: DEBUG nova.compute.manager [req-dc1bb31e-37cf-4d5a-bba3-c233af00a211 req-0cdc7c24-698c-4c41-84b6-38c3c0be86ac service nova] [instance: 8503d42f-646c-4e59-91fd-0c006b08de7b] Received event network-vif-plugged-48d1ca2a-7881-4f05-a889-0e40e46c0e12 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:20:58 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-dc1bb31e-37cf-4d5a-bba3-c233af00a211 req-0cdc7c24-698c-4c41-84b6-38c3c0be86ac service nova] Acquiring lock "8503d42f-646c-4e59-91fd-0c006b08de7b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:20:58 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-dc1bb31e-37cf-4d5a-bba3-c233af00a211 req-0cdc7c24-698c-4c41-84b6-38c3c0be86ac service nova] Lock "8503d42f-646c-4e59-91fd-0c006b08de7b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:20:58 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-dc1bb31e-37cf-4d5a-bba3-c233af00a211 req-0cdc7c24-698c-4c41-84b6-38c3c0be86ac service nova] Lock "8503d42f-646c-4e59-91fd-0c006b08de7b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:20:58 user nova-compute[71874]: DEBUG nova.compute.manager [req-dc1bb31e-37cf-4d5a-bba3-c233af00a211 req-0cdc7c24-698c-4c41-84b6-38c3c0be86ac service nova] [instance: 8503d42f-646c-4e59-91fd-0c006b08de7b] No waiting events found dispatching network-vif-plugged-48d1ca2a-7881-4f05-a889-0e40e46c0e12 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:20:58 user nova-compute[71874]: WARNING nova.compute.manager [req-dc1bb31e-37cf-4d5a-bba3-c233af00a211 req-0cdc7c24-698c-4c41-84b6-38c3c0be86ac service nova] [instance: 8503d42f-646c-4e59-91fd-0c006b08de7b] Received unexpected event network-vif-plugged-48d1ca2a-7881-4f05-a889-0e40e46c0e12 for instance with vm_state building and task_state spawning.
Apr 12 16:20:58 user nova-compute[71874]: DEBUG nova.virt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Emitting event <LifecycleEvent: 1681316458.567039, 8503d42f-646c-4e59-91fd-0c006b08de7b => Resumed> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:20:58 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 8503d42f-646c-4e59-91fd-0c006b08de7b] VM Resumed (Lifecycle Event)
Apr 12 16:20:58 user nova-compute[71874]: DEBUG nova.compute.manager [None req-dd8fd665-654f-4fa0-8e55-03f97cbbff9d tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 8503d42f-646c-4e59-91fd-0c006b08de7b] Instance event wait completed in 0 seconds for  {{(pid=71874) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 16:20:58 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-dd8fd665-654f-4fa0-8e55-03f97cbbff9d tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 8503d42f-646c-4e59-91fd-0c006b08de7b] Guest created on hypervisor {{(pid=71874) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 16:20:58 user nova-compute[71874]: INFO nova.virt.libvirt.driver [-] [instance: 8503d42f-646c-4e59-91fd-0c006b08de7b] Instance spawned successfully.
Apr 12 16:20:58 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-dd8fd665-654f-4fa0-8e55-03f97cbbff9d tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 8503d42f-646c-4e59-91fd-0c006b08de7b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 16:20:58 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 8503d42f-646c-4e59-91fd-0c006b08de7b] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:20:58 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 8503d42f-646c-4e59-91fd-0c006b08de7b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 16:20:58 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-dd8fd665-654f-4fa0-8e55-03f97cbbff9d tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 8503d42f-646c-4e59-91fd-0c006b08de7b] Found default for hw_cdrom_bus of ide {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:20:58 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-dd8fd665-654f-4fa0-8e55-03f97cbbff9d tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 8503d42f-646c-4e59-91fd-0c006b08de7b] Found default for hw_disk_bus of virtio {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:20:58 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-dd8fd665-654f-4fa0-8e55-03f97cbbff9d tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 8503d42f-646c-4e59-91fd-0c006b08de7b] Found default for hw_input_bus of None {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:20:58 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-dd8fd665-654f-4fa0-8e55-03f97cbbff9d tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 8503d42f-646c-4e59-91fd-0c006b08de7b] Found default for hw_pointer_model of None {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:20:58 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-dd8fd665-654f-4fa0-8e55-03f97cbbff9d tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 8503d42f-646c-4e59-91fd-0c006b08de7b] Found default for hw_video_model of virtio {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:20:58 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-dd8fd665-654f-4fa0-8e55-03f97cbbff9d tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 8503d42f-646c-4e59-91fd-0c006b08de7b] Found default for hw_vif_model of virtio {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:20:58 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 8503d42f-646c-4e59-91fd-0c006b08de7b] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 16:20:58 user nova-compute[71874]: DEBUG nova.virt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Emitting event <LifecycleEvent: 1681316458.5690217, 8503d42f-646c-4e59-91fd-0c006b08de7b => Started> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:20:58 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 8503d42f-646c-4e59-91fd-0c006b08de7b] VM Started (Lifecycle Event)
Apr 12 16:20:58 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 8503d42f-646c-4e59-91fd-0c006b08de7b] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:20:58 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 8503d42f-646c-4e59-91fd-0c006b08de7b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 16:20:58 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 8503d42f-646c-4e59-91fd-0c006b08de7b] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 16:20:58 user nova-compute[71874]: INFO nova.compute.manager [None req-dd8fd665-654f-4fa0-8e55-03f97cbbff9d tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 8503d42f-646c-4e59-91fd-0c006b08de7b] Took 6.19 seconds to spawn the instance on the hypervisor.
Apr 12 16:20:58 user nova-compute[71874]: DEBUG nova.compute.manager [None req-dd8fd665-654f-4fa0-8e55-03f97cbbff9d tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 8503d42f-646c-4e59-91fd-0c006b08de7b] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:20:58 user nova-compute[71874]: INFO nova.compute.manager [None req-dd8fd665-654f-4fa0-8e55-03f97cbbff9d tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 8503d42f-646c-4e59-91fd-0c006b08de7b] Took 7.70 seconds to build instance.
Apr 12 16:20:58 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-dd8fd665-654f-4fa0-8e55-03f97cbbff9d tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "8503d42f-646c-4e59-91fd-0c006b08de7b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.802s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:20:59 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:21:04 user nova-compute[71874]: DEBUG nova.compute.manager [req-d8c10a75-6ca1-4d90-bb55-33afae0a0764 req-fc2627c3-9db3-4a66-b805-360ae3e1eced service nova] [instance: 540a8fd5-8c18-4efe-97d4-9f0942cebcf5] Received event network-changed-be492426-cc7d-4f76-80a2-ab97d8733e58 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:21:04 user nova-compute[71874]: DEBUG nova.compute.manager [req-d8c10a75-6ca1-4d90-bb55-33afae0a0764 req-fc2627c3-9db3-4a66-b805-360ae3e1eced service nova] [instance: 540a8fd5-8c18-4efe-97d4-9f0942cebcf5] Refreshing instance network info cache due to event network-changed-be492426-cc7d-4f76-80a2-ab97d8733e58. {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 16:21:04 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-d8c10a75-6ca1-4d90-bb55-33afae0a0764 req-fc2627c3-9db3-4a66-b805-360ae3e1eced service nova] Acquiring lock "refresh_cache-540a8fd5-8c18-4efe-97d4-9f0942cebcf5" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:21:04 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-d8c10a75-6ca1-4d90-bb55-33afae0a0764 req-fc2627c3-9db3-4a66-b805-360ae3e1eced service nova] Acquired lock "refresh_cache-540a8fd5-8c18-4efe-97d4-9f0942cebcf5" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:21:04 user nova-compute[71874]: DEBUG nova.network.neutron [req-d8c10a75-6ca1-4d90-bb55-33afae0a0764 req-fc2627c3-9db3-4a66-b805-360ae3e1eced service nova] [instance: 540a8fd5-8c18-4efe-97d4-9f0942cebcf5] Refreshing network info cache for port be492426-cc7d-4f76-80a2-ab97d8733e58 {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 16:21:04 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:21:04 user nova-compute[71874]: DEBUG nova.network.neutron [req-d8c10a75-6ca1-4d90-bb55-33afae0a0764 req-fc2627c3-9db3-4a66-b805-360ae3e1eced service nova] [instance: 540a8fd5-8c18-4efe-97d4-9f0942cebcf5] Updated VIF entry in instance network info cache for port be492426-cc7d-4f76-80a2-ab97d8733e58. {{(pid=71874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 16:21:04 user nova-compute[71874]: DEBUG nova.network.neutron [req-d8c10a75-6ca1-4d90-bb55-33afae0a0764 req-fc2627c3-9db3-4a66-b805-360ae3e1eced service nova] [instance: 540a8fd5-8c18-4efe-97d4-9f0942cebcf5] Updating instance_info_cache with network_info: [{"id": "be492426-cc7d-4f76-80a2-ab97d8733e58", "address": "fa:16:3e:23:bb:b8", "network": {"id": "9c134a59-09c8-44dc-b4c7-3bb522d3f948", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-787092091-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29d8082517724895a2027594f440071d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe492426-cc", "ovs_interfaceid": "be492426-cc7d-4f76-80a2-ab97d8733e58", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:21:04 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-d8c10a75-6ca1-4d90-bb55-33afae0a0764 req-fc2627c3-9db3-4a66-b805-360ae3e1eced service nova] Releasing lock "refresh_cache-540a8fd5-8c18-4efe-97d4-9f0942cebcf5" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:21:06 user nova-compute[71874]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681316451.3122559, 1b613235-a905-466f-b9cc-a21a321a6313 => Stopped> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:21:06 user nova-compute[71874]: INFO nova.compute.manager [-] [instance: 1b613235-a905-466f-b9cc-a21a321a6313] VM Stopped (Lifecycle Event)
Apr 12 16:21:06 user nova-compute[71874]: DEBUG nova.compute.manager [None req-a9d3f85d-98ba-4f5a-8b97-13b7fdef01c8 None None] [instance: 1b613235-a905-466f-b9cc-a21a321a6313] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:21:07 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-0e4660f4-be92-46c8-96b9-3a201faa3f3b tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Acquiring lock "540a8fd5-8c18-4efe-97d4-9f0942cebcf5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:21:07 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-0e4660f4-be92-46c8-96b9-3a201faa3f3b tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "540a8fd5-8c18-4efe-97d4-9f0942cebcf5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:21:07 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-0e4660f4-be92-46c8-96b9-3a201faa3f3b tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Acquiring lock "540a8fd5-8c18-4efe-97d4-9f0942cebcf5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:21:07 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-0e4660f4-be92-46c8-96b9-3a201faa3f3b tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "540a8fd5-8c18-4efe-97d4-9f0942cebcf5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:21:07 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-0e4660f4-be92-46c8-96b9-3a201faa3f3b tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "540a8fd5-8c18-4efe-97d4-9f0942cebcf5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:21:07 user nova-compute[71874]: INFO nova.compute.manager [None req-0e4660f4-be92-46c8-96b9-3a201faa3f3b tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] [instance: 540a8fd5-8c18-4efe-97d4-9f0942cebcf5] Terminating instance
Apr 12 16:21:07 user nova-compute[71874]: DEBUG nova.compute.manager [None req-0e4660f4-be92-46c8-96b9-3a201faa3f3b tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] [instance: 540a8fd5-8c18-4efe-97d4-9f0942cebcf5] Start destroying the instance on the hypervisor. {{(pid=71874) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 16:21:07 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:21:07 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:21:07 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:21:07 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:21:08 user nova-compute[71874]: DEBUG nova.compute.manager [req-0f00b49d-c297-4027-8829-c52e7581c257 req-b653f051-c882-4d5c-afaf-2dcae2d640cc service nova] [instance: 540a8fd5-8c18-4efe-97d4-9f0942cebcf5] Received event network-vif-unplugged-be492426-cc7d-4f76-80a2-ab97d8733e58 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:21:08 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-0f00b49d-c297-4027-8829-c52e7581c257 req-b653f051-c882-4d5c-afaf-2dcae2d640cc service nova] Acquiring lock "540a8fd5-8c18-4efe-97d4-9f0942cebcf5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:21:08 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-0f00b49d-c297-4027-8829-c52e7581c257 req-b653f051-c882-4d5c-afaf-2dcae2d640cc service nova] Lock "540a8fd5-8c18-4efe-97d4-9f0942cebcf5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:21:08 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-0f00b49d-c297-4027-8829-c52e7581c257 req-b653f051-c882-4d5c-afaf-2dcae2d640cc service nova] Lock "540a8fd5-8c18-4efe-97d4-9f0942cebcf5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:21:08 user nova-compute[71874]: DEBUG nova.compute.manager [req-0f00b49d-c297-4027-8829-c52e7581c257 req-b653f051-c882-4d5c-afaf-2dcae2d640cc service nova] [instance: 540a8fd5-8c18-4efe-97d4-9f0942cebcf5] No waiting events found dispatching network-vif-unplugged-be492426-cc7d-4f76-80a2-ab97d8733e58 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:21:08 user nova-compute[71874]: DEBUG nova.compute.manager [req-0f00b49d-c297-4027-8829-c52e7581c257 req-b653f051-c882-4d5c-afaf-2dcae2d640cc service nova] [instance: 540a8fd5-8c18-4efe-97d4-9f0942cebcf5] Received event network-vif-unplugged-be492426-cc7d-4f76-80a2-ab97d8733e58 for instance with task_state deleting. {{(pid=71874) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 16:21:08 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:21:08 user nova-compute[71874]: INFO nova.virt.libvirt.driver [-] [instance: 540a8fd5-8c18-4efe-97d4-9f0942cebcf5] Instance destroyed successfully.
Apr 12 16:21:08 user nova-compute[71874]: DEBUG nova.objects.instance [None req-0e4660f4-be92-46c8-96b9-3a201faa3f3b tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lazy-loading 'resources' on Instance uuid 540a8fd5-8c18-4efe-97d4-9f0942cebcf5 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:21:08 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-0e4660f4-be92-46c8-96b9-3a201faa3f3b tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T16:14:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-491760148',display_name='tempest-SnapshotDataIntegrityTests-server-491760148',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-491760148',id=36,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA+FpbR8FK82hCEPJ5HMQ8owWEJRGyodg69j5jSQV/QhgdEnkk4eYIy7X1tEJsjea4X8jfMn9W0N1l8a7XMKl5DRaLYt49U8Vr9yiskiXDGQVl0iBNmRtOG0NsqYt2si5A==',key_name='tempest-SnapshotDataIntegrityTests-437348076',keypairs=<?>,launch_index=0,launched_at=2023-04-12T16:14:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='29d8082517724895a2027594f440071d',ramdisk_id='',reservation_id='r-a3mgbodc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-540489687',owner_user_name='tempest-SnapshotDataIntegrityTests-540489687-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T16:14:50Z,user_data=None,user_id='3823da50be004112aaa5ee35b724c6df',uuid=540a8fd5-8c18-4efe-97d4-9f0942cebcf5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "be492426-cc7d-4f76-80a2-ab97d8733e58", "address": "fa:16:3e:23:bb:b8", "network": {"id": "9c134a59-09c8-44dc-b4c7-3bb522d3f948", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-787092091-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29d8082517724895a2027594f440071d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe492426-cc", "ovs_interfaceid": "be492426-cc7d-4f76-80a2-ab97d8733e58", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 16:21:08 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-0e4660f4-be92-46c8-96b9-3a201faa3f3b tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Converting VIF {"id": "be492426-cc7d-4f76-80a2-ab97d8733e58", "address": "fa:16:3e:23:bb:b8", "network": {"id": "9c134a59-09c8-44dc-b4c7-3bb522d3f948", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-787092091-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29d8082517724895a2027594f440071d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe492426-cc", "ovs_interfaceid": "be492426-cc7d-4f76-80a2-ab97d8733e58", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:21:08 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-0e4660f4-be92-46c8-96b9-3a201faa3f3b tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:23:bb:b8,bridge_name='br-int',has_traffic_filtering=True,id=be492426-cc7d-4f76-80a2-ab97d8733e58,network=Network(9c134a59-09c8-44dc-b4c7-3bb522d3f948),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe492426-cc') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:21:08 user nova-compute[71874]: DEBUG os_vif [None req-0e4660f4-be92-46c8-96b9-3a201faa3f3b tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:bb:b8,bridge_name='br-int',has_traffic_filtering=True,id=be492426-cc7d-4f76-80a2-ab97d8733e58,network=Network(9c134a59-09c8-44dc-b4c7-3bb522d3f948),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe492426-cc') {{(pid=71874) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 16:21:08 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:21:08 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbe492426-cc, bridge=br-int, if_exists=True) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:21:08 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:21:08 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:21:08 user nova-compute[71874]: INFO os_vif [None req-0e4660f4-be92-46c8-96b9-3a201faa3f3b tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:bb:b8,bridge_name='br-int',has_traffic_filtering=True,id=be492426-cc7d-4f76-80a2-ab97d8733e58,network=Network(9c134a59-09c8-44dc-b4c7-3bb522d3f948),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe492426-cc')
Apr 12 16:21:08 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-0e4660f4-be92-46c8-96b9-3a201faa3f3b tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] [instance: 540a8fd5-8c18-4efe-97d4-9f0942cebcf5] Deleting instance files /opt/stack/data/nova/instances/540a8fd5-8c18-4efe-97d4-9f0942cebcf5_del
Apr 12 16:21:08 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-0e4660f4-be92-46c8-96b9-3a201faa3f3b tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] [instance: 540a8fd5-8c18-4efe-97d4-9f0942cebcf5] Deletion of /opt/stack/data/nova/instances/540a8fd5-8c18-4efe-97d4-9f0942cebcf5_del complete
Apr 12 16:21:08 user nova-compute[71874]: INFO nova.compute.manager [None req-0e4660f4-be92-46c8-96b9-3a201faa3f3b tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] [instance: 540a8fd5-8c18-4efe-97d4-9f0942cebcf5] Took 0.91 seconds to destroy the instance on the hypervisor.
Apr 12 16:21:08 user nova-compute[71874]: DEBUG oslo.service.loopingcall [None req-0e4660f4-be92-46c8-96b9-3a201faa3f3b tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71874) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 16:21:08 user nova-compute[71874]: DEBUG nova.compute.manager [-] [instance: 540a8fd5-8c18-4efe-97d4-9f0942cebcf5] Deallocating network for instance {{(pid=71874) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 16:21:08 user nova-compute[71874]: DEBUG nova.network.neutron [-] [instance: 540a8fd5-8c18-4efe-97d4-9f0942cebcf5] deallocate_for_instance() {{(pid=71874) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 16:21:09 user nova-compute[71874]: DEBUG nova.network.neutron [-] [instance: 540a8fd5-8c18-4efe-97d4-9f0942cebcf5] Updating instance_info_cache with network_info: [] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:21:09 user nova-compute[71874]: INFO nova.compute.manager [-] [instance: 540a8fd5-8c18-4efe-97d4-9f0942cebcf5] Took 0.51 seconds to deallocate network for instance.
Apr 12 16:21:09 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-0e4660f4-be92-46c8-96b9-3a201faa3f3b tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:21:09 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-0e4660f4-be92-46c8-96b9-3a201faa3f3b tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:21:09 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-0e4660f4-be92-46c8-96b9-3a201faa3f3b tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Inventory has not changed in ProviderTree for provider: 0e94b4c8-cd49-45e4-9133-d36eb4b2456b {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 16:21:09 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-0e4660f4-be92-46c8-96b9-3a201faa3f3b tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Inventory has not changed for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 16:21:09 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-0e4660f4-be92-46c8-96b9-3a201faa3f3b tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.253s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:21:09 user nova-compute[71874]: INFO nova.scheduler.client.report [None req-0e4660f4-be92-46c8-96b9-3a201faa3f3b tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Deleted allocations for instance 540a8fd5-8c18-4efe-97d4-9f0942cebcf5
Apr 12 16:21:09 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-0e4660f4-be92-46c8-96b9-3a201faa3f3b tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "540a8fd5-8c18-4efe-97d4-9f0942cebcf5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.882s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:21:10 user nova-compute[71874]: DEBUG nova.compute.manager [req-1f477cc1-8afc-4e97-a21a-23d40fcfec30 req-9a01e3ae-9295-4cd6-9e1f-913476ba8f03 service nova] [instance: 540a8fd5-8c18-4efe-97d4-9f0942cebcf5] Received event network-vif-plugged-be492426-cc7d-4f76-80a2-ab97d8733e58 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:21:10 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-1f477cc1-8afc-4e97-a21a-23d40fcfec30 req-9a01e3ae-9295-4cd6-9e1f-913476ba8f03 service nova] Acquiring lock "540a8fd5-8c18-4efe-97d4-9f0942cebcf5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:21:10 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-1f477cc1-8afc-4e97-a21a-23d40fcfec30 req-9a01e3ae-9295-4cd6-9e1f-913476ba8f03 service nova] Lock "540a8fd5-8c18-4efe-97d4-9f0942cebcf5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:21:10 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-1f477cc1-8afc-4e97-a21a-23d40fcfec30 req-9a01e3ae-9295-4cd6-9e1f-913476ba8f03 service nova] Lock "540a8fd5-8c18-4efe-97d4-9f0942cebcf5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:21:10 user nova-compute[71874]: DEBUG nova.compute.manager [req-1f477cc1-8afc-4e97-a21a-23d40fcfec30 req-9a01e3ae-9295-4cd6-9e1f-913476ba8f03 service nova] [instance: 540a8fd5-8c18-4efe-97d4-9f0942cebcf5] No waiting events found dispatching network-vif-plugged-be492426-cc7d-4f76-80a2-ab97d8733e58 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:21:10 user nova-compute[71874]: WARNING nova.compute.manager [req-1f477cc1-8afc-4e97-a21a-23d40fcfec30 req-9a01e3ae-9295-4cd6-9e1f-913476ba8f03 service nova] [instance: 540a8fd5-8c18-4efe-97d4-9f0942cebcf5] Received unexpected event network-vif-plugged-be492426-cc7d-4f76-80a2-ab97d8733e58 for instance with vm_state deleted and task_state None.
Apr 12 16:21:10 user nova-compute[71874]: DEBUG nova.compute.manager [req-1f477cc1-8afc-4e97-a21a-23d40fcfec30 req-9a01e3ae-9295-4cd6-9e1f-913476ba8f03 service nova] [instance: 540a8fd5-8c18-4efe-97d4-9f0942cebcf5] Received event network-vif-deleted-be492426-cc7d-4f76-80a2-ab97d8733e58 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:21:13 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:21:13 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:21:18 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:21:18 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:21:19 user nova-compute[71874]: INFO nova.compute.manager [None req-5e7e1259-eba1-410f-8674-2d2edab26814 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] Get console output
Apr 12 16:21:19 user nova-compute[71874]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Apr 12 16:21:23 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:21:23 user nova-compute[71874]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681316468.5452545, 540a8fd5-8c18-4efe-97d4-9f0942cebcf5 => Stopped> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:21:23 user nova-compute[71874]: INFO nova.compute.manager [-] [instance: 540a8fd5-8c18-4efe-97d4-9f0942cebcf5] VM Stopped (Lifecycle Event)
Apr 12 16:21:23 user nova-compute[71874]: DEBUG nova.compute.manager [None req-b794c8c0-3977-4e2d-8054-96b48ecc13b1 None None] [instance: 540a8fd5-8c18-4efe-97d4-9f0942cebcf5] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:21:23 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:21:28 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:21:28 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:21:28 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:21:28 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:21:28 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:21:28 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:21:28 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Auditing locally available compute resources for user (node: user) {{(pid=71874) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 16:21:28 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 16:21:28 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 16:21:29 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 16:21:29 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8503d42f-646c-4e59-91fd-0c006b08de7b/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:21:29 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8503d42f-646c-4e59-91fd-0c006b08de7b/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:21:29 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8503d42f-646c-4e59-91fd-0c006b08de7b/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:21:29 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8503d42f-646c-4e59-91fd-0c006b08de7b/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:21:29 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32471bee-e77e-4a1b-8e00-d938a1373976/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:21:29 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32471bee-e77e-4a1b-8e00-d938a1373976/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:21:29 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32471bee-e77e-4a1b-8e00-d938a1373976/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:21:29 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32471bee-e77e-4a1b-8e00-d938a1373976/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:21:30 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:21:30 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:21:30 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Hypervisor/Node resource view: name=user free_ram=8185MB free_disk=25.968971252441406GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71874) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 16:21:30 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:21:30 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:21:30 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 32471bee-e77e-4a1b-8e00-d938a1373976 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:21:30 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance bef10c89-360e-42d6-aa26-7edf1afca567 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:21:30 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 77842113-37e8-4dc3-bd28-84417eb1ac31 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:21:30 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance eb6ec19f-61e7-43af-92d7-44fbf8535d04 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:21:30 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 8503d42f-646c-4e59-91fd-0c006b08de7b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:21:30 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=71874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 16:21:30 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Final resource view: name=user phys_ram=16023MB used_ram=1216MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=71874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 16:21:30 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Inventory has not changed in ProviderTree for provider: 0e94b4c8-cd49-45e4-9133-d36eb4b2456b {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 16:21:30 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Inventory has not changed for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 16:21:30 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Compute_service record updated for user:user {{(pid=71874) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 16:21:30 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.313s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:21:33 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:21:33 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:21:33 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:21:33 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:21:33 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71874) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 16:21:33 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71874) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 16:21:33 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71874) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 16:21:33 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:21:33 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:21:34 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:21:34 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:21:34 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Starting heal instance info cache {{(pid=71874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 16:21:34 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquiring lock "refresh_cache-32471bee-e77e-4a1b-8e00-d938a1373976" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:21:34 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquired lock "refresh_cache-32471bee-e77e-4a1b-8e00-d938a1373976" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:21:34 user nova-compute[71874]: DEBUG nova.network.neutron [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] [instance: 32471bee-e77e-4a1b-8e00-d938a1373976] Forcefully refreshing network info cache for instance {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 16:21:35 user nova-compute[71874]: DEBUG nova.network.neutron [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] [instance: 32471bee-e77e-4a1b-8e00-d938a1373976] Updating instance_info_cache with network_info: [{"id": "69029e57-b138-43c1-b31f-59bc7957994d", "address": "fa:16:3e:04:8e:ce", "network": {"id": "e6694358-e361-4952-b859-93755c11721e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-667152893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97ea81bd1962466bbe552424973f71a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69029e57-b1", "ovs_interfaceid": "69029e57-b138-43c1-b31f-59bc7957994d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:21:35 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Releasing lock "refresh_cache-32471bee-e77e-4a1b-8e00-d938a1373976" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:21:35 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] [instance: 32471bee-e77e-4a1b-8e00-d938a1373976] Updated the network info_cache for instance {{(pid=71874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 16:21:36 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:21:36 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:21:36 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71874) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 16:21:38 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:21:38 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:21:39 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:21:39 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:21:43 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:21:43 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:21:43 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:21:48 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:21:53 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:21:53 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:21:53 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71874) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 16:21:53 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71874) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 16:21:53 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71874) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 16:21:53 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:21:57 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:21:58 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:22:00 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-fe1c29db-9eeb-4200-a4a5-c36b8b73ad0e tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "eb6ec19f-61e7-43af-92d7-44fbf8535d04" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:22:00 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-fe1c29db-9eeb-4200-a4a5-c36b8b73ad0e tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "eb6ec19f-61e7-43af-92d7-44fbf8535d04" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:22:00 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-fe1c29db-9eeb-4200-a4a5-c36b8b73ad0e tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "eb6ec19f-61e7-43af-92d7-44fbf8535d04-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:22:00 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-fe1c29db-9eeb-4200-a4a5-c36b8b73ad0e tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "eb6ec19f-61e7-43af-92d7-44fbf8535d04-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:22:00 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-fe1c29db-9eeb-4200-a4a5-c36b8b73ad0e tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "eb6ec19f-61e7-43af-92d7-44fbf8535d04-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:22:00 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:22:00 user nova-compute[71874]: INFO nova.compute.manager [None req-fe1c29db-9eeb-4200-a4a5-c36b8b73ad0e tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: eb6ec19f-61e7-43af-92d7-44fbf8535d04] Terminating instance
Apr 12 16:22:00 user nova-compute[71874]: DEBUG nova.compute.manager [None req-fe1c29db-9eeb-4200-a4a5-c36b8b73ad0e tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: eb6ec19f-61e7-43af-92d7-44fbf8535d04] Start destroying the instance on the hypervisor. {{(pid=71874) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 16:22:00 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:22:00 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:22:00 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:22:01 user nova-compute[71874]: DEBUG nova.compute.manager [req-df40a2a0-44df-40ff-8f0a-103fdcbeaa0c req-33701265-998a-4270-aa0f-bd093d921552 service nova] [instance: eb6ec19f-61e7-43af-92d7-44fbf8535d04] Received event network-vif-unplugged-b392629c-5b31-400b-be14-aa168e45f717 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:22:01 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-df40a2a0-44df-40ff-8f0a-103fdcbeaa0c req-33701265-998a-4270-aa0f-bd093d921552 service nova] Acquiring lock "eb6ec19f-61e7-43af-92d7-44fbf8535d04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:22:01 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-df40a2a0-44df-40ff-8f0a-103fdcbeaa0c req-33701265-998a-4270-aa0f-bd093d921552 service nova] Lock "eb6ec19f-61e7-43af-92d7-44fbf8535d04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:22:01 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-df40a2a0-44df-40ff-8f0a-103fdcbeaa0c req-33701265-998a-4270-aa0f-bd093d921552 service nova] Lock "eb6ec19f-61e7-43af-92d7-44fbf8535d04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:22:01 user nova-compute[71874]: DEBUG nova.compute.manager [req-df40a2a0-44df-40ff-8f0a-103fdcbeaa0c req-33701265-998a-4270-aa0f-bd093d921552 service nova] [instance: eb6ec19f-61e7-43af-92d7-44fbf8535d04] No waiting events found dispatching network-vif-unplugged-b392629c-5b31-400b-be14-aa168e45f717 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:22:01 user nova-compute[71874]: DEBUG nova.compute.manager [req-df40a2a0-44df-40ff-8f0a-103fdcbeaa0c req-33701265-998a-4270-aa0f-bd093d921552 service nova] [instance: eb6ec19f-61e7-43af-92d7-44fbf8535d04] Received event network-vif-unplugged-b392629c-5b31-400b-be14-aa168e45f717 for instance with task_state deleting. {{(pid=71874) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 16:22:01 user nova-compute[71874]: INFO nova.virt.libvirt.driver [-] [instance: eb6ec19f-61e7-43af-92d7-44fbf8535d04] Instance destroyed successfully.
Apr 12 16:22:01 user nova-compute[71874]: DEBUG nova.objects.instance [None req-fe1c29db-9eeb-4200-a4a5-c36b8b73ad0e tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lazy-loading 'resources' on Instance uuid eb6ec19f-61e7-43af-92d7-44fbf8535d04 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:22:01 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-fe1c29db-9eeb-4200-a4a5-c36b8b73ad0e tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T16:20:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1807466168',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1807466168',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1807466168',id=40,image_ref='85e3d4b3-113c-46c2-9365-bfa680ff8338',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T16:20:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='29b1b89a5eeb408a8d0938e5f59f405f',ramdisk_id='',reservation_id='r-h5ug49mp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-734600841',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-734600841-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-734600841',owner_user_name='tempest-TestVolumeBootPattern-734600841-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T16:20:27Z,user_data=None,user_id='7054687447fc42339e9046ced4915890',uuid=eb6ec19f-61e7-43af-92d7-44fbf8535d04,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b392629c-5b31-400b-be14-aa168e45f717", "address": "fa:16:3e:71:a8:aa", "network": {"id": "1439244b-8287-4bba-a88c-99d4b498cccd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1491302639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29b1b89a5eeb408a8d0938e5f59f405f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb392629c-5b", "ovs_interfaceid": "b392629c-5b31-400b-be14-aa168e45f717", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 16:22:01 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-fe1c29db-9eeb-4200-a4a5-c36b8b73ad0e tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Converting VIF {"id": "b392629c-5b31-400b-be14-aa168e45f717", "address": "fa:16:3e:71:a8:aa", "network": {"id": "1439244b-8287-4bba-a88c-99d4b498cccd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1491302639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29b1b89a5eeb408a8d0938e5f59f405f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb392629c-5b", "ovs_interfaceid": "b392629c-5b31-400b-be14-aa168e45f717", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:22:01 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-fe1c29db-9eeb-4200-a4a5-c36b8b73ad0e tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:a8:aa,bridge_name='br-int',has_traffic_filtering=True,id=b392629c-5b31-400b-be14-aa168e45f717,network=Network(1439244b-8287-4bba-a88c-99d4b498cccd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb392629c-5b') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:22:01 user nova-compute[71874]: DEBUG os_vif [None req-fe1c29db-9eeb-4200-a4a5-c36b8b73ad0e tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:a8:aa,bridge_name='br-int',has_traffic_filtering=True,id=b392629c-5b31-400b-be14-aa168e45f717,network=Network(1439244b-8287-4bba-a88c-99d4b498cccd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb392629c-5b') {{(pid=71874) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 16:22:01 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:22:01 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb392629c-5b, bridge=br-int, if_exists=True) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:22:01 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:22:01 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:22:01 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:22:01 user nova-compute[71874]: INFO os_vif [None req-fe1c29db-9eeb-4200-a4a5-c36b8b73ad0e tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:a8:aa,bridge_name='br-int',has_traffic_filtering=True,id=b392629c-5b31-400b-be14-aa168e45f717,network=Network(1439244b-8287-4bba-a88c-99d4b498cccd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb392629c-5b')
Apr 12 16:22:01 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe1c29db-9eeb-4200-a4a5-c36b8b73ad0e tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: eb6ec19f-61e7-43af-92d7-44fbf8535d04] calling os-brick to detach iSCSI Volume {{(pid=71874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 16:22:01 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe1c29db-9eeb-4200-a4a5-c36b8b73ad0e tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3c0216320>, {'target_iqn': 'iqn.2010-10.org.openstack:f1a40711-37cc-48c3-9696-d6d52670932c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PIWcQZAN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:22:01 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-fe1c29db-9eeb-4200-a4a5-c36b8b73ad0e tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:22:01 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-fe1c29db-9eeb-4200-a4a5-c36b8b73ad0e tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:22:01 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-fe1c29db-9eeb-4200-a4a5-c36b8b73ad0e tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:22:01 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:22:01 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:22:01 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d53c8bf-1cbb-4f0f-9e43-7c1b7478ad0e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f1a40711-37cc-48c3-9696-d6d52670932c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:952c0ad3-7b56-454e-af58-10213195373d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:22:01 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe1c29db-9eeb-4200-a4a5-c36b8b73ad0e tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 16:22:01 user nova-compute[71874]: No targets found.
Apr 12 16:22:01 user nova-compute[71874]: iSNS:
Apr 12 16:22:01 user nova-compute[71874]: No targets found.
Apr 12 16:22:01 user nova-compute[71874]: STATIC:
Apr 12 16:22:01 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:f1a40711-37cc-48c3-9696-d6d52670932c
Apr 12 16:22:01 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:22:01 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:22:01 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:952c0ad3-7b56-454e-af58-10213195373d
Apr 12 16:22:01 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:22:01 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:22:01 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775
Apr 12 16:22:01 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:22:01 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:22:01 user nova-compute[71874]: FIRMWARE:
Apr 12 16:22:01 user nova-compute[71874]: No targets found.
Apr 12 16:22:01 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:22:01 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe1c29db-9eeb-4200-a4a5-c36b8b73ad0e tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 16:22:01 user nova-compute[71874]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 16:22:01 user nova-compute[71874]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71874) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 16:22:01 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe1c29db-9eeb-4200-a4a5-c36b8b73ad0e tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f1a40711-37cc-48c3-9696-d6d52670932c', 0)] {{(pid=71874) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 16:22:01 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:22:01 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.032s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:22:01 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[11f838cb-f285-463c-b6b8-2b689566f091]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:952c0ad3-7b56-454e-af58-10213195373d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f1a40711-37cc-48c3-9696-d6d52670932c\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:22:01 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:22:01 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:22:01 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b5ff9c8-a243-4896-85eb-239d8a0148e0]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:952c0ad3-7b56-454e-af58-10213195373d (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1a40711-37cc-48c3-9696-d6d52670932c (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:22:01 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe1c29db-9eeb-4200-a4a5-c36b8b73ad0e tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775 (non-flash)
Apr 12 16:22:01 user nova-compute[71874]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:952c0ad3-7b56-454e-af58-10213195373d (non-flash)
Apr 12 16:22:01 user nova-compute[71874]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1a40711-37cc-48c3-9696-d6d52670932c (non-flash)
Apr 12 16:22:01 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:22:01 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe1c29db-9eeb-4200-a4a5-c36b8b73ad0e tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775 (non-flash)
Apr 12 16:22:01 user nova-compute[71874]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:952c0ad3-7b56-454e-af58-10213195373d (non-flash)
Apr 12 16:22:01 user nova-compute[71874]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1a40711-37cc-48c3-9696-d6d52670932c (non-flash)
Apr 12 16:22:01 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:22:01 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe1c29db-9eeb-4200-a4a5-c36b8b73ad0e tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc3c07e9000>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f1a40711-37cc-48c3-9696-d6d52670932c'): ({'sdc'}, set())}) {{(pid=71874) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 16:22:01 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-fe1c29db-9eeb-4200-a4a5-c36b8b73ad0e tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Removing single pathed devices sdc {{(pid=71874) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 16:22:01 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:22:01 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:22:01 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7da7d7d-fc40-4107-8621-c1e1d6bbb356]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:22:01 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:22:01 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.024s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:22:01 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[32cb4c3f-04d0-40f8-9b93-9109e491fa03]: (4, ('ok\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:22:01 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-fe1c29db-9eeb-4200-a4a5-c36b8b73ad0e tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Flushing IO for device /dev/sdc {{(pid=71874) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 16:22:01 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:22:01 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:22:01 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb507c32-feac-41b9-b48a-49aa08997da7]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:22:01 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-fe1c29db-9eeb-4200-a4a5-c36b8b73ad0e tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71874) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 16:22:01 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:22:01 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:22:01 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bd67da2-0abd-4a35-a4c8-95bdaedaad03]: (4, ('1', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:22:01 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-fe1c29db-9eeb-4200-a4a5-c36b8b73ad0e tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71874) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 16:22:01 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-fe1c29db-9eeb-4200-a4a5-c36b8b73ad0e tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] SCSI volumes sdc have been removed. {{(pid=71874) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 16:22:01 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe1c29db-9eeb-4200-a4a5-c36b8b73ad0e tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f1a40711-37cc-48c3-9696-d6d52670932c')] {{(pid=71874) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 16:22:01 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1a40711-37cc-48c3-9696-d6d52670932c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:22:01 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1a40711-37cc-48c3-9696-d6d52670932c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:22:01 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9872457-4b10-4e9b-b80b-0bbd482b6991]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:22:01 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe1c29db-9eeb-4200-a4a5-c36b8b73ad0e tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:22:01 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1a40711-37cc-48c3-9696-d6d52670932c -p 172.16.0.220:3260 --logout {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:22:01 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1a40711-37cc-48c3-9696-d6d52670932c -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:22:01 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdb45aab-86ed-495a-b4ff-1d08e588e5df]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:f1a40711-37cc-48c3-9696-d6d52670932c, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:f1a40711-37cc-48c3-9696-d6d52670932c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:22:01 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe1c29db-9eeb-4200-a4a5-c36b8b73ad0e tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:f1a40711-37cc-48c3-9696-d6d52670932c, portal: 172.16.0.220,3260]
Apr 12 16:22:01 user nova-compute[71874]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:f1a40711-37cc-48c3-9696-d6d52670932c, portal: 172.16.0.220,3260] successful.
Apr 12 16:22:01 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:22:01 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1a40711-37cc-48c3-9696-d6d52670932c -p 172.16.0.220:3260 --op delete {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:22:01 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1a40711-37cc-48c3-9696-d6d52670932c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:22:01 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[99dfacb1-ba6f-47aa-b240-f136df760fb3]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:22:01 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe1c29db-9eeb-4200-a4a5-c36b8b73ad0e tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:22:01 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-fe1c29db-9eeb-4200-a4a5-c36b8b73ad0e tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.348s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:22:01 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe1c29db-9eeb-4200-a4a5-c36b8b73ad0e tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] <== disconnect_volume: return (349ms) None {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:22:01 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe1c29db-9eeb-4200-a4a5-c36b8b73ad0e tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: eb6ec19f-61e7-43af-92d7-44fbf8535d04] Disconnected iSCSI Volume {{(pid=71874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 16:22:01 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-fe1c29db-9eeb-4200-a4a5-c36b8b73ad0e tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: eb6ec19f-61e7-43af-92d7-44fbf8535d04] Deleting instance files /opt/stack/data/nova/instances/eb6ec19f-61e7-43af-92d7-44fbf8535d04_del
Apr 12 16:22:01 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-fe1c29db-9eeb-4200-a4a5-c36b8b73ad0e tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: eb6ec19f-61e7-43af-92d7-44fbf8535d04] Deletion of /opt/stack/data/nova/instances/eb6ec19f-61e7-43af-92d7-44fbf8535d04_del complete
Apr 12 16:22:01 user nova-compute[71874]: INFO nova.compute.manager [None req-fe1c29db-9eeb-4200-a4a5-c36b8b73ad0e tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: eb6ec19f-61e7-43af-92d7-44fbf8535d04] Took 1.26 seconds to destroy the instance on the hypervisor.
Apr 12 16:22:01 user nova-compute[71874]: DEBUG oslo.service.loopingcall [None req-fe1c29db-9eeb-4200-a4a5-c36b8b73ad0e tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71874) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 16:22:01 user nova-compute[71874]: DEBUG nova.compute.manager [-] [instance: eb6ec19f-61e7-43af-92d7-44fbf8535d04] Deallocating network for instance {{(pid=71874) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 16:22:01 user nova-compute[71874]: DEBUG nova.network.neutron [-] [instance: eb6ec19f-61e7-43af-92d7-44fbf8535d04] deallocate_for_instance() {{(pid=71874) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 16:22:02 user nova-compute[71874]: DEBUG nova.network.neutron [-] [instance: eb6ec19f-61e7-43af-92d7-44fbf8535d04] Updating instance_info_cache with network_info: [] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:22:02 user nova-compute[71874]: INFO nova.compute.manager [-] [instance: eb6ec19f-61e7-43af-92d7-44fbf8535d04] Took 0.60 seconds to deallocate network for instance.
Apr 12 16:22:02 user nova-compute[71874]: DEBUG nova.compute.manager [req-d19509f8-fd30-4ce0-97d6-8f48978958aa req-af3530d6-91a0-4576-82cb-1b066c1a18f4 service nova] [instance: eb6ec19f-61e7-43af-92d7-44fbf8535d04] Received event network-vif-deleted-b392629c-5b31-400b-be14-aa168e45f717 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:22:02 user nova-compute[71874]: INFO nova.compute.manager [req-d19509f8-fd30-4ce0-97d6-8f48978958aa req-af3530d6-91a0-4576-82cb-1b066c1a18f4 service nova] [instance: eb6ec19f-61e7-43af-92d7-44fbf8535d04] Neutron deleted interface b392629c-5b31-400b-be14-aa168e45f717; detaching it from the instance and deleting it from the info cache
Apr 12 16:22:02 user nova-compute[71874]: DEBUG nova.network.neutron [req-d19509f8-fd30-4ce0-97d6-8f48978958aa req-af3530d6-91a0-4576-82cb-1b066c1a18f4 service nova] [instance: eb6ec19f-61e7-43af-92d7-44fbf8535d04] Updating instance_info_cache with network_info: [] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:22:02 user nova-compute[71874]: DEBUG nova.compute.manager [req-d19509f8-fd30-4ce0-97d6-8f48978958aa req-af3530d6-91a0-4576-82cb-1b066c1a18f4 service nova] [instance: eb6ec19f-61e7-43af-92d7-44fbf8535d04] Detach interface failed, port_id=b392629c-5b31-400b-be14-aa168e45f717, reason: Instance eb6ec19f-61e7-43af-92d7-44fbf8535d04 could not be found. {{(pid=71874) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 12 16:22:03 user nova-compute[71874]: DEBUG nova.compute.manager [req-f9ae1b0f-edff-4400-9923-4568073076cd req-943f5ff8-d113-4dde-9db2-8f7228a1def7 service nova] [instance: eb6ec19f-61e7-43af-92d7-44fbf8535d04] Received event network-vif-plugged-b392629c-5b31-400b-be14-aa168e45f717 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:22:03 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-f9ae1b0f-edff-4400-9923-4568073076cd req-943f5ff8-d113-4dde-9db2-8f7228a1def7 service nova] Acquiring lock "eb6ec19f-61e7-43af-92d7-44fbf8535d04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:22:03 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-f9ae1b0f-edff-4400-9923-4568073076cd req-943f5ff8-d113-4dde-9db2-8f7228a1def7 service nova] Lock "eb6ec19f-61e7-43af-92d7-44fbf8535d04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:22:03 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-f9ae1b0f-edff-4400-9923-4568073076cd req-943f5ff8-d113-4dde-9db2-8f7228a1def7 service nova] Lock "eb6ec19f-61e7-43af-92d7-44fbf8535d04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:22:03 user nova-compute[71874]: DEBUG nova.compute.manager [req-f9ae1b0f-edff-4400-9923-4568073076cd req-943f5ff8-d113-4dde-9db2-8f7228a1def7 service nova] [instance: eb6ec19f-61e7-43af-92d7-44fbf8535d04] No waiting events found dispatching network-vif-plugged-b392629c-5b31-400b-be14-aa168e45f717 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:22:03 user nova-compute[71874]: WARNING nova.compute.manager [req-f9ae1b0f-edff-4400-9923-4568073076cd req-943f5ff8-d113-4dde-9db2-8f7228a1def7 service nova] [instance: eb6ec19f-61e7-43af-92d7-44fbf8535d04] Received unexpected event network-vif-plugged-b392629c-5b31-400b-be14-aa168e45f717 for instance with vm_state active and task_state deleting.
Apr 12 16:22:03 user nova-compute[71874]: INFO nova.compute.manager [None req-fe1c29db-9eeb-4200-a4a5-c36b8b73ad0e tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: eb6ec19f-61e7-43af-92d7-44fbf8535d04] Took 0.85 seconds to detach 1 volumes for instance.
Apr 12 16:22:03 user nova-compute[71874]: DEBUG nova.compute.manager [None req-fe1c29db-9eeb-4200-a4a5-c36b8b73ad0e tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: eb6ec19f-61e7-43af-92d7-44fbf8535d04] Deleting volume: f1a40711-37cc-48c3-9696-d6d52670932c {{(pid=71874) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 12 16:22:03 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-fe1c29db-9eeb-4200-a4a5-c36b8b73ad0e tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:22:03 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-fe1c29db-9eeb-4200-a4a5-c36b8b73ad0e tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:22:03 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-fe1c29db-9eeb-4200-a4a5-c36b8b73ad0e tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Inventory has not changed in ProviderTree for provider: 0e94b4c8-cd49-45e4-9133-d36eb4b2456b {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 16:22:03 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-fe1c29db-9eeb-4200-a4a5-c36b8b73ad0e tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Inventory has not changed for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 16:22:03 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-fe1c29db-9eeb-4200-a4a5-c36b8b73ad0e tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.229s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:22:03 user nova-compute[71874]: INFO nova.scheduler.client.report [None req-fe1c29db-9eeb-4200-a4a5-c36b8b73ad0e tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Deleted allocations for instance eb6ec19f-61e7-43af-92d7-44fbf8535d04
Apr 12 16:22:03 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-fe1c29db-9eeb-4200-a4a5-c36b8b73ad0e tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "eb6ec19f-61e7-43af-92d7-44fbf8535d04" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.229s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:22:03 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:22:06 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:22:08 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:22:11 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:22:13 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:22:16 user nova-compute[71874]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681316521.374566, eb6ec19f-61e7-43af-92d7-44fbf8535d04 => Stopped> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:22:16 user nova-compute[71874]: INFO nova.compute.manager [-] [instance: eb6ec19f-61e7-43af-92d7-44fbf8535d04] VM Stopped (Lifecycle Event)
Apr 12 16:22:16 user nova-compute[71874]: DEBUG nova.compute.manager [None req-5f723a2a-03dd-459e-a84b-7f098c75a7f3 None None] [instance: eb6ec19f-61e7-43af-92d7-44fbf8535d04] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:22:16 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:22:20 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-3ce9644a-3829-46ff-9cd6-3d4ccebb994a tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Acquiring lock "0ef81d71-afb0-4335-b60f-13071b957d08" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:22:20 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-3ce9644a-3829-46ff-9cd6-3d4ccebb994a tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Lock "0ef81d71-afb0-4335-b60f-13071b957d08" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:22:20 user nova-compute[71874]: DEBUG nova.compute.manager [None req-3ce9644a-3829-46ff-9cd6-3d4ccebb994a tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] [instance: 0ef81d71-afb0-4335-b60f-13071b957d08] Starting instance... {{(pid=71874) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 16:22:20 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-c582f687-7510-4cc7-a71c-9e38db5b93d1 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "bef10c89-360e-42d6-aa26-7edf1afca567" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:22:20 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-c582f687-7510-4cc7-a71c-9e38db5b93d1 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "bef10c89-360e-42d6-aa26-7edf1afca567" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:22:20 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-c582f687-7510-4cc7-a71c-9e38db5b93d1 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "bef10c89-360e-42d6-aa26-7edf1afca567-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:22:20 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-c582f687-7510-4cc7-a71c-9e38db5b93d1 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "bef10c89-360e-42d6-aa26-7edf1afca567-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:22:20 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-c582f687-7510-4cc7-a71c-9e38db5b93d1 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "bef10c89-360e-42d6-aa26-7edf1afca567-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:22:20 user nova-compute[71874]: INFO nova.compute.manager [None req-c582f687-7510-4cc7-a71c-9e38db5b93d1 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] Terminating instance
Apr 12 16:22:20 user nova-compute[71874]: DEBUG nova.compute.manager [None req-c582f687-7510-4cc7-a71c-9e38db5b93d1 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] Start destroying the instance on the hypervisor. {{(pid=71874) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 16:22:20 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-3ce9644a-3829-46ff-9cd6-3d4ccebb994a tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:22:20 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-3ce9644a-3829-46ff-9cd6-3d4ccebb994a tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:22:20 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-3ce9644a-3829-46ff-9cd6-3d4ccebb994a tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71874) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 16:22:20 user nova-compute[71874]: INFO nova.compute.claims [None req-3ce9644a-3829-46ff-9cd6-3d4ccebb994a tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] [instance: 0ef81d71-afb0-4335-b60f-13071b957d08] Claim successful on node user
Apr 12 16:22:20 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:22:20 user nova-compute[71874]: DEBUG nova.compute.manager [req-80ddc14c-ef8f-4cec-ac8b-873b84b193fa req-d7bc2e88-1d1a-45ca-a486-652a66e64839 service nova] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] Received event network-vif-unplugged-ecba9b76-45d2-49e7-addc-367dc21b38ce {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:22:20 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-80ddc14c-ef8f-4cec-ac8b-873b84b193fa req-d7bc2e88-1d1a-45ca-a486-652a66e64839 service nova] Acquiring lock "bef10c89-360e-42d6-aa26-7edf1afca567-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:22:20 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-80ddc14c-ef8f-4cec-ac8b-873b84b193fa req-d7bc2e88-1d1a-45ca-a486-652a66e64839 service nova] Lock "bef10c89-360e-42d6-aa26-7edf1afca567-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:22:20 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-80ddc14c-ef8f-4cec-ac8b-873b84b193fa req-d7bc2e88-1d1a-45ca-a486-652a66e64839 service nova] Lock "bef10c89-360e-42d6-aa26-7edf1afca567-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:22:20 user nova-compute[71874]: DEBUG nova.compute.manager [req-80ddc14c-ef8f-4cec-ac8b-873b84b193fa req-d7bc2e88-1d1a-45ca-a486-652a66e64839 service nova] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] No waiting events found dispatching network-vif-unplugged-ecba9b76-45d2-49e7-addc-367dc21b38ce {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:22:20 user nova-compute[71874]: DEBUG nova.compute.manager [req-80ddc14c-ef8f-4cec-ac8b-873b84b193fa req-d7bc2e88-1d1a-45ca-a486-652a66e64839 service nova] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] Received event network-vif-unplugged-ecba9b76-45d2-49e7-addc-367dc21b38ce for instance with task_state deleting. {{(pid=71874) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 16:22:20 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:22:20 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:22:20 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-3ce9644a-3829-46ff-9cd6-3d4ccebb994a tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Inventory has not changed in ProviderTree for provider: 0e94b4c8-cd49-45e4-9133-d36eb4b2456b {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 16:22:20 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-3ce9644a-3829-46ff-9cd6-3d4ccebb994a tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Inventory has not changed for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 16:22:20 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-3ce9644a-3829-46ff-9cd6-3d4ccebb994a tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.352s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:22:20 user nova-compute[71874]: DEBUG nova.compute.manager [None req-3ce9644a-3829-46ff-9cd6-3d4ccebb994a tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] [instance: 0ef81d71-afb0-4335-b60f-13071b957d08] Start building networks asynchronously for instance. {{(pid=71874) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 16:22:20 user nova-compute[71874]: DEBUG nova.compute.manager [None req-3ce9644a-3829-46ff-9cd6-3d4ccebb994a tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] [instance: 0ef81d71-afb0-4335-b60f-13071b957d08] Allocating IP information in the background. {{(pid=71874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 16:22:20 user nova-compute[71874]: DEBUG nova.network.neutron [None req-3ce9644a-3829-46ff-9cd6-3d4ccebb994a tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] [instance: 0ef81d71-afb0-4335-b60f-13071b957d08] allocate_for_instance() {{(pid=71874) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 16:22:20 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-3ce9644a-3829-46ff-9cd6-3d4ccebb994a tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] [instance: 0ef81d71-afb0-4335-b60f-13071b957d08] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 16:22:20 user nova-compute[71874]: DEBUG nova.compute.manager [None req-3ce9644a-3829-46ff-9cd6-3d4ccebb994a tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] [instance: 0ef81d71-afb0-4335-b60f-13071b957d08] Start building block device mappings for instance. {{(pid=71874) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 16:22:20 user nova-compute[71874]: DEBUG nova.policy [None req-3ce9644a-3829-46ff-9cd6-3d4ccebb994a tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c9173175144449a391d282ba8978c9d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91ef8cd37154632a031592cdc6792aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71874) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 16:22:20 user nova-compute[71874]: DEBUG nova.compute.manager [None req-3ce9644a-3829-46ff-9cd6-3d4ccebb994a tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] [instance: 0ef81d71-afb0-4335-b60f-13071b957d08] Start spawning the instance on the hypervisor. {{(pid=71874) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 16:22:20 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-3ce9644a-3829-46ff-9cd6-3d4ccebb994a tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] [instance: 0ef81d71-afb0-4335-b60f-13071b957d08] Creating instance directory {{(pid=71874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 16:22:20 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-3ce9644a-3829-46ff-9cd6-3d4ccebb994a tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] [instance: 0ef81d71-afb0-4335-b60f-13071b957d08] Creating image(s)
Apr 12 16:22:20 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-3ce9644a-3829-46ff-9cd6-3d4ccebb994a tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Acquiring lock "/opt/stack/data/nova/instances/0ef81d71-afb0-4335-b60f-13071b957d08/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:22:20 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-3ce9644a-3829-46ff-9cd6-3d4ccebb994a tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Lock "/opt/stack/data/nova/instances/0ef81d71-afb0-4335-b60f-13071b957d08/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:22:20 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-3ce9644a-3829-46ff-9cd6-3d4ccebb994a tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Lock "/opt/stack/data/nova/instances/0ef81d71-afb0-4335-b60f-13071b957d08/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:22:20 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-3ce9644a-3829-46ff-9cd6-3d4ccebb994a tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:22:20 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-3ce9644a-3829-46ff-9cd6-3d4ccebb994a tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json" returned: 0 in 0.138s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:22:20 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-3ce9644a-3829-46ff-9cd6-3d4ccebb994a tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Acquiring lock "b88df1b37cb431f52bc53b5616015c89b5bec411" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:22:20 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-3ce9644a-3829-46ff-9cd6-3d4ccebb994a tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Lock "b88df1b37cb431f52bc53b5616015c89b5bec411" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:22:20 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-3ce9644a-3829-46ff-9cd6-3d4ccebb994a tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:22:21 user nova-compute[71874]: INFO nova.virt.libvirt.driver [-] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] Instance destroyed successfully.
Apr 12 16:22:21 user nova-compute[71874]: DEBUG nova.objects.instance [None req-c582f687-7510-4cc7-a71c-9e38db5b93d1 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lazy-loading 'resources' on Instance uuid bef10c89-360e-42d6-aa26-7edf1afca567 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:22:21 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-c582f687-7510-4cc7-a71c-9e38db5b93d1 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T16:15:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1742194488',display_name='tempest-ServerActionsTestJSON-server-1742194488',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1742194488',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNmXVADjvoPSh3uGCGCTNS/vcfcDtUjn/vZEaV3bCllfz1ZO8VIgFuZhP+mAsa+G/KA4ubi5U9Vj41YtHGsakdPR5VoByhorvfUv/PIWtER2tn1LWX2mlFyT+T8AEJplPw==',key_name='tempest-keypair-1923467613',keypairs=<?>,launch_index=0,launched_at=2023-04-12T16:17:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='97ea81bd1962466bbe552424973f71a8',ramdisk_id='',reservation_id='r-kpxobl69',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-631887779',owner_user_name='tempest-ServerActionsTestJSON-631887779-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T16:19:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1a699b3ba8304eadb8a53d465ea340cf',uuid=bef10c89-360e-42d6-aa26-7edf1afca567,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ecba9b76-45d2-49e7-addc-367dc21b38ce", "address": "fa:16:3e:e4:f4:15", "network": {"id": "e6694358-e361-4952-b859-93755c11721e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-667152893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97ea81bd1962466bbe552424973f71a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecba9b76-45", "ovs_interfaceid": "ecba9b76-45d2-49e7-addc-367dc21b38ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 16:22:21 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-c582f687-7510-4cc7-a71c-9e38db5b93d1 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Converting VIF {"id": "ecba9b76-45d2-49e7-addc-367dc21b38ce", "address": "fa:16:3e:e4:f4:15", "network": {"id": "e6694358-e361-4952-b859-93755c11721e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-667152893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97ea81bd1962466bbe552424973f71a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecba9b76-45", "ovs_interfaceid": "ecba9b76-45d2-49e7-addc-367dc21b38ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:22:21 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-c582f687-7510-4cc7-a71c-9e38db5b93d1 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e4:f4:15,bridge_name='br-int',has_traffic_filtering=True,id=ecba9b76-45d2-49e7-addc-367dc21b38ce,network=Network(e6694358-e361-4952-b859-93755c11721e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecba9b76-45') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:22:21 user nova-compute[71874]: DEBUG os_vif [None req-c582f687-7510-4cc7-a71c-9e38db5b93d1 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e4:f4:15,bridge_name='br-int',has_traffic_filtering=True,id=ecba9b76-45d2-49e7-addc-367dc21b38ce,network=Network(e6694358-e361-4952-b859-93755c11721e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecba9b76-45') {{(pid=71874) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 16:22:21 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:22:21 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapecba9b76-45, bridge=br-int, if_exists=True) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:22:21 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:22:21 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:22:21 user nova-compute[71874]: INFO os_vif [None req-c582f687-7510-4cc7-a71c-9e38db5b93d1 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e4:f4:15,bridge_name='br-int',has_traffic_filtering=True,id=ecba9b76-45d2-49e7-addc-367dc21b38ce,network=Network(e6694358-e361-4952-b859-93755c11721e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecba9b76-45')
Apr 12 16:22:21 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c582f687-7510-4cc7-a71c-9e38db5b93d1 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] calling os-brick to detach iSCSI Volume {{(pid=71874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 16:22:21 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-c582f687-7510-4cc7-a71c-9e38db5b93d1 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3c0216320>, {'target_iqn': 'iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IalnbXCE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:22:21 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-c582f687-7510-4cc7-a71c-9e38db5b93d1 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:22:21 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-c582f687-7510-4cc7-a71c-9e38db5b93d1 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:22:21 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-c582f687-7510-4cc7-a71c-9e38db5b93d1 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:22:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:22:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:22:21 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[a22c502c-50d8-4590-8e11-6a9dd3b565a9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:952c0ad3-7b56-454e-af58-10213195373d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:22:21 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-c582f687-7510-4cc7-a71c-9e38db5b93d1 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 16:22:21 user nova-compute[71874]: No targets found.
Apr 12 16:22:21 user nova-compute[71874]: iSNS:
Apr 12 16:22:21 user nova-compute[71874]: No targets found.
Apr 12 16:22:21 user nova-compute[71874]: STATIC:
Apr 12 16:22:21 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:952c0ad3-7b56-454e-af58-10213195373d
Apr 12 16:22:21 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:22:21 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:22:21 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775
Apr 12 16:22:21 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:22:21 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:22:21 user nova-compute[71874]: FIRMWARE:
Apr 12 16:22:21 user nova-compute[71874]: No targets found.
Apr 12 16:22:21 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:22:21 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-c582f687-7510-4cc7-a71c-9e38db5b93d1 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 16:22:21 user nova-compute[71874]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 16:22:21 user nova-compute[71874]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71874) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 16:22:21 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-c582f687-7510-4cc7-a71c-9e38db5b93d1 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775', 0)] {{(pid=71874) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 16:22:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:22:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:22:21 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecca26e8-1961-42f8-b7b6-92047d93de6a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:952c0ad3-7b56-454e-af58-10213195373d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:22:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:22:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-3ce9644a-3829-46ff-9cd6-3d4ccebb994a tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json" returned: 0 in 0.161s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:22:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-3ce9644a-3829-46ff-9cd6-3d4ccebb994a tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411,backing_fmt=raw /opt/stack/data/nova/instances/0ef81d71-afb0-4335-b60f-13071b957d08/disk 1073741824 {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:22:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:22:21 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef9c7b5c-cf59-4771-8b6a-02199745aaad]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:952c0ad3-7b56-454e-af58-10213195373d (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:22:21 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-c582f687-7510-4cc7-a71c-9e38db5b93d1 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775 (non-flash)
Apr 12 16:22:21 user nova-compute[71874]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:952c0ad3-7b56-454e-af58-10213195373d (non-flash)
Apr 12 16:22:21 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:22:21 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-c582f687-7510-4cc7-a71c-9e38db5b93d1 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775 (non-flash)
Apr 12 16:22:21 user nova-compute[71874]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:952c0ad3-7b56-454e-af58-10213195373d (non-flash)
Apr 12 16:22:21 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:22:21 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-c582f687-7510-4cc7-a71c-9e38db5b93d1 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc37d661a20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775'): ({'sdd'}, set())}) {{(pid=71874) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 16:22:21 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-c582f687-7510-4cc7-a71c-9e38db5b93d1 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Removing single pathed devices sdd {{(pid=71874) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 16:22:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-3ce9644a-3829-46ff-9cd6-3d4ccebb994a tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411,backing_fmt=raw /opt/stack/data/nova/instances/0ef81d71-afb0-4335-b60f-13071b957d08/disk 1073741824" returned: 0 in 0.051s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:22:21 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-3ce9644a-3829-46ff-9cd6-3d4ccebb994a tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Lock "b88df1b37cb431f52bc53b5616015c89b5bec411" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.214s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:22:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-3ce9644a-3829-46ff-9cd6-3d4ccebb994a tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:22:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:22:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:22:21 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[22fcd472-2065-43b6-8ad2-2099b694286f]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:22:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:22:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:22:21 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[617a4bca-36df-4b52-9ead-c22f43b30687]: (4, ('ok\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:22:21 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-c582f687-7510-4cc7-a71c-9e38db5b93d1 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Flushing IO for device /dev/sdd {{(pid=71874) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 16:22:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:22:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:22:21 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[440574f6-2d79-4bd1-bfca-aefa01465a68]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:22:21 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-c582f687-7510-4cc7-a71c-9e38db5b93d1 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71874) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 16:22:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:22:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.072s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:22:21 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[8db9368d-2f7a-4310-a108-337a069f81d4]: (4, ('1', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:22:21 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-c582f687-7510-4cc7-a71c-9e38db5b93d1 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71874) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 16:22:21 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-c582f687-7510-4cc7-a71c-9e38db5b93d1 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] SCSI volumes sdd have been removed. {{(pid=71874) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 16:22:21 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-c582f687-7510-4cc7-a71c-9e38db5b93d1 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775')] {{(pid=71874) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 16:22:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-3ce9644a-3829-46ff-9cd6-3d4ccebb994a tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json" returned: 0 in 0.159s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:22:21 user nova-compute[71874]: DEBUG nova.virt.disk.api [None req-3ce9644a-3829-46ff-9cd6-3d4ccebb994a tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0ef81d71-afb0-4335-b60f-13071b957d08/disk. size=1073741824 {{(pid=71874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 16:22:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-3ce9644a-3829-46ff-9cd6-3d4ccebb994a tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ef81d71-afb0-4335-b60f-13071b957d08/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:22:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:22:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-3ce9644a-3829-46ff-9cd6-3d4ccebb994a tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ef81d71-afb0-4335-b60f-13071b957d08/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:22:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:22:21 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d24788d-abad-4033-bf26-0dba62fc343f]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:22:21 user nova-compute[71874]: DEBUG nova.virt.disk.api [None req-3ce9644a-3829-46ff-9cd6-3d4ccebb994a tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Cannot resize image /opt/stack/data/nova/instances/0ef81d71-afb0-4335-b60f-13071b957d08/disk to a smaller size. {{(pid=71874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 16:22:21 user nova-compute[71874]: DEBUG nova.objects.instance [None req-3ce9644a-3829-46ff-9cd6-3d4ccebb994a tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Lazy-loading 'migration_context' on Instance uuid 0ef81d71-afb0-4335-b60f-13071b957d08 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:22:21 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-c582f687-7510-4cc7-a71c-9e38db5b93d1 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:22:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775 -p 172.16.0.220:3260 --logout {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:22:21 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-3ce9644a-3829-46ff-9cd6-3d4ccebb994a tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] [instance: 0ef81d71-afb0-4335-b60f-13071b957d08] Created local disks {{(pid=71874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 16:22:21 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-3ce9644a-3829-46ff-9cd6-3d4ccebb994a tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] [instance: 0ef81d71-afb0-4335-b60f-13071b957d08] Ensure instance console log exists: /opt/stack/data/nova/instances/0ef81d71-afb0-4335-b60f-13071b957d08/console.log {{(pid=71874) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 16:22:21 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-3ce9644a-3829-46ff-9cd6-3d4ccebb994a tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:22:21 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-3ce9644a-3829-46ff-9cd6-3d4ccebb994a tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:22:21 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-3ce9644a-3829-46ff-9cd6-3d4ccebb994a tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:22:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775 -p 172.16.0.220:3260 --logout" returned: 0 in 0.117s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:22:21 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b9f11be-bf98-4c8e-a960-d50a90a31f35]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:22:21 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-c582f687-7510-4cc7-a71c-9e38db5b93d1 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775, portal: 172.16.0.220,3260]
Apr 12 16:22:21 user nova-compute[71874]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775, portal: 172.16.0.220,3260] successful.
Apr 12 16:22:21 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:22:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775 -p 172.16.0.220:3260 --op delete {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:22:21 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5a801df-b37e-4132-8465-d4011ca47775 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:22:21 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[58c87c19-4cf3-4b66-9be4-9015795b5df0]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:22:21 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-c582f687-7510-4cc7-a71c-9e38db5b93d1 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:22:21 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-c582f687-7510-4cc7-a71c-9e38db5b93d1 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.575s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:22:21 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-c582f687-7510-4cc7-a71c-9e38db5b93d1 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] <== disconnect_volume: return (577ms) None {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:22:21 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c582f687-7510-4cc7-a71c-9e38db5b93d1 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] Disconnected iSCSI Volume {{(pid=71874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 16:22:21 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-c582f687-7510-4cc7-a71c-9e38db5b93d1 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] Deleting instance files /opt/stack/data/nova/instances/bef10c89-360e-42d6-aa26-7edf1afca567_del
Apr 12 16:22:21 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-c582f687-7510-4cc7-a71c-9e38db5b93d1 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] Deletion of /opt/stack/data/nova/instances/bef10c89-360e-42d6-aa26-7edf1afca567_del complete
Apr 12 16:22:21 user nova-compute[71874]: DEBUG nova.network.neutron [None req-3ce9644a-3829-46ff-9cd6-3d4ccebb994a tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] [instance: 0ef81d71-afb0-4335-b60f-13071b957d08] Successfully created port: cb7029cd-2b2f-4e5a-8f70-5f644a14eb24 {{(pid=71874) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 16:22:21 user nova-compute[71874]: INFO nova.compute.manager [None req-c582f687-7510-4cc7-a71c-9e38db5b93d1 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] Took 1.55 seconds to destroy the instance on the hypervisor.
Apr 12 16:22:21 user nova-compute[71874]: DEBUG oslo.service.loopingcall [None req-c582f687-7510-4cc7-a71c-9e38db5b93d1 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71874) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 16:22:21 user nova-compute[71874]: DEBUG nova.compute.manager [-] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] Deallocating network for instance {{(pid=71874) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 16:22:21 user nova-compute[71874]: DEBUG nova.network.neutron [-] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] deallocate_for_instance() {{(pid=71874) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 16:22:22 user nova-compute[71874]: DEBUG nova.compute.manager [req-ab747159-8b90-49cf-a4cf-99b2c2036546 req-6f012168-897a-4c9b-af85-f40b5e741efa service nova] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] Received event network-vif-plugged-ecba9b76-45d2-49e7-addc-367dc21b38ce {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:22:22 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-ab747159-8b90-49cf-a4cf-99b2c2036546 req-6f012168-897a-4c9b-af85-f40b5e741efa service nova] Acquiring lock "bef10c89-360e-42d6-aa26-7edf1afca567-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:22:22 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-ab747159-8b90-49cf-a4cf-99b2c2036546 req-6f012168-897a-4c9b-af85-f40b5e741efa service nova] Lock "bef10c89-360e-42d6-aa26-7edf1afca567-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:22:22 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-ab747159-8b90-49cf-a4cf-99b2c2036546 req-6f012168-897a-4c9b-af85-f40b5e741efa service nova] Lock "bef10c89-360e-42d6-aa26-7edf1afca567-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:22:22 user nova-compute[71874]: DEBUG nova.compute.manager [req-ab747159-8b90-49cf-a4cf-99b2c2036546 req-6f012168-897a-4c9b-af85-f40b5e741efa service nova] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] No waiting events found dispatching network-vif-plugged-ecba9b76-45d2-49e7-addc-367dc21b38ce {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:22:22 user nova-compute[71874]: WARNING nova.compute.manager [req-ab747159-8b90-49cf-a4cf-99b2c2036546 req-6f012168-897a-4c9b-af85-f40b5e741efa service nova] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] Received unexpected event network-vif-plugged-ecba9b76-45d2-49e7-addc-367dc21b38ce for instance with vm_state active and task_state deleting.
Apr 12 16:22:22 user nova-compute[71874]: DEBUG nova.network.neutron [-] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] Updating instance_info_cache with network_info: [] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:22:22 user nova-compute[71874]: INFO nova.compute.manager [-] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] Took 1.01 seconds to deallocate network for instance.
Apr 12 16:22:23 user nova-compute[71874]: DEBUG nova.network.neutron [None req-3ce9644a-3829-46ff-9cd6-3d4ccebb994a tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] [instance: 0ef81d71-afb0-4335-b60f-13071b957d08] Successfully updated port: cb7029cd-2b2f-4e5a-8f70-5f644a14eb24 {{(pid=71874) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 16:22:23 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-3ce9644a-3829-46ff-9cd6-3d4ccebb994a tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Acquiring lock "refresh_cache-0ef81d71-afb0-4335-b60f-13071b957d08" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:22:23 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-3ce9644a-3829-46ff-9cd6-3d4ccebb994a tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Acquired lock "refresh_cache-0ef81d71-afb0-4335-b60f-13071b957d08" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:22:23 user nova-compute[71874]: DEBUG nova.network.neutron [None req-3ce9644a-3829-46ff-9cd6-3d4ccebb994a tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] [instance: 0ef81d71-afb0-4335-b60f-13071b957d08] Building network info cache for instance {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 16:22:23 user nova-compute[71874]: DEBUG nova.compute.manager [req-4b95ea1a-fb78-4607-aed4-f7c596b03f9f req-09ef93cd-fb03-4452-b992-fae9cdebe12b service nova] [instance: 0ef81d71-afb0-4335-b60f-13071b957d08] Received event network-changed-cb7029cd-2b2f-4e5a-8f70-5f644a14eb24 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:22:23 user nova-compute[71874]: DEBUG nova.compute.manager [req-4b95ea1a-fb78-4607-aed4-f7c596b03f9f req-09ef93cd-fb03-4452-b992-fae9cdebe12b service nova] [instance: 0ef81d71-afb0-4335-b60f-13071b957d08] Refreshing instance network info cache due to event network-changed-cb7029cd-2b2f-4e5a-8f70-5f644a14eb24. {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 16:22:23 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-4b95ea1a-fb78-4607-aed4-f7c596b03f9f req-09ef93cd-fb03-4452-b992-fae9cdebe12b service nova] Acquiring lock "refresh_cache-0ef81d71-afb0-4335-b60f-13071b957d08" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:22:23 user nova-compute[71874]: DEBUG nova.network.neutron [None req-3ce9644a-3829-46ff-9cd6-3d4ccebb994a tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] [instance: 0ef81d71-afb0-4335-b60f-13071b957d08] Instance cache missing network info. {{(pid=71874) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 16:22:23 user nova-compute[71874]: INFO nova.compute.manager [None req-c582f687-7510-4cc7-a71c-9e38db5b93d1 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] Took 0.84 seconds to detach 1 volumes for instance.
Apr 12 16:22:23 user nova-compute[71874]: DEBUG nova.compute.manager [None req-c582f687-7510-4cc7-a71c-9e38db5b93d1 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] Deleting volume: b5a801df-b37e-4132-8465-d4011ca47775 {{(pid=71874) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 12 16:22:23 user nova-compute[71874]: DEBUG nova.network.neutron [None req-3ce9644a-3829-46ff-9cd6-3d4ccebb994a tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] [instance: 0ef81d71-afb0-4335-b60f-13071b957d08] Updating instance_info_cache with network_info: [{"id": "cb7029cd-2b2f-4e5a-8f70-5f644a14eb24", "address": "fa:16:3e:68:3a:b3", "network": {"id": "8a87df1a-24b8-499e-a908-0d1fa99ed69a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-824466532-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "c91ef8cd37154632a031592cdc6792aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb7029cd-2b", "ovs_interfaceid": "cb7029cd-2b2f-4e5a-8f70-5f644a14eb24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:22:23 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-3ce9644a-3829-46ff-9cd6-3d4ccebb994a tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Releasing lock "refresh_cache-0ef81d71-afb0-4335-b60f-13071b957d08" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:22:23 user nova-compute[71874]: DEBUG nova.compute.manager [None req-3ce9644a-3829-46ff-9cd6-3d4ccebb994a tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] [instance: 0ef81d71-afb0-4335-b60f-13071b957d08] Instance network_info: |[{"id": "cb7029cd-2b2f-4e5a-8f70-5f644a14eb24", "address": "fa:16:3e:68:3a:b3", "network": {"id": "8a87df1a-24b8-499e-a908-0d1fa99ed69a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-824466532-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "c91ef8cd37154632a031592cdc6792aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb7029cd-2b", "ovs_interfaceid": "cb7029cd-2b2f-4e5a-8f70-5f644a14eb24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 16:22:23 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-4b95ea1a-fb78-4607-aed4-f7c596b03f9f req-09ef93cd-fb03-4452-b992-fae9cdebe12b service nova] Acquired lock "refresh_cache-0ef81d71-afb0-4335-b60f-13071b957d08" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:22:23 user nova-compute[71874]: DEBUG nova.network.neutron [req-4b95ea1a-fb78-4607-aed4-f7c596b03f9f req-09ef93cd-fb03-4452-b992-fae9cdebe12b service nova] [instance: 0ef81d71-afb0-4335-b60f-13071b957d08] Refreshing network info cache for port cb7029cd-2b2f-4e5a-8f70-5f644a14eb24 {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 16:22:23 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-3ce9644a-3829-46ff-9cd6-3d4ccebb994a tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] [instance: 0ef81d71-afb0-4335-b60f-13071b957d08] Start _get_guest_xml network_info=[{"id": "cb7029cd-2b2f-4e5a-8f70-5f644a14eb24", "address": "fa:16:3e:68:3a:b3", "network": {"id": "8a87df1a-24b8-499e-a908-0d1fa99ed69a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-824466532-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "c91ef8cd37154632a031592cdc6792aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb7029cd-2b", "ovs_interfaceid": "cb7029cd-2b2f-4e5a-8f70-5f644a14eb24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T15:55:37Z,direct_url=<?>,disk_format='qcow2',id=9dc63f14-8b70-4e72-89f2-13464f2f5c7c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='61a4936d9b7744c0b488d81c9b7746b6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T15:55:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_options': None, 'image_id': '9dc63f14-8b70-4e72-89f2-13464f2f5c7c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 16:22:23 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-3ce9644a-3829-46ff-9cd6-3d4ccebb994a tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:22:23 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-3ce9644a-3829-46ff-9cd6-3d4ccebb994a tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:22:23 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-3ce9644a-3829-46ff-9cd6-3d4ccebb994a tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71874) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 16:22:23 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-3ce9644a-3829-46ff-9cd6-3d4ccebb994a tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T15:56:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T15:55:37Z,direct_url=<?>,disk_format='qcow2',id=9dc63f14-8b70-4e72-89f2-13464f2f5c7c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='61a4936d9b7744c0b488d81c9b7746b6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T15:55:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 16:22:23 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-3ce9644a-3829-46ff-9cd6-3d4ccebb994a tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Flavor limits 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 16:22:23 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-3ce9644a-3829-46ff-9cd6-3d4ccebb994a tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Image limits 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 16:22:23 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-3ce9644a-3829-46ff-9cd6-3d4ccebb994a tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Flavor pref 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 16:22:23 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-3ce9644a-3829-46ff-9cd6-3d4ccebb994a tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Image pref 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 16:22:23 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-3ce9644a-3829-46ff-9cd6-3d4ccebb994a tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 16:22:23 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-3ce9644a-3829-46ff-9cd6-3d4ccebb994a tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 16:22:23 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-3ce9644a-3829-46ff-9cd6-3d4ccebb994a tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 16:22:23 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-3ce9644a-3829-46ff-9cd6-3d4ccebb994a tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Got 1 possible topologies {{(pid=71874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 16:22:23 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-3ce9644a-3829-46ff-9cd6-3d4ccebb994a tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 16:22:23 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-3ce9644a-3829-46ff-9cd6-3d4ccebb994a tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 16:22:23 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-3ce9644a-3829-46ff-9cd6-3d4ccebb994a tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T16:22:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-2079897140',display_name='tempest-VolumesSnapshotTestJSON-instance-2079897140',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-2079897140',id=42,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c91ef8cd37154632a031592cdc6792aa',ramdisk_id='',reservation_id='r-ppo9jtda',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1094479403',owner_user_name='tempest-VolumesSnapshotTestJSON-1094479403-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T16:22:21Z,user_data=None,user_id='c9173175144449a391d282ba8978c9d9',uuid=0ef81d71-afb0-4335-b60f-13071b957d08,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cb7029cd-2b2f-4e5a-8f70-5f644a14eb24", "address": "fa:16:3e:68:3a:b3", "network": {"id": "8a87df1a-24b8-499e-a908-0d1fa99ed69a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-824466532-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "c91ef8cd37154632a031592cdc6792aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb7029cd-2b", "ovs_interfaceid": "cb7029cd-2b2f-4e5a-8f70-5f644a14eb24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 16:22:23 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-3ce9644a-3829-46ff-9cd6-3d4ccebb994a tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Converting VIF {"id": "cb7029cd-2b2f-4e5a-8f70-5f644a14eb24", "address": "fa:16:3e:68:3a:b3", "network": {"id": "8a87df1a-24b8-499e-a908-0d1fa99ed69a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-824466532-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "c91ef8cd37154632a031592cdc6792aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb7029cd-2b", "ovs_interfaceid": "cb7029cd-2b2f-4e5a-8f70-5f644a14eb24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:22:23 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-3ce9644a-3829-46ff-9cd6-3d4ccebb994a tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:3a:b3,bridge_name='br-int',has_traffic_filtering=True,id=cb7029cd-2b2f-4e5a-8f70-5f644a14eb24,network=Network(8a87df1a-24b8-499e-a908-0d1fa99ed69a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb7029cd-2b') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:22:23 user nova-compute[71874]: DEBUG nova.objects.instance [None req-3ce9644a-3829-46ff-9cd6-3d4ccebb994a tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Lazy-loading 'pci_devices' on Instance uuid 0ef81d71-afb0-4335-b60f-13071b957d08 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:22:23 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-c582f687-7510-4cc7-a71c-9e38db5b93d1 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:22:23 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-c582f687-7510-4cc7-a71c-9e38db5b93d1 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:22:23 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-3ce9644a-3829-46ff-9cd6-3d4ccebb994a tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] [instance: 0ef81d71-afb0-4335-b60f-13071b957d08] End _get_guest_xml xml=<domain type="kvm">
Apr 12 16:22:23 user nova-compute[71874]:   <uuid>0ef81d71-afb0-4335-b60f-13071b957d08</uuid>
Apr 12 16:22:23 user nova-compute[71874]:   <name>instance-0000002a</name>
Apr 12 16:22:23 user nova-compute[71874]:   <memory>131072</memory>
Apr 12 16:22:23 user nova-compute[71874]:   <vcpu>1</vcpu>
Apr 12 16:22:23 user nova-compute[71874]:   <metadata>
Apr 12 16:22:23 user nova-compute[71874]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 16:22:23 user nova-compute[71874]:       <nova:package version="0.0.0"/>
Apr 12 16:22:23 user nova-compute[71874]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-2079897140</nova:name>
Apr 12 16:22:23 user nova-compute[71874]:       <nova:creationTime>2023-04-12 16:22:23</nova:creationTime>
Apr 12 16:22:23 user nova-compute[71874]:       <nova:flavor name="m1.nano">
Apr 12 16:22:23 user nova-compute[71874]:         <nova:memory>128</nova:memory>
Apr 12 16:22:23 user nova-compute[71874]:         <nova:disk>1</nova:disk>
Apr 12 16:22:23 user nova-compute[71874]:         <nova:swap>0</nova:swap>
Apr 12 16:22:23 user nova-compute[71874]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 16:22:23 user nova-compute[71874]:         <nova:vcpus>1</nova:vcpus>
Apr 12 16:22:23 user nova-compute[71874]:       </nova:flavor>
Apr 12 16:22:23 user nova-compute[71874]:       <nova:owner>
Apr 12 16:22:23 user nova-compute[71874]:         <nova:user uuid="c9173175144449a391d282ba8978c9d9">tempest-VolumesSnapshotTestJSON-1094479403-project-member</nova:user>
Apr 12 16:22:23 user nova-compute[71874]:         <nova:project uuid="c91ef8cd37154632a031592cdc6792aa">tempest-VolumesSnapshotTestJSON-1094479403</nova:project>
Apr 12 16:22:23 user nova-compute[71874]:       </nova:owner>
Apr 12 16:22:23 user nova-compute[71874]:       <nova:root type="image" uuid="9dc63f14-8b70-4e72-89f2-13464f2f5c7c"/>
Apr 12 16:22:23 user nova-compute[71874]:       <nova:ports>
Apr 12 16:22:23 user nova-compute[71874]:         <nova:port uuid="cb7029cd-2b2f-4e5a-8f70-5f644a14eb24">
Apr 12 16:22:23 user nova-compute[71874]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 12 16:22:23 user nova-compute[71874]:         </nova:port>
Apr 12 16:22:23 user nova-compute[71874]:       </nova:ports>
Apr 12 16:22:23 user nova-compute[71874]:     </nova:instance>
Apr 12 16:22:23 user nova-compute[71874]:   </metadata>
Apr 12 16:22:23 user nova-compute[71874]:   <sysinfo type="smbios">
Apr 12 16:22:23 user nova-compute[71874]:     <system>
Apr 12 16:22:23 user nova-compute[71874]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 16:22:23 user nova-compute[71874]:       <entry name="product">OpenStack Nova</entry>
Apr 12 16:22:23 user nova-compute[71874]:       <entry name="version">0.0.0</entry>
Apr 12 16:22:23 user nova-compute[71874]:       <entry name="serial">0ef81d71-afb0-4335-b60f-13071b957d08</entry>
Apr 12 16:22:23 user nova-compute[71874]:       <entry name="uuid">0ef81d71-afb0-4335-b60f-13071b957d08</entry>
Apr 12 16:22:23 user nova-compute[71874]:       <entry name="family">Virtual Machine</entry>
Apr 12 16:22:23 user nova-compute[71874]:     </system>
Apr 12 16:22:23 user nova-compute[71874]:   </sysinfo>
Apr 12 16:22:23 user nova-compute[71874]:   <os>
Apr 12 16:22:23 user nova-compute[71874]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 16:22:23 user nova-compute[71874]:     <boot dev="hd"/>
Apr 12 16:22:23 user nova-compute[71874]:     <smbios mode="sysinfo"/>
Apr 12 16:22:23 user nova-compute[71874]:   </os>
Apr 12 16:22:23 user nova-compute[71874]:   <features>
Apr 12 16:22:23 user nova-compute[71874]:     <acpi/>
Apr 12 16:22:23 user nova-compute[71874]:     <apic/>
Apr 12 16:22:23 user nova-compute[71874]:     <vmcoreinfo/>
Apr 12 16:22:23 user nova-compute[71874]:   </features>
Apr 12 16:22:23 user nova-compute[71874]:   <clock offset="utc">
Apr 12 16:22:23 user nova-compute[71874]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 16:22:23 user nova-compute[71874]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 16:22:23 user nova-compute[71874]:     <timer name="hpet" present="no"/>
Apr 12 16:22:23 user nova-compute[71874]:   </clock>
Apr 12 16:22:23 user nova-compute[71874]:   <cpu mode="custom" match="exact">
Apr 12 16:22:23 user nova-compute[71874]:     <model>Nehalem</model>
Apr 12 16:22:23 user nova-compute[71874]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 16:22:23 user nova-compute[71874]:   </cpu>
Apr 12 16:22:23 user nova-compute[71874]:   <devices>
Apr 12 16:22:23 user nova-compute[71874]:     <disk type="file" device="disk">
Apr 12 16:22:23 user nova-compute[71874]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 16:22:23 user nova-compute[71874]:       <source file="/opt/stack/data/nova/instances/0ef81d71-afb0-4335-b60f-13071b957d08/disk"/>
Apr 12 16:22:23 user nova-compute[71874]:       <target dev="vda" bus="virtio"/>
Apr 12 16:22:23 user nova-compute[71874]:     </disk>
Apr 12 16:22:23 user nova-compute[71874]:     <interface type="ethernet">
Apr 12 16:22:23 user nova-compute[71874]:       <mac address="fa:16:3e:68:3a:b3"/>
Apr 12 16:22:23 user nova-compute[71874]:       <model type="virtio"/>
Apr 12 16:22:23 user nova-compute[71874]:       <mtu size="1442"/>
Apr 12 16:22:23 user nova-compute[71874]:       <target dev="tapcb7029cd-2b"/>
Apr 12 16:22:23 user nova-compute[71874]:     </interface>
Apr 12 16:22:23 user nova-compute[71874]:     <serial type="pty">
Apr 12 16:22:23 user nova-compute[71874]:       <log file="/opt/stack/data/nova/instances/0ef81d71-afb0-4335-b60f-13071b957d08/console.log" append="off"/>
Apr 12 16:22:23 user nova-compute[71874]:     </serial>
Apr 12 16:22:23 user nova-compute[71874]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 16:22:23 user nova-compute[71874]:     <video>
Apr 12 16:22:23 user nova-compute[71874]:       <model type="virtio"/>
Apr 12 16:22:23 user nova-compute[71874]:     </video>
Apr 12 16:22:23 user nova-compute[71874]:     <rng model="virtio">
Apr 12 16:22:23 user nova-compute[71874]:       <backend model="random">/dev/urandom</backend>
Apr 12 16:22:23 user nova-compute[71874]:     </rng>
Apr 12 16:22:23 user nova-compute[71874]:     <controller type="usb" index="0" model="none"/>
Apr 12 16:22:23 user nova-compute[71874]:     <memballoon model="virtio">
Apr 12 16:22:23 user nova-compute[71874]:       <stats period="10"/>
Apr 12 16:22:23 user nova-compute[71874]:     </memballoon>
Apr 12 16:22:23 user nova-compute[71874]:   </devices>
Apr 12 16:22:23 user nova-compute[71874]: </domain>
Apr 12 16:22:23 user nova-compute[71874]:  {{(pid=71874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 16:22:23 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-3ce9644a-3829-46ff-9cd6-3d4ccebb994a tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T16:22:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-2079897140',display_name='tempest-VolumesSnapshotTestJSON-instance-2079897140',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-2079897140',id=42,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c91ef8cd37154632a031592cdc6792aa',ramdisk_id='',reservation_id='r-ppo9jtda',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1094479403',owner_user_name='tempest-VolumesSnapshotTestJSON-1094479403-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T16:22:21Z,user_data=None,user_id='c9173175144449a391d282ba8978c9d9',uuid=0ef81d71-afb0-4335-b60f-13071b957d08,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cb7029cd-2b2f-4e5a-8f70-5f644a14eb24", "address": "fa:16:3e:68:3a:b3", "network": {"id": "8a87df1a-24b8-499e-a908-0d1fa99ed69a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-824466532-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "c91ef8cd37154632a031592cdc6792aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb7029cd-2b", "ovs_interfaceid": "cb7029cd-2b2f-4e5a-8f70-5f644a14eb24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 16:22:23 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-3ce9644a-3829-46ff-9cd6-3d4ccebb994a tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Converting VIF {"id": "cb7029cd-2b2f-4e5a-8f70-5f644a14eb24", "address": "fa:16:3e:68:3a:b3", "network": {"id": "8a87df1a-24b8-499e-a908-0d1fa99ed69a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-824466532-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "c91ef8cd37154632a031592cdc6792aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb7029cd-2b", "ovs_interfaceid": "cb7029cd-2b2f-4e5a-8f70-5f644a14eb24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:22:23 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-3ce9644a-3829-46ff-9cd6-3d4ccebb994a tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:3a:b3,bridge_name='br-int',has_traffic_filtering=True,id=cb7029cd-2b2f-4e5a-8f70-5f644a14eb24,network=Network(8a87df1a-24b8-499e-a908-0d1fa99ed69a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb7029cd-2b') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:22:23 user nova-compute[71874]: DEBUG os_vif [None req-3ce9644a-3829-46ff-9cd6-3d4ccebb994a tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:3a:b3,bridge_name='br-int',has_traffic_filtering=True,id=cb7029cd-2b2f-4e5a-8f70-5f644a14eb24,network=Network(8a87df1a-24b8-499e-a908-0d1fa99ed69a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb7029cd-2b') {{(pid=71874) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 16:22:23 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:22:23 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:22:23 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 16:22:23 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:22:23 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcb7029cd-2b, may_exist=True) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:22:23 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapcb7029cd-2b, col_values=(('external_ids', {'iface-id': 'cb7029cd-2b2f-4e5a-8f70-5f644a14eb24', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:68:3a:b3', 'vm-uuid': '0ef81d71-afb0-4335-b60f-13071b957d08'}),)) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:22:23 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:22:23 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:22:23 user nova-compute[71874]: INFO os_vif [None req-3ce9644a-3829-46ff-9cd6-3d4ccebb994a tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:3a:b3,bridge_name='br-int',has_traffic_filtering=True,id=cb7029cd-2b2f-4e5a-8f70-5f644a14eb24,network=Network(8a87df1a-24b8-499e-a908-0d1fa99ed69a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb7029cd-2b')
Apr 12 16:22:23 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-3ce9644a-3829-46ff-9cd6-3d4ccebb994a tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] No BDM found with device name vda, not building metadata. {{(pid=71874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 16:22:23 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-3ce9644a-3829-46ff-9cd6-3d4ccebb994a tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] No VIF found with MAC fa:16:3e:68:3a:b3, not building metadata {{(pid=71874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 16:22:23 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-c582f687-7510-4cc7-a71c-9e38db5b93d1 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Inventory has not changed in ProviderTree for provider: 0e94b4c8-cd49-45e4-9133-d36eb4b2456b {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 16:22:23 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-c582f687-7510-4cc7-a71c-9e38db5b93d1 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Inventory has not changed for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 16:22:23 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-c582f687-7510-4cc7-a71c-9e38db5b93d1 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.218s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:22:24 user nova-compute[71874]: INFO nova.scheduler.client.report [None req-c582f687-7510-4cc7-a71c-9e38db5b93d1 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Deleted allocations for instance bef10c89-360e-42d6-aa26-7edf1afca567
Apr 12 16:22:24 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-c582f687-7510-4cc7-a71c-9e38db5b93d1 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "bef10c89-360e-42d6-aa26-7edf1afca567" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.902s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:22:24 user nova-compute[71874]: DEBUG nova.network.neutron [req-4b95ea1a-fb78-4607-aed4-f7c596b03f9f req-09ef93cd-fb03-4452-b992-fae9cdebe12b service nova] [instance: 0ef81d71-afb0-4335-b60f-13071b957d08] Updated VIF entry in instance network info cache for port cb7029cd-2b2f-4e5a-8f70-5f644a14eb24. {{(pid=71874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 16:22:24 user nova-compute[71874]: DEBUG nova.network.neutron [req-4b95ea1a-fb78-4607-aed4-f7c596b03f9f req-09ef93cd-fb03-4452-b992-fae9cdebe12b service nova] [instance: 0ef81d71-afb0-4335-b60f-13071b957d08] Updating instance_info_cache with network_info: [{"id": "cb7029cd-2b2f-4e5a-8f70-5f644a14eb24", "address": "fa:16:3e:68:3a:b3", "network": {"id": "8a87df1a-24b8-499e-a908-0d1fa99ed69a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-824466532-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "c91ef8cd37154632a031592cdc6792aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb7029cd-2b", "ovs_interfaceid": "cb7029cd-2b2f-4e5a-8f70-5f644a14eb24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:22:24 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-4b95ea1a-fb78-4607-aed4-f7c596b03f9f req-09ef93cd-fb03-4452-b992-fae9cdebe12b service nova] Releasing lock "refresh_cache-0ef81d71-afb0-4335-b60f-13071b957d08" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:22:24 user nova-compute[71874]: DEBUG nova.compute.manager [req-49a388ab-9cc9-469f-85e5-7161578cdf83 req-4d0d7d82-d16d-429e-a4e6-9f591222418f service nova] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] Received event network-vif-deleted-ecba9b76-45d2-49e7-addc-367dc21b38ce {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:22:25 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:22:25 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:22:25 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:22:25 user nova-compute[71874]: DEBUG nova.compute.manager [req-bc804b0c-0462-4f24-b81e-c03825a13477 req-c436d08b-c4bd-44d5-be7b-2c1b6ed0757c service nova] [instance: 0ef81d71-afb0-4335-b60f-13071b957d08] Received event network-vif-plugged-cb7029cd-2b2f-4e5a-8f70-5f644a14eb24 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:22:25 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-bc804b0c-0462-4f24-b81e-c03825a13477 req-c436d08b-c4bd-44d5-be7b-2c1b6ed0757c service nova] Acquiring lock "0ef81d71-afb0-4335-b60f-13071b957d08-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:22:25 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-bc804b0c-0462-4f24-b81e-c03825a13477 req-c436d08b-c4bd-44d5-be7b-2c1b6ed0757c service nova] Lock "0ef81d71-afb0-4335-b60f-13071b957d08-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:22:25 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-bc804b0c-0462-4f24-b81e-c03825a13477 req-c436d08b-c4bd-44d5-be7b-2c1b6ed0757c service nova] Lock "0ef81d71-afb0-4335-b60f-13071b957d08-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:22:25 user nova-compute[71874]: DEBUG nova.compute.manager [req-bc804b0c-0462-4f24-b81e-c03825a13477 req-c436d08b-c4bd-44d5-be7b-2c1b6ed0757c service nova] [instance: 0ef81d71-afb0-4335-b60f-13071b957d08] No waiting events found dispatching network-vif-plugged-cb7029cd-2b2f-4e5a-8f70-5f644a14eb24 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:22:25 user nova-compute[71874]: WARNING nova.compute.manager [req-bc804b0c-0462-4f24-b81e-c03825a13477 req-c436d08b-c4bd-44d5-be7b-2c1b6ed0757c service nova] [instance: 0ef81d71-afb0-4335-b60f-13071b957d08] Received unexpected event network-vif-plugged-cb7029cd-2b2f-4e5a-8f70-5f644a14eb24 for instance with vm_state building and task_state spawning.
Apr 12 16:22:27 user nova-compute[71874]: DEBUG nova.compute.manager [req-46595fb3-ed13-45d4-822a-919b3f1b02a1 req-0c3f8b92-2ba1-40b6-a02e-1bdeb38a4518 service nova] [instance: 0ef81d71-afb0-4335-b60f-13071b957d08] Received event network-vif-plugged-cb7029cd-2b2f-4e5a-8f70-5f644a14eb24 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:22:27 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-46595fb3-ed13-45d4-822a-919b3f1b02a1 req-0c3f8b92-2ba1-40b6-a02e-1bdeb38a4518 service nova] Acquiring lock "0ef81d71-afb0-4335-b60f-13071b957d08-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:22:27 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-46595fb3-ed13-45d4-822a-919b3f1b02a1 req-0c3f8b92-2ba1-40b6-a02e-1bdeb38a4518 service nova] Lock "0ef81d71-afb0-4335-b60f-13071b957d08-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:22:27 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-46595fb3-ed13-45d4-822a-919b3f1b02a1 req-0c3f8b92-2ba1-40b6-a02e-1bdeb38a4518 service nova] Lock "0ef81d71-afb0-4335-b60f-13071b957d08-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:22:27 user nova-compute[71874]: DEBUG nova.compute.manager [req-46595fb3-ed13-45d4-822a-919b3f1b02a1 req-0c3f8b92-2ba1-40b6-a02e-1bdeb38a4518 service nova] [instance: 0ef81d71-afb0-4335-b60f-13071b957d08] No waiting events found dispatching network-vif-plugged-cb7029cd-2b2f-4e5a-8f70-5f644a14eb24 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:22:27 user nova-compute[71874]: WARNING nova.compute.manager [req-46595fb3-ed13-45d4-822a-919b3f1b02a1 req-0c3f8b92-2ba1-40b6-a02e-1bdeb38a4518 service nova] [instance: 0ef81d71-afb0-4335-b60f-13071b957d08] Received unexpected event network-vif-plugged-cb7029cd-2b2f-4e5a-8f70-5f644a14eb24 for instance with vm_state building and task_state spawning.
Apr 12 16:22:27 user nova-compute[71874]: DEBUG nova.virt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Emitting event <LifecycleEvent: 1681316547.529442, 0ef81d71-afb0-4335-b60f-13071b957d08 => Resumed> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:22:27 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 0ef81d71-afb0-4335-b60f-13071b957d08] VM Resumed (Lifecycle Event)
Apr 12 16:22:27 user nova-compute[71874]: DEBUG nova.compute.manager [None req-3ce9644a-3829-46ff-9cd6-3d4ccebb994a tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] [instance: 0ef81d71-afb0-4335-b60f-13071b957d08] Instance event wait completed in 0 seconds for  {{(pid=71874) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 16:22:27 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-3ce9644a-3829-46ff-9cd6-3d4ccebb994a tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] [instance: 0ef81d71-afb0-4335-b60f-13071b957d08] Guest created on hypervisor {{(pid=71874) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 16:22:27 user nova-compute[71874]: INFO nova.virt.libvirt.driver [-] [instance: 0ef81d71-afb0-4335-b60f-13071b957d08] Instance spawned successfully.
Apr 12 16:22:27 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-3ce9644a-3829-46ff-9cd6-3d4ccebb994a tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] [instance: 0ef81d71-afb0-4335-b60f-13071b957d08] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 16:22:27 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 0ef81d71-afb0-4335-b60f-13071b957d08] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:22:27 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-3ce9644a-3829-46ff-9cd6-3d4ccebb994a tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] [instance: 0ef81d71-afb0-4335-b60f-13071b957d08] Found default for hw_cdrom_bus of ide {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:22:27 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-3ce9644a-3829-46ff-9cd6-3d4ccebb994a tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] [instance: 0ef81d71-afb0-4335-b60f-13071b957d08] Found default for hw_disk_bus of virtio {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:22:27 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-3ce9644a-3829-46ff-9cd6-3d4ccebb994a tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] [instance: 0ef81d71-afb0-4335-b60f-13071b957d08] Found default for hw_input_bus of None {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:22:27 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-3ce9644a-3829-46ff-9cd6-3d4ccebb994a tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] [instance: 0ef81d71-afb0-4335-b60f-13071b957d08] Found default for hw_pointer_model of None {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:22:27 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-3ce9644a-3829-46ff-9cd6-3d4ccebb994a tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] [instance: 0ef81d71-afb0-4335-b60f-13071b957d08] Found default for hw_video_model of virtio {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:22:27 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-3ce9644a-3829-46ff-9cd6-3d4ccebb994a tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] [instance: 0ef81d71-afb0-4335-b60f-13071b957d08] Found default for hw_vif_model of virtio {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:22:27 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 0ef81d71-afb0-4335-b60f-13071b957d08] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 16:22:27 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 0ef81d71-afb0-4335-b60f-13071b957d08] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 16:22:27 user nova-compute[71874]: DEBUG nova.virt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Emitting event <LifecycleEvent: 1681316547.5296392, 0ef81d71-afb0-4335-b60f-13071b957d08 => Started> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:22:27 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 0ef81d71-afb0-4335-b60f-13071b957d08] VM Started (Lifecycle Event)
Apr 12 16:22:27 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 0ef81d71-afb0-4335-b60f-13071b957d08] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:22:27 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 0ef81d71-afb0-4335-b60f-13071b957d08] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 16:22:27 user nova-compute[71874]: INFO nova.compute.manager [None req-3ce9644a-3829-46ff-9cd6-3d4ccebb994a tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] [instance: 0ef81d71-afb0-4335-b60f-13071b957d08] Took 6.85 seconds to spawn the instance on the hypervisor.
Apr 12 16:22:27 user nova-compute[71874]: DEBUG nova.compute.manager [None req-3ce9644a-3829-46ff-9cd6-3d4ccebb994a tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] [instance: 0ef81d71-afb0-4335-b60f-13071b957d08] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:22:27 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 0ef81d71-afb0-4335-b60f-13071b957d08] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 16:22:27 user nova-compute[71874]: INFO nova.compute.manager [None req-3ce9644a-3829-46ff-9cd6-3d4ccebb994a tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] [instance: 0ef81d71-afb0-4335-b60f-13071b957d08] Took 7.53 seconds to build instance.
Apr 12 16:22:27 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-3ce9644a-3829-46ff-9cd6-3d4ccebb994a tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Lock "0ef81d71-afb0-4335-b60f-13071b957d08" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.632s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:22:28 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:22:28 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:22:28 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:22:28 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:22:28 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:22:28 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:22:28 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Auditing locally available compute resources for user (node: user) {{(pid=71874) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 16:22:29 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8503d42f-646c-4e59-91fd-0c006b08de7b/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:22:29 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8503d42f-646c-4e59-91fd-0c006b08de7b/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:22:29 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8503d42f-646c-4e59-91fd-0c006b08de7b/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:22:29 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8503d42f-646c-4e59-91fd-0c006b08de7b/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:22:29 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 16:22:29 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32471bee-e77e-4a1b-8e00-d938a1373976/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:22:29 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32471bee-e77e-4a1b-8e00-d938a1373976/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:22:29 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32471bee-e77e-4a1b-8e00-d938a1373976/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:22:29 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32471bee-e77e-4a1b-8e00-d938a1373976/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:22:29 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ef81d71-afb0-4335-b60f-13071b957d08/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:22:29 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ef81d71-afb0-4335-b60f-13071b957d08/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:22:29 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ef81d71-afb0-4335-b60f-13071b957d08/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:22:29 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ef81d71-afb0-4335-b60f-13071b957d08/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:22:30 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:22:30 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:22:30 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Hypervisor/Node resource view: name=user free_ram=8426MB free_disk=25.96316146850586GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71874) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 16:22:30 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:22:30 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:22:30 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 32471bee-e77e-4a1b-8e00-d938a1373976 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:22:30 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 77842113-37e8-4dc3-bd28-84417eb1ac31 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:22:30 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 8503d42f-646c-4e59-91fd-0c006b08de7b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:22:30 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 0ef81d71-afb0-4335-b60f-13071b957d08 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:22:30 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=71874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 16:22:30 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Final resource view: name=user phys_ram=16023MB used_ram=1024MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=71874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 16:22:30 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Inventory has not changed in ProviderTree for provider: 0e94b4c8-cd49-45e4-9133-d36eb4b2456b {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 16:22:30 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Inventory has not changed for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 16:22:30 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Compute_service record updated for user:user {{(pid=71874) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 16:22:30 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.280s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:22:33 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:22:33 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:22:33 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71874) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 16:22:33 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71874) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 16:22:33 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71874) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 16:22:33 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:22:34 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:22:34 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:22:34 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:22:34 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:22:35 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:22:35 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Starting heal instance info cache {{(pid=71874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 16:22:35 user nova-compute[71874]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681316540.9439664, bef10c89-360e-42d6-aa26-7edf1afca567 => Stopped> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:22:35 user nova-compute[71874]: INFO nova.compute.manager [-] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] VM Stopped (Lifecycle Event)
Apr 12 16:22:35 user nova-compute[71874]: DEBUG nova.compute.manager [None req-83ac6a12-100c-430a-bb0a-c12f2a54f7b0 None None] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:22:35 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquiring lock "refresh_cache-77842113-37e8-4dc3-bd28-84417eb1ac31" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:22:35 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquired lock "refresh_cache-77842113-37e8-4dc3-bd28-84417eb1ac31" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:22:35 user nova-compute[71874]: DEBUG nova.network.neutron [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] [instance: 77842113-37e8-4dc3-bd28-84417eb1ac31] Forcefully refreshing network info cache for instance {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 16:22:36 user nova-compute[71874]: DEBUG nova.network.neutron [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] [instance: 77842113-37e8-4dc3-bd28-84417eb1ac31] Updating instance_info_cache with network_info: [{"id": "c9b27dd5-a751-4179-af86-77931b5f55e6", "address": "fa:16:3e:cb:0c:5a", "network": {"id": "1439244b-8287-4bba-a88c-99d4b498cccd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1491302639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29b1b89a5eeb408a8d0938e5f59f405f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9b27dd5-a7", "ovs_interfaceid": "c9b27dd5-a751-4179-af86-77931b5f55e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:22:36 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Releasing lock "refresh_cache-77842113-37e8-4dc3-bd28-84417eb1ac31" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:22:36 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] [instance: 77842113-37e8-4dc3-bd28-84417eb1ac31] Updated the network info_cache for instance {{(pid=71874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 16:22:37 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:22:37 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71874) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 16:22:38 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:22:38 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:22:38 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71874) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 16:22:38 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71874) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 16:22:38 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71874) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 16:22:38 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:22:39 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:22:40 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:22:41 user nova-compute[71874]: DEBUG nova.compute.manager [req-3f8c3fd8-1051-4058-a815-d871e15bb215 req-d59bacb4-0788-4232-b8b2-cd3b459bd25a service nova] [instance: 8503d42f-646c-4e59-91fd-0c006b08de7b] Received event network-changed-48d1ca2a-7881-4f05-a889-0e40e46c0e12 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:22:41 user nova-compute[71874]: DEBUG nova.compute.manager [req-3f8c3fd8-1051-4058-a815-d871e15bb215 req-d59bacb4-0788-4232-b8b2-cd3b459bd25a service nova] [instance: 8503d42f-646c-4e59-91fd-0c006b08de7b] Refreshing instance network info cache due to event network-changed-48d1ca2a-7881-4f05-a889-0e40e46c0e12. {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 16:22:41 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-3f8c3fd8-1051-4058-a815-d871e15bb215 req-d59bacb4-0788-4232-b8b2-cd3b459bd25a service nova] Acquiring lock "refresh_cache-8503d42f-646c-4e59-91fd-0c006b08de7b" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:22:41 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-3f8c3fd8-1051-4058-a815-d871e15bb215 req-d59bacb4-0788-4232-b8b2-cd3b459bd25a service nova] Acquired lock "refresh_cache-8503d42f-646c-4e59-91fd-0c006b08de7b" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:22:41 user nova-compute[71874]: DEBUG nova.network.neutron [req-3f8c3fd8-1051-4058-a815-d871e15bb215 req-d59bacb4-0788-4232-b8b2-cd3b459bd25a service nova] [instance: 8503d42f-646c-4e59-91fd-0c006b08de7b] Refreshing network info cache for port 48d1ca2a-7881-4f05-a889-0e40e46c0e12 {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 16:22:42 user nova-compute[71874]: DEBUG nova.network.neutron [req-3f8c3fd8-1051-4058-a815-d871e15bb215 req-d59bacb4-0788-4232-b8b2-cd3b459bd25a service nova] [instance: 8503d42f-646c-4e59-91fd-0c006b08de7b] Updated VIF entry in instance network info cache for port 48d1ca2a-7881-4f05-a889-0e40e46c0e12. {{(pid=71874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 16:22:42 user nova-compute[71874]: DEBUG nova.network.neutron [req-3f8c3fd8-1051-4058-a815-d871e15bb215 req-d59bacb4-0788-4232-b8b2-cd3b459bd25a service nova] [instance: 8503d42f-646c-4e59-91fd-0c006b08de7b] Updating instance_info_cache with network_info: [{"id": "48d1ca2a-7881-4f05-a889-0e40e46c0e12", "address": "fa:16:3e:af:68:02", "network": {"id": "1ef428ff-90e5-4abd-93d0-b7c2c581cb26", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-425924095-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf4334df004490ba51b4d92ce5408ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48d1ca2a-78", "ovs_interfaceid": "48d1ca2a-7881-4f05-a889-0e40e46c0e12", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:22:42 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-3f8c3fd8-1051-4058-a815-d871e15bb215 req-d59bacb4-0788-4232-b8b2-cd3b459bd25a service nova] Releasing lock "refresh_cache-8503d42f-646c-4e59-91fd-0c006b08de7b" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:22:43 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8c22a4d-884c-4d5f-908f-8aff1a721bd1 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Acquiring lock "8503d42f-646c-4e59-91fd-0c006b08de7b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:22:43 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8c22a4d-884c-4d5f-908f-8aff1a721bd1 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "8503d42f-646c-4e59-91fd-0c006b08de7b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:22:43 user nova-compute[71874]: DEBUG nova.objects.instance [None req-d8c22a4d-884c-4d5f-908f-8aff1a721bd1 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lazy-loading 'flavor' on Instance uuid 8503d42f-646c-4e59-91fd-0c006b08de7b {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:22:43 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8c22a4d-884c-4d5f-908f-8aff1a721bd1 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "8503d42f-646c-4e59-91fd-0c006b08de7b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:22:43 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8c22a4d-884c-4d5f-908f-8aff1a721bd1 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Acquiring lock "8503d42f-646c-4e59-91fd-0c006b08de7b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:22:43 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8c22a4d-884c-4d5f-908f-8aff1a721bd1 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "8503d42f-646c-4e59-91fd-0c006b08de7b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:22:43 user nova-compute[71874]: INFO nova.compute.manager [None req-d8c22a4d-884c-4d5f-908f-8aff1a721bd1 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 8503d42f-646c-4e59-91fd-0c006b08de7b] Attaching volume b9ced9f7-ea73-42ee-a889-09d6ae729361 to /dev/vdb
Apr 12 16:22:43 user nova-compute[71874]: DEBUG os_brick.utils [None req-d8c22a4d-884c-4d5f-908f-8aff1a721bd1 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:22:43 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:22:43 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:22:43 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:22:43 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[38c55e61-342d-4565-8c04-22f2e2aba25a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:61a48d4489d2\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:22:43 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:22:43 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:22:43 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[8442099c-b74f-4943-8a12-5d30606d698e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:22:43 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:22:43 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:22:43 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8c40372-c577-40c2-b085-d6a776a5e9d7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:22:43 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad098797-c519-401f-bd04-6f532375f920]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:22:43 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8c22a4d-884c-4d5f-908f-8aff1a721bd1 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Running cmd (subprocess): nvme version {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:22:43 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8c22a4d-884c-4d5f-908f-8aff1a721bd1 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] 'nvme version' failed. Not Retrying. {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 16:22:43 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d8c22a4d-884c-4d5f-908f-8aff1a721bd1 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] nvme not present on system {{(pid=71874) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 16:22:43 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:22:43 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 16:22:43 user nova-compute[71874]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 16:22:43 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1474b12-4207-4347-bcf0-1890bc4a64c6]: (4, '') {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:22:43 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.lightos [None req-d8c22a4d-884c-4d5f-908f-8aff1a721bd1 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71874) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 16:22:43 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.lightos [None req-d8c22a4d-884c-4d5f-908f-8aff1a721bd1 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71874) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 16:22:43 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.lightos [None req-d8c22a4d-884c-4d5f-908f-8aff1a721bd1 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] LIGHTOS: no hostnqn found. {{(pid=71874) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 16:22:43 user nova-compute[71874]: DEBUG os_brick.utils [None req-d8c22a4d-884c-4d5f-908f-8aff1a721bd1 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:61a48d4489d2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:22:43 user nova-compute[71874]: DEBUG nova.virt.block_device [None req-d8c22a4d-884c-4d5f-908f-8aff1a721bd1 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 8503d42f-646c-4e59-91fd-0c006b08de7b] Updating existing volume attachment record: 233cffa5-b393-4357-9f9f-86dd43191dca {{(pid=71874) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 16:22:43 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:22:47 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d8c22a4d-884c-4d5f-908f-8aff1a721bd1 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 8503d42f-646c-4e59-91fd-0c006b08de7b] Calling os-brick to attach iSCSI Volume {{(pid=71874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 16:22:47 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8c22a4d-884c-4d5f-908f-8aff1a721bd1 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3c0216320>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b9ced9f7-ea73-42ee-a889-09d6ae729361', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YTXElRiO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:22:47 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-d8c22a4d-884c-4d5f-908f-8aff1a721bd1 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:22:47 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-d8c22a4d-884c-4d5f-908f-8aff1a721bd1 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:22:47 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-d8c22a4d-884c-4d5f-908f-8aff1a721bd1 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:22:47 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-d8c22a4d-884c-4d5f-908f-8aff1a721bd1 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:22:47 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-d8c22a4d-884c-4d5f-908f-8aff1a721bd1 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b9ced9f7-ea73-42ee-a889-09d6ae729361" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:22:47 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-d8c22a4d-884c-4d5f-908f-8aff1a721bd1 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b9ced9f7-ea73-42ee-a889-09d6ae729361" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:22:47 user nova-compute[71874]: INFO os_brick.initiator.connectors.iscsi [None req-d8c22a4d-884c-4d5f-908f-8aff1a721bd1 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 16:22:47 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9ced9f7-ea73-42ee-a889-09d6ae729361 -p 172.16.0.220:3260 {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:22:47 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9ced9f7-ea73-42ee-a889-09d6ae729361 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:22:47 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[c40f6c8b-a761-4fe3-9803-cbf3c0d87228]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:22:47 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8c22a4d-884c-4d5f-908f-8aff1a721bd1 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 16:22:47 user nova-compute[71874]:  {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:22:47 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9ced9f7-ea73-42ee-a889-09d6ae729361 -p 172.16.0.220:3260 --interface default --op new {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:22:47 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9ced9f7-ea73-42ee-a889-09d6ae729361 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:22:47 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[d868f3be-399d-4ce2-8c02-bd381194ecab]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b9ced9f7-ea73-42ee-a889-09d6ae729361] added\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:22:47 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8c22a4d-884c-4d5f-908f-8aff1a721bd1 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b9ced9f7-ea73-42ee-a889-09d6ae729361] added
Apr 12 16:22:47 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:22:47 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9ced9f7-ea73-42ee-a889-09d6ae729361 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:22:47 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9ced9f7-ea73-42ee-a889-09d6ae729361 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.031s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:22:48 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa330610-9fbc-4276-811a-aeb08d47fee4]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:22:48 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8c22a4d-884c-4d5f-908f-8aff1a721bd1 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:22:48 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9ced9f7-ea73-42ee-a889-09d6ae729361 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:22:48 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9ced9f7-ea73-42ee-a889-09d6ae729361 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.106s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:22:48 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[44193887-0e1f-4ef4-8347-fe46cc1541eb]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:22:48 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8c22a4d-884c-4d5f-908f-8aff1a721bd1 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:22:48 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9ced9f7-ea73-42ee-a889-09d6ae729361 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YTXElRiO {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:22:48 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9ced9f7-ea73-42ee-a889-09d6ae729361 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YTXElRiO" returned: 0 in 0.029s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:22:48 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[50af2720-b455-4586-a593-905d44751794]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:22:48 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8c22a4d-884c-4d5f-908f-8aff1a721bd1 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YTXElRiO'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:22:48 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9ced9f7-ea73-42ee-a889-09d6ae729361 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:22:48 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9ced9f7-ea73-42ee-a889-09d6ae729361 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:22:48 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee46608a-aa2c-4932-8780-403d090a694f]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:22:48 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8c22a4d-884c-4d5f-908f-8aff1a721bd1 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:22:48 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:22:48 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:22:48 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[b35bb7bc-03bc-4ff7-838d-52865d2bbadd]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:952c0ad3-7b56-454e-af58-10213195373d (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:22:48 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8c22a4d-884c-4d5f-908f-8aff1a721bd1 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:952c0ad3-7b56-454e-af58-10213195373d (non-flash)
Apr 12 16:22:48 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:22:48 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8c22a4d-884c-4d5f-908f-8aff1a721bd1 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:952c0ad3-7b56-454e-af58-10213195373d (non-flash)
Apr 12 16:22:48 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:22:48 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9ced9f7-ea73-42ee-a889-09d6ae729361 -p 172.16.0.220:3260 --login {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:22:48 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9ced9f7-ea73-42ee-a889-09d6ae729361 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:22:48 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[c758e92d-864f-41d6-ac66-2a03f27309b9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b9ced9f7-ea73-42ee-a889-09d6ae729361, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b9ced9f7-ea73-42ee-a889-09d6ae729361, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:22:48 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8c22a4d-884c-4d5f-908f-8aff1a721bd1 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b9ced9f7-ea73-42ee-a889-09d6ae729361, portal: 172.16.0.220,3260]
Apr 12 16:22:48 user nova-compute[71874]: Login to [iface: default, target: iqn.2010-10.org.openstack:b9ced9f7-ea73-42ee-a889-09d6ae729361, portal: 172.16.0.220,3260] successful.
Apr 12 16:22:48 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:22:48 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9ced9f7-ea73-42ee-a889-09d6ae729361 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:22:48 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9ced9f7-ea73-42ee-a889-09d6ae729361 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:22:48 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[7232e307-d1b9-4ac9-8e24-c055f876f522]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:22:48 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8c22a4d-884c-4d5f-908f-8aff1a721bd1 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:22:48 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:22:48 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:22:48 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[56051709-1ded-49ef-8250-1a8a92fc8169]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:952c0ad3-7b56-454e-af58-10213195373d (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9ced9f7-ea73-42ee-a889-09d6ae729361 (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:22:48 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8c22a4d-884c-4d5f-908f-8aff1a721bd1 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:952c0ad3-7b56-454e-af58-10213195373d (non-flash)
Apr 12 16:22:48 user nova-compute[71874]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9ced9f7-ea73-42ee-a889-09d6ae729361 (non-flash)
Apr 12 16:22:48 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:22:48 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8c22a4d-884c-4d5f-908f-8aff1a721bd1 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:952c0ad3-7b56-454e-af58-10213195373d (non-flash)
Apr 12 16:22:48 user nova-compute[71874]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9ced9f7-ea73-42ee-a889-09d6ae729361 (non-flash)
Apr 12 16:22:48 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:22:48 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-d8c22a4d-884c-4d5f-908f-8aff1a721bd1 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b9ced9f7-ea73-42ee-a889-09d6ae729361" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.368s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:22:48 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8c22a4d-884c-4d5f-908f-8aff1a721bd1 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Connected to 172.16.0.220:3260 {{(pid=71874) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 16:22:48 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-d8c22a4d-884c-4d5f-908f-8aff1a721bd1 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] HCTL ('34', '-', '-', 0) found on session 47 with lun 0 {{(pid=71874) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 16:22:48 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-d8c22a4d-884c-4d5f-908f-8aff1a721bd1 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71874) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 16:22:48 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:22:48 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:22:48 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f3711fe-acf6-4e42-9288-ae4eddb97923]: (4, ('- - 0', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:22:48 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-d8c22a4d-884c-4d5f-908f-8aff1a721bd1 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Searching for a device in session 47 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71874) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 16:22:48 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8c22a4d-884c-4d5f-908f-8aff1a721bd1 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:b9ced9f7-ea73-42ee-a889-09d6ae729361', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YTXElRiO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71874) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 16:22:48 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:22:48 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:22:49 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-d8c22a4d-884c-4d5f-908f-8aff1a721bd1 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.401s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:22:49 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8c22a4d-884c-4d5f-908f-8aff1a721bd1 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] <== connect_volume: return (1403ms) {'type': 'block', 'scsi_wwn': '23638353366386338', 'path': '/dev/sdc'} {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:22:49 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d8c22a4d-884c-4d5f-908f-8aff1a721bd1 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 8503d42f-646c-4e59-91fd-0c006b08de7b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23638353366386338', 'path': '/dev/sdc'} {{(pid=71874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 16:22:49 user nova-compute[71874]: DEBUG nova.objects.instance [None req-d8c22a4d-884c-4d5f-908f-8aff1a721bd1 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lazy-loading 'flavor' on Instance uuid 8503d42f-646c-4e59-91fd-0c006b08de7b {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:22:49 user nova-compute[71874]: DEBUG nova.virt.libvirt.guest [None req-d8c22a4d-884c-4d5f-908f-8aff1a721bd1 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 16:22:49 user nova-compute[71874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 16:22:49 user nova-compute[71874]:   <source dev="/dev/sdc"/>
Apr 12 16:22:49 user nova-compute[71874]:   <target dev="vdb" bus="virtio"/>
Apr 12 16:22:49 user nova-compute[71874]:   <serial>b9ced9f7-ea73-42ee-a889-09d6ae729361</serial>
Apr 12 16:22:49 user nova-compute[71874]: </disk>
Apr 12 16:22:49 user nova-compute[71874]:  {{(pid=71874) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 16:22:49 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d8c22a4d-884c-4d5f-908f-8aff1a721bd1 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] No BDM found with device name vda, not building metadata. {{(pid=71874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 16:22:49 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d8c22a4d-884c-4d5f-908f-8aff1a721bd1 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 16:22:49 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d8c22a4d-884c-4d5f-908f-8aff1a721bd1 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] No VIF found with MAC fa:16:3e:af:68:02, not building metadata {{(pid=71874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 16:22:49 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8c22a4d-884c-4d5f-908f-8aff1a721bd1 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "8503d42f-646c-4e59-91fd-0c006b08de7b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.354s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:22:51 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-e4bfd698-c771-4105-8efd-0ea875077f77 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Acquiring lock "8503d42f-646c-4e59-91fd-0c006b08de7b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:22:51 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-e4bfd698-c771-4105-8efd-0ea875077f77 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "8503d42f-646c-4e59-91fd-0c006b08de7b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:22:51 user nova-compute[71874]: DEBUG nova.objects.instance [None req-e4bfd698-c771-4105-8efd-0ea875077f77 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lazy-loading 'flavor' on Instance uuid 8503d42f-646c-4e59-91fd-0c006b08de7b {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:22:51 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-e4bfd698-c771-4105-8efd-0ea875077f77 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "8503d42f-646c-4e59-91fd-0c006b08de7b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:22:51 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-e4bfd698-c771-4105-8efd-0ea875077f77 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Acquiring lock "8503d42f-646c-4e59-91fd-0c006b08de7b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:22:51 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-e4bfd698-c771-4105-8efd-0ea875077f77 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "8503d42f-646c-4e59-91fd-0c006b08de7b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:22:51 user nova-compute[71874]: INFO nova.compute.manager [None req-e4bfd698-c771-4105-8efd-0ea875077f77 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 8503d42f-646c-4e59-91fd-0c006b08de7b] Attaching volume 276e3d8f-d485-4148-9e7d-bb31e9d903f7 to /dev/vdc
Apr 12 16:22:51 user nova-compute[71874]: DEBUG os_brick.utils [None req-e4bfd698-c771-4105-8efd-0ea875077f77 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:22:51 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:22:51 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:22:51 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1e663a5-7ae3-43d5-b054-a68f6be67fdf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:61a48d4489d2\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:22:51 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:22:51 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:22:51 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd713365-85ed-4a91-ac5f-79ab7f66e619]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:22:51 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:22:51 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:22:51 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[70b7a1a6-09a1-4e63-b740-d22c92ddf17f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:22:51 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f560061-e68a-4811-9502-18f9899ac3dc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:22:51 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-e4bfd698-c771-4105-8efd-0ea875077f77 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Running cmd (subprocess): nvme version {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:22:51 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-e4bfd698-c771-4105-8efd-0ea875077f77 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] 'nvme version' failed. Not Retrying. {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 16:22:51 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e4bfd698-c771-4105-8efd-0ea875077f77 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] nvme not present on system {{(pid=71874) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 16:22:51 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:22:51 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 16:22:51 user nova-compute[71874]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 16:22:51 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fcaa960-641d-4dd3-a907-cd2603ffa69c]: (4, '') {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:22:51 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.lightos [None req-e4bfd698-c771-4105-8efd-0ea875077f77 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71874) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 16:22:51 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.lightos [None req-e4bfd698-c771-4105-8efd-0ea875077f77 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71874) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 16:22:51 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.lightos [None req-e4bfd698-c771-4105-8efd-0ea875077f77 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] LIGHTOS: no hostnqn found. {{(pid=71874) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 16:22:51 user nova-compute[71874]: DEBUG os_brick.utils [None req-e4bfd698-c771-4105-8efd-0ea875077f77 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:61a48d4489d2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:22:51 user nova-compute[71874]: DEBUG nova.virt.block_device [None req-e4bfd698-c771-4105-8efd-0ea875077f77 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 8503d42f-646c-4e59-91fd-0c006b08de7b] Updating existing volume attachment record: d4d11aec-2441-466e-9098-0295c7a9d17d {{(pid=71874) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 16:22:53 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-7de2639f-2b9b-46f9-a3d8-a059e6db6dbb tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "77842113-37e8-4dc3-bd28-84417eb1ac31" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:22:53 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-7de2639f-2b9b-46f9-a3d8-a059e6db6dbb tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "77842113-37e8-4dc3-bd28-84417eb1ac31" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:22:53 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-7de2639f-2b9b-46f9-a3d8-a059e6db6dbb tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "77842113-37e8-4dc3-bd28-84417eb1ac31-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:22:53 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-7de2639f-2b9b-46f9-a3d8-a059e6db6dbb tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "77842113-37e8-4dc3-bd28-84417eb1ac31-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:22:53 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-7de2639f-2b9b-46f9-a3d8-a059e6db6dbb tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "77842113-37e8-4dc3-bd28-84417eb1ac31-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:22:53 user nova-compute[71874]: INFO nova.compute.manager [None req-7de2639f-2b9b-46f9-a3d8-a059e6db6dbb tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 77842113-37e8-4dc3-bd28-84417eb1ac31] Terminating instance
Apr 12 16:22:53 user nova-compute[71874]: DEBUG nova.compute.manager [None req-7de2639f-2b9b-46f9-a3d8-a059e6db6dbb tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 77842113-37e8-4dc3-bd28-84417eb1ac31] Start destroying the instance on the hypervisor. {{(pid=71874) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 16:22:53 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:22:53 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:22:53 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:22:53 user nova-compute[71874]: DEBUG nova.compute.manager [req-95341ded-c519-4cb9-859f-76d997a2b7b7 req-65388f8e-311b-4eff-8391-63373dd4b05a service nova] [instance: 77842113-37e8-4dc3-bd28-84417eb1ac31] Received event network-vif-unplugged-c9b27dd5-a751-4179-af86-77931b5f55e6 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:22:53 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-95341ded-c519-4cb9-859f-76d997a2b7b7 req-65388f8e-311b-4eff-8391-63373dd4b05a service nova] Acquiring lock "77842113-37e8-4dc3-bd28-84417eb1ac31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:22:53 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-95341ded-c519-4cb9-859f-76d997a2b7b7 req-65388f8e-311b-4eff-8391-63373dd4b05a service nova] Lock "77842113-37e8-4dc3-bd28-84417eb1ac31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:22:53 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-95341ded-c519-4cb9-859f-76d997a2b7b7 req-65388f8e-311b-4eff-8391-63373dd4b05a service nova] Lock "77842113-37e8-4dc3-bd28-84417eb1ac31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:22:53 user nova-compute[71874]: DEBUG nova.compute.manager [req-95341ded-c519-4cb9-859f-76d997a2b7b7 req-65388f8e-311b-4eff-8391-63373dd4b05a service nova] [instance: 77842113-37e8-4dc3-bd28-84417eb1ac31] No waiting events found dispatching network-vif-unplugged-c9b27dd5-a751-4179-af86-77931b5f55e6 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:22:53 user nova-compute[71874]: DEBUG nova.compute.manager [req-95341ded-c519-4cb9-859f-76d997a2b7b7 req-65388f8e-311b-4eff-8391-63373dd4b05a service nova] [instance: 77842113-37e8-4dc3-bd28-84417eb1ac31] Received event network-vif-unplugged-c9b27dd5-a751-4179-af86-77931b5f55e6 for instance with task_state deleting. {{(pid=71874) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 16:22:53 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:22:54 user nova-compute[71874]: INFO nova.virt.libvirt.driver [-] [instance: 77842113-37e8-4dc3-bd28-84417eb1ac31] Instance destroyed successfully.
Apr 12 16:22:54 user nova-compute[71874]: DEBUG nova.objects.instance [None req-7de2639f-2b9b-46f9-a3d8-a059e6db6dbb tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lazy-loading 'resources' on Instance uuid 77842113-37e8-4dc3-bd28-84417eb1ac31 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:22:54 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-7de2639f-2b9b-46f9-a3d8-a059e6db6dbb tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T16:18:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1534459262',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1534459262',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1534459262',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T16:18:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='29b1b89a5eeb408a8d0938e5f59f405f',ramdisk_id='',reservation_id='r-gqr2t7mb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-734600841',owner_user_name='tempest-TestVolumeBootPattern-734600841-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T16:18:26Z,user_data=None,user_id='7054687447fc42339e9046ced4915890',uuid=77842113-37e8-4dc3-bd28-84417eb1ac31,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c9b27dd5-a751-4179-af86-77931b5f55e6", "address": "fa:16:3e:cb:0c:5a", "network": {"id": "1439244b-8287-4bba-a88c-99d4b498cccd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1491302639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29b1b89a5eeb408a8d0938e5f59f405f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9b27dd5-a7", "ovs_interfaceid": "c9b27dd5-a751-4179-af86-77931b5f55e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 16:22:54 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-7de2639f-2b9b-46f9-a3d8-a059e6db6dbb tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Converting VIF {"id": "c9b27dd5-a751-4179-af86-77931b5f55e6", "address": "fa:16:3e:cb:0c:5a", "network": {"id": "1439244b-8287-4bba-a88c-99d4b498cccd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1491302639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29b1b89a5eeb408a8d0938e5f59f405f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9b27dd5-a7", "ovs_interfaceid": "c9b27dd5-a751-4179-af86-77931b5f55e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:22:54 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-7de2639f-2b9b-46f9-a3d8-a059e6db6dbb tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cb:0c:5a,bridge_name='br-int',has_traffic_filtering=True,id=c9b27dd5-a751-4179-af86-77931b5f55e6,network=Network(1439244b-8287-4bba-a88c-99d4b498cccd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9b27dd5-a7') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:22:54 user nova-compute[71874]: DEBUG os_vif [None req-7de2639f-2b9b-46f9-a3d8-a059e6db6dbb tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cb:0c:5a,bridge_name='br-int',has_traffic_filtering=True,id=c9b27dd5-a751-4179-af86-77931b5f55e6,network=Network(1439244b-8287-4bba-a88c-99d4b498cccd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9b27dd5-a7') {{(pid=71874) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 16:22:54 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:22:54 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc9b27dd5-a7, bridge=br-int, if_exists=True) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:22:54 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:22:54 user nova-compute[71874]: INFO os_vif [None req-7de2639f-2b9b-46f9-a3d8-a059e6db6dbb tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cb:0c:5a,bridge_name='br-int',has_traffic_filtering=True,id=c9b27dd5-a751-4179-af86-77931b5f55e6,network=Network(1439244b-8287-4bba-a88c-99d4b498cccd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9b27dd5-a7')
Apr 12 16:22:54 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7de2639f-2b9b-46f9-a3d8-a059e6db6dbb tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 77842113-37e8-4dc3-bd28-84417eb1ac31] calling os-brick to detach iSCSI Volume {{(pid=71874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 16:22:54 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-7de2639f-2b9b-46f9-a3d8-a059e6db6dbb tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3c0216320>, {'target_iqn': 'iqn.2010-10.org.openstack:952c0ad3-7b56-454e-af58-10213195373d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CVOnjaXq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:22:54 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-7de2639f-2b9b-46f9-a3d8-a059e6db6dbb tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:22:54 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-7de2639f-2b9b-46f9-a3d8-a059e6db6dbb tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:22:54 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-7de2639f-2b9b-46f9-a3d8-a059e6db6dbb tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:22:54 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:22:54 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:22:54 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c05f7ff-03dd-45a8-945c-fc52fb1545ec]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b9ced9f7-ea73-42ee-a889-09d6ae729361\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:952c0ad3-7b56-454e-af58-10213195373d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:22:54 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-7de2639f-2b9b-46f9-a3d8-a059e6db6dbb tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 16:22:54 user nova-compute[71874]: No targets found.
Apr 12 16:22:54 user nova-compute[71874]: iSNS:
Apr 12 16:22:54 user nova-compute[71874]: No targets found.
Apr 12 16:22:54 user nova-compute[71874]: STATIC:
Apr 12 16:22:54 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:b9ced9f7-ea73-42ee-a889-09d6ae729361
Apr 12 16:22:54 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:22:54 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:22:54 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:952c0ad3-7b56-454e-af58-10213195373d
Apr 12 16:22:54 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:22:54 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:22:54 user nova-compute[71874]: FIRMWARE:
Apr 12 16:22:54 user nova-compute[71874]: No targets found.
Apr 12 16:22:54 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:22:54 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-7de2639f-2b9b-46f9-a3d8-a059e6db6dbb tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 16:22:54 user nova-compute[71874]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 16:22:54 user nova-compute[71874]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71874) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 16:22:54 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-7de2639f-2b9b-46f9-a3d8-a059e6db6dbb tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:952c0ad3-7b56-454e-af58-10213195373d', 0)] {{(pid=71874) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 16:22:54 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:22:54 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:22:54 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c8739ba-2941-47c4-90fc-df52d6a6ac59]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:952c0ad3-7b56-454e-af58-10213195373d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b9ced9f7-ea73-42ee-a889-09d6ae729361\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:22:54 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:22:54 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:22:54 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[851928ea-ee45-4506-9e34-7c2cdaf2b5f9]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:952c0ad3-7b56-454e-af58-10213195373d (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9ced9f7-ea73-42ee-a889-09d6ae729361 (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:22:54 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-7de2639f-2b9b-46f9-a3d8-a059e6db6dbb tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:952c0ad3-7b56-454e-af58-10213195373d (non-flash)
Apr 12 16:22:54 user nova-compute[71874]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9ced9f7-ea73-42ee-a889-09d6ae729361 (non-flash)
Apr 12 16:22:54 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:22:54 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-7de2639f-2b9b-46f9-a3d8-a059e6db6dbb tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:952c0ad3-7b56-454e-af58-10213195373d (non-flash)
Apr 12 16:22:54 user nova-compute[71874]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9ced9f7-ea73-42ee-a889-09d6ae729361 (non-flash)
Apr 12 16:22:54 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:22:54 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-7de2639f-2b9b-46f9-a3d8-a059e6db6dbb tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc37d663910>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:952c0ad3-7b56-454e-af58-10213195373d'): ({'sdb'}, set())}) {{(pid=71874) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 16:22:54 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-7de2639f-2b9b-46f9-a3d8-a059e6db6dbb tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Removing single pathed devices sdb {{(pid=71874) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 16:22:54 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:22:54 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:22:54 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdd0a3e8-d7ca-46ed-8979-3ebd6d61b6cf]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:22:54 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:22:54 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:22:54 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d593f45-e15c-4973-89f1-9898c02587db]: (4, ('ok\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:22:54 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-7de2639f-2b9b-46f9-a3d8-a059e6db6dbb tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Flushing IO for device /dev/sdb {{(pid=71874) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 16:22:54 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:22:54 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:22:54 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c087ac8-0a49-4c26-bae4-868738c271d2]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:22:54 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-7de2639f-2b9b-46f9-a3d8-a059e6db6dbb tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71874) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 16:22:54 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:22:54 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:22:54 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d4f8291-e0ff-4c32-92f4-2ba4dff53e54]: (4, ('1', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:22:54 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-7de2639f-2b9b-46f9-a3d8-a059e6db6dbb tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71874) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 16:22:54 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-7de2639f-2b9b-46f9-a3d8-a059e6db6dbb tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] SCSI volumes sdb have been removed. {{(pid=71874) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 16:22:54 user nova-compute[71874]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO913d93ea-66e4d441f4546e12', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_913d93ea', '/dev/disk/by-id/scsi-23636653464343431') {{(pid=82384) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 12 16:22:54 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ce6048c-c263-4ea8-9e85-509de471f130]: (4, None) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:22:54 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-7de2639f-2b9b-46f9-a3d8-a059e6db6dbb tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:952c0ad3-7b56-454e-af58-10213195373d')] {{(pid=71874) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 16:22:54 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:952c0ad3-7b56-454e-af58-10213195373d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:22:54 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:952c0ad3-7b56-454e-af58-10213195373d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:22:54 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[58a65858-51ea-4447-b512-b8df4a199013]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:22:54 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-7de2639f-2b9b-46f9-a3d8-a059e6db6dbb tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:22:54 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:952c0ad3-7b56-454e-af58-10213195373d -p 172.16.0.220:3260 --logout {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:22:54 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:952c0ad3-7b56-454e-af58-10213195373d -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:22:54 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[895a43f6-c9f2-4e16-9e17-9607c86cea0e]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:952c0ad3-7b56-454e-af58-10213195373d, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:952c0ad3-7b56-454e-af58-10213195373d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:22:54 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-7de2639f-2b9b-46f9-a3d8-a059e6db6dbb tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:952c0ad3-7b56-454e-af58-10213195373d, portal: 172.16.0.220,3260]
Apr 12 16:22:54 user nova-compute[71874]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:952c0ad3-7b56-454e-af58-10213195373d, portal: 172.16.0.220,3260] successful.
Apr 12 16:22:54 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:22:54 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:952c0ad3-7b56-454e-af58-10213195373d -p 172.16.0.220:3260 --op delete {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:22:54 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:952c0ad3-7b56-454e-af58-10213195373d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:22:54 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddf0133c-ec3f-4e77-aeb8-9e4c9f9afded]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:22:54 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-7de2639f-2b9b-46f9-a3d8-a059e6db6dbb tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:22:54 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-7de2639f-2b9b-46f9-a3d8-a059e6db6dbb tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:22:54 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-7de2639f-2b9b-46f9-a3d8-a059e6db6dbb tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] <== disconnect_volume: return (313ms) None {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:22:54 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7de2639f-2b9b-46f9-a3d8-a059e6db6dbb tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 77842113-37e8-4dc3-bd28-84417eb1ac31] Disconnected iSCSI Volume {{(pid=71874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 16:22:54 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-7de2639f-2b9b-46f9-a3d8-a059e6db6dbb tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 77842113-37e8-4dc3-bd28-84417eb1ac31] Deleting instance files /opt/stack/data/nova/instances/77842113-37e8-4dc3-bd28-84417eb1ac31_del
Apr 12 16:22:54 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-7de2639f-2b9b-46f9-a3d8-a059e6db6dbb tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 77842113-37e8-4dc3-bd28-84417eb1ac31] Deletion of /opt/stack/data/nova/instances/77842113-37e8-4dc3-bd28-84417eb1ac31_del complete
Apr 12 16:22:54 user nova-compute[71874]: INFO nova.compute.manager [None req-7de2639f-2b9b-46f9-a3d8-a059e6db6dbb tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 77842113-37e8-4dc3-bd28-84417eb1ac31] Took 1.15 seconds to destroy the instance on the hypervisor.
Apr 12 16:22:54 user nova-compute[71874]: DEBUG oslo.service.loopingcall [None req-7de2639f-2b9b-46f9-a3d8-a059e6db6dbb tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71874) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 16:22:54 user nova-compute[71874]: DEBUG nova.compute.manager [-] [instance: 77842113-37e8-4dc3-bd28-84417eb1ac31] Deallocating network for instance {{(pid=71874) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 16:22:54 user nova-compute[71874]: DEBUG nova.network.neutron [-] [instance: 77842113-37e8-4dc3-bd28-84417eb1ac31] deallocate_for_instance() {{(pid=71874) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 16:22:55 user nova-compute[71874]: DEBUG nova.network.neutron [-] [instance: 77842113-37e8-4dc3-bd28-84417eb1ac31] Updating instance_info_cache with network_info: [] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:22:55 user nova-compute[71874]: INFO nova.compute.manager [-] [instance: 77842113-37e8-4dc3-bd28-84417eb1ac31] Took 0.59 seconds to deallocate network for instance.
Apr 12 16:22:55 user nova-compute[71874]: DEBUG nova.compute.manager [req-d2c2fc9c-4b05-4a1a-8224-ccfa367e4733 req-44d1029f-d081-405d-b742-832935440e88 service nova] [instance: 77842113-37e8-4dc3-bd28-84417eb1ac31] Received event network-vif-deleted-c9b27dd5-a751-4179-af86-77931b5f55e6 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:22:55 user nova-compute[71874]: DEBUG nova.compute.manager [req-d20146d4-7afd-4cf1-9316-9e77af1a1131 req-7975d195-2901-499f-90f9-09ac95a95807 service nova] [instance: 77842113-37e8-4dc3-bd28-84417eb1ac31] Received event network-vif-plugged-c9b27dd5-a751-4179-af86-77931b5f55e6 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:22:55 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-d20146d4-7afd-4cf1-9316-9e77af1a1131 req-7975d195-2901-499f-90f9-09ac95a95807 service nova] Acquiring lock "77842113-37e8-4dc3-bd28-84417eb1ac31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:22:55 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-d20146d4-7afd-4cf1-9316-9e77af1a1131 req-7975d195-2901-499f-90f9-09ac95a95807 service nova] Lock "77842113-37e8-4dc3-bd28-84417eb1ac31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:22:55 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-d20146d4-7afd-4cf1-9316-9e77af1a1131 req-7975d195-2901-499f-90f9-09ac95a95807 service nova] Lock "77842113-37e8-4dc3-bd28-84417eb1ac31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:22:55 user nova-compute[71874]: DEBUG nova.compute.manager [req-d20146d4-7afd-4cf1-9316-9e77af1a1131 req-7975d195-2901-499f-90f9-09ac95a95807 service nova] [instance: 77842113-37e8-4dc3-bd28-84417eb1ac31] No waiting events found dispatching network-vif-plugged-c9b27dd5-a751-4179-af86-77931b5f55e6 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:22:55 user nova-compute[71874]: WARNING nova.compute.manager [req-d20146d4-7afd-4cf1-9316-9e77af1a1131 req-7975d195-2901-499f-90f9-09ac95a95807 service nova] [instance: 77842113-37e8-4dc3-bd28-84417eb1ac31] Received unexpected event network-vif-plugged-c9b27dd5-a751-4179-af86-77931b5f55e6 for instance with vm_state active and task_state deleting.
Apr 12 16:22:55 user nova-compute[71874]: INFO nova.compute.manager [None req-7de2639f-2b9b-46f9-a3d8-a059e6db6dbb tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 77842113-37e8-4dc3-bd28-84417eb1ac31] Took 0.78 seconds to detach 1 volumes for instance.
Apr 12 16:22:55 user nova-compute[71874]: DEBUG nova.compute.manager [None req-7de2639f-2b9b-46f9-a3d8-a059e6db6dbb tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 77842113-37e8-4dc3-bd28-84417eb1ac31] Deleting volume: 952c0ad3-7b56-454e-af58-10213195373d {{(pid=71874) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 12 16:22:55 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-7de2639f-2b9b-46f9-a3d8-a059e6db6dbb tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:22:55 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-7de2639f-2b9b-46f9-a3d8-a059e6db6dbb tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:22:56 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-7de2639f-2b9b-46f9-a3d8-a059e6db6dbb tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Inventory has not changed in ProviderTree for provider: 0e94b4c8-cd49-45e4-9133-d36eb4b2456b {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 16:22:56 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-7de2639f-2b9b-46f9-a3d8-a059e6db6dbb tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Inventory has not changed for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 16:22:56 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-7de2639f-2b9b-46f9-a3d8-a059e6db6dbb tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.180s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:22:56 user nova-compute[71874]: INFO nova.scheduler.client.report [None req-7de2639f-2b9b-46f9-a3d8-a059e6db6dbb tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Deleted allocations for instance 77842113-37e8-4dc3-bd28-84417eb1ac31
Apr 12 16:22:56 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-7de2639f-2b9b-46f9-a3d8-a059e6db6dbb tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "77842113-37e8-4dc3-bd28-84417eb1ac31" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.961s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:22:56 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4bfd698-c771-4105-8efd-0ea875077f77 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 8503d42f-646c-4e59-91fd-0c006b08de7b] Calling os-brick to attach iSCSI Volume {{(pid=71874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 16:22:56 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4bfd698-c771-4105-8efd-0ea875077f77 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3c0216320>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:276e3d8f-d485-4148-9e7d-bb31e9d903f7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jxrKBAzZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:22:56 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-e4bfd698-c771-4105-8efd-0ea875077f77 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:22:56 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-e4bfd698-c771-4105-8efd-0ea875077f77 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:22:56 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-e4bfd698-c771-4105-8efd-0ea875077f77 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:22:56 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-e4bfd698-c771-4105-8efd-0ea875077f77 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:22:56 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-e4bfd698-c771-4105-8efd-0ea875077f77 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:276e3d8f-d485-4148-9e7d-bb31e9d903f7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:22:56 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-e4bfd698-c771-4105-8efd-0ea875077f77 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:276e3d8f-d485-4148-9e7d-bb31e9d903f7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:22:56 user nova-compute[71874]: INFO os_brick.initiator.connectors.iscsi [None req-e4bfd698-c771-4105-8efd-0ea875077f77 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 16:22:56 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:276e3d8f-d485-4148-9e7d-bb31e9d903f7 -p 172.16.0.220:3260 {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:22:56 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:276e3d8f-d485-4148-9e7d-bb31e9d903f7 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:22:56 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[19368875-292c-47ce-8922-43a06ed53bb0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:22:56 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4bfd698-c771-4105-8efd-0ea875077f77 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 16:22:56 user nova-compute[71874]:  {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:22:56 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:276e3d8f-d485-4148-9e7d-bb31e9d903f7 -p 172.16.0.220:3260 --interface default --op new {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:22:56 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:276e3d8f-d485-4148-9e7d-bb31e9d903f7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:22:56 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[56244149-892a-41b0-b334-9efbfb800a12]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:276e3d8f-d485-4148-9e7d-bb31e9d903f7] added\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:22:56 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4bfd698-c771-4105-8efd-0ea875077f77 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:276e3d8f-d485-4148-9e7d-bb31e9d903f7] added
Apr 12 16:22:56 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:22:56 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:276e3d8f-d485-4148-9e7d-bb31e9d903f7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:22:56 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:276e3d8f-d485-4148-9e7d-bb31e9d903f7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.036s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:22:56 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cdb3de8-252e-4307-a26c-4732f268fc1d]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:22:56 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4bfd698-c771-4105-8efd-0ea875077f77 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:22:56 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:276e3d8f-d485-4148-9e7d-bb31e9d903f7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:22:56 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:276e3d8f-d485-4148-9e7d-bb31e9d903f7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:22:56 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[4346ce4f-53f6-4775-b591-53df81ab7863]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:22:56 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4bfd698-c771-4105-8efd-0ea875077f77 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:22:56 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:276e3d8f-d485-4148-9e7d-bb31e9d903f7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jxrKBAzZ {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:22:56 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:276e3d8f-d485-4148-9e7d-bb31e9d903f7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jxrKBAzZ" returned: 0 in 0.019s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:22:56 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae3e2741-90d0-4d6b-908a-1ec52adf59c9]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:22:56 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4bfd698-c771-4105-8efd-0ea875077f77 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jxrKBAzZ'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:22:56 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:276e3d8f-d485-4148-9e7d-bb31e9d903f7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:22:56 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:276e3d8f-d485-4148-9e7d-bb31e9d903f7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:22:56 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[f613ef0a-a674-4ee0-be4d-64f784d0f8ad]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:22:56 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4bfd698-c771-4105-8efd-0ea875077f77 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:22:56 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:22:56 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:22:56 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b31321f-6bfb-4d09-9875-41e44bb16410]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9ced9f7-ea73-42ee-a889-09d6ae729361 (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:22:56 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4bfd698-c771-4105-8efd-0ea875077f77 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9ced9f7-ea73-42ee-a889-09d6ae729361 (non-flash)
Apr 12 16:22:56 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:22:56 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4bfd698-c771-4105-8efd-0ea875077f77 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9ced9f7-ea73-42ee-a889-09d6ae729361 (non-flash)
Apr 12 16:22:56 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:22:56 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:276e3d8f-d485-4148-9e7d-bb31e9d903f7 -p 172.16.0.220:3260 --login {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:22:56 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:276e3d8f-d485-4148-9e7d-bb31e9d903f7 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:22:56 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[29dee7a6-83b8-4981-872c-69624f136d34]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:276e3d8f-d485-4148-9e7d-bb31e9d903f7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:276e3d8f-d485-4148-9e7d-bb31e9d903f7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:22:56 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4bfd698-c771-4105-8efd-0ea875077f77 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:276e3d8f-d485-4148-9e7d-bb31e9d903f7, portal: 172.16.0.220,3260]
Apr 12 16:22:56 user nova-compute[71874]: Login to [iface: default, target: iqn.2010-10.org.openstack:276e3d8f-d485-4148-9e7d-bb31e9d903f7, portal: 172.16.0.220,3260] successful.
Apr 12 16:22:56 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:22:56 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:276e3d8f-d485-4148-9e7d-bb31e9d903f7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:22:56 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:276e3d8f-d485-4148-9e7d-bb31e9d903f7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:22:56 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[19bd3e5a-f7ef-4966-91f8-7f1b283e6a41]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:22:56 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4bfd698-c771-4105-8efd-0ea875077f77 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:22:56 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:22:56 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:22:56 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[a45e4158-a1c4-48f3-be97-4401d30fbf7c]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9ced9f7-ea73-42ee-a889-09d6ae729361 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:276e3d8f-d485-4148-9e7d-bb31e9d903f7 (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:22:56 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4bfd698-c771-4105-8efd-0ea875077f77 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9ced9f7-ea73-42ee-a889-09d6ae729361 (non-flash)
Apr 12 16:22:56 user nova-compute[71874]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:276e3d8f-d485-4148-9e7d-bb31e9d903f7 (non-flash)
Apr 12 16:22:56 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:22:56 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4bfd698-c771-4105-8efd-0ea875077f77 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9ced9f7-ea73-42ee-a889-09d6ae729361 (non-flash)
Apr 12 16:22:56 user nova-compute[71874]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:276e3d8f-d485-4148-9e7d-bb31e9d903f7 (non-flash)
Apr 12 16:22:56 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:22:56 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-e4bfd698-c771-4105-8efd-0ea875077f77 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:276e3d8f-d485-4148-9e7d-bb31e9d903f7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.274s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:22:56 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4bfd698-c771-4105-8efd-0ea875077f77 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Connected to 172.16.0.220:3260 {{(pid=71874) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 16:22:56 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-e4bfd698-c771-4105-8efd-0ea875077f77 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] HCTL ('33', '-', '-', 0) found on session 48 with lun 0 {{(pid=71874) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 16:22:56 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-e4bfd698-c771-4105-8efd-0ea875077f77 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71874) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 16:22:56 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:22:56 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:22:56 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7ef4aba-140d-45f3-a5af-92466565ad0b]: (4, ('- - 0', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:22:56 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-e4bfd698-c771-4105-8efd-0ea875077f77 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Searching for a device in session 48 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71874) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 16:22:56 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4bfd698-c771-4105-8efd-0ea875077f77 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:276e3d8f-d485-4148-9e7d-bb31e9d903f7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jxrKBAzZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71874) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 16:22:57 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-e4bfd698-c771-4105-8efd-0ea875077f77 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.303s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:22:57 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4bfd698-c771-4105-8efd-0ea875077f77 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] <== connect_volume: return (1305ms) {'type': 'block', 'scsi_wwn': '26263303133646135', 'path': '/dev/sdb'} {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:22:57 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4bfd698-c771-4105-8efd-0ea875077f77 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 8503d42f-646c-4e59-91fd-0c006b08de7b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26263303133646135', 'path': '/dev/sdb'} {{(pid=71874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 16:22:57 user nova-compute[71874]: DEBUG nova.objects.instance [None req-e4bfd698-c771-4105-8efd-0ea875077f77 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lazy-loading 'flavor' on Instance uuid 8503d42f-646c-4e59-91fd-0c006b08de7b {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:22:57 user nova-compute[71874]: DEBUG nova.virt.libvirt.guest [None req-e4bfd698-c771-4105-8efd-0ea875077f77 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 16:22:57 user nova-compute[71874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 16:22:57 user nova-compute[71874]:   <source dev="/dev/sdb"/>
Apr 12 16:22:57 user nova-compute[71874]:   <target dev="vdc" bus="virtio"/>
Apr 12 16:22:57 user nova-compute[71874]:   <serial>276e3d8f-d485-4148-9e7d-bb31e9d903f7</serial>
Apr 12 16:22:57 user nova-compute[71874]: </disk>
Apr 12 16:22:57 user nova-compute[71874]:  {{(pid=71874) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 16:22:58 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-e4bfd698-c771-4105-8efd-0ea875077f77 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] No BDM found with device name vda, not building metadata. {{(pid=71874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 16:22:58 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-e4bfd698-c771-4105-8efd-0ea875077f77 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 16:22:58 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-e4bfd698-c771-4105-8efd-0ea875077f77 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 16:22:58 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-e4bfd698-c771-4105-8efd-0ea875077f77 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] No VIF found with MAC fa:16:3e:af:68:02, not building metadata {{(pid=71874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 16:22:58 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-e4bfd698-c771-4105-8efd-0ea875077f77 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "8503d42f-646c-4e59-91fd-0c006b08de7b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.518s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:22:58 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:22:59 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:22:59 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-69e0b2ba-030f-4c59-b0dd-9d7f11f21245 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Acquiring lock "8503d42f-646c-4e59-91fd-0c006b08de7b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:22:59 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-69e0b2ba-030f-4c59-b0dd-9d7f11f21245 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "8503d42f-646c-4e59-91fd-0c006b08de7b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:22:59 user nova-compute[71874]: INFO nova.compute.manager [None req-69e0b2ba-030f-4c59-b0dd-9d7f11f21245 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 8503d42f-646c-4e59-91fd-0c006b08de7b] Detaching volume b9ced9f7-ea73-42ee-a889-09d6ae729361
Apr 12 16:22:59 user nova-compute[71874]: INFO nova.virt.block_device [None req-69e0b2ba-030f-4c59-b0dd-9d7f11f21245 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 8503d42f-646c-4e59-91fd-0c006b08de7b] Attempting to driver detach volume b9ced9f7-ea73-42ee-a889-09d6ae729361 from mountpoint /dev/vdb
Apr 12 16:22:59 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-69e0b2ba-030f-4c59-b0dd-9d7f11f21245 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Attempting to detach device vdb from instance 8503d42f-646c-4e59-91fd-0c006b08de7b from the persistent domain config. {{(pid=71874) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 16:22:59 user nova-compute[71874]: DEBUG nova.virt.libvirt.guest [None req-69e0b2ba-030f-4c59-b0dd-9d7f11f21245 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 16:22:59 user nova-compute[71874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 16:22:59 user nova-compute[71874]:   <source dev="/dev/sdc"/>
Apr 12 16:22:59 user nova-compute[71874]:   <target dev="vdb" bus="virtio"/>
Apr 12 16:22:59 user nova-compute[71874]:   <serial>b9ced9f7-ea73-42ee-a889-09d6ae729361</serial>
Apr 12 16:22:59 user nova-compute[71874]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 16:22:59 user nova-compute[71874]: </disk>
Apr 12 16:22:59 user nova-compute[71874]:  {{(pid=71874) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 16:22:59 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-69e0b2ba-030f-4c59-b0dd-9d7f11f21245 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Successfully detached device vdb from instance 8503d42f-646c-4e59-91fd-0c006b08de7b from the persistent domain config.
Apr 12 16:22:59 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-69e0b2ba-030f-4c59-b0dd-9d7f11f21245 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8503d42f-646c-4e59-91fd-0c006b08de7b from the live domain config. {{(pid=71874) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 16:22:59 user nova-compute[71874]: DEBUG nova.virt.libvirt.guest [None req-69e0b2ba-030f-4c59-b0dd-9d7f11f21245 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 16:22:59 user nova-compute[71874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 16:22:59 user nova-compute[71874]:   <source dev="/dev/sdc"/>
Apr 12 16:22:59 user nova-compute[71874]:   <target dev="vdb" bus="virtio"/>
Apr 12 16:22:59 user nova-compute[71874]:   <serial>b9ced9f7-ea73-42ee-a889-09d6ae729361</serial>
Apr 12 16:22:59 user nova-compute[71874]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 16:22:59 user nova-compute[71874]: </disk>
Apr 12 16:22:59 user nova-compute[71874]:  {{(pid=71874) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 16:23:00 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Received event <DeviceRemovedEvent: 1681316580.176571, 8503d42f-646c-4e59-91fd-0c006b08de7b => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71874) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 16:23:00 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-69e0b2ba-030f-4c59-b0dd-9d7f11f21245 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8503d42f-646c-4e59-91fd-0c006b08de7b {{(pid=71874) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 16:23:00 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-69e0b2ba-030f-4c59-b0dd-9d7f11f21245 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Successfully detached device vdb from instance 8503d42f-646c-4e59-91fd-0c006b08de7b from the live domain config.
Apr 12 16:23:00 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-69e0b2ba-030f-4c59-b0dd-9d7f11f21245 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 8503d42f-646c-4e59-91fd-0c006b08de7b] calling os-brick to detach iSCSI Volume {{(pid=71874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 16:23:00 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-69e0b2ba-030f-4c59-b0dd-9d7f11f21245 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3c0216320>, {'target_iqn': 'iqn.2010-10.org.openstack:b9ced9f7-ea73-42ee-a889-09d6ae729361', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YTXElRiO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:23:00 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-69e0b2ba-030f-4c59-b0dd-9d7f11f21245 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:23:00 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-69e0b2ba-030f-4c59-b0dd-9d7f11f21245 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:23:00 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-69e0b2ba-030f-4c59-b0dd-9d7f11f21245 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:23:00 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:23:00 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:23:00 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[6287feb4-2d03-41f5-af51-e1399f6fbb82]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:276e3d8f-d485-4148-9e7d-bb31e9d903f7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b9ced9f7-ea73-42ee-a889-09d6ae729361\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:23:00 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-69e0b2ba-030f-4c59-b0dd-9d7f11f21245 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 16:23:00 user nova-compute[71874]: No targets found.
Apr 12 16:23:00 user nova-compute[71874]: iSNS:
Apr 12 16:23:00 user nova-compute[71874]: No targets found.
Apr 12 16:23:00 user nova-compute[71874]: STATIC:
Apr 12 16:23:00 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:276e3d8f-d485-4148-9e7d-bb31e9d903f7
Apr 12 16:23:00 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:23:00 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:23:00 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:b9ced9f7-ea73-42ee-a889-09d6ae729361
Apr 12 16:23:00 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:23:00 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:23:00 user nova-compute[71874]: FIRMWARE:
Apr 12 16:23:00 user nova-compute[71874]: No targets found.
Apr 12 16:23:00 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:23:00 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-69e0b2ba-030f-4c59-b0dd-9d7f11f21245 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 16:23:00 user nova-compute[71874]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 16:23:00 user nova-compute[71874]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71874) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 16:23:00 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-69e0b2ba-030f-4c59-b0dd-9d7f11f21245 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b9ced9f7-ea73-42ee-a889-09d6ae729361', 0)] {{(pid=71874) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 16:23:00 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:23:00 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:23:00 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[11162e58-4c7b-493b-b10c-c613decf47b7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:276e3d8f-d485-4148-9e7d-bb31e9d903f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b9ced9f7-ea73-42ee-a889-09d6ae729361\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:23:00 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:23:00 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:23:00 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fc17ce4-170a-41be-8fc7-165d39cdc964]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9ced9f7-ea73-42ee-a889-09d6ae729361 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:276e3d8f-d485-4148-9e7d-bb31e9d903f7 (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:23:00 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-69e0b2ba-030f-4c59-b0dd-9d7f11f21245 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9ced9f7-ea73-42ee-a889-09d6ae729361 (non-flash)
Apr 12 16:23:00 user nova-compute[71874]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:276e3d8f-d485-4148-9e7d-bb31e9d903f7 (non-flash)
Apr 12 16:23:00 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:23:00 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-69e0b2ba-030f-4c59-b0dd-9d7f11f21245 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9ced9f7-ea73-42ee-a889-09d6ae729361 (non-flash)
Apr 12 16:23:00 user nova-compute[71874]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:276e3d8f-d485-4148-9e7d-bb31e9d903f7 (non-flash)
Apr 12 16:23:00 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:23:00 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-69e0b2ba-030f-4c59-b0dd-9d7f11f21245 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc37d61d090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b9ced9f7-ea73-42ee-a889-09d6ae729361'): ({'sdc'}, set())}) {{(pid=71874) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 16:23:00 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-69e0b2ba-030f-4c59-b0dd-9d7f11f21245 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Removing single pathed devices sdc {{(pid=71874) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 16:23:00 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:23:00 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:23:00 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[12008401-74f4-4770-85cf-97f4342482d6]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:23:00 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:23:00 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:23:00 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[58bec804-01b9-40d3-803b-e815e17675f2]: (4, ('ok\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:23:00 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-69e0b2ba-030f-4c59-b0dd-9d7f11f21245 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Flushing IO for device /dev/sdc {{(pid=71874) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 16:23:00 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:23:00 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:23:00 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[be786353-2806-4801-884c-421faf042075]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:23:00 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-69e0b2ba-030f-4c59-b0dd-9d7f11f21245 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71874) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 16:23:00 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:23:00 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.029s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:23:00 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[e510be19-d76b-43dc-8dc4-6a863e7769d8]: (4, ('1', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:23:00 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-69e0b2ba-030f-4c59-b0dd-9d7f11f21245 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71874) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 16:23:00 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-69e0b2ba-030f-4c59-b0dd-9d7f11f21245 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] SCSI volumes sdc have been removed. {{(pid=71874) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 16:23:00 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-69e0b2ba-030f-4c59-b0dd-9d7f11f21245 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b9ced9f7-ea73-42ee-a889-09d6ae729361')] {{(pid=71874) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 16:23:00 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9ced9f7-ea73-42ee-a889-09d6ae729361 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:23:00 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9ced9f7-ea73-42ee-a889-09d6ae729361 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:23:00 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[671ee4b7-08a3-4038-895f-e5ccb0ce0333]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:23:00 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-69e0b2ba-030f-4c59-b0dd-9d7f11f21245 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:23:00 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9ced9f7-ea73-42ee-a889-09d6ae729361 -p 172.16.0.220:3260 --logout {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:23:00 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9ced9f7-ea73-42ee-a889-09d6ae729361 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:23:00 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[32edbbb4-3769-4c84-8084-a1f6319883ac]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:b9ced9f7-ea73-42ee-a889-09d6ae729361, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:b9ced9f7-ea73-42ee-a889-09d6ae729361, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:23:00 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-69e0b2ba-030f-4c59-b0dd-9d7f11f21245 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:b9ced9f7-ea73-42ee-a889-09d6ae729361, portal: 172.16.0.220,3260]
Apr 12 16:23:00 user nova-compute[71874]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:b9ced9f7-ea73-42ee-a889-09d6ae729361, portal: 172.16.0.220,3260] successful.
Apr 12 16:23:00 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:23:00 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9ced9f7-ea73-42ee-a889-09d6ae729361 -p 172.16.0.220:3260 --op delete {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:23:00 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9ced9f7-ea73-42ee-a889-09d6ae729361 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:23:00 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bdfc91e-7f38-4383-85e3-905e6f7faffc]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:23:00 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-69e0b2ba-030f-4c59-b0dd-9d7f11f21245 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:23:00 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-69e0b2ba-030f-4c59-b0dd-9d7f11f21245 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.281s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:23:00 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-69e0b2ba-030f-4c59-b0dd-9d7f11f21245 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] <== disconnect_volume: return (282ms) None {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:23:00 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-69e0b2ba-030f-4c59-b0dd-9d7f11f21245 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 8503d42f-646c-4e59-91fd-0c006b08de7b] Disconnected iSCSI Volume {{(pid=71874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 16:23:01 user nova-compute[71874]: DEBUG nova.objects.instance [None req-69e0b2ba-030f-4c59-b0dd-9d7f11f21245 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lazy-loading 'flavor' on Instance uuid 8503d42f-646c-4e59-91fd-0c006b08de7b {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:23:01 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-69e0b2ba-030f-4c59-b0dd-9d7f11f21245 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "8503d42f-646c-4e59-91fd-0c006b08de7b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.726s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:23:02 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-4e8d47e1-8df9-4d3e-99f7-166a038421b5 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Acquiring lock "8503d42f-646c-4e59-91fd-0c006b08de7b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:23:02 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-4e8d47e1-8df9-4d3e-99f7-166a038421b5 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "8503d42f-646c-4e59-91fd-0c006b08de7b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:23:02 user nova-compute[71874]: INFO nova.compute.manager [None req-4e8d47e1-8df9-4d3e-99f7-166a038421b5 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 8503d42f-646c-4e59-91fd-0c006b08de7b] Detaching volume 276e3d8f-d485-4148-9e7d-bb31e9d903f7
Apr 12 16:23:02 user nova-compute[71874]: INFO nova.virt.block_device [None req-4e8d47e1-8df9-4d3e-99f7-166a038421b5 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 8503d42f-646c-4e59-91fd-0c006b08de7b] Attempting to driver detach volume 276e3d8f-d485-4148-9e7d-bb31e9d903f7 from mountpoint /dev/vdc
Apr 12 16:23:02 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-4e8d47e1-8df9-4d3e-99f7-166a038421b5 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Attempting to detach device vdc from instance 8503d42f-646c-4e59-91fd-0c006b08de7b from the persistent domain config. {{(pid=71874) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 16:23:02 user nova-compute[71874]: DEBUG nova.virt.libvirt.guest [None req-4e8d47e1-8df9-4d3e-99f7-166a038421b5 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 16:23:02 user nova-compute[71874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 16:23:02 user nova-compute[71874]:   <source dev="/dev/sdb"/>
Apr 12 16:23:02 user nova-compute[71874]:   <target dev="vdc" bus="virtio"/>
Apr 12 16:23:02 user nova-compute[71874]:   <serial>276e3d8f-d485-4148-9e7d-bb31e9d903f7</serial>
Apr 12 16:23:02 user nova-compute[71874]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Apr 12 16:23:02 user nova-compute[71874]: </disk>
Apr 12 16:23:02 user nova-compute[71874]:  {{(pid=71874) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 16:23:02 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-4e8d47e1-8df9-4d3e-99f7-166a038421b5 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Successfully detached device vdc from instance 8503d42f-646c-4e59-91fd-0c006b08de7b from the persistent domain config.
Apr 12 16:23:02 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-4e8d47e1-8df9-4d3e-99f7-166a038421b5 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 8503d42f-646c-4e59-91fd-0c006b08de7b from the live domain config. {{(pid=71874) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 16:23:02 user nova-compute[71874]: DEBUG nova.virt.libvirt.guest [None req-4e8d47e1-8df9-4d3e-99f7-166a038421b5 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 16:23:02 user nova-compute[71874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 16:23:02 user nova-compute[71874]:   <source dev="/dev/sdb"/>
Apr 12 16:23:02 user nova-compute[71874]:   <target dev="vdc" bus="virtio"/>
Apr 12 16:23:02 user nova-compute[71874]:   <serial>276e3d8f-d485-4148-9e7d-bb31e9d903f7</serial>
Apr 12 16:23:02 user nova-compute[71874]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Apr 12 16:23:02 user nova-compute[71874]: </disk>
Apr 12 16:23:02 user nova-compute[71874]:  {{(pid=71874) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 16:23:02 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Received event <DeviceRemovedEvent: 1681316582.640453, 8503d42f-646c-4e59-91fd-0c006b08de7b => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=71874) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 16:23:02 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-4e8d47e1-8df9-4d3e-99f7-166a038421b5 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 8503d42f-646c-4e59-91fd-0c006b08de7b {{(pid=71874) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 16:23:02 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-4e8d47e1-8df9-4d3e-99f7-166a038421b5 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Successfully detached device vdc from instance 8503d42f-646c-4e59-91fd-0c006b08de7b from the live domain config.
Apr 12 16:23:02 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e8d47e1-8df9-4d3e-99f7-166a038421b5 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 8503d42f-646c-4e59-91fd-0c006b08de7b] calling os-brick to detach iSCSI Volume {{(pid=71874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 16:23:02 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e8d47e1-8df9-4d3e-99f7-166a038421b5 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3c0216320>, {'target_iqn': 'iqn.2010-10.org.openstack:276e3d8f-d485-4148-9e7d-bb31e9d903f7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jxrKBAzZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:23:02 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-4e8d47e1-8df9-4d3e-99f7-166a038421b5 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:23:02 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-4e8d47e1-8df9-4d3e-99f7-166a038421b5 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:23:02 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-4e8d47e1-8df9-4d3e-99f7-166a038421b5 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:23:02 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:23:02 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:23:02 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[16f2c495-07ef-49cb-9132-aba8e36ebc93]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:276e3d8f-d485-4148-9e7d-bb31e9d903f7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:23:02 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e8d47e1-8df9-4d3e-99f7-166a038421b5 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 16:23:02 user nova-compute[71874]: No targets found.
Apr 12 16:23:02 user nova-compute[71874]: iSNS:
Apr 12 16:23:02 user nova-compute[71874]: No targets found.
Apr 12 16:23:02 user nova-compute[71874]: STATIC:
Apr 12 16:23:02 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:276e3d8f-d485-4148-9e7d-bb31e9d903f7
Apr 12 16:23:02 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:23:02 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:23:02 user nova-compute[71874]: FIRMWARE:
Apr 12 16:23:02 user nova-compute[71874]: No targets found.
Apr 12 16:23:02 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:23:02 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e8d47e1-8df9-4d3e-99f7-166a038421b5 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 16:23:02 user nova-compute[71874]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 16:23:02 user nova-compute[71874]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71874) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 16:23:02 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e8d47e1-8df9-4d3e-99f7-166a038421b5 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:276e3d8f-d485-4148-9e7d-bb31e9d903f7', 0)] {{(pid=71874) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 16:23:02 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:23:02 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:23:02 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[88fa1933-cbff-459b-94a0-7b85044323a8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:276e3d8f-d485-4148-9e7d-bb31e9d903f7\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:23:02 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:23:02 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:23:02 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[28a73424-2bcb-4166-9e7e-f0294ec40db6]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:276e3d8f-d485-4148-9e7d-bb31e9d903f7 (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:23:02 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e8d47e1-8df9-4d3e-99f7-166a038421b5 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:276e3d8f-d485-4148-9e7d-bb31e9d903f7 (non-flash)
Apr 12 16:23:02 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:23:02 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e8d47e1-8df9-4d3e-99f7-166a038421b5 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:276e3d8f-d485-4148-9e7d-bb31e9d903f7 (non-flash)
Apr 12 16:23:02 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:23:02 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e8d47e1-8df9-4d3e-99f7-166a038421b5 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc39c2b8a60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:276e3d8f-d485-4148-9e7d-bb31e9d903f7'): ({'sdb'}, set())}) {{(pid=71874) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 16:23:02 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-4e8d47e1-8df9-4d3e-99f7-166a038421b5 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Removing single pathed devices sdb {{(pid=71874) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 16:23:02 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:23:02 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:23:02 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[800fe566-52fb-4b52-92fa-a4b91ed831c3]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:23:02 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:23:02 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:23:02 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c077966-0895-4c5b-81ce-41408ab7d80e]: (4, ('ok\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:23:02 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-4e8d47e1-8df9-4d3e-99f7-166a038421b5 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Flushing IO for device /dev/sdb {{(pid=71874) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 16:23:02 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:23:02 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:23:02 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfb377b7-681e-44e6-9baa-db6a2786f3a0]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:23:02 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-4e8d47e1-8df9-4d3e-99f7-166a038421b5 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71874) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 16:23:02 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:23:02 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.032s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:23:02 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2d3b118-b8c9-47b9-9e26-2be6c618579d]: (4, ('1', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:23:02 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-4e8d47e1-8df9-4d3e-99f7-166a038421b5 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71874) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 16:23:02 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-4e8d47e1-8df9-4d3e-99f7-166a038421b5 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] SCSI volumes sdb have been removed. {{(pid=71874) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 16:23:02 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e8d47e1-8df9-4d3e-99f7-166a038421b5 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:276e3d8f-d485-4148-9e7d-bb31e9d903f7')] {{(pid=71874) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 16:23:02 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:276e3d8f-d485-4148-9e7d-bb31e9d903f7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:23:02 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:276e3d8f-d485-4148-9e7d-bb31e9d903f7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:23:02 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7d49cb6-48bf-432b-b6bf-fce0399e9c37]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:23:02 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e8d47e1-8df9-4d3e-99f7-166a038421b5 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:23:02 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:276e3d8f-d485-4148-9e7d-bb31e9d903f7 -p 172.16.0.220:3260 --logout {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:23:02 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:276e3d8f-d485-4148-9e7d-bb31e9d903f7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.043s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:23:02 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab4a7272-d7bb-4bce-aa55-023b08e5f274]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:276e3d8f-d485-4148-9e7d-bb31e9d903f7, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:276e3d8f-d485-4148-9e7d-bb31e9d903f7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:23:02 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e8d47e1-8df9-4d3e-99f7-166a038421b5 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:276e3d8f-d485-4148-9e7d-bb31e9d903f7, portal: 172.16.0.220,3260]
Apr 12 16:23:02 user nova-compute[71874]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:276e3d8f-d485-4148-9e7d-bb31e9d903f7, portal: 172.16.0.220,3260] successful.
Apr 12 16:23:02 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:23:02 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:276e3d8f-d485-4148-9e7d-bb31e9d903f7 -p 172.16.0.220:3260 --op delete {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:23:02 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:276e3d8f-d485-4148-9e7d-bb31e9d903f7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:23:02 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[a084ff26-123f-4779-a7c7-3c461d413d73]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:23:02 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e8d47e1-8df9-4d3e-99f7-166a038421b5 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:23:02 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-4e8d47e1-8df9-4d3e-99f7-166a038421b5 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.252s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:23:02 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e8d47e1-8df9-4d3e-99f7-166a038421b5 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] <== disconnect_volume: return (253ms) None {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:23:02 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e8d47e1-8df9-4d3e-99f7-166a038421b5 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 8503d42f-646c-4e59-91fd-0c006b08de7b] Disconnected iSCSI Volume {{(pid=71874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 16:23:03 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:23:03 user nova-compute[71874]: DEBUG nova.objects.instance [None req-4e8d47e1-8df9-4d3e-99f7-166a038421b5 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lazy-loading 'flavor' on Instance uuid 8503d42f-646c-4e59-91fd-0c006b08de7b {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:23:03 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-4e8d47e1-8df9-4d3e-99f7-166a038421b5 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "8503d42f-646c-4e59-91fd-0c006b08de7b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.782s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:23:04 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:23:04 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-333c8bc2-790f-4f03-b7c6-3b4c216f7c29 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Acquiring lock "8503d42f-646c-4e59-91fd-0c006b08de7b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:23:04 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-333c8bc2-790f-4f03-b7c6-3b4c216f7c29 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "8503d42f-646c-4e59-91fd-0c006b08de7b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:23:04 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-333c8bc2-790f-4f03-b7c6-3b4c216f7c29 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Acquiring lock "8503d42f-646c-4e59-91fd-0c006b08de7b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:23:04 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-333c8bc2-790f-4f03-b7c6-3b4c216f7c29 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "8503d42f-646c-4e59-91fd-0c006b08de7b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:23:04 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-333c8bc2-790f-4f03-b7c6-3b4c216f7c29 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "8503d42f-646c-4e59-91fd-0c006b08de7b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:23:04 user nova-compute[71874]: INFO nova.compute.manager [None req-333c8bc2-790f-4f03-b7c6-3b4c216f7c29 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 8503d42f-646c-4e59-91fd-0c006b08de7b] Terminating instance
Apr 12 16:23:04 user nova-compute[71874]: DEBUG nova.compute.manager [None req-333c8bc2-790f-4f03-b7c6-3b4c216f7c29 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 8503d42f-646c-4e59-91fd-0c006b08de7b] Start destroying the instance on the hypervisor. {{(pid=71874) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 16:23:04 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:23:04 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:23:04 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:23:05 user nova-compute[71874]: DEBUG nova.compute.manager [req-425a0d5f-1f0b-40f0-b8fe-7a30284648a1 req-4a06ea3d-a9c1-4409-85c6-3534395ffafa service nova] [instance: 8503d42f-646c-4e59-91fd-0c006b08de7b] Received event network-vif-unplugged-48d1ca2a-7881-4f05-a889-0e40e46c0e12 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:23:05 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-425a0d5f-1f0b-40f0-b8fe-7a30284648a1 req-4a06ea3d-a9c1-4409-85c6-3534395ffafa service nova] Acquiring lock "8503d42f-646c-4e59-91fd-0c006b08de7b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:23:05 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-425a0d5f-1f0b-40f0-b8fe-7a30284648a1 req-4a06ea3d-a9c1-4409-85c6-3534395ffafa service nova] Lock "8503d42f-646c-4e59-91fd-0c006b08de7b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:23:05 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-425a0d5f-1f0b-40f0-b8fe-7a30284648a1 req-4a06ea3d-a9c1-4409-85c6-3534395ffafa service nova] Lock "8503d42f-646c-4e59-91fd-0c006b08de7b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:23:05 user nova-compute[71874]: DEBUG nova.compute.manager [req-425a0d5f-1f0b-40f0-b8fe-7a30284648a1 req-4a06ea3d-a9c1-4409-85c6-3534395ffafa service nova] [instance: 8503d42f-646c-4e59-91fd-0c006b08de7b] No waiting events found dispatching network-vif-unplugged-48d1ca2a-7881-4f05-a889-0e40e46c0e12 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:23:05 user nova-compute[71874]: DEBUG nova.compute.manager [req-425a0d5f-1f0b-40f0-b8fe-7a30284648a1 req-4a06ea3d-a9c1-4409-85c6-3534395ffafa service nova] [instance: 8503d42f-646c-4e59-91fd-0c006b08de7b] Received event network-vif-unplugged-48d1ca2a-7881-4f05-a889-0e40e46c0e12 for instance with task_state deleting. {{(pid=71874) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 16:23:05 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:23:05 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:23:05 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:23:05 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:23:05 user nova-compute[71874]: INFO nova.virt.libvirt.driver [-] [instance: 8503d42f-646c-4e59-91fd-0c006b08de7b] Instance destroyed successfully.
Apr 12 16:23:05 user nova-compute[71874]: DEBUG nova.objects.instance [None req-333c8bc2-790f-4f03-b7c6-3b4c216f7c29 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lazy-loading 'resources' on Instance uuid 8503d42f-646c-4e59-91fd-0c006b08de7b {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:23:05 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:23:05 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-333c8bc2-790f-4f03-b7c6-3b4c216f7c29 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T16:20:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1694219693',display_name='tempest-AttachVolumeTestJSON-server-1694219693',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1694219693',id=41,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFegUIJydsU75qcTJSV45dkY83seloCWf7obTREoxQ5Tzm2UtnqJnKrcKtlka/HBhmbE6gwOWBaksH9phh2mET8aWcIhrLEtEDmJocz9/pW3fFh7UqcEP6/AzD4YnExbQA==',key_name='tempest-keypair-857316521',keypairs=<?>,launch_index=0,launched_at=2023-04-12T16:20:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7cf4334df004490ba51b4d92ce5408ae',ramdisk_id='',reservation_id='r-e7rtictf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-178648074',owner_user_name='tempest-AttachVolumeTestJSON-178648074-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T16:20:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2996f6997bb14fc3aec9c3736cc65b8a',uuid=8503d42f-646c-4e59-91fd-0c006b08de7b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "48d1ca2a-7881-4f05-a889-0e40e46c0e12", "address": "fa:16:3e:af:68:02", "network": {"id": "1ef428ff-90e5-4abd-93d0-b7c2c581cb26", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-425924095-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf4334df004490ba51b4d92ce5408ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48d1ca2a-78", "ovs_interfaceid": "48d1ca2a-7881-4f05-a889-0e40e46c0e12", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 16:23:05 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-333c8bc2-790f-4f03-b7c6-3b4c216f7c29 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Converting VIF {"id": "48d1ca2a-7881-4f05-a889-0e40e46c0e12", "address": "fa:16:3e:af:68:02", "network": {"id": "1ef428ff-90e5-4abd-93d0-b7c2c581cb26", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-425924095-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cf4334df004490ba51b4d92ce5408ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48d1ca2a-78", "ovs_interfaceid": "48d1ca2a-7881-4f05-a889-0e40e46c0e12", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:23:05 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-333c8bc2-790f-4f03-b7c6-3b4c216f7c29 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:af:68:02,bridge_name='br-int',has_traffic_filtering=True,id=48d1ca2a-7881-4f05-a889-0e40e46c0e12,network=Network(1ef428ff-90e5-4abd-93d0-b7c2c581cb26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48d1ca2a-78') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:23:05 user nova-compute[71874]: DEBUG os_vif [None req-333c8bc2-790f-4f03-b7c6-3b4c216f7c29 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:af:68:02,bridge_name='br-int',has_traffic_filtering=True,id=48d1ca2a-7881-4f05-a889-0e40e46c0e12,network=Network(1ef428ff-90e5-4abd-93d0-b7c2c581cb26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48d1ca2a-78') {{(pid=71874) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 16:23:05 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:23:05 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap48d1ca2a-78, bridge=br-int, if_exists=True) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:23:05 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:23:05 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:23:05 user nova-compute[71874]: INFO os_vif [None req-333c8bc2-790f-4f03-b7c6-3b4c216f7c29 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:af:68:02,bridge_name='br-int',has_traffic_filtering=True,id=48d1ca2a-7881-4f05-a889-0e40e46c0e12,network=Network(1ef428ff-90e5-4abd-93d0-b7c2c581cb26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48d1ca2a-78')
Apr 12 16:23:05 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-333c8bc2-790f-4f03-b7c6-3b4c216f7c29 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 8503d42f-646c-4e59-91fd-0c006b08de7b] Deleting instance files /opt/stack/data/nova/instances/8503d42f-646c-4e59-91fd-0c006b08de7b_del
Apr 12 16:23:05 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-333c8bc2-790f-4f03-b7c6-3b4c216f7c29 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 8503d42f-646c-4e59-91fd-0c006b08de7b] Deletion of /opt/stack/data/nova/instances/8503d42f-646c-4e59-91fd-0c006b08de7b_del complete
Apr 12 16:23:05 user nova-compute[71874]: INFO nova.compute.manager [None req-333c8bc2-790f-4f03-b7c6-3b4c216f7c29 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 8503d42f-646c-4e59-91fd-0c006b08de7b] Took 0.86 seconds to destroy the instance on the hypervisor.
Apr 12 16:23:05 user nova-compute[71874]: DEBUG oslo.service.loopingcall [None req-333c8bc2-790f-4f03-b7c6-3b4c216f7c29 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71874) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 16:23:05 user nova-compute[71874]: DEBUG nova.compute.manager [-] [instance: 8503d42f-646c-4e59-91fd-0c006b08de7b] Deallocating network for instance {{(pid=71874) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 16:23:05 user nova-compute[71874]: DEBUG nova.network.neutron [-] [instance: 8503d42f-646c-4e59-91fd-0c006b08de7b] deallocate_for_instance() {{(pid=71874) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 16:23:05 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:23:05 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:23:06 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:23:06 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:23:06 user nova-compute[71874]: DEBUG nova.network.neutron [-] [instance: 8503d42f-646c-4e59-91fd-0c006b08de7b] Updating instance_info_cache with network_info: [] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:23:07 user nova-compute[71874]: INFO nova.compute.manager [-] [instance: 8503d42f-646c-4e59-91fd-0c006b08de7b] Took 1.42 seconds to deallocate network for instance.
Apr 12 16:23:07 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-333c8bc2-790f-4f03-b7c6-3b4c216f7c29 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:23:07 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-333c8bc2-790f-4f03-b7c6-3b4c216f7c29 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:23:07 user nova-compute[71874]: DEBUG nova.compute.manager [req-7347a9d6-3be8-4da6-aa10-34644e4b396f req-37feee9b-8b8a-4c6d-8d4e-81bf40801eee service nova] [instance: 8503d42f-646c-4e59-91fd-0c006b08de7b] Received event network-vif-plugged-48d1ca2a-7881-4f05-a889-0e40e46c0e12 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:23:07 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-7347a9d6-3be8-4da6-aa10-34644e4b396f req-37feee9b-8b8a-4c6d-8d4e-81bf40801eee service nova] Acquiring lock "8503d42f-646c-4e59-91fd-0c006b08de7b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:23:07 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-7347a9d6-3be8-4da6-aa10-34644e4b396f req-37feee9b-8b8a-4c6d-8d4e-81bf40801eee service nova] Lock "8503d42f-646c-4e59-91fd-0c006b08de7b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:23:07 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-7347a9d6-3be8-4da6-aa10-34644e4b396f req-37feee9b-8b8a-4c6d-8d4e-81bf40801eee service nova] Lock "8503d42f-646c-4e59-91fd-0c006b08de7b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:23:07 user nova-compute[71874]: DEBUG nova.compute.manager [req-7347a9d6-3be8-4da6-aa10-34644e4b396f req-37feee9b-8b8a-4c6d-8d4e-81bf40801eee service nova] [instance: 8503d42f-646c-4e59-91fd-0c006b08de7b] No waiting events found dispatching network-vif-plugged-48d1ca2a-7881-4f05-a889-0e40e46c0e12 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:23:07 user nova-compute[71874]: WARNING nova.compute.manager [req-7347a9d6-3be8-4da6-aa10-34644e4b396f req-37feee9b-8b8a-4c6d-8d4e-81bf40801eee service nova] [instance: 8503d42f-646c-4e59-91fd-0c006b08de7b] Received unexpected event network-vif-plugged-48d1ca2a-7881-4f05-a889-0e40e46c0e12 for instance with vm_state deleted and task_state None.
Apr 12 16:23:07 user nova-compute[71874]: DEBUG nova.compute.manager [req-7347a9d6-3be8-4da6-aa10-34644e4b396f req-37feee9b-8b8a-4c6d-8d4e-81bf40801eee service nova] [instance: 8503d42f-646c-4e59-91fd-0c006b08de7b] Received event network-vif-plugged-48d1ca2a-7881-4f05-a889-0e40e46c0e12 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:23:07 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-7347a9d6-3be8-4da6-aa10-34644e4b396f req-37feee9b-8b8a-4c6d-8d4e-81bf40801eee service nova] Acquiring lock "8503d42f-646c-4e59-91fd-0c006b08de7b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:23:07 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-7347a9d6-3be8-4da6-aa10-34644e4b396f req-37feee9b-8b8a-4c6d-8d4e-81bf40801eee service nova] Lock "8503d42f-646c-4e59-91fd-0c006b08de7b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:23:07 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-7347a9d6-3be8-4da6-aa10-34644e4b396f req-37feee9b-8b8a-4c6d-8d4e-81bf40801eee service nova] Lock "8503d42f-646c-4e59-91fd-0c006b08de7b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:23:07 user nova-compute[71874]: DEBUG nova.compute.manager [req-7347a9d6-3be8-4da6-aa10-34644e4b396f req-37feee9b-8b8a-4c6d-8d4e-81bf40801eee service nova] [instance: 8503d42f-646c-4e59-91fd-0c006b08de7b] No waiting events found dispatching network-vif-plugged-48d1ca2a-7881-4f05-a889-0e40e46c0e12 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:23:07 user nova-compute[71874]: WARNING nova.compute.manager [req-7347a9d6-3be8-4da6-aa10-34644e4b396f req-37feee9b-8b8a-4c6d-8d4e-81bf40801eee service nova] [instance: 8503d42f-646c-4e59-91fd-0c006b08de7b] Received unexpected event network-vif-plugged-48d1ca2a-7881-4f05-a889-0e40e46c0e12 for instance with vm_state deleted and task_state None.
Apr 12 16:23:07 user nova-compute[71874]: DEBUG nova.compute.manager [req-7347a9d6-3be8-4da6-aa10-34644e4b396f req-37feee9b-8b8a-4c6d-8d4e-81bf40801eee service nova] [instance: 8503d42f-646c-4e59-91fd-0c006b08de7b] Received event network-vif-plugged-48d1ca2a-7881-4f05-a889-0e40e46c0e12 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:23:07 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-7347a9d6-3be8-4da6-aa10-34644e4b396f req-37feee9b-8b8a-4c6d-8d4e-81bf40801eee service nova] Acquiring lock "8503d42f-646c-4e59-91fd-0c006b08de7b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:23:07 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-7347a9d6-3be8-4da6-aa10-34644e4b396f req-37feee9b-8b8a-4c6d-8d4e-81bf40801eee service nova] Lock "8503d42f-646c-4e59-91fd-0c006b08de7b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:23:07 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-7347a9d6-3be8-4da6-aa10-34644e4b396f req-37feee9b-8b8a-4c6d-8d4e-81bf40801eee service nova] Lock "8503d42f-646c-4e59-91fd-0c006b08de7b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:23:07 user nova-compute[71874]: DEBUG nova.compute.manager [req-7347a9d6-3be8-4da6-aa10-34644e4b396f req-37feee9b-8b8a-4c6d-8d4e-81bf40801eee service nova] [instance: 8503d42f-646c-4e59-91fd-0c006b08de7b] No waiting events found dispatching network-vif-plugged-48d1ca2a-7881-4f05-a889-0e40e46c0e12 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:23:07 user nova-compute[71874]: WARNING nova.compute.manager [req-7347a9d6-3be8-4da6-aa10-34644e4b396f req-37feee9b-8b8a-4c6d-8d4e-81bf40801eee service nova] [instance: 8503d42f-646c-4e59-91fd-0c006b08de7b] Received unexpected event network-vif-plugged-48d1ca2a-7881-4f05-a889-0e40e46c0e12 for instance with vm_state deleted and task_state None.
Apr 12 16:23:07 user nova-compute[71874]: DEBUG nova.compute.manager [req-7347a9d6-3be8-4da6-aa10-34644e4b396f req-37feee9b-8b8a-4c6d-8d4e-81bf40801eee service nova] [instance: 8503d42f-646c-4e59-91fd-0c006b08de7b] Received event network-vif-unplugged-48d1ca2a-7881-4f05-a889-0e40e46c0e12 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:23:07 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-7347a9d6-3be8-4da6-aa10-34644e4b396f req-37feee9b-8b8a-4c6d-8d4e-81bf40801eee service nova] Acquiring lock "8503d42f-646c-4e59-91fd-0c006b08de7b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:23:07 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-7347a9d6-3be8-4da6-aa10-34644e4b396f req-37feee9b-8b8a-4c6d-8d4e-81bf40801eee service nova] Lock "8503d42f-646c-4e59-91fd-0c006b08de7b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:23:07 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-7347a9d6-3be8-4da6-aa10-34644e4b396f req-37feee9b-8b8a-4c6d-8d4e-81bf40801eee service nova] Lock "8503d42f-646c-4e59-91fd-0c006b08de7b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:23:07 user nova-compute[71874]: DEBUG nova.compute.manager [req-7347a9d6-3be8-4da6-aa10-34644e4b396f req-37feee9b-8b8a-4c6d-8d4e-81bf40801eee service nova] [instance: 8503d42f-646c-4e59-91fd-0c006b08de7b] No waiting events found dispatching network-vif-unplugged-48d1ca2a-7881-4f05-a889-0e40e46c0e12 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:23:07 user nova-compute[71874]: WARNING nova.compute.manager [req-7347a9d6-3be8-4da6-aa10-34644e4b396f req-37feee9b-8b8a-4c6d-8d4e-81bf40801eee service nova] [instance: 8503d42f-646c-4e59-91fd-0c006b08de7b] Received unexpected event network-vif-unplugged-48d1ca2a-7881-4f05-a889-0e40e46c0e12 for instance with vm_state deleted and task_state None.
Apr 12 16:23:07 user nova-compute[71874]: DEBUG nova.compute.manager [req-7347a9d6-3be8-4da6-aa10-34644e4b396f req-37feee9b-8b8a-4c6d-8d4e-81bf40801eee service nova] [instance: 8503d42f-646c-4e59-91fd-0c006b08de7b] Received event network-vif-plugged-48d1ca2a-7881-4f05-a889-0e40e46c0e12 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:23:07 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-7347a9d6-3be8-4da6-aa10-34644e4b396f req-37feee9b-8b8a-4c6d-8d4e-81bf40801eee service nova] Acquiring lock "8503d42f-646c-4e59-91fd-0c006b08de7b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:23:07 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-7347a9d6-3be8-4da6-aa10-34644e4b396f req-37feee9b-8b8a-4c6d-8d4e-81bf40801eee service nova] Lock "8503d42f-646c-4e59-91fd-0c006b08de7b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:23:07 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-7347a9d6-3be8-4da6-aa10-34644e4b396f req-37feee9b-8b8a-4c6d-8d4e-81bf40801eee service nova] Lock "8503d42f-646c-4e59-91fd-0c006b08de7b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:23:07 user nova-compute[71874]: DEBUG nova.compute.manager [req-7347a9d6-3be8-4da6-aa10-34644e4b396f req-37feee9b-8b8a-4c6d-8d4e-81bf40801eee service nova] [instance: 8503d42f-646c-4e59-91fd-0c006b08de7b] No waiting events found dispatching network-vif-plugged-48d1ca2a-7881-4f05-a889-0e40e46c0e12 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:23:07 user nova-compute[71874]: WARNING nova.compute.manager [req-7347a9d6-3be8-4da6-aa10-34644e4b396f req-37feee9b-8b8a-4c6d-8d4e-81bf40801eee service nova] [instance: 8503d42f-646c-4e59-91fd-0c006b08de7b] Received unexpected event network-vif-plugged-48d1ca2a-7881-4f05-a889-0e40e46c0e12 for instance with vm_state deleted and task_state None.
Apr 12 16:23:07 user nova-compute[71874]: DEBUG nova.compute.manager [req-7347a9d6-3be8-4da6-aa10-34644e4b396f req-37feee9b-8b8a-4c6d-8d4e-81bf40801eee service nova] [instance: 8503d42f-646c-4e59-91fd-0c006b08de7b] Received event network-vif-deleted-48d1ca2a-7881-4f05-a889-0e40e46c0e12 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:23:07 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-333c8bc2-790f-4f03-b7c6-3b4c216f7c29 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Inventory has not changed in ProviderTree for provider: 0e94b4c8-cd49-45e4-9133-d36eb4b2456b {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 16:23:07 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-333c8bc2-790f-4f03-b7c6-3b4c216f7c29 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Inventory has not changed for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 16:23:07 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-333c8bc2-790f-4f03-b7c6-3b4c216f7c29 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.186s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:23:07 user nova-compute[71874]: INFO nova.scheduler.client.report [None req-333c8bc2-790f-4f03-b7c6-3b4c216f7c29 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Deleted allocations for instance 8503d42f-646c-4e59-91fd-0c006b08de7b
Apr 12 16:23:07 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-333c8bc2-790f-4f03-b7c6-3b4c216f7c29 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "8503d42f-646c-4e59-91fd-0c006b08de7b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.647s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:23:09 user nova-compute[71874]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681316574.051776, 77842113-37e8-4dc3-bd28-84417eb1ac31 => Stopped> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:23:09 user nova-compute[71874]: INFO nova.compute.manager [-] [instance: 77842113-37e8-4dc3-bd28-84417eb1ac31] VM Stopped (Lifecycle Event)
Apr 12 16:23:09 user nova-compute[71874]: DEBUG nova.compute.manager [None req-269d1c23-f2c6-4589-bea0-0c52f8f11b8e None None] [instance: 77842113-37e8-4dc3-bd28-84417eb1ac31] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:23:10 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:23:10 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-c5a98f47-3ad0-4a49-bf01-05be842b562d tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "32471bee-e77e-4a1b-8e00-d938a1373976" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:23:10 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-c5a98f47-3ad0-4a49-bf01-05be842b562d tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "32471bee-e77e-4a1b-8e00-d938a1373976" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:23:10 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-c5a98f47-3ad0-4a49-bf01-05be842b562d tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "32471bee-e77e-4a1b-8e00-d938a1373976-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:23:10 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-c5a98f47-3ad0-4a49-bf01-05be842b562d tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "32471bee-e77e-4a1b-8e00-d938a1373976-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:23:10 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-c5a98f47-3ad0-4a49-bf01-05be842b562d tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "32471bee-e77e-4a1b-8e00-d938a1373976-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:23:10 user nova-compute[71874]: INFO nova.compute.manager [None req-c5a98f47-3ad0-4a49-bf01-05be842b562d tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: 32471bee-e77e-4a1b-8e00-d938a1373976] Terminating instance
Apr 12 16:23:10 user nova-compute[71874]: DEBUG nova.compute.manager [None req-c5a98f47-3ad0-4a49-bf01-05be842b562d tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: 32471bee-e77e-4a1b-8e00-d938a1373976] Start destroying the instance on the hypervisor. {{(pid=71874) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 16:23:10 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:23:10 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:23:10 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:23:10 user nova-compute[71874]: DEBUG nova.compute.manager [req-4d32e5a5-6d26-4d70-a125-57942cbb13c2 req-54903182-c73b-4447-9dc1-46b6eda47ef3 service nova] [instance: 32471bee-e77e-4a1b-8e00-d938a1373976] Received event network-vif-unplugged-69029e57-b138-43c1-b31f-59bc7957994d {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:23:10 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-4d32e5a5-6d26-4d70-a125-57942cbb13c2 req-54903182-c73b-4447-9dc1-46b6eda47ef3 service nova] Acquiring lock "32471bee-e77e-4a1b-8e00-d938a1373976-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:23:10 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-4d32e5a5-6d26-4d70-a125-57942cbb13c2 req-54903182-c73b-4447-9dc1-46b6eda47ef3 service nova] Lock "32471bee-e77e-4a1b-8e00-d938a1373976-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:23:10 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-4d32e5a5-6d26-4d70-a125-57942cbb13c2 req-54903182-c73b-4447-9dc1-46b6eda47ef3 service nova] Lock "32471bee-e77e-4a1b-8e00-d938a1373976-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:23:10 user nova-compute[71874]: DEBUG nova.compute.manager [req-4d32e5a5-6d26-4d70-a125-57942cbb13c2 req-54903182-c73b-4447-9dc1-46b6eda47ef3 service nova] [instance: 32471bee-e77e-4a1b-8e00-d938a1373976] No waiting events found dispatching network-vif-unplugged-69029e57-b138-43c1-b31f-59bc7957994d {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:23:10 user nova-compute[71874]: DEBUG nova.compute.manager [req-4d32e5a5-6d26-4d70-a125-57942cbb13c2 req-54903182-c73b-4447-9dc1-46b6eda47ef3 service nova] [instance: 32471bee-e77e-4a1b-8e00-d938a1373976] Received event network-vif-unplugged-69029e57-b138-43c1-b31f-59bc7957994d for instance with task_state deleting. {{(pid=71874) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 16:23:11 user nova-compute[71874]: INFO nova.virt.libvirt.driver [-] [instance: 32471bee-e77e-4a1b-8e00-d938a1373976] Instance destroyed successfully.
Apr 12 16:23:11 user nova-compute[71874]: DEBUG nova.objects.instance [None req-c5a98f47-3ad0-4a49-bf01-05be842b562d tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lazy-loading 'resources' on Instance uuid 32471bee-e77e-4a1b-8e00-d938a1373976 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:23:11 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-c5a98f47-3ad0-4a49-bf01-05be842b562d tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T16:13:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1551944182',display_name='tempest-ServerActionsTestJSON-server-1551944182',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1551944182',id=33,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNmXVADjvoPSh3uGCGCTNS/vcfcDtUjn/vZEaV3bCllfz1ZO8VIgFuZhP+mAsa+G/KA4ubi5U9Vj41YtHGsakdPR5VoByhorvfUv/PIWtER2tn1LWX2mlFyT+T8AEJplPw==',key_name='tempest-keypair-1923467613',keypairs=<?>,launch_index=0,launched_at=2023-04-12T16:13:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='97ea81bd1962466bbe552424973f71a8',ramdisk_id='',reservation_id='r-mxg9p0v0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-631887779',owner_user_name='tempest-ServerActionsTestJSON-631887779-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T16:13:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1a699b3ba8304eadb8a53d465ea340cf',uuid=32471bee-e77e-4a1b-8e00-d938a1373976,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "69029e57-b138-43c1-b31f-59bc7957994d", "address": "fa:16:3e:04:8e:ce", "network": {"id": "e6694358-e361-4952-b859-93755c11721e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-667152893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97ea81bd1962466bbe552424973f71a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69029e57-b1", "ovs_interfaceid": "69029e57-b138-43c1-b31f-59bc7957994d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 16:23:11 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-c5a98f47-3ad0-4a49-bf01-05be842b562d tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Converting VIF {"id": "69029e57-b138-43c1-b31f-59bc7957994d", "address": "fa:16:3e:04:8e:ce", "network": {"id": "e6694358-e361-4952-b859-93755c11721e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-667152893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97ea81bd1962466bbe552424973f71a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69029e57-b1", "ovs_interfaceid": "69029e57-b138-43c1-b31f-59bc7957994d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:23:11 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-c5a98f47-3ad0-4a49-bf01-05be842b562d tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:04:8e:ce,bridge_name='br-int',has_traffic_filtering=True,id=69029e57-b138-43c1-b31f-59bc7957994d,network=Network(e6694358-e361-4952-b859-93755c11721e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69029e57-b1') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:23:11 user nova-compute[71874]: DEBUG os_vif [None req-c5a98f47-3ad0-4a49-bf01-05be842b562d tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:04:8e:ce,bridge_name='br-int',has_traffic_filtering=True,id=69029e57-b138-43c1-b31f-59bc7957994d,network=Network(e6694358-e361-4952-b859-93755c11721e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69029e57-b1') {{(pid=71874) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 16:23:11 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:23:11 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap69029e57-b1, bridge=br-int, if_exists=True) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:23:11 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:23:11 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:23:11 user nova-compute[71874]: INFO os_vif [None req-c5a98f47-3ad0-4a49-bf01-05be842b562d tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:04:8e:ce,bridge_name='br-int',has_traffic_filtering=True,id=69029e57-b138-43c1-b31f-59bc7957994d,network=Network(e6694358-e361-4952-b859-93755c11721e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69029e57-b1')
Apr 12 16:23:11 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-c5a98f47-3ad0-4a49-bf01-05be842b562d tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: 32471bee-e77e-4a1b-8e00-d938a1373976] Deleting instance files /opt/stack/data/nova/instances/32471bee-e77e-4a1b-8e00-d938a1373976_del
Apr 12 16:23:11 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-c5a98f47-3ad0-4a49-bf01-05be842b562d tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: 32471bee-e77e-4a1b-8e00-d938a1373976] Deletion of /opt/stack/data/nova/instances/32471bee-e77e-4a1b-8e00-d938a1373976_del complete
Apr 12 16:23:11 user nova-compute[71874]: INFO nova.compute.manager [None req-c5a98f47-3ad0-4a49-bf01-05be842b562d tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: 32471bee-e77e-4a1b-8e00-d938a1373976] Took 0.83 seconds to destroy the instance on the hypervisor.
Apr 12 16:23:11 user nova-compute[71874]: DEBUG oslo.service.loopingcall [None req-c5a98f47-3ad0-4a49-bf01-05be842b562d tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71874) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 16:23:11 user nova-compute[71874]: DEBUG nova.compute.manager [-] [instance: 32471bee-e77e-4a1b-8e00-d938a1373976] Deallocating network for instance {{(pid=71874) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 16:23:11 user nova-compute[71874]: DEBUG nova.network.neutron [-] [instance: 32471bee-e77e-4a1b-8e00-d938a1373976] deallocate_for_instance() {{(pid=71874) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 16:23:12 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:23:12 user nova-compute[71874]: DEBUG nova.network.neutron [-] [instance: 32471bee-e77e-4a1b-8e00-d938a1373976] Updating instance_info_cache with network_info: [] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:23:12 user nova-compute[71874]: INFO nova.compute.manager [-] [instance: 32471bee-e77e-4a1b-8e00-d938a1373976] Took 0.56 seconds to deallocate network for instance.
Apr 12 16:23:12 user nova-compute[71874]: DEBUG nova.compute.manager [req-5f47bad3-fbeb-43d2-975c-b20be731c668 req-21a3e675-efd1-4923-80d4-183c1530df47 service nova] [instance: 32471bee-e77e-4a1b-8e00-d938a1373976] Received event network-vif-deleted-69029e57-b138-43c1-b31f-59bc7957994d {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:23:12 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-c5a98f47-3ad0-4a49-bf01-05be842b562d tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:23:12 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-c5a98f47-3ad0-4a49-bf01-05be842b562d tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:23:12 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-c5a98f47-3ad0-4a49-bf01-05be842b562d tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Inventory has not changed in ProviderTree for provider: 0e94b4c8-cd49-45e4-9133-d36eb4b2456b {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 16:23:12 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-c5a98f47-3ad0-4a49-bf01-05be842b562d tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Inventory has not changed for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 16:23:12 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-c5a98f47-3ad0-4a49-bf01-05be842b562d tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.120s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:23:12 user nova-compute[71874]: INFO nova.scheduler.client.report [None req-c5a98f47-3ad0-4a49-bf01-05be842b562d tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Deleted allocations for instance 32471bee-e77e-4a1b-8e00-d938a1373976
Apr 12 16:23:12 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-c5a98f47-3ad0-4a49-bf01-05be842b562d tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "32471bee-e77e-4a1b-8e00-d938a1373976" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.686s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:23:12 user nova-compute[71874]: DEBUG nova.compute.manager [req-6b9902ea-8ab9-49e4-a310-db0ecc38cb1b req-ab44a389-63f0-4eef-a23b-77b57ab9e0f6 service nova] [instance: 32471bee-e77e-4a1b-8e00-d938a1373976] Received event network-vif-plugged-69029e57-b138-43c1-b31f-59bc7957994d {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:23:12 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-6b9902ea-8ab9-49e4-a310-db0ecc38cb1b req-ab44a389-63f0-4eef-a23b-77b57ab9e0f6 service nova] Acquiring lock "32471bee-e77e-4a1b-8e00-d938a1373976-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:23:12 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-6b9902ea-8ab9-49e4-a310-db0ecc38cb1b req-ab44a389-63f0-4eef-a23b-77b57ab9e0f6 service nova] Lock "32471bee-e77e-4a1b-8e00-d938a1373976-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:23:12 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-6b9902ea-8ab9-49e4-a310-db0ecc38cb1b req-ab44a389-63f0-4eef-a23b-77b57ab9e0f6 service nova] Lock "32471bee-e77e-4a1b-8e00-d938a1373976-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:23:12 user nova-compute[71874]: DEBUG nova.compute.manager [req-6b9902ea-8ab9-49e4-a310-db0ecc38cb1b req-ab44a389-63f0-4eef-a23b-77b57ab9e0f6 service nova] [instance: 32471bee-e77e-4a1b-8e00-d938a1373976] No waiting events found dispatching network-vif-plugged-69029e57-b138-43c1-b31f-59bc7957994d {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:23:12 user nova-compute[71874]: WARNING nova.compute.manager [req-6b9902ea-8ab9-49e4-a310-db0ecc38cb1b req-ab44a389-63f0-4eef-a23b-77b57ab9e0f6 service nova] [instance: 32471bee-e77e-4a1b-8e00-d938a1373976] Received unexpected event network-vif-plugged-69029e57-b138-43c1-b31f-59bc7957994d for instance with vm_state deleted and task_state None.
Apr 12 16:23:13 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:23:16 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:23:20 user nova-compute[71874]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681316585.4755118, 8503d42f-646c-4e59-91fd-0c006b08de7b => Stopped> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:23:20 user nova-compute[71874]: INFO nova.compute.manager [-] [instance: 8503d42f-646c-4e59-91fd-0c006b08de7b] VM Stopped (Lifecycle Event)
Apr 12 16:23:20 user nova-compute[71874]: DEBUG nova.compute.manager [None req-7eb908d1-bb7c-4666-bf75-006493bd89c7 None None] [instance: 8503d42f-646c-4e59-91fd-0c006b08de7b] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:23:21 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:23:26 user nova-compute[71874]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681316591.3972244, 32471bee-e77e-4a1b-8e00-d938a1373976 => Stopped> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:23:26 user nova-compute[71874]: INFO nova.compute.manager [-] [instance: 32471bee-e77e-4a1b-8e00-d938a1373976] VM Stopped (Lifecycle Event)
Apr 12 16:23:26 user nova-compute[71874]: DEBUG nova.compute.manager [None req-1b65c72a-1e82-40b7-b0d4-f795b58ccfab None None] [instance: 32471bee-e77e-4a1b-8e00-d938a1373976] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:23:26 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:23:30 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:23:30 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:23:30 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:23:30 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:23:30 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Auditing locally available compute resources for user (node: user) {{(pid=71874) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 16:23:30 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ef81d71-afb0-4335-b60f-13071b957d08/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:23:31 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ef81d71-afb0-4335-b60f-13071b957d08/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:23:31 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ef81d71-afb0-4335-b60f-13071b957d08/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:23:31 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ef81d71-afb0-4335-b60f-13071b957d08/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:23:31 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:23:31 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:23:31 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:23:31 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Hypervisor/Node resource view: name=user free_ram=8589MB free_disk=25.97423553466797GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71874) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 16:23:31 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:23:31 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:23:31 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 0ef81d71-afb0-4335-b60f-13071b957d08 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:23:31 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 16:23:31 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 16:23:31 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Inventory has not changed in ProviderTree for provider: 0e94b4c8-cd49-45e4-9133-d36eb4b2456b {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 16:23:31 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Inventory has not changed for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 16:23:31 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Compute_service record updated for user:user {{(pid=71874) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 16:23:31 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.188s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:23:34 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:23:34 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:23:35 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:23:35 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:23:36 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:23:36 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:23:36 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71874) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 16:23:36 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71874) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 16:23:36 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71874) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 16:23:36 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:23:36 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:23:37 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:23:37 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Starting heal instance info cache {{(pid=71874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 16:23:37 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Rebuilding the list of instances to heal {{(pid=71874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 16:23:37 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquiring lock "refresh_cache-0ef81d71-afb0-4335-b60f-13071b957d08" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:23:37 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquired lock "refresh_cache-0ef81d71-afb0-4335-b60f-13071b957d08" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:23:37 user nova-compute[71874]: DEBUG nova.network.neutron [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] [instance: 0ef81d71-afb0-4335-b60f-13071b957d08] Forcefully refreshing network info cache for instance {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 16:23:37 user nova-compute[71874]: DEBUG nova.objects.instance [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lazy-loading 'info_cache' on Instance uuid 0ef81d71-afb0-4335-b60f-13071b957d08 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:23:38 user nova-compute[71874]: DEBUG nova.network.neutron [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] [instance: 0ef81d71-afb0-4335-b60f-13071b957d08] Updating instance_info_cache with network_info: [{"id": "cb7029cd-2b2f-4e5a-8f70-5f644a14eb24", "address": "fa:16:3e:68:3a:b3", "network": {"id": "8a87df1a-24b8-499e-a908-0d1fa99ed69a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-824466532-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "c91ef8cd37154632a031592cdc6792aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb7029cd-2b", "ovs_interfaceid": "cb7029cd-2b2f-4e5a-8f70-5f644a14eb24", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:23:38 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Releasing lock "refresh_cache-0ef81d71-afb0-4335-b60f-13071b957d08" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:23:38 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] [instance: 0ef81d71-afb0-4335-b60f-13071b957d08] Updated the network info_cache for instance {{(pid=71874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 16:23:39 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:23:39 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71874) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 16:23:41 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4996-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:23:41 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:23:41 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:23:43 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:23:46 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:23:48 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:23:49 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-020d960b-f749-461c-bf09-7ec71b67b6de tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "d9a374be-4852-45e3-b346-79a08b60f981" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:23:49 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-020d960b-f749-461c-bf09-7ec71b67b6de tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "d9a374be-4852-45e3-b346-79a08b60f981" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:23:49 user nova-compute[71874]: DEBUG nova.compute.manager [None req-020d960b-f749-461c-bf09-7ec71b67b6de tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: d9a374be-4852-45e3-b346-79a08b60f981] Starting instance... {{(pid=71874) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 16:23:49 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-020d960b-f749-461c-bf09-7ec71b67b6de tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:23:49 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-020d960b-f749-461c-bf09-7ec71b67b6de tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:23:49 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-020d960b-f749-461c-bf09-7ec71b67b6de tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71874) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 16:23:49 user nova-compute[71874]: INFO nova.compute.claims [None req-020d960b-f749-461c-bf09-7ec71b67b6de tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: d9a374be-4852-45e3-b346-79a08b60f981] Claim successful on node user
Apr 12 16:23:49 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-020d960b-f749-461c-bf09-7ec71b67b6de tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Inventory has not changed in ProviderTree for provider: 0e94b4c8-cd49-45e4-9133-d36eb4b2456b {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 16:23:49 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-020d960b-f749-461c-bf09-7ec71b67b6de tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Inventory has not changed for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 16:23:49 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-020d960b-f749-461c-bf09-7ec71b67b6de tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.224s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:23:49 user nova-compute[71874]: DEBUG nova.compute.manager [None req-020d960b-f749-461c-bf09-7ec71b67b6de tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: d9a374be-4852-45e3-b346-79a08b60f981] Start building networks asynchronously for instance. {{(pid=71874) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 16:23:49 user nova-compute[71874]: DEBUG nova.compute.manager [None req-020d960b-f749-461c-bf09-7ec71b67b6de tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: d9a374be-4852-45e3-b346-79a08b60f981] Allocating IP information in the background. {{(pid=71874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 16:23:49 user nova-compute[71874]: DEBUG nova.network.neutron [None req-020d960b-f749-461c-bf09-7ec71b67b6de tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: d9a374be-4852-45e3-b346-79a08b60f981] allocate_for_instance() {{(pid=71874) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 16:23:49 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-020d960b-f749-461c-bf09-7ec71b67b6de tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: d9a374be-4852-45e3-b346-79a08b60f981] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 16:23:49 user nova-compute[71874]: DEBUG nova.compute.manager [None req-020d960b-f749-461c-bf09-7ec71b67b6de tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: d9a374be-4852-45e3-b346-79a08b60f981] Start building block device mappings for instance. {{(pid=71874) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 16:23:49 user nova-compute[71874]: INFO nova.virt.block_device [None req-020d960b-f749-461c-bf09-7ec71b67b6de tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: d9a374be-4852-45e3-b346-79a08b60f981] Booting with volume 7ae18173-eee9-4607-b0a7-940d48146909 at /dev/vda
Apr 12 16:23:49 user nova-compute[71874]: DEBUG nova.policy [None req-020d960b-f749-461c-bf09-7ec71b67b6de tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7054687447fc42339e9046ced4915890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b1b89a5eeb408a8d0938e5f59f405f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71874) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 16:23:49 user nova-compute[71874]: DEBUG os_brick.utils [None req-020d960b-f749-461c-bf09-7ec71b67b6de tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:23:49 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:23:49 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:23:49 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fcdba4f-b52b-4f00-b0f6-52d04cd6e624]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:61a48d4489d2\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:23:49 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:23:49 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:23:49 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[13a4ae57-c8cd-43fe-930d-58639cbd95c6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:23:49 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:23:49 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:23:49 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e2be170-8723-4430-9453-c2530d48c7ab]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:23:49 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf41b385-954c-4eae-9486-d79157f8d131]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:23:49 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-020d960b-f749-461c-bf09-7ec71b67b6de tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Running cmd (subprocess): nvme version {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:23:49 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-020d960b-f749-461c-bf09-7ec71b67b6de tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] 'nvme version' failed. Not Retrying. {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 16:23:49 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.nvmeof [None req-020d960b-f749-461c-bf09-7ec71b67b6de tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] nvme not present on system {{(pid=71874) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 16:23:49 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:23:50 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 16:23:50 user nova-compute[71874]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 16:23:50 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee57f60f-fef2-4198-a8ac-7427f5dfa3cf]: (4, '') {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:23:50 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.lightos [None req-020d960b-f749-461c-bf09-7ec71b67b6de tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71874) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 16:23:50 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.lightos [None req-020d960b-f749-461c-bf09-7ec71b67b6de tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71874) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 16:23:50 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.lightos [None req-020d960b-f749-461c-bf09-7ec71b67b6de tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] LIGHTOS: no hostnqn found. {{(pid=71874) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 16:23:50 user nova-compute[71874]: DEBUG os_brick.utils [None req-020d960b-f749-461c-bf09-7ec71b67b6de tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:61a48d4489d2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:23:50 user nova-compute[71874]: DEBUG nova.virt.block_device [None req-020d960b-f749-461c-bf09-7ec71b67b6de tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: d9a374be-4852-45e3-b346-79a08b60f981] Updating existing volume attachment record: e5afa777-b02e-4d3c-8fb9-a3955b178edb {{(pid=71874) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 16:23:50 user nova-compute[71874]: DEBUG nova.network.neutron [None req-020d960b-f749-461c-bf09-7ec71b67b6de tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: d9a374be-4852-45e3-b346-79a08b60f981] Successfully created port: aeffb3da-3b3c-40c0-bca4-ee483aa11e39 {{(pid=71874) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 16:23:51 user nova-compute[71874]: DEBUG nova.network.neutron [None req-020d960b-f749-461c-bf09-7ec71b67b6de tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: d9a374be-4852-45e3-b346-79a08b60f981] Successfully updated port: aeffb3da-3b3c-40c0-bca4-ee483aa11e39 {{(pid=71874) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 16:23:51 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-020d960b-f749-461c-bf09-7ec71b67b6de tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "refresh_cache-d9a374be-4852-45e3-b346-79a08b60f981" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:23:51 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-020d960b-f749-461c-bf09-7ec71b67b6de tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquired lock "refresh_cache-d9a374be-4852-45e3-b346-79a08b60f981" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:23:51 user nova-compute[71874]: DEBUG nova.network.neutron [None req-020d960b-f749-461c-bf09-7ec71b67b6de tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: d9a374be-4852-45e3-b346-79a08b60f981] Building network info cache for instance {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 16:23:51 user nova-compute[71874]: DEBUG nova.compute.manager [req-3dc00224-09ac-4893-9b24-23a2c0c14c62 req-7642d90b-c5cb-49c5-9346-4893d5ef17ed service nova] [instance: d9a374be-4852-45e3-b346-79a08b60f981] Received event network-changed-aeffb3da-3b3c-40c0-bca4-ee483aa11e39 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:23:51 user nova-compute[71874]: DEBUG nova.compute.manager [req-3dc00224-09ac-4893-9b24-23a2c0c14c62 req-7642d90b-c5cb-49c5-9346-4893d5ef17ed service nova] [instance: d9a374be-4852-45e3-b346-79a08b60f981] Refreshing instance network info cache due to event network-changed-aeffb3da-3b3c-40c0-bca4-ee483aa11e39. {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 16:23:51 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-3dc00224-09ac-4893-9b24-23a2c0c14c62 req-7642d90b-c5cb-49c5-9346-4893d5ef17ed service nova] Acquiring lock "refresh_cache-d9a374be-4852-45e3-b346-79a08b60f981" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:23:51 user nova-compute[71874]: DEBUG nova.network.neutron [None req-020d960b-f749-461c-bf09-7ec71b67b6de tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: d9a374be-4852-45e3-b346-79a08b60f981] Instance cache missing network info. {{(pid=71874) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 16:23:51 user nova-compute[71874]: DEBUG nova.network.neutron [None req-020d960b-f749-461c-bf09-7ec71b67b6de tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: d9a374be-4852-45e3-b346-79a08b60f981] Updating instance_info_cache with network_info: [{"id": "aeffb3da-3b3c-40c0-bca4-ee483aa11e39", "address": "fa:16:3e:05:c5:b7", "network": {"id": "1439244b-8287-4bba-a88c-99d4b498cccd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1491302639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29b1b89a5eeb408a8d0938e5f59f405f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaeffb3da-3b", "ovs_interfaceid": "aeffb3da-3b3c-40c0-bca4-ee483aa11e39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:23:51 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:23:51 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-020d960b-f749-461c-bf09-7ec71b67b6de tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Releasing lock "refresh_cache-d9a374be-4852-45e3-b346-79a08b60f981" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:23:51 user nova-compute[71874]: DEBUG nova.compute.manager [None req-020d960b-f749-461c-bf09-7ec71b67b6de tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: d9a374be-4852-45e3-b346-79a08b60f981] Instance network_info: |[{"id": "aeffb3da-3b3c-40c0-bca4-ee483aa11e39", "address": "fa:16:3e:05:c5:b7", "network": {"id": "1439244b-8287-4bba-a88c-99d4b498cccd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1491302639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29b1b89a5eeb408a8d0938e5f59f405f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaeffb3da-3b", "ovs_interfaceid": "aeffb3da-3b3c-40c0-bca4-ee483aa11e39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 16:23:51 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-3dc00224-09ac-4893-9b24-23a2c0c14c62 req-7642d90b-c5cb-49c5-9346-4893d5ef17ed service nova] Acquired lock "refresh_cache-d9a374be-4852-45e3-b346-79a08b60f981" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:23:51 user nova-compute[71874]: DEBUG nova.network.neutron [req-3dc00224-09ac-4893-9b24-23a2c0c14c62 req-7642d90b-c5cb-49c5-9346-4893d5ef17ed service nova] [instance: d9a374be-4852-45e3-b346-79a08b60f981] Refreshing network info cache for port aeffb3da-3b3c-40c0-bca4-ee483aa11e39 {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 16:23:52 user nova-compute[71874]: DEBUG nova.network.neutron [req-3dc00224-09ac-4893-9b24-23a2c0c14c62 req-7642d90b-c5cb-49c5-9346-4893d5ef17ed service nova] [instance: d9a374be-4852-45e3-b346-79a08b60f981] Updated VIF entry in instance network info cache for port aeffb3da-3b3c-40c0-bca4-ee483aa11e39. {{(pid=71874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 16:23:52 user nova-compute[71874]: DEBUG nova.network.neutron [req-3dc00224-09ac-4893-9b24-23a2c0c14c62 req-7642d90b-c5cb-49c5-9346-4893d5ef17ed service nova] [instance: d9a374be-4852-45e3-b346-79a08b60f981] Updating instance_info_cache with network_info: [{"id": "aeffb3da-3b3c-40c0-bca4-ee483aa11e39", "address": "fa:16:3e:05:c5:b7", "network": {"id": "1439244b-8287-4bba-a88c-99d4b498cccd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1491302639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29b1b89a5eeb408a8d0938e5f59f405f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaeffb3da-3b", "ovs_interfaceid": "aeffb3da-3b3c-40c0-bca4-ee483aa11e39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:23:52 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-3dc00224-09ac-4893-9b24-23a2c0c14c62 req-7642d90b-c5cb-49c5-9346-4893d5ef17ed service nova] Releasing lock "refresh_cache-d9a374be-4852-45e3-b346-79a08b60f981" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:23:54 user nova-compute[71874]: DEBUG nova.compute.manager [None req-020d960b-f749-461c-bf09-7ec71b67b6de tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: d9a374be-4852-45e3-b346-79a08b60f981] Start spawning the instance on the hypervisor. {{(pid=71874) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 16:23:54 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-020d960b-f749-461c-bf09-7ec71b67b6de tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: d9a374be-4852-45e3-b346-79a08b60f981] Creating instance directory {{(pid=71874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 16:23:54 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-020d960b-f749-461c-bf09-7ec71b67b6de tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: d9a374be-4852-45e3-b346-79a08b60f981] Creating image(s)
Apr 12 16:23:54 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-020d960b-f749-461c-bf09-7ec71b67b6de tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: d9a374be-4852-45e3-b346-79a08b60f981] Did not create local disks {{(pid=71874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 12 16:23:54 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-020d960b-f749-461c-bf09-7ec71b67b6de tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: d9a374be-4852-45e3-b346-79a08b60f981] Ensure instance console log exists: /opt/stack/data/nova/instances/d9a374be-4852-45e3-b346-79a08b60f981/console.log {{(pid=71874) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 16:23:54 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-020d960b-f749-461c-bf09-7ec71b67b6de tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:23:54 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-020d960b-f749-461c-bf09-7ec71b67b6de tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:23:54 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-020d960b-f749-461c-bf09-7ec71b67b6de tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:23:54 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-020d960b-f749-461c-bf09-7ec71b67b6de tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: d9a374be-4852-45e3-b346-79a08b60f981] Start _get_guest_xml network_info=[{"id": "aeffb3da-3b3c-40c0-bca4-ee483aa11e39", "address": "fa:16:3e:05:c5:b7", "network": {"id": "1439244b-8287-4bba-a88c-99d4b498cccd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1491302639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29b1b89a5eeb408a8d0938e5f59f405f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaeffb3da-3b", "ovs_interfaceid": "aeffb3da-3b3c-40c0-bca4-ee483aa11e39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'delete_on_termination': False, 'attachment_id': 'e5afa777-b02e-4d3c-8fb9-a3955b178edb', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ChyEKuGP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd9a374be-4852-45e3-b346-79a08b60f981', 'attached_at': '', 'detached_at': '', 'volume_id': '7ae18173-eee9-4607-b0a7-940d48146909', 'serial': '7ae18173-eee9-4607-b0a7-940d48146909'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'volume_type': None} {{(pid=71874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 16:23:54 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-020d960b-f749-461c-bf09-7ec71b67b6de tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:23:54 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-020d960b-f749-461c-bf09-7ec71b67b6de tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:23:54 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-020d960b-f749-461c-bf09-7ec71b67b6de tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71874) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 16:23:54 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-020d960b-f749-461c-bf09-7ec71b67b6de tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T15:56:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 16:23:54 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-020d960b-f749-461c-bf09-7ec71b67b6de tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Flavor limits 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 16:23:54 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-020d960b-f749-461c-bf09-7ec71b67b6de tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Image limits 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 16:23:54 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-020d960b-f749-461c-bf09-7ec71b67b6de tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Flavor pref 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 16:23:54 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-020d960b-f749-461c-bf09-7ec71b67b6de tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Image pref 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 16:23:54 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-020d960b-f749-461c-bf09-7ec71b67b6de tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 16:23:54 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-020d960b-f749-461c-bf09-7ec71b67b6de tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 16:23:54 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-020d960b-f749-461c-bf09-7ec71b67b6de tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 16:23:54 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-020d960b-f749-461c-bf09-7ec71b67b6de tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Got 1 possible topologies {{(pid=71874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 16:23:54 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-020d960b-f749-461c-bf09-7ec71b67b6de tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 16:23:54 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-020d960b-f749-461c-bf09-7ec71b67b6de tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 16:23:54 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-020d960b-f749-461c-bf09-7ec71b67b6de tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: d9a374be-4852-45e3-b346-79a08b60f981] Calling os-brick to attach iSCSI Volume {{(pid=71874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 16:23:54 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-020d960b-f749-461c-bf09-7ec71b67b6de tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3c0216320>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ChyEKuGP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:23:54 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-020d960b-f749-461c-bf09-7ec71b67b6de tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:23:54 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-020d960b-f749-461c-bf09-7ec71b67b6de tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:23:54 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-020d960b-f749-461c-bf09-7ec71b67b6de tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:23:54 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-020d960b-f749-461c-bf09-7ec71b67b6de tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:23:54 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-020d960b-f749-461c-bf09-7ec71b67b6de tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:23:54 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-020d960b-f749-461c-bf09-7ec71b67b6de tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:23:54 user nova-compute[71874]: INFO os_brick.initiator.connectors.iscsi [None req-020d960b-f749-461c-bf09-7ec71b67b6de tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 16:23:54 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909 -p 172.16.0.220:3260 {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:23:54 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:23:54 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[59f299fb-2c65-48fa-af1b-8978cdec7539]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:23:54 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-020d960b-f749-461c-bf09-7ec71b67b6de tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 16:23:54 user nova-compute[71874]:  {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:23:54 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909 -p 172.16.0.220:3260 --interface default --op new {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:23:54 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.031s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:23:54 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[c43384ce-9e57-469b-be7b-34ea48d6f5bc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909] added\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:23:54 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-020d960b-f749-461c-bf09-7ec71b67b6de tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909] added
Apr 12 16:23:54 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:23:54 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:23:54 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.054s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:23:54 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[e66af30b-043b-40f3-b71a-8c3a8ec9ccf9]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:23:54 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-020d960b-f749-461c-bf09-7ec71b67b6de tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:23:54 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:23:54 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:23:54 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed0535e4-2076-4666-a564-bff76ee02f2d]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:23:54 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-020d960b-f749-461c-bf09-7ec71b67b6de tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:23:54 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ChyEKuGP {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:23:54 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ChyEKuGP" returned: 0 in 0.018s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:23:54 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[36d0df46-9fee-4b7d-975b-8c1c5db28b1a]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:23:54 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-020d960b-f749-461c-bf09-7ec71b67b6de tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ChyEKuGP'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:23:54 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:23:54 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:23:54 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[e98c55ef-e3d3-48c7-accc-c25cd857bd50]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:23:54 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-020d960b-f749-461c-bf09-7ec71b67b6de tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:23:54 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:23:54 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:23:54 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b51f0c9-cffc-4afd-a793-9426d5babe6a]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:23:54 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-020d960b-f749-461c-bf09-7ec71b67b6de tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 12 16:23:54 user nova-compute[71874]:  {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:23:54 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-020d960b-f749-461c-bf09-7ec71b67b6de tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 12 16:23:54 user nova-compute[71874]:  {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:23:54 user nova-compute[71874]: WARNING os_brick.initiator.connectors.iscsi [None req-020d960b-f749-461c-bf09-7ec71b67b6de tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 12 16:23:54 user nova-compute[71874]: 
Apr 12 16:23:54 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909 -p 172.16.0.220:3260 --login {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:23:54 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:23:54 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[f78bc690-b946-4f14-aa20-0e417978be16]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:23:54 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-020d960b-f749-461c-bf09-7ec71b67b6de tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909, portal: 172.16.0.220,3260]
Apr 12 16:23:54 user nova-compute[71874]: Login to [iface: default, target: iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909, portal: 172.16.0.220,3260] successful.
Apr 12 16:23:54 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:23:54 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:23:55 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:23:55 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eee3f54-5dc8-407a-8802-6e35475b1eab]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:23:55 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-020d960b-f749-461c-bf09-7ec71b67b6de tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:23:55 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:23:55 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:23:55 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[66c8557e-9768-4f1d-acfb-1a3cdb06da0f]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909 (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:23:55 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-020d960b-f749-461c-bf09-7ec71b67b6de tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909 (non-flash)
Apr 12 16:23:55 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:23:55 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-020d960b-f749-461c-bf09-7ec71b67b6de tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909 (non-flash)
Apr 12 16:23:55 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:23:55 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-020d960b-f749-461c-bf09-7ec71b67b6de tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.303s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:23:55 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-020d960b-f749-461c-bf09-7ec71b67b6de tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Connected to 172.16.0.220:3260 {{(pid=71874) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 16:23:55 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-020d960b-f749-461c-bf09-7ec71b67b6de tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] HCTL ('33', '-', '-', 0) found on session 49 with lun 0 {{(pid=71874) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 16:23:55 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-020d960b-f749-461c-bf09-7ec71b67b6de tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71874) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 16:23:55 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:23:55 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:23:55 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[086dcbf0-fb59-43b7-82a8-753d3a8a08ab]: (4, ('- - 0', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:23:55 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-020d960b-f749-461c-bf09-7ec71b67b6de tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Searching for a device in session 49 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71874) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 16:23:55 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-020d960b-f749-461c-bf09-7ec71b67b6de tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ChyEKuGP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71874) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 16:23:56 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-020d960b-f749-461c-bf09-7ec71b67b6de tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.334s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:23:56 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-020d960b-f749-461c-bf09-7ec71b67b6de tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] <== connect_volume: return (1336ms) {'type': 'block', 'scsi_wwn': '23861323965396230', 'path': '/dev/sdb'} {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:23:56 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-020d960b-f749-461c-bf09-7ec71b67b6de tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: d9a374be-4852-45e3-b346-79a08b60f981] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23861323965396230', 'path': '/dev/sdb'} {{(pid=71874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 16:23:56 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-020d960b-f749-461c-bf09-7ec71b67b6de tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T16:23:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-515149958',display_name='tempest-TestVolumeBootPattern-server-515149958',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-515149958',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGG/oSOmCDB20hkof5ViTlXYepxJsQ10bBtdYs7WKmIje03wdrGPlfe9DBPbPhAeMjSuszZPOH/w828DcGTtmLpZpE/aguNTugqw/I5GMmvTcJqr8fOGXLe6lzwKxF1ecQ==',key_name='tempest-TestVolumeBootPattern-2081417066',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='29b1b89a5eeb408a8d0938e5f59f405f',ramdisk_id='',reservation_id='r-e0zx8m7k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-734600841',owner_user_name='tempest-TestVolumeBootPattern-734600841-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T16:23:50Z,user_data=None,user_id='7054687447fc42339e9046ced4915890',uuid=d9a374be-4852-45e3-b346-79a08b60f981,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aeffb3da-3b3c-40c0-bca4-ee483aa11e39", "address": "fa:16:3e:05:c5:b7", "network": {"id": "1439244b-8287-4bba-a88c-99d4b498cccd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1491302639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29b1b89a5eeb408a8d0938e5f59f405f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaeffb3da-3b", "ovs_interfaceid": "aeffb3da-3b3c-40c0-bca4-ee483aa11e39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 16:23:56 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-020d960b-f749-461c-bf09-7ec71b67b6de tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Converting VIF {"id": "aeffb3da-3b3c-40c0-bca4-ee483aa11e39", "address": "fa:16:3e:05:c5:b7", "network": {"id": "1439244b-8287-4bba-a88c-99d4b498cccd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1491302639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29b1b89a5eeb408a8d0938e5f59f405f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaeffb3da-3b", "ovs_interfaceid": "aeffb3da-3b3c-40c0-bca4-ee483aa11e39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:23:56 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-020d960b-f749-461c-bf09-7ec71b67b6de tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:c5:b7,bridge_name='br-int',has_traffic_filtering=True,id=aeffb3da-3b3c-40c0-bca4-ee483aa11e39,network=Network(1439244b-8287-4bba-a88c-99d4b498cccd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaeffb3da-3b') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:23:56 user nova-compute[71874]: DEBUG nova.objects.instance [None req-020d960b-f749-461c-bf09-7ec71b67b6de tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lazy-loading 'pci_devices' on Instance uuid d9a374be-4852-45e3-b346-79a08b60f981 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:23:56 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-020d960b-f749-461c-bf09-7ec71b67b6de tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: d9a374be-4852-45e3-b346-79a08b60f981] End _get_guest_xml xml=<domain type="kvm">
Apr 12 16:23:56 user nova-compute[71874]:   <uuid>d9a374be-4852-45e3-b346-79a08b60f981</uuid>
Apr 12 16:23:56 user nova-compute[71874]:   <name>instance-0000002b</name>
Apr 12 16:23:56 user nova-compute[71874]:   <memory>131072</memory>
Apr 12 16:23:56 user nova-compute[71874]:   <vcpu>1</vcpu>
Apr 12 16:23:56 user nova-compute[71874]:   <metadata>
Apr 12 16:23:56 user nova-compute[71874]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 16:23:56 user nova-compute[71874]:       <nova:package version="0.0.0"/>
Apr 12 16:23:56 user nova-compute[71874]:       <nova:name>tempest-TestVolumeBootPattern-server-515149958</nova:name>
Apr 12 16:23:56 user nova-compute[71874]:       <nova:creationTime>2023-04-12 16:23:54</nova:creationTime>
Apr 12 16:23:56 user nova-compute[71874]:       <nova:flavor name="m1.nano">
Apr 12 16:23:56 user nova-compute[71874]:         <nova:memory>128</nova:memory>
Apr 12 16:23:56 user nova-compute[71874]:         <nova:disk>1</nova:disk>
Apr 12 16:23:56 user nova-compute[71874]:         <nova:swap>0</nova:swap>
Apr 12 16:23:56 user nova-compute[71874]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 16:23:56 user nova-compute[71874]:         <nova:vcpus>1</nova:vcpus>
Apr 12 16:23:56 user nova-compute[71874]:       </nova:flavor>
Apr 12 16:23:56 user nova-compute[71874]:       <nova:owner>
Apr 12 16:23:56 user nova-compute[71874]:         <nova:user uuid="7054687447fc42339e9046ced4915890">tempest-TestVolumeBootPattern-734600841-project-member</nova:user>
Apr 12 16:23:56 user nova-compute[71874]:         <nova:project uuid="29b1b89a5eeb408a8d0938e5f59f405f">tempest-TestVolumeBootPattern-734600841</nova:project>
Apr 12 16:23:56 user nova-compute[71874]:       </nova:owner>
Apr 12 16:23:56 user nova-compute[71874]:       <nova:ports>
Apr 12 16:23:56 user nova-compute[71874]:         <nova:port uuid="aeffb3da-3b3c-40c0-bca4-ee483aa11e39">
Apr 12 16:23:56 user nova-compute[71874]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 12 16:23:56 user nova-compute[71874]:         </nova:port>
Apr 12 16:23:56 user nova-compute[71874]:       </nova:ports>
Apr 12 16:23:56 user nova-compute[71874]:     </nova:instance>
Apr 12 16:23:56 user nova-compute[71874]:   </metadata>
Apr 12 16:23:56 user nova-compute[71874]:   <sysinfo type="smbios">
Apr 12 16:23:56 user nova-compute[71874]:     <system>
Apr 12 16:23:56 user nova-compute[71874]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 16:23:56 user nova-compute[71874]:       <entry name="product">OpenStack Nova</entry>
Apr 12 16:23:56 user nova-compute[71874]:       <entry name="version">0.0.0</entry>
Apr 12 16:23:56 user nova-compute[71874]:       <entry name="serial">d9a374be-4852-45e3-b346-79a08b60f981</entry>
Apr 12 16:23:56 user nova-compute[71874]:       <entry name="uuid">d9a374be-4852-45e3-b346-79a08b60f981</entry>
Apr 12 16:23:56 user nova-compute[71874]:       <entry name="family">Virtual Machine</entry>
Apr 12 16:23:56 user nova-compute[71874]:     </system>
Apr 12 16:23:56 user nova-compute[71874]:   </sysinfo>
Apr 12 16:23:56 user nova-compute[71874]:   <os>
Apr 12 16:23:56 user nova-compute[71874]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 16:23:56 user nova-compute[71874]:     <boot dev="hd"/>
Apr 12 16:23:56 user nova-compute[71874]:     <smbios mode="sysinfo"/>
Apr 12 16:23:56 user nova-compute[71874]:   </os>
Apr 12 16:23:56 user nova-compute[71874]:   <features>
Apr 12 16:23:56 user nova-compute[71874]:     <acpi/>
Apr 12 16:23:56 user nova-compute[71874]:     <apic/>
Apr 12 16:23:56 user nova-compute[71874]:     <vmcoreinfo/>
Apr 12 16:23:56 user nova-compute[71874]:   </features>
Apr 12 16:23:56 user nova-compute[71874]:   <clock offset="utc">
Apr 12 16:23:56 user nova-compute[71874]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 16:23:56 user nova-compute[71874]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 16:23:56 user nova-compute[71874]:     <timer name="hpet" present="no"/>
Apr 12 16:23:56 user nova-compute[71874]:   </clock>
Apr 12 16:23:56 user nova-compute[71874]:   <cpu mode="custom" match="exact">
Apr 12 16:23:56 user nova-compute[71874]:     <model>Nehalem</model>
Apr 12 16:23:56 user nova-compute[71874]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 16:23:56 user nova-compute[71874]:   </cpu>
Apr 12 16:23:56 user nova-compute[71874]:   <devices>
Apr 12 16:23:56 user nova-compute[71874]:     <disk type="block" device="disk">
Apr 12 16:23:56 user nova-compute[71874]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 16:23:56 user nova-compute[71874]:       <source dev="/dev/sdb"/>
Apr 12 16:23:56 user nova-compute[71874]:       <target dev="vda" bus="virtio"/>
Apr 12 16:23:56 user nova-compute[71874]:       <serial>7ae18173-eee9-4607-b0a7-940d48146909</serial>
Apr 12 16:23:56 user nova-compute[71874]:     </disk>
Apr 12 16:23:56 user nova-compute[71874]:     <interface type="ethernet">
Apr 12 16:23:56 user nova-compute[71874]:       <mac address="fa:16:3e:05:c5:b7"/>
Apr 12 16:23:56 user nova-compute[71874]:       <model type="virtio"/>
Apr 12 16:23:56 user nova-compute[71874]:       <mtu size="1442"/>
Apr 12 16:23:56 user nova-compute[71874]:       <target dev="tapaeffb3da-3b"/>
Apr 12 16:23:56 user nova-compute[71874]:     </interface>
Apr 12 16:23:56 user nova-compute[71874]:     <serial type="pty">
Apr 12 16:23:56 user nova-compute[71874]:       <log file="/opt/stack/data/nova/instances/d9a374be-4852-45e3-b346-79a08b60f981/console.log" append="off"/>
Apr 12 16:23:56 user nova-compute[71874]:     </serial>
Apr 12 16:23:56 user nova-compute[71874]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 16:23:56 user nova-compute[71874]:     <video>
Apr 12 16:23:56 user nova-compute[71874]:       <model type="virtio"/>
Apr 12 16:23:56 user nova-compute[71874]:     </video>
Apr 12 16:23:56 user nova-compute[71874]:     <rng model="virtio">
Apr 12 16:23:56 user nova-compute[71874]:       <backend model="random">/dev/urandom</backend>
Apr 12 16:23:56 user nova-compute[71874]:     </rng>
Apr 12 16:23:56 user nova-compute[71874]:     <controller type="usb" index="0" model="none"/>
Apr 12 16:23:56 user nova-compute[71874]:     <memballoon model="virtio">
Apr 12 16:23:56 user nova-compute[71874]:       <stats period="10"/>
Apr 12 16:23:56 user nova-compute[71874]:     </memballoon>
Apr 12 16:23:56 user nova-compute[71874]:   </devices>
Apr 12 16:23:56 user nova-compute[71874]: </domain>
Apr 12 16:23:56 user nova-compute[71874]:  {{(pid=71874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 16:23:56 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-020d960b-f749-461c-bf09-7ec71b67b6de tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T16:23:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-515149958',display_name='tempest-TestVolumeBootPattern-server-515149958',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-515149958',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGG/oSOmCDB20hkof5ViTlXYepxJsQ10bBtdYs7WKmIje03wdrGPlfe9DBPbPhAeMjSuszZPOH/w828DcGTtmLpZpE/aguNTugqw/I5GMmvTcJqr8fOGXLe6lzwKxF1ecQ==',key_name='tempest-TestVolumeBootPattern-2081417066',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='29b1b89a5eeb408a8d0938e5f59f405f',ramdisk_id='',reservation_id='r-e0zx8m7k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-734600841',owner_user_name='tempest-TestVolumeBootPattern-734600841-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T16:23:50Z,user_data=None,user_id='7054687447fc42339e9046ced4915890',uuid=d9a374be-4852-45e3-b346-79a08b60f981,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aeffb3da-3b3c-40c0-bca4-ee483aa11e39", "address": "fa:16:3e:05:c5:b7", "network": {"id": "1439244b-8287-4bba-a88c-99d4b498cccd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1491302639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29b1b89a5eeb408a8d0938e5f59f405f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaeffb3da-3b", "ovs_interfaceid": "aeffb3da-3b3c-40c0-bca4-ee483aa11e39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 16:23:56 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-020d960b-f749-461c-bf09-7ec71b67b6de tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Converting VIF {"id": "aeffb3da-3b3c-40c0-bca4-ee483aa11e39", "address": "fa:16:3e:05:c5:b7", "network": {"id": "1439244b-8287-4bba-a88c-99d4b498cccd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1491302639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29b1b89a5eeb408a8d0938e5f59f405f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaeffb3da-3b", "ovs_interfaceid": "aeffb3da-3b3c-40c0-bca4-ee483aa11e39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:23:56 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-020d960b-f749-461c-bf09-7ec71b67b6de tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:c5:b7,bridge_name='br-int',has_traffic_filtering=True,id=aeffb3da-3b3c-40c0-bca4-ee483aa11e39,network=Network(1439244b-8287-4bba-a88c-99d4b498cccd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaeffb3da-3b') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:23:56 user nova-compute[71874]: DEBUG os_vif [None req-020d960b-f749-461c-bf09-7ec71b67b6de tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:c5:b7,bridge_name='br-int',has_traffic_filtering=True,id=aeffb3da-3b3c-40c0-bca4-ee483aa11e39,network=Network(1439244b-8287-4bba-a88c-99d4b498cccd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaeffb3da-3b') {{(pid=71874) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 16:23:56 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:23:56 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:23:56 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 16:23:56 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:23:56 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaeffb3da-3b, may_exist=True) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:23:56 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapaeffb3da-3b, col_values=(('external_ids', {'iface-id': 'aeffb3da-3b3c-40c0-bca4-ee483aa11e39', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:05:c5:b7', 'vm-uuid': 'd9a374be-4852-45e3-b346-79a08b60f981'}),)) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:23:56 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:23:56 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:23:56 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:23:56 user nova-compute[71874]: INFO os_vif [None req-020d960b-f749-461c-bf09-7ec71b67b6de tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:c5:b7,bridge_name='br-int',has_traffic_filtering=True,id=aeffb3da-3b3c-40c0-bca4-ee483aa11e39,network=Network(1439244b-8287-4bba-a88c-99d4b498cccd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaeffb3da-3b')
Apr 12 16:23:56 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-020d960b-f749-461c-bf09-7ec71b67b6de tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] No BDM found with device name vda, not building metadata. {{(pid=71874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 16:23:56 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-020d960b-f749-461c-bf09-7ec71b67b6de tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] No VIF found with MAC fa:16:3e:05:c5:b7, not building metadata {{(pid=71874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 16:23:56 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:23:57 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:23:57 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:23:57 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:23:57 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:23:57 user nova-compute[71874]: DEBUG nova.compute.manager [req-89ef34e7-06d0-470b-a606-74419d786303 req-29f91d02-46e9-4bab-b1e0-c96e83d000fe service nova] [instance: d9a374be-4852-45e3-b346-79a08b60f981] Received event network-vif-plugged-aeffb3da-3b3c-40c0-bca4-ee483aa11e39 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:23:57 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-89ef34e7-06d0-470b-a606-74419d786303 req-29f91d02-46e9-4bab-b1e0-c96e83d000fe service nova] Acquiring lock "d9a374be-4852-45e3-b346-79a08b60f981-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:23:57 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-89ef34e7-06d0-470b-a606-74419d786303 req-29f91d02-46e9-4bab-b1e0-c96e83d000fe service nova] Lock "d9a374be-4852-45e3-b346-79a08b60f981-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:23:57 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-89ef34e7-06d0-470b-a606-74419d786303 req-29f91d02-46e9-4bab-b1e0-c96e83d000fe service nova] Lock "d9a374be-4852-45e3-b346-79a08b60f981-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:23:57 user nova-compute[71874]: DEBUG nova.compute.manager [req-89ef34e7-06d0-470b-a606-74419d786303 req-29f91d02-46e9-4bab-b1e0-c96e83d000fe service nova] [instance: d9a374be-4852-45e3-b346-79a08b60f981] No waiting events found dispatching network-vif-plugged-aeffb3da-3b3c-40c0-bca4-ee483aa11e39 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:23:57 user nova-compute[71874]: WARNING nova.compute.manager [req-89ef34e7-06d0-470b-a606-74419d786303 req-29f91d02-46e9-4bab-b1e0-c96e83d000fe service nova] [instance: d9a374be-4852-45e3-b346-79a08b60f981] Received unexpected event network-vif-plugged-aeffb3da-3b3c-40c0-bca4-ee483aa11e39 for instance with vm_state building and task_state spawning.
Apr 12 16:23:58 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:23:58 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:23:58 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:23:58 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:23:59 user nova-compute[71874]: DEBUG nova.virt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Emitting event <LifecycleEvent: 1681316639.7231176, d9a374be-4852-45e3-b346-79a08b60f981 => Resumed> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:23:59 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: d9a374be-4852-45e3-b346-79a08b60f981] VM Resumed (Lifecycle Event)
Apr 12 16:23:59 user nova-compute[71874]: DEBUG nova.compute.manager [None req-020d960b-f749-461c-bf09-7ec71b67b6de tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: d9a374be-4852-45e3-b346-79a08b60f981] Instance event wait completed in 0 seconds for  {{(pid=71874) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 16:23:59 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-020d960b-f749-461c-bf09-7ec71b67b6de tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: d9a374be-4852-45e3-b346-79a08b60f981] Guest created on hypervisor {{(pid=71874) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 16:23:59 user nova-compute[71874]: INFO nova.virt.libvirt.driver [-] [instance: d9a374be-4852-45e3-b346-79a08b60f981] Instance spawned successfully.
Apr 12 16:23:59 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-020d960b-f749-461c-bf09-7ec71b67b6de tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: d9a374be-4852-45e3-b346-79a08b60f981] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 16:23:59 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: d9a374be-4852-45e3-b346-79a08b60f981] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:23:59 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: d9a374be-4852-45e3-b346-79a08b60f981] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 16:23:59 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-020d960b-f749-461c-bf09-7ec71b67b6de tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: d9a374be-4852-45e3-b346-79a08b60f981] Found default for hw_cdrom_bus of ide {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:23:59 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-020d960b-f749-461c-bf09-7ec71b67b6de tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: d9a374be-4852-45e3-b346-79a08b60f981] Found default for hw_disk_bus of virtio {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:23:59 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-020d960b-f749-461c-bf09-7ec71b67b6de tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: d9a374be-4852-45e3-b346-79a08b60f981] Found default for hw_input_bus of None {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:23:59 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-020d960b-f749-461c-bf09-7ec71b67b6de tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: d9a374be-4852-45e3-b346-79a08b60f981] Found default for hw_pointer_model of None {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:23:59 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-020d960b-f749-461c-bf09-7ec71b67b6de tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: d9a374be-4852-45e3-b346-79a08b60f981] Found default for hw_video_model of virtio {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:23:59 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-020d960b-f749-461c-bf09-7ec71b67b6de tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: d9a374be-4852-45e3-b346-79a08b60f981] Found default for hw_vif_model of virtio {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:23:59 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: d9a374be-4852-45e3-b346-79a08b60f981] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 16:23:59 user nova-compute[71874]: DEBUG nova.virt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Emitting event <LifecycleEvent: 1681316639.726378, d9a374be-4852-45e3-b346-79a08b60f981 => Started> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:23:59 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: d9a374be-4852-45e3-b346-79a08b60f981] VM Started (Lifecycle Event)
Apr 12 16:23:59 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: d9a374be-4852-45e3-b346-79a08b60f981] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:23:59 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: d9a374be-4852-45e3-b346-79a08b60f981] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 16:23:59 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: d9a374be-4852-45e3-b346-79a08b60f981] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 16:23:59 user nova-compute[71874]: DEBUG nova.compute.manager [req-bc20e533-47d9-4e0a-bff3-de28178f0389 req-d1c4ecb8-6fdc-422a-a92d-fd33d0e90268 service nova] [instance: d9a374be-4852-45e3-b346-79a08b60f981] Received event network-vif-plugged-aeffb3da-3b3c-40c0-bca4-ee483aa11e39 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:23:59 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-bc20e533-47d9-4e0a-bff3-de28178f0389 req-d1c4ecb8-6fdc-422a-a92d-fd33d0e90268 service nova] Acquiring lock "d9a374be-4852-45e3-b346-79a08b60f981-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:23:59 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-bc20e533-47d9-4e0a-bff3-de28178f0389 req-d1c4ecb8-6fdc-422a-a92d-fd33d0e90268 service nova] Lock "d9a374be-4852-45e3-b346-79a08b60f981-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:23:59 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-bc20e533-47d9-4e0a-bff3-de28178f0389 req-d1c4ecb8-6fdc-422a-a92d-fd33d0e90268 service nova] Lock "d9a374be-4852-45e3-b346-79a08b60f981-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:23:59 user nova-compute[71874]: DEBUG nova.compute.manager [req-bc20e533-47d9-4e0a-bff3-de28178f0389 req-d1c4ecb8-6fdc-422a-a92d-fd33d0e90268 service nova] [instance: d9a374be-4852-45e3-b346-79a08b60f981] No waiting events found dispatching network-vif-plugged-aeffb3da-3b3c-40c0-bca4-ee483aa11e39 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:23:59 user nova-compute[71874]: WARNING nova.compute.manager [req-bc20e533-47d9-4e0a-bff3-de28178f0389 req-d1c4ecb8-6fdc-422a-a92d-fd33d0e90268 service nova] [instance: d9a374be-4852-45e3-b346-79a08b60f981] Received unexpected event network-vif-plugged-aeffb3da-3b3c-40c0-bca4-ee483aa11e39 for instance with vm_state building and task_state spawning.
Apr 12 16:23:59 user nova-compute[71874]: INFO nova.compute.manager [None req-020d960b-f749-461c-bf09-7ec71b67b6de tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: d9a374be-4852-45e3-b346-79a08b60f981] Took 5.18 seconds to spawn the instance on the hypervisor.
Apr 12 16:23:59 user nova-compute[71874]: DEBUG nova.compute.manager [None req-020d960b-f749-461c-bf09-7ec71b67b6de tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: d9a374be-4852-45e3-b346-79a08b60f981] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:23:59 user nova-compute[71874]: INFO nova.compute.manager [None req-020d960b-f749-461c-bf09-7ec71b67b6de tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: d9a374be-4852-45e3-b346-79a08b60f981] Took 10.48 seconds to build instance.
Apr 12 16:23:59 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-020d960b-f749-461c-bf09-7ec71b67b6de tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "d9a374be-4852-45e3-b346-79a08b60f981" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.577s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:24:01 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:24:03 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:24:05 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:24:06 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:24:08 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:24:10 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-38e09fcc-50a3-4a14-9a74-08c0c648be84 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Acquiring lock "0ef81d71-afb0-4335-b60f-13071b957d08" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:24:10 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-38e09fcc-50a3-4a14-9a74-08c0c648be84 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Lock "0ef81d71-afb0-4335-b60f-13071b957d08" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:24:10 user nova-compute[71874]: DEBUG nova.objects.instance [None req-38e09fcc-50a3-4a14-9a74-08c0c648be84 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Lazy-loading 'flavor' on Instance uuid 0ef81d71-afb0-4335-b60f-13071b957d08 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:24:10 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-38e09fcc-50a3-4a14-9a74-08c0c648be84 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] [instance: 0ef81d71-afb0-4335-b60f-13071b957d08] Ignoring supplied device name: /dev/vdb
Apr 12 16:24:10 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-38e09fcc-50a3-4a14-9a74-08c0c648be84 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Lock "0ef81d71-afb0-4335-b60f-13071b957d08" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:24:10 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-38e09fcc-50a3-4a14-9a74-08c0c648be84 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Acquiring lock "0ef81d71-afb0-4335-b60f-13071b957d08" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:24:10 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-38e09fcc-50a3-4a14-9a74-08c0c648be84 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Lock "0ef81d71-afb0-4335-b60f-13071b957d08" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:24:10 user nova-compute[71874]: INFO nova.compute.manager [None req-38e09fcc-50a3-4a14-9a74-08c0c648be84 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] [instance: 0ef81d71-afb0-4335-b60f-13071b957d08] Attaching volume 080c2e7c-0047-4794-90a2-ab4835def5de to /dev/vdb
Apr 12 16:24:10 user nova-compute[71874]: DEBUG os_brick.utils [None req-38e09fcc-50a3-4a14-9a74-08c0c648be84 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:24:10 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:24:10 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:24:10 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fd90453-0da3-42fc-818a-c6d126e88834]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:61a48d4489d2\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:24:10 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:24:10 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:24:10 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e293262-49ff-43d9-be3a-ebe17198c937]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:24:10 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:24:10 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:24:10 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff3b543a-c2c3-477d-85e7-852be56b3190]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:24:10 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[565ccb83-a707-4db1-ba36-54fd1ea2ced6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:24:10 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-38e09fcc-50a3-4a14-9a74-08c0c648be84 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Running cmd (subprocess): nvme version {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:24:10 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-38e09fcc-50a3-4a14-9a74-08c0c648be84 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] 'nvme version' failed. Not Retrying. {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 16:24:10 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.nvmeof [None req-38e09fcc-50a3-4a14-9a74-08c0c648be84 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] nvme not present on system {{(pid=71874) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 16:24:10 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:24:10 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 16:24:10 user nova-compute[71874]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 16:24:10 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[61bdfb52-f210-4bca-a172-f9da50248524]: (4, '') {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:24:10 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.lightos [None req-38e09fcc-50a3-4a14-9a74-08c0c648be84 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71874) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 16:24:10 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.lightos [None req-38e09fcc-50a3-4a14-9a74-08c0c648be84 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71874) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 16:24:10 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.lightos [None req-38e09fcc-50a3-4a14-9a74-08c0c648be84 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] LIGHTOS: no hostnqn found. {{(pid=71874) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 16:24:10 user nova-compute[71874]: DEBUG os_brick.utils [None req-38e09fcc-50a3-4a14-9a74-08c0c648be84 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:61a48d4489d2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:24:10 user nova-compute[71874]: DEBUG nova.virt.block_device [None req-38e09fcc-50a3-4a14-9a74-08c0c648be84 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] [instance: 0ef81d71-afb0-4335-b60f-13071b957d08] Updating existing volume attachment record: 0e2b4b8c-8ff5-4b0f-961c-252419d566eb {{(pid=71874) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 16:24:11 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:24:12 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-3b37d2be-de53-4106-852a-c76b015ec88f tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] Acquiring lock "6b40e07a-eb45-4fe7-9f98-dc718231a4a4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:24:12 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-3b37d2be-de53-4106-852a-c76b015ec88f tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] Lock "6b40e07a-eb45-4fe7-9f98-dc718231a4a4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:24:12 user nova-compute[71874]: DEBUG nova.compute.manager [None req-3b37d2be-de53-4106-852a-c76b015ec88f tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] [instance: 6b40e07a-eb45-4fe7-9f98-dc718231a4a4] Starting instance... {{(pid=71874) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 16:24:12 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-3b37d2be-de53-4106-852a-c76b015ec88f tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:24:12 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-3b37d2be-de53-4106-852a-c76b015ec88f tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:24:12 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-3b37d2be-de53-4106-852a-c76b015ec88f tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71874) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 16:24:12 user nova-compute[71874]: INFO nova.compute.claims [None req-3b37d2be-de53-4106-852a-c76b015ec88f tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] [instance: 6b40e07a-eb45-4fe7-9f98-dc718231a4a4] Claim successful on node user
Apr 12 16:24:12 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-3b37d2be-de53-4106-852a-c76b015ec88f tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] Inventory has not changed in ProviderTree for provider: 0e94b4c8-cd49-45e4-9133-d36eb4b2456b {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 16:24:12 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-3b37d2be-de53-4106-852a-c76b015ec88f tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] Inventory has not changed for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 16:24:12 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-3b37d2be-de53-4106-852a-c76b015ec88f tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.252s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:24:12 user nova-compute[71874]: DEBUG nova.compute.manager [None req-3b37d2be-de53-4106-852a-c76b015ec88f tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] [instance: 6b40e07a-eb45-4fe7-9f98-dc718231a4a4] Start building networks asynchronously for instance. {{(pid=71874) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 16:24:12 user nova-compute[71874]: DEBUG nova.compute.manager [None req-3b37d2be-de53-4106-852a-c76b015ec88f tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] [instance: 6b40e07a-eb45-4fe7-9f98-dc718231a4a4] Allocating IP information in the background. {{(pid=71874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 16:24:12 user nova-compute[71874]: DEBUG nova.network.neutron [None req-3b37d2be-de53-4106-852a-c76b015ec88f tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] [instance: 6b40e07a-eb45-4fe7-9f98-dc718231a4a4] allocate_for_instance() {{(pid=71874) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 16:24:12 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-3b37d2be-de53-4106-852a-c76b015ec88f tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] [instance: 6b40e07a-eb45-4fe7-9f98-dc718231a4a4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 16:24:12 user nova-compute[71874]: DEBUG nova.compute.manager [None req-3b37d2be-de53-4106-852a-c76b015ec88f tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] [instance: 6b40e07a-eb45-4fe7-9f98-dc718231a4a4] Start building block device mappings for instance. {{(pid=71874) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 16:24:12 user nova-compute[71874]: DEBUG nova.compute.manager [None req-3b37d2be-de53-4106-852a-c76b015ec88f tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] [instance: 6b40e07a-eb45-4fe7-9f98-dc718231a4a4] Start spawning the instance on the hypervisor. {{(pid=71874) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 16:24:12 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-3b37d2be-de53-4106-852a-c76b015ec88f tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] [instance: 6b40e07a-eb45-4fe7-9f98-dc718231a4a4] Creating instance directory {{(pid=71874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 16:24:12 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-3b37d2be-de53-4106-852a-c76b015ec88f tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] [instance: 6b40e07a-eb45-4fe7-9f98-dc718231a4a4] Creating image(s)
Apr 12 16:24:12 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-3b37d2be-de53-4106-852a-c76b015ec88f tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] Acquiring lock "/opt/stack/data/nova/instances/6b40e07a-eb45-4fe7-9f98-dc718231a4a4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:24:12 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-3b37d2be-de53-4106-852a-c76b015ec88f tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] Lock "/opt/stack/data/nova/instances/6b40e07a-eb45-4fe7-9f98-dc718231a4a4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:24:12 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-3b37d2be-de53-4106-852a-c76b015ec88f tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] Lock "/opt/stack/data/nova/instances/6b40e07a-eb45-4fe7-9f98-dc718231a4a4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:24:12 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-3b37d2be-de53-4106-852a-c76b015ec88f tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:24:12 user nova-compute[71874]: DEBUG nova.policy [None req-3b37d2be-de53-4106-852a-c76b015ec88f tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '995a52402acf40bf88b6c7c0440b1b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af762be84c243289780b7af16caae5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71874) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 16:24:13 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-3b37d2be-de53-4106-852a-c76b015ec88f tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json" returned: 0 in 0.133s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:24:13 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-3b37d2be-de53-4106-852a-c76b015ec88f tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] Acquiring lock "b88df1b37cb431f52bc53b5616015c89b5bec411" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:24:13 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-3b37d2be-de53-4106-852a-c76b015ec88f tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] Lock "b88df1b37cb431f52bc53b5616015c89b5bec411" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:24:13 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-3b37d2be-de53-4106-852a-c76b015ec88f tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:24:13 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-3b37d2be-de53-4106-852a-c76b015ec88f tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json" returned: 0 in 0.140s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:24:13 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-3b37d2be-de53-4106-852a-c76b015ec88f tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411,backing_fmt=raw /opt/stack/data/nova/instances/6b40e07a-eb45-4fe7-9f98-dc718231a4a4/disk 1073741824 {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:24:13 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-3b37d2be-de53-4106-852a-c76b015ec88f tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411,backing_fmt=raw /opt/stack/data/nova/instances/6b40e07a-eb45-4fe7-9f98-dc718231a4a4/disk 1073741824" returned: 0 in 0.053s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:24:13 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-3b37d2be-de53-4106-852a-c76b015ec88f tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] Lock "b88df1b37cb431f52bc53b5616015c89b5bec411" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.200s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:24:13 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-3b37d2be-de53-4106-852a-c76b015ec88f tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:24:13 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-3b37d2be-de53-4106-852a-c76b015ec88f tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json" returned: 0 in 0.133s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:24:13 user nova-compute[71874]: DEBUG nova.virt.disk.api [None req-3b37d2be-de53-4106-852a-c76b015ec88f tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6b40e07a-eb45-4fe7-9f98-dc718231a4a4/disk. size=1073741824 {{(pid=71874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 16:24:13 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-3b37d2be-de53-4106-852a-c76b015ec88f tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b40e07a-eb45-4fe7-9f98-dc718231a4a4/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:24:13 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-3b37d2be-de53-4106-852a-c76b015ec88f tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b40e07a-eb45-4fe7-9f98-dc718231a4a4/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:24:13 user nova-compute[71874]: DEBUG nova.virt.disk.api [None req-3b37d2be-de53-4106-852a-c76b015ec88f tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] Cannot resize image /opt/stack/data/nova/instances/6b40e07a-eb45-4fe7-9f98-dc718231a4a4/disk to a smaller size. {{(pid=71874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 16:24:13 user nova-compute[71874]: DEBUG nova.objects.instance [None req-3b37d2be-de53-4106-852a-c76b015ec88f tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] Lazy-loading 'migration_context' on Instance uuid 6b40e07a-eb45-4fe7-9f98-dc718231a4a4 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:24:13 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-3b37d2be-de53-4106-852a-c76b015ec88f tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] [instance: 6b40e07a-eb45-4fe7-9f98-dc718231a4a4] Created local disks {{(pid=71874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 16:24:13 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-3b37d2be-de53-4106-852a-c76b015ec88f tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] [instance: 6b40e07a-eb45-4fe7-9f98-dc718231a4a4] Ensure instance console log exists: /opt/stack/data/nova/instances/6b40e07a-eb45-4fe7-9f98-dc718231a4a4/console.log {{(pid=71874) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 16:24:13 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-3b37d2be-de53-4106-852a-c76b015ec88f tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:24:13 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-3b37d2be-de53-4106-852a-c76b015ec88f tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:24:13 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-3b37d2be-de53-4106-852a-c76b015ec88f tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:24:13 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:24:13 user nova-compute[71874]: DEBUG nova.network.neutron [None req-3b37d2be-de53-4106-852a-c76b015ec88f tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] [instance: 6b40e07a-eb45-4fe7-9f98-dc718231a4a4] Successfully created port: f4ad5837-50cf-4283-aee0-7f531fb6cee6 {{(pid=71874) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 16:24:14 user nova-compute[71874]: DEBUG nova.network.neutron [None req-3b37d2be-de53-4106-852a-c76b015ec88f tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] [instance: 6b40e07a-eb45-4fe7-9f98-dc718231a4a4] Successfully updated port: f4ad5837-50cf-4283-aee0-7f531fb6cee6 {{(pid=71874) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 16:24:14 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-3b37d2be-de53-4106-852a-c76b015ec88f tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] Acquiring lock "refresh_cache-6b40e07a-eb45-4fe7-9f98-dc718231a4a4" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:24:14 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-3b37d2be-de53-4106-852a-c76b015ec88f tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] Acquired lock "refresh_cache-6b40e07a-eb45-4fe7-9f98-dc718231a4a4" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:24:14 user nova-compute[71874]: DEBUG nova.network.neutron [None req-3b37d2be-de53-4106-852a-c76b015ec88f tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] [instance: 6b40e07a-eb45-4fe7-9f98-dc718231a4a4] Building network info cache for instance {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 16:24:14 user nova-compute[71874]: DEBUG nova.compute.manager [req-87423761-d569-4f50-b177-42cce6005c64 req-aa28d82e-eba9-4201-b796-5fa26909163b service nova] [instance: 6b40e07a-eb45-4fe7-9f98-dc718231a4a4] Received event network-changed-f4ad5837-50cf-4283-aee0-7f531fb6cee6 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:24:14 user nova-compute[71874]: DEBUG nova.compute.manager [req-87423761-d569-4f50-b177-42cce6005c64 req-aa28d82e-eba9-4201-b796-5fa26909163b service nova] [instance: 6b40e07a-eb45-4fe7-9f98-dc718231a4a4] Refreshing instance network info cache due to event network-changed-f4ad5837-50cf-4283-aee0-7f531fb6cee6. {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 16:24:14 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-87423761-d569-4f50-b177-42cce6005c64 req-aa28d82e-eba9-4201-b796-5fa26909163b service nova] Acquiring lock "refresh_cache-6b40e07a-eb45-4fe7-9f98-dc718231a4a4" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:24:14 user nova-compute[71874]: DEBUG nova.network.neutron [None req-3b37d2be-de53-4106-852a-c76b015ec88f tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] [instance: 6b40e07a-eb45-4fe7-9f98-dc718231a4a4] Instance cache missing network info. {{(pid=71874) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 16:24:15 user nova-compute[71874]: DEBUG nova.network.neutron [None req-3b37d2be-de53-4106-852a-c76b015ec88f tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] [instance: 6b40e07a-eb45-4fe7-9f98-dc718231a4a4] Updating instance_info_cache with network_info: [{"id": "f4ad5837-50cf-4283-aee0-7f531fb6cee6", "address": "fa:16:3e:55:f5:c9", "network": {"id": "28cbab83-7a0f-44eb-98c5-9d1c9fb305c3", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1112763010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "5af762be84c243289780b7af16caae5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4ad5837-50", "ovs_interfaceid": "f4ad5837-50cf-4283-aee0-7f531fb6cee6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:24:15 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-3b37d2be-de53-4106-852a-c76b015ec88f tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] Releasing lock "refresh_cache-6b40e07a-eb45-4fe7-9f98-dc718231a4a4" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:24:15 user nova-compute[71874]: DEBUG nova.compute.manager [None req-3b37d2be-de53-4106-852a-c76b015ec88f tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] [instance: 6b40e07a-eb45-4fe7-9f98-dc718231a4a4] Instance network_info: |[{"id": "f4ad5837-50cf-4283-aee0-7f531fb6cee6", "address": "fa:16:3e:55:f5:c9", "network": {"id": "28cbab83-7a0f-44eb-98c5-9d1c9fb305c3", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1112763010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "5af762be84c243289780b7af16caae5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4ad5837-50", "ovs_interfaceid": "f4ad5837-50cf-4283-aee0-7f531fb6cee6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 16:24:15 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-87423761-d569-4f50-b177-42cce6005c64 req-aa28d82e-eba9-4201-b796-5fa26909163b service nova] Acquired lock "refresh_cache-6b40e07a-eb45-4fe7-9f98-dc718231a4a4" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:24:15 user nova-compute[71874]: DEBUG nova.network.neutron [req-87423761-d569-4f50-b177-42cce6005c64 req-aa28d82e-eba9-4201-b796-5fa26909163b service nova] [instance: 6b40e07a-eb45-4fe7-9f98-dc718231a4a4] Refreshing network info cache for port f4ad5837-50cf-4283-aee0-7f531fb6cee6 {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 16:24:15 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-3b37d2be-de53-4106-852a-c76b015ec88f tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] [instance: 6b40e07a-eb45-4fe7-9f98-dc718231a4a4] Start _get_guest_xml network_info=[{"id": "f4ad5837-50cf-4283-aee0-7f531fb6cee6", "address": "fa:16:3e:55:f5:c9", "network": {"id": "28cbab83-7a0f-44eb-98c5-9d1c9fb305c3", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1112763010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "5af762be84c243289780b7af16caae5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4ad5837-50", "ovs_interfaceid": "f4ad5837-50cf-4283-aee0-7f531fb6cee6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T15:55:37Z,direct_url=<?>,disk_format='qcow2',id=9dc63f14-8b70-4e72-89f2-13464f2f5c7c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='61a4936d9b7744c0b488d81c9b7746b6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T15:55:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_options': None, 'image_id': '9dc63f14-8b70-4e72-89f2-13464f2f5c7c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 16:24:15 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-3b37d2be-de53-4106-852a-c76b015ec88f tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:24:15 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-3b37d2be-de53-4106-852a-c76b015ec88f tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:24:15 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-3b37d2be-de53-4106-852a-c76b015ec88f tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71874) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 16:24:15 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-3b37d2be-de53-4106-852a-c76b015ec88f tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T15:56:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T15:55:37Z,direct_url=<?>,disk_format='qcow2',id=9dc63f14-8b70-4e72-89f2-13464f2f5c7c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='61a4936d9b7744c0b488d81c9b7746b6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T15:55:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 16:24:15 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-3b37d2be-de53-4106-852a-c76b015ec88f tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] Flavor limits 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 16:24:15 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-3b37d2be-de53-4106-852a-c76b015ec88f tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] Image limits 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 16:24:15 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-3b37d2be-de53-4106-852a-c76b015ec88f tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] Flavor pref 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 16:24:15 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-3b37d2be-de53-4106-852a-c76b015ec88f tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] Image pref 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 16:24:15 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-3b37d2be-de53-4106-852a-c76b015ec88f tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 16:24:15 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-3b37d2be-de53-4106-852a-c76b015ec88f tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 16:24:15 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-3b37d2be-de53-4106-852a-c76b015ec88f tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 16:24:15 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-3b37d2be-de53-4106-852a-c76b015ec88f tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] Got 1 possible topologies {{(pid=71874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 16:24:15 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-3b37d2be-de53-4106-852a-c76b015ec88f tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 16:24:15 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-3b37d2be-de53-4106-852a-c76b015ec88f tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 16:24:15 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-3b37d2be-de53-4106-852a-c76b015ec88f tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T16:24:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1251953966',display_name='tempest-VolumesActionsTest-instance-1251953966',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1251953966',id=44,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5af762be84c243289780b7af16caae5c',ramdisk_id='',reservation_id='r-nshhusbk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-944096851',owner_user_name='tempest-VolumesActionsTest-944096851-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T16:24:13Z,user_data=None,user_id='995a52402acf40bf88b6c7c0440b1b94',uuid=6b40e07a-eb45-4fe7-9f98-dc718231a4a4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f4ad5837-50cf-4283-aee0-7f531fb6cee6", "address": "fa:16:3e:55:f5:c9", "network": {"id": "28cbab83-7a0f-44eb-98c5-9d1c9fb305c3", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1112763010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "5af762be84c243289780b7af16caae5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4ad5837-50", "ovs_interfaceid": "f4ad5837-50cf-4283-aee0-7f531fb6cee6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 16:24:15 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-3b37d2be-de53-4106-852a-c76b015ec88f tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] Converting VIF {"id": "f4ad5837-50cf-4283-aee0-7f531fb6cee6", "address": "fa:16:3e:55:f5:c9", "network": {"id": "28cbab83-7a0f-44eb-98c5-9d1c9fb305c3", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1112763010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "5af762be84c243289780b7af16caae5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4ad5837-50", "ovs_interfaceid": "f4ad5837-50cf-4283-aee0-7f531fb6cee6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:24:15 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-3b37d2be-de53-4106-852a-c76b015ec88f tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:f5:c9,bridge_name='br-int',has_traffic_filtering=True,id=f4ad5837-50cf-4283-aee0-7f531fb6cee6,network=Network(28cbab83-7a0f-44eb-98c5-9d1c9fb305c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4ad5837-50') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:24:15 user nova-compute[71874]: DEBUG nova.objects.instance [None req-3b37d2be-de53-4106-852a-c76b015ec88f tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] Lazy-loading 'pci_devices' on Instance uuid 6b40e07a-eb45-4fe7-9f98-dc718231a4a4 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:24:15 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-3b37d2be-de53-4106-852a-c76b015ec88f tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] [instance: 6b40e07a-eb45-4fe7-9f98-dc718231a4a4] End _get_guest_xml xml=<domain type="kvm">
Apr 12 16:24:15 user nova-compute[71874]:   <uuid>6b40e07a-eb45-4fe7-9f98-dc718231a4a4</uuid>
Apr 12 16:24:15 user nova-compute[71874]:   <name>instance-0000002c</name>
Apr 12 16:24:15 user nova-compute[71874]:   <memory>131072</memory>
Apr 12 16:24:15 user nova-compute[71874]:   <vcpu>1</vcpu>
Apr 12 16:24:15 user nova-compute[71874]:   <metadata>
Apr 12 16:24:15 user nova-compute[71874]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 16:24:15 user nova-compute[71874]:       <nova:package version="0.0.0"/>
Apr 12 16:24:15 user nova-compute[71874]:       <nova:name>tempest-VolumesActionsTest-instance-1251953966</nova:name>
Apr 12 16:24:15 user nova-compute[71874]:       <nova:creationTime>2023-04-12 16:24:15</nova:creationTime>
Apr 12 16:24:15 user nova-compute[71874]:       <nova:flavor name="m1.nano">
Apr 12 16:24:15 user nova-compute[71874]:         <nova:memory>128</nova:memory>
Apr 12 16:24:15 user nova-compute[71874]:         <nova:disk>1</nova:disk>
Apr 12 16:24:15 user nova-compute[71874]:         <nova:swap>0</nova:swap>
Apr 12 16:24:15 user nova-compute[71874]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 16:24:15 user nova-compute[71874]:         <nova:vcpus>1</nova:vcpus>
Apr 12 16:24:15 user nova-compute[71874]:       </nova:flavor>
Apr 12 16:24:15 user nova-compute[71874]:       <nova:owner>
Apr 12 16:24:15 user nova-compute[71874]:         <nova:user uuid="995a52402acf40bf88b6c7c0440b1b94">tempest-VolumesActionsTest-944096851-project-member</nova:user>
Apr 12 16:24:15 user nova-compute[71874]:         <nova:project uuid="5af762be84c243289780b7af16caae5c">tempest-VolumesActionsTest-944096851</nova:project>
Apr 12 16:24:15 user nova-compute[71874]:       </nova:owner>
Apr 12 16:24:15 user nova-compute[71874]:       <nova:root type="image" uuid="9dc63f14-8b70-4e72-89f2-13464f2f5c7c"/>
Apr 12 16:24:15 user nova-compute[71874]:       <nova:ports>
Apr 12 16:24:15 user nova-compute[71874]:         <nova:port uuid="f4ad5837-50cf-4283-aee0-7f531fb6cee6">
Apr 12 16:24:15 user nova-compute[71874]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 12 16:24:15 user nova-compute[71874]:         </nova:port>
Apr 12 16:24:15 user nova-compute[71874]:       </nova:ports>
Apr 12 16:24:15 user nova-compute[71874]:     </nova:instance>
Apr 12 16:24:15 user nova-compute[71874]:   </metadata>
Apr 12 16:24:15 user nova-compute[71874]:   <sysinfo type="smbios">
Apr 12 16:24:15 user nova-compute[71874]:     <system>
Apr 12 16:24:15 user nova-compute[71874]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 16:24:15 user nova-compute[71874]:       <entry name="product">OpenStack Nova</entry>
Apr 12 16:24:15 user nova-compute[71874]:       <entry name="version">0.0.0</entry>
Apr 12 16:24:15 user nova-compute[71874]:       <entry name="serial">6b40e07a-eb45-4fe7-9f98-dc718231a4a4</entry>
Apr 12 16:24:15 user nova-compute[71874]:       <entry name="uuid">6b40e07a-eb45-4fe7-9f98-dc718231a4a4</entry>
Apr 12 16:24:15 user nova-compute[71874]:       <entry name="family">Virtual Machine</entry>
Apr 12 16:24:15 user nova-compute[71874]:     </system>
Apr 12 16:24:15 user nova-compute[71874]:   </sysinfo>
Apr 12 16:24:15 user nova-compute[71874]:   <os>
Apr 12 16:24:15 user nova-compute[71874]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 16:24:15 user nova-compute[71874]:     <boot dev="hd"/>
Apr 12 16:24:15 user nova-compute[71874]:     <smbios mode="sysinfo"/>
Apr 12 16:24:15 user nova-compute[71874]:   </os>
Apr 12 16:24:15 user nova-compute[71874]:   <features>
Apr 12 16:24:15 user nova-compute[71874]:     <acpi/>
Apr 12 16:24:15 user nova-compute[71874]:     <apic/>
Apr 12 16:24:15 user nova-compute[71874]:     <vmcoreinfo/>
Apr 12 16:24:15 user nova-compute[71874]:   </features>
Apr 12 16:24:15 user nova-compute[71874]:   <clock offset="utc">
Apr 12 16:24:15 user nova-compute[71874]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 16:24:15 user nova-compute[71874]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 16:24:15 user nova-compute[71874]:     <timer name="hpet" present="no"/>
Apr 12 16:24:15 user nova-compute[71874]:   </clock>
Apr 12 16:24:15 user nova-compute[71874]:   <cpu mode="custom" match="exact">
Apr 12 16:24:15 user nova-compute[71874]:     <model>Nehalem</model>
Apr 12 16:24:15 user nova-compute[71874]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 16:24:15 user nova-compute[71874]:   </cpu>
Apr 12 16:24:15 user nova-compute[71874]:   <devices>
Apr 12 16:24:15 user nova-compute[71874]:     <disk type="file" device="disk">
Apr 12 16:24:15 user nova-compute[71874]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 16:24:15 user nova-compute[71874]:       <source file="/opt/stack/data/nova/instances/6b40e07a-eb45-4fe7-9f98-dc718231a4a4/disk"/>
Apr 12 16:24:15 user nova-compute[71874]:       <target dev="vda" bus="virtio"/>
Apr 12 16:24:15 user nova-compute[71874]:     </disk>
Apr 12 16:24:15 user nova-compute[71874]:     <interface type="ethernet">
Apr 12 16:24:15 user nova-compute[71874]:       <mac address="fa:16:3e:55:f5:c9"/>
Apr 12 16:24:15 user nova-compute[71874]:       <model type="virtio"/>
Apr 12 16:24:15 user nova-compute[71874]:       <mtu size="1442"/>
Apr 12 16:24:15 user nova-compute[71874]:       <target dev="tapf4ad5837-50"/>
Apr 12 16:24:15 user nova-compute[71874]:     </interface>
Apr 12 16:24:15 user nova-compute[71874]:     <serial type="pty">
Apr 12 16:24:15 user nova-compute[71874]:       <log file="/opt/stack/data/nova/instances/6b40e07a-eb45-4fe7-9f98-dc718231a4a4/console.log" append="off"/>
Apr 12 16:24:15 user nova-compute[71874]:     </serial>
Apr 12 16:24:15 user nova-compute[71874]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 16:24:15 user nova-compute[71874]:     <video>
Apr 12 16:24:15 user nova-compute[71874]:       <model type="virtio"/>
Apr 12 16:24:15 user nova-compute[71874]:     </video>
Apr 12 16:24:15 user nova-compute[71874]:     <rng model="virtio">
Apr 12 16:24:15 user nova-compute[71874]:       <backend model="random">/dev/urandom</backend>
Apr 12 16:24:15 user nova-compute[71874]:     </rng>
Apr 12 16:24:15 user nova-compute[71874]:     <controller type="usb" index="0" model="none"/>
Apr 12 16:24:15 user nova-compute[71874]:     <memballoon model="virtio">
Apr 12 16:24:15 user nova-compute[71874]:       <stats period="10"/>
Apr 12 16:24:15 user nova-compute[71874]:     </memballoon>
Apr 12 16:24:15 user nova-compute[71874]:   </devices>
Apr 12 16:24:15 user nova-compute[71874]: </domain>
Apr 12 16:24:15 user nova-compute[71874]:  {{(pid=71874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 16:24:15 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-3b37d2be-de53-4106-852a-c76b015ec88f tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T16:24:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1251953966',display_name='tempest-VolumesActionsTest-instance-1251953966',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1251953966',id=44,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5af762be84c243289780b7af16caae5c',ramdisk_id='',reservation_id='r-nshhusbk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-944096851',owner_user_name='tempest-VolumesActionsTest-944096851-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T16:24:13Z,user_data=None,user_id='995a52402acf40bf88b6c7c0440b1b94',uuid=6b40e07a-eb45-4fe7-9f98-dc718231a4a4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f4ad5837-50cf-4283-aee0-7f531fb6cee6", "address": "fa:16:3e:55:f5:c9", "network": {"id": "28cbab83-7a0f-44eb-98c5-9d1c9fb305c3", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1112763010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "5af762be84c243289780b7af16caae5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4ad5837-50", "ovs_interfaceid": "f4ad5837-50cf-4283-aee0-7f531fb6cee6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 16:24:15 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-3b37d2be-de53-4106-852a-c76b015ec88f tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] Converting VIF {"id": "f4ad5837-50cf-4283-aee0-7f531fb6cee6", "address": "fa:16:3e:55:f5:c9", "network": {"id": "28cbab83-7a0f-44eb-98c5-9d1c9fb305c3", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1112763010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "5af762be84c243289780b7af16caae5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4ad5837-50", "ovs_interfaceid": "f4ad5837-50cf-4283-aee0-7f531fb6cee6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:24:15 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-3b37d2be-de53-4106-852a-c76b015ec88f tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:f5:c9,bridge_name='br-int',has_traffic_filtering=True,id=f4ad5837-50cf-4283-aee0-7f531fb6cee6,network=Network(28cbab83-7a0f-44eb-98c5-9d1c9fb305c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4ad5837-50') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:24:15 user nova-compute[71874]: DEBUG os_vif [None req-3b37d2be-de53-4106-852a-c76b015ec88f tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:f5:c9,bridge_name='br-int',has_traffic_filtering=True,id=f4ad5837-50cf-4283-aee0-7f531fb6cee6,network=Network(28cbab83-7a0f-44eb-98c5-9d1c9fb305c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4ad5837-50') {{(pid=71874) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 16:24:15 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:24:15 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:24:15 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 16:24:15 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:24:15 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf4ad5837-50, may_exist=True) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:24:15 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf4ad5837-50, col_values=(('external_ids', {'iface-id': 'f4ad5837-50cf-4283-aee0-7f531fb6cee6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:55:f5:c9', 'vm-uuid': '6b40e07a-eb45-4fe7-9f98-dc718231a4a4'}),)) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:24:15 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:24:15 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:24:15 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:24:15 user nova-compute[71874]: INFO os_vif [None req-3b37d2be-de53-4106-852a-c76b015ec88f tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:f5:c9,bridge_name='br-int',has_traffic_filtering=True,id=f4ad5837-50cf-4283-aee0-7f531fb6cee6,network=Network(28cbab83-7a0f-44eb-98c5-9d1c9fb305c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4ad5837-50')
Apr 12 16:24:15 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-3b37d2be-de53-4106-852a-c76b015ec88f tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] No BDM found with device name vda, not building metadata. {{(pid=71874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 16:24:15 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-3b37d2be-de53-4106-852a-c76b015ec88f tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] No VIF found with MAC fa:16:3e:55:f5:c9, not building metadata {{(pid=71874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 16:24:15 user nova-compute[71874]: DEBUG nova.network.neutron [req-87423761-d569-4f50-b177-42cce6005c64 req-aa28d82e-eba9-4201-b796-5fa26909163b service nova] [instance: 6b40e07a-eb45-4fe7-9f98-dc718231a4a4] Updated VIF entry in instance network info cache for port f4ad5837-50cf-4283-aee0-7f531fb6cee6. {{(pid=71874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 16:24:15 user nova-compute[71874]: DEBUG nova.network.neutron [req-87423761-d569-4f50-b177-42cce6005c64 req-aa28d82e-eba9-4201-b796-5fa26909163b service nova] [instance: 6b40e07a-eb45-4fe7-9f98-dc718231a4a4] Updating instance_info_cache with network_info: [{"id": "f4ad5837-50cf-4283-aee0-7f531fb6cee6", "address": "fa:16:3e:55:f5:c9", "network": {"id": "28cbab83-7a0f-44eb-98c5-9d1c9fb305c3", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1112763010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "5af762be84c243289780b7af16caae5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4ad5837-50", "ovs_interfaceid": "f4ad5837-50cf-4283-aee0-7f531fb6cee6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:24:15 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-87423761-d569-4f50-b177-42cce6005c64 req-aa28d82e-eba9-4201-b796-5fa26909163b service nova] Releasing lock "refresh_cache-6b40e07a-eb45-4fe7-9f98-dc718231a4a4" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:24:16 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-38e09fcc-50a3-4a14-9a74-08c0c648be84 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] [instance: 0ef81d71-afb0-4335-b60f-13071b957d08] Calling os-brick to attach iSCSI Volume {{(pid=71874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 16:24:16 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-38e09fcc-50a3-4a14-9a74-08c0c648be84 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3c0216320>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:080c2e7c-0047-4794-90a2-ab4835def5de', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gAqupKDz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:24:16 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-38e09fcc-50a3-4a14-9a74-08c0c648be84 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:24:16 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-38e09fcc-50a3-4a14-9a74-08c0c648be84 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:24:16 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-38e09fcc-50a3-4a14-9a74-08c0c648be84 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:24:16 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-38e09fcc-50a3-4a14-9a74-08c0c648be84 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:24:16 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-38e09fcc-50a3-4a14-9a74-08c0c648be84 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:080c2e7c-0047-4794-90a2-ab4835def5de" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:24:16 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-38e09fcc-50a3-4a14-9a74-08c0c648be84 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:080c2e7c-0047-4794-90a2-ab4835def5de" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:24:16 user nova-compute[71874]: INFO os_brick.initiator.connectors.iscsi [None req-38e09fcc-50a3-4a14-9a74-08c0c648be84 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 16:24:16 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:080c2e7c-0047-4794-90a2-ab4835def5de -p 172.16.0.220:3260 {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:24:16 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:080c2e7c-0047-4794-90a2-ab4835def5de -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:24:16 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[15955078-a975-4498-8d9f-382f574ff483]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:24:16 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-38e09fcc-50a3-4a14-9a74-08c0c648be84 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 16:24:16 user nova-compute[71874]:  {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:24:16 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:080c2e7c-0047-4794-90a2-ab4835def5de -p 172.16.0.220:3260 --interface default --op new {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:24:16 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:080c2e7c-0047-4794-90a2-ab4835def5de -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:24:16 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c967b90-904b-4749-8849-6279de2fda0c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:080c2e7c-0047-4794-90a2-ab4835def5de] added\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:24:16 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-38e09fcc-50a3-4a14-9a74-08c0c648be84 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:080c2e7c-0047-4794-90a2-ab4835def5de] added
Apr 12 16:24:16 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:24:16 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:080c2e7c-0047-4794-90a2-ab4835def5de -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:24:16 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:080c2e7c-0047-4794-90a2-ab4835def5de -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:24:16 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[65d4b74a-7d01-4967-9210-1b9478a07ec6]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:24:16 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-38e09fcc-50a3-4a14-9a74-08c0c648be84 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:24:16 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:080c2e7c-0047-4794-90a2-ab4835def5de -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:24:16 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:080c2e7c-0047-4794-90a2-ab4835def5de -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.032s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:24:16 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ab1c551-c0cd-4b57-b6b1-b7ddd0f2a9e9]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:24:16 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-38e09fcc-50a3-4a14-9a74-08c0c648be84 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:24:16 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:080c2e7c-0047-4794-90a2-ab4835def5de -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gAqupKDz {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:24:16 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:080c2e7c-0047-4794-90a2-ab4835def5de -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gAqupKDz" returned: 0 in 0.018s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:24:16 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[15915161-eed2-4dda-a40b-d23820126439]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:24:16 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-38e09fcc-50a3-4a14-9a74-08c0c648be84 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gAqupKDz'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:24:16 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:080c2e7c-0047-4794-90a2-ab4835def5de -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:24:16 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:080c2e7c-0047-4794-90a2-ab4835def5de -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:24:16 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[207f0f19-4e8c-47b1-a35c-e80ff6fc0894]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:24:16 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-38e09fcc-50a3-4a14-9a74-08c0c648be84 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:24:16 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:24:16 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:24:16 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[652e80c4-8b85-4efe-b4ad-6dd487c18b11]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909 (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:24:16 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-38e09fcc-50a3-4a14-9a74-08c0c648be84 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909 (non-flash)
Apr 12 16:24:16 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:24:16 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-38e09fcc-50a3-4a14-9a74-08c0c648be84 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909 (non-flash)
Apr 12 16:24:16 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:24:16 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:080c2e7c-0047-4794-90a2-ab4835def5de -p 172.16.0.220:3260 --login {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:24:16 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:080c2e7c-0047-4794-90a2-ab4835def5de -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:24:16 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[945453ba-6923-4775-a770-29969f2f623d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:080c2e7c-0047-4794-90a2-ab4835def5de, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:080c2e7c-0047-4794-90a2-ab4835def5de, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:24:16 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-38e09fcc-50a3-4a14-9a74-08c0c648be84 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:080c2e7c-0047-4794-90a2-ab4835def5de, portal: 172.16.0.220,3260]
Apr 12 16:24:16 user nova-compute[71874]: Login to [iface: default, target: iqn.2010-10.org.openstack:080c2e7c-0047-4794-90a2-ab4835def5de, portal: 172.16.0.220,3260] successful.
Apr 12 16:24:16 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:24:16 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:080c2e7c-0047-4794-90a2-ab4835def5de -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:24:16 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:080c2e7c-0047-4794-90a2-ab4835def5de -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:24:16 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a70b562-cac3-4f62-8c15-09f23870ce8d]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:24:16 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-38e09fcc-50a3-4a14-9a74-08c0c648be84 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:24:16 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:24:16 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:24:16 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:24:16 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[826b5c7d-1a80-4e08-9edf-372e7bf4bc59]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:080c2e7c-0047-4794-90a2-ab4835def5de (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:24:16 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-38e09fcc-50a3-4a14-9a74-08c0c648be84 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909 (non-flash)
Apr 12 16:24:16 user nova-compute[71874]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:080c2e7c-0047-4794-90a2-ab4835def5de (non-flash)
Apr 12 16:24:16 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:24:16 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-38e09fcc-50a3-4a14-9a74-08c0c648be84 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909 (non-flash)
Apr 12 16:24:16 user nova-compute[71874]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:080c2e7c-0047-4794-90a2-ab4835def5de (non-flash)
Apr 12 16:24:16 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:24:16 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-38e09fcc-50a3-4a14-9a74-08c0c648be84 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:080c2e7c-0047-4794-90a2-ab4835def5de" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.270s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:24:16 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-38e09fcc-50a3-4a14-9a74-08c0c648be84 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Connected to 172.16.0.220:3260 {{(pid=71874) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 16:24:16 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-38e09fcc-50a3-4a14-9a74-08c0c648be84 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] HCTL ('34', '-', '-', 0) found on session 50 with lun 0 {{(pid=71874) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 16:24:16 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-38e09fcc-50a3-4a14-9a74-08c0c648be84 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71874) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 16:24:16 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:24:16 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.027s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:24:16 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bcdd61e-08bd-4301-bd2c-5960be9b2fa5]: (4, ('- - 0', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:24:16 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-38e09fcc-50a3-4a14-9a74-08c0c648be84 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Searching for a device in session 50 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71874) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 16:24:16 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-38e09fcc-50a3-4a14-9a74-08c0c648be84 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:080c2e7c-0047-4794-90a2-ab4835def5de', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gAqupKDz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71874) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 16:24:16 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:24:16 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:24:16 user nova-compute[71874]: DEBUG nova.compute.manager [req-6596a203-515f-4c23-b090-bc3dd6ea5cc8 req-34b80104-a43c-4448-b214-84288c9cf3fc service nova] [instance: 6b40e07a-eb45-4fe7-9f98-dc718231a4a4] Received event network-vif-plugged-f4ad5837-50cf-4283-aee0-7f531fb6cee6 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:24:16 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-6596a203-515f-4c23-b090-bc3dd6ea5cc8 req-34b80104-a43c-4448-b214-84288c9cf3fc service nova] Acquiring lock "6b40e07a-eb45-4fe7-9f98-dc718231a4a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:24:16 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-6596a203-515f-4c23-b090-bc3dd6ea5cc8 req-34b80104-a43c-4448-b214-84288c9cf3fc service nova] Lock "6b40e07a-eb45-4fe7-9f98-dc718231a4a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:24:16 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-6596a203-515f-4c23-b090-bc3dd6ea5cc8 req-34b80104-a43c-4448-b214-84288c9cf3fc service nova] Lock "6b40e07a-eb45-4fe7-9f98-dc718231a4a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:24:16 user nova-compute[71874]: DEBUG nova.compute.manager [req-6596a203-515f-4c23-b090-bc3dd6ea5cc8 req-34b80104-a43c-4448-b214-84288c9cf3fc service nova] [instance: 6b40e07a-eb45-4fe7-9f98-dc718231a4a4] No waiting events found dispatching network-vif-plugged-f4ad5837-50cf-4283-aee0-7f531fb6cee6 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:24:16 user nova-compute[71874]: WARNING nova.compute.manager [req-6596a203-515f-4c23-b090-bc3dd6ea5cc8 req-34b80104-a43c-4448-b214-84288c9cf3fc service nova] [instance: 6b40e07a-eb45-4fe7-9f98-dc718231a4a4] Received unexpected event network-vif-plugged-f4ad5837-50cf-4283-aee0-7f531fb6cee6 for instance with vm_state building and task_state spawning.
Apr 12 16:24:17 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-38e09fcc-50a3-4a14-9a74-08c0c648be84 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.317s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:24:17 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-38e09fcc-50a3-4a14-9a74-08c0c648be84 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] <== connect_volume: return (1319ms) {'type': 'block', 'scsi_wwn': '23636626561323565', 'path': '/dev/sdc'} {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:24:17 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-38e09fcc-50a3-4a14-9a74-08c0c648be84 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] [instance: 0ef81d71-afb0-4335-b60f-13071b957d08] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23636626561323565', 'path': '/dev/sdc'} {{(pid=71874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 16:24:17 user nova-compute[71874]: DEBUG nova.objects.instance [None req-38e09fcc-50a3-4a14-9a74-08c0c648be84 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Lazy-loading 'flavor' on Instance uuid 0ef81d71-afb0-4335-b60f-13071b957d08 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:24:17 user nova-compute[71874]: DEBUG nova.virt.libvirt.guest [None req-38e09fcc-50a3-4a14-9a74-08c0c648be84 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 16:24:17 user nova-compute[71874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 16:24:17 user nova-compute[71874]:   <source dev="/dev/sdc"/>
Apr 12 16:24:17 user nova-compute[71874]:   <target dev="vdb" bus="virtio"/>
Apr 12 16:24:17 user nova-compute[71874]:   <serial>080c2e7c-0047-4794-90a2-ab4835def5de</serial>
Apr 12 16:24:17 user nova-compute[71874]: </disk>
Apr 12 16:24:17 user nova-compute[71874]:  {{(pid=71874) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 16:24:18 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-38e09fcc-50a3-4a14-9a74-08c0c648be84 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] No BDM found with device name vda, not building metadata. {{(pid=71874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 16:24:18 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-38e09fcc-50a3-4a14-9a74-08c0c648be84 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 16:24:18 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-38e09fcc-50a3-4a14-9a74-08c0c648be84 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] No VIF found with MAC fa:16:3e:68:3a:b3, not building metadata {{(pid=71874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 16:24:18 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-38e09fcc-50a3-4a14-9a74-08c0c648be84 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Lock "0ef81d71-afb0-4335-b60f-13071b957d08" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.959s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:24:18 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:24:18 user nova-compute[71874]: DEBUG nova.virt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Emitting event <LifecycleEvent: 1681316658.8514023, 6b40e07a-eb45-4fe7-9f98-dc718231a4a4 => Resumed> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:24:18 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 6b40e07a-eb45-4fe7-9f98-dc718231a4a4] VM Resumed (Lifecycle Event)
Apr 12 16:24:18 user nova-compute[71874]: DEBUG nova.compute.manager [None req-3b37d2be-de53-4106-852a-c76b015ec88f tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] [instance: 6b40e07a-eb45-4fe7-9f98-dc718231a4a4] Instance event wait completed in 0 seconds for  {{(pid=71874) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 16:24:18 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-3b37d2be-de53-4106-852a-c76b015ec88f tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] [instance: 6b40e07a-eb45-4fe7-9f98-dc718231a4a4] Guest created on hypervisor {{(pid=71874) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 16:24:18 user nova-compute[71874]: INFO nova.virt.libvirt.driver [-] [instance: 6b40e07a-eb45-4fe7-9f98-dc718231a4a4] Instance spawned successfully.
Apr 12 16:24:18 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-3b37d2be-de53-4106-852a-c76b015ec88f tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] [instance: 6b40e07a-eb45-4fe7-9f98-dc718231a4a4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 16:24:18 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 6b40e07a-eb45-4fe7-9f98-dc718231a4a4] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:24:18 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 6b40e07a-eb45-4fe7-9f98-dc718231a4a4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 16:24:18 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-3b37d2be-de53-4106-852a-c76b015ec88f tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] [instance: 6b40e07a-eb45-4fe7-9f98-dc718231a4a4] Found default for hw_cdrom_bus of ide {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:24:18 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-3b37d2be-de53-4106-852a-c76b015ec88f tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] [instance: 6b40e07a-eb45-4fe7-9f98-dc718231a4a4] Found default for hw_disk_bus of virtio {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:24:18 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-3b37d2be-de53-4106-852a-c76b015ec88f tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] [instance: 6b40e07a-eb45-4fe7-9f98-dc718231a4a4] Found default for hw_input_bus of None {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:24:18 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-3b37d2be-de53-4106-852a-c76b015ec88f tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] [instance: 6b40e07a-eb45-4fe7-9f98-dc718231a4a4] Found default for hw_pointer_model of None {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:24:18 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-3b37d2be-de53-4106-852a-c76b015ec88f tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] [instance: 6b40e07a-eb45-4fe7-9f98-dc718231a4a4] Found default for hw_video_model of virtio {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:24:18 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-3b37d2be-de53-4106-852a-c76b015ec88f tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] [instance: 6b40e07a-eb45-4fe7-9f98-dc718231a4a4] Found default for hw_vif_model of virtio {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:24:18 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 6b40e07a-eb45-4fe7-9f98-dc718231a4a4] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 16:24:18 user nova-compute[71874]: DEBUG nova.virt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Emitting event <LifecycleEvent: 1681316658.853746, 6b40e07a-eb45-4fe7-9f98-dc718231a4a4 => Started> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:24:18 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 6b40e07a-eb45-4fe7-9f98-dc718231a4a4] VM Started (Lifecycle Event)
Apr 12 16:24:18 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 6b40e07a-eb45-4fe7-9f98-dc718231a4a4] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:24:18 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 6b40e07a-eb45-4fe7-9f98-dc718231a4a4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 16:24:18 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 6b40e07a-eb45-4fe7-9f98-dc718231a4a4] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 16:24:18 user nova-compute[71874]: INFO nova.compute.manager [None req-3b37d2be-de53-4106-852a-c76b015ec88f tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] [instance: 6b40e07a-eb45-4fe7-9f98-dc718231a4a4] Took 6.13 seconds to spawn the instance on the hypervisor.
Apr 12 16:24:18 user nova-compute[71874]: DEBUG nova.compute.manager [None req-3b37d2be-de53-4106-852a-c76b015ec88f tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] [instance: 6b40e07a-eb45-4fe7-9f98-dc718231a4a4] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:24:19 user nova-compute[71874]: DEBUG nova.compute.manager [req-4f11e5a5-6779-4bca-9d44-3b32e0718553 req-ca5a80b6-f719-4b41-b131-d76aa1b91592 service nova] [instance: 6b40e07a-eb45-4fe7-9f98-dc718231a4a4] Received event network-vif-plugged-f4ad5837-50cf-4283-aee0-7f531fb6cee6 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:24:19 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-4f11e5a5-6779-4bca-9d44-3b32e0718553 req-ca5a80b6-f719-4b41-b131-d76aa1b91592 service nova] Acquiring lock "6b40e07a-eb45-4fe7-9f98-dc718231a4a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:24:19 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-4f11e5a5-6779-4bca-9d44-3b32e0718553 req-ca5a80b6-f719-4b41-b131-d76aa1b91592 service nova] Lock "6b40e07a-eb45-4fe7-9f98-dc718231a4a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:24:19 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-4f11e5a5-6779-4bca-9d44-3b32e0718553 req-ca5a80b6-f719-4b41-b131-d76aa1b91592 service nova] Lock "6b40e07a-eb45-4fe7-9f98-dc718231a4a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:24:19 user nova-compute[71874]: DEBUG nova.compute.manager [req-4f11e5a5-6779-4bca-9d44-3b32e0718553 req-ca5a80b6-f719-4b41-b131-d76aa1b91592 service nova] [instance: 6b40e07a-eb45-4fe7-9f98-dc718231a4a4] No waiting events found dispatching network-vif-plugged-f4ad5837-50cf-4283-aee0-7f531fb6cee6 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:24:19 user nova-compute[71874]: WARNING nova.compute.manager [req-4f11e5a5-6779-4bca-9d44-3b32e0718553 req-ca5a80b6-f719-4b41-b131-d76aa1b91592 service nova] [instance: 6b40e07a-eb45-4fe7-9f98-dc718231a4a4] Received unexpected event network-vif-plugged-f4ad5837-50cf-4283-aee0-7f531fb6cee6 for instance with vm_state building and task_state spawning.
Apr 12 16:24:19 user nova-compute[71874]: INFO nova.compute.manager [None req-3b37d2be-de53-4106-852a-c76b015ec88f tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] [instance: 6b40e07a-eb45-4fe7-9f98-dc718231a4a4] Took 6.72 seconds to build instance.
Apr 12 16:24:19 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-3b37d2be-de53-4106-852a-c76b015ec88f tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] Lock "6b40e07a-eb45-4fe7-9f98-dc718231a4a4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.849s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:24:20 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:24:25 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:24:25 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:24:25 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71874) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 16:24:25 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71874) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 16:24:25 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71874) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 16:24:25 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:24:28 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:24:30 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:24:31 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:24:31 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:24:31 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:24:31 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:24:31 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Auditing locally available compute resources for user (node: user) {{(pid=71874) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 16:24:31 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 16:24:31 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b40e07a-eb45-4fe7-9f98-dc718231a4a4/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:24:32 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b40e07a-eb45-4fe7-9f98-dc718231a4a4/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:24:32 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b40e07a-eb45-4fe7-9f98-dc718231a4a4/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:24:32 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b40e07a-eb45-4fe7-9f98-dc718231a4a4/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:24:32 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ef81d71-afb0-4335-b60f-13071b957d08/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:24:32 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ef81d71-afb0-4335-b60f-13071b957d08/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:24:32 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ef81d71-afb0-4335-b60f-13071b957d08/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:24:32 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ef81d71-afb0-4335-b60f-13071b957d08/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:24:32 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 16:24:33 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:24:33 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:24:33 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Hypervisor/Node resource view: name=user free_ram=8399MB free_disk=25.95020294189453GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71874) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 16:24:33 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:24:33 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:24:33 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 0ef81d71-afb0-4335-b60f-13071b957d08 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:24:33 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance d9a374be-4852-45e3-b346-79a08b60f981 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:24:33 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 6b40e07a-eb45-4fe7-9f98-dc718231a4a4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:24:33 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=71874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 16:24:33 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Final resource view: name=user phys_ram=16023MB used_ram=896MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=71874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 16:24:33 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Inventory has not changed in ProviderTree for provider: 0e94b4c8-cd49-45e4-9133-d36eb4b2456b {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 16:24:33 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Inventory has not changed for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 16:24:33 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Compute_service record updated for user:user {{(pid=71874) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 16:24:33 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.241s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:24:33 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:24:35 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:24:35 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d986a610-3be9-4a51-84ad-3551814c3017 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Acquiring lock "0ef81d71-afb0-4335-b60f-13071b957d08" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:24:35 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d986a610-3be9-4a51-84ad-3551814c3017 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Lock "0ef81d71-afb0-4335-b60f-13071b957d08" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:24:35 user nova-compute[71874]: INFO nova.compute.manager [None req-d986a610-3be9-4a51-84ad-3551814c3017 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] [instance: 0ef81d71-afb0-4335-b60f-13071b957d08] Detaching volume 080c2e7c-0047-4794-90a2-ab4835def5de
Apr 12 16:24:35 user nova-compute[71874]: INFO nova.virt.block_device [None req-d986a610-3be9-4a51-84ad-3551814c3017 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] [instance: 0ef81d71-afb0-4335-b60f-13071b957d08] Attempting to driver detach volume 080c2e7c-0047-4794-90a2-ab4835def5de from mountpoint /dev/vdb
Apr 12 16:24:35 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d986a610-3be9-4a51-84ad-3551814c3017 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Attempting to detach device vdb from instance 0ef81d71-afb0-4335-b60f-13071b957d08 from the persistent domain config. {{(pid=71874) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 16:24:35 user nova-compute[71874]: DEBUG nova.virt.libvirt.guest [None req-d986a610-3be9-4a51-84ad-3551814c3017 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 16:24:35 user nova-compute[71874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 16:24:35 user nova-compute[71874]:   <source dev="/dev/sdc"/>
Apr 12 16:24:35 user nova-compute[71874]:   <target dev="vdb" bus="virtio"/>
Apr 12 16:24:35 user nova-compute[71874]:   <serial>080c2e7c-0047-4794-90a2-ab4835def5de</serial>
Apr 12 16:24:35 user nova-compute[71874]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 16:24:35 user nova-compute[71874]: </disk>
Apr 12 16:24:35 user nova-compute[71874]:  {{(pid=71874) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 16:24:35 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-d986a610-3be9-4a51-84ad-3551814c3017 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Successfully detached device vdb from instance 0ef81d71-afb0-4335-b60f-13071b957d08 from the persistent domain config.
Apr 12 16:24:35 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d986a610-3be9-4a51-84ad-3551814c3017 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0ef81d71-afb0-4335-b60f-13071b957d08 from the live domain config. {{(pid=71874) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 16:24:35 user nova-compute[71874]: DEBUG nova.virt.libvirt.guest [None req-d986a610-3be9-4a51-84ad-3551814c3017 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 16:24:35 user nova-compute[71874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 16:24:35 user nova-compute[71874]:   <source dev="/dev/sdc"/>
Apr 12 16:24:35 user nova-compute[71874]:   <target dev="vdb" bus="virtio"/>
Apr 12 16:24:35 user nova-compute[71874]:   <serial>080c2e7c-0047-4794-90a2-ab4835def5de</serial>
Apr 12 16:24:35 user nova-compute[71874]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 16:24:35 user nova-compute[71874]: </disk>
Apr 12 16:24:35 user nova-compute[71874]:  {{(pid=71874) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 16:24:35 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-f7f02e6f-b863-4034-8ea8-d0fe50364f4d tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Acquiring lock "0ef81d71-afb0-4335-b60f-13071b957d08" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:24:36 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:24:36 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:24:36 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Received event <DeviceRemovedEvent: 1681316676.405448, 0ef81d71-afb0-4335-b60f-13071b957d08 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71874) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 16:24:36 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d986a610-3be9-4a51-84ad-3551814c3017 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0ef81d71-afb0-4335-b60f-13071b957d08 {{(pid=71874) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 16:24:36 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-d986a610-3be9-4a51-84ad-3551814c3017 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Successfully detached device vdb from instance 0ef81d71-afb0-4335-b60f-13071b957d08 from the live domain config.
Apr 12 16:24:36 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d986a610-3be9-4a51-84ad-3551814c3017 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] [instance: 0ef81d71-afb0-4335-b60f-13071b957d08] calling os-brick to detach iSCSI Volume {{(pid=71874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 16:24:36 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-d986a610-3be9-4a51-84ad-3551814c3017 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3c0216320>, {'target_iqn': 'iqn.2010-10.org.openstack:080c2e7c-0047-4794-90a2-ab4835def5de', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gAqupKDz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:24:36 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-d986a610-3be9-4a51-84ad-3551814c3017 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:24:36 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-d986a610-3be9-4a51-84ad-3551814c3017 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:24:36 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-d986a610-3be9-4a51-84ad-3551814c3017 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:24:36 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:24:36 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:24:36 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ce51d4b-a672-4206-bdec-0ab80ccb549b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:080c2e7c-0047-4794-90a2-ab4835def5de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:24:36 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-d986a610-3be9-4a51-84ad-3551814c3017 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 16:24:36 user nova-compute[71874]: No targets found.
Apr 12 16:24:36 user nova-compute[71874]: iSNS:
Apr 12 16:24:36 user nova-compute[71874]: No targets found.
Apr 12 16:24:36 user nova-compute[71874]: STATIC:
Apr 12 16:24:36 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909
Apr 12 16:24:36 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:24:36 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:24:36 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:080c2e7c-0047-4794-90a2-ab4835def5de
Apr 12 16:24:36 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:24:36 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:24:36 user nova-compute[71874]: FIRMWARE:
Apr 12 16:24:36 user nova-compute[71874]: No targets found.
Apr 12 16:24:36 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:24:36 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-d986a610-3be9-4a51-84ad-3551814c3017 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 16:24:36 user nova-compute[71874]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 16:24:36 user nova-compute[71874]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71874) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 16:24:36 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-d986a610-3be9-4a51-84ad-3551814c3017 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:080c2e7c-0047-4794-90a2-ab4835def5de', 0)] {{(pid=71874) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 16:24:36 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:24:36 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:24:36 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ecd521d-5f4b-4b0c-9091-18b38d3f8646]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:080c2e7c-0047-4794-90a2-ab4835def5de\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:24:36 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:24:36 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:24:36 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[5505d105-70cc-4d32-bf3a-be235bf5e108]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:080c2e7c-0047-4794-90a2-ab4835def5de (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:24:36 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-d986a610-3be9-4a51-84ad-3551814c3017 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909 (non-flash)
Apr 12 16:24:36 user nova-compute[71874]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:080c2e7c-0047-4794-90a2-ab4835def5de (non-flash)
Apr 12 16:24:36 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:24:36 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-d986a610-3be9-4a51-84ad-3551814c3017 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909 (non-flash)
Apr 12 16:24:36 user nova-compute[71874]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:080c2e7c-0047-4794-90a2-ab4835def5de (non-flash)
Apr 12 16:24:36 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:24:36 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-d986a610-3be9-4a51-84ad-3551814c3017 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc3d45f80d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:080c2e7c-0047-4794-90a2-ab4835def5de'): ({'sdc'}, set())}) {{(pid=71874) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 16:24:36 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-d986a610-3be9-4a51-84ad-3551814c3017 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Removing single pathed devices sdc {{(pid=71874) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 16:24:36 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:24:36 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:24:36 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[71da1bc9-3cdf-42a1-8085-6bbfbd4fd830]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:24:36 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:24:36 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:24:36 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a37967e-c395-40cb-82b5-518097ad0a71]: (4, ('ok\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:24:36 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-d986a610-3be9-4a51-84ad-3551814c3017 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Flushing IO for device /dev/sdc {{(pid=71874) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 16:24:36 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:24:36 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:24:36 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5f55e53-1f68-40c5-879e-f683ddd925e5]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:24:36 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-d986a610-3be9-4a51-84ad-3551814c3017 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71874) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 16:24:36 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:24:36 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.055s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:24:36 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[870b3b13-919a-4864-80a0-31396879dd8a]: (4, ('1', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:24:36 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-d986a610-3be9-4a51-84ad-3551814c3017 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71874) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 16:24:36 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-d986a610-3be9-4a51-84ad-3551814c3017 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] SCSI volumes sdc have been removed. {{(pid=71874) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 16:24:36 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-d986a610-3be9-4a51-84ad-3551814c3017 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:080c2e7c-0047-4794-90a2-ab4835def5de')] {{(pid=71874) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 16:24:36 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:080c2e7c-0047-4794-90a2-ab4835def5de -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:24:36 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:080c2e7c-0047-4794-90a2-ab4835def5de -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:24:36 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d6b0fe4-fdc2-427c-a225-bcb0c399fdde]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:24:36 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-d986a610-3be9-4a51-84ad-3551814c3017 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:24:36 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:080c2e7c-0047-4794-90a2-ab4835def5de -p 172.16.0.220:3260 --logout {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:24:36 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:080c2e7c-0047-4794-90a2-ab4835def5de -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:24:36 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[b60b4d1a-3dbe-40d3-85b4-56865db83e45]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:080c2e7c-0047-4794-90a2-ab4835def5de, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:080c2e7c-0047-4794-90a2-ab4835def5de, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:24:36 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-d986a610-3be9-4a51-84ad-3551814c3017 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:080c2e7c-0047-4794-90a2-ab4835def5de, portal: 172.16.0.220,3260]
Apr 12 16:24:36 user nova-compute[71874]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:080c2e7c-0047-4794-90a2-ab4835def5de, portal: 172.16.0.220,3260] successful.
Apr 12 16:24:36 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:24:36 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:080c2e7c-0047-4794-90a2-ab4835def5de -p 172.16.0.220:3260 --op delete {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:24:36 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:080c2e7c-0047-4794-90a2-ab4835def5de -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:24:36 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[57bce6c3-f049-4078-b61f-187cef03f7cc]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:24:36 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-d986a610-3be9-4a51-84ad-3551814c3017 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:24:36 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-d986a610-3be9-4a51-84ad-3551814c3017 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.306s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:24:36 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-d986a610-3be9-4a51-84ad-3551814c3017 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] <== disconnect_volume: return (307ms) None {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:24:36 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d986a610-3be9-4a51-84ad-3551814c3017 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] [instance: 0ef81d71-afb0-4335-b60f-13071b957d08] Disconnected iSCSI Volume {{(pid=71874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 16:24:37 user nova-compute[71874]: DEBUG nova.objects.instance [None req-d986a610-3be9-4a51-84ad-3551814c3017 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Lazy-loading 'flavor' on Instance uuid 0ef81d71-afb0-4335-b60f-13071b957d08 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:24:37 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d986a610-3be9-4a51-84ad-3551814c3017 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Lock "0ef81d71-afb0-4335-b60f-13071b957d08" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.646s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:24:37 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-f7f02e6f-b863-4034-8ea8-d0fe50364f4d tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Lock "0ef81d71-afb0-4335-b60f-13071b957d08" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.536s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:24:37 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-f7f02e6f-b863-4034-8ea8-d0fe50364f4d tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Acquiring lock "0ef81d71-afb0-4335-b60f-13071b957d08-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:24:37 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-f7f02e6f-b863-4034-8ea8-d0fe50364f4d tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Lock "0ef81d71-afb0-4335-b60f-13071b957d08-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:24:37 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-f7f02e6f-b863-4034-8ea8-d0fe50364f4d tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Lock "0ef81d71-afb0-4335-b60f-13071b957d08-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:24:37 user nova-compute[71874]: INFO nova.compute.manager [None req-f7f02e6f-b863-4034-8ea8-d0fe50364f4d tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] [instance: 0ef81d71-afb0-4335-b60f-13071b957d08] Terminating instance
Apr 12 16:24:37 user nova-compute[71874]: DEBUG nova.compute.manager [None req-f7f02e6f-b863-4034-8ea8-d0fe50364f4d tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] [instance: 0ef81d71-afb0-4335-b60f-13071b957d08] Start destroying the instance on the hypervisor. {{(pid=71874) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 16:24:37 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:24:37 user nova-compute[71874]: DEBUG nova.compute.manager [req-c3a7d8cd-5aad-4dd5-b827-69d8db5a7471 req-86690e7c-b35d-42f3-8ba9-6774d37363e3 service nova] [instance: 0ef81d71-afb0-4335-b60f-13071b957d08] Received event network-vif-unplugged-cb7029cd-2b2f-4e5a-8f70-5f644a14eb24 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:24:37 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-c3a7d8cd-5aad-4dd5-b827-69d8db5a7471 req-86690e7c-b35d-42f3-8ba9-6774d37363e3 service nova] Acquiring lock "0ef81d71-afb0-4335-b60f-13071b957d08-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:24:37 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-c3a7d8cd-5aad-4dd5-b827-69d8db5a7471 req-86690e7c-b35d-42f3-8ba9-6774d37363e3 service nova] Lock "0ef81d71-afb0-4335-b60f-13071b957d08-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:24:37 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-c3a7d8cd-5aad-4dd5-b827-69d8db5a7471 req-86690e7c-b35d-42f3-8ba9-6774d37363e3 service nova] Lock "0ef81d71-afb0-4335-b60f-13071b957d08-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:24:37 user nova-compute[71874]: DEBUG nova.compute.manager [req-c3a7d8cd-5aad-4dd5-b827-69d8db5a7471 req-86690e7c-b35d-42f3-8ba9-6774d37363e3 service nova] [instance: 0ef81d71-afb0-4335-b60f-13071b957d08] No waiting events found dispatching network-vif-unplugged-cb7029cd-2b2f-4e5a-8f70-5f644a14eb24 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:24:37 user nova-compute[71874]: DEBUG nova.compute.manager [req-c3a7d8cd-5aad-4dd5-b827-69d8db5a7471 req-86690e7c-b35d-42f3-8ba9-6774d37363e3 service nova] [instance: 0ef81d71-afb0-4335-b60f-13071b957d08] Received event network-vif-unplugged-cb7029cd-2b2f-4e5a-8f70-5f644a14eb24 for instance with task_state deleting. {{(pid=71874) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 16:24:37 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:24:37 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:24:38 user nova-compute[71874]: INFO nova.virt.libvirt.driver [-] [instance: 0ef81d71-afb0-4335-b60f-13071b957d08] Instance destroyed successfully.
Apr 12 16:24:38 user nova-compute[71874]: DEBUG nova.objects.instance [None req-f7f02e6f-b863-4034-8ea8-d0fe50364f4d tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Lazy-loading 'resources' on Instance uuid 0ef81d71-afb0-4335-b60f-13071b957d08 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:24:38 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-f7f02e6f-b863-4034-8ea8-d0fe50364f4d tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T16:22:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-2079897140',display_name='tempest-VolumesSnapshotTestJSON-instance-2079897140',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-2079897140',id=42,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T16:22:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c91ef8cd37154632a031592cdc6792aa',ramdisk_id='',reservation_id='r-ppo9jtda',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1094479403',owner_user_name='tempest-VolumesSnapshotTestJSON-1094479403-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T16:22:28Z,user_data=None,user_id='c9173175144449a391d282ba8978c9d9',uuid=0ef81d71-afb0-4335-b60f-13071b957d08,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cb7029cd-2b2f-4e5a-8f70-5f644a14eb24", "address": "fa:16:3e:68:3a:b3", "network": {"id": "8a87df1a-24b8-499e-a908-0d1fa99ed69a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-824466532-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "c91ef8cd37154632a031592cdc6792aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb7029cd-2b", "ovs_interfaceid": "cb7029cd-2b2f-4e5a-8f70-5f644a14eb24", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 16:24:38 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-f7f02e6f-b863-4034-8ea8-d0fe50364f4d tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Converting VIF {"id": "cb7029cd-2b2f-4e5a-8f70-5f644a14eb24", "address": "fa:16:3e:68:3a:b3", "network": {"id": "8a87df1a-24b8-499e-a908-0d1fa99ed69a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-824466532-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "c91ef8cd37154632a031592cdc6792aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb7029cd-2b", "ovs_interfaceid": "cb7029cd-2b2f-4e5a-8f70-5f644a14eb24", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:24:38 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-f7f02e6f-b863-4034-8ea8-d0fe50364f4d tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:68:3a:b3,bridge_name='br-int',has_traffic_filtering=True,id=cb7029cd-2b2f-4e5a-8f70-5f644a14eb24,network=Network(8a87df1a-24b8-499e-a908-0d1fa99ed69a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb7029cd-2b') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:24:38 user nova-compute[71874]: DEBUG os_vif [None req-f7f02e6f-b863-4034-8ea8-d0fe50364f4d tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:68:3a:b3,bridge_name='br-int',has_traffic_filtering=True,id=cb7029cd-2b2f-4e5a-8f70-5f644a14eb24,network=Network(8a87df1a-24b8-499e-a908-0d1fa99ed69a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb7029cd-2b') {{(pid=71874) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 16:24:38 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:24:38 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcb7029cd-2b, bridge=br-int, if_exists=True) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:24:38 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:24:38 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:24:38 user nova-compute[71874]: INFO os_vif [None req-f7f02e6f-b863-4034-8ea8-d0fe50364f4d tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:68:3a:b3,bridge_name='br-int',has_traffic_filtering=True,id=cb7029cd-2b2f-4e5a-8f70-5f644a14eb24,network=Network(8a87df1a-24b8-499e-a908-0d1fa99ed69a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb7029cd-2b')
Apr 12 16:24:38 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7f02e6f-b863-4034-8ea8-d0fe50364f4d tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] [instance: 0ef81d71-afb0-4335-b60f-13071b957d08] calling os-brick to detach iSCSI Volume {{(pid=71874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 16:24:38 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7f02e6f-b863-4034-8ea8-d0fe50364f4d tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3c0216320>, {'target_iqn': 'iqn.2010-10.org.openstack:080c2e7c-0047-4794-90a2-ab4835def5de', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gAqupKDz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:24:38 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-f7f02e6f-b863-4034-8ea8-d0fe50364f4d tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:24:38 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-f7f02e6f-b863-4034-8ea8-d0fe50364f4d tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:24:38 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-f7f02e6f-b863-4034-8ea8-d0fe50364f4d tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:24:38 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:24:38 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:24:38 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[4136b912-60f5-4359-9437-088f6ddcb23a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:24:38 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7f02e6f-b863-4034-8ea8-d0fe50364f4d tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 16:24:38 user nova-compute[71874]: No targets found.
Apr 12 16:24:38 user nova-compute[71874]: iSNS:
Apr 12 16:24:38 user nova-compute[71874]: No targets found.
Apr 12 16:24:38 user nova-compute[71874]: STATIC:
Apr 12 16:24:38 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909
Apr 12 16:24:38 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:24:38 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:24:38 user nova-compute[71874]: FIRMWARE:
Apr 12 16:24:38 user nova-compute[71874]: No targets found.
Apr 12 16:24:38 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:24:38 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7f02e6f-b863-4034-8ea8-d0fe50364f4d tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 16:24:38 user nova-compute[71874]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 16:24:38 user nova-compute[71874]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71874) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 16:24:38 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7f02e6f-b863-4034-8ea8-d0fe50364f4d tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:080c2e7c-0047-4794-90a2-ab4835def5de', 0)] {{(pid=71874) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 16:24:38 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:24:38 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:24:38 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6c11ec7-4f13-43ce-aa5a-5e8a042acd08]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:24:38 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:24:38 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:24:38 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b241c0a-0256-414e-a3f3-0ea877432477]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909 (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:24:38 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7f02e6f-b863-4034-8ea8-d0fe50364f4d tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909 (non-flash)
Apr 12 16:24:38 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:24:38 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7f02e6f-b863-4034-8ea8-d0fe50364f4d tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909 (non-flash)
Apr 12 16:24:38 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:24:38 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7f02e6f-b863-4034-8ea8-d0fe50364f4d tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc3c01c0f70>, {}) {{(pid=71874) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 16:24:38 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7f02e6f-b863-4034-8ea8-d0fe50364f4d tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Disconnecting from: [] {{(pid=71874) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 16:24:38 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-f7f02e6f-b863-4034-8ea8-d0fe50364f4d tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.066s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:24:38 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7f02e6f-b863-4034-8ea8-d0fe50364f4d tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] <== disconnect_volume: return (67ms) None {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:24:38 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7f02e6f-b863-4034-8ea8-d0fe50364f4d tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] [instance: 0ef81d71-afb0-4335-b60f-13071b957d08] Disconnected iSCSI Volume {{(pid=71874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 16:24:38 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-f7f02e6f-b863-4034-8ea8-d0fe50364f4d tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] [instance: 0ef81d71-afb0-4335-b60f-13071b957d08] Deleting instance files /opt/stack/data/nova/instances/0ef81d71-afb0-4335-b60f-13071b957d08_del
Apr 12 16:24:38 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-f7f02e6f-b863-4034-8ea8-d0fe50364f4d tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] [instance: 0ef81d71-afb0-4335-b60f-13071b957d08] Deletion of /opt/stack/data/nova/instances/0ef81d71-afb0-4335-b60f-13071b957d08_del complete
Apr 12 16:24:38 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:24:38 user nova-compute[71874]: INFO nova.compute.manager [None req-f7f02e6f-b863-4034-8ea8-d0fe50364f4d tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] [instance: 0ef81d71-afb0-4335-b60f-13071b957d08] Took 1.10 seconds to destroy the instance on the hypervisor.
Apr 12 16:24:38 user nova-compute[71874]: DEBUG oslo.service.loopingcall [None req-f7f02e6f-b863-4034-8ea8-d0fe50364f4d tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71874) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 16:24:38 user nova-compute[71874]: DEBUG nova.compute.manager [-] [instance: 0ef81d71-afb0-4335-b60f-13071b957d08] Deallocating network for instance {{(pid=71874) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 16:24:38 user nova-compute[71874]: DEBUG nova.network.neutron [-] [instance: 0ef81d71-afb0-4335-b60f-13071b957d08] deallocate_for_instance() {{(pid=71874) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 16:24:39 user nova-compute[71874]: DEBUG nova.network.neutron [-] [instance: 0ef81d71-afb0-4335-b60f-13071b957d08] Updating instance_info_cache with network_info: [] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:24:39 user nova-compute[71874]: INFO nova.compute.manager [-] [instance: 0ef81d71-afb0-4335-b60f-13071b957d08] Took 0.48 seconds to deallocate network for instance.
Apr 12 16:24:39 user nova-compute[71874]: WARNING nova.volume.cinder [None req-f7f02e6f-b863-4034-8ea8-d0fe50364f4d tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Attachment 0e2b4b8c-8ff5-4b0f-961c-252419d566eb does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 0e2b4b8c-8ff5-4b0f-961c-252419d566eb. (HTTP 404) (Request-ID: req-f309020f-9877-4781-a2ba-aa911202a5c7)
Apr 12 16:24:39 user nova-compute[71874]: INFO nova.compute.manager [None req-f7f02e6f-b863-4034-8ea8-d0fe50364f4d tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] [instance: 0ef81d71-afb0-4335-b60f-13071b957d08] Took 0.02 seconds to detach 1 volumes for instance.
Apr 12 16:24:39 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-f7f02e6f-b863-4034-8ea8-d0fe50364f4d tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:24:39 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-f7f02e6f-b863-4034-8ea8-d0fe50364f4d tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:24:39 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-f7f02e6f-b863-4034-8ea8-d0fe50364f4d tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Inventory has not changed in ProviderTree for provider: 0e94b4c8-cd49-45e4-9133-d36eb4b2456b {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 16:24:39 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-f7f02e6f-b863-4034-8ea8-d0fe50364f4d tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Inventory has not changed for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 16:24:39 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-f7f02e6f-b863-4034-8ea8-d0fe50364f4d tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.159s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:24:39 user nova-compute[71874]: INFO nova.scheduler.client.report [None req-f7f02e6f-b863-4034-8ea8-d0fe50364f4d tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Deleted allocations for instance 0ef81d71-afb0-4335-b60f-13071b957d08
Apr 12 16:24:39 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-f7f02e6f-b863-4034-8ea8-d0fe50364f4d tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Lock "0ef81d71-afb0-4335-b60f-13071b957d08" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.941s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:24:39 user nova-compute[71874]: DEBUG nova.compute.manager [req-f809096e-c322-4104-b0d4-558d58200fa1 req-44d3b807-ae27-4b7b-8f56-8dad6169feda service nova] [instance: 0ef81d71-afb0-4335-b60f-13071b957d08] Received event network-vif-plugged-cb7029cd-2b2f-4e5a-8f70-5f644a14eb24 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:24:39 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-f809096e-c322-4104-b0d4-558d58200fa1 req-44d3b807-ae27-4b7b-8f56-8dad6169feda service nova] Acquiring lock "0ef81d71-afb0-4335-b60f-13071b957d08-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:24:39 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-f809096e-c322-4104-b0d4-558d58200fa1 req-44d3b807-ae27-4b7b-8f56-8dad6169feda service nova] Lock "0ef81d71-afb0-4335-b60f-13071b957d08-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:24:39 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-f809096e-c322-4104-b0d4-558d58200fa1 req-44d3b807-ae27-4b7b-8f56-8dad6169feda service nova] Lock "0ef81d71-afb0-4335-b60f-13071b957d08-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:24:39 user nova-compute[71874]: DEBUG nova.compute.manager [req-f809096e-c322-4104-b0d4-558d58200fa1 req-44d3b807-ae27-4b7b-8f56-8dad6169feda service nova] [instance: 0ef81d71-afb0-4335-b60f-13071b957d08] No waiting events found dispatching network-vif-plugged-cb7029cd-2b2f-4e5a-8f70-5f644a14eb24 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:24:39 user nova-compute[71874]: WARNING nova.compute.manager [req-f809096e-c322-4104-b0d4-558d58200fa1 req-44d3b807-ae27-4b7b-8f56-8dad6169feda service nova] [instance: 0ef81d71-afb0-4335-b60f-13071b957d08] Received unexpected event network-vif-plugged-cb7029cd-2b2f-4e5a-8f70-5f644a14eb24 for instance with vm_state deleted and task_state None.
Apr 12 16:24:39 user nova-compute[71874]: DEBUG nova.compute.manager [req-f809096e-c322-4104-b0d4-558d58200fa1 req-44d3b807-ae27-4b7b-8f56-8dad6169feda service nova] [instance: 0ef81d71-afb0-4335-b60f-13071b957d08] Received event network-vif-deleted-cb7029cd-2b2f-4e5a-8f70-5f644a14eb24 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:24:39 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:24:39 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Starting heal instance info cache {{(pid=71874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 16:24:39 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Rebuilding the list of instances to heal {{(pid=71874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 16:24:40 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquiring lock "refresh_cache-d9a374be-4852-45e3-b346-79a08b60f981" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:24:40 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquired lock "refresh_cache-d9a374be-4852-45e3-b346-79a08b60f981" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:24:40 user nova-compute[71874]: DEBUG nova.network.neutron [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] [instance: d9a374be-4852-45e3-b346-79a08b60f981] Forcefully refreshing network info cache for instance {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 16:24:40 user nova-compute[71874]: DEBUG nova.objects.instance [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lazy-loading 'info_cache' on Instance uuid d9a374be-4852-45e3-b346-79a08b60f981 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:24:40 user nova-compute[71874]: DEBUG nova.network.neutron [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] [instance: d9a374be-4852-45e3-b346-79a08b60f981] Updating instance_info_cache with network_info: [{"id": "aeffb3da-3b3c-40c0-bca4-ee483aa11e39", "address": "fa:16:3e:05:c5:b7", "network": {"id": "1439244b-8287-4bba-a88c-99d4b498cccd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1491302639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29b1b89a5eeb408a8d0938e5f59f405f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaeffb3da-3b", "ovs_interfaceid": "aeffb3da-3b3c-40c0-bca4-ee483aa11e39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:24:40 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Releasing lock "refresh_cache-d9a374be-4852-45e3-b346-79a08b60f981" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:24:40 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] [instance: d9a374be-4852-45e3-b346-79a08b60f981] Updated the network info_cache for instance {{(pid=71874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 16:24:41 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:24:41 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:24:41 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:24:41 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71874) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 16:24:43 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:24:48 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:24:48 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:24:53 user nova-compute[71874]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681316678.4112132, 0ef81d71-afb0-4335-b60f-13071b957d08 => Stopped> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:24:53 user nova-compute[71874]: INFO nova.compute.manager [-] [instance: 0ef81d71-afb0-4335-b60f-13071b957d08] VM Stopped (Lifecycle Event)
Apr 12 16:24:53 user nova-compute[71874]: DEBUG nova.compute.manager [None req-edd1f36c-34dc-4758-a96f-83249e757172 None None] [instance: 0ef81d71-afb0-4335-b60f-13071b957d08] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:24:53 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:24:58 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:25:03 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:25:03 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:25:08 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:25:13 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:25:13 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:25:13 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71874) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 16:25:13 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71874) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 16:25:13 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71874) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 16:25:13 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:25:18 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:25:18 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:25:23 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:25:23 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:25:28 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:25:30 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:25:30 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71874) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 12 16:25:31 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:25:31 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:25:31 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:25:31 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:25:31 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Auditing locally available compute resources for user (node: user) {{(pid=71874) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 16:25:31 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 16:25:31 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b40e07a-eb45-4fe7-9f98-dc718231a4a4/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:25:32 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b40e07a-eb45-4fe7-9f98-dc718231a4a4/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:25:32 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b40e07a-eb45-4fe7-9f98-dc718231a4a4/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:25:32 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b40e07a-eb45-4fe7-9f98-dc718231a4a4/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:25:32 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:25:32 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:25:32 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Hypervisor/Node resource view: name=user free_ram=8542MB free_disk=25.949249267578125GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71874) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 16:25:32 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:25:32 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:25:32 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance d9a374be-4852-45e3-b346-79a08b60f981 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:25:32 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 6b40e07a-eb45-4fe7-9f98-dc718231a4a4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:25:32 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=71874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 16:25:32 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=71874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 16:25:32 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Inventory has not changed in ProviderTree for provider: 0e94b4c8-cd49-45e4-9133-d36eb4b2456b {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 16:25:32 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Inventory has not changed for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 16:25:32 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Compute_service record updated for user:user {{(pid=71874) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 16:25:32 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.232s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:25:32 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:25:32 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Cleaning up deleted instances {{(pid=71874) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 12 16:25:32 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] There are 0 instances to clean {{(pid=71874) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 12 16:25:33 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:25:33 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:25:35 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:25:35 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:25:36 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-5a76f749-57af-4db3-9ae5-871fa3beb8a6 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Acquiring lock "f31d2b1b-afbe-4fef-9ee4-f003842d5237" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:25:36 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-5a76f749-57af-4db3-9ae5-871fa3beb8a6 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Lock "f31d2b1b-afbe-4fef-9ee4-f003842d5237" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:25:36 user nova-compute[71874]: DEBUG nova.compute.manager [None req-5a76f749-57af-4db3-9ae5-871fa3beb8a6 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] [instance: f31d2b1b-afbe-4fef-9ee4-f003842d5237] Starting instance... {{(pid=71874) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 16:25:36 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-5a76f749-57af-4db3-9ae5-871fa3beb8a6 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:25:36 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-5a76f749-57af-4db3-9ae5-871fa3beb8a6 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:25:36 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-5a76f749-57af-4db3-9ae5-871fa3beb8a6 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71874) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 16:25:36 user nova-compute[71874]: INFO nova.compute.claims [None req-5a76f749-57af-4db3-9ae5-871fa3beb8a6 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] [instance: f31d2b1b-afbe-4fef-9ee4-f003842d5237] Claim successful on node user
Apr 12 16:25:36 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-5a76f749-57af-4db3-9ae5-871fa3beb8a6 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Inventory has not changed in ProviderTree for provider: 0e94b4c8-cd49-45e4-9133-d36eb4b2456b {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 16:25:36 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-5a76f749-57af-4db3-9ae5-871fa3beb8a6 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Inventory has not changed for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 16:25:36 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-5a76f749-57af-4db3-9ae5-871fa3beb8a6 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.242s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:25:36 user nova-compute[71874]: DEBUG nova.compute.manager [None req-5a76f749-57af-4db3-9ae5-871fa3beb8a6 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] [instance: f31d2b1b-afbe-4fef-9ee4-f003842d5237] Start building networks asynchronously for instance. {{(pid=71874) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 16:25:37 user nova-compute[71874]: DEBUG nova.compute.manager [None req-5a76f749-57af-4db3-9ae5-871fa3beb8a6 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] [instance: f31d2b1b-afbe-4fef-9ee4-f003842d5237] Allocating IP information in the background. {{(pid=71874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 16:25:37 user nova-compute[71874]: DEBUG nova.network.neutron [None req-5a76f749-57af-4db3-9ae5-871fa3beb8a6 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] [instance: f31d2b1b-afbe-4fef-9ee4-f003842d5237] allocate_for_instance() {{(pid=71874) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 16:25:37 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-5a76f749-57af-4db3-9ae5-871fa3beb8a6 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] [instance: f31d2b1b-afbe-4fef-9ee4-f003842d5237] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 16:25:37 user nova-compute[71874]: DEBUG nova.compute.manager [None req-5a76f749-57af-4db3-9ae5-871fa3beb8a6 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] [instance: f31d2b1b-afbe-4fef-9ee4-f003842d5237] Start building block device mappings for instance. {{(pid=71874) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 16:25:37 user nova-compute[71874]: DEBUG nova.policy [None req-5a76f749-57af-4db3-9ae5-871fa3beb8a6 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c9173175144449a391d282ba8978c9d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91ef8cd37154632a031592cdc6792aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71874) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 16:25:37 user nova-compute[71874]: DEBUG nova.compute.manager [None req-5a76f749-57af-4db3-9ae5-871fa3beb8a6 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] [instance: f31d2b1b-afbe-4fef-9ee4-f003842d5237] Start spawning the instance on the hypervisor. {{(pid=71874) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 16:25:37 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-5a76f749-57af-4db3-9ae5-871fa3beb8a6 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] [instance: f31d2b1b-afbe-4fef-9ee4-f003842d5237] Creating instance directory {{(pid=71874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 16:25:37 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-5a76f749-57af-4db3-9ae5-871fa3beb8a6 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] [instance: f31d2b1b-afbe-4fef-9ee4-f003842d5237] Creating image(s)
Apr 12 16:25:37 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-5a76f749-57af-4db3-9ae5-871fa3beb8a6 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Acquiring lock "/opt/stack/data/nova/instances/f31d2b1b-afbe-4fef-9ee4-f003842d5237/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:25:37 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-5a76f749-57af-4db3-9ae5-871fa3beb8a6 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Lock "/opt/stack/data/nova/instances/f31d2b1b-afbe-4fef-9ee4-f003842d5237/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:25:37 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-5a76f749-57af-4db3-9ae5-871fa3beb8a6 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Lock "/opt/stack/data/nova/instances/f31d2b1b-afbe-4fef-9ee4-f003842d5237/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:25:37 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-5a76f749-57af-4db3-9ae5-871fa3beb8a6 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:25:37 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-5a76f749-57af-4db3-9ae5-871fa3beb8a6 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json" returned: 0 in 0.130s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:25:37 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-5a76f749-57af-4db3-9ae5-871fa3beb8a6 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Acquiring lock "b88df1b37cb431f52bc53b5616015c89b5bec411" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:25:37 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-5a76f749-57af-4db3-9ae5-871fa3beb8a6 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Lock "b88df1b37cb431f52bc53b5616015c89b5bec411" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:25:37 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-5a76f749-57af-4db3-9ae5-871fa3beb8a6 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:25:37 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-5a76f749-57af-4db3-9ae5-871fa3beb8a6 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json" returned: 0 in 0.150s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:25:37 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-5a76f749-57af-4db3-9ae5-871fa3beb8a6 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411,backing_fmt=raw /opt/stack/data/nova/instances/f31d2b1b-afbe-4fef-9ee4-f003842d5237/disk 1073741824 {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:25:37 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-5a76f749-57af-4db3-9ae5-871fa3beb8a6 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411,backing_fmt=raw /opt/stack/data/nova/instances/f31d2b1b-afbe-4fef-9ee4-f003842d5237/disk 1073741824" returned: 0 in 0.049s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:25:37 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-5a76f749-57af-4db3-9ae5-871fa3beb8a6 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Lock "b88df1b37cb431f52bc53b5616015c89b5bec411" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.206s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:25:37 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-5a76f749-57af-4db3-9ae5-871fa3beb8a6 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:25:37 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-5a76f749-57af-4db3-9ae5-871fa3beb8a6 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b88df1b37cb431f52bc53b5616015c89b5bec411 --force-share --output=json" returned: 0 in 0.153s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:25:37 user nova-compute[71874]: DEBUG nova.virt.disk.api [None req-5a76f749-57af-4db3-9ae5-871fa3beb8a6 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f31d2b1b-afbe-4fef-9ee4-f003842d5237/disk. size=1073741824 {{(pid=71874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 16:25:37 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-5a76f749-57af-4db3-9ae5-871fa3beb8a6 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f31d2b1b-afbe-4fef-9ee4-f003842d5237/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:25:37 user nova-compute[71874]: DEBUG nova.network.neutron [None req-5a76f749-57af-4db3-9ae5-871fa3beb8a6 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] [instance: f31d2b1b-afbe-4fef-9ee4-f003842d5237] Successfully created port: ce90db7b-5efd-411b-a2f8-b7484a527704 {{(pid=71874) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 16:25:37 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-5a76f749-57af-4db3-9ae5-871fa3beb8a6 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f31d2b1b-afbe-4fef-9ee4-f003842d5237/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:25:37 user nova-compute[71874]: DEBUG nova.virt.disk.api [None req-5a76f749-57af-4db3-9ae5-871fa3beb8a6 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Cannot resize image /opt/stack/data/nova/instances/f31d2b1b-afbe-4fef-9ee4-f003842d5237/disk to a smaller size. {{(pid=71874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 16:25:37 user nova-compute[71874]: DEBUG nova.objects.instance [None req-5a76f749-57af-4db3-9ae5-871fa3beb8a6 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Lazy-loading 'migration_context' on Instance uuid f31d2b1b-afbe-4fef-9ee4-f003842d5237 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:25:37 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:25:37 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-5a76f749-57af-4db3-9ae5-871fa3beb8a6 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] [instance: f31d2b1b-afbe-4fef-9ee4-f003842d5237] Created local disks {{(pid=71874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 16:25:37 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-5a76f749-57af-4db3-9ae5-871fa3beb8a6 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] [instance: f31d2b1b-afbe-4fef-9ee4-f003842d5237] Ensure instance console log exists: /opt/stack/data/nova/instances/f31d2b1b-afbe-4fef-9ee4-f003842d5237/console.log {{(pid=71874) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 16:25:37 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-5a76f749-57af-4db3-9ae5-871fa3beb8a6 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:25:37 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-5a76f749-57af-4db3-9ae5-871fa3beb8a6 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:25:37 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-5a76f749-57af-4db3-9ae5-871fa3beb8a6 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:25:38 user nova-compute[71874]: DEBUG nova.network.neutron [None req-5a76f749-57af-4db3-9ae5-871fa3beb8a6 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] [instance: f31d2b1b-afbe-4fef-9ee4-f003842d5237] Successfully updated port: ce90db7b-5efd-411b-a2f8-b7484a527704 {{(pid=71874) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 16:25:38 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-5a76f749-57af-4db3-9ae5-871fa3beb8a6 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Acquiring lock "refresh_cache-f31d2b1b-afbe-4fef-9ee4-f003842d5237" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:25:38 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-5a76f749-57af-4db3-9ae5-871fa3beb8a6 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Acquired lock "refresh_cache-f31d2b1b-afbe-4fef-9ee4-f003842d5237" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:25:38 user nova-compute[71874]: DEBUG nova.network.neutron [None req-5a76f749-57af-4db3-9ae5-871fa3beb8a6 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] [instance: f31d2b1b-afbe-4fef-9ee4-f003842d5237] Building network info cache for instance {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 16:25:38 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:25:38 user nova-compute[71874]: DEBUG nova.compute.manager [req-d85673a8-3cef-409c-a5de-1d6e832273dd req-731a019d-95ba-44ce-a03d-b354c6847882 service nova] [instance: f31d2b1b-afbe-4fef-9ee4-f003842d5237] Received event network-changed-ce90db7b-5efd-411b-a2f8-b7484a527704 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:25:38 user nova-compute[71874]: DEBUG nova.compute.manager [req-d85673a8-3cef-409c-a5de-1d6e832273dd req-731a019d-95ba-44ce-a03d-b354c6847882 service nova] [instance: f31d2b1b-afbe-4fef-9ee4-f003842d5237] Refreshing instance network info cache due to event network-changed-ce90db7b-5efd-411b-a2f8-b7484a527704. {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 16:25:38 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-d85673a8-3cef-409c-a5de-1d6e832273dd req-731a019d-95ba-44ce-a03d-b354c6847882 service nova] Acquiring lock "refresh_cache-f31d2b1b-afbe-4fef-9ee4-f003842d5237" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:25:38 user nova-compute[71874]: DEBUG nova.network.neutron [None req-5a76f749-57af-4db3-9ae5-871fa3beb8a6 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] [instance: f31d2b1b-afbe-4fef-9ee4-f003842d5237] Instance cache missing network info. {{(pid=71874) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 16:25:38 user nova-compute[71874]: DEBUG nova.network.neutron [None req-5a76f749-57af-4db3-9ae5-871fa3beb8a6 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] [instance: f31d2b1b-afbe-4fef-9ee4-f003842d5237] Updating instance_info_cache with network_info: [{"id": "ce90db7b-5efd-411b-a2f8-b7484a527704", "address": "fa:16:3e:e8:0f:22", "network": {"id": "8a87df1a-24b8-499e-a908-0d1fa99ed69a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-824466532-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "c91ef8cd37154632a031592cdc6792aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce90db7b-5e", "ovs_interfaceid": "ce90db7b-5efd-411b-a2f8-b7484a527704", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:25:38 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-5a76f749-57af-4db3-9ae5-871fa3beb8a6 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Releasing lock "refresh_cache-f31d2b1b-afbe-4fef-9ee4-f003842d5237" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:25:38 user nova-compute[71874]: DEBUG nova.compute.manager [None req-5a76f749-57af-4db3-9ae5-871fa3beb8a6 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] [instance: f31d2b1b-afbe-4fef-9ee4-f003842d5237] Instance network_info: |[{"id": "ce90db7b-5efd-411b-a2f8-b7484a527704", "address": "fa:16:3e:e8:0f:22", "network": {"id": "8a87df1a-24b8-499e-a908-0d1fa99ed69a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-824466532-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "c91ef8cd37154632a031592cdc6792aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce90db7b-5e", "ovs_interfaceid": "ce90db7b-5efd-411b-a2f8-b7484a527704", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 16:25:38 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:25:38 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-d85673a8-3cef-409c-a5de-1d6e832273dd req-731a019d-95ba-44ce-a03d-b354c6847882 service nova] Acquired lock "refresh_cache-f31d2b1b-afbe-4fef-9ee4-f003842d5237" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:25:38 user nova-compute[71874]: DEBUG nova.network.neutron [req-d85673a8-3cef-409c-a5de-1d6e832273dd req-731a019d-95ba-44ce-a03d-b354c6847882 service nova] [instance: f31d2b1b-afbe-4fef-9ee4-f003842d5237] Refreshing network info cache for port ce90db7b-5efd-411b-a2f8-b7484a527704 {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 16:25:38 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-5a76f749-57af-4db3-9ae5-871fa3beb8a6 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] [instance: f31d2b1b-afbe-4fef-9ee4-f003842d5237] Start _get_guest_xml network_info=[{"id": "ce90db7b-5efd-411b-a2f8-b7484a527704", "address": "fa:16:3e:e8:0f:22", "network": {"id": "8a87df1a-24b8-499e-a908-0d1fa99ed69a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-824466532-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "c91ef8cd37154632a031592cdc6792aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce90db7b-5e", "ovs_interfaceid": "ce90db7b-5efd-411b-a2f8-b7484a527704", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T15:55:37Z,direct_url=<?>,disk_format='qcow2',id=9dc63f14-8b70-4e72-89f2-13464f2f5c7c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='61a4936d9b7744c0b488d81c9b7746b6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T15:55:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_options': None, 'image_id': '9dc63f14-8b70-4e72-89f2-13464f2f5c7c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 16:25:38 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:25:38 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-5a76f749-57af-4db3-9ae5-871fa3beb8a6 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:25:38 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-5a76f749-57af-4db3-9ae5-871fa3beb8a6 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:25:38 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-5a76f749-57af-4db3-9ae5-871fa3beb8a6 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71874) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 16:25:38 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-5a76f749-57af-4db3-9ae5-871fa3beb8a6 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T15:56:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T15:55:37Z,direct_url=<?>,disk_format='qcow2',id=9dc63f14-8b70-4e72-89f2-13464f2f5c7c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='61a4936d9b7744c0b488d81c9b7746b6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T15:55:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 16:25:38 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-5a76f749-57af-4db3-9ae5-871fa3beb8a6 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Flavor limits 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 16:25:38 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-5a76f749-57af-4db3-9ae5-871fa3beb8a6 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Image limits 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 16:25:38 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-5a76f749-57af-4db3-9ae5-871fa3beb8a6 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Flavor pref 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 16:25:38 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-5a76f749-57af-4db3-9ae5-871fa3beb8a6 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Image pref 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 16:25:38 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-5a76f749-57af-4db3-9ae5-871fa3beb8a6 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 16:25:38 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-5a76f749-57af-4db3-9ae5-871fa3beb8a6 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 16:25:38 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-5a76f749-57af-4db3-9ae5-871fa3beb8a6 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 16:25:38 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-5a76f749-57af-4db3-9ae5-871fa3beb8a6 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Got 1 possible topologies {{(pid=71874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 16:25:38 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-5a76f749-57af-4db3-9ae5-871fa3beb8a6 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 16:25:38 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-5a76f749-57af-4db3-9ae5-871fa3beb8a6 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 16:25:38 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-5a76f749-57af-4db3-9ae5-871fa3beb8a6 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T16:25:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1016540753',display_name='tempest-VolumesSnapshotTestJSON-instance-1016540753',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1016540753',id=45,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c91ef8cd37154632a031592cdc6792aa',ramdisk_id='',reservation_id='r-uv64k0jq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1094479403',owner_user_name='tempest-VolumesSnapshotTestJSON-1094479403-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T16:25:37Z,user_data=None,user_id='c9173175144449a391d282ba8978c9d9',uuid=f31d2b1b-afbe-4fef-9ee4-f003842d5237,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ce90db7b-5efd-411b-a2f8-b7484a527704", "address": "fa:16:3e:e8:0f:22", "network": {"id": "8a87df1a-24b8-499e-a908-0d1fa99ed69a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-824466532-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "c91ef8cd37154632a031592cdc6792aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce90db7b-5e", "ovs_interfaceid": "ce90db7b-5efd-411b-a2f8-b7484a527704", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 16:25:38 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-5a76f749-57af-4db3-9ae5-871fa3beb8a6 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Converting VIF {"id": "ce90db7b-5efd-411b-a2f8-b7484a527704", "address": "fa:16:3e:e8:0f:22", "network": {"id": "8a87df1a-24b8-499e-a908-0d1fa99ed69a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-824466532-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "c91ef8cd37154632a031592cdc6792aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce90db7b-5e", "ovs_interfaceid": "ce90db7b-5efd-411b-a2f8-b7484a527704", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:25:38 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-5a76f749-57af-4db3-9ae5-871fa3beb8a6 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:0f:22,bridge_name='br-int',has_traffic_filtering=True,id=ce90db7b-5efd-411b-a2f8-b7484a527704,network=Network(8a87df1a-24b8-499e-a908-0d1fa99ed69a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce90db7b-5e') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:25:38 user nova-compute[71874]: DEBUG nova.objects.instance [None req-5a76f749-57af-4db3-9ae5-871fa3beb8a6 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Lazy-loading 'pci_devices' on Instance uuid f31d2b1b-afbe-4fef-9ee4-f003842d5237 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:25:38 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-5a76f749-57af-4db3-9ae5-871fa3beb8a6 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] [instance: f31d2b1b-afbe-4fef-9ee4-f003842d5237] End _get_guest_xml xml=<domain type="kvm">
Apr 12 16:25:38 user nova-compute[71874]:   <uuid>f31d2b1b-afbe-4fef-9ee4-f003842d5237</uuid>
Apr 12 16:25:38 user nova-compute[71874]:   <name>instance-0000002d</name>
Apr 12 16:25:38 user nova-compute[71874]:   <memory>131072</memory>
Apr 12 16:25:38 user nova-compute[71874]:   <vcpu>1</vcpu>
Apr 12 16:25:38 user nova-compute[71874]:   <metadata>
Apr 12 16:25:38 user nova-compute[71874]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 16:25:38 user nova-compute[71874]:       <nova:package version="0.0.0"/>
Apr 12 16:25:38 user nova-compute[71874]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1016540753</nova:name>
Apr 12 16:25:38 user nova-compute[71874]:       <nova:creationTime>2023-04-12 16:25:38</nova:creationTime>
Apr 12 16:25:38 user nova-compute[71874]:       <nova:flavor name="m1.nano">
Apr 12 16:25:38 user nova-compute[71874]:         <nova:memory>128</nova:memory>
Apr 12 16:25:38 user nova-compute[71874]:         <nova:disk>1</nova:disk>
Apr 12 16:25:38 user nova-compute[71874]:         <nova:swap>0</nova:swap>
Apr 12 16:25:38 user nova-compute[71874]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 16:25:38 user nova-compute[71874]:         <nova:vcpus>1</nova:vcpus>
Apr 12 16:25:38 user nova-compute[71874]:       </nova:flavor>
Apr 12 16:25:38 user nova-compute[71874]:       <nova:owner>
Apr 12 16:25:38 user nova-compute[71874]:         <nova:user uuid="c9173175144449a391d282ba8978c9d9">tempest-VolumesSnapshotTestJSON-1094479403-project-member</nova:user>
Apr 12 16:25:38 user nova-compute[71874]:         <nova:project uuid="c91ef8cd37154632a031592cdc6792aa">tempest-VolumesSnapshotTestJSON-1094479403</nova:project>
Apr 12 16:25:38 user nova-compute[71874]:       </nova:owner>
Apr 12 16:25:38 user nova-compute[71874]:       <nova:root type="image" uuid="9dc63f14-8b70-4e72-89f2-13464f2f5c7c"/>
Apr 12 16:25:38 user nova-compute[71874]:       <nova:ports>
Apr 12 16:25:38 user nova-compute[71874]:         <nova:port uuid="ce90db7b-5efd-411b-a2f8-b7484a527704">
Apr 12 16:25:38 user nova-compute[71874]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 12 16:25:38 user nova-compute[71874]:         </nova:port>
Apr 12 16:25:38 user nova-compute[71874]:       </nova:ports>
Apr 12 16:25:38 user nova-compute[71874]:     </nova:instance>
Apr 12 16:25:38 user nova-compute[71874]:   </metadata>
Apr 12 16:25:38 user nova-compute[71874]:   <sysinfo type="smbios">
Apr 12 16:25:38 user nova-compute[71874]:     <system>
Apr 12 16:25:38 user nova-compute[71874]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 16:25:38 user nova-compute[71874]:       <entry name="product">OpenStack Nova</entry>
Apr 12 16:25:38 user nova-compute[71874]:       <entry name="version">0.0.0</entry>
Apr 12 16:25:38 user nova-compute[71874]:       <entry name="serial">f31d2b1b-afbe-4fef-9ee4-f003842d5237</entry>
Apr 12 16:25:38 user nova-compute[71874]:       <entry name="uuid">f31d2b1b-afbe-4fef-9ee4-f003842d5237</entry>
Apr 12 16:25:38 user nova-compute[71874]:       <entry name="family">Virtual Machine</entry>
Apr 12 16:25:38 user nova-compute[71874]:     </system>
Apr 12 16:25:38 user nova-compute[71874]:   </sysinfo>
Apr 12 16:25:38 user nova-compute[71874]:   <os>
Apr 12 16:25:38 user nova-compute[71874]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 16:25:38 user nova-compute[71874]:     <boot dev="hd"/>
Apr 12 16:25:38 user nova-compute[71874]:     <smbios mode="sysinfo"/>
Apr 12 16:25:38 user nova-compute[71874]:   </os>
Apr 12 16:25:38 user nova-compute[71874]:   <features>
Apr 12 16:25:38 user nova-compute[71874]:     <acpi/>
Apr 12 16:25:38 user nova-compute[71874]:     <apic/>
Apr 12 16:25:38 user nova-compute[71874]:     <vmcoreinfo/>
Apr 12 16:25:38 user nova-compute[71874]:   </features>
Apr 12 16:25:38 user nova-compute[71874]:   <clock offset="utc">
Apr 12 16:25:38 user nova-compute[71874]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 16:25:38 user nova-compute[71874]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 16:25:38 user nova-compute[71874]:     <timer name="hpet" present="no"/>
Apr 12 16:25:38 user nova-compute[71874]:   </clock>
Apr 12 16:25:38 user nova-compute[71874]:   <cpu mode="custom" match="exact">
Apr 12 16:25:38 user nova-compute[71874]:     <model>Nehalem</model>
Apr 12 16:25:38 user nova-compute[71874]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 16:25:38 user nova-compute[71874]:   </cpu>
Apr 12 16:25:38 user nova-compute[71874]:   <devices>
Apr 12 16:25:38 user nova-compute[71874]:     <disk type="file" device="disk">
Apr 12 16:25:38 user nova-compute[71874]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 16:25:38 user nova-compute[71874]:       <source file="/opt/stack/data/nova/instances/f31d2b1b-afbe-4fef-9ee4-f003842d5237/disk"/>
Apr 12 16:25:38 user nova-compute[71874]:       <target dev="vda" bus="virtio"/>
Apr 12 16:25:38 user nova-compute[71874]:     </disk>
Apr 12 16:25:38 user nova-compute[71874]:     <interface type="ethernet">
Apr 12 16:25:38 user nova-compute[71874]:       <mac address="fa:16:3e:e8:0f:22"/>
Apr 12 16:25:38 user nova-compute[71874]:       <model type="virtio"/>
Apr 12 16:25:38 user nova-compute[71874]:       <mtu size="1442"/>
Apr 12 16:25:38 user nova-compute[71874]:       <target dev="tapce90db7b-5e"/>
Apr 12 16:25:38 user nova-compute[71874]:     </interface>
Apr 12 16:25:38 user nova-compute[71874]:     <serial type="pty">
Apr 12 16:25:38 user nova-compute[71874]:       <log file="/opt/stack/data/nova/instances/f31d2b1b-afbe-4fef-9ee4-f003842d5237/console.log" append="off"/>
Apr 12 16:25:38 user nova-compute[71874]:     </serial>
Apr 12 16:25:38 user nova-compute[71874]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 16:25:38 user nova-compute[71874]:     <video>
Apr 12 16:25:38 user nova-compute[71874]:       <model type="virtio"/>
Apr 12 16:25:38 user nova-compute[71874]:     </video>
Apr 12 16:25:38 user nova-compute[71874]:     <rng model="virtio">
Apr 12 16:25:38 user nova-compute[71874]:       <backend model="random">/dev/urandom</backend>
Apr 12 16:25:38 user nova-compute[71874]:     </rng>
Apr 12 16:25:38 user nova-compute[71874]:     <controller type="usb" index="0" model="none"/>
Apr 12 16:25:38 user nova-compute[71874]:     <memballoon model="virtio">
Apr 12 16:25:38 user nova-compute[71874]:       <stats period="10"/>
Apr 12 16:25:38 user nova-compute[71874]:     </memballoon>
Apr 12 16:25:38 user nova-compute[71874]:   </devices>
Apr 12 16:25:38 user nova-compute[71874]: </domain>
Apr 12 16:25:38 user nova-compute[71874]:  {{(pid=71874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 16:25:38 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-5a76f749-57af-4db3-9ae5-871fa3beb8a6 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T16:25:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1016540753',display_name='tempest-VolumesSnapshotTestJSON-instance-1016540753',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1016540753',id=45,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c91ef8cd37154632a031592cdc6792aa',ramdisk_id='',reservation_id='r-uv64k0jq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1094479403',owner_user_name='tempest-VolumesSnapshotTestJSON-1094479403-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T16:25:37Z,user_data=None,user_id='c9173175144449a391d282ba8978c9d9',uuid=f31d2b1b-afbe-4fef-9ee4-f003842d5237,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ce90db7b-5efd-411b-a2f8-b7484a527704", "address": "fa:16:3e:e8:0f:22", "network": {"id": "8a87df1a-24b8-499e-a908-0d1fa99ed69a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-824466532-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "c91ef8cd37154632a031592cdc6792aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce90db7b-5e", "ovs_interfaceid": "ce90db7b-5efd-411b-a2f8-b7484a527704", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 16:25:38 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-5a76f749-57af-4db3-9ae5-871fa3beb8a6 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Converting VIF {"id": "ce90db7b-5efd-411b-a2f8-b7484a527704", "address": "fa:16:3e:e8:0f:22", "network": {"id": "8a87df1a-24b8-499e-a908-0d1fa99ed69a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-824466532-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "c91ef8cd37154632a031592cdc6792aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce90db7b-5e", "ovs_interfaceid": "ce90db7b-5efd-411b-a2f8-b7484a527704", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:25:38 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-5a76f749-57af-4db3-9ae5-871fa3beb8a6 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:0f:22,bridge_name='br-int',has_traffic_filtering=True,id=ce90db7b-5efd-411b-a2f8-b7484a527704,network=Network(8a87df1a-24b8-499e-a908-0d1fa99ed69a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce90db7b-5e') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:25:38 user nova-compute[71874]: DEBUG os_vif [None req-5a76f749-57af-4db3-9ae5-871fa3beb8a6 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:0f:22,bridge_name='br-int',has_traffic_filtering=True,id=ce90db7b-5efd-411b-a2f8-b7484a527704,network=Network(8a87df1a-24b8-499e-a908-0d1fa99ed69a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce90db7b-5e') {{(pid=71874) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 16:25:38 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:25:38 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:25:38 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 16:25:38 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:25:38 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapce90db7b-5e, may_exist=True) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:25:38 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapce90db7b-5e, col_values=(('external_ids', {'iface-id': 'ce90db7b-5efd-411b-a2f8-b7484a527704', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e8:0f:22', 'vm-uuid': 'f31d2b1b-afbe-4fef-9ee4-f003842d5237'}),)) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:25:38 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:25:38 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:25:38 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:25:38 user nova-compute[71874]: INFO os_vif [None req-5a76f749-57af-4db3-9ae5-871fa3beb8a6 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:0f:22,bridge_name='br-int',has_traffic_filtering=True,id=ce90db7b-5efd-411b-a2f8-b7484a527704,network=Network(8a87df1a-24b8-499e-a908-0d1fa99ed69a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce90db7b-5e')
Apr 12 16:25:38 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-5a76f749-57af-4db3-9ae5-871fa3beb8a6 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] No BDM found with device name vda, not building metadata. {{(pid=71874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 16:25:38 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-5a76f749-57af-4db3-9ae5-871fa3beb8a6 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] No VIF found with MAC fa:16:3e:e8:0f:22, not building metadata {{(pid=71874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 16:25:39 user nova-compute[71874]: DEBUG nova.network.neutron [req-d85673a8-3cef-409c-a5de-1d6e832273dd req-731a019d-95ba-44ce-a03d-b354c6847882 service nova] [instance: f31d2b1b-afbe-4fef-9ee4-f003842d5237] Updated VIF entry in instance network info cache for port ce90db7b-5efd-411b-a2f8-b7484a527704. {{(pid=71874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 16:25:39 user nova-compute[71874]: DEBUG nova.network.neutron [req-d85673a8-3cef-409c-a5de-1d6e832273dd req-731a019d-95ba-44ce-a03d-b354c6847882 service nova] [instance: f31d2b1b-afbe-4fef-9ee4-f003842d5237] Updating instance_info_cache with network_info: [{"id": "ce90db7b-5efd-411b-a2f8-b7484a527704", "address": "fa:16:3e:e8:0f:22", "network": {"id": "8a87df1a-24b8-499e-a908-0d1fa99ed69a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-824466532-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "c91ef8cd37154632a031592cdc6792aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce90db7b-5e", "ovs_interfaceid": "ce90db7b-5efd-411b-a2f8-b7484a527704", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:25:39 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-d85673a8-3cef-409c-a5de-1d6e832273dd req-731a019d-95ba-44ce-a03d-b354c6847882 service nova] Releasing lock "refresh_cache-f31d2b1b-afbe-4fef-9ee4-f003842d5237" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:25:40 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:25:40 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:25:40 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:25:40 user nova-compute[71874]: DEBUG nova.compute.manager [req-a9d6e3c3-9ab9-470c-b60f-45f591c1563d req-603f174e-2ea6-47e5-b9f5-3c446c565b98 service nova] [instance: f31d2b1b-afbe-4fef-9ee4-f003842d5237] Received event network-vif-plugged-ce90db7b-5efd-411b-a2f8-b7484a527704 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:25:40 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-a9d6e3c3-9ab9-470c-b60f-45f591c1563d req-603f174e-2ea6-47e5-b9f5-3c446c565b98 service nova] Acquiring lock "f31d2b1b-afbe-4fef-9ee4-f003842d5237-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:25:40 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-a9d6e3c3-9ab9-470c-b60f-45f591c1563d req-603f174e-2ea6-47e5-b9f5-3c446c565b98 service nova] Lock "f31d2b1b-afbe-4fef-9ee4-f003842d5237-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:25:40 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-a9d6e3c3-9ab9-470c-b60f-45f591c1563d req-603f174e-2ea6-47e5-b9f5-3c446c565b98 service nova] Lock "f31d2b1b-afbe-4fef-9ee4-f003842d5237-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:25:40 user nova-compute[71874]: DEBUG nova.compute.manager [req-a9d6e3c3-9ab9-470c-b60f-45f591c1563d req-603f174e-2ea6-47e5-b9f5-3c446c565b98 service nova] [instance: f31d2b1b-afbe-4fef-9ee4-f003842d5237] No waiting events found dispatching network-vif-plugged-ce90db7b-5efd-411b-a2f8-b7484a527704 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:25:40 user nova-compute[71874]: WARNING nova.compute.manager [req-a9d6e3c3-9ab9-470c-b60f-45f591c1563d req-603f174e-2ea6-47e5-b9f5-3c446c565b98 service nova] [instance: f31d2b1b-afbe-4fef-9ee4-f003842d5237] Received unexpected event network-vif-plugged-ce90db7b-5efd-411b-a2f8-b7484a527704 for instance with vm_state building and task_state spawning.
Apr 12 16:25:40 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:25:40 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Starting heal instance info cache {{(pid=71874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 16:25:41 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquiring lock "refresh_cache-6b40e07a-eb45-4fe7-9f98-dc718231a4a4" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:25:41 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquired lock "refresh_cache-6b40e07a-eb45-4fe7-9f98-dc718231a4a4" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:25:41 user nova-compute[71874]: DEBUG nova.network.neutron [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] [instance: 6b40e07a-eb45-4fe7-9f98-dc718231a4a4] Forcefully refreshing network info cache for instance {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 16:25:42 user nova-compute[71874]: DEBUG nova.network.neutron [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] [instance: 6b40e07a-eb45-4fe7-9f98-dc718231a4a4] Updating instance_info_cache with network_info: [{"id": "f4ad5837-50cf-4283-aee0-7f531fb6cee6", "address": "fa:16:3e:55:f5:c9", "network": {"id": "28cbab83-7a0f-44eb-98c5-9d1c9fb305c3", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1112763010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "5af762be84c243289780b7af16caae5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4ad5837-50", "ovs_interfaceid": "f4ad5837-50cf-4283-aee0-7f531fb6cee6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:25:42 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Releasing lock "refresh_cache-6b40e07a-eb45-4fe7-9f98-dc718231a4a4" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:25:42 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] [instance: 6b40e07a-eb45-4fe7-9f98-dc718231a4a4] Updated the network info_cache for instance {{(pid=71874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 16:25:42 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:25:42 user nova-compute[71874]: DEBUG nova.virt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Emitting event <LifecycleEvent: 1681316742.5098417, f31d2b1b-afbe-4fef-9ee4-f003842d5237 => Resumed> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:25:42 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: f31d2b1b-afbe-4fef-9ee4-f003842d5237] VM Resumed (Lifecycle Event)
Apr 12 16:25:42 user nova-compute[71874]: DEBUG nova.compute.manager [None req-5a76f749-57af-4db3-9ae5-871fa3beb8a6 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] [instance: f31d2b1b-afbe-4fef-9ee4-f003842d5237] Instance event wait completed in 0 seconds for  {{(pid=71874) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 16:25:42 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-5a76f749-57af-4db3-9ae5-871fa3beb8a6 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] [instance: f31d2b1b-afbe-4fef-9ee4-f003842d5237] Guest created on hypervisor {{(pid=71874) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 16:25:42 user nova-compute[71874]: INFO nova.virt.libvirt.driver [-] [instance: f31d2b1b-afbe-4fef-9ee4-f003842d5237] Instance spawned successfully.
Apr 12 16:25:42 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-5a76f749-57af-4db3-9ae5-871fa3beb8a6 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] [instance: f31d2b1b-afbe-4fef-9ee4-f003842d5237] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 16:25:42 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: f31d2b1b-afbe-4fef-9ee4-f003842d5237] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:25:42 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: f31d2b1b-afbe-4fef-9ee4-f003842d5237] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 16:25:42 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-5a76f749-57af-4db3-9ae5-871fa3beb8a6 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] [instance: f31d2b1b-afbe-4fef-9ee4-f003842d5237] Found default for hw_cdrom_bus of ide {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:25:42 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-5a76f749-57af-4db3-9ae5-871fa3beb8a6 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] [instance: f31d2b1b-afbe-4fef-9ee4-f003842d5237] Found default for hw_disk_bus of virtio {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:25:42 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-5a76f749-57af-4db3-9ae5-871fa3beb8a6 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] [instance: f31d2b1b-afbe-4fef-9ee4-f003842d5237] Found default for hw_input_bus of None {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:25:42 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-5a76f749-57af-4db3-9ae5-871fa3beb8a6 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] [instance: f31d2b1b-afbe-4fef-9ee4-f003842d5237] Found default for hw_pointer_model of None {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:25:42 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-5a76f749-57af-4db3-9ae5-871fa3beb8a6 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] [instance: f31d2b1b-afbe-4fef-9ee4-f003842d5237] Found default for hw_video_model of virtio {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:25:42 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-5a76f749-57af-4db3-9ae5-871fa3beb8a6 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] [instance: f31d2b1b-afbe-4fef-9ee4-f003842d5237] Found default for hw_vif_model of virtio {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:25:42 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: f31d2b1b-afbe-4fef-9ee4-f003842d5237] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 16:25:42 user nova-compute[71874]: DEBUG nova.virt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Emitting event <LifecycleEvent: 1681316742.5118349, f31d2b1b-afbe-4fef-9ee4-f003842d5237 => Started> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:25:42 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: f31d2b1b-afbe-4fef-9ee4-f003842d5237] VM Started (Lifecycle Event)
Apr 12 16:25:42 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: f31d2b1b-afbe-4fef-9ee4-f003842d5237] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:25:42 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: f31d2b1b-afbe-4fef-9ee4-f003842d5237] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 16:25:42 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: f31d2b1b-afbe-4fef-9ee4-f003842d5237] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 16:25:42 user nova-compute[71874]: INFO nova.compute.manager [None req-5a76f749-57af-4db3-9ae5-871fa3beb8a6 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] [instance: f31d2b1b-afbe-4fef-9ee4-f003842d5237] Took 5.44 seconds to spawn the instance on the hypervisor.
Apr 12 16:25:42 user nova-compute[71874]: DEBUG nova.compute.manager [None req-5a76f749-57af-4db3-9ae5-871fa3beb8a6 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] [instance: f31d2b1b-afbe-4fef-9ee4-f003842d5237] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:25:42 user nova-compute[71874]: DEBUG nova.compute.manager [req-ea8d2d71-d42e-4d1d-a896-76b3646f7129 req-a6be5a4f-b8d8-4b3a-bb80-7e5760f07e44 service nova] [instance: f31d2b1b-afbe-4fef-9ee4-f003842d5237] Received event network-vif-plugged-ce90db7b-5efd-411b-a2f8-b7484a527704 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:25:42 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-ea8d2d71-d42e-4d1d-a896-76b3646f7129 req-a6be5a4f-b8d8-4b3a-bb80-7e5760f07e44 service nova] Acquiring lock "f31d2b1b-afbe-4fef-9ee4-f003842d5237-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:25:42 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-ea8d2d71-d42e-4d1d-a896-76b3646f7129 req-a6be5a4f-b8d8-4b3a-bb80-7e5760f07e44 service nova] Lock "f31d2b1b-afbe-4fef-9ee4-f003842d5237-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:25:42 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-ea8d2d71-d42e-4d1d-a896-76b3646f7129 req-a6be5a4f-b8d8-4b3a-bb80-7e5760f07e44 service nova] Lock "f31d2b1b-afbe-4fef-9ee4-f003842d5237-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:25:42 user nova-compute[71874]: DEBUG nova.compute.manager [req-ea8d2d71-d42e-4d1d-a896-76b3646f7129 req-a6be5a4f-b8d8-4b3a-bb80-7e5760f07e44 service nova] [instance: f31d2b1b-afbe-4fef-9ee4-f003842d5237] No waiting events found dispatching network-vif-plugged-ce90db7b-5efd-411b-a2f8-b7484a527704 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:25:42 user nova-compute[71874]: WARNING nova.compute.manager [req-ea8d2d71-d42e-4d1d-a896-76b3646f7129 req-a6be5a4f-b8d8-4b3a-bb80-7e5760f07e44 service nova] [instance: f31d2b1b-afbe-4fef-9ee4-f003842d5237] Received unexpected event network-vif-plugged-ce90db7b-5efd-411b-a2f8-b7484a527704 for instance with vm_state building and task_state spawning.
Apr 12 16:25:42 user nova-compute[71874]: DEBUG nova.compute.manager [req-ea8d2d71-d42e-4d1d-a896-76b3646f7129 req-a6be5a4f-b8d8-4b3a-bb80-7e5760f07e44 service nova] [instance: d9a374be-4852-45e3-b346-79a08b60f981] Received event network-changed-aeffb3da-3b3c-40c0-bca4-ee483aa11e39 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:25:42 user nova-compute[71874]: DEBUG nova.compute.manager [req-ea8d2d71-d42e-4d1d-a896-76b3646f7129 req-a6be5a4f-b8d8-4b3a-bb80-7e5760f07e44 service nova] [instance: d9a374be-4852-45e3-b346-79a08b60f981] Refreshing instance network info cache due to event network-changed-aeffb3da-3b3c-40c0-bca4-ee483aa11e39. {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 16:25:42 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-ea8d2d71-d42e-4d1d-a896-76b3646f7129 req-a6be5a4f-b8d8-4b3a-bb80-7e5760f07e44 service nova] Acquiring lock "refresh_cache-d9a374be-4852-45e3-b346-79a08b60f981" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:25:42 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-ea8d2d71-d42e-4d1d-a896-76b3646f7129 req-a6be5a4f-b8d8-4b3a-bb80-7e5760f07e44 service nova] Acquired lock "refresh_cache-d9a374be-4852-45e3-b346-79a08b60f981" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:25:42 user nova-compute[71874]: DEBUG nova.network.neutron [req-ea8d2d71-d42e-4d1d-a896-76b3646f7129 req-a6be5a4f-b8d8-4b3a-bb80-7e5760f07e44 service nova] [instance: d9a374be-4852-45e3-b346-79a08b60f981] Refreshing network info cache for port aeffb3da-3b3c-40c0-bca4-ee483aa11e39 {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 16:25:42 user nova-compute[71874]: INFO nova.compute.manager [None req-5a76f749-57af-4db3-9ae5-871fa3beb8a6 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] [instance: f31d2b1b-afbe-4fef-9ee4-f003842d5237] Took 6.00 seconds to build instance.
Apr 12 16:25:42 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-5a76f749-57af-4db3-9ae5-871fa3beb8a6 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Lock "f31d2b1b-afbe-4fef-9ee4-f003842d5237" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.102s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:25:42 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-b97cc7b7-8540-4f46-9345-ce518d322c32 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "d9a374be-4852-45e3-b346-79a08b60f981" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:25:42 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-b97cc7b7-8540-4f46-9345-ce518d322c32 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "d9a374be-4852-45e3-b346-79a08b60f981" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:25:42 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-b97cc7b7-8540-4f46-9345-ce518d322c32 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "d9a374be-4852-45e3-b346-79a08b60f981-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:25:42 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-b97cc7b7-8540-4f46-9345-ce518d322c32 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "d9a374be-4852-45e3-b346-79a08b60f981-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:25:42 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-b97cc7b7-8540-4f46-9345-ce518d322c32 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "d9a374be-4852-45e3-b346-79a08b60f981-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:25:42 user nova-compute[71874]: INFO nova.compute.manager [None req-b97cc7b7-8540-4f46-9345-ce518d322c32 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: d9a374be-4852-45e3-b346-79a08b60f981] Terminating instance
Apr 12 16:25:42 user nova-compute[71874]: DEBUG nova.compute.manager [None req-b97cc7b7-8540-4f46-9345-ce518d322c32 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: d9a374be-4852-45e3-b346-79a08b60f981] Start destroying the instance on the hypervisor. {{(pid=71874) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 16:25:42 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:25:42 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:25:43 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:25:43 user nova-compute[71874]: DEBUG nova.compute.manager [req-05c7a860-7fbf-49a7-927b-0ca3395063d4 req-20a8360c-70da-465c-a3ba-a6de6ee551e3 service nova] [instance: d9a374be-4852-45e3-b346-79a08b60f981] Received event network-vif-unplugged-aeffb3da-3b3c-40c0-bca4-ee483aa11e39 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:25:43 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-05c7a860-7fbf-49a7-927b-0ca3395063d4 req-20a8360c-70da-465c-a3ba-a6de6ee551e3 service nova] Acquiring lock "d9a374be-4852-45e3-b346-79a08b60f981-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:25:43 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-05c7a860-7fbf-49a7-927b-0ca3395063d4 req-20a8360c-70da-465c-a3ba-a6de6ee551e3 service nova] Lock "d9a374be-4852-45e3-b346-79a08b60f981-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:25:43 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-05c7a860-7fbf-49a7-927b-0ca3395063d4 req-20a8360c-70da-465c-a3ba-a6de6ee551e3 service nova] Lock "d9a374be-4852-45e3-b346-79a08b60f981-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:25:43 user nova-compute[71874]: DEBUG nova.compute.manager [req-05c7a860-7fbf-49a7-927b-0ca3395063d4 req-20a8360c-70da-465c-a3ba-a6de6ee551e3 service nova] [instance: d9a374be-4852-45e3-b346-79a08b60f981] No waiting events found dispatching network-vif-unplugged-aeffb3da-3b3c-40c0-bca4-ee483aa11e39 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:25:43 user nova-compute[71874]: DEBUG nova.compute.manager [req-05c7a860-7fbf-49a7-927b-0ca3395063d4 req-20a8360c-70da-465c-a3ba-a6de6ee551e3 service nova] [instance: d9a374be-4852-45e3-b346-79a08b60f981] Received event network-vif-unplugged-aeffb3da-3b3c-40c0-bca4-ee483aa11e39 for instance with task_state deleting. {{(pid=71874) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 16:25:43 user nova-compute[71874]: DEBUG nova.network.neutron [req-ea8d2d71-d42e-4d1d-a896-76b3646f7129 req-a6be5a4f-b8d8-4b3a-bb80-7e5760f07e44 service nova] [instance: d9a374be-4852-45e3-b346-79a08b60f981] Updated VIF entry in instance network info cache for port aeffb3da-3b3c-40c0-bca4-ee483aa11e39. {{(pid=71874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 16:25:43 user nova-compute[71874]: DEBUG nova.network.neutron [req-ea8d2d71-d42e-4d1d-a896-76b3646f7129 req-a6be5a4f-b8d8-4b3a-bb80-7e5760f07e44 service nova] [instance: d9a374be-4852-45e3-b346-79a08b60f981] Updating instance_info_cache with network_info: [{"id": "aeffb3da-3b3c-40c0-bca4-ee483aa11e39", "address": "fa:16:3e:05:c5:b7", "network": {"id": "1439244b-8287-4bba-a88c-99d4b498cccd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1491302639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29b1b89a5eeb408a8d0938e5f59f405f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaeffb3da-3b", "ovs_interfaceid": "aeffb3da-3b3c-40c0-bca4-ee483aa11e39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:25:43 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-ea8d2d71-d42e-4d1d-a896-76b3646f7129 req-a6be5a4f-b8d8-4b3a-bb80-7e5760f07e44 service nova] Releasing lock "refresh_cache-d9a374be-4852-45e3-b346-79a08b60f981" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:25:43 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:25:43 user nova-compute[71874]: INFO nova.virt.libvirt.driver [-] [instance: d9a374be-4852-45e3-b346-79a08b60f981] Instance destroyed successfully.
Apr 12 16:25:43 user nova-compute[71874]: DEBUG nova.objects.instance [None req-b97cc7b7-8540-4f46-9345-ce518d322c32 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lazy-loading 'resources' on Instance uuid d9a374be-4852-45e3-b346-79a08b60f981 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:25:43 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-b97cc7b7-8540-4f46-9345-ce518d322c32 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T16:23:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-515149958',display_name='tempest-TestVolumeBootPattern-server-515149958',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-515149958',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGG/oSOmCDB20hkof5ViTlXYepxJsQ10bBtdYs7WKmIje03wdrGPlfe9DBPbPhAeMjSuszZPOH/w828DcGTtmLpZpE/aguNTugqw/I5GMmvTcJqr8fOGXLe6lzwKxF1ecQ==',key_name='tempest-TestVolumeBootPattern-2081417066',keypairs=<?>,launch_index=0,launched_at=2023-04-12T16:23:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='29b1b89a5eeb408a8d0938e5f59f405f',ramdisk_id='',reservation_id='r-e0zx8m7k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-734600841',owner_user_name='tempest-TestVolumeBootPattern-734600841-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T16:24:00Z,user_data=None,user_id='7054687447fc42339e9046ced4915890',uuid=d9a374be-4852-45e3-b346-79a08b60f981,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "aeffb3da-3b3c-40c0-bca4-ee483aa11e39", "address": "fa:16:3e:05:c5:b7", "network": {"id": "1439244b-8287-4bba-a88c-99d4b498cccd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1491302639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29b1b89a5eeb408a8d0938e5f59f405f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaeffb3da-3b", "ovs_interfaceid": "aeffb3da-3b3c-40c0-bca4-ee483aa11e39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 16:25:43 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-b97cc7b7-8540-4f46-9345-ce518d322c32 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Converting VIF {"id": "aeffb3da-3b3c-40c0-bca4-ee483aa11e39", "address": "fa:16:3e:05:c5:b7", "network": {"id": "1439244b-8287-4bba-a88c-99d4b498cccd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1491302639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29b1b89a5eeb408a8d0938e5f59f405f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaeffb3da-3b", "ovs_interfaceid": "aeffb3da-3b3c-40c0-bca4-ee483aa11e39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:25:43 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-b97cc7b7-8540-4f46-9345-ce518d322c32 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:05:c5:b7,bridge_name='br-int',has_traffic_filtering=True,id=aeffb3da-3b3c-40c0-bca4-ee483aa11e39,network=Network(1439244b-8287-4bba-a88c-99d4b498cccd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaeffb3da-3b') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:25:43 user nova-compute[71874]: DEBUG os_vif [None req-b97cc7b7-8540-4f46-9345-ce518d322c32 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:05:c5:b7,bridge_name='br-int',has_traffic_filtering=True,id=aeffb3da-3b3c-40c0-bca4-ee483aa11e39,network=Network(1439244b-8287-4bba-a88c-99d4b498cccd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaeffb3da-3b') {{(pid=71874) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 16:25:43 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:25:43 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaeffb3da-3b, bridge=br-int, if_exists=True) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:25:43 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:25:43 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:25:43 user nova-compute[71874]: INFO os_vif [None req-b97cc7b7-8540-4f46-9345-ce518d322c32 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:05:c5:b7,bridge_name='br-int',has_traffic_filtering=True,id=aeffb3da-3b3c-40c0-bca4-ee483aa11e39,network=Network(1439244b-8287-4bba-a88c-99d4b498cccd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaeffb3da-3b')
Apr 12 16:25:43 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b97cc7b7-8540-4f46-9345-ce518d322c32 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: d9a374be-4852-45e3-b346-79a08b60f981] calling os-brick to detach iSCSI Volume {{(pid=71874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 16:25:43 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-b97cc7b7-8540-4f46-9345-ce518d322c32 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3c0216320>, {'target_iqn': 'iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ChyEKuGP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:25:43 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-b97cc7b7-8540-4f46-9345-ce518d322c32 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:25:43 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-b97cc7b7-8540-4f46-9345-ce518d322c32 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:25:43 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-b97cc7b7-8540-4f46-9345-ce518d322c32 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:25:43 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:25:43 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:25:43 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bb0e8b6-5e8d-464c-9d8d-eaf26486b426]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:25:43 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-b97cc7b7-8540-4f46-9345-ce518d322c32 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 16:25:43 user nova-compute[71874]: No targets found.
Apr 12 16:25:43 user nova-compute[71874]: iSNS:
Apr 12 16:25:43 user nova-compute[71874]: No targets found.
Apr 12 16:25:43 user nova-compute[71874]: STATIC:
Apr 12 16:25:43 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909
Apr 12 16:25:43 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:25:43 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:25:43 user nova-compute[71874]: FIRMWARE:
Apr 12 16:25:43 user nova-compute[71874]: No targets found.
Apr 12 16:25:43 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:25:43 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-b97cc7b7-8540-4f46-9345-ce518d322c32 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 16:25:43 user nova-compute[71874]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 16:25:43 user nova-compute[71874]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71874) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 16:25:43 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-b97cc7b7-8540-4f46-9345-ce518d322c32 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909', 0)] {{(pid=71874) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 16:25:43 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:25:43 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:25:43 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0691afd-029a-4bf7-9ad2-ceab13c52d64]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:25:43 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:25:43 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:25:43 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[54fdb7fd-9023-4270-83ce-0e81a9b665c9]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909 (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:25:43 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-b97cc7b7-8540-4f46-9345-ce518d322c32 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909 (non-flash)
Apr 12 16:25:43 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:25:43 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-b97cc7b7-8540-4f46-9345-ce518d322c32 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909 (non-flash)
Apr 12 16:25:43 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:25:43 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-b97cc7b7-8540-4f46-9345-ce518d322c32 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc37d61eef0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909'): ({'sdb'}, set())}) {{(pid=71874) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 16:25:43 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-b97cc7b7-8540-4f46-9345-ce518d322c32 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Removing single pathed devices sdb {{(pid=71874) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 16:25:43 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:25:43 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:25:43 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a39ac24-4388-4193-ad85-04ffaa5bc99f]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:25:43 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:25:43 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:25:43 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9fd2ec7-963f-4911-83e6-5bfc66622ff2]: (4, ('ok\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:25:43 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-b97cc7b7-8540-4f46-9345-ce518d322c32 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Flushing IO for device /dev/sdb {{(pid=71874) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 16:25:43 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:25:43 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:25:43 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[712f974a-60c9-45fc-b243-4050c48386d3]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:25:43 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-b97cc7b7-8540-4f46-9345-ce518d322c32 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71874) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 16:25:43 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:25:43 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:25:43 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:25:43 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71874) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 16:25:43 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.075s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:25:43 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e195c6d-5bc0-4d4a-86e3-f682b17c3921]: (4, ('1', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:25:43 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-b97cc7b7-8540-4f46-9345-ce518d322c32 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71874) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 16:25:43 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-b97cc7b7-8540-4f46-9345-ce518d322c32 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] SCSI volumes sdb have been removed. {{(pid=71874) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 16:25:43 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-b97cc7b7-8540-4f46-9345-ce518d322c32 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909')] {{(pid=71874) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 16:25:43 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:25:43 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:25:43 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cf83729-8852-455f-85b8-ee2f9b9c63d2]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:25:43 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-b97cc7b7-8540-4f46-9345-ce518d322c32 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:25:43 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909 -p 172.16.0.220:3260 --logout {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:25:44 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:25:44 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[12480716-eba8-4a5b-8ee1-ffa72a82bbec]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:25:44 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-b97cc7b7-8540-4f46-9345-ce518d322c32 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909, portal: 172.16.0.220,3260]
Apr 12 16:25:44 user nova-compute[71874]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909, portal: 172.16.0.220,3260] successful.
Apr 12 16:25:44 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:25:44 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909 -p 172.16.0.220:3260 --op delete {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:25:44 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:25:44 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fb1ba2b-34e3-4d52-bae6-e854b0ee6bee]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:25:44 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-b97cc7b7-8540-4f46-9345-ce518d322c32 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:25:44 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-b97cc7b7-8540-4f46-9345-ce518d322c32 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.356s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:25:44 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-b97cc7b7-8540-4f46-9345-ce518d322c32 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] <== disconnect_volume: return (358ms) None {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:25:44 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b97cc7b7-8540-4f46-9345-ce518d322c32 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: d9a374be-4852-45e3-b346-79a08b60f981] Disconnected iSCSI Volume {{(pid=71874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 16:25:44 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-b97cc7b7-8540-4f46-9345-ce518d322c32 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: d9a374be-4852-45e3-b346-79a08b60f981] Deleting instance files /opt/stack/data/nova/instances/d9a374be-4852-45e3-b346-79a08b60f981_del
Apr 12 16:25:44 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-b97cc7b7-8540-4f46-9345-ce518d322c32 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: d9a374be-4852-45e3-b346-79a08b60f981] Deletion of /opt/stack/data/nova/instances/d9a374be-4852-45e3-b346-79a08b60f981_del complete
Apr 12 16:25:44 user nova-compute[71874]: INFO nova.compute.manager [None req-b97cc7b7-8540-4f46-9345-ce518d322c32 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: d9a374be-4852-45e3-b346-79a08b60f981] Took 1.22 seconds to destroy the instance on the hypervisor.
Apr 12 16:25:44 user nova-compute[71874]: DEBUG oslo.service.loopingcall [None req-b97cc7b7-8540-4f46-9345-ce518d322c32 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71874) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 16:25:44 user nova-compute[71874]: DEBUG nova.compute.manager [-] [instance: d9a374be-4852-45e3-b346-79a08b60f981] Deallocating network for instance {{(pid=71874) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 16:25:44 user nova-compute[71874]: DEBUG nova.network.neutron [-] [instance: d9a374be-4852-45e3-b346-79a08b60f981] deallocate_for_instance() {{(pid=71874) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 16:25:45 user nova-compute[71874]: DEBUG nova.network.neutron [-] [instance: d9a374be-4852-45e3-b346-79a08b60f981] Updating instance_info_cache with network_info: [] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:25:45 user nova-compute[71874]: INFO nova.compute.manager [-] [instance: d9a374be-4852-45e3-b346-79a08b60f981] Took 1.09 seconds to deallocate network for instance.
Apr 12 16:25:45 user nova-compute[71874]: DEBUG nova.compute.manager [req-3b0a24de-0b37-4705-a886-5a2f8f53e95a req-6b16709b-2eae-463c-a42e-52bcef9bcbfa service nova] [instance: d9a374be-4852-45e3-b346-79a08b60f981] Received event network-vif-deleted-aeffb3da-3b3c-40c0-bca4-ee483aa11e39 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:25:45 user nova-compute[71874]: DEBUG nova.compute.manager [req-f06329dd-b6e4-4838-ba1b-10e2ec8631c8 req-ef79a858-1c67-4a5c-812d-8b4b5c4c4806 service nova] [instance: d9a374be-4852-45e3-b346-79a08b60f981] Received event network-vif-plugged-aeffb3da-3b3c-40c0-bca4-ee483aa11e39 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:25:45 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-f06329dd-b6e4-4838-ba1b-10e2ec8631c8 req-ef79a858-1c67-4a5c-812d-8b4b5c4c4806 service nova] Acquiring lock "d9a374be-4852-45e3-b346-79a08b60f981-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:25:45 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-f06329dd-b6e4-4838-ba1b-10e2ec8631c8 req-ef79a858-1c67-4a5c-812d-8b4b5c4c4806 service nova] Lock "d9a374be-4852-45e3-b346-79a08b60f981-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:25:45 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-f06329dd-b6e4-4838-ba1b-10e2ec8631c8 req-ef79a858-1c67-4a5c-812d-8b4b5c4c4806 service nova] Lock "d9a374be-4852-45e3-b346-79a08b60f981-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:25:45 user nova-compute[71874]: DEBUG nova.compute.manager [req-f06329dd-b6e4-4838-ba1b-10e2ec8631c8 req-ef79a858-1c67-4a5c-812d-8b4b5c4c4806 service nova] [instance: d9a374be-4852-45e3-b346-79a08b60f981] No waiting events found dispatching network-vif-plugged-aeffb3da-3b3c-40c0-bca4-ee483aa11e39 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:25:45 user nova-compute[71874]: WARNING nova.compute.manager [req-f06329dd-b6e4-4838-ba1b-10e2ec8631c8 req-ef79a858-1c67-4a5c-812d-8b4b5c4c4806 service nova] [instance: d9a374be-4852-45e3-b346-79a08b60f981] Received unexpected event network-vif-plugged-aeffb3da-3b3c-40c0-bca4-ee483aa11e39 for instance with vm_state active and task_state deleting.
Apr 12 16:25:46 user nova-compute[71874]: INFO nova.compute.manager [None req-b97cc7b7-8540-4f46-9345-ce518d322c32 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: d9a374be-4852-45e3-b346-79a08b60f981] Took 0.85 seconds to detach 1 volumes for instance.
Apr 12 16:25:46 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-b97cc7b7-8540-4f46-9345-ce518d322c32 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:25:46 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-b97cc7b7-8540-4f46-9345-ce518d322c32 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:25:46 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-b97cc7b7-8540-4f46-9345-ce518d322c32 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Inventory has not changed in ProviderTree for provider: 0e94b4c8-cd49-45e4-9133-d36eb4b2456b {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 16:25:46 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-b97cc7b7-8540-4f46-9345-ce518d322c32 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Inventory has not changed for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 16:25:46 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-b97cc7b7-8540-4f46-9345-ce518d322c32 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.196s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:25:46 user nova-compute[71874]: INFO nova.scheduler.client.report [None req-b97cc7b7-8540-4f46-9345-ce518d322c32 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Deleted allocations for instance d9a374be-4852-45e3-b346-79a08b60f981
Apr 12 16:25:46 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-b97cc7b7-8540-4f46-9345-ce518d322c32 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "d9a374be-4852-45e3-b346-79a08b60f981" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.529s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:25:48 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:25:53 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:25:58 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:25:58 user nova-compute[71874]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681316743.6231918, d9a374be-4852-45e3-b346-79a08b60f981 => Stopped> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:25:58 user nova-compute[71874]: INFO nova.compute.manager [-] [instance: d9a374be-4852-45e3-b346-79a08b60f981] VM Stopped (Lifecycle Event)
Apr 12 16:25:58 user nova-compute[71874]: DEBUG nova.compute.manager [None req-63658237-534e-48c7-95c8-9953aeb26652 None None] [instance: d9a374be-4852-45e3-b346-79a08b60f981] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:25:58 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:26:03 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:26:03 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:26:04 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:26:05 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:26:08 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-33f56fef-eb09-427e-afeb-8fdc74dbaa5d tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] Acquiring lock "6b40e07a-eb45-4fe7-9f98-dc718231a4a4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:26:08 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-33f56fef-eb09-427e-afeb-8fdc74dbaa5d tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] Lock "6b40e07a-eb45-4fe7-9f98-dc718231a4a4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:26:08 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-33f56fef-eb09-427e-afeb-8fdc74dbaa5d tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] Acquiring lock "6b40e07a-eb45-4fe7-9f98-dc718231a4a4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:26:08 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-33f56fef-eb09-427e-afeb-8fdc74dbaa5d tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] Lock "6b40e07a-eb45-4fe7-9f98-dc718231a4a4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:26:08 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-33f56fef-eb09-427e-afeb-8fdc74dbaa5d tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] Lock "6b40e07a-eb45-4fe7-9f98-dc718231a4a4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:26:08 user nova-compute[71874]: INFO nova.compute.manager [None req-33f56fef-eb09-427e-afeb-8fdc74dbaa5d tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] [instance: 6b40e07a-eb45-4fe7-9f98-dc718231a4a4] Terminating instance
Apr 12 16:26:08 user nova-compute[71874]: DEBUG nova.compute.manager [None req-33f56fef-eb09-427e-afeb-8fdc74dbaa5d tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] [instance: 6b40e07a-eb45-4fe7-9f98-dc718231a4a4] Start destroying the instance on the hypervisor. {{(pid=71874) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 16:26:08 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:26:08 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:26:08 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:26:08 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:26:08 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:26:08 user nova-compute[71874]: DEBUG nova.compute.manager [req-c8d72ceb-b143-41c7-9a4a-6683eb7c7d35 req-7b060f64-2813-4f8b-9a1f-f0424359c6e3 service nova] [instance: 6b40e07a-eb45-4fe7-9f98-dc718231a4a4] Received event network-vif-unplugged-f4ad5837-50cf-4283-aee0-7f531fb6cee6 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:26:08 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-c8d72ceb-b143-41c7-9a4a-6683eb7c7d35 req-7b060f64-2813-4f8b-9a1f-f0424359c6e3 service nova] Acquiring lock "6b40e07a-eb45-4fe7-9f98-dc718231a4a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:26:08 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-c8d72ceb-b143-41c7-9a4a-6683eb7c7d35 req-7b060f64-2813-4f8b-9a1f-f0424359c6e3 service nova] Lock "6b40e07a-eb45-4fe7-9f98-dc718231a4a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:26:08 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-c8d72ceb-b143-41c7-9a4a-6683eb7c7d35 req-7b060f64-2813-4f8b-9a1f-f0424359c6e3 service nova] Lock "6b40e07a-eb45-4fe7-9f98-dc718231a4a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:26:08 user nova-compute[71874]: DEBUG nova.compute.manager [req-c8d72ceb-b143-41c7-9a4a-6683eb7c7d35 req-7b060f64-2813-4f8b-9a1f-f0424359c6e3 service nova] [instance: 6b40e07a-eb45-4fe7-9f98-dc718231a4a4] No waiting events found dispatching network-vif-unplugged-f4ad5837-50cf-4283-aee0-7f531fb6cee6 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:26:08 user nova-compute[71874]: DEBUG nova.compute.manager [req-c8d72ceb-b143-41c7-9a4a-6683eb7c7d35 req-7b060f64-2813-4f8b-9a1f-f0424359c6e3 service nova] [instance: 6b40e07a-eb45-4fe7-9f98-dc718231a4a4] Received event network-vif-unplugged-f4ad5837-50cf-4283-aee0-7f531fb6cee6 for instance with task_state deleting. {{(pid=71874) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 16:26:08 user nova-compute[71874]: INFO nova.virt.libvirt.driver [-] [instance: 6b40e07a-eb45-4fe7-9f98-dc718231a4a4] Instance destroyed successfully.
Apr 12 16:26:08 user nova-compute[71874]: DEBUG nova.objects.instance [None req-33f56fef-eb09-427e-afeb-8fdc74dbaa5d tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] Lazy-loading 'resources' on Instance uuid 6b40e07a-eb45-4fe7-9f98-dc718231a4a4 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:26:08 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-33f56fef-eb09-427e-afeb-8fdc74dbaa5d tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T16:24:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1251953966',display_name='tempest-VolumesActionsTest-instance-1251953966',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1251953966',id=44,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T16:24:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5af762be84c243289780b7af16caae5c',ramdisk_id='',reservation_id='r-nshhusbk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-944096851',owner_user_name='tempest-VolumesActionsTest-944096851-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T16:24:19Z,user_data=None,user_id='995a52402acf40bf88b6c7c0440b1b94',uuid=6b40e07a-eb45-4fe7-9f98-dc718231a4a4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f4ad5837-50cf-4283-aee0-7f531fb6cee6", "address": "fa:16:3e:55:f5:c9", "network": {"id": "28cbab83-7a0f-44eb-98c5-9d1c9fb305c3", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1112763010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "5af762be84c243289780b7af16caae5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4ad5837-50", "ovs_interfaceid": "f4ad5837-50cf-4283-aee0-7f531fb6cee6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 16:26:08 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-33f56fef-eb09-427e-afeb-8fdc74dbaa5d tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] Converting VIF {"id": "f4ad5837-50cf-4283-aee0-7f531fb6cee6", "address": "fa:16:3e:55:f5:c9", "network": {"id": "28cbab83-7a0f-44eb-98c5-9d1c9fb305c3", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1112763010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "5af762be84c243289780b7af16caae5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4ad5837-50", "ovs_interfaceid": "f4ad5837-50cf-4283-aee0-7f531fb6cee6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:26:08 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-33f56fef-eb09-427e-afeb-8fdc74dbaa5d tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:55:f5:c9,bridge_name='br-int',has_traffic_filtering=True,id=f4ad5837-50cf-4283-aee0-7f531fb6cee6,network=Network(28cbab83-7a0f-44eb-98c5-9d1c9fb305c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4ad5837-50') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:26:08 user nova-compute[71874]: DEBUG os_vif [None req-33f56fef-eb09-427e-afeb-8fdc74dbaa5d tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:55:f5:c9,bridge_name='br-int',has_traffic_filtering=True,id=f4ad5837-50cf-4283-aee0-7f531fb6cee6,network=Network(28cbab83-7a0f-44eb-98c5-9d1c9fb305c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4ad5837-50') {{(pid=71874) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 16:26:08 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:26:08 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf4ad5837-50, bridge=br-int, if_exists=True) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:26:08 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:26:08 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:26:08 user nova-compute[71874]: INFO os_vif [None req-33f56fef-eb09-427e-afeb-8fdc74dbaa5d tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:55:f5:c9,bridge_name='br-int',has_traffic_filtering=True,id=f4ad5837-50cf-4283-aee0-7f531fb6cee6,network=Network(28cbab83-7a0f-44eb-98c5-9d1c9fb305c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4ad5837-50')
Apr 12 16:26:08 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-33f56fef-eb09-427e-afeb-8fdc74dbaa5d tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] [instance: 6b40e07a-eb45-4fe7-9f98-dc718231a4a4] Deleting instance files /opt/stack/data/nova/instances/6b40e07a-eb45-4fe7-9f98-dc718231a4a4_del
Apr 12 16:26:08 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-33f56fef-eb09-427e-afeb-8fdc74dbaa5d tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] [instance: 6b40e07a-eb45-4fe7-9f98-dc718231a4a4] Deletion of /opt/stack/data/nova/instances/6b40e07a-eb45-4fe7-9f98-dc718231a4a4_del complete
Apr 12 16:26:08 user nova-compute[71874]: INFO nova.compute.manager [None req-33f56fef-eb09-427e-afeb-8fdc74dbaa5d tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] [instance: 6b40e07a-eb45-4fe7-9f98-dc718231a4a4] Took 0.69 seconds to destroy the instance on the hypervisor.
Apr 12 16:26:08 user nova-compute[71874]: DEBUG oslo.service.loopingcall [None req-33f56fef-eb09-427e-afeb-8fdc74dbaa5d tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71874) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 16:26:08 user nova-compute[71874]: DEBUG nova.compute.manager [-] [instance: 6b40e07a-eb45-4fe7-9f98-dc718231a4a4] Deallocating network for instance {{(pid=71874) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 16:26:08 user nova-compute[71874]: DEBUG nova.network.neutron [-] [instance: 6b40e07a-eb45-4fe7-9f98-dc718231a4a4] deallocate_for_instance() {{(pid=71874) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 16:26:09 user nova-compute[71874]: DEBUG nova.network.neutron [-] [instance: 6b40e07a-eb45-4fe7-9f98-dc718231a4a4] Updating instance_info_cache with network_info: [] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:26:09 user nova-compute[71874]: INFO nova.compute.manager [-] [instance: 6b40e07a-eb45-4fe7-9f98-dc718231a4a4] Took 0.55 seconds to deallocate network for instance.
Apr 12 16:26:09 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-33f56fef-eb09-427e-afeb-8fdc74dbaa5d tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:26:09 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-33f56fef-eb09-427e-afeb-8fdc74dbaa5d tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:26:09 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-33f56fef-eb09-427e-afeb-8fdc74dbaa5d tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] Refreshing inventories for resource provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b {{(pid=71874) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 12 16:26:09 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-33f56fef-eb09-427e-afeb-8fdc74dbaa5d tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] Updating ProviderTree inventory for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 12 16:26:09 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-33f56fef-eb09-427e-afeb-8fdc74dbaa5d tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] Updating inventory in ProviderTree for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 12 16:26:09 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-33f56fef-eb09-427e-afeb-8fdc74dbaa5d tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] Refreshing aggregate associations for resource provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b, aggregates: None {{(pid=71874) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 12 16:26:09 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-33f56fef-eb09-427e-afeb-8fdc74dbaa5d tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] Refreshing trait associations for resource provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b, traits: COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_ACCELERATORS,HW_CPU_X86_MMX,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE2,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_FDC,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE {{(pid=71874) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 12 16:26:09 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-33f56fef-eb09-427e-afeb-8fdc74dbaa5d tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] Inventory has not changed in ProviderTree for provider: 0e94b4c8-cd49-45e4-9133-d36eb4b2456b {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 16:26:09 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-33f56fef-eb09-427e-afeb-8fdc74dbaa5d tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] Inventory has not changed for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 16:26:09 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-33f56fef-eb09-427e-afeb-8fdc74dbaa5d tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.379s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:26:09 user nova-compute[71874]: INFO nova.scheduler.client.report [None req-33f56fef-eb09-427e-afeb-8fdc74dbaa5d tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] Deleted allocations for instance 6b40e07a-eb45-4fe7-9f98-dc718231a4a4
Apr 12 16:26:09 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-33f56fef-eb09-427e-afeb-8fdc74dbaa5d tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] Lock "6b40e07a-eb45-4fe7-9f98-dc718231a4a4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.775s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:26:10 user nova-compute[71874]: DEBUG nova.compute.manager [req-76705270-f3a4-4776-9bfd-f03c743f7874 req-72af23f3-2235-4886-9c8e-8b620a6814f1 service nova] [instance: 6b40e07a-eb45-4fe7-9f98-dc718231a4a4] Received event network-vif-plugged-f4ad5837-50cf-4283-aee0-7f531fb6cee6 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:26:10 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-76705270-f3a4-4776-9bfd-f03c743f7874 req-72af23f3-2235-4886-9c8e-8b620a6814f1 service nova] Acquiring lock "6b40e07a-eb45-4fe7-9f98-dc718231a4a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:26:10 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-76705270-f3a4-4776-9bfd-f03c743f7874 req-72af23f3-2235-4886-9c8e-8b620a6814f1 service nova] Lock "6b40e07a-eb45-4fe7-9f98-dc718231a4a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:26:10 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-76705270-f3a4-4776-9bfd-f03c743f7874 req-72af23f3-2235-4886-9c8e-8b620a6814f1 service nova] Lock "6b40e07a-eb45-4fe7-9f98-dc718231a4a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:26:10 user nova-compute[71874]: DEBUG nova.compute.manager [req-76705270-f3a4-4776-9bfd-f03c743f7874 req-72af23f3-2235-4886-9c8e-8b620a6814f1 service nova] [instance: 6b40e07a-eb45-4fe7-9f98-dc718231a4a4] No waiting events found dispatching network-vif-plugged-f4ad5837-50cf-4283-aee0-7f531fb6cee6 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:26:10 user nova-compute[71874]: WARNING nova.compute.manager [req-76705270-f3a4-4776-9bfd-f03c743f7874 req-72af23f3-2235-4886-9c8e-8b620a6814f1 service nova] [instance: 6b40e07a-eb45-4fe7-9f98-dc718231a4a4] Received unexpected event network-vif-plugged-f4ad5837-50cf-4283-aee0-7f531fb6cee6 for instance with vm_state deleted and task_state None.
Apr 12 16:26:10 user nova-compute[71874]: DEBUG nova.compute.manager [req-76705270-f3a4-4776-9bfd-f03c743f7874 req-72af23f3-2235-4886-9c8e-8b620a6814f1 service nova] [instance: 6b40e07a-eb45-4fe7-9f98-dc718231a4a4] Received event network-vif-deleted-f4ad5837-50cf-4283-aee0-7f531fb6cee6 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:26:13 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:26:18 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._sync_power_states {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:26:18 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Triggering sync for uuid f31d2b1b-afbe-4fef-9ee4-f003842d5237 {{(pid=71874) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 16:26:18 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquiring lock "f31d2b1b-afbe-4fef-9ee4-f003842d5237" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:26:18 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "f31d2b1b-afbe-4fef-9ee4-f003842d5237" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:26:18 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "f31d2b1b-afbe-4fef-9ee4-f003842d5237" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.027s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:26:18 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:26:23 user nova-compute[71874]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681316768.7922938, 6b40e07a-eb45-4fe7-9f98-dc718231a4a4 => Stopped> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:26:23 user nova-compute[71874]: INFO nova.compute.manager [-] [instance: 6b40e07a-eb45-4fe7-9f98-dc718231a4a4] VM Stopped (Lifecycle Event)
Apr 12 16:26:23 user nova-compute[71874]: DEBUG nova.compute.manager [None req-f4d85f6d-97a9-41bb-b7da-e573ad40ea77 None None] [instance: 6b40e07a-eb45-4fe7-9f98-dc718231a4a4] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:26:23 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:26:28 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:26:28 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:26:33 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:26:33 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:26:33 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71874) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 16:26:33 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71874) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 16:26:33 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71874) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 16:26:33 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:26:33 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:26:33 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:26:33 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:26:33 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:26:33 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Auditing locally available compute resources for user (node: user) {{(pid=71874) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 16:26:33 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f31d2b1b-afbe-4fef-9ee4-f003842d5237/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:26:34 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f31d2b1b-afbe-4fef-9ee4-f003842d5237/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:26:34 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f31d2b1b-afbe-4fef-9ee4-f003842d5237/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:26:34 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f31d2b1b-afbe-4fef-9ee4-f003842d5237/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:26:34 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-1753685d-6fcb-4f64-b492-96e19693e575 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "2c01f491-2979-40d7-b74e-f580009309c5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:26:34 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-1753685d-6fcb-4f64-b492-96e19693e575 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "2c01f491-2979-40d7-b74e-f580009309c5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:26:34 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:26:34 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:26:34 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Hypervisor/Node resource view: name=user free_ram=8669MB free_disk=25.938289642333984GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71874) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 16:26:34 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:26:34 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:26:34 user nova-compute[71874]: DEBUG nova.compute.manager [None req-1753685d-6fcb-4f64-b492-96e19693e575 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 2c01f491-2979-40d7-b74e-f580009309c5] Starting instance... {{(pid=71874) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 16:26:34 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance f31d2b1b-afbe-4fef-9ee4-f003842d5237 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:26:34 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 2c01f491-2979-40d7-b74e-f580009309c5 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1689}}
Apr 12 16:26:34 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 16:26:34 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 16:26:34 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-1753685d-6fcb-4f64-b492-96e19693e575 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:26:34 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Inventory has not changed in ProviderTree for provider: 0e94b4c8-cd49-45e4-9133-d36eb4b2456b {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 16:26:34 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Inventory has not changed for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 16:26:34 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Compute_service record updated for user:user {{(pid=71874) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 16:26:34 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.212s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:26:34 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-1753685d-6fcb-4f64-b492-96e19693e575 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.120s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:26:34 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-1753685d-6fcb-4f64-b492-96e19693e575 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71874) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 16:26:34 user nova-compute[71874]: INFO nova.compute.claims [None req-1753685d-6fcb-4f64-b492-96e19693e575 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 2c01f491-2979-40d7-b74e-f580009309c5] Claim successful on node user
Apr 12 16:26:35 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-1753685d-6fcb-4f64-b492-96e19693e575 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Inventory has not changed in ProviderTree for provider: 0e94b4c8-cd49-45e4-9133-d36eb4b2456b {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 16:26:35 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-1753685d-6fcb-4f64-b492-96e19693e575 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Inventory has not changed for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 16:26:35 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-1753685d-6fcb-4f64-b492-96e19693e575 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.242s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:26:35 user nova-compute[71874]: DEBUG nova.compute.manager [None req-1753685d-6fcb-4f64-b492-96e19693e575 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 2c01f491-2979-40d7-b74e-f580009309c5] Start building networks asynchronously for instance. {{(pid=71874) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 16:26:35 user nova-compute[71874]: DEBUG nova.compute.manager [None req-1753685d-6fcb-4f64-b492-96e19693e575 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 2c01f491-2979-40d7-b74e-f580009309c5] Allocating IP information in the background. {{(pid=71874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 16:26:35 user nova-compute[71874]: DEBUG nova.network.neutron [None req-1753685d-6fcb-4f64-b492-96e19693e575 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 2c01f491-2979-40d7-b74e-f580009309c5] allocate_for_instance() {{(pid=71874) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 16:26:35 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-1753685d-6fcb-4f64-b492-96e19693e575 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 2c01f491-2979-40d7-b74e-f580009309c5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 16:26:35 user nova-compute[71874]: DEBUG nova.compute.manager [None req-1753685d-6fcb-4f64-b492-96e19693e575 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 2c01f491-2979-40d7-b74e-f580009309c5] Start building block device mappings for instance. {{(pid=71874) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 16:26:35 user nova-compute[71874]: INFO nova.virt.block_device [None req-1753685d-6fcb-4f64-b492-96e19693e575 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 2c01f491-2979-40d7-b74e-f580009309c5] Booting with volume 7ae18173-eee9-4607-b0a7-940d48146909 at /dev/vda
Apr 12 16:26:35 user nova-compute[71874]: DEBUG os_brick.utils [None req-1753685d-6fcb-4f64-b492-96e19693e575 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:26:35 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:26:35 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:26:35 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[29fba507-0b1c-4aaf-8594-5a28a7584ccb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:61a48d4489d2\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:26:35 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:26:35 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:26:35 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0cfad72-bad8-409d-9bd1-602c56092901]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:26:35 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:26:35 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:26:35 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[203bb717-33e2-4abe-80ab-3cee1dffd89f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:26:35 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[b84bbc58-e89c-47ec-8d4d-3fb0a5976b02]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:26:35 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-1753685d-6fcb-4f64-b492-96e19693e575 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Running cmd (subprocess): nvme version {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:26:35 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-1753685d-6fcb-4f64-b492-96e19693e575 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] 'nvme version' failed. Not Retrying. {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 16:26:35 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1753685d-6fcb-4f64-b492-96e19693e575 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] nvme not present on system {{(pid=71874) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 16:26:35 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:26:35 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 16:26:35 user nova-compute[71874]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 16:26:35 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[d918aae7-6fdc-4b55-b8aa-3b31d206d93f]: (4, '') {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:26:35 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.lightos [None req-1753685d-6fcb-4f64-b492-96e19693e575 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71874) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 16:26:35 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.lightos [None req-1753685d-6fcb-4f64-b492-96e19693e575 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71874) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 16:26:35 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.lightos [None req-1753685d-6fcb-4f64-b492-96e19693e575 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] LIGHTOS: no hostnqn found. {{(pid=71874) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 16:26:35 user nova-compute[71874]: DEBUG os_brick.utils [None req-1753685d-6fcb-4f64-b492-96e19693e575 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:61a48d4489d2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:26:35 user nova-compute[71874]: DEBUG nova.virt.block_device [None req-1753685d-6fcb-4f64-b492-96e19693e575 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 2c01f491-2979-40d7-b74e-f580009309c5] Updating existing volume attachment record: fd767da0-f58c-45c0-b4a4-41bf30e0cf73 {{(pid=71874) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 16:26:35 user nova-compute[71874]: DEBUG nova.policy [None req-1753685d-6fcb-4f64-b492-96e19693e575 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7054687447fc42339e9046ced4915890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b1b89a5eeb408a8d0938e5f59f405f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71874) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 16:26:35 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:26:36 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:26:36 user nova-compute[71874]: DEBUG nova.network.neutron [None req-1753685d-6fcb-4f64-b492-96e19693e575 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 2c01f491-2979-40d7-b74e-f580009309c5] Successfully created port: 88022433-f52e-45f9-80a5-b93ca88aa273 {{(pid=71874) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 16:26:37 user nova-compute[71874]: DEBUG nova.network.neutron [None req-1753685d-6fcb-4f64-b492-96e19693e575 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 2c01f491-2979-40d7-b74e-f580009309c5] Successfully updated port: 88022433-f52e-45f9-80a5-b93ca88aa273 {{(pid=71874) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 16:26:37 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-1753685d-6fcb-4f64-b492-96e19693e575 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "refresh_cache-2c01f491-2979-40d7-b74e-f580009309c5" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:26:37 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-1753685d-6fcb-4f64-b492-96e19693e575 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquired lock "refresh_cache-2c01f491-2979-40d7-b74e-f580009309c5" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:26:37 user nova-compute[71874]: DEBUG nova.network.neutron [None req-1753685d-6fcb-4f64-b492-96e19693e575 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 2c01f491-2979-40d7-b74e-f580009309c5] Building network info cache for instance {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 16:26:37 user nova-compute[71874]: DEBUG nova.compute.manager [req-00964457-6bea-4a18-875a-55c1cf246827 req-f235a580-e0ad-423a-81d6-6efd7d68e932 service nova] [instance: 2c01f491-2979-40d7-b74e-f580009309c5] Received event network-changed-88022433-f52e-45f9-80a5-b93ca88aa273 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:26:37 user nova-compute[71874]: DEBUG nova.compute.manager [req-00964457-6bea-4a18-875a-55c1cf246827 req-f235a580-e0ad-423a-81d6-6efd7d68e932 service nova] [instance: 2c01f491-2979-40d7-b74e-f580009309c5] Refreshing instance network info cache due to event network-changed-88022433-f52e-45f9-80a5-b93ca88aa273. {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 16:26:37 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-00964457-6bea-4a18-875a-55c1cf246827 req-f235a580-e0ad-423a-81d6-6efd7d68e932 service nova] Acquiring lock "refresh_cache-2c01f491-2979-40d7-b74e-f580009309c5" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:26:37 user nova-compute[71874]: DEBUG nova.network.neutron [None req-1753685d-6fcb-4f64-b492-96e19693e575 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 2c01f491-2979-40d7-b74e-f580009309c5] Instance cache missing network info. {{(pid=71874) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 16:26:37 user nova-compute[71874]: DEBUG nova.network.neutron [None req-1753685d-6fcb-4f64-b492-96e19693e575 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 2c01f491-2979-40d7-b74e-f580009309c5] Updating instance_info_cache with network_info: [{"id": "88022433-f52e-45f9-80a5-b93ca88aa273", "address": "fa:16:3e:8c:23:9e", "network": {"id": "1439244b-8287-4bba-a88c-99d4b498cccd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1491302639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29b1b89a5eeb408a8d0938e5f59f405f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88022433-f5", "ovs_interfaceid": "88022433-f52e-45f9-80a5-b93ca88aa273", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:26:37 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-1753685d-6fcb-4f64-b492-96e19693e575 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Releasing lock "refresh_cache-2c01f491-2979-40d7-b74e-f580009309c5" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:26:37 user nova-compute[71874]: DEBUG nova.compute.manager [None req-1753685d-6fcb-4f64-b492-96e19693e575 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 2c01f491-2979-40d7-b74e-f580009309c5] Instance network_info: |[{"id": "88022433-f52e-45f9-80a5-b93ca88aa273", "address": "fa:16:3e:8c:23:9e", "network": {"id": "1439244b-8287-4bba-a88c-99d4b498cccd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1491302639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29b1b89a5eeb408a8d0938e5f59f405f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88022433-f5", "ovs_interfaceid": "88022433-f52e-45f9-80a5-b93ca88aa273", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 16:26:37 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-00964457-6bea-4a18-875a-55c1cf246827 req-f235a580-e0ad-423a-81d6-6efd7d68e932 service nova] Acquired lock "refresh_cache-2c01f491-2979-40d7-b74e-f580009309c5" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:26:37 user nova-compute[71874]: DEBUG nova.network.neutron [req-00964457-6bea-4a18-875a-55c1cf246827 req-f235a580-e0ad-423a-81d6-6efd7d68e932 service nova] [instance: 2c01f491-2979-40d7-b74e-f580009309c5] Refreshing network info cache for port 88022433-f52e-45f9-80a5-b93ca88aa273 {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 16:26:37 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:26:37 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:26:37 user nova-compute[71874]: DEBUG nova.network.neutron [req-00964457-6bea-4a18-875a-55c1cf246827 req-f235a580-e0ad-423a-81d6-6efd7d68e932 service nova] [instance: 2c01f491-2979-40d7-b74e-f580009309c5] Updated VIF entry in instance network info cache for port 88022433-f52e-45f9-80a5-b93ca88aa273. {{(pid=71874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 16:26:37 user nova-compute[71874]: DEBUG nova.network.neutron [req-00964457-6bea-4a18-875a-55c1cf246827 req-f235a580-e0ad-423a-81d6-6efd7d68e932 service nova] [instance: 2c01f491-2979-40d7-b74e-f580009309c5] Updating instance_info_cache with network_info: [{"id": "88022433-f52e-45f9-80a5-b93ca88aa273", "address": "fa:16:3e:8c:23:9e", "network": {"id": "1439244b-8287-4bba-a88c-99d4b498cccd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1491302639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29b1b89a5eeb408a8d0938e5f59f405f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88022433-f5", "ovs_interfaceid": "88022433-f52e-45f9-80a5-b93ca88aa273", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:26:37 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-00964457-6bea-4a18-875a-55c1cf246827 req-f235a580-e0ad-423a-81d6-6efd7d68e932 service nova] Releasing lock "refresh_cache-2c01f491-2979-40d7-b74e-f580009309c5" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:26:38 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:26:38 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:26:39 user nova-compute[71874]: DEBUG nova.compute.manager [None req-1753685d-6fcb-4f64-b492-96e19693e575 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 2c01f491-2979-40d7-b74e-f580009309c5] Start spawning the instance on the hypervisor. {{(pid=71874) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 16:26:39 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-1753685d-6fcb-4f64-b492-96e19693e575 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 2c01f491-2979-40d7-b74e-f580009309c5] Creating instance directory {{(pid=71874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 16:26:39 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-1753685d-6fcb-4f64-b492-96e19693e575 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 2c01f491-2979-40d7-b74e-f580009309c5] Creating image(s)
Apr 12 16:26:39 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-1753685d-6fcb-4f64-b492-96e19693e575 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 2c01f491-2979-40d7-b74e-f580009309c5] Did not create local disks {{(pid=71874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 12 16:26:39 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-1753685d-6fcb-4f64-b492-96e19693e575 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 2c01f491-2979-40d7-b74e-f580009309c5] Ensure instance console log exists: /opt/stack/data/nova/instances/2c01f491-2979-40d7-b74e-f580009309c5/console.log {{(pid=71874) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 16:26:39 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-1753685d-6fcb-4f64-b492-96e19693e575 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:26:39 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-1753685d-6fcb-4f64-b492-96e19693e575 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:26:39 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-1753685d-6fcb-4f64-b492-96e19693e575 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:26:39 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-1753685d-6fcb-4f64-b492-96e19693e575 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 2c01f491-2979-40d7-b74e-f580009309c5] Start _get_guest_xml network_info=[{"id": "88022433-f52e-45f9-80a5-b93ca88aa273", "address": "fa:16:3e:8c:23:9e", "network": {"id": "1439244b-8287-4bba-a88c-99d4b498cccd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1491302639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29b1b89a5eeb408a8d0938e5f59f405f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88022433-f5", "ovs_interfaceid": "88022433-f52e-45f9-80a5-b93ca88aa273", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'delete_on_termination': False, 'attachment_id': 'fd767da0-f58c-45c0-b4a4-41bf30e0cf73', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ChyEKuGP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2c01f491-2979-40d7-b74e-f580009309c5', 'attached_at': '', 'detached_at': '', 'volume_id': '7ae18173-eee9-4607-b0a7-940d48146909', 'serial': '7ae18173-eee9-4607-b0a7-940d48146909'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'volume_type': None} {{(pid=71874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 16:26:39 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-1753685d-6fcb-4f64-b492-96e19693e575 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:26:39 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-1753685d-6fcb-4f64-b492-96e19693e575 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:26:39 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-1753685d-6fcb-4f64-b492-96e19693e575 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71874) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 16:26:39 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-1753685d-6fcb-4f64-b492-96e19693e575 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T15:56:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 16:26:39 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-1753685d-6fcb-4f64-b492-96e19693e575 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Flavor limits 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 16:26:39 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-1753685d-6fcb-4f64-b492-96e19693e575 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Image limits 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 16:26:39 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-1753685d-6fcb-4f64-b492-96e19693e575 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Flavor pref 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 16:26:39 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-1753685d-6fcb-4f64-b492-96e19693e575 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Image pref 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 16:26:39 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-1753685d-6fcb-4f64-b492-96e19693e575 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 16:26:39 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-1753685d-6fcb-4f64-b492-96e19693e575 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 16:26:39 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-1753685d-6fcb-4f64-b492-96e19693e575 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 16:26:39 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-1753685d-6fcb-4f64-b492-96e19693e575 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Got 1 possible topologies {{(pid=71874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 16:26:39 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-1753685d-6fcb-4f64-b492-96e19693e575 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 16:26:39 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-1753685d-6fcb-4f64-b492-96e19693e575 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 16:26:39 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1753685d-6fcb-4f64-b492-96e19693e575 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 2c01f491-2979-40d7-b74e-f580009309c5] Calling os-brick to attach iSCSI Volume {{(pid=71874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 16:26:39 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-1753685d-6fcb-4f64-b492-96e19693e575 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3c0216320>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ChyEKuGP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:26:39 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-1753685d-6fcb-4f64-b492-96e19693e575 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:26:39 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-1753685d-6fcb-4f64-b492-96e19693e575 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:26:39 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-1753685d-6fcb-4f64-b492-96e19693e575 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:26:39 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-1753685d-6fcb-4f64-b492-96e19693e575 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:26:39 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-1753685d-6fcb-4f64-b492-96e19693e575 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:26:39 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-1753685d-6fcb-4f64-b492-96e19693e575 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:26:39 user nova-compute[71874]: INFO os_brick.initiator.connectors.iscsi [None req-1753685d-6fcb-4f64-b492-96e19693e575 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 16:26:39 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909 -p 172.16.0.220:3260 {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:26:39 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:26:39 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[73b5a9f5-cd98-4c53-8076-2a4f3aa8d6ac]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:26:39 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-1753685d-6fcb-4f64-b492-96e19693e575 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 16:26:39 user nova-compute[71874]:  {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:26:39 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909 -p 172.16.0.220:3260 --interface default --op new {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:26:39 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:26:39 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb2007ce-c249-4eed-bd13-9f155508c209]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909] added\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:26:39 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-1753685d-6fcb-4f64-b492-96e19693e575 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909] added
Apr 12 16:26:39 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:26:39 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:26:39 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:26:39 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d4fc712-9873-45f2-bfbe-f4f89ed14fc6]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:26:39 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-1753685d-6fcb-4f64-b492-96e19693e575 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:26:39 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:26:39 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:26:39 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[d61f33f7-8685-4ad3-8372-ac5859bab644]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:26:39 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-1753685d-6fcb-4f64-b492-96e19693e575 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:26:39 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ChyEKuGP {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:26:39 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ChyEKuGP" returned: 0 in 0.020s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:26:39 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9f2e19b-50e2-4032-a61f-5c0ab1392fdf]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:26:39 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-1753685d-6fcb-4f64-b492-96e19693e575 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ChyEKuGP'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:26:39 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:26:39 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:26:39 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[65512c5b-261e-4f29-9199-91a2bd7cc063]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:26:39 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-1753685d-6fcb-4f64-b492-96e19693e575 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:26:39 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:26:39 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:26:39 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8c40e0b-ddde-45c2-9197-1d17e86ad6c8]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:26:39 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-1753685d-6fcb-4f64-b492-96e19693e575 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 12 16:26:39 user nova-compute[71874]:  {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:26:39 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-1753685d-6fcb-4f64-b492-96e19693e575 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 12 16:26:39 user nova-compute[71874]:  {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:26:39 user nova-compute[71874]: WARNING os_brick.initiator.connectors.iscsi [None req-1753685d-6fcb-4f64-b492-96e19693e575 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 12 16:26:39 user nova-compute[71874]: 
Apr 12 16:26:39 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909 -p 172.16.0.220:3260 --login {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:26:40 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:26:40 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[688c58bd-443f-4cab-9cb0-ea53c7f4c75d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:26:40 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-1753685d-6fcb-4f64-b492-96e19693e575 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909, portal: 172.16.0.220,3260]
Apr 12 16:26:40 user nova-compute[71874]: Login to [iface: default, target: iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909, portal: 172.16.0.220,3260] successful.
Apr 12 16:26:40 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:26:40 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:26:40 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:26:40 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[707f66dc-8f90-41fe-8dbf-9b9e49a65e47]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:26:40 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-1753685d-6fcb-4f64-b492-96e19693e575 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:26:40 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:26:40 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:26:40 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[03b2c9ef-c3cd-400b-a988-b19c1a675ed3]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909 (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:26:40 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-1753685d-6fcb-4f64-b492-96e19693e575 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909 (non-flash)
Apr 12 16:26:40 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:26:40 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-1753685d-6fcb-4f64-b492-96e19693e575 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909 (non-flash)
Apr 12 16:26:40 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:26:40 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-1753685d-6fcb-4f64-b492-96e19693e575 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.252s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:26:40 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-1753685d-6fcb-4f64-b492-96e19693e575 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Connected to 172.16.0.220:3260 {{(pid=71874) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 16:26:40 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-1753685d-6fcb-4f64-b492-96e19693e575 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] HCTL ('33', '-', '-', 0) found on session 51 with lun 0 {{(pid=71874) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 16:26:40 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-1753685d-6fcb-4f64-b492-96e19693e575 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71874) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 16:26:40 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:26:40 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:26:40 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[233bac10-8a53-45c6-a982-b1cbca45a291]: (4, ('- - 0', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:26:40 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-1753685d-6fcb-4f64-b492-96e19693e575 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Searching for a device in session 51 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71874) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 16:26:40 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-1753685d-6fcb-4f64-b492-96e19693e575 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ChyEKuGP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71874) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 16:26:40 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:26:40 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Starting heal instance info cache {{(pid=71874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 16:26:40 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Rebuilding the list of instances to heal {{(pid=71874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 16:26:40 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] [instance: 2c01f491-2979-40d7-b74e-f580009309c5] Skipping network cache update for instance because it is Building. {{(pid=71874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9805}}
Apr 12 16:26:40 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquiring lock "refresh_cache-f31d2b1b-afbe-4fef-9ee4-f003842d5237" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:26:40 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquired lock "refresh_cache-f31d2b1b-afbe-4fef-9ee4-f003842d5237" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:26:40 user nova-compute[71874]: DEBUG nova.network.neutron [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] [instance: f31d2b1b-afbe-4fef-9ee4-f003842d5237] Forcefully refreshing network info cache for instance {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 16:26:40 user nova-compute[71874]: DEBUG nova.objects.instance [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lazy-loading 'info_cache' on Instance uuid f31d2b1b-afbe-4fef-9ee4-f003842d5237 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:26:41 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-1753685d-6fcb-4f64-b492-96e19693e575 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.281s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:26:41 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-1753685d-6fcb-4f64-b492-96e19693e575 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] <== connect_volume: return (1282ms) {'type': 'block', 'scsi_wwn': '23861323965396230', 'path': '/dev/sdb'} {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:26:41 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1753685d-6fcb-4f64-b492-96e19693e575 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 2c01f491-2979-40d7-b74e-f580009309c5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23861323965396230', 'path': '/dev/sdb'} {{(pid=71874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 16:26:41 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-1753685d-6fcb-4f64-b492-96e19693e575 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T16:26:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1740870386',display_name='tempest-TestVolumeBootPattern-server-1740870386',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1740870386',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGG/oSOmCDB20hkof5ViTlXYepxJsQ10bBtdYs7WKmIje03wdrGPlfe9DBPbPhAeMjSuszZPOH/w828DcGTtmLpZpE/aguNTugqw/I5GMmvTcJqr8fOGXLe6lzwKxF1ecQ==',key_name='tempest-TestVolumeBootPattern-2081417066',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='29b1b89a5eeb408a8d0938e5f59f405f',ramdisk_id='',reservation_id='r-821u600j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-734600841',owner_user_name='tempest-TestVolumeBootPattern-734600841-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T16:26:35Z,user_data=None,user_id='7054687447fc42339e9046ced4915890',uuid=2c01f491-2979-40d7-b74e-f580009309c5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "88022433-f52e-45f9-80a5-b93ca88aa273", "address": "fa:16:3e:8c:23:9e", "network": {"id": "1439244b-8287-4bba-a88c-99d4b498cccd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1491302639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29b1b89a5eeb408a8d0938e5f59f405f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88022433-f5", "ovs_interfaceid": "88022433-f52e-45f9-80a5-b93ca88aa273", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 16:26:41 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-1753685d-6fcb-4f64-b492-96e19693e575 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Converting VIF {"id": "88022433-f52e-45f9-80a5-b93ca88aa273", "address": "fa:16:3e:8c:23:9e", "network": {"id": "1439244b-8287-4bba-a88c-99d4b498cccd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1491302639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29b1b89a5eeb408a8d0938e5f59f405f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88022433-f5", "ovs_interfaceid": "88022433-f52e-45f9-80a5-b93ca88aa273", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:26:41 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-1753685d-6fcb-4f64-b492-96e19693e575 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:23:9e,bridge_name='br-int',has_traffic_filtering=True,id=88022433-f52e-45f9-80a5-b93ca88aa273,network=Network(1439244b-8287-4bba-a88c-99d4b498cccd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88022433-f5') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:26:41 user nova-compute[71874]: DEBUG nova.objects.instance [None req-1753685d-6fcb-4f64-b492-96e19693e575 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lazy-loading 'pci_devices' on Instance uuid 2c01f491-2979-40d7-b74e-f580009309c5 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:26:41 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-1753685d-6fcb-4f64-b492-96e19693e575 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 2c01f491-2979-40d7-b74e-f580009309c5] End _get_guest_xml xml=<domain type="kvm">
Apr 12 16:26:41 user nova-compute[71874]:   <uuid>2c01f491-2979-40d7-b74e-f580009309c5</uuid>
Apr 12 16:26:41 user nova-compute[71874]:   <name>instance-0000002e</name>
Apr 12 16:26:41 user nova-compute[71874]:   <memory>131072</memory>
Apr 12 16:26:41 user nova-compute[71874]:   <vcpu>1</vcpu>
Apr 12 16:26:41 user nova-compute[71874]:   <metadata>
Apr 12 16:26:41 user nova-compute[71874]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 16:26:41 user nova-compute[71874]:       <nova:package version="0.0.0"/>
Apr 12 16:26:41 user nova-compute[71874]:       <nova:name>tempest-TestVolumeBootPattern-server-1740870386</nova:name>
Apr 12 16:26:41 user nova-compute[71874]:       <nova:creationTime>2023-04-12 16:26:39</nova:creationTime>
Apr 12 16:26:41 user nova-compute[71874]:       <nova:flavor name="m1.nano">
Apr 12 16:26:41 user nova-compute[71874]:         <nova:memory>128</nova:memory>
Apr 12 16:26:41 user nova-compute[71874]:         <nova:disk>1</nova:disk>
Apr 12 16:26:41 user nova-compute[71874]:         <nova:swap>0</nova:swap>
Apr 12 16:26:41 user nova-compute[71874]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 16:26:41 user nova-compute[71874]:         <nova:vcpus>1</nova:vcpus>
Apr 12 16:26:41 user nova-compute[71874]:       </nova:flavor>
Apr 12 16:26:41 user nova-compute[71874]:       <nova:owner>
Apr 12 16:26:41 user nova-compute[71874]:         <nova:user uuid="7054687447fc42339e9046ced4915890">tempest-TestVolumeBootPattern-734600841-project-member</nova:user>
Apr 12 16:26:41 user nova-compute[71874]:         <nova:project uuid="29b1b89a5eeb408a8d0938e5f59f405f">tempest-TestVolumeBootPattern-734600841</nova:project>
Apr 12 16:26:41 user nova-compute[71874]:       </nova:owner>
Apr 12 16:26:41 user nova-compute[71874]:       <nova:ports>
Apr 12 16:26:41 user nova-compute[71874]:         <nova:port uuid="88022433-f52e-45f9-80a5-b93ca88aa273">
Apr 12 16:26:41 user nova-compute[71874]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 12 16:26:41 user nova-compute[71874]:         </nova:port>
Apr 12 16:26:41 user nova-compute[71874]:       </nova:ports>
Apr 12 16:26:41 user nova-compute[71874]:     </nova:instance>
Apr 12 16:26:41 user nova-compute[71874]:   </metadata>
Apr 12 16:26:41 user nova-compute[71874]:   <sysinfo type="smbios">
Apr 12 16:26:41 user nova-compute[71874]:     <system>
Apr 12 16:26:41 user nova-compute[71874]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 16:26:41 user nova-compute[71874]:       <entry name="product">OpenStack Nova</entry>
Apr 12 16:26:41 user nova-compute[71874]:       <entry name="version">0.0.0</entry>
Apr 12 16:26:41 user nova-compute[71874]:       <entry name="serial">2c01f491-2979-40d7-b74e-f580009309c5</entry>
Apr 12 16:26:41 user nova-compute[71874]:       <entry name="uuid">2c01f491-2979-40d7-b74e-f580009309c5</entry>
Apr 12 16:26:41 user nova-compute[71874]:       <entry name="family">Virtual Machine</entry>
Apr 12 16:26:41 user nova-compute[71874]:     </system>
Apr 12 16:26:41 user nova-compute[71874]:   </sysinfo>
Apr 12 16:26:41 user nova-compute[71874]:   <os>
Apr 12 16:26:41 user nova-compute[71874]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 16:26:41 user nova-compute[71874]:     <boot dev="hd"/>
Apr 12 16:26:41 user nova-compute[71874]:     <smbios mode="sysinfo"/>
Apr 12 16:26:41 user nova-compute[71874]:   </os>
Apr 12 16:26:41 user nova-compute[71874]:   <features>
Apr 12 16:26:41 user nova-compute[71874]:     <acpi/>
Apr 12 16:26:41 user nova-compute[71874]:     <apic/>
Apr 12 16:26:41 user nova-compute[71874]:     <vmcoreinfo/>
Apr 12 16:26:41 user nova-compute[71874]:   </features>
Apr 12 16:26:41 user nova-compute[71874]:   <clock offset="utc">
Apr 12 16:26:41 user nova-compute[71874]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 16:26:41 user nova-compute[71874]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 16:26:41 user nova-compute[71874]:     <timer name="hpet" present="no"/>
Apr 12 16:26:41 user nova-compute[71874]:   </clock>
Apr 12 16:26:41 user nova-compute[71874]:   <cpu mode="custom" match="exact">
Apr 12 16:26:41 user nova-compute[71874]:     <model>Nehalem</model>
Apr 12 16:26:41 user nova-compute[71874]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 16:26:41 user nova-compute[71874]:   </cpu>
Apr 12 16:26:41 user nova-compute[71874]:   <devices>
Apr 12 16:26:41 user nova-compute[71874]:     <disk type="block" device="disk">
Apr 12 16:26:41 user nova-compute[71874]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 16:26:41 user nova-compute[71874]:       <source dev="/dev/sdb"/>
Apr 12 16:26:41 user nova-compute[71874]:       <target dev="vda" bus="virtio"/>
Apr 12 16:26:41 user nova-compute[71874]:       <serial>7ae18173-eee9-4607-b0a7-940d48146909</serial>
Apr 12 16:26:41 user nova-compute[71874]:     </disk>
Apr 12 16:26:41 user nova-compute[71874]:     <interface type="ethernet">
Apr 12 16:26:41 user nova-compute[71874]:       <mac address="fa:16:3e:8c:23:9e"/>
Apr 12 16:26:41 user nova-compute[71874]:       <model type="virtio"/>
Apr 12 16:26:41 user nova-compute[71874]:       <mtu size="1442"/>
Apr 12 16:26:41 user nova-compute[71874]:       <target dev="tap88022433-f5"/>
Apr 12 16:26:41 user nova-compute[71874]:     </interface>
Apr 12 16:26:41 user nova-compute[71874]:     <serial type="pty">
Apr 12 16:26:41 user nova-compute[71874]:       <log file="/opt/stack/data/nova/instances/2c01f491-2979-40d7-b74e-f580009309c5/console.log" append="off"/>
Apr 12 16:26:41 user nova-compute[71874]:     </serial>
Apr 12 16:26:41 user nova-compute[71874]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 16:26:41 user nova-compute[71874]:     <video>
Apr 12 16:26:41 user nova-compute[71874]:       <model type="virtio"/>
Apr 12 16:26:41 user nova-compute[71874]:     </video>
Apr 12 16:26:41 user nova-compute[71874]:     <rng model="virtio">
Apr 12 16:26:41 user nova-compute[71874]:       <backend model="random">/dev/urandom</backend>
Apr 12 16:26:41 user nova-compute[71874]:     </rng>
Apr 12 16:26:41 user nova-compute[71874]:     <controller type="usb" index="0" model="none"/>
Apr 12 16:26:41 user nova-compute[71874]:     <memballoon model="virtio">
Apr 12 16:26:41 user nova-compute[71874]:       <stats period="10"/>
Apr 12 16:26:41 user nova-compute[71874]:     </memballoon>
Apr 12 16:26:41 user nova-compute[71874]:   </devices>
Apr 12 16:26:41 user nova-compute[71874]: </domain>
Apr 12 16:26:41 user nova-compute[71874]:  {{(pid=71874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 16:26:41 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-1753685d-6fcb-4f64-b492-96e19693e575 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T16:26:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1740870386',display_name='tempest-TestVolumeBootPattern-server-1740870386',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1740870386',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGG/oSOmCDB20hkof5ViTlXYepxJsQ10bBtdYs7WKmIje03wdrGPlfe9DBPbPhAeMjSuszZPOH/w828DcGTtmLpZpE/aguNTugqw/I5GMmvTcJqr8fOGXLe6lzwKxF1ecQ==',key_name='tempest-TestVolumeBootPattern-2081417066',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='29b1b89a5eeb408a8d0938e5f59f405f',ramdisk_id='',reservation_id='r-821u600j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-734600841',owner_user_name='tempest-TestVolumeBootPattern-734600841-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T16:26:35Z,user_data=None,user_id='7054687447fc42339e9046ced4915890',uuid=2c01f491-2979-40d7-b74e-f580009309c5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "88022433-f52e-45f9-80a5-b93ca88aa273", "address": "fa:16:3e:8c:23:9e", "network": {"id": "1439244b-8287-4bba-a88c-99d4b498cccd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1491302639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29b1b89a5eeb408a8d0938e5f59f405f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88022433-f5", "ovs_interfaceid": "88022433-f52e-45f9-80a5-b93ca88aa273", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 16:26:41 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-1753685d-6fcb-4f64-b492-96e19693e575 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Converting VIF {"id": "88022433-f52e-45f9-80a5-b93ca88aa273", "address": "fa:16:3e:8c:23:9e", "network": {"id": "1439244b-8287-4bba-a88c-99d4b498cccd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1491302639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29b1b89a5eeb408a8d0938e5f59f405f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88022433-f5", "ovs_interfaceid": "88022433-f52e-45f9-80a5-b93ca88aa273", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:26:41 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-1753685d-6fcb-4f64-b492-96e19693e575 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:23:9e,bridge_name='br-int',has_traffic_filtering=True,id=88022433-f52e-45f9-80a5-b93ca88aa273,network=Network(1439244b-8287-4bba-a88c-99d4b498cccd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88022433-f5') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:26:41 user nova-compute[71874]: DEBUG os_vif [None req-1753685d-6fcb-4f64-b492-96e19693e575 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:23:9e,bridge_name='br-int',has_traffic_filtering=True,id=88022433-f52e-45f9-80a5-b93ca88aa273,network=Network(1439244b-8287-4bba-a88c-99d4b498cccd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88022433-f5') {{(pid=71874) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 16:26:41 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:26:41 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:26:41 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 16:26:41 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:26:41 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap88022433-f5, may_exist=True) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:26:41 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap88022433-f5, col_values=(('external_ids', {'iface-id': '88022433-f52e-45f9-80a5-b93ca88aa273', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8c:23:9e', 'vm-uuid': '2c01f491-2979-40d7-b74e-f580009309c5'}),)) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:26:41 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:26:41 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:26:41 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:26:41 user nova-compute[71874]: INFO os_vif [None req-1753685d-6fcb-4f64-b492-96e19693e575 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:23:9e,bridge_name='br-int',has_traffic_filtering=True,id=88022433-f52e-45f9-80a5-b93ca88aa273,network=Network(1439244b-8287-4bba-a88c-99d4b498cccd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88022433-f5')
Apr 12 16:26:41 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-1753685d-6fcb-4f64-b492-96e19693e575 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] No BDM found with device name vda, not building metadata. {{(pid=71874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 16:26:41 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-1753685d-6fcb-4f64-b492-96e19693e575 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] No VIF found with MAC fa:16:3e:8c:23:9e, not building metadata {{(pid=71874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 16:26:41 user nova-compute[71874]: DEBUG nova.network.neutron [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] [instance: f31d2b1b-afbe-4fef-9ee4-f003842d5237] Updating instance_info_cache with network_info: [{"id": "ce90db7b-5efd-411b-a2f8-b7484a527704", "address": "fa:16:3e:e8:0f:22", "network": {"id": "8a87df1a-24b8-499e-a908-0d1fa99ed69a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-824466532-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "c91ef8cd37154632a031592cdc6792aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce90db7b-5e", "ovs_interfaceid": "ce90db7b-5efd-411b-a2f8-b7484a527704", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:26:41 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Releasing lock "refresh_cache-f31d2b1b-afbe-4fef-9ee4-f003842d5237" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:26:41 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] [instance: f31d2b1b-afbe-4fef-9ee4-f003842d5237] Updated the network info_cache for instance {{(pid=71874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 16:26:41 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:26:42 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:26:42 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:26:42 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:26:42 user nova-compute[71874]: DEBUG nova.compute.manager [req-7097f8c6-697a-4b01-8066-627994340331 req-b76a88da-8c18-440f-9f0b-219e0bba150b service nova] [instance: 2c01f491-2979-40d7-b74e-f580009309c5] Received event network-vif-plugged-88022433-f52e-45f9-80a5-b93ca88aa273 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:26:42 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-7097f8c6-697a-4b01-8066-627994340331 req-b76a88da-8c18-440f-9f0b-219e0bba150b service nova] Acquiring lock "2c01f491-2979-40d7-b74e-f580009309c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:26:42 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-7097f8c6-697a-4b01-8066-627994340331 req-b76a88da-8c18-440f-9f0b-219e0bba150b service nova] Lock "2c01f491-2979-40d7-b74e-f580009309c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:26:42 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-7097f8c6-697a-4b01-8066-627994340331 req-b76a88da-8c18-440f-9f0b-219e0bba150b service nova] Lock "2c01f491-2979-40d7-b74e-f580009309c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:26:42 user nova-compute[71874]: DEBUG nova.compute.manager [req-7097f8c6-697a-4b01-8066-627994340331 req-b76a88da-8c18-440f-9f0b-219e0bba150b service nova] [instance: 2c01f491-2979-40d7-b74e-f580009309c5] No waiting events found dispatching network-vif-plugged-88022433-f52e-45f9-80a5-b93ca88aa273 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:26:42 user nova-compute[71874]: WARNING nova.compute.manager [req-7097f8c6-697a-4b01-8066-627994340331 req-b76a88da-8c18-440f-9f0b-219e0bba150b service nova] [instance: 2c01f491-2979-40d7-b74e-f580009309c5] Received unexpected event network-vif-plugged-88022433-f52e-45f9-80a5-b93ca88aa273 for instance with vm_state building and task_state spawning.
Apr 12 16:26:43 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:26:43 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:26:43 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:26:43 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:26:44 user nova-compute[71874]: DEBUG nova.virt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Emitting event <LifecycleEvent: 1681316804.587667, 2c01f491-2979-40d7-b74e-f580009309c5 => Resumed> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:26:44 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 2c01f491-2979-40d7-b74e-f580009309c5] VM Resumed (Lifecycle Event)
Apr 12 16:26:44 user nova-compute[71874]: DEBUG nova.compute.manager [None req-1753685d-6fcb-4f64-b492-96e19693e575 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 2c01f491-2979-40d7-b74e-f580009309c5] Instance event wait completed in 0 seconds for  {{(pid=71874) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 16:26:44 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-1753685d-6fcb-4f64-b492-96e19693e575 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 2c01f491-2979-40d7-b74e-f580009309c5] Guest created on hypervisor {{(pid=71874) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 16:26:44 user nova-compute[71874]: INFO nova.virt.libvirt.driver [-] [instance: 2c01f491-2979-40d7-b74e-f580009309c5] Instance spawned successfully.
Apr 12 16:26:44 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-1753685d-6fcb-4f64-b492-96e19693e575 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 2c01f491-2979-40d7-b74e-f580009309c5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 16:26:44 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 2c01f491-2979-40d7-b74e-f580009309c5] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:26:44 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 2c01f491-2979-40d7-b74e-f580009309c5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 16:26:44 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-1753685d-6fcb-4f64-b492-96e19693e575 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 2c01f491-2979-40d7-b74e-f580009309c5] Found default for hw_cdrom_bus of ide {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:26:44 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-1753685d-6fcb-4f64-b492-96e19693e575 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 2c01f491-2979-40d7-b74e-f580009309c5] Found default for hw_disk_bus of virtio {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:26:44 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-1753685d-6fcb-4f64-b492-96e19693e575 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 2c01f491-2979-40d7-b74e-f580009309c5] Found default for hw_input_bus of None {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:26:44 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-1753685d-6fcb-4f64-b492-96e19693e575 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 2c01f491-2979-40d7-b74e-f580009309c5] Found default for hw_pointer_model of None {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:26:44 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-1753685d-6fcb-4f64-b492-96e19693e575 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 2c01f491-2979-40d7-b74e-f580009309c5] Found default for hw_video_model of virtio {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:26:44 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-1753685d-6fcb-4f64-b492-96e19693e575 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 2c01f491-2979-40d7-b74e-f580009309c5] Found default for hw_vif_model of virtio {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:26:44 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 2c01f491-2979-40d7-b74e-f580009309c5] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 16:26:44 user nova-compute[71874]: DEBUG nova.virt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Emitting event <LifecycleEvent: 1681316804.591153, 2c01f491-2979-40d7-b74e-f580009309c5 => Started> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:26:44 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 2c01f491-2979-40d7-b74e-f580009309c5] VM Started (Lifecycle Event)
Apr 12 16:26:44 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 2c01f491-2979-40d7-b74e-f580009309c5] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:26:44 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 2c01f491-2979-40d7-b74e-f580009309c5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 16:26:44 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 2c01f491-2979-40d7-b74e-f580009309c5] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 16:26:44 user nova-compute[71874]: INFO nova.compute.manager [None req-1753685d-6fcb-4f64-b492-96e19693e575 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 2c01f491-2979-40d7-b74e-f580009309c5] Took 4.95 seconds to spawn the instance on the hypervisor.
Apr 12 16:26:44 user nova-compute[71874]: DEBUG nova.compute.manager [None req-1753685d-6fcb-4f64-b492-96e19693e575 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 2c01f491-2979-40d7-b74e-f580009309c5] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:26:44 user nova-compute[71874]: INFO nova.compute.manager [None req-1753685d-6fcb-4f64-b492-96e19693e575 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 2c01f491-2979-40d7-b74e-f580009309c5] Took 10.06 seconds to build instance.
Apr 12 16:26:44 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-1753685d-6fcb-4f64-b492-96e19693e575 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "2c01f491-2979-40d7-b74e-f580009309c5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.158s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:26:44 user nova-compute[71874]: DEBUG nova.compute.manager [req-8c335daf-9d2e-4e62-ae8a-863a28c5212f req-8cdaecac-efb1-40c3-9327-e609722a7e4a service nova] [instance: 2c01f491-2979-40d7-b74e-f580009309c5] Received event network-vif-plugged-88022433-f52e-45f9-80a5-b93ca88aa273 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:26:44 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-8c335daf-9d2e-4e62-ae8a-863a28c5212f req-8cdaecac-efb1-40c3-9327-e609722a7e4a service nova] Acquiring lock "2c01f491-2979-40d7-b74e-f580009309c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:26:44 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-8c335daf-9d2e-4e62-ae8a-863a28c5212f req-8cdaecac-efb1-40c3-9327-e609722a7e4a service nova] Lock "2c01f491-2979-40d7-b74e-f580009309c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:26:44 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-8c335daf-9d2e-4e62-ae8a-863a28c5212f req-8cdaecac-efb1-40c3-9327-e609722a7e4a service nova] Lock "2c01f491-2979-40d7-b74e-f580009309c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:26:44 user nova-compute[71874]: DEBUG nova.compute.manager [req-8c335daf-9d2e-4e62-ae8a-863a28c5212f req-8cdaecac-efb1-40c3-9327-e609722a7e4a service nova] [instance: 2c01f491-2979-40d7-b74e-f580009309c5] No waiting events found dispatching network-vif-plugged-88022433-f52e-45f9-80a5-b93ca88aa273 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:26:44 user nova-compute[71874]: WARNING nova.compute.manager [req-8c335daf-9d2e-4e62-ae8a-863a28c5212f req-8cdaecac-efb1-40c3-9327-e609722a7e4a service nova] [instance: 2c01f491-2979-40d7-b74e-f580009309c5] Received unexpected event network-vif-plugged-88022433-f52e-45f9-80a5-b93ca88aa273 for instance with vm_state active and task_state None.
Apr 12 16:26:45 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:26:45 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:26:45 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71874) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 16:26:46 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:26:48 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:26:51 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:26:56 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:26:58 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:27:01 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:27:03 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:27:06 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:27:11 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:27:11 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:27:11 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71874) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 16:27:11 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71874) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 16:27:11 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71874) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 16:27:11 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:27:13 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:27:16 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:27:19 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:27:19 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:27:21 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:27:26 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:27:26 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:27:26 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71874) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 16:27:26 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71874) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 16:27:26 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71874) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 16:27:26 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:27:26 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-6cf7398f-8c5b-4738-b4b6-63f919fa764f tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Acquiring lock "f31d2b1b-afbe-4fef-9ee4-f003842d5237" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:27:26 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-6cf7398f-8c5b-4738-b4b6-63f919fa764f tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Lock "f31d2b1b-afbe-4fef-9ee4-f003842d5237" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:27:26 user nova-compute[71874]: DEBUG nova.objects.instance [None req-6cf7398f-8c5b-4738-b4b6-63f919fa764f tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Lazy-loading 'flavor' on Instance uuid f31d2b1b-afbe-4fef-9ee4-f003842d5237 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:27:27 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-6cf7398f-8c5b-4738-b4b6-63f919fa764f tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] [instance: f31d2b1b-afbe-4fef-9ee4-f003842d5237] Ignoring supplied device name: /dev/vdb
Apr 12 16:27:27 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-6cf7398f-8c5b-4738-b4b6-63f919fa764f tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Lock "f31d2b1b-afbe-4fef-9ee4-f003842d5237" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.078s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:27:27 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-6cf7398f-8c5b-4738-b4b6-63f919fa764f tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Acquiring lock "f31d2b1b-afbe-4fef-9ee4-f003842d5237" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:27:27 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-6cf7398f-8c5b-4738-b4b6-63f919fa764f tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Lock "f31d2b1b-afbe-4fef-9ee4-f003842d5237" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:27:27 user nova-compute[71874]: INFO nova.compute.manager [None req-6cf7398f-8c5b-4738-b4b6-63f919fa764f tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] [instance: f31d2b1b-afbe-4fef-9ee4-f003842d5237] Attaching volume db778c74-4764-46cf-9b9d-b6f3023dd52f to /dev/vdb
Apr 12 16:27:27 user nova-compute[71874]: DEBUG os_brick.utils [None req-6cf7398f-8c5b-4738-b4b6-63f919fa764f tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:27:27 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:27:27 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:27:27 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dfd7207-42fb-409f-9b84-b0ed8a49e283]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:61a48d4489d2\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:27:27 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:27:27 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:27:27 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bf296d2-5bef-49da-83f5-7186823e1b51]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:27:27 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:27:27 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:27:27 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[9953215a-450a-4d9b-8ef0-81f2be7ef6a8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:27:27 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0038b29-ecec-4db5-9eb9-21a64a60c590]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:27:27 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-6cf7398f-8c5b-4738-b4b6-63f919fa764f tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Running cmd (subprocess): nvme version {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:27:27 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-6cf7398f-8c5b-4738-b4b6-63f919fa764f tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] 'nvme version' failed. Not Retrying. {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 16:27:27 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6cf7398f-8c5b-4738-b4b6-63f919fa764f tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] nvme not present on system {{(pid=71874) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 16:27:27 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:27:27 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 16:27:27 user nova-compute[71874]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 16:27:27 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[71431fb5-6067-4fcd-acd2-7a0d559f4ae8]: (4, '') {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:27:27 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.lightos [None req-6cf7398f-8c5b-4738-b4b6-63f919fa764f tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71874) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 16:27:27 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.lightos [None req-6cf7398f-8c5b-4738-b4b6-63f919fa764f tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71874) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 16:27:27 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.lightos [None req-6cf7398f-8c5b-4738-b4b6-63f919fa764f tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] LIGHTOS: no hostnqn found. {{(pid=71874) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 16:27:27 user nova-compute[71874]: DEBUG os_brick.utils [None req-6cf7398f-8c5b-4738-b4b6-63f919fa764f tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:61a48d4489d2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:27:27 user nova-compute[71874]: DEBUG nova.virt.block_device [None req-6cf7398f-8c5b-4738-b4b6-63f919fa764f tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] [instance: f31d2b1b-afbe-4fef-9ee4-f003842d5237] Updating existing volume attachment record: 1508684b-3d70-4611-805f-286b8b289a0c {{(pid=71874) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 16:27:31 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:27:31 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6cf7398f-8c5b-4738-b4b6-63f919fa764f tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] [instance: f31d2b1b-afbe-4fef-9ee4-f003842d5237] Calling os-brick to attach iSCSI Volume {{(pid=71874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 16:27:31 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cf7398f-8c5b-4738-b4b6-63f919fa764f tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3c0216320>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:db778c74-4764-46cf-9b9d-b6f3023dd52f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BQjWzyba', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:27:31 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-6cf7398f-8c5b-4738-b4b6-63f919fa764f tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:27:31 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-6cf7398f-8c5b-4738-b4b6-63f919fa764f tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:27:31 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-6cf7398f-8c5b-4738-b4b6-63f919fa764f tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:27:31 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-6cf7398f-8c5b-4738-b4b6-63f919fa764f tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:27:31 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-6cf7398f-8c5b-4738-b4b6-63f919fa764f tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db778c74-4764-46cf-9b9d-b6f3023dd52f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:27:31 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-6cf7398f-8c5b-4738-b4b6-63f919fa764f tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db778c74-4764-46cf-9b9d-b6f3023dd52f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:27:31 user nova-compute[71874]: INFO os_brick.initiator.connectors.iscsi [None req-6cf7398f-8c5b-4738-b4b6-63f919fa764f tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 16:27:31 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db778c74-4764-46cf-9b9d-b6f3023dd52f -p 172.16.0.220:3260 {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:27:31 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db778c74-4764-46cf-9b9d-b6f3023dd52f -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:27:31 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a14bd80-7722-4108-be3a-c8b522430981]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:27:31 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cf7398f-8c5b-4738-b4b6-63f919fa764f tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 16:27:31 user nova-compute[71874]:  {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:27:31 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db778c74-4764-46cf-9b9d-b6f3023dd52f -p 172.16.0.220:3260 --interface default --op new {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:27:31 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db778c74-4764-46cf-9b9d-b6f3023dd52f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:27:31 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[b92e204b-3a74-4cfc-bd8a-b3001c6d4e9d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:db778c74-4764-46cf-9b9d-b6f3023dd52f] added\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:27:31 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cf7398f-8c5b-4738-b4b6-63f919fa764f tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:db778c74-4764-46cf-9b9d-b6f3023dd52f] added
Apr 12 16:27:31 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:27:31 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db778c74-4764-46cf-9b9d-b6f3023dd52f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:27:31 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db778c74-4764-46cf-9b9d-b6f3023dd52f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:27:31 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[d33ad8d6-fe67-4528-8270-fd271d2effd0]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:27:31 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cf7398f-8c5b-4738-b4b6-63f919fa764f tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:27:31 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db778c74-4764-46cf-9b9d-b6f3023dd52f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:27:31 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db778c74-4764-46cf-9b9d-b6f3023dd52f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:27:31 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ebcfa60-bd59-43ca-accf-692427cb1080]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:27:31 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cf7398f-8c5b-4738-b4b6-63f919fa764f tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:27:32 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db778c74-4764-46cf-9b9d-b6f3023dd52f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BQjWzyba {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:27:32 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db778c74-4764-46cf-9b9d-b6f3023dd52f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BQjWzyba" returned: 0 in 0.056s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:27:32 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff306583-d83d-4ef9-b1f9-9032aa42e953]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:27:32 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cf7398f-8c5b-4738-b4b6-63f919fa764f tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BQjWzyba'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:27:32 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db778c74-4764-46cf-9b9d-b6f3023dd52f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:27:32 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db778c74-4764-46cf-9b9d-b6f3023dd52f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:27:32 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[28751ef6-7de1-4022-b631-9bfd1ebd5470]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:27:32 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cf7398f-8c5b-4738-b4b6-63f919fa764f tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:27:32 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:27:32 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:27:32 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[371bfe1c-d6de-428e-8176-9ec80df1ee24]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909 (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:27:32 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cf7398f-8c5b-4738-b4b6-63f919fa764f tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909 (non-flash)
Apr 12 16:27:32 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:27:32 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cf7398f-8c5b-4738-b4b6-63f919fa764f tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909 (non-flash)
Apr 12 16:27:32 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:27:32 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db778c74-4764-46cf-9b9d-b6f3023dd52f -p 172.16.0.220:3260 --login {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:27:32 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db778c74-4764-46cf-9b9d-b6f3023dd52f -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:27:32 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[96976bfc-cf5b-4c92-83fe-740e78c61a03]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:db778c74-4764-46cf-9b9d-b6f3023dd52f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:db778c74-4764-46cf-9b9d-b6f3023dd52f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:27:32 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cf7398f-8c5b-4738-b4b6-63f919fa764f tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:db778c74-4764-46cf-9b9d-b6f3023dd52f, portal: 172.16.0.220,3260]
Apr 12 16:27:32 user nova-compute[71874]: Login to [iface: default, target: iqn.2010-10.org.openstack:db778c74-4764-46cf-9b9d-b6f3023dd52f, portal: 172.16.0.220,3260] successful.
Apr 12 16:27:32 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:27:32 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db778c74-4764-46cf-9b9d-b6f3023dd52f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:27:32 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db778c74-4764-46cf-9b9d-b6f3023dd52f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:27:32 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[808f6830-7e42-4582-b597-9f398f5e6474]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:27:32 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cf7398f-8c5b-4738-b4b6-63f919fa764f tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:27:32 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:27:32 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:27:32 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[abf7e936-6e49-4389-83b8-b51b59edea32]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db778c74-4764-46cf-9b9d-b6f3023dd52f (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:27:32 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cf7398f-8c5b-4738-b4b6-63f919fa764f tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909 (non-flash)
Apr 12 16:27:32 user nova-compute[71874]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db778c74-4764-46cf-9b9d-b6f3023dd52f (non-flash)
Apr 12 16:27:32 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:27:32 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cf7398f-8c5b-4738-b4b6-63f919fa764f tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909 (non-flash)
Apr 12 16:27:32 user nova-compute[71874]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db778c74-4764-46cf-9b9d-b6f3023dd52f (non-flash)
Apr 12 16:27:32 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:27:32 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-6cf7398f-8c5b-4738-b4b6-63f919fa764f tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db778c74-4764-46cf-9b9d-b6f3023dd52f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.316s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:27:32 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cf7398f-8c5b-4738-b4b6-63f919fa764f tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Connected to 172.16.0.220:3260 {{(pid=71874) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 16:27:32 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-6cf7398f-8c5b-4738-b4b6-63f919fa764f tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] HCTL ('34', '-', '-', 0) found on session 52 with lun 0 {{(pid=71874) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 16:27:32 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-6cf7398f-8c5b-4738-b4b6-63f919fa764f tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71874) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 16:27:32 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:27:32 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:27:32 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[f23f2786-f77d-41cb-b567-750333b3c41c]: (4, ('- - 0', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:27:32 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-6cf7398f-8c5b-4738-b4b6-63f919fa764f tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Searching for a device in session 52 and hctl ['34', '*', '*', 0] yield: None {{(pid=71874) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 16:27:33 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-6cf7398f-8c5b-4738-b4b6-63f919fa764f tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Searching for a device in session 52 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71874) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 16:27:33 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cf7398f-8c5b-4738-b4b6-63f919fa764f tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:db778c74-4764-46cf-9b9d-b6f3023dd52f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BQjWzyba', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71874) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 16:27:33 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-6cf7398f-8c5b-4738-b4b6-63f919fa764f tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.346s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:27:33 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cf7398f-8c5b-4738-b4b6-63f919fa764f tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] <== connect_volume: return (1348ms) {'type': 'block', 'scsi_wwn': '26535636630386136', 'path': '/dev/sdc'} {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:27:33 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6cf7398f-8c5b-4738-b4b6-63f919fa764f tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] [instance: f31d2b1b-afbe-4fef-9ee4-f003842d5237] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26535636630386136', 'path': '/dev/sdc'} {{(pid=71874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 16:27:33 user nova-compute[71874]: DEBUG nova.objects.instance [None req-6cf7398f-8c5b-4738-b4b6-63f919fa764f tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Lazy-loading 'flavor' on Instance uuid f31d2b1b-afbe-4fef-9ee4-f003842d5237 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:27:33 user nova-compute[71874]: DEBUG nova.virt.libvirt.guest [None req-6cf7398f-8c5b-4738-b4b6-63f919fa764f tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 16:27:33 user nova-compute[71874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 16:27:33 user nova-compute[71874]:   <source dev="/dev/sdc"/>
Apr 12 16:27:33 user nova-compute[71874]:   <target dev="vdb" bus="virtio"/>
Apr 12 16:27:33 user nova-compute[71874]:   <serial>db778c74-4764-46cf-9b9d-b6f3023dd52f</serial>
Apr 12 16:27:33 user nova-compute[71874]: </disk>
Apr 12 16:27:33 user nova-compute[71874]:  {{(pid=71874) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 16:27:33 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:27:33 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-6cf7398f-8c5b-4738-b4b6-63f919fa764f tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] No BDM found with device name vda, not building metadata. {{(pid=71874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 16:27:33 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-6cf7398f-8c5b-4738-b4b6-63f919fa764f tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 16:27:33 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-6cf7398f-8c5b-4738-b4b6-63f919fa764f tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] No VIF found with MAC fa:16:3e:e8:0f:22, not building metadata {{(pid=71874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 16:27:33 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-6cf7398f-8c5b-4738-b4b6-63f919fa764f tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Lock "f31d2b1b-afbe-4fef-9ee4-f003842d5237" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.586s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:27:35 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:27:35 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:27:35 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:27:35 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:27:35 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Auditing locally available compute resources for user (node: user) {{(pid=71874) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 16:27:36 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 16:27:36 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f31d2b1b-afbe-4fef-9ee4-f003842d5237/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:27:36 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:27:36 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f31d2b1b-afbe-4fef-9ee4-f003842d5237/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:27:36 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f31d2b1b-afbe-4fef-9ee4-f003842d5237/disk --force-share --output=json {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:27:36 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f31d2b1b-afbe-4fef-9ee4-f003842d5237/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:27:36 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 16:27:36 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:27:36 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:27:36 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Hypervisor/Node resource view: name=user free_ram=8575MB free_disk=25.92657470703125GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71874) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 16:27:36 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:27:36 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:27:36 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance f31d2b1b-afbe-4fef-9ee4-f003842d5237 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:27:36 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 2c01f491-2979-40d7-b74e-f580009309c5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:27:36 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=71874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 16:27:36 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=71874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 16:27:36 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Inventory has not changed in ProviderTree for provider: 0e94b4c8-cd49-45e4-9133-d36eb4b2456b {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 16:27:37 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Inventory has not changed for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 16:27:37 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Compute_service record updated for user:user {{(pid=71874) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 16:27:37 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.235s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:27:38 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:27:38 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:27:38 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:27:38 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:27:39 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:27:41 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:27:41 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:27:41 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Starting heal instance info cache {{(pid=71874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 16:27:41 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Rebuilding the list of instances to heal {{(pid=71874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 16:27:41 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquiring lock "refresh_cache-f31d2b1b-afbe-4fef-9ee4-f003842d5237" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:27:41 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquired lock "refresh_cache-f31d2b1b-afbe-4fef-9ee4-f003842d5237" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:27:41 user nova-compute[71874]: DEBUG nova.network.neutron [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] [instance: f31d2b1b-afbe-4fef-9ee4-f003842d5237] Forcefully refreshing network info cache for instance {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 16:27:41 user nova-compute[71874]: DEBUG nova.objects.instance [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lazy-loading 'info_cache' on Instance uuid f31d2b1b-afbe-4fef-9ee4-f003842d5237 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:27:42 user nova-compute[71874]: DEBUG nova.network.neutron [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] [instance: f31d2b1b-afbe-4fef-9ee4-f003842d5237] Updating instance_info_cache with network_info: [{"id": "ce90db7b-5efd-411b-a2f8-b7484a527704", "address": "fa:16:3e:e8:0f:22", "network": {"id": "8a87df1a-24b8-499e-a908-0d1fa99ed69a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-824466532-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "c91ef8cd37154632a031592cdc6792aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce90db7b-5e", "ovs_interfaceid": "ce90db7b-5efd-411b-a2f8-b7484a527704", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:27:42 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Releasing lock "refresh_cache-f31d2b1b-afbe-4fef-9ee4-f003842d5237" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:27:42 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] [instance: f31d2b1b-afbe-4fef-9ee4-f003842d5237] Updated the network info_cache for instance {{(pid=71874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 16:27:42 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:27:45 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:27:45 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:27:45 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71874) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 16:27:46 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-a10c66d7-97ed-404b-a100-0027dfa46a0e tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Acquiring lock "f31d2b1b-afbe-4fef-9ee4-f003842d5237" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:27:46 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-a10c66d7-97ed-404b-a100-0027dfa46a0e tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Lock "f31d2b1b-afbe-4fef-9ee4-f003842d5237" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:27:46 user nova-compute[71874]: INFO nova.compute.manager [None req-a10c66d7-97ed-404b-a100-0027dfa46a0e tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] [instance: f31d2b1b-afbe-4fef-9ee4-f003842d5237] Detaching volume db778c74-4764-46cf-9b9d-b6f3023dd52f
Apr 12 16:27:46 user nova-compute[71874]: INFO nova.virt.block_device [None req-a10c66d7-97ed-404b-a100-0027dfa46a0e tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] [instance: f31d2b1b-afbe-4fef-9ee4-f003842d5237] Attempting to driver detach volume db778c74-4764-46cf-9b9d-b6f3023dd52f from mountpoint /dev/vdb
Apr 12 16:27:46 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-a10c66d7-97ed-404b-a100-0027dfa46a0e tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Attempting to detach device vdb from instance f31d2b1b-afbe-4fef-9ee4-f003842d5237 from the persistent domain config. {{(pid=71874) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 16:27:46 user nova-compute[71874]: DEBUG nova.virt.libvirt.guest [None req-a10c66d7-97ed-404b-a100-0027dfa46a0e tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 16:27:46 user nova-compute[71874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 16:27:46 user nova-compute[71874]:   <source dev="/dev/sdc"/>
Apr 12 16:27:46 user nova-compute[71874]:   <target dev="vdb" bus="virtio"/>
Apr 12 16:27:46 user nova-compute[71874]:   <serial>db778c74-4764-46cf-9b9d-b6f3023dd52f</serial>
Apr 12 16:27:46 user nova-compute[71874]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 16:27:46 user nova-compute[71874]: </disk>
Apr 12 16:27:46 user nova-compute[71874]:  {{(pid=71874) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 16:27:46 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-a10c66d7-97ed-404b-a100-0027dfa46a0e tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Successfully detached device vdb from instance f31d2b1b-afbe-4fef-9ee4-f003842d5237 from the persistent domain config.
Apr 12 16:27:46 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-a10c66d7-97ed-404b-a100-0027dfa46a0e tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f31d2b1b-afbe-4fef-9ee4-f003842d5237 from the live domain config. {{(pid=71874) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 16:27:46 user nova-compute[71874]: DEBUG nova.virt.libvirt.guest [None req-a10c66d7-97ed-404b-a100-0027dfa46a0e tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 16:27:46 user nova-compute[71874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 16:27:46 user nova-compute[71874]:   <source dev="/dev/sdc"/>
Apr 12 16:27:46 user nova-compute[71874]:   <target dev="vdb" bus="virtio"/>
Apr 12 16:27:46 user nova-compute[71874]:   <serial>db778c74-4764-46cf-9b9d-b6f3023dd52f</serial>
Apr 12 16:27:46 user nova-compute[71874]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 16:27:46 user nova-compute[71874]: </disk>
Apr 12 16:27:46 user nova-compute[71874]:  {{(pid=71874) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 16:27:46 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:27:46 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-18ebb6c3-0702-4886-96a1-2bd63cc75e8e tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Acquiring lock "f31d2b1b-afbe-4fef-9ee4-f003842d5237" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:27:46 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:27:46 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71874) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 16:27:46 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71874) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 16:27:46 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71874) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 16:27:46 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:27:46 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Received event <DeviceRemovedEvent: 1681316866.563437, f31d2b1b-afbe-4fef-9ee4-f003842d5237 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71874) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 16:27:46 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-a10c66d7-97ed-404b-a100-0027dfa46a0e tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f31d2b1b-afbe-4fef-9ee4-f003842d5237 {{(pid=71874) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 16:27:46 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-a10c66d7-97ed-404b-a100-0027dfa46a0e tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Successfully detached device vdb from instance f31d2b1b-afbe-4fef-9ee4-f003842d5237 from the live domain config.
Apr 12 16:27:46 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a10c66d7-97ed-404b-a100-0027dfa46a0e tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] [instance: f31d2b1b-afbe-4fef-9ee4-f003842d5237] calling os-brick to detach iSCSI Volume {{(pid=71874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 16:27:46 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-a10c66d7-97ed-404b-a100-0027dfa46a0e tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3c0216320>, {'target_iqn': 'iqn.2010-10.org.openstack:db778c74-4764-46cf-9b9d-b6f3023dd52f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BQjWzyba', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:27:46 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-a10c66d7-97ed-404b-a100-0027dfa46a0e tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:27:46 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-a10c66d7-97ed-404b-a100-0027dfa46a0e tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:27:46 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-a10c66d7-97ed-404b-a100-0027dfa46a0e tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:27:46 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:27:46 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:27:46 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca2df641-a7c3-426e-bef7-7c7d3097e78a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:db778c74-4764-46cf-9b9d-b6f3023dd52f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:27:46 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-a10c66d7-97ed-404b-a100-0027dfa46a0e tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 16:27:46 user nova-compute[71874]: No targets found.
Apr 12 16:27:46 user nova-compute[71874]: iSNS:
Apr 12 16:27:46 user nova-compute[71874]: No targets found.
Apr 12 16:27:46 user nova-compute[71874]: STATIC:
Apr 12 16:27:46 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:db778c74-4764-46cf-9b9d-b6f3023dd52f
Apr 12 16:27:46 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:27:46 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:27:46 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909
Apr 12 16:27:46 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:27:46 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:27:46 user nova-compute[71874]: FIRMWARE:
Apr 12 16:27:46 user nova-compute[71874]: No targets found.
Apr 12 16:27:46 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:27:46 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-a10c66d7-97ed-404b-a100-0027dfa46a0e tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 16:27:46 user nova-compute[71874]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 16:27:46 user nova-compute[71874]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71874) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 16:27:46 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-a10c66d7-97ed-404b-a100-0027dfa46a0e tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:db778c74-4764-46cf-9b9d-b6f3023dd52f', 0)] {{(pid=71874) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 16:27:46 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:27:46 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:27:46 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[416db2e0-db15-4cf1-833b-8d649d3c845c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:db778c74-4764-46cf-9b9d-b6f3023dd52f\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:27:46 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:27:46 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:27:46 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[75ed841b-5b92-4e07-a9d3-982e597416f4]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db778c74-4764-46cf-9b9d-b6f3023dd52f (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:27:46 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-a10c66d7-97ed-404b-a100-0027dfa46a0e tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909 (non-flash)
Apr 12 16:27:46 user nova-compute[71874]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db778c74-4764-46cf-9b9d-b6f3023dd52f (non-flash)
Apr 12 16:27:46 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:27:46 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-a10c66d7-97ed-404b-a100-0027dfa46a0e tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909 (non-flash)
Apr 12 16:27:46 user nova-compute[71874]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db778c74-4764-46cf-9b9d-b6f3023dd52f (non-flash)
Apr 12 16:27:46 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:27:46 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-a10c66d7-97ed-404b-a100-0027dfa46a0e tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc3c01c2050>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:db778c74-4764-46cf-9b9d-b6f3023dd52f'): ({'sdc'}, set())}) {{(pid=71874) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 16:27:46 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-a10c66d7-97ed-404b-a100-0027dfa46a0e tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Removing single pathed devices sdc {{(pid=71874) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 16:27:46 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:27:46 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:27:46 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bdae4a1-96a8-4835-bd00-98f8faac2aad]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:27:46 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:27:46 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:27:46 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[b710b1a9-1a11-4e42-a4a7-dc1c9be3640b]: (4, ('ok\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:27:46 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-a10c66d7-97ed-404b-a100-0027dfa46a0e tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Flushing IO for device /dev/sdc {{(pid=71874) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 16:27:46 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:27:46 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:27:46 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[cff78567-b361-4692-bf44-52fb75db5a58]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:27:46 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-a10c66d7-97ed-404b-a100-0027dfa46a0e tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71874) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 16:27:46 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:27:46 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:27:46 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dd13bae-b9de-4f4f-a1f5-5c2dd5bcc212]: (4, ('1', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:27:46 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-a10c66d7-97ed-404b-a100-0027dfa46a0e tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71874) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 16:27:46 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-a10c66d7-97ed-404b-a100-0027dfa46a0e tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] SCSI volumes sdc have been removed. {{(pid=71874) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 16:27:46 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-a10c66d7-97ed-404b-a100-0027dfa46a0e tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:db778c74-4764-46cf-9b9d-b6f3023dd52f')] {{(pid=71874) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 16:27:46 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db778c74-4764-46cf-9b9d-b6f3023dd52f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:27:46 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db778c74-4764-46cf-9b9d-b6f3023dd52f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:27:46 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[b15c5fc9-e3d4-43df-8d3a-90c941efb990]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:27:46 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-a10c66d7-97ed-404b-a100-0027dfa46a0e tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:27:46 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db778c74-4764-46cf-9b9d-b6f3023dd52f -p 172.16.0.220:3260 --logout {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:27:46 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db778c74-4764-46cf-9b9d-b6f3023dd52f -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:27:46 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[12ce2cf1-c74d-4a72-840a-a11a5e5eb34c]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:db778c74-4764-46cf-9b9d-b6f3023dd52f, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:db778c74-4764-46cf-9b9d-b6f3023dd52f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:27:46 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-a10c66d7-97ed-404b-a100-0027dfa46a0e tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:db778c74-4764-46cf-9b9d-b6f3023dd52f, portal: 172.16.0.220,3260]
Apr 12 16:27:46 user nova-compute[71874]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:db778c74-4764-46cf-9b9d-b6f3023dd52f, portal: 172.16.0.220,3260] successful.
Apr 12 16:27:46 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:27:46 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db778c74-4764-46cf-9b9d-b6f3023dd52f -p 172.16.0.220:3260 --op delete {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:27:46 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db778c74-4764-46cf-9b9d-b6f3023dd52f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:27:46 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[99e0202b-2df9-4881-b4a9-2e1640692725]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:27:46 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-a10c66d7-97ed-404b-a100-0027dfa46a0e tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:27:46 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-a10c66d7-97ed-404b-a100-0027dfa46a0e tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:27:46 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-a10c66d7-97ed-404b-a100-0027dfa46a0e tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] <== disconnect_volume: return (305ms) None {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:27:46 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a10c66d7-97ed-404b-a100-0027dfa46a0e tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] [instance: f31d2b1b-afbe-4fef-9ee4-f003842d5237] Disconnected iSCSI Volume {{(pid=71874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 16:27:47 user nova-compute[71874]: DEBUG nova.objects.instance [None req-a10c66d7-97ed-404b-a100-0027dfa46a0e tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Lazy-loading 'flavor' on Instance uuid f31d2b1b-afbe-4fef-9ee4-f003842d5237 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:27:47 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-a10c66d7-97ed-404b-a100-0027dfa46a0e tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Lock "f31d2b1b-afbe-4fef-9ee4-f003842d5237" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.617s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:27:47 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-18ebb6c3-0702-4886-96a1-2bd63cc75e8e tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Lock "f31d2b1b-afbe-4fef-9ee4-f003842d5237" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.494s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:27:47 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-18ebb6c3-0702-4886-96a1-2bd63cc75e8e tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Acquiring lock "f31d2b1b-afbe-4fef-9ee4-f003842d5237-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:27:47 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-18ebb6c3-0702-4886-96a1-2bd63cc75e8e tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Lock "f31d2b1b-afbe-4fef-9ee4-f003842d5237-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:27:47 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-18ebb6c3-0702-4886-96a1-2bd63cc75e8e tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Lock "f31d2b1b-afbe-4fef-9ee4-f003842d5237-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:27:47 user nova-compute[71874]: INFO nova.compute.manager [None req-18ebb6c3-0702-4886-96a1-2bd63cc75e8e tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] [instance: f31d2b1b-afbe-4fef-9ee4-f003842d5237] Terminating instance
Apr 12 16:27:47 user nova-compute[71874]: DEBUG nova.compute.manager [None req-18ebb6c3-0702-4886-96a1-2bd63cc75e8e tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] [instance: f31d2b1b-afbe-4fef-9ee4-f003842d5237] Start destroying the instance on the hypervisor. {{(pid=71874) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 16:27:47 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:27:47 user nova-compute[71874]: DEBUG nova.compute.manager [req-cee01b18-8730-43ec-813f-d233213e834d req-10091f2d-85ff-4944-b3e9-c94240fe597e service nova] [instance: f31d2b1b-afbe-4fef-9ee4-f003842d5237] Received event network-vif-unplugged-ce90db7b-5efd-411b-a2f8-b7484a527704 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:27:47 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-cee01b18-8730-43ec-813f-d233213e834d req-10091f2d-85ff-4944-b3e9-c94240fe597e service nova] Acquiring lock "f31d2b1b-afbe-4fef-9ee4-f003842d5237-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:27:47 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-cee01b18-8730-43ec-813f-d233213e834d req-10091f2d-85ff-4944-b3e9-c94240fe597e service nova] Lock "f31d2b1b-afbe-4fef-9ee4-f003842d5237-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:27:47 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-cee01b18-8730-43ec-813f-d233213e834d req-10091f2d-85ff-4944-b3e9-c94240fe597e service nova] Lock "f31d2b1b-afbe-4fef-9ee4-f003842d5237-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:27:47 user nova-compute[71874]: DEBUG nova.compute.manager [req-cee01b18-8730-43ec-813f-d233213e834d req-10091f2d-85ff-4944-b3e9-c94240fe597e service nova] [instance: f31d2b1b-afbe-4fef-9ee4-f003842d5237] No waiting events found dispatching network-vif-unplugged-ce90db7b-5efd-411b-a2f8-b7484a527704 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:27:47 user nova-compute[71874]: DEBUG nova.compute.manager [req-cee01b18-8730-43ec-813f-d233213e834d req-10091f2d-85ff-4944-b3e9-c94240fe597e service nova] [instance: f31d2b1b-afbe-4fef-9ee4-f003842d5237] Received event network-vif-unplugged-ce90db7b-5efd-411b-a2f8-b7484a527704 for instance with task_state deleting. {{(pid=71874) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 16:27:48 user nova-compute[71874]: INFO nova.virt.libvirt.driver [-] [instance: f31d2b1b-afbe-4fef-9ee4-f003842d5237] Instance destroyed successfully.
Apr 12 16:27:48 user nova-compute[71874]: DEBUG nova.objects.instance [None req-18ebb6c3-0702-4886-96a1-2bd63cc75e8e tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Lazy-loading 'resources' on Instance uuid f31d2b1b-afbe-4fef-9ee4-f003842d5237 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:27:48 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-18ebb6c3-0702-4886-96a1-2bd63cc75e8e tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T16:25:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1016540753',display_name='tempest-VolumesSnapshotTestJSON-instance-1016540753',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1016540753',id=45,image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T16:25:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c91ef8cd37154632a031592cdc6792aa',ramdisk_id='',reservation_id='r-uv64k0jq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1094479403',owner_user_name='tempest-VolumesSnapshotTestJSON-1094479403-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T16:25:43Z,user_data=None,user_id='c9173175144449a391d282ba8978c9d9',uuid=f31d2b1b-afbe-4fef-9ee4-f003842d5237,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ce90db7b-5efd-411b-a2f8-b7484a527704", "address": "fa:16:3e:e8:0f:22", "network": {"id": "8a87df1a-24b8-499e-a908-0d1fa99ed69a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-824466532-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "c91ef8cd37154632a031592cdc6792aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce90db7b-5e", "ovs_interfaceid": "ce90db7b-5efd-411b-a2f8-b7484a527704", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 16:27:48 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-18ebb6c3-0702-4886-96a1-2bd63cc75e8e tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Converting VIF {"id": "ce90db7b-5efd-411b-a2f8-b7484a527704", "address": "fa:16:3e:e8:0f:22", "network": {"id": "8a87df1a-24b8-499e-a908-0d1fa99ed69a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-824466532-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "c91ef8cd37154632a031592cdc6792aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce90db7b-5e", "ovs_interfaceid": "ce90db7b-5efd-411b-a2f8-b7484a527704", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:27:48 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-18ebb6c3-0702-4886-96a1-2bd63cc75e8e tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e8:0f:22,bridge_name='br-int',has_traffic_filtering=True,id=ce90db7b-5efd-411b-a2f8-b7484a527704,network=Network(8a87df1a-24b8-499e-a908-0d1fa99ed69a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce90db7b-5e') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:27:48 user nova-compute[71874]: DEBUG os_vif [None req-18ebb6c3-0702-4886-96a1-2bd63cc75e8e tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e8:0f:22,bridge_name='br-int',has_traffic_filtering=True,id=ce90db7b-5efd-411b-a2f8-b7484a527704,network=Network(8a87df1a-24b8-499e-a908-0d1fa99ed69a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce90db7b-5e') {{(pid=71874) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 16:27:48 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:27:48 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapce90db7b-5e, bridge=br-int, if_exists=True) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:27:48 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:27:48 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:27:48 user nova-compute[71874]: INFO os_vif [None req-18ebb6c3-0702-4886-96a1-2bd63cc75e8e tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e8:0f:22,bridge_name='br-int',has_traffic_filtering=True,id=ce90db7b-5efd-411b-a2f8-b7484a527704,network=Network(8a87df1a-24b8-499e-a908-0d1fa99ed69a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce90db7b-5e')
Apr 12 16:27:48 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18ebb6c3-0702-4886-96a1-2bd63cc75e8e tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] [instance: f31d2b1b-afbe-4fef-9ee4-f003842d5237] calling os-brick to detach iSCSI Volume {{(pid=71874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 16:27:48 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-18ebb6c3-0702-4886-96a1-2bd63cc75e8e tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3c0216320>, {'target_iqn': 'iqn.2010-10.org.openstack:db778c74-4764-46cf-9b9d-b6f3023dd52f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BQjWzyba', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:27:48 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-18ebb6c3-0702-4886-96a1-2bd63cc75e8e tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:27:48 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-18ebb6c3-0702-4886-96a1-2bd63cc75e8e tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:27:48 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-18ebb6c3-0702-4886-96a1-2bd63cc75e8e tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:27:48 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:27:48 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:27:48 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dca51dc-12f9-4381-9ec2-940627cca742]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:27:48 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-18ebb6c3-0702-4886-96a1-2bd63cc75e8e tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 16:27:48 user nova-compute[71874]: No targets found.
Apr 12 16:27:48 user nova-compute[71874]: iSNS:
Apr 12 16:27:48 user nova-compute[71874]: No targets found.
Apr 12 16:27:48 user nova-compute[71874]: STATIC:
Apr 12 16:27:48 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909
Apr 12 16:27:48 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:27:48 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:27:48 user nova-compute[71874]: FIRMWARE:
Apr 12 16:27:48 user nova-compute[71874]: No targets found.
Apr 12 16:27:48 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:27:48 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-18ebb6c3-0702-4886-96a1-2bd63cc75e8e tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 16:27:48 user nova-compute[71874]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 16:27:48 user nova-compute[71874]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71874) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 16:27:48 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-18ebb6c3-0702-4886-96a1-2bd63cc75e8e tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:db778c74-4764-46cf-9b9d-b6f3023dd52f', 0)] {{(pid=71874) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 16:27:48 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:27:48 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:27:48 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc400563-0e71-407a-9993-ddb3a826c9ca]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:27:48 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:27:48 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:27:48 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae0e9796-963a-44c0-b5c2-a739a0043c6d]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909 (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:27:48 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-18ebb6c3-0702-4886-96a1-2bd63cc75e8e tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909 (non-flash)
Apr 12 16:27:48 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:27:48 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-18ebb6c3-0702-4886-96a1-2bd63cc75e8e tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909 (non-flash)
Apr 12 16:27:48 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:27:48 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-18ebb6c3-0702-4886-96a1-2bd63cc75e8e tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc37d61e440>, {}) {{(pid=71874) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 16:27:48 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-18ebb6c3-0702-4886-96a1-2bd63cc75e8e tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Disconnecting from: [] {{(pid=71874) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 16:27:48 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-18ebb6c3-0702-4886-96a1-2bd63cc75e8e tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.065s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:27:48 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-18ebb6c3-0702-4886-96a1-2bd63cc75e8e tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] <== disconnect_volume: return (66ms) None {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:27:48 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18ebb6c3-0702-4886-96a1-2bd63cc75e8e tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] [instance: f31d2b1b-afbe-4fef-9ee4-f003842d5237] Disconnected iSCSI Volume {{(pid=71874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 16:27:48 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-18ebb6c3-0702-4886-96a1-2bd63cc75e8e tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] [instance: f31d2b1b-afbe-4fef-9ee4-f003842d5237] Deleting instance files /opt/stack/data/nova/instances/f31d2b1b-afbe-4fef-9ee4-f003842d5237_del
Apr 12 16:27:48 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-18ebb6c3-0702-4886-96a1-2bd63cc75e8e tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] [instance: f31d2b1b-afbe-4fef-9ee4-f003842d5237] Deletion of /opt/stack/data/nova/instances/f31d2b1b-afbe-4fef-9ee4-f003842d5237_del complete
Apr 12 16:27:48 user nova-compute[71874]: INFO nova.compute.manager [None req-18ebb6c3-0702-4886-96a1-2bd63cc75e8e tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] [instance: f31d2b1b-afbe-4fef-9ee4-f003842d5237] Took 0.93 seconds to destroy the instance on the hypervisor.
Apr 12 16:27:48 user nova-compute[71874]: DEBUG oslo.service.loopingcall [None req-18ebb6c3-0702-4886-96a1-2bd63cc75e8e tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71874) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 16:27:48 user nova-compute[71874]: DEBUG nova.compute.manager [-] [instance: f31d2b1b-afbe-4fef-9ee4-f003842d5237] Deallocating network for instance {{(pid=71874) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 16:27:48 user nova-compute[71874]: DEBUG nova.network.neutron [-] [instance: f31d2b1b-afbe-4fef-9ee4-f003842d5237] deallocate_for_instance() {{(pid=71874) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 16:27:49 user nova-compute[71874]: DEBUG nova.network.neutron [-] [instance: f31d2b1b-afbe-4fef-9ee4-f003842d5237] Updating instance_info_cache with network_info: [] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:27:49 user nova-compute[71874]: INFO nova.compute.manager [-] [instance: f31d2b1b-afbe-4fef-9ee4-f003842d5237] Took 0.45 seconds to deallocate network for instance.
Apr 12 16:27:49 user nova-compute[71874]: WARNING nova.volume.cinder [None req-18ebb6c3-0702-4886-96a1-2bd63cc75e8e tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Attachment 1508684b-3d70-4611-805f-286b8b289a0c does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 1508684b-3d70-4611-805f-286b8b289a0c. (HTTP 404) (Request-ID: req-9aacc883-0ba5-4bdb-8e23-a1f9856cf0b8)
Apr 12 16:27:49 user nova-compute[71874]: INFO nova.compute.manager [None req-18ebb6c3-0702-4886-96a1-2bd63cc75e8e tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] [instance: f31d2b1b-afbe-4fef-9ee4-f003842d5237] Took 0.02 seconds to detach 1 volumes for instance.
Apr 12 16:27:49 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-18ebb6c3-0702-4886-96a1-2bd63cc75e8e tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:27:49 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-18ebb6c3-0702-4886-96a1-2bd63cc75e8e tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:27:49 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-18ebb6c3-0702-4886-96a1-2bd63cc75e8e tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Inventory has not changed in ProviderTree for provider: 0e94b4c8-cd49-45e4-9133-d36eb4b2456b {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 16:27:49 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-18ebb6c3-0702-4886-96a1-2bd63cc75e8e tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Inventory has not changed for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 16:27:49 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-18ebb6c3-0702-4886-96a1-2bd63cc75e8e tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.130s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:27:49 user nova-compute[71874]: INFO nova.scheduler.client.report [None req-18ebb6c3-0702-4886-96a1-2bd63cc75e8e tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Deleted allocations for instance f31d2b1b-afbe-4fef-9ee4-f003842d5237
Apr 12 16:27:49 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-18ebb6c3-0702-4886-96a1-2bd63cc75e8e tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Lock "f31d2b1b-afbe-4fef-9ee4-f003842d5237" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.702s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:27:49 user nova-compute[71874]: DEBUG nova.compute.manager [req-8d8b829a-a35c-49c1-904f-a74b7a5326ed req-ebc87444-07fc-4e48-8d4d-5b4a3c10c5fb service nova] [instance: f31d2b1b-afbe-4fef-9ee4-f003842d5237] Received event network-vif-plugged-ce90db7b-5efd-411b-a2f8-b7484a527704 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:27:49 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-8d8b829a-a35c-49c1-904f-a74b7a5326ed req-ebc87444-07fc-4e48-8d4d-5b4a3c10c5fb service nova] Acquiring lock "f31d2b1b-afbe-4fef-9ee4-f003842d5237-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:27:49 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-8d8b829a-a35c-49c1-904f-a74b7a5326ed req-ebc87444-07fc-4e48-8d4d-5b4a3c10c5fb service nova] Lock "f31d2b1b-afbe-4fef-9ee4-f003842d5237-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:27:49 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-8d8b829a-a35c-49c1-904f-a74b7a5326ed req-ebc87444-07fc-4e48-8d4d-5b4a3c10c5fb service nova] Lock "f31d2b1b-afbe-4fef-9ee4-f003842d5237-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:27:49 user nova-compute[71874]: DEBUG nova.compute.manager [req-8d8b829a-a35c-49c1-904f-a74b7a5326ed req-ebc87444-07fc-4e48-8d4d-5b4a3c10c5fb service nova] [instance: f31d2b1b-afbe-4fef-9ee4-f003842d5237] No waiting events found dispatching network-vif-plugged-ce90db7b-5efd-411b-a2f8-b7484a527704 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:27:49 user nova-compute[71874]: WARNING nova.compute.manager [req-8d8b829a-a35c-49c1-904f-a74b7a5326ed req-ebc87444-07fc-4e48-8d4d-5b4a3c10c5fb service nova] [instance: f31d2b1b-afbe-4fef-9ee4-f003842d5237] Received unexpected event network-vif-plugged-ce90db7b-5efd-411b-a2f8-b7484a527704 for instance with vm_state deleted and task_state None.
Apr 12 16:27:49 user nova-compute[71874]: DEBUG nova.compute.manager [req-8d8b829a-a35c-49c1-904f-a74b7a5326ed req-ebc87444-07fc-4e48-8d4d-5b4a3c10c5fb service nova] [instance: f31d2b1b-afbe-4fef-9ee4-f003842d5237] Received event network-vif-deleted-ce90db7b-5efd-411b-a2f8-b7484a527704 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:27:53 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:27:58 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:28:03 user nova-compute[71874]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681316868.4485524, f31d2b1b-afbe-4fef-9ee4-f003842d5237 => Stopped> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:28:03 user nova-compute[71874]: INFO nova.compute.manager [-] [instance: f31d2b1b-afbe-4fef-9ee4-f003842d5237] VM Stopped (Lifecycle Event)
Apr 12 16:28:03 user nova-compute[71874]: DEBUG nova.compute.manager [None req-83d3d7f2-341c-4562-b144-8e3676078002 None None] [instance: f31d2b1b-afbe-4fef-9ee4-f003842d5237] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:28:03 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:28:03 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:28:03 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71874) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 16:28:03 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71874) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 16:28:03 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71874) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 16:28:03 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:28:08 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:28:08 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:28:13 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:28:18 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:28:18 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:28:18 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71874) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 16:28:18 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71874) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 16:28:18 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71874) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 16:28:18 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:28:23 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:28:26 user nova-compute[71874]: DEBUG nova.compute.manager [req-58f6c2ac-cfe5-4a20-ad0c-2d534aabbbd3 req-79e5582b-7da5-4fbd-81eb-5782056cefaa service nova] [instance: 2c01f491-2979-40d7-b74e-f580009309c5] Received event network-changed-88022433-f52e-45f9-80a5-b93ca88aa273 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:28:26 user nova-compute[71874]: DEBUG nova.compute.manager [req-58f6c2ac-cfe5-4a20-ad0c-2d534aabbbd3 req-79e5582b-7da5-4fbd-81eb-5782056cefaa service nova] [instance: 2c01f491-2979-40d7-b74e-f580009309c5] Refreshing instance network info cache due to event network-changed-88022433-f52e-45f9-80a5-b93ca88aa273. {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 16:28:26 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-58f6c2ac-cfe5-4a20-ad0c-2d534aabbbd3 req-79e5582b-7da5-4fbd-81eb-5782056cefaa service nova] Acquiring lock "refresh_cache-2c01f491-2979-40d7-b74e-f580009309c5" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:28:26 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-58f6c2ac-cfe5-4a20-ad0c-2d534aabbbd3 req-79e5582b-7da5-4fbd-81eb-5782056cefaa service nova] Acquired lock "refresh_cache-2c01f491-2979-40d7-b74e-f580009309c5" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:28:26 user nova-compute[71874]: DEBUG nova.network.neutron [req-58f6c2ac-cfe5-4a20-ad0c-2d534aabbbd3 req-79e5582b-7da5-4fbd-81eb-5782056cefaa service nova] [instance: 2c01f491-2979-40d7-b74e-f580009309c5] Refreshing network info cache for port 88022433-f52e-45f9-80a5-b93ca88aa273 {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 16:28:27 user nova-compute[71874]: DEBUG nova.network.neutron [req-58f6c2ac-cfe5-4a20-ad0c-2d534aabbbd3 req-79e5582b-7da5-4fbd-81eb-5782056cefaa service nova] [instance: 2c01f491-2979-40d7-b74e-f580009309c5] Updated VIF entry in instance network info cache for port 88022433-f52e-45f9-80a5-b93ca88aa273. {{(pid=71874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 16:28:27 user nova-compute[71874]: DEBUG nova.network.neutron [req-58f6c2ac-cfe5-4a20-ad0c-2d534aabbbd3 req-79e5582b-7da5-4fbd-81eb-5782056cefaa service nova] [instance: 2c01f491-2979-40d7-b74e-f580009309c5] Updating instance_info_cache with network_info: [{"id": "88022433-f52e-45f9-80a5-b93ca88aa273", "address": "fa:16:3e:8c:23:9e", "network": {"id": "1439244b-8287-4bba-a88c-99d4b498cccd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1491302639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29b1b89a5eeb408a8d0938e5f59f405f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88022433-f5", "ovs_interfaceid": "88022433-f52e-45f9-80a5-b93ca88aa273", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:28:27 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-58f6c2ac-cfe5-4a20-ad0c-2d534aabbbd3 req-79e5582b-7da5-4fbd-81eb-5782056cefaa service nova] Releasing lock "refresh_cache-2c01f491-2979-40d7-b74e-f580009309c5" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:28:28 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:28:28 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:28:28 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71874) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 16:28:28 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71874) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 16:28:28 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71874) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 16:28:28 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:28:28 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:28:32 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-69a1fde3-83d8-450f-a3e6-31448de085a4 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "34545689-e52e-428b-9106-550d3cd7536b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:28:32 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-69a1fde3-83d8-450f-a3e6-31448de085a4 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "34545689-e52e-428b-9106-550d3cd7536b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:28:32 user nova-compute[71874]: DEBUG nova.compute.manager [None req-69a1fde3-83d8-450f-a3e6-31448de085a4 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 34545689-e52e-428b-9106-550d3cd7536b] Starting instance... {{(pid=71874) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 16:28:32 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-69a1fde3-83d8-450f-a3e6-31448de085a4 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:28:32 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-69a1fde3-83d8-450f-a3e6-31448de085a4 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:28:32 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-69a1fde3-83d8-450f-a3e6-31448de085a4 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71874) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 16:28:32 user nova-compute[71874]: INFO nova.compute.claims [None req-69a1fde3-83d8-450f-a3e6-31448de085a4 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 34545689-e52e-428b-9106-550d3cd7536b] Claim successful on node user
Apr 12 16:28:33 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-69a1fde3-83d8-450f-a3e6-31448de085a4 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Inventory has not changed in ProviderTree for provider: 0e94b4c8-cd49-45e4-9133-d36eb4b2456b {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 16:28:33 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-69a1fde3-83d8-450f-a3e6-31448de085a4 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Inventory has not changed for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 16:28:33 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-69a1fde3-83d8-450f-a3e6-31448de085a4 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.211s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:28:33 user nova-compute[71874]: DEBUG nova.compute.manager [None req-69a1fde3-83d8-450f-a3e6-31448de085a4 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 34545689-e52e-428b-9106-550d3cd7536b] Start building networks asynchronously for instance. {{(pid=71874) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 16:28:33 user nova-compute[71874]: DEBUG nova.compute.manager [None req-69a1fde3-83d8-450f-a3e6-31448de085a4 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 34545689-e52e-428b-9106-550d3cd7536b] Allocating IP information in the background. {{(pid=71874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 16:28:33 user nova-compute[71874]: DEBUG nova.network.neutron [None req-69a1fde3-83d8-450f-a3e6-31448de085a4 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 34545689-e52e-428b-9106-550d3cd7536b] allocate_for_instance() {{(pid=71874) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 16:28:33 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-69a1fde3-83d8-450f-a3e6-31448de085a4 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 34545689-e52e-428b-9106-550d3cd7536b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 16:28:33 user nova-compute[71874]: DEBUG nova.compute.manager [None req-69a1fde3-83d8-450f-a3e6-31448de085a4 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 34545689-e52e-428b-9106-550d3cd7536b] Start building block device mappings for instance. {{(pid=71874) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 16:28:33 user nova-compute[71874]: INFO nova.virt.block_device [None req-69a1fde3-83d8-450f-a3e6-31448de085a4 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 34545689-e52e-428b-9106-550d3cd7536b] Booting with volume 9ea46a74-c4ee-408e-ace3-887f94a0e939 at /dev/vda
Apr 12 16:28:33 user nova-compute[71874]: DEBUG nova.policy [None req-69a1fde3-83d8-450f-a3e6-31448de085a4 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7054687447fc42339e9046ced4915890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b1b89a5eeb408a8d0938e5f59f405f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71874) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 16:28:33 user nova-compute[71874]: DEBUG os_brick.utils [None req-69a1fde3-83d8-450f-a3e6-31448de085a4 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:28:33 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:28:33 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:28:33 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[69e2eb4a-b43f-46ad-8917-c38edda99b57]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:61a48d4489d2\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:28:33 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:28:33 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:28:33 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cdc83fc-a9fc-4925-81c6-bc0731b41b5d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:28:33 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:28:33 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:28:33 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[8117fa42-0336-43c0-9d76-9af47d6f9ab5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:28:33 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[e690554e-4ee1-47ba-844f-58bf53342e43]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:28:33 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-69a1fde3-83d8-450f-a3e6-31448de085a4 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Running cmd (subprocess): nvme version {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:28:33 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [None req-69a1fde3-83d8-450f-a3e6-31448de085a4 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] 'nvme version' failed. Not Retrying. {{(pid=71874) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 16:28:33 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.nvmeof [None req-69a1fde3-83d8-450f-a3e6-31448de085a4 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] nvme not present on system {{(pid=71874) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 16:28:33 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:28:33 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 16:28:33 user nova-compute[71874]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 16:28:33 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[eab25b40-bd3e-4c6c-be9f-721094d06c2d]: (4, '') {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:28:33 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.lightos [None req-69a1fde3-83d8-450f-a3e6-31448de085a4 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71874) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 16:28:33 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.lightos [None req-69a1fde3-83d8-450f-a3e6-31448de085a4 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71874) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 16:28:33 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.lightos [None req-69a1fde3-83d8-450f-a3e6-31448de085a4 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] LIGHTOS: no hostnqn found. {{(pid=71874) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 16:28:33 user nova-compute[71874]: DEBUG os_brick.utils [None req-69a1fde3-83d8-450f-a3e6-31448de085a4 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:61a48d4489d2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:28:33 user nova-compute[71874]: DEBUG nova.virt.block_device [None req-69a1fde3-83d8-450f-a3e6-31448de085a4 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 34545689-e52e-428b-9106-550d3cd7536b] Updating existing volume attachment record: a765320e-6dde-4fb3-b6f6-7cac009c3dbd {{(pid=71874) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 16:28:33 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:28:33 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:28:33 user nova-compute[71874]: DEBUG nova.network.neutron [None req-69a1fde3-83d8-450f-a3e6-31448de085a4 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 34545689-e52e-428b-9106-550d3cd7536b] Successfully created port: 96ff73b8-4a94-433c-ab04-02d046ea5cfb {{(pid=71874) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 16:28:34 user nova-compute[71874]: DEBUG nova.network.neutron [None req-69a1fde3-83d8-450f-a3e6-31448de085a4 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 34545689-e52e-428b-9106-550d3cd7536b] Successfully updated port: 96ff73b8-4a94-433c-ab04-02d046ea5cfb {{(pid=71874) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 16:28:34 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-69a1fde3-83d8-450f-a3e6-31448de085a4 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "refresh_cache-34545689-e52e-428b-9106-550d3cd7536b" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:28:34 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-69a1fde3-83d8-450f-a3e6-31448de085a4 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquired lock "refresh_cache-34545689-e52e-428b-9106-550d3cd7536b" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:28:34 user nova-compute[71874]: DEBUG nova.network.neutron [None req-69a1fde3-83d8-450f-a3e6-31448de085a4 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 34545689-e52e-428b-9106-550d3cd7536b] Building network info cache for instance {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 16:28:34 user nova-compute[71874]: DEBUG nova.compute.manager [req-92af2c33-7aa9-4992-8df5-0aacebab9e4b req-4942df92-82c0-4cd9-a423-28bd05f9c067 service nova] [instance: 34545689-e52e-428b-9106-550d3cd7536b] Received event network-changed-96ff73b8-4a94-433c-ab04-02d046ea5cfb {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:28:34 user nova-compute[71874]: DEBUG nova.compute.manager [req-92af2c33-7aa9-4992-8df5-0aacebab9e4b req-4942df92-82c0-4cd9-a423-28bd05f9c067 service nova] [instance: 34545689-e52e-428b-9106-550d3cd7536b] Refreshing instance network info cache due to event network-changed-96ff73b8-4a94-433c-ab04-02d046ea5cfb. {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 16:28:34 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-92af2c33-7aa9-4992-8df5-0aacebab9e4b req-4942df92-82c0-4cd9-a423-28bd05f9c067 service nova] Acquiring lock "refresh_cache-34545689-e52e-428b-9106-550d3cd7536b" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:28:34 user nova-compute[71874]: DEBUG nova.network.neutron [None req-69a1fde3-83d8-450f-a3e6-31448de085a4 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 34545689-e52e-428b-9106-550d3cd7536b] Instance cache missing network info. {{(pid=71874) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 16:28:34 user nova-compute[71874]: DEBUG nova.network.neutron [None req-69a1fde3-83d8-450f-a3e6-31448de085a4 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 34545689-e52e-428b-9106-550d3cd7536b] Updating instance_info_cache with network_info: [{"id": "96ff73b8-4a94-433c-ab04-02d046ea5cfb", "address": "fa:16:3e:bb:24:38", "network": {"id": "1439244b-8287-4bba-a88c-99d4b498cccd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1491302639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29b1b89a5eeb408a8d0938e5f59f405f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96ff73b8-4a", "ovs_interfaceid": "96ff73b8-4a94-433c-ab04-02d046ea5cfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:28:34 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-69a1fde3-83d8-450f-a3e6-31448de085a4 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Releasing lock "refresh_cache-34545689-e52e-428b-9106-550d3cd7536b" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:28:34 user nova-compute[71874]: DEBUG nova.compute.manager [None req-69a1fde3-83d8-450f-a3e6-31448de085a4 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 34545689-e52e-428b-9106-550d3cd7536b] Instance network_info: |[{"id": "96ff73b8-4a94-433c-ab04-02d046ea5cfb", "address": "fa:16:3e:bb:24:38", "network": {"id": "1439244b-8287-4bba-a88c-99d4b498cccd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1491302639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29b1b89a5eeb408a8d0938e5f59f405f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96ff73b8-4a", "ovs_interfaceid": "96ff73b8-4a94-433c-ab04-02d046ea5cfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 16:28:35 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-92af2c33-7aa9-4992-8df5-0aacebab9e4b req-4942df92-82c0-4cd9-a423-28bd05f9c067 service nova] Acquired lock "refresh_cache-34545689-e52e-428b-9106-550d3cd7536b" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:28:35 user nova-compute[71874]: DEBUG nova.network.neutron [req-92af2c33-7aa9-4992-8df5-0aacebab9e4b req-4942df92-82c0-4cd9-a423-28bd05f9c067 service nova] [instance: 34545689-e52e-428b-9106-550d3cd7536b] Refreshing network info cache for port 96ff73b8-4a94-433c-ab04-02d046ea5cfb {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 16:28:35 user nova-compute[71874]: DEBUG nova.network.neutron [req-92af2c33-7aa9-4992-8df5-0aacebab9e4b req-4942df92-82c0-4cd9-a423-28bd05f9c067 service nova] [instance: 34545689-e52e-428b-9106-550d3cd7536b] Updated VIF entry in instance network info cache for port 96ff73b8-4a94-433c-ab04-02d046ea5cfb. {{(pid=71874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 16:28:35 user nova-compute[71874]: DEBUG nova.network.neutron [req-92af2c33-7aa9-4992-8df5-0aacebab9e4b req-4942df92-82c0-4cd9-a423-28bd05f9c067 service nova] [instance: 34545689-e52e-428b-9106-550d3cd7536b] Updating instance_info_cache with network_info: [{"id": "96ff73b8-4a94-433c-ab04-02d046ea5cfb", "address": "fa:16:3e:bb:24:38", "network": {"id": "1439244b-8287-4bba-a88c-99d4b498cccd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1491302639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29b1b89a5eeb408a8d0938e5f59f405f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96ff73b8-4a", "ovs_interfaceid": "96ff73b8-4a94-433c-ab04-02d046ea5cfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:28:35 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-92af2c33-7aa9-4992-8df5-0aacebab9e4b req-4942df92-82c0-4cd9-a423-28bd05f9c067 service nova] Releasing lock "refresh_cache-34545689-e52e-428b-9106-550d3cd7536b" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:28:36 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:28:36 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:28:36 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:28:36 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:28:36 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:28:36 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Auditing locally available compute resources for user (node: user) {{(pid=71874) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 16:28:36 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 16:28:37 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:28:37 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:28:37 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Hypervisor/Node resource view: name=user free_ram=8715MB free_disk=25.94232940673828GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71874) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 16:28:37 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:28:37 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:28:37 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 2c01f491-2979-40d7-b74e-f580009309c5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:28:37 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 34545689-e52e-428b-9106-550d3cd7536b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:28:37 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=71874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 16:28:37 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=71874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 16:28:37 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Inventory has not changed in ProviderTree for provider: 0e94b4c8-cd49-45e4-9133-d36eb4b2456b {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 16:28:37 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Inventory has not changed for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 16:28:37 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Compute_service record updated for user:user {{(pid=71874) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 16:28:37 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.190s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:28:38 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:28:38 user nova-compute[71874]: DEBUG nova.compute.manager [None req-69a1fde3-83d8-450f-a3e6-31448de085a4 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 34545689-e52e-428b-9106-550d3cd7536b] Start spawning the instance on the hypervisor. {{(pid=71874) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 16:28:38 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-69a1fde3-83d8-450f-a3e6-31448de085a4 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 34545689-e52e-428b-9106-550d3cd7536b] Creating instance directory {{(pid=71874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 16:28:38 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-69a1fde3-83d8-450f-a3e6-31448de085a4 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 34545689-e52e-428b-9106-550d3cd7536b] Creating image(s)
Apr 12 16:28:38 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-69a1fde3-83d8-450f-a3e6-31448de085a4 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 34545689-e52e-428b-9106-550d3cd7536b] Did not create local disks {{(pid=71874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 12 16:28:38 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-69a1fde3-83d8-450f-a3e6-31448de085a4 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 34545689-e52e-428b-9106-550d3cd7536b] Ensure instance console log exists: /opt/stack/data/nova/instances/34545689-e52e-428b-9106-550d3cd7536b/console.log {{(pid=71874) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 16:28:38 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-69a1fde3-83d8-450f-a3e6-31448de085a4 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:28:38 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-69a1fde3-83d8-450f-a3e6-31448de085a4 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:28:38 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-69a1fde3-83d8-450f-a3e6-31448de085a4 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:28:38 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-69a1fde3-83d8-450f-a3e6-31448de085a4 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 34545689-e52e-428b-9106-550d3cd7536b] Start _get_guest_xml network_info=[{"id": "96ff73b8-4a94-433c-ab04-02d046ea5cfb", "address": "fa:16:3e:bb:24:38", "network": {"id": "1439244b-8287-4bba-a88c-99d4b498cccd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1491302639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29b1b89a5eeb408a8d0938e5f59f405f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96ff73b8-4a", "ovs_interfaceid": "96ff73b8-4a94-433c-ab04-02d046ea5cfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'delete_on_termination': False, 'attachment_id': 'a765320e-6dde-4fb3-b6f6-7cac009c3dbd', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9ea46a74-c4ee-408e-ace3-887f94a0e939', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eYRWuvPE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '34545689-e52e-428b-9106-550d3cd7536b', 'attached_at': '', 'detached_at': '', 'volume_id': '9ea46a74-c4ee-408e-ace3-887f94a0e939', 'serial': '9ea46a74-c4ee-408e-ace3-887f94a0e939'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'volume_type': None} {{(pid=71874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 16:28:38 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-69a1fde3-83d8-450f-a3e6-31448de085a4 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:28:38 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-69a1fde3-83d8-450f-a3e6-31448de085a4 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:28:38 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-69a1fde3-83d8-450f-a3e6-31448de085a4 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71874) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 16:28:38 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-69a1fde3-83d8-450f-a3e6-31448de085a4 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T15:56:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 16:28:38 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-69a1fde3-83d8-450f-a3e6-31448de085a4 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Flavor limits 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 16:28:38 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-69a1fde3-83d8-450f-a3e6-31448de085a4 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Image limits 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 16:28:38 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-69a1fde3-83d8-450f-a3e6-31448de085a4 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Flavor pref 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 16:28:38 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-69a1fde3-83d8-450f-a3e6-31448de085a4 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Image pref 0:0:0 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 16:28:38 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-69a1fde3-83d8-450f-a3e6-31448de085a4 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 16:28:38 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-69a1fde3-83d8-450f-a3e6-31448de085a4 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 16:28:38 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-69a1fde3-83d8-450f-a3e6-31448de085a4 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 16:28:38 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-69a1fde3-83d8-450f-a3e6-31448de085a4 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Got 1 possible topologies {{(pid=71874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 16:28:38 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-69a1fde3-83d8-450f-a3e6-31448de085a4 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 16:28:38 user nova-compute[71874]: DEBUG nova.virt.hardware [None req-69a1fde3-83d8-450f-a3e6-31448de085a4 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 16:28:38 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-69a1fde3-83d8-450f-a3e6-31448de085a4 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 34545689-e52e-428b-9106-550d3cd7536b] Calling os-brick to attach iSCSI Volume {{(pid=71874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 16:28:38 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-69a1fde3-83d8-450f-a3e6-31448de085a4 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3c0216320>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9ea46a74-c4ee-408e-ace3-887f94a0e939', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eYRWuvPE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:28:38 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-69a1fde3-83d8-450f-a3e6-31448de085a4 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:28:38 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-69a1fde3-83d8-450f-a3e6-31448de085a4 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:28:38 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-69a1fde3-83d8-450f-a3e6-31448de085a4 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:28:38 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-69a1fde3-83d8-450f-a3e6-31448de085a4 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:28:38 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-69a1fde3-83d8-450f-a3e6-31448de085a4 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9ea46a74-c4ee-408e-ace3-887f94a0e939" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:28:38 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-69a1fde3-83d8-450f-a3e6-31448de085a4 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9ea46a74-c4ee-408e-ace3-887f94a0e939" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:28:38 user nova-compute[71874]: INFO os_brick.initiator.connectors.iscsi [None req-69a1fde3-83d8-450f-a3e6-31448de085a4 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 16:28:38 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ea46a74-c4ee-408e-ace3-887f94a0e939 -p 172.16.0.220:3260 {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:28:38 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ea46a74-c4ee-408e-ace3-887f94a0e939 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:28:38 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[541f1ff2-54c4-48f2-8d0e-2e75adbe8dff]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:28:38 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-69a1fde3-83d8-450f-a3e6-31448de085a4 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 16:28:38 user nova-compute[71874]:  {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:28:38 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ea46a74-c4ee-408e-ace3-887f94a0e939 -p 172.16.0.220:3260 --interface default --op new {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:28:38 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ea46a74-c4ee-408e-ace3-887f94a0e939 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:28:38 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[6953e2c2-2e6f-4618-b621-128363bbc9a8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9ea46a74-c4ee-408e-ace3-887f94a0e939] added\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:28:38 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-69a1fde3-83d8-450f-a3e6-31448de085a4 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9ea46a74-c4ee-408e-ace3-887f94a0e939] added
Apr 12 16:28:38 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:28:38 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ea46a74-c4ee-408e-ace3-887f94a0e939 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:28:38 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ea46a74-c4ee-408e-ace3-887f94a0e939 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:28:38 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd01251e-0c98-4c3f-b409-fc4b7ad3d044]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:28:38 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-69a1fde3-83d8-450f-a3e6-31448de085a4 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:28:38 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ea46a74-c4ee-408e-ace3-887f94a0e939 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:28:38 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ea46a74-c4ee-408e-ace3-887f94a0e939 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:28:38 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[236ff2a5-5662-4f54-b0b8-2b65147c8e90]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:28:38 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-69a1fde3-83d8-450f-a3e6-31448de085a4 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:28:38 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ea46a74-c4ee-408e-ace3-887f94a0e939 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eYRWuvPE {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:28:38 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ea46a74-c4ee-408e-ace3-887f94a0e939 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eYRWuvPE" returned: 0 in 0.017s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:28:38 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa2a2346-9e33-4fd5-becd-1b459cbe80cd]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:28:38 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-69a1fde3-83d8-450f-a3e6-31448de085a4 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eYRWuvPE'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:28:38 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ea46a74-c4ee-408e-ace3-887f94a0e939 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:28:38 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ea46a74-c4ee-408e-ace3-887f94a0e939 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:28:38 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f52d6a5-115a-4815-a170-9df6cf68a997]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:28:38 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-69a1fde3-83d8-450f-a3e6-31448de085a4 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:28:38 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:28:38 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:28:38 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cde0d09-2d85-4d30-8259-f9b228874ec2]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909 (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:28:38 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-69a1fde3-83d8-450f-a3e6-31448de085a4 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909 (non-flash)
Apr 12 16:28:38 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:28:38 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-69a1fde3-83d8-450f-a3e6-31448de085a4 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909 (non-flash)
Apr 12 16:28:38 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:28:38 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ea46a74-c4ee-408e-ace3-887f94a0e939 -p 172.16.0.220:3260 --login {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:28:38 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ea46a74-c4ee-408e-ace3-887f94a0e939 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:28:38 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb033470-2e7b-4e38-8716-72b455ba3477]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9ea46a74-c4ee-408e-ace3-887f94a0e939, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9ea46a74-c4ee-408e-ace3-887f94a0e939, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:28:38 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-69a1fde3-83d8-450f-a3e6-31448de085a4 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9ea46a74-c4ee-408e-ace3-887f94a0e939, portal: 172.16.0.220,3260]
Apr 12 16:28:38 user nova-compute[71874]: Login to [iface: default, target: iqn.2010-10.org.openstack:9ea46a74-c4ee-408e-ace3-887f94a0e939, portal: 172.16.0.220,3260] successful.
Apr 12 16:28:38 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:28:38 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ea46a74-c4ee-408e-ace3-887f94a0e939 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:28:38 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ea46a74-c4ee-408e-ace3-887f94a0e939 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:28:38 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6082d6c-2938-4d1f-a96c-1f29b99fabb9]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:28:38 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-69a1fde3-83d8-450f-a3e6-31448de085a4 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:28:38 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:28:38 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:28:38 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9d73839-415f-4fb3-a4c8-a910d653d467]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ea46a74-c4ee-408e-ace3-887f94a0e939 (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:28:38 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-69a1fde3-83d8-450f-a3e6-31448de085a4 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909 (non-flash)
Apr 12 16:28:38 user nova-compute[71874]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ea46a74-c4ee-408e-ace3-887f94a0e939 (non-flash)
Apr 12 16:28:38 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:28:38 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-69a1fde3-83d8-450f-a3e6-31448de085a4 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909 (non-flash)
Apr 12 16:28:38 user nova-compute[71874]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ea46a74-c4ee-408e-ace3-887f94a0e939 (non-flash)
Apr 12 16:28:38 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:28:38 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-69a1fde3-83d8-450f-a3e6-31448de085a4 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9ea46a74-c4ee-408e-ace3-887f94a0e939" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.245s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:28:38 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-69a1fde3-83d8-450f-a3e6-31448de085a4 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Connected to 172.16.0.220:3260 {{(pid=71874) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 16:28:38 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-69a1fde3-83d8-450f-a3e6-31448de085a4 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] HCTL ('34', '-', '-', 0) found on session 54 with lun 0 {{(pid=71874) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 16:28:38 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-69a1fde3-83d8-450f-a3e6-31448de085a4 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71874) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 16:28:38 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:28:38 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:28:38 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0af2596-c053-4159-a0e1-a9c7ae82d1fb]: (4, ('- - 0', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:28:38 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-69a1fde3-83d8-450f-a3e6-31448de085a4 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Searching for a device in session 54 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71874) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 16:28:38 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-69a1fde3-83d8-450f-a3e6-31448de085a4 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:9ea46a74-c4ee-408e-ace3-887f94a0e939', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eYRWuvPE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71874) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 16:28:39 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:28:39 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-69a1fde3-83d8-450f-a3e6-31448de085a4 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.274s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:28:39 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-69a1fde3-83d8-450f-a3e6-31448de085a4 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] <== connect_volume: return (1276ms) {'type': 'block', 'scsi_wwn': '23138653964666333', 'path': '/dev/sdc'} {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:28:39 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-69a1fde3-83d8-450f-a3e6-31448de085a4 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 34545689-e52e-428b-9106-550d3cd7536b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23138653964666333', 'path': '/dev/sdc'} {{(pid=71874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 16:28:39 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-69a1fde3-83d8-450f-a3e6-31448de085a4 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T16:28:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-341342855',display_name='tempest-TestVolumeBootPattern-server-341342855',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-341342855',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGG/oSOmCDB20hkof5ViTlXYepxJsQ10bBtdYs7WKmIje03wdrGPlfe9DBPbPhAeMjSuszZPOH/w828DcGTtmLpZpE/aguNTugqw/I5GMmvTcJqr8fOGXLe6lzwKxF1ecQ==',key_name='tempest-TestVolumeBootPattern-2081417066',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='29b1b89a5eeb408a8d0938e5f59f405f',ramdisk_id='',reservation_id='r-02e17lh9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-734600841',owner_user_name='tempest-TestVolumeBootPattern-734600841-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T16:28:33Z,user_data=None,user_id='7054687447fc42339e9046ced4915890',uuid=34545689-e52e-428b-9106-550d3cd7536b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "96ff73b8-4a94-433c-ab04-02d046ea5cfb", "address": "fa:16:3e:bb:24:38", "network": {"id": "1439244b-8287-4bba-a88c-99d4b498cccd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1491302639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29b1b89a5eeb408a8d0938e5f59f405f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96ff73b8-4a", "ovs_interfaceid": "96ff73b8-4a94-433c-ab04-02d046ea5cfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 16:28:39 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-69a1fde3-83d8-450f-a3e6-31448de085a4 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Converting VIF {"id": "96ff73b8-4a94-433c-ab04-02d046ea5cfb", "address": "fa:16:3e:bb:24:38", "network": {"id": "1439244b-8287-4bba-a88c-99d4b498cccd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1491302639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29b1b89a5eeb408a8d0938e5f59f405f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96ff73b8-4a", "ovs_interfaceid": "96ff73b8-4a94-433c-ab04-02d046ea5cfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:28:39 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-69a1fde3-83d8-450f-a3e6-31448de085a4 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:24:38,bridge_name='br-int',has_traffic_filtering=True,id=96ff73b8-4a94-433c-ab04-02d046ea5cfb,network=Network(1439244b-8287-4bba-a88c-99d4b498cccd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96ff73b8-4a') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:28:39 user nova-compute[71874]: DEBUG nova.objects.instance [None req-69a1fde3-83d8-450f-a3e6-31448de085a4 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lazy-loading 'pci_devices' on Instance uuid 34545689-e52e-428b-9106-550d3cd7536b {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:28:39 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-69a1fde3-83d8-450f-a3e6-31448de085a4 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 34545689-e52e-428b-9106-550d3cd7536b] End _get_guest_xml xml=<domain type="kvm">
Apr 12 16:28:39 user nova-compute[71874]:   <uuid>34545689-e52e-428b-9106-550d3cd7536b</uuid>
Apr 12 16:28:39 user nova-compute[71874]:   <name>instance-0000002f</name>
Apr 12 16:28:39 user nova-compute[71874]:   <memory>131072</memory>
Apr 12 16:28:39 user nova-compute[71874]:   <vcpu>1</vcpu>
Apr 12 16:28:39 user nova-compute[71874]:   <metadata>
Apr 12 16:28:39 user nova-compute[71874]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 16:28:39 user nova-compute[71874]:       <nova:package version="0.0.0"/>
Apr 12 16:28:39 user nova-compute[71874]:       <nova:name>tempest-TestVolumeBootPattern-server-341342855</nova:name>
Apr 12 16:28:39 user nova-compute[71874]:       <nova:creationTime>2023-04-12 16:28:38</nova:creationTime>
Apr 12 16:28:39 user nova-compute[71874]:       <nova:flavor name="m1.nano">
Apr 12 16:28:39 user nova-compute[71874]:         <nova:memory>128</nova:memory>
Apr 12 16:28:39 user nova-compute[71874]:         <nova:disk>1</nova:disk>
Apr 12 16:28:39 user nova-compute[71874]:         <nova:swap>0</nova:swap>
Apr 12 16:28:39 user nova-compute[71874]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 16:28:39 user nova-compute[71874]:         <nova:vcpus>1</nova:vcpus>
Apr 12 16:28:39 user nova-compute[71874]:       </nova:flavor>
Apr 12 16:28:39 user nova-compute[71874]:       <nova:owner>
Apr 12 16:28:39 user nova-compute[71874]:         <nova:user uuid="7054687447fc42339e9046ced4915890">tempest-TestVolumeBootPattern-734600841-project-member</nova:user>
Apr 12 16:28:39 user nova-compute[71874]:         <nova:project uuid="29b1b89a5eeb408a8d0938e5f59f405f">tempest-TestVolumeBootPattern-734600841</nova:project>
Apr 12 16:28:39 user nova-compute[71874]:       </nova:owner>
Apr 12 16:28:39 user nova-compute[71874]:       <nova:ports>
Apr 12 16:28:39 user nova-compute[71874]:         <nova:port uuid="96ff73b8-4a94-433c-ab04-02d046ea5cfb">
Apr 12 16:28:39 user nova-compute[71874]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 12 16:28:39 user nova-compute[71874]:         </nova:port>
Apr 12 16:28:39 user nova-compute[71874]:       </nova:ports>
Apr 12 16:28:39 user nova-compute[71874]:     </nova:instance>
Apr 12 16:28:39 user nova-compute[71874]:   </metadata>
Apr 12 16:28:39 user nova-compute[71874]:   <sysinfo type="smbios">
Apr 12 16:28:39 user nova-compute[71874]:     <system>
Apr 12 16:28:39 user nova-compute[71874]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 16:28:39 user nova-compute[71874]:       <entry name="product">OpenStack Nova</entry>
Apr 12 16:28:39 user nova-compute[71874]:       <entry name="version">0.0.0</entry>
Apr 12 16:28:39 user nova-compute[71874]:       <entry name="serial">34545689-e52e-428b-9106-550d3cd7536b</entry>
Apr 12 16:28:39 user nova-compute[71874]:       <entry name="uuid">34545689-e52e-428b-9106-550d3cd7536b</entry>
Apr 12 16:28:39 user nova-compute[71874]:       <entry name="family">Virtual Machine</entry>
Apr 12 16:28:39 user nova-compute[71874]:     </system>
Apr 12 16:28:39 user nova-compute[71874]:   </sysinfo>
Apr 12 16:28:39 user nova-compute[71874]:   <os>
Apr 12 16:28:39 user nova-compute[71874]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 16:28:39 user nova-compute[71874]:     <boot dev="hd"/>
Apr 12 16:28:39 user nova-compute[71874]:     <smbios mode="sysinfo"/>
Apr 12 16:28:39 user nova-compute[71874]:   </os>
Apr 12 16:28:39 user nova-compute[71874]:   <features>
Apr 12 16:28:39 user nova-compute[71874]:     <acpi/>
Apr 12 16:28:39 user nova-compute[71874]:     <apic/>
Apr 12 16:28:39 user nova-compute[71874]:     <vmcoreinfo/>
Apr 12 16:28:39 user nova-compute[71874]:   </features>
Apr 12 16:28:39 user nova-compute[71874]:   <clock offset="utc">
Apr 12 16:28:39 user nova-compute[71874]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 16:28:39 user nova-compute[71874]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 16:28:39 user nova-compute[71874]:     <timer name="hpet" present="no"/>
Apr 12 16:28:39 user nova-compute[71874]:   </clock>
Apr 12 16:28:39 user nova-compute[71874]:   <cpu mode="custom" match="exact">
Apr 12 16:28:39 user nova-compute[71874]:     <model>Nehalem</model>
Apr 12 16:28:39 user nova-compute[71874]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 16:28:39 user nova-compute[71874]:   </cpu>
Apr 12 16:28:39 user nova-compute[71874]:   <devices>
Apr 12 16:28:39 user nova-compute[71874]:     <disk type="block" device="disk">
Apr 12 16:28:39 user nova-compute[71874]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 16:28:39 user nova-compute[71874]:       <source dev="/dev/sdc"/>
Apr 12 16:28:39 user nova-compute[71874]:       <target dev="vda" bus="virtio"/>
Apr 12 16:28:39 user nova-compute[71874]:       <serial>9ea46a74-c4ee-408e-ace3-887f94a0e939</serial>
Apr 12 16:28:39 user nova-compute[71874]:     </disk>
Apr 12 16:28:39 user nova-compute[71874]:     <interface type="ethernet">
Apr 12 16:28:39 user nova-compute[71874]:       <mac address="fa:16:3e:bb:24:38"/>
Apr 12 16:28:39 user nova-compute[71874]:       <model type="virtio"/>
Apr 12 16:28:39 user nova-compute[71874]:       <mtu size="1442"/>
Apr 12 16:28:39 user nova-compute[71874]:       <target dev="tap96ff73b8-4a"/>
Apr 12 16:28:39 user nova-compute[71874]:     </interface>
Apr 12 16:28:39 user nova-compute[71874]:     <serial type="pty">
Apr 12 16:28:39 user nova-compute[71874]:       <log file="/opt/stack/data/nova/instances/34545689-e52e-428b-9106-550d3cd7536b/console.log" append="off"/>
Apr 12 16:28:39 user nova-compute[71874]:     </serial>
Apr 12 16:28:39 user nova-compute[71874]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 16:28:39 user nova-compute[71874]:     <video>
Apr 12 16:28:39 user nova-compute[71874]:       <model type="virtio"/>
Apr 12 16:28:39 user nova-compute[71874]:     </video>
Apr 12 16:28:39 user nova-compute[71874]:     <rng model="virtio">
Apr 12 16:28:39 user nova-compute[71874]:       <backend model="random">/dev/urandom</backend>
Apr 12 16:28:39 user nova-compute[71874]:     </rng>
Apr 12 16:28:39 user nova-compute[71874]:     <controller type="usb" index="0" model="none"/>
Apr 12 16:28:39 user nova-compute[71874]:     <memballoon model="virtio">
Apr 12 16:28:39 user nova-compute[71874]:       <stats period="10"/>
Apr 12 16:28:39 user nova-compute[71874]:     </memballoon>
Apr 12 16:28:39 user nova-compute[71874]:   </devices>
Apr 12 16:28:39 user nova-compute[71874]: </domain>
Apr 12 16:28:39 user nova-compute[71874]:  {{(pid=71874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 16:28:39 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-69a1fde3-83d8-450f-a3e6-31448de085a4 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T16:28:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-341342855',display_name='tempest-TestVolumeBootPattern-server-341342855',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-341342855',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGG/oSOmCDB20hkof5ViTlXYepxJsQ10bBtdYs7WKmIje03wdrGPlfe9DBPbPhAeMjSuszZPOH/w828DcGTtmLpZpE/aguNTugqw/I5GMmvTcJqr8fOGXLe6lzwKxF1ecQ==',key_name='tempest-TestVolumeBootPattern-2081417066',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='29b1b89a5eeb408a8d0938e5f59f405f',ramdisk_id='',reservation_id='r-02e17lh9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-734600841',owner_user_name='tempest-TestVolumeBootPattern-734600841-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T16:28:33Z,user_data=None,user_id='7054687447fc42339e9046ced4915890',uuid=34545689-e52e-428b-9106-550d3cd7536b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "96ff73b8-4a94-433c-ab04-02d046ea5cfb", "address": "fa:16:3e:bb:24:38", "network": {"id": "1439244b-8287-4bba-a88c-99d4b498cccd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1491302639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29b1b89a5eeb408a8d0938e5f59f405f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96ff73b8-4a", "ovs_interfaceid": "96ff73b8-4a94-433c-ab04-02d046ea5cfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 16:28:39 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-69a1fde3-83d8-450f-a3e6-31448de085a4 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Converting VIF {"id": "96ff73b8-4a94-433c-ab04-02d046ea5cfb", "address": "fa:16:3e:bb:24:38", "network": {"id": "1439244b-8287-4bba-a88c-99d4b498cccd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1491302639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29b1b89a5eeb408a8d0938e5f59f405f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96ff73b8-4a", "ovs_interfaceid": "96ff73b8-4a94-433c-ab04-02d046ea5cfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:28:39 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-69a1fde3-83d8-450f-a3e6-31448de085a4 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:24:38,bridge_name='br-int',has_traffic_filtering=True,id=96ff73b8-4a94-433c-ab04-02d046ea5cfb,network=Network(1439244b-8287-4bba-a88c-99d4b498cccd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96ff73b8-4a') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:28:39 user nova-compute[71874]: DEBUG os_vif [None req-69a1fde3-83d8-450f-a3e6-31448de085a4 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:24:38,bridge_name='br-int',has_traffic_filtering=True,id=96ff73b8-4a94-433c-ab04-02d046ea5cfb,network=Network(1439244b-8287-4bba-a88c-99d4b498cccd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96ff73b8-4a') {{(pid=71874) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 16:28:39 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:28:39 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:28:39 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 16:28:39 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:28:39 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap96ff73b8-4a, may_exist=True) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:28:39 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap96ff73b8-4a, col_values=(('external_ids', {'iface-id': '96ff73b8-4a94-433c-ab04-02d046ea5cfb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bb:24:38', 'vm-uuid': '34545689-e52e-428b-9106-550d3cd7536b'}),)) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:28:39 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:28:39 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:28:39 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:28:39 user nova-compute[71874]: INFO os_vif [None req-69a1fde3-83d8-450f-a3e6-31448de085a4 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:24:38,bridge_name='br-int',has_traffic_filtering=True,id=96ff73b8-4a94-433c-ab04-02d046ea5cfb,network=Network(1439244b-8287-4bba-a88c-99d4b498cccd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96ff73b8-4a')
Apr 12 16:28:40 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-69a1fde3-83d8-450f-a3e6-31448de085a4 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] No BDM found with device name vda, not building metadata. {{(pid=71874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 16:28:40 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-69a1fde3-83d8-450f-a3e6-31448de085a4 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] No VIF found with MAC fa:16:3e:bb:24:38, not building metadata {{(pid=71874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 16:28:40 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:28:40 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:28:41 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:28:41 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:28:41 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:28:41 user nova-compute[71874]: DEBUG nova.compute.manager [req-959c9757-fbf9-4865-8f00-c6b1233419e2 req-bb66b58d-ee68-4d47-b0e8-4b99cd789acb service nova] [instance: 34545689-e52e-428b-9106-550d3cd7536b] Received event network-vif-plugged-96ff73b8-4a94-433c-ab04-02d046ea5cfb {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:28:41 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-959c9757-fbf9-4865-8f00-c6b1233419e2 req-bb66b58d-ee68-4d47-b0e8-4b99cd789acb service nova] Acquiring lock "34545689-e52e-428b-9106-550d3cd7536b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:28:41 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-959c9757-fbf9-4865-8f00-c6b1233419e2 req-bb66b58d-ee68-4d47-b0e8-4b99cd789acb service nova] Lock "34545689-e52e-428b-9106-550d3cd7536b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:28:41 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-959c9757-fbf9-4865-8f00-c6b1233419e2 req-bb66b58d-ee68-4d47-b0e8-4b99cd789acb service nova] Lock "34545689-e52e-428b-9106-550d3cd7536b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:28:41 user nova-compute[71874]: DEBUG nova.compute.manager [req-959c9757-fbf9-4865-8f00-c6b1233419e2 req-bb66b58d-ee68-4d47-b0e8-4b99cd789acb service nova] [instance: 34545689-e52e-428b-9106-550d3cd7536b] No waiting events found dispatching network-vif-plugged-96ff73b8-4a94-433c-ab04-02d046ea5cfb {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:28:41 user nova-compute[71874]: WARNING nova.compute.manager [req-959c9757-fbf9-4865-8f00-c6b1233419e2 req-bb66b58d-ee68-4d47-b0e8-4b99cd789acb service nova] [instance: 34545689-e52e-428b-9106-550d3cd7536b] Received unexpected event network-vif-plugged-96ff73b8-4a94-433c-ab04-02d046ea5cfb for instance with vm_state building and task_state spawning.
Apr 12 16:28:41 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:28:42 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:28:42 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Starting heal instance info cache {{(pid=71874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 16:28:42 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquiring lock "refresh_cache-2c01f491-2979-40d7-b74e-f580009309c5" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:28:42 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquired lock "refresh_cache-2c01f491-2979-40d7-b74e-f580009309c5" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:28:42 user nova-compute[71874]: DEBUG nova.network.neutron [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] [instance: 2c01f491-2979-40d7-b74e-f580009309c5] Forcefully refreshing network info cache for instance {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 16:28:43 user nova-compute[71874]: DEBUG nova.network.neutron [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] [instance: 2c01f491-2979-40d7-b74e-f580009309c5] Updating instance_info_cache with network_info: [{"id": "88022433-f52e-45f9-80a5-b93ca88aa273", "address": "fa:16:3e:8c:23:9e", "network": {"id": "1439244b-8287-4bba-a88c-99d4b498cccd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1491302639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29b1b89a5eeb408a8d0938e5f59f405f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88022433-f5", "ovs_interfaceid": "88022433-f52e-45f9-80a5-b93ca88aa273", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:28:43 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Releasing lock "refresh_cache-2c01f491-2979-40d7-b74e-f580009309c5" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:28:43 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] [instance: 2c01f491-2979-40d7-b74e-f580009309c5] Updated the network info_cache for instance {{(pid=71874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 16:28:43 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:28:43 user nova-compute[71874]: DEBUG nova.compute.manager [req-bb50175a-8b68-4553-96f3-ceb8f2d7a2ac req-486917f0-d643-4b89-b2a8-468b99d082e2 service nova] [instance: 34545689-e52e-428b-9106-550d3cd7536b] Received event network-vif-plugged-96ff73b8-4a94-433c-ab04-02d046ea5cfb {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:28:43 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-bb50175a-8b68-4553-96f3-ceb8f2d7a2ac req-486917f0-d643-4b89-b2a8-468b99d082e2 service nova] Acquiring lock "34545689-e52e-428b-9106-550d3cd7536b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:28:43 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-bb50175a-8b68-4553-96f3-ceb8f2d7a2ac req-486917f0-d643-4b89-b2a8-468b99d082e2 service nova] Lock "34545689-e52e-428b-9106-550d3cd7536b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:28:43 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-bb50175a-8b68-4553-96f3-ceb8f2d7a2ac req-486917f0-d643-4b89-b2a8-468b99d082e2 service nova] Lock "34545689-e52e-428b-9106-550d3cd7536b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:28:43 user nova-compute[71874]: DEBUG nova.compute.manager [req-bb50175a-8b68-4553-96f3-ceb8f2d7a2ac req-486917f0-d643-4b89-b2a8-468b99d082e2 service nova] [instance: 34545689-e52e-428b-9106-550d3cd7536b] No waiting events found dispatching network-vif-plugged-96ff73b8-4a94-433c-ab04-02d046ea5cfb {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:28:43 user nova-compute[71874]: WARNING nova.compute.manager [req-bb50175a-8b68-4553-96f3-ceb8f2d7a2ac req-486917f0-d643-4b89-b2a8-468b99d082e2 service nova] [instance: 34545689-e52e-428b-9106-550d3cd7536b] Received unexpected event network-vif-plugged-96ff73b8-4a94-433c-ab04-02d046ea5cfb for instance with vm_state building and task_state spawning.
Apr 12 16:28:43 user nova-compute[71874]: DEBUG nova.virt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Emitting event <LifecycleEvent: 1681316923.5084422, 34545689-e52e-428b-9106-550d3cd7536b => Resumed> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:28:43 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 34545689-e52e-428b-9106-550d3cd7536b] VM Resumed (Lifecycle Event)
Apr 12 16:28:43 user nova-compute[71874]: DEBUG nova.compute.manager [None req-69a1fde3-83d8-450f-a3e6-31448de085a4 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 34545689-e52e-428b-9106-550d3cd7536b] Instance event wait completed in 0 seconds for  {{(pid=71874) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 16:28:43 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-69a1fde3-83d8-450f-a3e6-31448de085a4 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 34545689-e52e-428b-9106-550d3cd7536b] Guest created on hypervisor {{(pid=71874) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 16:28:43 user nova-compute[71874]: INFO nova.virt.libvirt.driver [-] [instance: 34545689-e52e-428b-9106-550d3cd7536b] Instance spawned successfully.
Apr 12 16:28:43 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-69a1fde3-83d8-450f-a3e6-31448de085a4 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 34545689-e52e-428b-9106-550d3cd7536b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 16:28:43 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 34545689-e52e-428b-9106-550d3cd7536b] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:28:43 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 34545689-e52e-428b-9106-550d3cd7536b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 16:28:43 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-69a1fde3-83d8-450f-a3e6-31448de085a4 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 34545689-e52e-428b-9106-550d3cd7536b] Found default for hw_cdrom_bus of ide {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:28:43 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-69a1fde3-83d8-450f-a3e6-31448de085a4 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 34545689-e52e-428b-9106-550d3cd7536b] Found default for hw_disk_bus of virtio {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:28:43 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-69a1fde3-83d8-450f-a3e6-31448de085a4 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 34545689-e52e-428b-9106-550d3cd7536b] Found default for hw_input_bus of None {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:28:43 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-69a1fde3-83d8-450f-a3e6-31448de085a4 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 34545689-e52e-428b-9106-550d3cd7536b] Found default for hw_pointer_model of None {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:28:43 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-69a1fde3-83d8-450f-a3e6-31448de085a4 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 34545689-e52e-428b-9106-550d3cd7536b] Found default for hw_video_model of virtio {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:28:43 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-69a1fde3-83d8-450f-a3e6-31448de085a4 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 34545689-e52e-428b-9106-550d3cd7536b] Found default for hw_vif_model of virtio {{(pid=71874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 16:28:43 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 34545689-e52e-428b-9106-550d3cd7536b] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 16:28:43 user nova-compute[71874]: DEBUG nova.virt.driver [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] Emitting event <LifecycleEvent: 1681316923.5102158, 34545689-e52e-428b-9106-550d3cd7536b => Started> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:28:43 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 34545689-e52e-428b-9106-550d3cd7536b] VM Started (Lifecycle Event)
Apr 12 16:28:43 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 34545689-e52e-428b-9106-550d3cd7536b] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:28:43 user nova-compute[71874]: DEBUG nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 34545689-e52e-428b-9106-550d3cd7536b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 16:28:43 user nova-compute[71874]: INFO nova.compute.manager [None req-eb5669f4-a6a6-4889-8070-ca1f45890167 None None] [instance: 34545689-e52e-428b-9106-550d3cd7536b] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 16:28:43 user nova-compute[71874]: INFO nova.compute.manager [None req-69a1fde3-83d8-450f-a3e6-31448de085a4 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 34545689-e52e-428b-9106-550d3cd7536b] Took 5.03 seconds to spawn the instance on the hypervisor.
Apr 12 16:28:43 user nova-compute[71874]: DEBUG nova.compute.manager [None req-69a1fde3-83d8-450f-a3e6-31448de085a4 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 34545689-e52e-428b-9106-550d3cd7536b] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:28:43 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:28:43 user nova-compute[71874]: INFO nova.compute.manager [None req-69a1fde3-83d8-450f-a3e6-31448de085a4 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 34545689-e52e-428b-9106-550d3cd7536b] Took 10.86 seconds to build instance.
Apr 12 16:28:43 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-69a1fde3-83d8-450f-a3e6-31448de085a4 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "34545689-e52e-428b-9106-550d3cd7536b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.977s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:28:44 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:28:45 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:28:45 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:28:45 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71874) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 16:28:49 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:28:54 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:28:58 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:28:59 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:29:03 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:29:04 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:29:06 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:29:06 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:29:09 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:29:13 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:29:14 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:29:19 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:29:23 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:29:24 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:29:28 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:29:30 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:29:35 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:29:35 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:29:35 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71874) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 16:29:35 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71874) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 16:29:35 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71874) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 16:29:35 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:29:36 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:29:37 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:29:38 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:29:38 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:29:38 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:29:38 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Auditing locally available compute resources for user (node: user) {{(pid=71874) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 16:29:38 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 16:29:38 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 16:29:38 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:29:38 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:29:38 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Hypervisor/Node resource view: name=user free_ram=8694MB free_disk=25.93999481201172GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71874) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 16:29:38 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:29:38 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:29:38 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 2c01f491-2979-40d7-b74e-f580009309c5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:29:38 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 34545689-e52e-428b-9106-550d3cd7536b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:29:38 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=71874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 16:29:38 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=71874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 16:29:38 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Inventory has not changed in ProviderTree for provider: 0e94b4c8-cd49-45e4-9133-d36eb4b2456b {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 16:29:38 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Inventory has not changed for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 16:29:38 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Compute_service record updated for user:user {{(pid=71874) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 16:29:38 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.197s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:29:40 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:29:41 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:29:41 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:29:42 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:29:42 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:29:43 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:29:43 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Starting heal instance info cache {{(pid=71874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 16:29:43 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Rebuilding the list of instances to heal {{(pid=71874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 16:29:44 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquiring lock "refresh_cache-2c01f491-2979-40d7-b74e-f580009309c5" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:29:44 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquired lock "refresh_cache-2c01f491-2979-40d7-b74e-f580009309c5" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:29:44 user nova-compute[71874]: DEBUG nova.network.neutron [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] [instance: 2c01f491-2979-40d7-b74e-f580009309c5] Forcefully refreshing network info cache for instance {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 16:29:44 user nova-compute[71874]: DEBUG nova.objects.instance [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lazy-loading 'info_cache' on Instance uuid 2c01f491-2979-40d7-b74e-f580009309c5 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:29:44 user nova-compute[71874]: DEBUG nova.network.neutron [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] [instance: 2c01f491-2979-40d7-b74e-f580009309c5] Updating instance_info_cache with network_info: [{"id": "88022433-f52e-45f9-80a5-b93ca88aa273", "address": "fa:16:3e:8c:23:9e", "network": {"id": "1439244b-8287-4bba-a88c-99d4b498cccd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1491302639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29b1b89a5eeb408a8d0938e5f59f405f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88022433-f5", "ovs_interfaceid": "88022433-f52e-45f9-80a5-b93ca88aa273", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:29:44 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Releasing lock "refresh_cache-2c01f491-2979-40d7-b74e-f580009309c5" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:29:44 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] [instance: 2c01f491-2979-40d7-b74e-f580009309c5] Updated the network info_cache for instance {{(pid=71874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 16:29:44 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:29:45 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:29:45 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:29:45 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71874) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 16:29:45 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71874) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 16:29:45 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71874) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 16:29:45 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:29:45 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:29:45 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71874) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 16:29:47 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:29:50 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:29:55 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:29:58 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:30:00 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:30:05 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:30:10 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:30:15 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:30:20 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:30:23 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:30:24 user nova-compute[71874]: DEBUG nova.compute.manager [req-fcb1f7c2-0ed8-4903-9882-a465c1f12257 req-7a9e70d7-d081-4720-bb38-9d025eebe174 service nova] [instance: 34545689-e52e-428b-9106-550d3cd7536b] Received event network-changed-96ff73b8-4a94-433c-ab04-02d046ea5cfb {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:30:24 user nova-compute[71874]: DEBUG nova.compute.manager [req-fcb1f7c2-0ed8-4903-9882-a465c1f12257 req-7a9e70d7-d081-4720-bb38-9d025eebe174 service nova] [instance: 34545689-e52e-428b-9106-550d3cd7536b] Refreshing instance network info cache due to event network-changed-96ff73b8-4a94-433c-ab04-02d046ea5cfb. {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 16:30:24 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-fcb1f7c2-0ed8-4903-9882-a465c1f12257 req-7a9e70d7-d081-4720-bb38-9d025eebe174 service nova] Acquiring lock "refresh_cache-34545689-e52e-428b-9106-550d3cd7536b" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:30:24 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-fcb1f7c2-0ed8-4903-9882-a465c1f12257 req-7a9e70d7-d081-4720-bb38-9d025eebe174 service nova] Acquired lock "refresh_cache-34545689-e52e-428b-9106-550d3cd7536b" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:30:24 user nova-compute[71874]: DEBUG nova.network.neutron [req-fcb1f7c2-0ed8-4903-9882-a465c1f12257 req-7a9e70d7-d081-4720-bb38-9d025eebe174 service nova] [instance: 34545689-e52e-428b-9106-550d3cd7536b] Refreshing network info cache for port 96ff73b8-4a94-433c-ab04-02d046ea5cfb {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 16:30:25 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:30:25 user nova-compute[71874]: DEBUG nova.network.neutron [req-fcb1f7c2-0ed8-4903-9882-a465c1f12257 req-7a9e70d7-d081-4720-bb38-9d025eebe174 service nova] [instance: 34545689-e52e-428b-9106-550d3cd7536b] Updated VIF entry in instance network info cache for port 96ff73b8-4a94-433c-ab04-02d046ea5cfb. {{(pid=71874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 16:30:25 user nova-compute[71874]: DEBUG nova.network.neutron [req-fcb1f7c2-0ed8-4903-9882-a465c1f12257 req-7a9e70d7-d081-4720-bb38-9d025eebe174 service nova] [instance: 34545689-e52e-428b-9106-550d3cd7536b] Updating instance_info_cache with network_info: [{"id": "96ff73b8-4a94-433c-ab04-02d046ea5cfb", "address": "fa:16:3e:bb:24:38", "network": {"id": "1439244b-8287-4bba-a88c-99d4b498cccd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1491302639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29b1b89a5eeb408a8d0938e5f59f405f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96ff73b8-4a", "ovs_interfaceid": "96ff73b8-4a94-433c-ab04-02d046ea5cfb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:30:25 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-fcb1f7c2-0ed8-4903-9882-a465c1f12257 req-7a9e70d7-d081-4720-bb38-9d025eebe174 service nova] Releasing lock "refresh_cache-34545689-e52e-428b-9106-550d3cd7536b" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:30:27 user nova-compute[71874]: DEBUG nova.compute.manager [req-880b9243-3ebe-4345-ab78-bdd1a69fbe9c req-676edbd8-7031-4194-b86c-d15e9e2fdc57 service nova] [instance: 34545689-e52e-428b-9106-550d3cd7536b] Received event network-changed-96ff73b8-4a94-433c-ab04-02d046ea5cfb {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:30:27 user nova-compute[71874]: DEBUG nova.compute.manager [req-880b9243-3ebe-4345-ab78-bdd1a69fbe9c req-676edbd8-7031-4194-b86c-d15e9e2fdc57 service nova] [instance: 34545689-e52e-428b-9106-550d3cd7536b] Refreshing instance network info cache due to event network-changed-96ff73b8-4a94-433c-ab04-02d046ea5cfb. {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 16:30:27 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-880b9243-3ebe-4345-ab78-bdd1a69fbe9c req-676edbd8-7031-4194-b86c-d15e9e2fdc57 service nova] Acquiring lock "refresh_cache-34545689-e52e-428b-9106-550d3cd7536b" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:30:27 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-880b9243-3ebe-4345-ab78-bdd1a69fbe9c req-676edbd8-7031-4194-b86c-d15e9e2fdc57 service nova] Acquired lock "refresh_cache-34545689-e52e-428b-9106-550d3cd7536b" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:30:27 user nova-compute[71874]: DEBUG nova.network.neutron [req-880b9243-3ebe-4345-ab78-bdd1a69fbe9c req-676edbd8-7031-4194-b86c-d15e9e2fdc57 service nova] [instance: 34545689-e52e-428b-9106-550d3cd7536b] Refreshing network info cache for port 96ff73b8-4a94-433c-ab04-02d046ea5cfb {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 16:30:27 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-2649d3f1-47d8-45bd-af40-01d660de4046 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "34545689-e52e-428b-9106-550d3cd7536b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:30:27 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-2649d3f1-47d8-45bd-af40-01d660de4046 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "34545689-e52e-428b-9106-550d3cd7536b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:30:27 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-2649d3f1-47d8-45bd-af40-01d660de4046 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "34545689-e52e-428b-9106-550d3cd7536b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:30:27 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-2649d3f1-47d8-45bd-af40-01d660de4046 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "34545689-e52e-428b-9106-550d3cd7536b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:30:27 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-2649d3f1-47d8-45bd-af40-01d660de4046 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "34545689-e52e-428b-9106-550d3cd7536b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:30:27 user nova-compute[71874]: INFO nova.compute.manager [None req-2649d3f1-47d8-45bd-af40-01d660de4046 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 34545689-e52e-428b-9106-550d3cd7536b] Terminating instance
Apr 12 16:30:27 user nova-compute[71874]: DEBUG nova.compute.manager [None req-2649d3f1-47d8-45bd-af40-01d660de4046 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 34545689-e52e-428b-9106-550d3cd7536b] Start destroying the instance on the hypervisor. {{(pid=71874) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 16:30:27 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:30:27 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:30:27 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:30:27 user nova-compute[71874]: DEBUG nova.compute.manager [req-218d89ae-279f-4869-91cd-7f31e60f442c req-1b8455ee-f534-48ba-9900-47d290275390 service nova] [instance: 34545689-e52e-428b-9106-550d3cd7536b] Received event network-vif-unplugged-96ff73b8-4a94-433c-ab04-02d046ea5cfb {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:30:27 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-218d89ae-279f-4869-91cd-7f31e60f442c req-1b8455ee-f534-48ba-9900-47d290275390 service nova] Acquiring lock "34545689-e52e-428b-9106-550d3cd7536b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:30:27 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-218d89ae-279f-4869-91cd-7f31e60f442c req-1b8455ee-f534-48ba-9900-47d290275390 service nova] Lock "34545689-e52e-428b-9106-550d3cd7536b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:30:27 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-218d89ae-279f-4869-91cd-7f31e60f442c req-1b8455ee-f534-48ba-9900-47d290275390 service nova] Lock "34545689-e52e-428b-9106-550d3cd7536b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:30:27 user nova-compute[71874]: DEBUG nova.compute.manager [req-218d89ae-279f-4869-91cd-7f31e60f442c req-1b8455ee-f534-48ba-9900-47d290275390 service nova] [instance: 34545689-e52e-428b-9106-550d3cd7536b] No waiting events found dispatching network-vif-unplugged-96ff73b8-4a94-433c-ab04-02d046ea5cfb {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:30:27 user nova-compute[71874]: DEBUG nova.compute.manager [req-218d89ae-279f-4869-91cd-7f31e60f442c req-1b8455ee-f534-48ba-9900-47d290275390 service nova] [instance: 34545689-e52e-428b-9106-550d3cd7536b] Received event network-vif-unplugged-96ff73b8-4a94-433c-ab04-02d046ea5cfb for instance with task_state deleting. {{(pid=71874) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 16:30:27 user nova-compute[71874]: DEBUG nova.network.neutron [req-880b9243-3ebe-4345-ab78-bdd1a69fbe9c req-676edbd8-7031-4194-b86c-d15e9e2fdc57 service nova] [instance: 34545689-e52e-428b-9106-550d3cd7536b] Updated VIF entry in instance network info cache for port 96ff73b8-4a94-433c-ab04-02d046ea5cfb. {{(pid=71874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 16:30:27 user nova-compute[71874]: DEBUG nova.network.neutron [req-880b9243-3ebe-4345-ab78-bdd1a69fbe9c req-676edbd8-7031-4194-b86c-d15e9e2fdc57 service nova] [instance: 34545689-e52e-428b-9106-550d3cd7536b] Updating instance_info_cache with network_info: [{"id": "96ff73b8-4a94-433c-ab04-02d046ea5cfb", "address": "fa:16:3e:bb:24:38", "network": {"id": "1439244b-8287-4bba-a88c-99d4b498cccd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1491302639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29b1b89a5eeb408a8d0938e5f59f405f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96ff73b8-4a", "ovs_interfaceid": "96ff73b8-4a94-433c-ab04-02d046ea5cfb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:30:27 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-880b9243-3ebe-4345-ab78-bdd1a69fbe9c req-676edbd8-7031-4194-b86c-d15e9e2fdc57 service nova] Releasing lock "refresh_cache-34545689-e52e-428b-9106-550d3cd7536b" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:30:28 user nova-compute[71874]: INFO nova.virt.libvirt.driver [-] [instance: 34545689-e52e-428b-9106-550d3cd7536b] Instance destroyed successfully.
Apr 12 16:30:28 user nova-compute[71874]: DEBUG nova.objects.instance [None req-2649d3f1-47d8-45bd-af40-01d660de4046 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lazy-loading 'resources' on Instance uuid 34545689-e52e-428b-9106-550d3cd7536b {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:30:28 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-2649d3f1-47d8-45bd-af40-01d660de4046 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T16:28:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-341342855',display_name='tempest-TestVolumeBootPattern-server-341342855',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-341342855',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGG/oSOmCDB20hkof5ViTlXYepxJsQ10bBtdYs7WKmIje03wdrGPlfe9DBPbPhAeMjSuszZPOH/w828DcGTtmLpZpE/aguNTugqw/I5GMmvTcJqr8fOGXLe6lzwKxF1ecQ==',key_name='tempest-TestVolumeBootPattern-2081417066',keypairs=<?>,launch_index=0,launched_at=2023-04-12T16:28:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='29b1b89a5eeb408a8d0938e5f59f405f',ramdisk_id='',reservation_id='r-02e17lh9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-734600841',owner_user_name='tempest-TestVolumeBootPattern-734600841-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T16:28:44Z,user_data=None,user_id='7054687447fc42339e9046ced4915890',uuid=34545689-e52e-428b-9106-550d3cd7536b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "96ff73b8-4a94-433c-ab04-02d046ea5cfb", "address": "fa:16:3e:bb:24:38", "network": {"id": "1439244b-8287-4bba-a88c-99d4b498cccd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1491302639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29b1b89a5eeb408a8d0938e5f59f405f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96ff73b8-4a", "ovs_interfaceid": "96ff73b8-4a94-433c-ab04-02d046ea5cfb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 16:30:28 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-2649d3f1-47d8-45bd-af40-01d660de4046 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Converting VIF {"id": "96ff73b8-4a94-433c-ab04-02d046ea5cfb", "address": "fa:16:3e:bb:24:38", "network": {"id": "1439244b-8287-4bba-a88c-99d4b498cccd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1491302639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29b1b89a5eeb408a8d0938e5f59f405f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96ff73b8-4a", "ovs_interfaceid": "96ff73b8-4a94-433c-ab04-02d046ea5cfb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:30:28 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-2649d3f1-47d8-45bd-af40-01d660de4046 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bb:24:38,bridge_name='br-int',has_traffic_filtering=True,id=96ff73b8-4a94-433c-ab04-02d046ea5cfb,network=Network(1439244b-8287-4bba-a88c-99d4b498cccd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96ff73b8-4a') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:30:28 user nova-compute[71874]: DEBUG os_vif [None req-2649d3f1-47d8-45bd-af40-01d660de4046 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bb:24:38,bridge_name='br-int',has_traffic_filtering=True,id=96ff73b8-4a94-433c-ab04-02d046ea5cfb,network=Network(1439244b-8287-4bba-a88c-99d4b498cccd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96ff73b8-4a') {{(pid=71874) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 16:30:28 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:30:28 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap96ff73b8-4a, bridge=br-int, if_exists=True) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:30:28 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:30:28 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:30:28 user nova-compute[71874]: INFO os_vif [None req-2649d3f1-47d8-45bd-af40-01d660de4046 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bb:24:38,bridge_name='br-int',has_traffic_filtering=True,id=96ff73b8-4a94-433c-ab04-02d046ea5cfb,network=Network(1439244b-8287-4bba-a88c-99d4b498cccd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96ff73b8-4a')
Apr 12 16:30:28 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2649d3f1-47d8-45bd-af40-01d660de4046 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 34545689-e52e-428b-9106-550d3cd7536b] calling os-brick to detach iSCSI Volume {{(pid=71874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 16:30:28 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-2649d3f1-47d8-45bd-af40-01d660de4046 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3c0216320>, {'target_iqn': 'iqn.2010-10.org.openstack:9ea46a74-c4ee-408e-ace3-887f94a0e939', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eYRWuvPE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:30:28 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-2649d3f1-47d8-45bd-af40-01d660de4046 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:30:28 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-2649d3f1-47d8-45bd-af40-01d660de4046 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:30:28 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-2649d3f1-47d8-45bd-af40-01d660de4046 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:30:28 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:30:28 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:30:28 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a9a2efe-1e88-4711-aa2a-f7714e180bba]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9ea46a74-c4ee-408e-ace3-887f94a0e939\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:30:28 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-2649d3f1-47d8-45bd-af40-01d660de4046 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 16:30:28 user nova-compute[71874]: No targets found.
Apr 12 16:30:28 user nova-compute[71874]: iSNS:
Apr 12 16:30:28 user nova-compute[71874]: No targets found.
Apr 12 16:30:28 user nova-compute[71874]: STATIC:
Apr 12 16:30:28 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:9ea46a74-c4ee-408e-ace3-887f94a0e939
Apr 12 16:30:28 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:30:28 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:30:28 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909
Apr 12 16:30:28 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:30:28 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:30:28 user nova-compute[71874]: FIRMWARE:
Apr 12 16:30:28 user nova-compute[71874]: No targets found.
Apr 12 16:30:28 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:30:28 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-2649d3f1-47d8-45bd-af40-01d660de4046 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 16:30:28 user nova-compute[71874]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 16:30:28 user nova-compute[71874]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71874) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 16:30:28 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-2649d3f1-47d8-45bd-af40-01d660de4046 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9ea46a74-c4ee-408e-ace3-887f94a0e939', 0)] {{(pid=71874) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 16:30:28 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:30:28 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:30:28 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[f38ebe86-8eca-4b64-97e4-30766a570196]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9ea46a74-c4ee-408e-ace3-887f94a0e939\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:30:28 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:30:28 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:30:28 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[56ca7ab1-f81d-4ad9-8c38-1fa326de2177]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ea46a74-c4ee-408e-ace3-887f94a0e939 (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:30:28 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-2649d3f1-47d8-45bd-af40-01d660de4046 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909 (non-flash)
Apr 12 16:30:28 user nova-compute[71874]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ea46a74-c4ee-408e-ace3-887f94a0e939 (non-flash)
Apr 12 16:30:28 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:30:28 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-2649d3f1-47d8-45bd-af40-01d660de4046 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909 (non-flash)
Apr 12 16:30:28 user nova-compute[71874]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ea46a74-c4ee-408e-ace3-887f94a0e939 (non-flash)
Apr 12 16:30:28 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:30:28 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-2649d3f1-47d8-45bd-af40-01d660de4046 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc37d6813f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9ea46a74-c4ee-408e-ace3-887f94a0e939'): ({'sdc'}, set())}) {{(pid=71874) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 16:30:28 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-2649d3f1-47d8-45bd-af40-01d660de4046 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Removing single pathed devices sdc {{(pid=71874) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 16:30:28 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:30:28 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:30:28 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b10d4d0-0173-4859-8939-1369c1d636f2]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:30:28 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:30:28 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:30:28 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e7b2bff-c5bc-4f70-9df4-31755a6bcaa3]: (4, ('ok\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:30:28 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-2649d3f1-47d8-45bd-af40-01d660de4046 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Flushing IO for device /dev/sdc {{(pid=71874) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 16:30:28 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:30:28 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:30:28 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[498c3223-e219-45d9-b10c-9961aabe4c67]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:30:28 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-2649d3f1-47d8-45bd-af40-01d660de4046 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71874) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 16:30:28 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:30:28 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.052s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:30:28 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[b916d713-19b2-4f97-bf0f-5bade02ed358]: (4, ('1', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:30:28 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-2649d3f1-47d8-45bd-af40-01d660de4046 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71874) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 16:30:28 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-2649d3f1-47d8-45bd-af40-01d660de4046 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] SCSI volumes sdc have been removed. {{(pid=71874) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 16:30:28 user nova-compute[71874]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO93a4be02-18e9dfc3d0e5ebc2', '/dev/disk/by-id/scsi-23138653964666333', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_93a4be02') {{(pid=82384) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 12 16:30:28 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a2bf9df-01e7-43fa-ad20-4ae4dbce8bc3]: (4, None) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:30:28 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-2649d3f1-47d8-45bd-af40-01d660de4046 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9ea46a74-c4ee-408e-ace3-887f94a0e939')] {{(pid=71874) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 16:30:28 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ea46a74-c4ee-408e-ace3-887f94a0e939 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:30:28 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ea46a74-c4ee-408e-ace3-887f94a0e939 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:30:28 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[e470bc1d-b133-406c-8014-8cde2dfd4c0d]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:30:28 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-2649d3f1-47d8-45bd-af40-01d660de4046 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:30:28 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ea46a74-c4ee-408e-ace3-887f94a0e939 -p 172.16.0.220:3260 --logout {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:30:28 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ea46a74-c4ee-408e-ace3-887f94a0e939 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:30:28 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[922c23d7-37ff-4af6-9196-abdf82dd9ba6]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:9ea46a74-c4ee-408e-ace3-887f94a0e939, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:9ea46a74-c4ee-408e-ace3-887f94a0e939, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:30:28 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-2649d3f1-47d8-45bd-af40-01d660de4046 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:9ea46a74-c4ee-408e-ace3-887f94a0e939, portal: 172.16.0.220,3260]
Apr 12 16:30:28 user nova-compute[71874]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:9ea46a74-c4ee-408e-ace3-887f94a0e939, portal: 172.16.0.220,3260] successful.
Apr 12 16:30:28 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:30:28 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ea46a74-c4ee-408e-ace3-887f94a0e939 -p 172.16.0.220:3260 --op delete {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:30:28 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ea46a74-c4ee-408e-ace3-887f94a0e939 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:30:28 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d887007-78dd-47d5-ab90-ab8ff2769fb2]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:30:28 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-2649d3f1-47d8-45bd-af40-01d660de4046 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:30:28 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-2649d3f1-47d8-45bd-af40-01d660de4046 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:30:28 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-2649d3f1-47d8-45bd-af40-01d660de4046 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] <== disconnect_volume: return (309ms) None {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:30:28 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2649d3f1-47d8-45bd-af40-01d660de4046 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 34545689-e52e-428b-9106-550d3cd7536b] Disconnected iSCSI Volume {{(pid=71874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 16:30:28 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-2649d3f1-47d8-45bd-af40-01d660de4046 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 34545689-e52e-428b-9106-550d3cd7536b] Deleting instance files /opt/stack/data/nova/instances/34545689-e52e-428b-9106-550d3cd7536b_del
Apr 12 16:30:28 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-2649d3f1-47d8-45bd-af40-01d660de4046 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 34545689-e52e-428b-9106-550d3cd7536b] Deletion of /opt/stack/data/nova/instances/34545689-e52e-428b-9106-550d3cd7536b_del complete
Apr 12 16:30:28 user nova-compute[71874]: INFO nova.compute.manager [None req-2649d3f1-47d8-45bd-af40-01d660de4046 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 34545689-e52e-428b-9106-550d3cd7536b] Took 1.16 seconds to destroy the instance on the hypervisor.
Apr 12 16:30:28 user nova-compute[71874]: DEBUG oslo.service.loopingcall [None req-2649d3f1-47d8-45bd-af40-01d660de4046 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71874) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 16:30:28 user nova-compute[71874]: DEBUG nova.compute.manager [-] [instance: 34545689-e52e-428b-9106-550d3cd7536b] Deallocating network for instance {{(pid=71874) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 16:30:28 user nova-compute[71874]: DEBUG nova.network.neutron [-] [instance: 34545689-e52e-428b-9106-550d3cd7536b] deallocate_for_instance() {{(pid=71874) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 16:30:28 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:30:29 user nova-compute[71874]: DEBUG nova.network.neutron [-] [instance: 34545689-e52e-428b-9106-550d3cd7536b] Updating instance_info_cache with network_info: [] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:30:29 user nova-compute[71874]: INFO nova.compute.manager [-] [instance: 34545689-e52e-428b-9106-550d3cd7536b] Took 0.51 seconds to deallocate network for instance.
Apr 12 16:30:29 user nova-compute[71874]: DEBUG nova.compute.manager [req-b0421556-e2fb-494b-9e27-28a0eaedcc0f req-9d94cf4b-bccf-4cb2-babf-35f3a3cc7074 service nova] [instance: 34545689-e52e-428b-9106-550d3cd7536b] Received event network-vif-deleted-96ff73b8-4a94-433c-ab04-02d046ea5cfb {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:30:29 user nova-compute[71874]: DEBUG nova.compute.manager [req-bc8f9621-2d62-4eb7-b36e-55305bc02f10 req-fc995310-93dd-48e4-adbb-2b32432b850e service nova] [instance: 34545689-e52e-428b-9106-550d3cd7536b] Received event network-vif-plugged-96ff73b8-4a94-433c-ab04-02d046ea5cfb {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:30:29 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-bc8f9621-2d62-4eb7-b36e-55305bc02f10 req-fc995310-93dd-48e4-adbb-2b32432b850e service nova] Acquiring lock "34545689-e52e-428b-9106-550d3cd7536b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:30:29 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-bc8f9621-2d62-4eb7-b36e-55305bc02f10 req-fc995310-93dd-48e4-adbb-2b32432b850e service nova] Lock "34545689-e52e-428b-9106-550d3cd7536b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:30:29 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-bc8f9621-2d62-4eb7-b36e-55305bc02f10 req-fc995310-93dd-48e4-adbb-2b32432b850e service nova] Lock "34545689-e52e-428b-9106-550d3cd7536b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:30:29 user nova-compute[71874]: DEBUG nova.compute.manager [req-bc8f9621-2d62-4eb7-b36e-55305bc02f10 req-fc995310-93dd-48e4-adbb-2b32432b850e service nova] [instance: 34545689-e52e-428b-9106-550d3cd7536b] No waiting events found dispatching network-vif-plugged-96ff73b8-4a94-433c-ab04-02d046ea5cfb {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:30:29 user nova-compute[71874]: WARNING nova.compute.manager [req-bc8f9621-2d62-4eb7-b36e-55305bc02f10 req-fc995310-93dd-48e4-adbb-2b32432b850e service nova] [instance: 34545689-e52e-428b-9106-550d3cd7536b] Received unexpected event network-vif-plugged-96ff73b8-4a94-433c-ab04-02d046ea5cfb for instance with vm_state active and task_state deleting.
Apr 12 16:30:29 user nova-compute[71874]: INFO nova.compute.manager [None req-2649d3f1-47d8-45bd-af40-01d660de4046 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 34545689-e52e-428b-9106-550d3cd7536b] Took 0.80 seconds to detach 1 volumes for instance.
Apr 12 16:30:29 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-2649d3f1-47d8-45bd-af40-01d660de4046 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:30:29 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-2649d3f1-47d8-45bd-af40-01d660de4046 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:30:29 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-2649d3f1-47d8-45bd-af40-01d660de4046 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Inventory has not changed in ProviderTree for provider: 0e94b4c8-cd49-45e4-9133-d36eb4b2456b {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 16:30:30 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-2649d3f1-47d8-45bd-af40-01d660de4046 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Inventory has not changed for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 16:30:30 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-2649d3f1-47d8-45bd-af40-01d660de4046 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.152s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:30:30 user nova-compute[71874]: INFO nova.scheduler.client.report [None req-2649d3f1-47d8-45bd-af40-01d660de4046 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Deleted allocations for instance 34545689-e52e-428b-9106-550d3cd7536b
Apr 12 16:30:30 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-2649d3f1-47d8-45bd-af40-01d660de4046 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "34545689-e52e-428b-9106-550d3cd7536b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.809s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:30:32 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:30:32 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Cleaning up deleted instances {{(pid=71874) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 12 16:30:32 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] There are 0 instances to clean {{(pid=71874) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 12 16:30:33 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:30:37 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:30:38 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:30:39 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:30:39 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:30:39 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:30:39 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:30:39 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Auditing locally available compute resources for user (node: user) {{(pid=71874) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 16:30:39 user nova-compute[71874]: DEBUG nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 16:30:40 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:30:40 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:30:40 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Hypervisor/Node resource view: name=user free_ram=8763MB free_disk=25.939044952392578GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71874) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 16:30:40 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:30:40 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:30:40 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Instance 2c01f491-2979-40d7-b74e-f580009309c5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 16:30:40 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 16:30:40 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 16:30:40 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Inventory has not changed in ProviderTree for provider: 0e94b4c8-cd49-45e4-9133-d36eb4b2456b {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 16:30:40 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Inventory has not changed for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 16:30:40 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Compute_service record updated for user:user {{(pid=71874) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 16:30:40 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.153s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:30:41 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:30:42 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:30:43 user nova-compute[71874]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681317028.1116412, 34545689-e52e-428b-9106-550d3cd7536b => Stopped> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:30:43 user nova-compute[71874]: INFO nova.compute.manager [-] [instance: 34545689-e52e-428b-9106-550d3cd7536b] VM Stopped (Lifecycle Event)
Apr 12 16:30:43 user nova-compute[71874]: DEBUG nova.compute.manager [None req-00d492c7-44b6-4e36-b402-23d96709b4e0 None None] [instance: 34545689-e52e-428b-9106-550d3cd7536b] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:30:43 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:30:43 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:30:43 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71874) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 16:30:43 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71874) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 16:30:43 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71874) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 16:30:43 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:30:43 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:30:43 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:30:43 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Starting heal instance info cache {{(pid=71874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 16:30:43 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Didn't find any instances for network info cache update. {{(pid=71874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 12 16:30:43 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:30:43 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71874) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 12 16:30:45 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:30:47 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:30:47 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71874) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 16:30:48 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:30:48 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:30:53 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:30:53 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:30:53 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71874) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 16:30:53 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71874) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 16:30:53 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71874) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 16:30:53 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:30:58 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:31:03 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:31:03 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:31:03 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71874) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 16:31:03 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71874) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 16:31:03 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71874) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 16:31:03 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:31:08 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:31:13 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:31:16 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:31:18 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:31:23 user nova-compute[71874]: DEBUG nova.compute.manager [req-a48edd92-60b1-4c63-bdc7-8e497c84c6ae req-6daef12d-3bb7-4790-b782-8b58707dc4aa service nova] [instance: 2c01f491-2979-40d7-b74e-f580009309c5] Received event network-changed-88022433-f52e-45f9-80a5-b93ca88aa273 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:31:23 user nova-compute[71874]: DEBUG nova.compute.manager [req-a48edd92-60b1-4c63-bdc7-8e497c84c6ae req-6daef12d-3bb7-4790-b782-8b58707dc4aa service nova] [instance: 2c01f491-2979-40d7-b74e-f580009309c5] Refreshing instance network info cache due to event network-changed-88022433-f52e-45f9-80a5-b93ca88aa273. {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 16:31:23 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-a48edd92-60b1-4c63-bdc7-8e497c84c6ae req-6daef12d-3bb7-4790-b782-8b58707dc4aa service nova] Acquiring lock "refresh_cache-2c01f491-2979-40d7-b74e-f580009309c5" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 16:31:23 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-a48edd92-60b1-4c63-bdc7-8e497c84c6ae req-6daef12d-3bb7-4790-b782-8b58707dc4aa service nova] Acquired lock "refresh_cache-2c01f491-2979-40d7-b74e-f580009309c5" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 16:31:23 user nova-compute[71874]: DEBUG nova.network.neutron [req-a48edd92-60b1-4c63-bdc7-8e497c84c6ae req-6daef12d-3bb7-4790-b782-8b58707dc4aa service nova] [instance: 2c01f491-2979-40d7-b74e-f580009309c5] Refreshing network info cache for port 88022433-f52e-45f9-80a5-b93ca88aa273 {{(pid=71874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 16:31:23 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-06e69e2a-b3aa-45a3-b2b5-0ff4745c1473 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "2c01f491-2979-40d7-b74e-f580009309c5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:31:23 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-06e69e2a-b3aa-45a3-b2b5-0ff4745c1473 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "2c01f491-2979-40d7-b74e-f580009309c5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:31:23 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-06e69e2a-b3aa-45a3-b2b5-0ff4745c1473 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "2c01f491-2979-40d7-b74e-f580009309c5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:31:23 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-06e69e2a-b3aa-45a3-b2b5-0ff4745c1473 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "2c01f491-2979-40d7-b74e-f580009309c5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:31:23 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-06e69e2a-b3aa-45a3-b2b5-0ff4745c1473 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "2c01f491-2979-40d7-b74e-f580009309c5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:31:23 user nova-compute[71874]: INFO nova.compute.manager [None req-06e69e2a-b3aa-45a3-b2b5-0ff4745c1473 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 2c01f491-2979-40d7-b74e-f580009309c5] Terminating instance
Apr 12 16:31:23 user nova-compute[71874]: DEBUG nova.compute.manager [None req-06e69e2a-b3aa-45a3-b2b5-0ff4745c1473 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 2c01f491-2979-40d7-b74e-f580009309c5] Start destroying the instance on the hypervisor. {{(pid=71874) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 16:31:23 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:31:23 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:31:23 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:31:23 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:31:23 user nova-compute[71874]: DEBUG nova.network.neutron [req-a48edd92-60b1-4c63-bdc7-8e497c84c6ae req-6daef12d-3bb7-4790-b782-8b58707dc4aa service nova] [instance: 2c01f491-2979-40d7-b74e-f580009309c5] Updated VIF entry in instance network info cache for port 88022433-f52e-45f9-80a5-b93ca88aa273. {{(pid=71874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 16:31:23 user nova-compute[71874]: DEBUG nova.network.neutron [req-a48edd92-60b1-4c63-bdc7-8e497c84c6ae req-6daef12d-3bb7-4790-b782-8b58707dc4aa service nova] [instance: 2c01f491-2979-40d7-b74e-f580009309c5] Updating instance_info_cache with network_info: [{"id": "88022433-f52e-45f9-80a5-b93ca88aa273", "address": "fa:16:3e:8c:23:9e", "network": {"id": "1439244b-8287-4bba-a88c-99d4b498cccd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1491302639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29b1b89a5eeb408a8d0938e5f59f405f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88022433-f5", "ovs_interfaceid": "88022433-f52e-45f9-80a5-b93ca88aa273", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:31:23 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-a48edd92-60b1-4c63-bdc7-8e497c84c6ae req-6daef12d-3bb7-4790-b782-8b58707dc4aa service nova] Releasing lock "refresh_cache-2c01f491-2979-40d7-b74e-f580009309c5" {{(pid=71874) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 16:31:23 user nova-compute[71874]: INFO nova.virt.libvirt.driver [-] [instance: 2c01f491-2979-40d7-b74e-f580009309c5] Instance destroyed successfully.
Apr 12 16:31:23 user nova-compute[71874]: DEBUG nova.objects.instance [None req-06e69e2a-b3aa-45a3-b2b5-0ff4745c1473 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lazy-loading 'resources' on Instance uuid 2c01f491-2979-40d7-b74e-f580009309c5 {{(pid=71874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 16:31:23 user nova-compute[71874]: DEBUG nova.virt.libvirt.vif [None req-06e69e2a-b3aa-45a3-b2b5-0ff4745c1473 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T16:26:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1740870386',display_name='tempest-TestVolumeBootPattern-server-1740870386',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1740870386',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGG/oSOmCDB20hkof5ViTlXYepxJsQ10bBtdYs7WKmIje03wdrGPlfe9DBPbPhAeMjSuszZPOH/w828DcGTtmLpZpE/aguNTugqw/I5GMmvTcJqr8fOGXLe6lzwKxF1ecQ==',key_name='tempest-TestVolumeBootPattern-2081417066',keypairs=<?>,launch_index=0,launched_at=2023-04-12T16:26:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='29b1b89a5eeb408a8d0938e5f59f405f',ramdisk_id='',reservation_id='r-821u600j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-734600841',owner_user_name='tempest-TestVolumeBootPattern-734600841-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T16:26:45Z,user_data=None,user_id='7054687447fc42339e9046ced4915890',uuid=2c01f491-2979-40d7-b74e-f580009309c5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "88022433-f52e-45f9-80a5-b93ca88aa273", "address": "fa:16:3e:8c:23:9e", "network": {"id": "1439244b-8287-4bba-a88c-99d4b498cccd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1491302639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29b1b89a5eeb408a8d0938e5f59f405f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88022433-f5", "ovs_interfaceid": "88022433-f52e-45f9-80a5-b93ca88aa273", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 16:31:23 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-06e69e2a-b3aa-45a3-b2b5-0ff4745c1473 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Converting VIF {"id": "88022433-f52e-45f9-80a5-b93ca88aa273", "address": "fa:16:3e:8c:23:9e", "network": {"id": "1439244b-8287-4bba-a88c-99d4b498cccd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1491302639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29b1b89a5eeb408a8d0938e5f59f405f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88022433-f5", "ovs_interfaceid": "88022433-f52e-45f9-80a5-b93ca88aa273", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 16:31:23 user nova-compute[71874]: DEBUG nova.network.os_vif_util [None req-06e69e2a-b3aa-45a3-b2b5-0ff4745c1473 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8c:23:9e,bridge_name='br-int',has_traffic_filtering=True,id=88022433-f52e-45f9-80a5-b93ca88aa273,network=Network(1439244b-8287-4bba-a88c-99d4b498cccd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88022433-f5') {{(pid=71874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 16:31:23 user nova-compute[71874]: DEBUG os_vif [None req-06e69e2a-b3aa-45a3-b2b5-0ff4745c1473 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8c:23:9e,bridge_name='br-int',has_traffic_filtering=True,id=88022433-f52e-45f9-80a5-b93ca88aa273,network=Network(1439244b-8287-4bba-a88c-99d4b498cccd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88022433-f5') {{(pid=71874) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 16:31:23 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:31:23 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap88022433-f5, bridge=br-int, if_exists=True) {{(pid=71874) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 16:31:23 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:31:23 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:31:23 user nova-compute[71874]: INFO os_vif [None req-06e69e2a-b3aa-45a3-b2b5-0ff4745c1473 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8c:23:9e,bridge_name='br-int',has_traffic_filtering=True,id=88022433-f52e-45f9-80a5-b93ca88aa273,network=Network(1439244b-8287-4bba-a88c-99d4b498cccd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88022433-f5')
Apr 12 16:31:23 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-06e69e2a-b3aa-45a3-b2b5-0ff4745c1473 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 2c01f491-2979-40d7-b74e-f580009309c5] calling os-brick to detach iSCSI Volume {{(pid=71874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 16:31:23 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-06e69e2a-b3aa-45a3-b2b5-0ff4745c1473 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc3c0216320>, {'target_iqn': 'iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ChyEKuGP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 16:31:23 user nova-compute[71874]: WARNING os_brick.initiator.connectors.base [None req-06e69e2a-b3aa-45a3-b2b5-0ff4745c1473 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 16:31:23 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-06e69e2a-b3aa-45a3-b2b5-0ff4745c1473 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 16:31:23 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-06e69e2a-b3aa-45a3-b2b5-0ff4745c1473 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 16:31:23 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:31:23 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:31:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:31:24 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f857c76-4aab-4b56-aa05-2a4c29debdec]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:31:24 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-06e69e2a-b3aa-45a3-b2b5-0ff4745c1473 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 16:31:24 user nova-compute[71874]: No targets found.
Apr 12 16:31:24 user nova-compute[71874]: iSNS:
Apr 12 16:31:24 user nova-compute[71874]: No targets found.
Apr 12 16:31:24 user nova-compute[71874]: STATIC:
Apr 12 16:31:24 user nova-compute[71874]: Target: iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909
Apr 12 16:31:24 user nova-compute[71874]:         Portal: 172.16.0.220:3260,-1
Apr 12 16:31:24 user nova-compute[71874]:                 Iface Name: default
Apr 12 16:31:24 user nova-compute[71874]: FIRMWARE:
Apr 12 16:31:24 user nova-compute[71874]: No targets found.
Apr 12 16:31:24 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:31:24 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-06e69e2a-b3aa-45a3-b2b5-0ff4745c1473 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 16:31:24 user nova-compute[71874]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 16:31:24 user nova-compute[71874]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71874) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 16:31:24 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-06e69e2a-b3aa-45a3-b2b5-0ff4745c1473 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909', 0)] {{(pid=71874) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 16:31:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:31:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:31:24 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e16eaeb-850f-42e8-8f13-ccc388fa9635]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:31:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:31:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:31:24 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aee31a9-b950-4af8-8ecb-1172d1f2901f]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909 (non-flash)\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:31:24 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-06e69e2a-b3aa-45a3-b2b5-0ff4745c1473 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909 (non-flash)
Apr 12 16:31:24 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 16:31:24 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-06e69e2a-b3aa-45a3-b2b5-0ff4745c1473 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909 (non-flash)
Apr 12 16:31:24 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 16:31:24 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-06e69e2a-b3aa-45a3-b2b5-0ff4745c1473 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc37d61dcf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909'): ({'sdb'}, set())}) {{(pid=71874) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 16:31:24 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-06e69e2a-b3aa-45a3-b2b5-0ff4745c1473 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Removing single pathed devices sdb {{(pid=71874) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 16:31:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:31:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:31:24 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[59f54964-d87b-486c-9e6b-3b11ff895e71]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:31:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:31:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:31:24 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[c23e4d0b-5983-4c66-99c5-d2725374ac6f]: (4, ('ok\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:31:24 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-06e69e2a-b3aa-45a3-b2b5-0ff4745c1473 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Flushing IO for device /dev/sdb {{(pid=71874) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 16:31:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:31:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:31:24 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[706ccdc5-40c6-4205-b86c-f7d45dfff415]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:31:24 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-06e69e2a-b3aa-45a3-b2b5-0ff4745c1473 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71874) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 16:31:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:31:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:31:24 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[e197e00a-7719-4d4e-9360-6fe1f07d1e88]: (4, ('1', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:31:24 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-06e69e2a-b3aa-45a3-b2b5-0ff4745c1473 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71874) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 16:31:24 user nova-compute[71874]: DEBUG os_brick.initiator.linuxscsi [None req-06e69e2a-b3aa-45a3-b2b5-0ff4745c1473 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] SCSI volumes sdb have been removed. {{(pid=71874) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 16:31:24 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-06e69e2a-b3aa-45a3-b2b5-0ff4745c1473 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909')] {{(pid=71874) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 16:31:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:31:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:31:24 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[70fa2ef1-bb48-423d-baa6-bb38795f0ac9]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:31:24 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-06e69e2a-b3aa-45a3-b2b5-0ff4745c1473 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:31:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909 -p 172.16.0.220:3260 --logout {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:31:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:31:24 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[73d2a3dd-df6e-4201-80ba-9799d2470f93]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:31:24 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-06e69e2a-b3aa-45a3-b2b5-0ff4745c1473 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909, portal: 172.16.0.220,3260]
Apr 12 16:31:24 user nova-compute[71874]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909, portal: 172.16.0.220,3260] successful.
Apr 12 16:31:24 user nova-compute[71874]:  stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:31:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909 -p 172.16.0.220:3260 --op delete {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 16:31:24 user nova-compute[71874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ae18173-eee9-4607-b0a7-940d48146909 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=82384) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 16:31:24 user nova-compute[71874]: DEBUG oslo.privsep.daemon [-] privsep: reply[038ddafb-7363-4a0a-b583-411d69797107]: (4, ('', '')) {{(pid=82384) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 16:31:24 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-06e69e2a-b3aa-45a3-b2b5-0ff4745c1473 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71874) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 16:31:24 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.base [None req-06e69e2a-b3aa-45a3-b2b5-0ff4745c1473 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.295s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 16:31:24 user nova-compute[71874]: DEBUG os_brick.initiator.connectors.iscsi [None req-06e69e2a-b3aa-45a3-b2b5-0ff4745c1473 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] <== disconnect_volume: return (296ms) None {{(pid=71874) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 16:31:24 user nova-compute[71874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-06e69e2a-b3aa-45a3-b2b5-0ff4745c1473 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 2c01f491-2979-40d7-b74e-f580009309c5] Disconnected iSCSI Volume {{(pid=71874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 16:31:24 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-06e69e2a-b3aa-45a3-b2b5-0ff4745c1473 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 2c01f491-2979-40d7-b74e-f580009309c5] Deleting instance files /opt/stack/data/nova/instances/2c01f491-2979-40d7-b74e-f580009309c5_del
Apr 12 16:31:24 user nova-compute[71874]: INFO nova.virt.libvirt.driver [None req-06e69e2a-b3aa-45a3-b2b5-0ff4745c1473 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 2c01f491-2979-40d7-b74e-f580009309c5] Deletion of /opt/stack/data/nova/instances/2c01f491-2979-40d7-b74e-f580009309c5_del complete
Apr 12 16:31:24 user nova-compute[71874]: INFO nova.compute.manager [None req-06e69e2a-b3aa-45a3-b2b5-0ff4745c1473 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 2c01f491-2979-40d7-b74e-f580009309c5] Took 1.18 seconds to destroy the instance on the hypervisor.
Apr 12 16:31:24 user nova-compute[71874]: DEBUG oslo.service.loopingcall [None req-06e69e2a-b3aa-45a3-b2b5-0ff4745c1473 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71874) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 16:31:24 user nova-compute[71874]: DEBUG nova.compute.manager [-] [instance: 2c01f491-2979-40d7-b74e-f580009309c5] Deallocating network for instance {{(pid=71874) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 16:31:24 user nova-compute[71874]: DEBUG nova.network.neutron [-] [instance: 2c01f491-2979-40d7-b74e-f580009309c5] deallocate_for_instance() {{(pid=71874) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 16:31:24 user nova-compute[71874]: DEBUG nova.network.neutron [-] [instance: 2c01f491-2979-40d7-b74e-f580009309c5] Updating instance_info_cache with network_info: [] {{(pid=71874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 16:31:24 user nova-compute[71874]: INFO nova.compute.manager [-] [instance: 2c01f491-2979-40d7-b74e-f580009309c5] Took 0.52 seconds to deallocate network for instance.
Apr 12 16:31:24 user nova-compute[71874]: DEBUG nova.compute.manager [req-7fc549c9-73f9-4719-a2e9-111238fa580f req-d24d955c-7a6b-4b4e-832b-cef3aba5a0ee service nova] [instance: 2c01f491-2979-40d7-b74e-f580009309c5] Received event network-vif-deleted-88022433-f52e-45f9-80a5-b93ca88aa273 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:31:25 user nova-compute[71874]: DEBUG nova.compute.manager [req-1a838430-9e1e-4b52-87c0-7eec5912b9ff req-a392781c-f3a1-4601-895c-e0b7ac7cd563 service nova] [instance: 2c01f491-2979-40d7-b74e-f580009309c5] Received event network-vif-unplugged-88022433-f52e-45f9-80a5-b93ca88aa273 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:31:25 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-1a838430-9e1e-4b52-87c0-7eec5912b9ff req-a392781c-f3a1-4601-895c-e0b7ac7cd563 service nova] Acquiring lock "2c01f491-2979-40d7-b74e-f580009309c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:31:25 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-1a838430-9e1e-4b52-87c0-7eec5912b9ff req-a392781c-f3a1-4601-895c-e0b7ac7cd563 service nova] Lock "2c01f491-2979-40d7-b74e-f580009309c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:31:25 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-1a838430-9e1e-4b52-87c0-7eec5912b9ff req-a392781c-f3a1-4601-895c-e0b7ac7cd563 service nova] Lock "2c01f491-2979-40d7-b74e-f580009309c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:31:25 user nova-compute[71874]: DEBUG nova.compute.manager [req-1a838430-9e1e-4b52-87c0-7eec5912b9ff req-a392781c-f3a1-4601-895c-e0b7ac7cd563 service nova] [instance: 2c01f491-2979-40d7-b74e-f580009309c5] No waiting events found dispatching network-vif-unplugged-88022433-f52e-45f9-80a5-b93ca88aa273 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:31:25 user nova-compute[71874]: DEBUG nova.compute.manager [req-1a838430-9e1e-4b52-87c0-7eec5912b9ff req-a392781c-f3a1-4601-895c-e0b7ac7cd563 service nova] [instance: 2c01f491-2979-40d7-b74e-f580009309c5] Received event network-vif-unplugged-88022433-f52e-45f9-80a5-b93ca88aa273 for instance with task_state deleting. {{(pid=71874) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 16:31:25 user nova-compute[71874]: DEBUG nova.compute.manager [req-1a838430-9e1e-4b52-87c0-7eec5912b9ff req-a392781c-f3a1-4601-895c-e0b7ac7cd563 service nova] [instance: 2c01f491-2979-40d7-b74e-f580009309c5] Received event network-vif-plugged-88022433-f52e-45f9-80a5-b93ca88aa273 {{(pid=71874) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 16:31:25 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-1a838430-9e1e-4b52-87c0-7eec5912b9ff req-a392781c-f3a1-4601-895c-e0b7ac7cd563 service nova] Acquiring lock "2c01f491-2979-40d7-b74e-f580009309c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:31:25 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-1a838430-9e1e-4b52-87c0-7eec5912b9ff req-a392781c-f3a1-4601-895c-e0b7ac7cd563 service nova] Lock "2c01f491-2979-40d7-b74e-f580009309c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:31:25 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [req-1a838430-9e1e-4b52-87c0-7eec5912b9ff req-a392781c-f3a1-4601-895c-e0b7ac7cd563 service nova] Lock "2c01f491-2979-40d7-b74e-f580009309c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:31:25 user nova-compute[71874]: DEBUG nova.compute.manager [req-1a838430-9e1e-4b52-87c0-7eec5912b9ff req-a392781c-f3a1-4601-895c-e0b7ac7cd563 service nova] [instance: 2c01f491-2979-40d7-b74e-f580009309c5] No waiting events found dispatching network-vif-plugged-88022433-f52e-45f9-80a5-b93ca88aa273 {{(pid=71874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 16:31:25 user nova-compute[71874]: WARNING nova.compute.manager [req-1a838430-9e1e-4b52-87c0-7eec5912b9ff req-a392781c-f3a1-4601-895c-e0b7ac7cd563 service nova] [instance: 2c01f491-2979-40d7-b74e-f580009309c5] Received unexpected event network-vif-plugged-88022433-f52e-45f9-80a5-b93ca88aa273 for instance with vm_state active and task_state deleting.
Apr 12 16:31:25 user nova-compute[71874]: INFO nova.compute.manager [None req-06e69e2a-b3aa-45a3-b2b5-0ff4745c1473 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 2c01f491-2979-40d7-b74e-f580009309c5] Took 0.83 seconds to detach 1 volumes for instance.
Apr 12 16:31:25 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-06e69e2a-b3aa-45a3-b2b5-0ff4745c1473 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:31:25 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-06e69e2a-b3aa-45a3-b2b5-0ff4745c1473 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:31:25 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-06e69e2a-b3aa-45a3-b2b5-0ff4745c1473 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Refreshing inventories for resource provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b {{(pid=71874) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 12 16:31:26 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-06e69e2a-b3aa-45a3-b2b5-0ff4745c1473 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Updating ProviderTree inventory for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 12 16:31:26 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-06e69e2a-b3aa-45a3-b2b5-0ff4745c1473 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Updating inventory in ProviderTree for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 12 16:31:26 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-06e69e2a-b3aa-45a3-b2b5-0ff4745c1473 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Refreshing aggregate associations for resource provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b, aggregates: None {{(pid=71874) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 12 16:31:26 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-06e69e2a-b3aa-45a3-b2b5-0ff4745c1473 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Refreshing trait associations for resource provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b, traits: COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_ACCELERATORS,HW_CPU_X86_MMX,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE2,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_FDC,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE {{(pid=71874) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 12 16:31:26 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-06e69e2a-b3aa-45a3-b2b5-0ff4745c1473 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Inventory has not changed in ProviderTree for provider: 0e94b4c8-cd49-45e4-9133-d36eb4b2456b {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 16:31:26 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-06e69e2a-b3aa-45a3-b2b5-0ff4745c1473 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Inventory has not changed for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 16:31:26 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-06e69e2a-b3aa-45a3-b2b5-0ff4745c1473 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.484s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:31:26 user nova-compute[71874]: INFO nova.scheduler.client.report [None req-06e69e2a-b3aa-45a3-b2b5-0ff4745c1473 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Deleted allocations for instance 2c01f491-2979-40d7-b74e-f580009309c5
Apr 12 16:31:26 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-06e69e2a-b3aa-45a3-b2b5-0ff4745c1473 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "2c01f491-2979-40d7-b74e-f580009309c5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.257s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:31:28 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:31:33 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:31:38 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:31:38 user nova-compute[71874]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681317083.9395776, 2c01f491-2979-40d7-b74e-f580009309c5 => Stopped> {{(pid=71874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 16:31:38 user nova-compute[71874]: INFO nova.compute.manager [-] [instance: 2c01f491-2979-40d7-b74e-f580009309c5] VM Stopped (Lifecycle Event)
Apr 12 16:31:38 user nova-compute[71874]: DEBUG nova.compute.manager [None req-dd668db2-a81e-4e6b-9366-666135cc7f97 None None] [instance: 2c01f491-2979-40d7-b74e-f580009309c5] Checking state {{(pid=71874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 16:31:38 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:31:38 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:31:38 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71874) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 16:31:38 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71874) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 16:31:38 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71874) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 16:31:38 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:31:39 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:31:39 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:31:39 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:31:39 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:31:39 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Auditing locally available compute resources for user (node: user) {{(pid=71874) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 16:31:40 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:31:40 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:31:40 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Hypervisor/Node resource view: name=user free_ram=8870MB free_disk=25.938106536865234GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71874) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 16:31:40 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:31:40 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:31:40 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 16:31:40 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 16:31:40 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Inventory has not changed in ProviderTree for provider: 0e94b4c8-cd49-45e4-9133-d36eb4b2456b {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 16:31:40 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Inventory has not changed for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 16:31:40 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Compute_service record updated for user:user {{(pid=71874) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 16:31:40 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.155s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:31:42 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:31:43 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:31:43 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:31:43 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:31:44 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:31:44 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Starting heal instance info cache {{(pid=71874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 16:31:44 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Rebuilding the list of instances to heal {{(pid=71874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 16:31:44 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Didn't find any instances for network info cache update. {{(pid=71874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 12 16:31:45 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:31:47 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:31:47 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:31:47 user nova-compute[71874]: DEBUG nova.compute.manager [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71874) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 16:31:48 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:31:50 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:31:53 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:31:53 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:31:53 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71874) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 16:31:53 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71874) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 16:31:53 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71874) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 16:31:53 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:31:58 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:32:03 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:32:08 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:32:13 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:32:18 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:32:18 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:32:18 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=71874) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 16:32:18 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71874) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 16:32:19 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:32:19 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71874) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 16:32:19 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:32:21 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:32:24 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:32:29 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:32:34 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:32:38 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:32:39 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 16:32:39 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:32:39 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71874) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 16:32:39 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71874) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 16:32:39 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71874) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 16:32:39 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 16:32:39 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:32:39 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:32:39 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:32:39 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:32:39 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Auditing locally available compute resources for user (node: user) {{(pid=71874) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 16:32:40 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:32:40 user nova-compute[71874]: WARNING nova.virt.libvirt.driver [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 16:32:40 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Hypervisor/Node resource view: name=user free_ram=9004MB free_disk=25.936153411865234GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71874) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 16:32:40 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 16:32:40 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 16:32:40 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 16:32:40 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 16:32:40 user nova-compute[71874]: DEBUG nova.compute.provider_tree [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Inventory has not changed in ProviderTree for provider: 0e94b4c8-cd49-45e4-9133-d36eb4b2456b {{(pid=71874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 16:32:40 user nova-compute[71874]: DEBUG nova.scheduler.client.report [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Inventory has not changed for provider 0e94b4c8-cd49-45e4-9133-d36eb4b2456b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 16:32:40 user nova-compute[71874]: DEBUG nova.compute.resource_tracker [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Compute_service record updated for user:user {{(pid=71874) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 16:32:40 user nova-compute[71874]: DEBUG oslo_concurrency.lockutils [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.112s {{(pid=71874) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 16:32:43 user nova-compute[71874]: DEBUG oslo_service.periodic_task [None req-d8fa596d-7ae2-4934-a20d-2ffb970b5634 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71874) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 16:32:44 user nova-compute[71874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71874) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}